System

Abstract

To provide a system capable of efficiently performing travel planning to reservation and change of the plan on the day.SOLUTION: Provided is a system comprising: means for inputting preferences and wishes regarding a travel of a user; means for generating prompt sentences to instruct generation of an optimal travel plan on the basis of the inputted preferences and wishes of the user; means for generating a travel plan that matches the preferences and wishes of the user using the generated prompt sentences and a generative AI model; means for presenting the generated travel plan to the user; means for receiving the selection result for the presented travel plan from the user; means for reserving related services and facilities all at once on the basis of the travel plan selected by the user; and means for displaying the travel plan or schedule selected on the basis of the services and facilities reserved all at once.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] When planning a trip, it is time-consuming to research and book the weather, local cuisine, hotels, transportation, etc. In addition, there are times when you need to change your plans based on real-time information such as the weather and traffic conditions on the day, but it is not easy to obtain this information appropriately and change your plans flexibly. [Means for solving the problem]

[0005] This invention provides a means for specifying user preferences, a means for presenting travel plans that take weather and traffic congestion information into consideration, a means for making collective reservations for shops, hotels, bullet trains, rental cars, etc. based on the selected plan, a means for showing the schedule for the day, and a means for presenting different plan variations based on real-time information such as weather and traffic congestion, making it possible to efficiently carry out everything from planning a trip to making reservations and changing plans on the day. [Brief explanation of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment Example 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0007] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0010] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0014] [First embodiment]

[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0019] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0022] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0023] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0027] "Example 1"

[0028] The system of the present invention has a means for receiving user preferences through a user interface, such as allowing the user to specify travel destinations, preferred meals, types of accommodation, mode of transportation, etc.

[0029] "Example 2"

[0030] The system of the present invention also includes means for acquiring weather forecast information and traffic information. This information is taken into consideration when presenting a travel plan. For example, if rain is predicted, a plan recommending indoor tourist spots is presented. Furthermore, based on the traffic information, transportation methods and routes that avoid crowds are suggested.

[0031] "Example 3"

[0032] Furthermore, the system of the present invention has a means for making collective reservations for shops, hotels, bullet trains, rental cars, etc. based on the selected plan, which saves the user the trouble of making reservations for each service individually.

[0033] "Example 4"

[0034] The system of the present invention also has a means for displaying the schedule for the day, which allows the user to easily understand what to do on the day of travel.

[0035] "Example 5"

[0036] Furthermore, the system of the present invention has a means for presenting alternative plans based on real-time information such as weather and traffic congestion. This allows users to receive suggestions for changing their plans to accommodate unexpected changes in weather or traffic conditions. For example, if rain is predicted for the afternoon, a suggestion is made to change the afternoon sightseeing spot to an indoor facility.

[0037] The processing flow of each embodiment will be described below.

[0038] "Example 1"

[0039] Step 1: The user specifies the travel destination, preferred meals, type of accommodation, mode of transportation, etc. through the system's user interface.

[0040] Step 2: The system generates a travel plan based on the user's input, taking into account weather and traffic information.

[0041] Step 3: The system presents the generated itinerary to the user.

[0042] "Example 2"

[0043] Step 1: When the user selects a proposed travel plan, the system will make a bulk reservation for the shops, hotels, bullet trains, rental cars, etc. included in that plan.

[0044] Step 2: The system provides the reservation confirmation information to the user.

[0045] "Example 3"

[0046] Step 1: On the day of travel, the system shows the user the schedule for the day.

[0047] Step 2: The system will suggest alternative plans as needed based on real-time information such as weather and traffic congestion.

[0048] Step 3: Once the user selects a new plan, the system will make the necessary changes to the reservation.

[0049] Example 1

[0050] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0051] Conventional travel plan generation systems have difficulty automatically generating travel plans that reflect the user's preferences in detail. Furthermore, they do not adequately suggest changes to the plan that take into account real-time information such as weather and traffic congestion. Furthermore, there is a lack of technology that can generate prompts based on the user's preferences and generate travel plans using a generative AI model.

[0052] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0053] In this invention, the server includes means for generating a prompt sentence that instructs the creation of an optimal travel plan based on the user's preferences and wishes, and for generating a travel plan using a generative AI model, means for providing the generated travel plan to the user, and means for presenting alternative plans based on real-time information such as weather and traffic congestion. This makes it possible to automatically create a travel plan that matches the user's preferences and wishes, and also to suggest changes to the plan that take real-time information into consideration.

[0054] A "means for specifying user preferences" is a means for providing an interface for a user to input information such as travel destination, preferred meals, type of accommodation, and mode of transportation.

[0055] "Means for presenting travel plans that take into account weather and traffic information" refers to means for obtaining weather forecast information and traffic information and presenting optimal travel plans to users based on that information.

[0056] "A means of making a collective reservation for shops, accommodations, transportation, etc. based on a selected plan" means a means of making a collective reservation for related shops, accommodations, transportation, etc. based on a travel plan selected by the user.

[0057] The "means for showing the schedule for the day" is a means for showing the user the schedule and plans for the day of travel.

[0058] "Means for presenting alternative plans based on real-time information such as weather and traffic congestion" refers to means for presenting alternative travel plans to users based on weather and traffic information obtained in real time.

[0059] "Means for generating prompt sentences based on user preferences and generating travel plans using a generative AI model" refers to means for generating prompt sentences based on preference information input by a user, and inputting the prompt sentences into a generative AI model to generate travel plans.

[0060] "Means for providing a generated travel plan to a user" means means for providing a travel plan generated by a generative AI model to a user.

[0061] MODE FOR CARRYING OUT THE INVENTION

[0062] This invention is a system that automatically generates travel plans based on user preferences and proposes changes to the plans taking real-time information into account. The system receives user preferences through a user interface and generates an optimal travel plan using a generative AI model.

[0063] Hardware and software used

[0064] Hardware:

[0065] Server: Stores and processes data and runs generative AI models.

[0066] Device: The device (smartphone, tablet, PC, etc.) where the user enters information and views the generated itinerary.

[0067] software:

[0068] Database Management System: A system for storing user preferences and generated travel plans, such as MySQL or PostgreSQL.

[0069] Generative AI models: Models for generating travel plans based on user preferences, such as OpenAI's GPT-4.

[0070] Communication protocol: A protocol for sending and receiving data between a device and a server, such as an HTTP request.

[0071] Program processing

[0072] The server receives information entered by the user through their device, such as travel destinations, preferred meals, types of accommodation, and transportation methods. The received information is stored in a database. The server then generates prompt sentences based on the stored information and inputs them into the generative AI model.

[0073] The generative AI model generates a travel plan that matches the user's preferences based on the prompt text, and the generated travel plan is sent to the device via the server and provided to the user.

[0074] Specific examples

[0075] Suppose a user enters the following preferences:

[0076] Travel destination: Paris

[0077] Favorite food: French cuisine

[0078] Type of accommodation: Luxury hotel

[0079] Transportation: Plane

[0080] In this case, the server will input the following prompt into the generative AI model:

[0081] "The user wants to travel to Paris, enjoys French cuisine, stays in a luxury hotel, and travels by plane. Generate the optimal itinerary based on this."

[0082] Based on this prompt, the generative AI model might generate a travel plan like this:

[0083] Visit Paris's tourist attractions (Eiffel Tower, Louvre, etc.)

[0084] Dinner at a Michelin-starred French restaurant

[0085] Accommodation in a luxury hotel on the Champs-Élysées

[0086] Direct plane ticket to Paris

[0087] The generated travel plan is sent to the user's device via the server, where the user can check the plan. The server can also present different plans based on real-time information such as weather and traffic congestion.

[0088] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0089] Program processing flow

[0090] Step 1:

[0091] The user inputs their preferences through the device

[0092] Specific behavior:

[0093] The user inputs information such as travel destination, preferred meals, type of accommodation, and mode of transportation into the terminal's user interface.

[0094] input:

[0095] Travel destination (e.g. Paris)

[0096] Favorite food (e.g. French cuisine)

[0097] Type of accommodation (e.g. luxury hotel)

[0098] Transportation (e.g., airplane)

[0099] output:

[0100] User preference information is entered into the terminal.

[0101] Step 2:

[0102] The device sends the entered information to the server.

[0103] Specific behavior:

[0104] The device sends the information entered by the user to the server in JSON format using an HTTP request.

[0105] input:

[0106] User-entered preference information

[0107] output:

[0108] The data is sent to the server in JSON format.

[0109] Step 3:

[0110] The server stores the received information in a database

[0111] Specific behavior:

[0112] The server analyzes the JSON data received from the device and stores it in a database, for example, using a database management system such as MySQL or PostgreSQL.

[0113] input:

[0114] JSON data sent from the terminal

[0115] output:

[0116] A database stores user preference information.

[0117] Step 4:

[0118] The server generates a prompt based on the stored information.

[0119] Specific behavior:

[0120] The server retrieves the user's preferences from a database and generates prompts, which are textual inputs to the generative AI model.

[0121] input:

[0122] User preference information stored in a database

[0123] output:

[0124] Prompt statement (e.g., "The user wants to travel to Paris, enjoys French cuisine, stays in a luxury hotel, and travels by plane. Based on this, generate the optimal itinerary.")

[0125] Step 5:

[0126] The server inputs prompt sentences into the generative AI model and generates a travel plan.

[0127] Specific behavior:

[0128] The server inputs the prompt sentence into a generative AI model (e.g., OpenAI's GPT-4) to generate a travel plan. The generative AI model generates a travel plan that matches the user's preferences based on the prompt sentence.

[0129] input:

[0130] Prompt statement

[0131] output:

[0132] Generated itinerary (e.g., visit to Parisian attractions, dinner at a Michelin-starred French restaurant, accommodation at a luxury hotel, and direct flight tickets to Paris)

[0133] Step 6:

[0134] The server transmits the generated travel plan to the terminal.

[0135] Specific behavior:

[0136] The server sends the generated itinerary in JSON format to the device using an HTTP request.

[0137] input:

[0138] Generated itinerary

[0139] output:

[0140] The travel plan in JSON format is sent to the device.

[0141] Step 7:

[0142] The user checks the travel plan through the terminal.

[0143] Specific behavior:

[0144] The user can check the travel plan sent from the server through the terminal, and can request corrections or additions as needed after viewing the generated travel plan.

[0145] input:

[0146] Travel plans sent from the server

[0147] output:

[0148] Travel plans confirmed by the user

[0149] (Application example 1)

[0150] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0151] Conventional travel planning systems can present travel plans that take into account user preferences and real-time information, but they have the problem of not being able to suggest restaurants that take into account the user's dietary preferences and allergy information. They also lack the functionality to learn from the user's past ordering history and ratings to make more accurate suggestions. This often makes it difficult for users to find suitable restaurants during their trip.

[0152] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0153] In this invention, the server includes means for specifying user preferences, means for presenting a travel plan that takes weather and traffic congestion information into consideration, means for making collective reservations for facilities, accommodations, transportation, etc. based on the selected plan, means for showing the schedule for the day, means for presenting alternative plans based on real-time information such as weather and traffic congestion, means for receiving the user's food preferences and allergy information and suggesting optimal restaurants and menus based thereon, and means for learning the user's past ordering history and ratings to make more accurate suggestions, thereby enabling users to easily find restaurants that meet their preferences and allergies even while traveling.

[0154] A "means for specifying user preferences" is a means for providing an interface for a user to input their travel and dining preferences and requirements.

[0155] "Means for presenting travel plans that take into account weather and traffic information" refers to means for proposing optimal travel plans to users based on weather forecast information and traffic information.

[0156] "A means of reserving facilities, accommodations, transportation, etc. all at once based on the selected plan" means a means of reserving the necessary facilities, accommodations, and transportation all at once based on the travel plan selected by the user.

[0157] The "means for showing the plans for the day" is a means for displaying the schedule and plans for the user on the day of the trip.

[0158] "Means of presenting alternative plans based on real-time information such as weather and traffic congestion" refers to a means of suggesting alternative travel plans to users based on weather and traffic information obtained in real time.

[0159] "Means for receiving a user's food preferences and allergy information and suggesting the most suitable restaurant and menu based on that" refers to a means for having a user input information about their food preferences and allergies and then suggesting appropriate restaurants and menus based on that information.

[0160] "Means for learning from a user's past order history and ratings to make more accurate suggestions" refers to a means for analyzing a user's past order history and rating data and making more appropriate suggestions based on that.

[0161] To implement this invention, the following system configuration is required: The system includes means for specifying user preferences, means for presenting a travel plan that takes into account weather and traffic congestion information, means for making collective reservations for facilities, accommodations, transportation, etc. based on the selected plan, means for showing the schedule for the day, means for presenting different plan variations based on real-time information such as weather and traffic congestion, means for receiving the user's food preferences and allergy information and suggesting optimal restaurants and menus based on that information, and means for learning the user's past ordering history and ratings to make more accurate suggestions.

[0162] System Program

[0163] The system is implemented in Python using the machine learning library scikit-learn as its primary library. The user interface is provided as a smartphone application, which includes a form for entering user preferences and allergy information.

[0164] Processing Description

[0165] Hardware

[0166] Smartphone: Provides the user interface and receives user input.

[0167] Server: Processes and stores data.

[0168] software

[0169] Python: Used for data processing and implementing machine learning models.

[0170] scikit-learn: A machine learning library for learning user preferences and past order history to make suggestions.

[0171] Data processing and calculation

[0172] 1. Input of user preferences: Through a smartphone application, users input their travel destination, preferred meals, type of accommodation, mode of transportation, dietary preferences and allergy information.

[0173] 2. Data Vectorization: The input data is vectorized using TfidfVectorizer.

[0174] 3. Similarity calculation: The user preferences and restaurant menu information are vectorized and the cosine similarity is calculated.

[0175] 4. Suggestion generation: Suggest the most similar restaurants and menus to the user.

[0176] 5. Learning from past history: Learn from the user's past order history and ratings and reflect them in the next suggestion.

[0177] Specific examples

[0178] If a user specifies that they are a vegetarian and like Italian food, the system will suggest Restaurant A. The system also takes into account the user's past ordering history and ratings, improving the accuracy of the suggestions.

[0179] Prompt Sentence Examples

[0180] I'm a vegetarian and I love Italian food. I have a nut allergy. Can you recommend any restaurants?

[0181] In this way, it becomes possible to provide personalized travel plans and food delivery services based on user preferences.

[0182] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0183] Step 1:

[0184] Users launch a smartphone application and input their travel destination, preferred meals, type of accommodation, mode of transportation, dietary preferences, and allergy information. The input data is sent to the server. Examples of input data include "I'm a vegetarian and I like Italian food" and "I have a nut allergy."

[0185] Step 2:

[0186] The server analyzes the received user preference data and vectorizes it using TfidfVectorizer. By vectorizing the input data (user preferences), it can be treated as numerical data, which allows subsequent similarity calculations.

[0187] Step 3:

[0188] The server retrieves restaurant menu information from the database and similarly vectorizes it using TfidfVectorizer. By vectorizing the input data (restaurant menu information), it is converted into a format that can be compared with user preferences.

[0189] Step 4:

[0190] The server calculates the cosine similarity between the user's preference vector and the restaurant's menu vector. Using the input data (user's preference vector and restaurant's menu vector), the server calculates the similarity and identifies the restaurant with the highest similarity. This allows the server to select the restaurant that best suits the user's preferences.

[0191] Step 5:

[0192] Based on the calculation results, the server recommends the most suitable restaurant and menu to the user. It generates output data (information on the best restaurant and menu) and sends it to a smartphone application. The user can then check the recommendations through the application.

[0193] Step 6:

[0194] The user selects a restaurant and menu from the suggestions and confirms the order. The input data (user selection information) is sent to the server, and the order is processed.

[0195] Step 7:

[0196] The server stores the user's order history and ratings in a database and reflects them in the next recommendation. It learns from the input data (user's order history and ratings) and uses them to improve the accuracy of the next recommendation.

[0197] In this way, it is possible to provide personalized travel plans and food delivery services based on the user's preferences.

[0198] Example 2

[0199] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0200] Conventional travel planning systems have struggled to provide plans that fully consider user preferences and real-time weather and traffic information. There is also a demand for flexible plans that can quickly adapt to changes in weather and traffic conditions. Furthermore, there is a lack of systems that allow users to make reservations for facilities, accommodations, high-speed trains, rental cars, and more all at once. This has led to issues such as users spending a great deal of time and effort on trip planning, which can compromise the comfort of their trip.

[0201] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0202] In this invention, the server includes means for specifying user preferences, means for presenting a travel plan that takes weather and traffic information into consideration, means for making collective reservations for facilities, accommodations, high-speed trains, rental cars, etc. based on the selected plan, means for showing the schedule for the day, means for presenting different plan variations based on real-time information such as weather and traffic, means for acquiring weather forecast information, means for acquiring traffic information, means for analyzing the acquired weather forecast information and traffic information, means for generating a travel plan based on the analysis results, and means for presenting the generated travel plan to the user. This allows the user to easily obtain the optimal travel plan that takes real-time information into consideration and make the necessary reservations all at once.

[0203] A "means for specifying user preferences" is an interface through which a user can input personal preferences, such as travel destinations, dates, and activities of interest.

[0204] "Means for presenting travel plans that take weather and traffic information into consideration" is a function for generating and presenting optimal travel plans to users based on acquired weather forecast information and traffic information.

[0205] "A means of making bulk reservations for facilities, accommodations, high-speed trains, rental cars, etc. based on a selected plan" is a system that allows users to make all the necessary reservations in one go based on the travel plan they select.

[0206] "Means for showing the schedule for the day" is a function that provides users with detailed plans such as the schedule for the day of travel, places to visit, and means of transportation.

[0207] "A means of presenting different plans based on real-time information such as weather and traffic" is a function that generates and presents new travel plans based on real-time information if the weather or traffic conditions change during a trip.

[0208] The "means for acquiring weather forecast information" is a function for acquiring weather forecast information for a specified area from an external data source.

[0209] "Means for obtaining traffic information" refers to a function for obtaining traffic conditions and public transportation operation information for a specified area from external data sources.

[0210] The "means for analyzing the acquired weather forecast information and traffic information" is a function for analyzing the acquired weather forecast information and traffic information and identifying factors that affect travel plans.

[0211] The "means for generating a travel plan based on the analysis results" is a function for generating an optimal travel plan for the user based on the analysis results.

[0212] The "means for presenting the generated travel plan to the user" is a function for transmitting the generated travel plan to the user's terminal and presenting it to the user.

[0213] This invention is a system that provides users with optimal travel plans to enjoy a comfortable trip. This system includes: means for specifying user preferences; means for presenting travel plans that take weather and traffic information into consideration; means for making collective reservations for facilities, accommodations, high-speed trains, rental cars, etc. based on the selected plan; means for showing the schedule for the day; means for presenting alternative plans based on real-time information such as weather and traffic; means for acquiring weather forecast information; means for acquiring traffic information; means for analyzing the acquired weather forecast information and traffic information; means for generating a travel plan based on the analysis results; and means for presenting the generated travel plan to the user.

[0214] The server first provides a way for the user to specify their preferences: the user inputs personal preferences such as travel destinations, dates, and activities of interest. This information is sent from the user's device to the server.

[0215] Next, the server uses an external weather forecast data source (e.g., OpenWeatherMap API) to obtain weather forecast information for the specified area and stores it in a database for analysis.

[0216] Similarly, the server uses external traffic information data sources (e.g., Google (registered trademark) Maps API) to obtain traffic information. It obtains traffic conditions and public transport operation information for a specified area and stores them in a database for analysis.

[0217] The server analyzes the weather forecast and traffic information it has acquired, for example, prioritizing indoor tourist spots on days when rain is expected and considering transportation methods to avoid crowds.

[0218] Based on the analysis results, the server uses a travel plan generation method to generate an optimal travel plan for the user, for example, creating a plan to visit museums and art galleries on rainy days and suggesting routes using public transportation to avoid crowds.

[0219] The generated travel plan is sent from the server to the user's device and presented to the user. The user can review the presented plan and customize it as needed. For example, the user can make a request to change this tourist spot to another location.

[0220] As a concrete example, consider a user planning a trip to Tokyo. The user inputs the travel destination and itinerary, and the server retrieves weather and traffic information for Tokyo. Since the forecast predicts rain on the first day of the trip, the server prioritizes indoor tourist attractions (e.g., museums and art galleries) and suggests a route using public transportation. The generated itinerary is sent to the user's device, where the user can review it and customize it as needed.

[0221] An example prompt is, "Please create a travel plan for Tokyo. Rain is expected on the first day of the trip. Please also suggest transportation options and routes to avoid crowds."

[0222] In this way, the server, terminals, and users work together to create a system that provides optimal travel plans that take real-time information into account.

[0223] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0224] Step 1:

[0225] The user inputs personal preferences such as travel destination and itinerary, and activities of interest. The device sends this information to the server. The input data includes the destination (e.g., Tokyo), travel itinerary (e.g., 3 days), and activities of interest (e.g., museums, art galleries). The server receives this information and stores it in a database.

[0226] Step 2:

[0227] The server sends a request to an external weather forecast data source (e.g., a weather forecast API) to obtain weather forecast information. The input data includes a destination and date range specified by the user. The weather forecast API returns weather forecast information for the specified area and time period. The server stores the obtained weather forecast information in a database for analysis.

[0228] Step 3:

[0229] The server sends a request to an external traffic information data source (e.g., a traffic information API) to obtain traffic information. The input data includes the destination specified by the user. The traffic information API returns traffic conditions and public transportation operation information for the specified area. The server stores the obtained traffic information in a database for analysis.

[0230] Step 4:

[0231] The server analyzes the acquired weather forecast and traffic information. The input data includes weather forecast and traffic information. Based on this information, the server identifies factors that will affect the travel plan. For example, on days when rain is expected, the server may prioritize indoor tourist spots and consider transportation methods to avoid crowds. The analysis results are stored in a database for generating travel plans.

[0232] Step 5:

[0233] The server generates an optimal travel plan for the user based on the analysis results. The input data includes the analysis results and the user's preferences. Based on this information, the server creates a travel plan that includes tourist spots to visit, means of transportation, routes, etc. The generated travel plan is saved in a database.

[0234] Step 6:

[0235] The server sends the generated travel plan to the user's terminal and presents it to the user. The input data includes the generated travel plan. The user can review the presented plan and customize it as needed. For example, the user can make a request to change this tourist spot to another location in the presented plan. The server regenerates the plan based on the user's request and presents it to the user again.

[0236] In this way, the server, terminals, and users work together to create a system that provides optimal travel plans that take real-time information into consideration.

[0237] (Application example 2)

[0238] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0239] Conventional travel plan suggestion systems take weather forecasts and traffic information into account when presenting plans, but lack the functionality to suggest optimal delivery options that take weather and traffic conditions into account when users use food delivery services. As a result, users are at risk of delivery delays due to bad weather or traffic congestion. The present invention aims to solve this problem and provide users with the optimal delivery options.

[0240] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0241] In this invention, the server includes a means for specifying user preferences, a means for presenting a travel plan that takes into account weather and traffic congestion information, a means for making a collective reservation of facilities, accommodations, high-speed trains, rental vehicles, etc. based on the selected plan, a means for showing the schedule for the day, a means for presenting different plan patterns based on real-time information such as weather and traffic congestion, and a means for acquiring weather forecast information and traffic information and proposing the optimal delivery option, thereby enabling the user to use the optimal delivery option that takes into account weather and traffic conditions.

[0242] "Means for specifying user preferences" is a function that provides an interface for users to input or select their preferences or requests.

[0243] "A means of presenting travel plans that take into account weather and traffic information" is a function that suggests optimal travel plans to users based on weather forecast information and traffic information.

[0244] "A means of making reservations for facilities, accommodations, high-speed trains, rental vehicles, etc. all at once" is a function that allows users to make reservations for the necessary facilities and transportation means all at once based on the travel plan they select.

[0245] "Means for showing plans for the day" is a function that displays the user's schedule and plans for the day of travel.

[0246] "A means of presenting alternative plans based on real-time information such as weather and traffic congestion" is a function that suggests alternative travel plans to users based on weather and traffic information obtained in real time.

[0247] "Means of obtaining weather forecast information and traffic information and suggesting optimal delivery options" refers to a function that collects weather forecast information and traffic information and suggests optimal food delivery options to users based on that information.

[0248] A system for implementing this invention includes means for specifying user preferences, means for presenting a travel plan that takes into account weather and traffic congestion information, means for making collective reservations for facilities, accommodations, high-speed trains, rental vehicles, etc. based on the selected plan, means for showing the schedule for the day, means for presenting different plan patterns based on real-time information such as weather and traffic congestion, and means for obtaining weather forecast information and traffic information and proposing optimal delivery options.

[0249] The server provides an interface for users to specify their preferences. Through this interface, users can input or select their preferences and requests. The server then retrieves weather forecast information and traffic information, and based on that, suggests optimal travel plans for users. This is done using weather forecast APIs and traffic information APIs.

[0250] Based on the travel plan selected by the user, the server makes reservations for facilities, accommodations, high-speed trains, rental cars, etc. in one go, allowing the user to complete all necessary reservations with a single operation.

[0251] To show the schedule for the day, the server displays the user's schedule and plans for the day of travel, using the calendar API and notification functions.

[0252] In addition, the server will suggest alternative travel plans to users based on real-time information such as weather and traffic congestion, allowing users to adapt to unexpected weather changes and traffic jams.

[0253] In particular, the server uses weather forecast and traffic information APIs to collect information and suggest optimal delivery options. For example, if rain is forecast, restaurants with short delivery times will be prioritized, and if traffic congestion is expected, routes that avoid traffic congestion will be suggested.

[0254] As a concrete example, consider the case where the optimal delivery option is suggested taking into account weather forecast and traffic information when ordering food delivery in Tokyo. Below is an example of a prompt sentence to input to the generative AI model.

[0255] Example prompt sentence:

[0256] When ordering food delivery in Tokyo, consider weather and traffic forecasts to suggest the best delivery options. If rain is expected, prioritize restaurants with quick delivery times. If traffic congestion is expected, suggest routes that avoid congestion.

[0257] This way, users can enjoy the best delivery options taking into account weather and traffic conditions.

[0258] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0259] Step 1:

[0260] The server provides an interface for users to specify their preferences. Through this interface, users input their preferences and requests. The input data is sent to the server and stored as user profile information.

[0261] Step 2:

[0262] The server obtains weather forecast information and traffic information. Specifically, it uses the weather forecast API and traffic information API to collect weather forecast information and traffic information for the specified location. This information is stored on the server and used for subsequent processing.

[0263] Step 3:

[0264] The server proposes the optimal travel plan for the user based on the acquired weather and traffic information. If the weather forecast indicates rain, it will prioritize indoor tourist spots, and if the traffic information indicates congestion, it will suggest routes that avoid traffic jams. The proposed plan is sent to the user's device.

[0265] Step 4:

[0266] Based on the travel plan selected by the user, the server makes reservations for facilities, accommodations, high-speed trains, rental cars, etc. Reservation information is sent using the API of each service provider, and once the reservation is complete, confirmation information is sent to the user's device.

[0267] Step 5:

[0268] The server displays the user's schedule and plans for the day of the trip. Specifically, it uses the calendar API and notification function to display the plans for the day on the user's device, allowing the user to check their travel schedule.

[0269] Step 6:

[0270] The server proposes alternative travel plans to users based on real-time information such as weather and traffic congestion. Based on real-time weather forecasts and traffic information, the server generates the optimal alternative plan for the user and sends it to the user's device.

[0271] Step 7:

[0272] The server obtains weather forecast and traffic information and suggests optimal delivery options. It uses weather forecast and traffic information APIs to collect information, and if rain is expected, it prioritizes restaurants with short delivery times. If traffic congestion is expected, it suggests routes that avoid traffic congestion. The suggested delivery options are sent to the user's device.

[0273] Example 3

[0274] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0275] Conventional travel planning systems require users to make individual reservations for each service (shops, hotels, bullet trains, rental cars, etc.), which is time-consuming, and make it difficult to keep track of the day's schedule. Furthermore, they are unable to flexibly change plans based on real-time information such as weather and traffic congestion, which can detract from the user's travel experience. To solve these problems, a system is needed that allows users to easily select a travel plan and dynamically change the plan based on real-time information.

[0276] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0277] In this invention, the server includes means for specifying user preferences, means for presenting a travel plan that takes weather and traffic congestion information into consideration, means for making a bulk reservation for multiple services based on the selected plan, means for showing the schedule for the day, means for presenting different plan patterns based on real-time information such as weather and traffic congestion, means for dynamically changing the plan based on the real-time information, and means for notifying the user of the changed plan. This saves the user the trouble of making reservations for each service individually, allows the user to easily grasp the schedule for the day, and enables the user to flexibly change the plan based on the real-time information.

[0278] "Means for specifying user preferences" refers to a function that provides an interface for users to input their preferences and wishes when selecting a travel plan.

[0279] "Means for presenting travel plans that take into account weather and traffic information" is a function that generates and presents optimal travel plans to users based on weather forecast information and traffic information.

[0280] "A means of booking multiple services at once" is a function that allows users to book various services such as shops, hotels, bullet trains, and rental cars all at once based on the travel plan they select.

[0281] "Means for showing the schedule for the day" is a function that displays the schedule that the user needs to do on the day of the trip in a list format or the like.

[0282] "Means of presenting alternative plans based on real-time information" refers to a function that suggests alternative travel plans to users based on real-time information such as weather and traffic congestion.

[0283] The "means for dynamically changing plans based on real-time information" is a function that automatically changes an existing travel plan in accordance with acquired real-time information.

[0284] "Means for notifying the user of the changed plan" is a function for notifying the user of the changed travel plan.

[0285] The present invention relates to a system that allows a user to select a travel plan and dynamically change the plan based on real-time information. A specific embodiment of this system will be described below.

[0286] System configuration

[0287] Hardware

[0288] Server: High-performance server (e.g. Dell PowerEdge R740)

[0289] Device: Smartphone (e.g. iPhone (registered trademark) 13)

[0290] software

[0291] Database Management System: MySQL

[0292] API integration tool: Postman

[0293] Mobile Application: React Native

[0294] Weather information API: OpenWeatherMap

[0295] Traffic Information API: Google Maps API

[0296] Program processing

[0297] A means of specifying user preferences

[0298] A user selects a travel plan using the mobile application on the device. For example, the user selects a "Tokyo sightseeing plan" and enters details such as the travel dates and number of people.

[0299] A means of presenting travel plans that take weather and traffic information into account

[0300] The server retrieves data from weather and traffic information APIs and generates an optimal travel plan for the user. For example, if fine weather is expected, it will present a plan that includes many outdoor tourist spots.

[0301] A way to book multiple services at once

[0302] The server sends a request to each service's reservation API based on the plan selected by the user. For example, to a hotel reservation API, it sends information such as the date of stay and number of people to confirm the reservation. To a Shinkansen reservation API, it sends information such as the departure point, destination, and departure time to reserve a ticket.

[0303] A way to show the schedule for the day

[0304] The server generates a schedule for the day based on the user's travel plan and sends it to the device. The device then displays the schedule information received from the server to the user. For example, it displays a list of tourist spots to visit in the morning, lunch spots, and tourist spots to visit in the afternoon.

[0305] A means of presenting alternative plans based on real-time information

[0306] The server retrieves real-time data from weather and traffic information APIs and suggests alternative travel plans to users. For example, if rain is expected in the afternoon, it suggests changing outdoor tourist spots to indoor facilities.

[0307] A means to dynamically change plans based on real-time information

[0308] The server automatically modifies existing travel plans based on real-time information it receives, for example, suggesting alternative routes or destinations if traffic congestion occurs.

[0309] How will users be notified of the changed plan?

[0310] The server then sends the changed plan to the device, and the device notifies the user of the changed plan. For example, if the afternoon sightseeing spot is changed to an indoor facility, that information is displayed on the mobile application screen.

[0311] Specific examples

[0312] The user opens the mobile application, selects the "Tokyo Sightseeing Plan," and enters the travel dates as "December 1st to December 3rd, 2023." The server sends a request to the hotel reservation API for "December 1st to December 3rd, 2023, for 2 people" to confirm the reservation. The server sends a request to the Shinkansen reservation API for "Tokyo Station to Kyoto Station, departing December 1st, 2023 at 9:00 AM" to reserve the ticket. The server generates an itinerary such as "December 1st, 2023, 10:00 AM: Visit Tokyo Tower, 12:00 PM: Lunch in Ginza, 2:00 PM: Visit Sensoji Temple" and sends it to the device. The device displays "December 1st, 2023, 10:00 AM: Visit Tokyo Tower, 12:00 PM: Lunch in Ginza, 2:00 PM: Visit Sensoji Temple" on the mobile application screen. The server retrieves information from the weather information API that indicates "rain will start in the afternoon on December 1, 2023," and generates a proposal to change an afternoon visit to Sensoji Temple to "visit the Tokyo National Museum at 2 PM." The server sends the revised plan to the device, and the device displays "visit the Tokyo National Museum at 2 PM" on the mobile application screen.

[0313] Prompt Sentence Examples

[0314] "Please develop a system that can make reservations for shops, hotels, bullet trains, rental cars, etc. all at once based on the travel plan selected by the user. Please also include a function that shows the schedule for the day and a function that presents different plans based on real-time information such as weather and traffic congestion."

[0315] In this way, the present invention makes the user's travel experience smoother and can flexibly respond to real-time situations. The flow of the identification process in the third embodiment will be described with reference to FIG.

[0316] Step 1:

[0317] The user selects a travel plan.

[0318] Input: A user uses a mobile application on their device to enter details such as a travel plan (e.g., Tokyo sightseeing plan), travel dates (e.g., December 1st to December 3rd, 2023), and number of people (e.g., 2 people).

[0319] Data processing: The terminal formats the information entered by the user for transmission to the server.

[0320] Output: The formatted travel plan information is sent to the server.

[0321] Specific operation: The user selects "Tokyo Sightseeing Plan" on the mobile application screen, enters the travel dates and number of people, and presses the "Submit" button.

[0322] Step 2:

[0323] The server makes reservations for each service in bulk based on the selected plan.

[0324] Input: The server receives travel plan information sent by the user.

[0325] Data processing: The server generates appropriate requests to each service's reservation API. For example, a hotel reservation API generates a request including information such as the date of stay and number of people, and a Shinkansen reservation API generates a request including information such as the departure point, destination, and departure time.

[0326] Output: The reservation for each service is confirmed and the reservation confirmation information is returned to the server.

[0327] Specific operation: The server sends a request to the hotel reservation API for "December 1st to December 3rd, 2023, for 2 people" to confirm the reservation. It also sends a request to the Shinkansen reservation API for "Tokyo Station to Kyoto Station, departing December 1st, 2023 at 9:00 AM" to reserve the ticket.

[0328] Step 3:

[0329] The server generates a schedule for the day and sends it to the terminal.

[0330] Input: The server receives reservation confirmation information for each confirmed service.

[0331] Data processing: The server generates a schedule for the day based on the user's travel plan, such as a list of tourist spots to visit in the morning, lunch spots, and tourist spots in the afternoon.

[0332] Output: The generated schedule information for the day is sent to the terminal.

[0333] Specific operation: The server generates a schedule such as "December 1, 2023, 10:00 AM: Visit Tokyo Tower, 12:00 PM: Lunch in Ginza, 2:00 PM: Visit Sensoji Temple" and sends it to the terminal.

[0334] Step 4:

[0335] The terminal displays the schedule for the day to the user.

[0336] Input: The device receives the schedule information for the day from the server.

[0337] Data processing: The terminal formats the received schedule information for display to the user.

[0338] Output: The formatted appointment information is displayed on the mobile application screen.

[0339] Specific operation: The device displays the following on the mobile application screen: "December 1, 2023, 10:00 AM: Visit Tokyo Tower, 12:00 PM: Lunch in Ginza, 2:00 PM: Visit Sensoji Temple."

[0340] Step 5:

[0341] The server gets real-time information and changes the plan as needed.

[0342] Input: The server retrieves real-time data from weather and traffic APIs.

[0343] Data processing: The server evaluates the existing itinerary based on the acquired real-time information and generates suggested changes if necessary. For example, if rain is predicted for the afternoon, it will suggest changing outdoor tourist attractions to indoor facilities.

[0344] Output: The proposed changes are generated and sent to the terminal.

[0345] Specific operation: The server retrieves information from the weather information API that says "It will rain from the afternoon on December 1, 2023," and generates a proposal to change the afternoon visit to Sensoji Temple to "2:00 PM: Visit to Tokyo National Museum."

[0346] Step 6:

[0347] The server transmits the changed plan to the terminal, which displays it to the user.

[0348] Input: The changed plan information generated by the server is sent to the device.

[0349] Data processing: The device formats the received changed plan information for display to the user.

[0350] Output: The formatted modified plan information is displayed on the mobile application screen.

[0351] Specific behavior: The device displays "2:00 PM: Visit Tokyo National Museum" on the mobile application screen.

[0352] (Application example 3)

[0353] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0354] Conventional travel planning systems require users to make individual reservations for restaurants, hotels, bullet trains, rental cars, etc., and they also have the problem of making it difficult to manage schedules for the day or change plans based on real-time information such as weather and traffic congestion. Furthermore, they lack the functionality to simultaneously book food delivery from multiple restaurants, manage schedules for the day, and change delivery times and destinations depending on weather and traffic conditions. This reduces user convenience and makes it difficult to plan trips and meals efficiently.

[0355] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0356] In this invention, the server includes means for specifying user preferences, means for presenting travel plans that take weather and traffic information into consideration, means for making collective reservations for restaurants, hotels, bullet trains, rental cars, etc. based on the selected plan, means for showing the schedule for the day, means for presenting alternative plans based on real-time information such as weather and traffic, means for making collective reservations for food delivery from multiple restaurants, means for managing the schedule for the day, and means for changing delivery times and destinations according to weather and traffic conditions. This allows users to efficiently plan trips and meals and flexibly change plans based on real-time information.

[0357] "Means for specifying user preferences" is a function that provides an interface for users to input or select their preferences or wishes.

[0358] "Means of presenting travel plans that take into account weather and traffic information" is a function that suggests optimal travel plans to users based on weather forecast information and traffic information.

[0359] "A means of making bulk reservations for shops, hotels, bullet trains, rental cars, etc. based on a selected plan" refers to a function that allows users to make bulk reservations for related services based on the travel plan they select.

[0360] "Means for showing plans for the day" is a function that displays the plans and schedule that the user should follow on the day of the trip.

[0361] "A means of presenting alternative plans based on real-time information such as weather and traffic congestion" is a function that suggests alternative travel plans to users depending on changes in weather and traffic conditions.

[0362] "Means for reserving food delivery from multiple restaurants at once" is a function that allows users to reserve food delivery from multiple restaurants at once.

[0363] "Means for managing the day's schedule" is a function that manages and displays the user's schedule and plans for the day.

[0364] "Means for changing delivery times and destinations depending on weather and traffic conditions" refers to a function that adjusts food delivery times and destinations based on real-time weather and traffic information.

[0365] A system for implementing this invention includes means for specifying user preferences, means for presenting a travel plan that takes into account weather and traffic congestion information, means for making collective reservations for restaurants, hotels, bullet trains, rental cars, etc. based on the selected plan, means for showing the schedule for the day, means for presenting different plan patterns based on real-time information such as weather and traffic congestion, means for making collective reservations for food delivery from multiple restaurants, means for managing the schedule for the day, and means for changing delivery times and destinations depending on weather and traffic conditions.

[0366] 1. System Program

[0367] The system is implemented using Python. Specifically, it uses the Weather API and Traffic API to obtain weather and traffic information, and generates optimal plans based on user preferences and real-time information. It also has the ability to book food deliveries from multiple restaurants at once, manage the schedule for the day, and change delivery times and destinations as needed.

[0368] 2. Program Processing

[0369] The server uses the following hardware and software:

[0370] Hardware: Smartphone

[0371] Software: Python, Weather API, Traffic API

[0372] The server receives input from the user and obtains weather and traffic information. Based on this, it generates travel plans and food delivery plans that suit the user's preferences. The generated plans are displayed on the user's smartphone, allowing the user to review and select. Based on the selected plan, the server makes reservations for shops, hotels, bullet trains, rental cars, etc. all at once, managing the day's schedule. It also makes suggestions to change the plan as needed based on real-time weather and traffic information.

[0373] 3. Specific Examples

[0374] For example, consider a case where a user orders "pizza" from "Restaurant A" at 12:00 and "sushi" from "Restaurant B" at 13:00. If it is raining and traffic is heavy, the server will adjust the delivery time to 30 minutes and 15 minutes later, respectively. This information is notified to the user's smartphone in real time.

[0375] Example prompts to input to a generative AI model:

[0376] Build an application that allows users to book food delivery from multiple restaurants at once, manage their schedules for the day, and adjust delivery times and destinations depending on weather and traffic conditions. Using Python, implement a feature that uses the Weather and Traffic APIs to adjust delivery times if it's raining or traffic is heavy.

[0377] In this way, users can efficiently plan their trips and meals, and have the flexibility to change their plans based on real-time information.

[0378] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0379] Step 1:

[0380] The user uses the terminal to input their preferences and wishes.

[0381] Input: User preferences and wishes (e.g., travel destination, type of meal, budget, etc.)

[0382] Output: The user's preferences and wishes are sent to the server.

[0383] How it works: The user opens the smartphone application and inputs their preferences and wishes, such as travel destination, type of meal, budget, etc. This information is sent to the server.

[0384] Step 2:

[0385] The server retrieves weather and traffic information.

[0386] Input: User preferences, wishes, current location

[0387] Output: Weather and traffic information

[0388] Specific operation: The server uses the Weather API and Traffic API to obtain weather and traffic information based on the user's current location.

[0389] Step 3:

[0390] The server generates optimal travel plans and food delivery plans based on user preferences and real-time information.

[0391] Input: User preferences and wishes, weather information, traffic information

[0392] Output: Optimal travel plans or food delivery plans

[0393] Specific operation: The server takes into account the acquired weather and traffic information and generates travel plans and food delivery plans that suit the user's preferences. For example, if rain is expected, it will suggest indoor tourist spots.

[0394] Step 4:

[0395] The server transmits the generated plan to the user's terminal.

[0396] Input: The best travel plans or food delivery plans

[0397] Output: The plan as it appears on the user's device

[0398] Specific operation: The server sends the generated plan to the user's smartphone, and the user can review and select it.

[0399] Step 5:

[0400] Based on the plan selected by the user, the server makes reservations for shops, hotels, bullet trains, rental cars, etc. all at once.

[0401] Input: The plan selected by the user

[0402] Output: Reservation confirmation information

[0403] Specific operation: When the user selects a plan, the server makes reservations for shops, hotels, bullet trains, rental cars, etc. all at once and sends reservation confirmation information to the user.

[0404] Step 6:

[0405] The server manages the schedule for the day and displays it on the user's terminal.

[0406] Input: Reservation confirmation information, schedule for the day

[0407] Output: Today's schedule

[0408] Specific operation: The server creates a schedule for the day based on the reservation confirmation information and displays it on the user's smartphone.

[0409] Step 7:

[0410] The server will suggest changes to your plan as needed based on real-time weather and traffic information.

[0411] Input: Real-time weather and traffic information

[0412] Output: Change proposal

[0413] How it works: The server uses the Weather API and Traffic API to obtain real-time information and sends suggestions for changing the plan to the user's smartphone as needed. For example, if there is traffic congestion, it suggests delaying the delivery time.

[0414] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0415] "Example 1"

[0416] In one embodiment of the present invention, a system is provided that includes an emotion engine that recognizes a user's emotions. The system recognizes emotions from the user's facial expressions, tone of voice, text input, etc., and uses this information to generate a travel plan. For example, if the user expresses joy, the system captures this information and suggests activities, meals, accommodations, etc. that the user would like. Also, if the user expresses anxiety or confusion, the system captures this information and provides more detailed information and support.

[0417] "Example 2"

[0418] Another embodiment of the present invention provides a travel plan that takes into account the output of the emotion engine. Specifically, the system recognizes the user's emotion and adjusts the travel plan accordingly. For example, if the user expresses joy, the system suggests a more active plan. On the other hand, if the user expresses anxiety or confusion, the system suggests a more relaxed plan or a plan that provides more detailed information.

[0419] "Example 3"

[0420] Furthermore, another embodiment of the present invention provides a plan modification suggestion based on the output of the emotion engine. Specifically, the system recognizes the user's emotions in real time and suggests plan modifications based on the emotions. For example, if the user expresses stress or frustration during the trip, the system captures this information and suggests plan modifications. The suggestions may include activities, meals, accommodations, etc. that better match the user's current emotions.

[0421] The processing flow of each embodiment will be described below.

[0422] "Example 1"

[0423] Step 1: Recognize emotions from the user's facial expressions, tone of voice, text input, etc.

[0424] Step 2: Based on the recognized emotional information, suggest activities, meals, accommodations, etc. that the user may prefer.

[0425] Step 3: If the user expresses anxiety or confusion, provide more information or support.

[0426] "Example 2"

[0427] Step 1: Recognize the user's emotions.

[0428] Step 2: Adjust your travel plans according to the emotions you recognize.

[0429] Step 3: If the user is showing signs of happiness, suggest a more active plan.

[0430] Step 4: If the user expresses anxiety or confusion, suggest a more relaxed plan or one that provides more detailed information.

[0431] "Example 3"

[0432] Step 1: Recognize user emotions in real time.

[0433] Step 2: Suggest changes to the plan based on the emotions you identify.

[0434] Step 3: If the user expresses stress or dissatisfaction during their trip, capture that information and suggest changes to the plan.

[0435] Step 4: The suggestions will include activities, meals, accommodations, etc. that better match the user's current emotions.

[0436] Example 1

[0437] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0438] While conventional travel planning systems can take into account user preferences, weather, and traffic information, they have the problem of not being able to adjust plans to take the user's emotions into account. This makes it difficult to maximize the user's satisfaction during their trip. Furthermore, when changing plans based on real-time information, the system is unable to reflect the user's emotions.

[0439] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0440] In this invention, the server includes a means for specifying user preferences, a means for presenting a travel plan that takes into account weather and traffic congestion information, a means for making a collective reservation of facilities, accommodations, transportation, etc. based on the selected plan, a means for showing the schedule for the day, a means for presenting different plan patterns based on real-time information such as weather and traffic congestion, a means for recognizing the user's emotions, and a means for adjusting the travel plan based on the recognized emotions, thereby making it possible to provide an optimal travel plan that takes into account the user's emotions.

[0441] "Means for specifying user preferences" refers to means for providing an interface for users to input travel destinations, preferred meals, types of accommodation, means of transportation, etc.

[0442] The "means for presenting travel plans that take into account weather and traffic information" refers to a means for acquiring weather forecast information and traffic information, and generating and presenting an optimal travel plan based on that information.

[0443] "A means of making a collective reservation of facilities, accommodations, transportation, etc. based on a selected plan" means a means of making a collective reservation of related facilities, accommodations, transportation, etc. based on a travel plan selected by the user.

[0444] The "means for showing the schedule for the day" is a means for displaying the user's schedule and activities for the day of travel.

[0445] "A means for presenting alternative plans based on real-time information such as weather and traffic congestion" refers to a means for changing an existing travel plan and presenting an alternative plan based on weather and traffic information obtained in real time.

[0446] "Means for recognizing user emotions" refers to a means for analyzing and recognizing emotions from the user's facial expressions, tone of voice, text input, etc.

[0447] The "means for adjusting the travel plan based on the recognized emotions" is a means for adjusting the contents of the travel plan based on the results of the user's emotion analysis, thereby increasing user satisfaction.

[0448] The present invention is a system for providing a travel plan that takes into account the preferences and emotions of a user. A specific embodiment of this system will be described below.

[0449] First, the user uses a device to input information such as the travel destination, preferred meals, type of accommodation, and mode of transportation. The device can be a smartphone or a PC. The user then accesses a dedicated web form and enters the necessary information.

[0450] Next, the server receives the user's input and stores it in a database, typically a database management system such as MySQL. The server receives the information entered by the user in real time and stores it in the database.

[0451] The server then launches the emotion engine, which is software for analyzing the user's emotions and uses emotion recognition APIs such as those from Microsoft® Azure® Cognitive Services. The server sends the user's facial expressions, tone of voice, and text input to the emotion engine, which then analyzes their emotions.

[0452] The emotion engine analyzes the user's emotions and returns the results to the server, which then generates a travel plan based on that information. For example, if a user wants to travel to Hawaii, specifies that they like seafood, and expresses joy, the server will suggest popular seafood restaurants and activities in Hawaii.

[0453] The server then presents the generated travel plan to the user, who can then review the details of the proposed plan through their device. Specifically, the plan details are displayed to the user through a web page or application. The user can review the information and adjust the plan as needed.

[0454] As a concrete example, consider a case where a user wishes to take a trip to Hawaii and selects seafood as their preferred food. When the user smiles through the camera, the emotion engine recognizes that the user is expressing a happy emotion. Based on this information, the server suggests popular seafood restaurants and activities in Hawaii.

[0455] Example prompts to input to a generative AI model:

[0456] The user indicated that they would like to travel to Hawaii and that they like seafood. They smile, which is recognized as expressing the emotion of happiness. Use this information to suggest recommended seafood restaurants and activities in Hawaii.

[0457] In this way, the server provides the best travel plan based on the user's preferences and feelings.

[0458] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0459] Step 1:

[0460] User enters preferences

[0461] Using a terminal, the user inputs information such as travel destination, preferred meals, type of accommodation, and mode of transportation. The input information is then sent from the terminal to the server. Specifically, the user enters the information into a dedicated web form through a smartphone or PC browser and presses the send button. Examples of input data include "Destination: Hawaii," "Meals: Seafood," "Accommodation: Hotel," and "Mode of transportation: Rental car."

[0462] Step 2:

[0463] The server receives the user's input

[0464] The server receives the information entered by the user and saves it in a database. The input data is stored in a MySQL database on the server. Specifically, the server receives an HTTP request, extracts the user's input data from the request body, and executes an INSERT query to save it in the database. For example, data such as "Destination: Hawaii," "Meal: Seafood," "Accommodation: Hotel," and "Transportation: Rental Car" are saved.

[0465] Step 3:

[0466] The server starts the emotion engine

[0467] The server launches an emotion engine to analyze the user's emotions. The emotion engine is software for analyzing the user's facial expressions, tone of voice, text input, etc. Specifically, the server calls an emotion recognition API and sends the user's input data. For example, when using the emotion recognition API of Microsoft Azure Cognitive Services, authentication is performed using an API key, and the user's facial expression data and voice data are sent.

[0468] Step 4:

[0469] The server analyzes the user's emotions

[0470] The server receives the analysis results returned from the emotion engine. The analysis results include the user's emotional state (happiness, sadness, surprise, etc.). Specifically, the server analyzes the JSON format data returned from the emotion recognition API and extracts the user's emotional state. For example, data such as "Emotion: joy" may be returned.

[0471] Step 5:

[0472] The server generates the itinerary

[0473] The server generates an optimal travel plan based on the user's preferences and the results of emotion analysis. Specifically, it runs an algorithm that combines the user's input data with emotion data to create a travel plan. For example, if a user requests a trip to Hawaii, specifies that they like seafood, and expresses an emotion of joy, the server will suggest popular seafood restaurants and activities in Hawaii. The generated plan will include restaurant names, addresses, ratings, menu details, and more.

[0474] Step 6:

[0475] The server presents the generated plan to the user.

[0476] The server presents the generated travel plan to the user. Specifically, the server displays the plan details to the user through a web page or application. The user can then check the details of the proposed plan through their device. For example, a list of seafood restaurants in Hawaii and detailed information about activities may be displayed. The user can review the information and adjust the plan as necessary.

[0477] (Application example 1)

[0478] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0479] Conventional food delivery systems have the problem that they do not take into account the user's preferences and emotions when making suggestions, making it difficult for users to choose meals that satisfy them. In addition, they do not provide appropriate support when users are anxious or confused, which leads to a poor user experience.

[0480] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0481] In this invention, the server includes a means for specifying a user's preferences, a means for recognizing the user's emotions, a means for making optimal suggestions based on the recognized emotions, and a means for providing detailed information and support when the user is anxious or confused. This enables optimal food delivery suggestions that take the user's preferences and emotions into consideration, improving the user experience.

[0482] "Means for specifying user preferences" refers to an interface that allows users to input their preferred dishes, ingredients, allergy information, etc.

[0483] "A means of presenting travel plans that take into account weather and traffic information" is a function that suggests optimal travel plans to users based on weather forecast information and traffic information.

[0484] "A means of making bulk reservations for shops, accommodations, transportation, etc. based on a selected plan" refers to a function that allows users to make bulk reservations for related services based on the travel plan they select.

[0485] The "means for showing the schedule for the day" is a function for displaying the user's schedule for the day of travel.

[0486] "A means of presenting alternative plans based on real-time information such as weather and traffic congestion" is a function that suggests alternative plans to users based on weather and traffic information obtained in real time.

[0487] "Means for recognizing user emotions" refers to a system for analyzing emotions from a user's facial expressions, tone of voice, text input, etc.

[0488] "Means for making optimal suggestions based on recognized emotions" is a function that suggests dishes and services that the user is likely to enjoy based on the user's emotional data.

[0489] "Means to provide detailed information and support when users are anxious or confused" refers to a function that provides detailed information and customer support when users express feelings of anxiety or confusion.

[0490] A system for implementing the present invention includes means for specifying user preferences, means for recognizing the user's emotions, means for making optimal suggestions based on the recognized emotions, and means for providing detailed information and support when the user is anxious or confused.

[0491] 1. System Program

[0492] The system is implemented using the following hardware and software.

[0493] Hardware

[0494] Smartphone: Provides the user interface and camera functionality.

[0495] Server: Runs the data processing and proposal system.

[0496] software

[0497] OpenCV: An image processing library used to analyze the user's facial expressions.

[0498] Keras: A deep learning library used to run emotion recognition models.

[0499] TextBlob: A text analysis library used to analyze sentiment from user text input.

[0500] 2. Program processing explanation

[0501] A means of specifying user preferences

[0502] Users input their preferred dishes, ingredients, allergy information, etc. through a smartphone application, which allows the system to understand the user's basic preferences.

[0503] A means of recognizing user emotions

[0504] The smartphone camera captures the user's facial expression and performs face detection using OpenCV. The detected face area is input into the Keras emotion recognition model to analyze the user's emotion. If the user inputs text, TextBlob is used to analyze the emotion from the text.

[0505] A means of making optimal recommendations based on perceived emotions

[0506] Based on the recognized emotion data, the system suggests dishes and restaurants that the user is likely to enjoy. For example, if the user smiles, the system recognizes the emotion of "happiness" and suggests restaurants and dishes that the user might like.

[0507] A way to provide further information and support if users are worried or confused

[0508] If the user expresses anxiety or confusion, the system will provide detailed cooking information and customer support. For example, if the user types "I'm tired today," the system will recognize the negative emotion and suggest relaxing dishes and delivery services.

[0509] 3. Examples and prompts

[0510] Specific examples

[0511] When users smile into their smartphone camera, the app recognizes the emotion "happiness" and suggests restaurants and dishes the user might like.

[0512] When a user types "I'm tired today" in the text input, the app recognizes the "negative" emotion and suggests relaxing meals and delivery services.

[0513] Prompt Sentence Examples

[0514] When a user smiles into the smartphone camera, the app should recognize the emotion "happiness" and suggest restaurants and dishes that the user might like.

[0515]

[0516] If a user types "I'm tired today" in the text input, the app should recognize the "negative" emotion and suggest relaxing meals and delivery services.

[0517] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0518] Step 1:

[0519] Users launch the smartphone application and enter their preferred dishes, ingredients, allergy information, etc.

[0520] Input: User preferences and allergy information

[0521] Output: User preference data

[0522] What it does: A user enters information through the application's interface using text boxes and check boxes, and the data is sent to a server and stored as a user profile.

[0523] Step 2:

[0524] The user shows their facial expression to the smartphone camera.

[0525] Input: Camera image

[0526] Output: Face image data

[0527] Specific operation: The smartphone camera captures the user's face and acquires video data in real time. The acquired video data is then used to extract the face area using a face detection algorithm (OpenCV).

[0528] Step 3:

[0529] The server receives the facial image data and analyzes the user's emotions using an emotion recognition model (Keras).

[0530] Input: Face image data

[0531] Output: Emotion data

[0532] How it works: The extracted facial image data is converted to grayscale and fed into an emotion recognition model. The model analyzes the image data and identifies the user's emotions (happiness, sadness, surprise, etc.).

[0533] Step 4:

[0534] When a user inputs text, the server receives the text data and analyzes the sentiment using a text analysis library (TextBlob).

[0535] Input: Text data

[0536] Output: Emotion data

[0537] What it does: When a user enters text into a text box in an application, it is sent to a server, which uses TextBlob to analyze the sentiment of the text and classify it as positive, negative, or neutral.

[0538] Step 5:

[0539] The server will suggest the best dishes and restaurants based on the recognized emotional data and the user's preference data.

[0540] Input: Emotion data, user preference data

[0541] Output: Proposal data

[0542] How it works: The server compares the emotion data with the user's preference data to select dishes and restaurants that the user is likely to enjoy. The selected suggestions are then sent to the user's smartphone.

[0543] Step 6:

[0544] If the user expresses anxiety or confusion, the server will provide detailed information and customer support.

[0545] Input: Emotion data

[0546] Output: Support data

[0547] How it works: The server analyzes the user's emotional data and, if it determines that the user is anxious or confused, provides detailed recipe information and customer support contact information, allowing the user to use the service with peace of mind.

[0548] Example 2

[0549] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0550] Conventional travel planning systems do not adequately consider weather and traffic information when presenting plans, and do not adjust plans based on user emotions. Therefore, to increase user satisfaction, flexible planning that takes real-time information and user emotions into account is required.

[0551] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0552] In this invention, the server includes a means for specifying user preferences, a means for presenting a travel plan that takes into account weather and traffic congestion information, a means for making a collective reservation of facilities, accommodations, transportation, etc. based on the selected plan, a means for showing the schedule for the day, a means for presenting different plan patterns based on real-time information such as weather and traffic congestion, and a means for analyzing the user's emotions and adjusting the travel plan based on those emotions. This makes it possible to provide flexible and satisfying travel plans that take into account the user's preferences, real-time information, and even the user's emotions.

[0553] A "means for specifying user preferences" is an interface through which a user can input information such as travel destination, dates, and desired activities.

[0554] "Means for presenting travel plans that take into account weather and traffic information" is a function for generating and presenting optimal travel plans to users based on acquired weather forecast information and traffic information.

[0555] "A means of making bulk reservations for facilities, accommodations, transportation, etc. based on a selected plan" is a function that allows users to make bulk reservations for related facilities, accommodations, and transportation based on the travel plan selected by the user.

[0556] The "means for showing the plans for the day" is a function that allows the user to display the plans that they will carry out on the day of their trip and provide detailed information.

[0557] "A means of presenting alternative plans based on real-time information such as weather and traffic congestion" is a function that suggests alternative travel plans to users based on weather and traffic information obtained in real time.

[0558] "Means for analyzing the user's emotions and adjusting the travel plan based on those emotions" is a function that analyzes the user's facial expressions and voice and adjusts the travel plan based on those emotions.

[0559] The "means for acquiring weather forecast information" is a function for acquiring weather forecast data from a weather information providing service.

[0560] The "means for acquiring traffic information" is a function for acquiring traffic condition data from a traffic information service.

[0561] "Means for analyzing the user's facial expressions and voice" refers to a function for analyzing the user's facial expressions and voice data and identifying emotions.

[0562] MODE FOR CARRYING OUT THE INVENTION

[0563] The present invention provides a system that provides flexible and satisfying travel plans that take into account user preferences, real-time information, and even user emotions. Specific embodiments of this system are described below.

[0564] System configuration

[0565] The system includes a means for specifying user preferences, a means for presenting travel plans that take weather and traffic congestion information into consideration, a means for making reservations for facilities, accommodations, transportation, etc. all at once based on the selected plan, a means for showing the schedule for the day, a means for presenting different plan variations based on real-time information such as weather and traffic congestion, and a means for analyzing the user's emotions and adjusting the travel plan based on those emotions.

[0566] Hardware and software used

[0567] Server: A central processing unit for data acquisition, analysis, and plan generation.

[0568] Device: The device (e.g., smartphone, tablet) where you enter information and view your plan.

[0569] API: A weather information service for obtaining weather forecast information (e.g., the Japan Meteorological Agency's API), or a traffic information service for obtaining traffic information (e.g., Google Maps API).

[0570] Emotion engine: Software for analyzing a user's facial expressions and voice (e.g., Microsoft Azure Cognitive Services).

[0571] Program processing

[0572] 1. Accepting user input

[0573] Users input information such as travel destination, itinerary, and desired activities into the device, which then transmits this information to the server.

[0574] 2. Get weather forecast information

[0575] The server uses the weather information provider's API to obtain weather forecast information for the travel date specified by the user. For example, the server obtains weather information using a URL such as "https: / / api.weather.com / v3 / wx / forecast / daily / 5day?geocode=35.6895,139.6917&format=json&apiKey=YOUR_API_KEY".

[0576] 3. Get traffic information.

[0577] The server uses the API of the traffic information service to obtain traffic information to the destination specified by the user. For example, the server obtains traffic information using a URL such as "https: / / maps.googleapis.com / maps / api / directions / json?origin=Tokyo&destination=Kyoto&key=YOUR_API_KEY".

[0578] 4. Analyze user emotions with an emotion engine.

[0579] The device captures the user's facial expressions and voice using a camera and microphone and sends them to the emotion engine, which analyzes the user's emotions and sends the results to the server.

[0580] 5. Generate a travel plan.

[0581] The server generates an optimal travel plan based on the acquired weather forecast information, traffic information, and the results of user emotion analysis. For example, if rain is predicted, the server generates a plan that includes indoor sightseeing spots. If the user expresses joy, the server generates a plan that includes active activities.

[0582] 6. Present the generated travel plan to the user.

[0583] The server sends the generated travel plan to the device, which displays the plan to the user and provides detailed information and recommended routes. The user can review the presented plan and make corrections or additions as needed.

[0584] Specific examples

[0585] If it's going to rain on the day the user is planning to travel, the server will offer the following plan:

[0586] Visiting indoor art galleries and museums

[0587] Shopping at the mall

[0588] Indoor activities (e.g. bowling, karaoke)

[0589] It also suggests routes and travel methods to avoid congestion based on traffic information. For example, if major roads are congested, the server will recommend using public transport.

[0590] If the user is happy, the server suggests the following active plans:

[0591] Outdoor activities (e.g. hiking, cycling)

[0592] Amusement park visit

[0593] Watching sporting events

[0594] On the other hand, if the user expresses anxiety or confusion, the server suggests a more relaxed plan:

[0595] Visiting hot springs and spas

[0596] Relaxing at the cafe

[0597] Sightseeing on a guided tour

[0598] Prompt Sentence Examples

[0599] An example of a prompt to input to a generative AI model is as follows:

[0600] "If it's going to rain on the day a user is planning a trip, suggest itineraries that include indoor tourist attractions. Also, if major roads are congested, create itineraries that encourage people to use public transportation."

[0601]

[0602] "If the user is expressing joy, suggest an active itinerary. If the user is expressing anxiety or confusion, create a relaxing itinerary or one that provides detailed information."

[0603] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0604] Step 1:

[0605] The user inputs information such as the travel destination, itinerary, and desired activities into the terminal. The terminal then sends this information to the server. The input data includes the destination (e.g., Kyoto), itinerary (e.g., October 15, 2023), and desired activities (e.g., sightseeing). The server receives this data and proceeds to the next processing step.

[0606] Step 2:

[0607] The server uses the weather information service's API to obtain weather forecast information for the travel itinerary specified by the user. For example, the server obtains weather information using a URL such as "https: / / api.weather.com / v3 / wx / forecast / daily / 5day?geocode=35.6895,139.6917&format=json&apiKey=YOUR_API_KEY". The input data is the destination's latitude and longitude and travel date, and the output data is the weather forecast information for the specified travel date. The server saves the obtained weather forecast information and proceeds to the next processing step.

[0608] Step 3:

[0609] The server uses the API of the traffic information service to obtain traffic information to the destination specified by the user. For example, the server obtains traffic information using a URL such as "https: / / maps.googleapis.com / maps / api / directions / json?origin=Tokyo&destination=Kyoto&key=YOUR_API_KEY". The input data is the departure point and destination, and the output data is traffic information for the specified route. The server saves the obtained traffic information and proceeds to the next processing step.

[0610] Step 4:

[0611] The device captures the user's facial expressions and voice using a camera and microphone and sends them to the emotion engine. The emotion engine analyzes the user's emotions and sends the results to the server. The input data is the user's facial expressions and voice data, and the output data is the analyzed emotion information. The server saves the acquired emotion information and proceeds to the next processing step.

[0612] Step 5:

[0613] The server generates an optimal travel plan based on the acquired weather forecast information, traffic information, and the results of user emotion analysis. For example, if rain is predicted, the server generates a plan that includes indoor tourist attractions. If the user expresses joy, the server generates a plan that includes active activities. The input data are weather forecast information, traffic information, and emotion information, and the output data is the generated travel plan. The server saves the generated travel plan and proceeds to the next processing step.

[0614] Step 6:

[0615] The server sends the generated travel plan to the terminal. The terminal displays the plan to the user and provides detailed information and recommended routes. The input data is the generated travel plan, and the output data is the plan information displayed to the user. The user can review the presented plan and make corrections or additions as necessary.

[0616] (Application example 2)

[0617] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0618] Conventional travel plan suggestion systems consider weather forecasts and traffic information when presenting plans, but lack the flexibility to respond based on user emotions and real-time information.Furthermore, in food delivery, optimal suggestions are not made based on weather, traffic conditions, or user emotions, making it difficult to improve user satisfaction.

[0619] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0620] In this invention, the server includes a means for specifying a user's preferences, a means for presenting a travel plan that takes into account weather and traffic congestion information, a means for making a collective reservation of facilities, accommodations, transportation, vehicles, etc. based on the selected plan, a means for showing the schedule for the day, a means for presenting different plan patterns based on real-time information such as weather and traffic congestion, a means for acquiring weather forecast information and traffic information and proposing optimal delivery times and routes, and a means for recognizing the user's emotions and proposing meals according to the emotions. This enables flexible travel plan presentation and optimization of food delivery based on the user's emotions and real-time information.

[0621] A "means for specifying user preferences" is an interface or function that allows a user to input or select their preferences or wishes.

[0622] "A means of presenting travel plans that take into account weather and traffic information" is a function that suggests optimal travel plans to users based on weather forecast information and traffic information.

[0623] "A means of booking facilities, accommodations, transportation, vehicles, etc. all at once" is a function for booking related facilities and services all at once based on the selected travel plan.

[0624] The "means for showing plans for the day" is a function that allows the user to display the plans and schedule that the user will carry out on the day of the trip.

[0625] "A means of presenting alternative plans based on real-time information such as weather and traffic congestion" is a function that suggests alternative travel plans based on weather and traffic conditions obtained in real time.

[0626] "Means of obtaining weather forecast information and traffic information and proposing optimal delivery times and routes" is a function that collects weather forecast information and traffic information and, based on that, proposes optimal delivery times and routes to users.

[0627] "Means for recognizing the user's emotions and suggesting meals according to those emotions" is a function that analyzes the user's emotions and suggests the optimal meal according to those emotions.

[0628] A system for implementing this invention includes means for specifying user preferences, means for presenting a travel plan that takes weather and traffic congestion information into consideration, means for making collective reservations for facilities, accommodations, transportation, vehicles, etc. based on the selected plan, means for showing the schedule for the day, means for presenting different plan patterns based on real-time information such as weather and traffic congestion, means for acquiring weather forecast information and traffic information and proposing optimal delivery times and routes, and means for recognizing the user's emotions and proposing meals according to the emotions.

[0629] Program processing explanation

[0630] Hardware used

[0631] Smartphone

[0632] Software used

[0633] Python

[0634] Weather API (e.g. WeatherAPI)

[0635] Traffic API (e.g. TrafficAPI)

[0636] Data processing and calculation

[0637] The server first provides an interface for users to specify their preferences. The preference data entered by the user is sent to the server and stored. The server then uses the Weather API and Traffic API to obtain weather forecast information and traffic information. This allows the server to collect weather forecast information and traffic information for the specified location.

[0638] The server generates an optimal travel plan based on the collected weather forecast and traffic information and presents it to the user. Based on the plan selected by the user, the server makes a bulk reservation of related facilities and services (e.g., accommodation, transportation, vehicles, etc.).

[0639] In addition, the server provides an interface for showing the current day's schedule, displaying the user's plans and schedule for the day of travel. Based on real-time weather and traffic conditions, the server suggests alternative travel plans.

[0640] The server also suggests optimal delivery times and routes based on weather forecasts and traffic information. To recognize user emotions, it uses an emotion analysis algorithm to analyze emotions from user input. Based on the analysis results, the server suggests the optimal meal according to the emotion.

[0641] Specific examples

[0642] For example, if a user types, "I'm so happy today!", the server uses a sentiment analysis algorithm to recognize the user's emotion as "joy." The server then suggests, "You seem happy, so I recommend a special dessert."

[0643] Prompt Sentence Examples

[0644] location = 'Tokyo'

[0645] user_input = 'I'm so happy today!'

[0646] print(suggest_delivery_plan(location, user_input))

[0647] In this way, a smart food delivery and travel plan presentation system can be realized that combines weather forecast information, traffic information, and emotion recognition.

[0648] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0649] Step 1:

[0650] Specifying user preferences

[0651] Users input their preferences and wishes through a smartphone interface, which is then sent to a server and stored in a database.

[0652] Input: User preferences and wishes (e.g., types of food, travel destinations)

[0653] Output: User preference data stored on the server

[0654] Step 2:

[0655] Obtaining weather and traffic information

[0656] The server uses the Weather API and Traffic API to retrieve weather forecast and traffic information for the specified location.

[0657] Input: A specified location (e.g. Tokyo)

[0658] Output: Weather forecast and traffic information

[0659] Step 3:

[0660] Generate a travel plan

[0661] The server generates an optimal travel plan based on the acquired weather forecast and traffic information, as well as the user's preference data.

[0662] Input: Weather forecast information, traffic information, user preference data

[0663] Output: Optimal travel plan

[0664] Step 4:

[0665] Presenting your travel plan

[0666] The server presents the generated travel plans to the user, who then selects from the plans presented.

[0667] Input: Optimal travel plan

[0668] Output: The itinerary presented to the user

[0669] Step 5:

[0670] Making bulk reservations

[0671] Based on the travel plan selected by the user, the server makes a bulk reservation of related facilities and services (e.g., accommodation, transportation, vehicles, etc.).

[0672] Input: User selected travel plan

[0673] Output: Facilities and services booked together

[0674] Step 6:

[0675] Viewing today's schedule

[0676] The server provides an interface that displays the plans and schedule that the user will follow on the day of the trip.

[0677] Input: User selected travel plan

[0678] Output: Today's events and schedule

[0679] Step 7:

[0680] Plan changes suggested based on real-time information

[0681] The server suggests alternative travel plans based on real-time weather and traffic conditions.

[0682] Input: Real-time weather and traffic information

[0683] Output: Alternative travel plans

[0684] Step 8:

[0685] Delivery time and route suggestions

[0686] The server uses weather forecast and traffic information to suggest optimal delivery times and routes to users.

[0687] Input: Weather and traffic information

[0688] Output: Optimal delivery time and route

[0689] Step 9:

[0690] Emotion Recognition and Meal Suggestions

[0691] The server analyzes the user's emotions from their input and suggests the best meal based on that emotion.

[0692] Input: User emotional input (e.g., "I'm so happy today!")

[0693] Output: Emotion-based meal suggestions

[0694] For example, if a user types, "I'm so happy today!", the server will use an emotion analysis algorithm to recognize the user's emotion as "joy" and suggest, "You seem happy, so I recommend a special dessert."

[0695] Example 3

[0696] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0697] Conventional travel planning systems require users to make individual reservations for accommodations, transportation, vehicles, etc., and have the problem of making it difficult to change plans based on real-time information such as weather and traffic congestion. Furthermore, they are unable to suggest changes to plans based on the user's emotions, making it difficult to increase satisfaction during the trip.

[0698] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0699] In this invention, the server includes means for specifying user preferences, means for presenting a travel plan that takes weather and traffic congestion information into consideration, means for making a collective reservation for accommodations, transportation, vehicles, etc. based on the selected plan, means for showing the schedule for the day, means for presenting alternative plans based on real-time information such as weather and traffic congestion, and means for recognizing the user's emotions in real time and suggesting changes to the plan in accordance with the emotions. This saves the user the trouble of making individual reservations, enables flexible plan changes based on real-time information, and further increases satisfaction during the trip by receiving suggestions for plan changes in accordance with the user's emotions.

[0700] A "means for specifying user preferences" is a feature that provides an interface for users to input or select their travel preferences and wishes.

[0701] "Means for presenting travel plans that take into account weather and traffic information" refers to a function that obtains weather forecast information and traffic information, generates optimal travel plans based on that information, and presents them to the user.

[0702] "A means of making bulk reservations for accommodation, transportation, vehicles, etc. based on a selected plan" refers to a function that allows users to make bulk reservations for accommodation, transportation, vehicles, etc. based on a travel plan selected by the user.

[0703] The "means for showing the schedule for the day" is a function that generates the schedule and plans for the day based on the user's travel plan and displays them to the user.

[0704] "A means of presenting alternative plans based on real-time information such as weather and traffic congestion" refers to a function that reevaluates the current plan based on weather and traffic information obtained in real time, and generates and proposes an alternative plan to the user if necessary.

[0705] "Means of recognizing the user's emotions in real time and suggesting changes to the plan based on those emotions" refers to a function that uses sensors and cameras to recognize the user's emotions in real time and suggests optimal changes to the plan based on those emotions.

[0706] This invention is a system that allows users to select a travel plan and book accommodations, transportation, vehicles, etc. in one go based on that plan. It also has the ability to change the plan taking into account real-time information such as weather and traffic congestion, and to recognize the user's emotions in real time and suggest changes to the plan based on those emotions.

[0707] System configuration

[0708] Hardware

[0709] Server: A central processing unit for data processing and communication with various APIs.

[0710] Terminal: A device that a user operates (such as a smartphone or tablet).

[0711] Sensors and cameras: Devices for recognizing user emotions in real time.

[0712] software

[0713] Reservation management software: Software for managing reservations for accommodation, transportation, vehicles, etc. all in one place.

[0714] Weather Forecast API: An interface for obtaining weather information.

[0715] Traffic Information API: An interface for obtaining traffic conditions.

[0716] Emotion recognition software: Software used to analyze user emotions (e.g., Microsoft Azure's Emotion API).

[0717] Program processing

[0718] 1. The user selects a travel plan

[0719] The user opens the application on the device and selects one of the travel plans provided. The device then sends the information about the selected plan to the server.

[0720] 2. The server collects reservation information based on the selected plan.

[0721] The server collects the necessary reservation information (hotel, transportation, rental car, etc.) based on the plan selected by the user. The server checks the API endpoints of each service and prepares the data required for the reservation.

[0722] 3. The server makes a bulk reservation using the API of each service.

[0723] The server makes reservations in bulk using hotel booking API, transportation API, rental car booking API, etc. The server receives responses from each API and checks whether the reservations were successful.

[0724] 4. The server notifies the user of the reservation completion information.

[0725] The server generates information indicating that the reservation has been completed and notifies the user. The terminal displays a notification of the reservation completion to the user.

[0726] 5. The server generates the schedule for the day and sends it to the device.

[0727] The server generates a schedule for the day based on the user's travel plan and sends the generated schedule to the terminal.

[0728] 6. The device displays the user's schedule for the day.

[0729] The device displays the schedule for the day received from the server to the user, who then checks the displayed schedule.

[0730] 7. The server retrieves the real-time information and re-evaluates the plan.

[0731] The server retrieves real-time information from weather and traffic APIs, and reevaluates the user's plan based on the information retrieved.

[0732] 8. The server generates alternative plans as needed and proposes them to the user.

[0733] The server generates a different plan based on the results of the reevaluation and proposes the generated plan to the user.

[0734] 9. The device will recognize the user's emotions in real time.

[0735] The device uses built-in sensors and cameras to recognize the user's emotions in real time, and transmits the recognized emotion data to a server.

[0736] 10. The server suggests changes to the plan based on the emotion recognition results.

[0737] The server uses emotion recognition software to analyze the user's emotions, and based on the analysis results, the server suggests changes to the plan that are appropriate for the user's emotions.

[0738] 11. The user reviews the proposed plan and approves any changes as needed.

[0739] The user reviews the proposed plan displayed on the device and approves any changes if necessary. The device then sends the user's approval to the server and applies the new plan.

[0740] Examples and prompts

[0741] Specific examples

[0742] If the user selects "Tourism Plan A," the server will use the hotel reservation API to reserve accommodation and the Shinkansen reservation API to secure transportation.

[0743] On the day of the trip, the device will display, "You will check out of the hotel at 10:00 and plan to arrive at tourist spot B at 11:00."

[0744] If rain is forecast for the afternoon, the server will notify the user, "We suggest changing your afternoon sightseeing spot to indoor facility C."

[0745] If the user feels stressed during their trip, the server will notify them, "We suggest changing to a relaxing spa facility D."

[0746] Prompt Sentence Examples

[0747] "Please generate a program that makes hotel and Shinkansen reservations in one go for users who have selected sightseeing plan A."

[0748] "Generate a program that recognizes user emotions in real time and makes suggestions to change travel plans based on those emotions."

[0749] In this way, the system can improve user convenience and enhance satisfaction during travel. The flow of the identification process in the third embodiment will be described with reference to FIG.

[0750] Step 1:

[0751] The user opens the application on their device and selects one of the multiple travel plans available.

[0752] Input: The ID of the itinerary selected by the user.

[0753] Output: The ID of the selected plan is sent to the server.

[0754] Specific operation: The user selects "Tourist Plan A" and the terminal sends the plan ID to the server.

[0755] Step 2:

[0756] The server collects the necessary reservation information (hotel, transportation, rental car, etc.) based on the plan selected by the user.

[0757] Input: The ID of the selected plan.

[0758] Output: Data required for booking (accommodation list, transport options, etc.).

[0759] Specific operation: The server retrieves information on accommodation and transportation related to "Tourist Plan A" from the database.

[0760] Step 3:

[0761] The server makes a bulk reservation using the API of each service.

[0762] Input: Data required for booking (accommodation list, transportation options, etc.).

[0763] Output: Booking confirmation number for each service.

[0764] Specific operation: The server sends a reservation request to the hotel reservation API and receives a reservation confirmation number in response. It also sends requests to the Shinkansen reservation API and the rental car reservation API to complete the reservation for each service.

[0765] Step 4:

[0766] The server generates information indicating that the reservation has been completed and notifies the user.

[0767] Input: Reservation confirmation number for each service.

[0768] Output: A notification message confirming the reservation is complete.

[0769] Specific operation: The server generates a message saying "Reservation completed" and sends it to the terminal, which then displays this notification to the user.

[0770] Step 5:

[0771] The server generates a schedule for the day based on the user's travel plans.

[0772] Input: User's travel plan details.

[0773] Output: Today's schedule.

[0774] Specific operation: The server generates a schedule for the day, such as "Check out of the hotel at 10:00 and plan to arrive at tourist spot B at 11:00," and sends it to the terminal.

[0775] Step 6:

[0776] The terminal displays the schedule for the day received from the server to the user.

[0777] Input: Today's schedule.

[0778] Output: The current day's agenda as displayed to the user.

[0779] Specific operation: The device displays the schedule for the day to the user, and the user confirms it.

[0780] Step 7:

[0781] The server retrieves real-time information from weather and traffic APIs.

[0782] Input: Data requests from weather and traffic APIs.

[0783] Output: Real-time weather and traffic information.

[0784] Specific operation: The server obtains the forecast of "rain in the afternoon" from the weather API and obtains the current traffic conditions from the traffic information API.

[0785] Step 8:

[0786] The server reevaluates the user's plan based on the acquired real-time information and generates a different plan if necessary.

[0787] Input: Real-time weather and traffic information.

[0788] Output: A different pattern plan.

[0789] Specific operation: The server generates a plan to change the afternoon tourist destination to indoor facility C and sends a message to the user saying, "Rain is forecast for the afternoon. We suggest changing the afternoon tourist destination to indoor facility C."

[0790] Step 9:

[0791] The device uses built-in sensors and cameras to recognize the user's emotions in real time.

[0792] Input: User's facial expression data.

[0793] Output: Recognized emotion data.

[0794] How it works: The device uses a camera to capture the user's facial expressions and sends them to emotion recognition software. The recognized emotion data is then sent to the server.

[0795] Step 10:

[0796] The server uses emotion recognition software to analyze the user's emotions.

[0797] Input: Recognized emotion data.

[0798] Output: Suggested plan changes based on emotions.

[0799] Specific operation: The server uses emotion recognition software to analyze that the user is feeling stressed, and generates and sends a message to the user saying, "We suggest you change to a more relaxing spa facility D."

[0800] Step 11:

[0801] The user reviews the proposed plan displayed on the device and approves any changes if necessary.

[0802] Input: Proposed plan.

[0803] Output: User approval.

[0804] Specific operation: The user taps the "Approve changes to Spa Facility D" button, and the device sends the approval to the server. The server applies the new plan.

[0805] (Application example 3)

[0806] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0807] Conventional travel planning systems require users to make individual reservations for shops, accommodations, transportation, vehicles, etc., and it is difficult to change plans based on real-time information such as weather and traffic congestion. Additionally, they are unable to suggest changes to plans based on the user's emotions, which means they are unable to reduce stress and frustration during travel.

[0808] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes a means for specifying the user's preferences, a means for presenting a travel plan that takes into account weather and traffic congestion information, a means for making a collective reservation of shops, accommodations, transportation, vehicles, etc. based on the selected plan, a means for showing the schedule for the day, a means for presenting alternative plans based on real-time information such as weather and traffic congestion, and a means for recognizing the user's emotions in real time and suggesting changes to the plan based on those emotions. This saves the user the trouble of making individual reservations and enables them to receive optimal plan changes based on real-time information and emotions.

[0809] "Means for specifying user preferences" is a function that provides an interface for users to input or select their preferences or wishes.

[0810] "A means of presenting travel plans that take into account weather and traffic information" is a function that suggests optimal travel plans to users based on weather forecast information and traffic information.

[0811] "A means of making bulk reservations for shops, accommodations, transportation, vehicles, etc. based on a selected plan" refers to a function that allows users to make bulk reservations for related services according to the travel plan selected by the user.

[0812] "Means for showing plans for the day" is a function that displays the plans and schedule that the user needs to complete on the day of the trip.

[0813] "A means of presenting alternative plans based on real-time information such as weather and traffic congestion" is a function that suggests alternative travel plans to users based on weather and traffic information obtained in real time.

[0814] "Means of recognizing the user's emotions in real time and suggesting changes to the plan based on those emotions" refers to a function that analyzes the user's emotional state in real time and suggests appropriate changes to the plan based on the results.

[0815] A system for implementing this invention includes means for specifying user preferences, means for presenting a travel plan that takes into account weather and traffic congestion information, means for making collective reservations for shops, accommodations, transportation, vehicles, etc. based on the selected plan, means for showing the schedule for the day, means for presenting different plan variations based on real-time information such as weather and traffic congestion, and means for recognizing the user's emotions in real time and suggesting changes to the plan in accordance with those emotions.

[0816] System program generation

[0817] The server provides an interface for users to specify their preferences and stores the preferences and wishes entered by the user in a database. It then obtains weather forecast and traffic information and generates an optimal travel plan based on that information. It makes bulk reservations for related services (shops, accommodations, transportation, vehicles, etc.) based on the plan selected by the user. It also shows the user the schedule for the day and suggests alternative plans based on real-time weather and traffic information. It recognizes the user's emotions in real time and suggests changes to the plan based on those emotions.

[0818] Hardware and software used

[0819] The system uses user devices such as smartphones and tablets, servers, weather forecast APIs, traffic information APIs, and emotion recognition software (e.g., Microsoft Azure Cognitive Services).The database uses an SQL database to store user preferences and reservation information.

[0820] Data processing and calculation

[0821] The server receives the user's preference data and stores it in a database. It then uses weather and traffic APIs to obtain real-time information and generates a travel plan based on that. It uses emotion recognition software to analyze the user's emotions and suggests changes to the plan based on the results.

[0822] Specific examples

[0823] For example, if a user is using food delivery in Tokyo and it's raining and the user is feeling stressed, the system will suggest indoor restaurants and cafes where they can relax.

[0824] Example prompts to input to a generative AI model:

[0825] "A user is using food delivery in Tokyo. It's raining, and the user is feeling stressed. Based on this situation, what alternative plan should the system suggest?"

[0826] In this way, users can avoid the hassle of making individual reservations and receive optimal plan changes based on real-time information and emotions.

[0827] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0828] Step 1:

[0829] The user inputs their preferences using the terminal. The terminal provides an interface for the user to input their tastes and wishes, and sends the data they input to the server. The input data includes the type of meal, budget, and favorite dishes. The server stores the received data in a database.

[0830] Step 2:

[0831] The server obtains real-time weather and traffic information using the weather forecast API and traffic information API. The server analyzes the data obtained from the API to understand the current weather and traffic conditions. The input is data from the API, and the output is the analyzed weather and traffic information.

[0832] Step 3:

[0833] The server generates an optimal travel plan based on the user's preferences and real-time weather and traffic information. The server combines the user's preference data stored in the database with the analyzed weather and traffic information to create an optimal plan for the user. The input is the user's preference data and real-time information, and the output is the generated travel plan.

[0834] Step 4:

[0835] The user selects the generated travel plan using the terminal. The terminal displays the travel plan received from the server to the user and sends the plan selected by the user to the server. The input is the travel plan from the server and the output is the plan selected by the user.

[0836] Step 5:

[0837] The server makes reservations for shops, accommodations, transportation, vehicles, etc. in bulk based on the selected plan. The server uses the reservation API of each service to make the necessary reservations in bulk. The input is the plan selected by the user, and the output is confirmation that the reservation has been completed.

[0838] Step 6:

[0839] The server shows the user the schedule for the day. Based on the generated travel plan, the server sends the user's plans and schedule for the day to the terminal. The input is the generated travel plan, and the output is the schedule information for the day.

[0840] Step 7:

[0841] The server proposes an alternative plan based on real-time weather and traffic information. The server monitors changes in weather and traffic conditions and presents an alternative plan to the user as needed. The input is real-time information, and the output is an alternative plan.

[0842] Step 8:

[0843] The server uses emotion recognition software to recognize the user's emotions in real time. The server analyzes the user's facial and voice data to understand the user's emotional state. The input is the user's facial and voice data, and the output is the analyzed emotional information.

[0844] Step 9:

[0845] The server proposes plan changes according to the user's emotions. The server proposes plan changes appropriate for the user based on the analyzed emotional information. The input is the analyzed emotional information, and the output is a plan change proposal according to the emotion.

[0846] In this way, users can avoid the hassle of making individual reservations and receive optimal plan changes based on real-time information and emotions.

[0847] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0848] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0849] Another example of generative AI is Gemini (registered trademark) (Internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[0850] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0851] [Second embodiment]

[0852] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0853] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0854] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0855] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0856] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0857] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0858] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0859] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0860] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0861] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0862] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0863] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0864] "Example 1"

[0865] The system of the present invention has a means for receiving user preferences through a user interface, such as allowing the user to specify travel destinations, preferred meals, types of accommodation, mode of transportation, etc.

[0866] "Example 2"

[0867] The system of the present invention also includes means for acquiring weather forecast information and traffic information. This information is taken into consideration when presenting a travel plan. For example, if rain is predicted, a plan recommending indoor tourist spots is presented. Furthermore, based on the traffic information, transportation methods and routes that avoid crowds are suggested.

[0868] "Example 3"

[0869] Furthermore, the system of the present invention has a means for making collective reservations for shops, hotels, bullet trains, rental cars, etc. based on the selected plan, which saves the user the trouble of making reservations for each service individually.

[0870] "Example 4"

[0871] The system of the present invention also has a means for displaying the schedule for the day, which allows the user to easily understand what to do on the day of travel.

[0872] "Example 5"

[0873] Furthermore, the system of the present invention has a means for presenting alternative plans based on real-time information such as weather and traffic congestion. This allows users to receive suggestions for changing their plans to accommodate unexpected changes in weather or traffic conditions. For example, if rain is predicted for the afternoon, a suggestion is made to change the afternoon sightseeing spot to an indoor facility.

[0874] The processing flow of each embodiment will be described below.

[0875] "Example 1"

[0876] Step 1: The user specifies the travel destination, preferred meals, type of accommodation, mode of transportation, etc. through the system's user interface.

[0877] Step 2: The system generates a travel plan based on the user's input, taking into account weather and traffic information.

[0878] Step 3: The system presents the generated itinerary to the user.

[0879] "Example 2"

[0880] Step 1: When the user selects a proposed travel plan, the system will make a bulk reservation for the shops, hotels, bullet trains, rental cars, etc. included in that plan.

[0881] Step 2: The system provides the reservation confirmation information to the user.

[0882] "Example 3"

[0883] Step 1: On the day of travel, the system shows the user the schedule for the day.

[0884] Step 2: The system will suggest alternative plans as needed based on real-time information such as weather and traffic congestion.

[0885] Step 3: Once the user selects a new plan, the system will make the necessary changes to the reservation.

[0886] Example 1

[0887] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0888] Conventional travel plan generation systems have difficulty automatically generating travel plans that reflect the user's preferences in detail. Furthermore, they do not adequately suggest changes to the plan that take into account real-time information such as weather and traffic congestion. Furthermore, there is a lack of technology that can generate prompts based on the user's preferences and generate travel plans using a generative AI model.

[0889] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0890] In this invention, the server includes means for generating prompt sentences based on the user's preferences and generating a travel plan using a generative AI model, means for providing the generated travel plan to the user, and means for presenting alternative plans based on real-time information such as weather and traffic congestion. This enables the automatic generation of travel plans that reflect the user's preferences in detail, and also makes it possible to suggest changes to the plan that take real-time information into consideration.

[0891] A "means for specifying user preferences" is a means for providing an interface for a user to input information such as travel destination, preferred meals, type of accommodation, and mode of transportation.

[0892] "Means for presenting travel plans that take into account weather and traffic information" refers to means for obtaining weather forecast information and traffic information and presenting optimal travel plans to users based on that information.

[0893] "A means of making a collective reservation for shops, accommodations, transportation, etc. based on a selected plan" means a means of making a collective reservation for related shops, accommodations, transportation, etc. based on a travel plan selected by the user.

[0894] The "means for showing the schedule for the day" is a means for showing the user the schedule and plans for the day of travel.

[0895] "Means for presenting alternative plans based on real-time information such as weather and traffic congestion" refers to means for presenting alternative travel plans to users based on weather and traffic information obtained in real time.

[0896] "Means for generating prompt sentences based on user preferences and generating travel plans using a generative AI model" refers to means for generating prompt sentences based on preference information input by a user, and inputting the prompt sentences into a generative AI model to generate travel plans.

[0897] "Means for providing a generated travel plan to a user" means means for providing a travel plan generated by a generative AI model to a user.

[0898] MODE FOR CARRYING OUT THE INVENTION

[0899] This invention is a system that automatically generates travel plans based on user preferences and proposes changes to the plans taking real-time information into account. The system receives user preferences through a user interface and generates an optimal travel plan using a generative AI model.

[0900] Hardware and software used

[0901] Hardware:

[0902] Server: Stores and processes data and runs generative AI models.

[0903] Device: The device (smartphone, tablet, PC, etc.) where the user enters information and views the generated itinerary.

[0904] software:

[0905] Database Management System: A system such as MySQL or PostgreSQL to store user preferences and generated itineraries.

[0906] Generative AI models: Models for generating travel plans based on user preferences, such as OpenAI's GPT-4.

[0907] Communication protocol: A protocol for sending and receiving data between a device and a server, such as an HTTP request.

[0908] Program processing

[0909] The server receives information entered by the user through their device, such as travel destinations, preferred meals, types of accommodation, and transportation methods. The received information is stored in a database. The server then generates prompt sentences based on the stored information and inputs them into the generative AI model.

[0910] The generative AI model generates a travel plan that matches the user's preferences based on the prompt text, and the generated travel plan is sent to the device via the server and provided to the user.

[0911] Specific examples

[0912] Suppose a user enters the following preferences:

[0913] Travel destination: Paris

[0914] Favorite food: French cuisine

[0915] Type of accommodation: Luxury hotel

[0916] Transportation: Plane

[0917] In this case, the server will input the following prompt into the generative AI model:

[0918] "The user wants to travel to Paris, enjoys French cuisine, stays in a luxury hotel, and travels by plane. Generate the optimal itinerary based on this."

[0919] Based on this prompt, the generative AI model might generate a travel plan like this:

[0920] Visit Paris's tourist attractions (Eiffel Tower, Louvre, etc.)

[0921] Dinner at a Michelin-starred French restaurant

[0922] Accommodation in a luxury hotel on the Champs-Élysées

[0923] Direct plane ticket to Paris

[0924] The generated travel plan is sent to the user's device via the server, where the user can check the plan. The server can also present different plans based on real-time information such as weather and traffic congestion.

[0925] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0926] Program processing flow

[0927] Step 1:

[0928] The user inputs their preferences through the device

[0929] Specific behavior:

[0930] The user inputs information such as travel destination, preferred meals, type of accommodation, and mode of transportation into the terminal's user interface.

[0931] input:

[0932] Travel destination (e.g. Paris)

[0933] Favorite food (e.g. French cuisine)

[0934] Type of accommodation (e.g. luxury hotel)

[0935] Transportation (e.g., airplane)

[0936] output:

[0937] User preference information is entered into the terminal.

[0938] Step 2:

[0939] The device sends the entered information to the server.

[0940] Specific behavior:

[0941] The device sends the information entered by the user to the server in JSON format using an HTTP request.

[0942] input:

[0943] User-entered preference information

[0944] output:

[0945] The data is sent to the server in JSON format.

[0946] Step 3:

[0947] The server stores the received information in a database

[0948] Specific behavior:

[0949] The server analyzes the JSON data received from the device and stores it in a database, for example, using a database management system such as MySQL or PostgreSQL.

[0950] input:

[0951] JSON data sent from the terminal

[0952] output:

[0953] A database stores user preference information.

[0954] Step 4:

[0955] The server generates a prompt based on the stored information.

[0956] Specific behavior:

[0957] The server retrieves the user's preferences from a database and generates prompts, which are textual inputs to the generative AI model.

[0958] input:

[0959] User preference information stored in a database

[0960] output:

[0961] Prompt statement (e.g., "The user wants to travel to Paris, enjoys French cuisine, stays in a luxury hotel, and travels by plane. Based on this, generate the optimal itinerary.")

[0962] Step 5:

[0963] The server inputs prompts into the generative AI model and generates a travel plan.

[0964] Specific behavior:

[0965] The server inputs the prompt sentence into a generative AI model (e.g., OpenAI's GPT-4) to generate a travel plan. The generative AI model generates a travel plan that matches the user's preferences based on the prompt sentence.

[0966] input:

[0967] Prompt statement

[0968] output:

[0969] Generated itinerary (e.g., visit to Parisian attractions, dinner at a Michelin-starred French restaurant, accommodation at a luxury hotel, and direct flight tickets to Paris)

[0970] Step 6:

[0971] The server sends the generated travel plan to the device.

[0972] Specific behavior:

[0973] The server sends the generated itinerary in JSON format to the device using an HTTP request.

[0974] input:

[0975] Generated itinerary

[0976] output:

[0977] The travel plan in JSON format is sent to the device.

[0978] Step 7:

[0979] The user checks the travel plan through the device

[0980] Specific behavior:

[0981] The user can check the travel plan sent from the server through the terminal, and can request corrections or additions as needed after viewing the generated travel plan.

[0982] input:

[0983] Travel plans sent from the server

[0984] output:

[0985] Travel plans confirmed by the user

[0986] (Application example 1)

[0987] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0988] Conventional travel planning systems can present travel plans that take into account user preferences and real-time information, but they have the problem of not being able to suggest restaurants that take into account the user's dietary preferences and allergy information. They also lack the functionality to learn from the user's past ordering history and ratings to make more accurate suggestions. This often makes it difficult for users to find suitable restaurants during their trip.

[0989] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0990] In this invention, the server includes means for specifying user preferences, means for presenting a travel plan that takes weather and traffic congestion information into consideration, means for making collective reservations for facilities, accommodations, transportation, etc. based on the selected plan, means for showing the schedule for the day, means for presenting alternative plans based on real-time information such as weather and traffic congestion, means for receiving the user's food preferences and allergy information and suggesting optimal restaurants and menus based thereon, and means for learning the user's past ordering history and ratings to make more accurate suggestions, thereby enabling users to easily find restaurants that meet their preferences and allergies even while traveling.

[0991] A "means for specifying user preferences" is a means for providing an interface for a user to input their travel and dining preferences and requirements.

[0992] "Means for presenting travel plans that take into account weather and traffic information" refers to means for proposing optimal travel plans to users based on weather forecast information and traffic information.

[0993] "A means of reserving facilities, accommodations, transportation, etc. all at once based on the selected plan" means a means of reserving the necessary facilities, accommodations, and transportation all at once based on the travel plan selected by the user.

[0994] The "means for showing the plans for the day" is a means for displaying the schedule and plans for the user on the day of the trip.

[0995] "Means of presenting alternative plans based on real-time information such as weather and traffic congestion" refers to a means of suggesting alternative travel plans to users based on weather and traffic information obtained in real time.

[0996] "Means for receiving a user's food preferences and allergy information and suggesting the most suitable restaurant and menu based on that" refers to a means for having a user input information about their food preferences and allergies and then suggesting appropriate restaurants and menus based on that information.

[0997] "Means for learning from a user's past order history and ratings to make more accurate suggestions" refers to a means for analyzing a user's past order history and rating data and making more appropriate suggestions based on that.

[0998] To implement this invention, the following system configuration is required: The system includes means for specifying user preferences, means for presenting a travel plan that takes into account weather and traffic congestion information, means for making collective reservations for facilities, accommodations, transportation, etc. based on the selected plan, means for showing the schedule for the day, means for presenting different plan variations based on real-time information such as weather and traffic congestion, means for receiving the user's food preferences and allergy information and suggesting optimal restaurants and menus based on that information, and means for learning the user's past ordering history and ratings to make more accurate suggestions.

[0999] System Program

[1000] The system is implemented in Python using the machine learning library scikit-learn as its primary library. The user interface is provided as a smartphone application, which includes a form for entering user preferences and allergy information.

[1001] Processing Description

[1002] Hardware

[1003] Smartphone: Provides the user interface and receives user input.

[1004] Server: Processes and stores data.

[1005] software

[1006] Python: Used for data processing and implementing machine learning models.

[1007] scikit-learn: A machine learning library for learning user preferences and past order history to make suggestions.

[1008] Data processing and calculation

[1009] 1. Input of user preferences: Through a smartphone application, users input their travel destination, preferred meals, type of accommodation, mode of transportation, dietary preferences and allergy information.

[1010] 2. Data Vectorization: The input data is vectorized using TfidfVectorizer.

[1011] 3. Similarity calculation: The user preferences and restaurant menu information are vectorized and the cosine similarity is calculated.

[1012] 4. Suggestion generation: Suggest the most similar restaurants and menus to the user.

[1013] 5. Learning from past history: Learn from the user's past order history and ratings and reflect them in the next suggestion.

[1014] Specific examples

[1015] If a user specifies that they are a vegetarian and like Italian food, the system will suggest Restaurant A. The system also takes into account the user's past ordering history and ratings, improving the accuracy of the suggestions.

[1016] Prompt Sentence Examples

[1017] I'm a vegetarian and I love Italian food. I have a nut allergy. Can you recommend any restaurants?

[1018] In this way, it becomes possible to provide personalized travel plans and food delivery services based on user preferences.

[1019] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1020] Step 1:

[1021] Users launch a smartphone application and input their travel destination, preferred meals, type of accommodation, mode of transportation, dietary preferences, and allergy information. The input data is sent to the server. Examples of input data include "I'm a vegetarian and I like Italian food" and "I have a nut allergy."

[1022] Step 2:

[1023] The server analyzes the received user preference data and vectorizes it using TfidfVectorizer. By vectorizing the input data (user preferences), it can be treated as numerical data, which allows subsequent similarity calculations.

[1024] Step 3:

[1025] The server retrieves restaurant menu information from the database and similarly vectorizes it using TfidfVectorizer. By vectorizing the input data (restaurant menu information), it is converted into a format that can be compared with user preferences.

[1026] Step 4:

[1027] The server calculates the cosine similarity between the user's preference vector and the restaurant's menu vector. Using the input data (user's preference vector and restaurant's menu vector), the server calculates the similarity and identifies the restaurant with the highest similarity. This allows the server to select the restaurant that best suits the user's preferences.

[1028] Step 5:

[1029] Based on the calculation results, the server recommends the most suitable restaurant and menu to the user. It generates output data (information on the best restaurant and menu) and sends it to a smartphone application. The user can then check the recommendations through the application.

[1030] Step 6:

[1031] The user selects a restaurant and menu from the suggestions and confirms the order. The input data (user selection information) is sent to the server, and the order is processed.

[1032] Step 7:

[1033] The server stores the user's order history and ratings in a database and reflects them in the next recommendation. It learns from the input data (user's order history and ratings) and uses them to improve the accuracy of the next recommendation.

[1034] In this way, it is possible to provide personalized travel plans and food delivery services based on the user's preferences.

[1035] Example 2

[1036] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1037] Conventional travel planning systems have struggled to provide plans that fully consider user preferences and real-time weather and traffic information. There is also a demand for flexible plans that can quickly adapt to changes in weather and traffic conditions. Furthermore, there is a lack of systems that allow users to make reservations for facilities, accommodations, high-speed trains, rental cars, and more all at once. This has led to issues such as users spending a great deal of time and effort on trip planning, which can compromise the comfort of their trip.

[1038] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1039] In this invention, the server includes means for specifying user preferences, means for presenting a travel plan that takes weather and traffic information into consideration, means for making collective reservations for facilities, accommodations, high-speed trains, rental cars, etc. based on the selected plan, means for showing the schedule for the day, means for presenting different plan variations based on real-time information such as weather and traffic, means for acquiring weather forecast information, means for acquiring traffic information, means for analyzing the acquired weather forecast information and traffic information, means for generating a travel plan based on the analysis results, and means for presenting the generated travel plan to the user. This allows the user to easily obtain the optimal travel plan that takes real-time information into consideration and make the necessary reservations all at once.

[1040] A "means for specifying user preferences" is an interface through which a user can input personal preferences, such as travel destinations, dates, and activities of interest.

[1041] "Means for presenting travel plans that take weather and traffic information into consideration" is a function for generating and presenting optimal travel plans to users based on acquired weather forecast information and traffic information.

[1042] "A means of making bulk reservations for facilities, accommodations, high-speed trains, rental cars, etc. based on a selected plan" is a system that allows users to make all the necessary reservations in one go based on the travel plan they select.

[1043] "Means for showing the schedule for the day" is a function that provides users with detailed plans such as the schedule for the day of travel, places to visit, and means of transportation.

[1044] "A means of presenting different plans based on real-time information such as weather and traffic" is a function that generates and presents new travel plans based on real-time information if the weather or traffic conditions change during a trip.

[1045] The "means for acquiring weather forecast information" is a function for acquiring weather forecast information for a specified area from an external data source.

[1046] "Means for obtaining traffic information" refers to a function for obtaining traffic conditions and public transportation operation information for a specified area from external data sources.

[1047] The "means for analyzing the acquired weather forecast information and traffic information" is a function for analyzing the acquired weather forecast information and traffic information and identifying factors that affect travel plans.

[1048] The "means for generating a travel plan based on the analysis results" is a function for generating an optimal travel plan for the user based on the analysis results.

[1049] The "means for presenting the generated travel plan to the user" is a function for transmitting the generated travel plan to the user's terminal and presenting it to the user.

[1050] This invention is a system that provides users with optimal travel plans to enjoy a comfortable trip. This system includes: means for specifying user preferences; means for presenting travel plans that take weather and traffic information into consideration; means for making collective reservations for facilities, accommodations, high-speed trains, rental cars, etc. based on the selected plan; means for showing the schedule for the day; means for presenting alternative plans based on real-time information such as weather and traffic; means for acquiring weather forecast information; means for acquiring traffic information; means for analyzing the acquired weather forecast information and traffic information; means for generating a travel plan based on the analysis results; and means for presenting the generated travel plan to the user.

[1051] The server first provides a way for the user to specify their preferences: the user inputs personal preferences such as travel destinations, dates, and activities of interest. This information is sent from the user's device to the server.

[1052] Next, the server uses an external weather forecast data source (e.g., OpenWeatherMap API) to obtain weather forecast information for the specified area and stores it in a database for analysis.

[1053] Similarly, the server uses external traffic information data sources (e.g., Google Maps API) to obtain traffic information. It obtains traffic conditions and public transport operation information for a specified area and stores them in a database for analysis.

[1054] The server analyzes the weather forecast and traffic information it has acquired, for example, prioritizing indoor tourist spots on days when rain is expected and considering transportation methods to avoid crowds.

[1055] Based on the analysis results, the server uses a travel plan generation method to generate an optimal travel plan for the user, for example, creating a plan to visit museums and art galleries on rainy days and suggesting routes using public transportation to avoid crowds.

[1056] The generated travel plan is sent from the server to the user's device and presented to the user. The user can review the presented plan and customize it as needed. For example, the user can make a request to change this tourist spot to another location.

[1057] As a concrete example, consider a user planning a trip to Tokyo. The user inputs the travel destination and itinerary, and the server retrieves weather and traffic information for Tokyo. Since the forecast predicts rain on the first day of the trip, the server prioritizes indoor tourist attractions (e.g., museums and art galleries) and suggests a route using public transportation. The generated itinerary is sent to the user's device, where the user can review it and customize it as needed.

[1058] An example prompt is, "Please create a travel plan for Tokyo. Rain is expected on the first day of the trip. Please also suggest transportation options and routes to avoid crowds."

[1059] In this way, the server, terminals, and users work together to create a system that provides optimal travel plans that take real-time information into account.

[1060] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1061] Step 1:

[1062] The user inputs personal preferences such as travel destination and itinerary, and activities of interest. The device sends this information to the server. The input data includes the destination (e.g., Tokyo), travel itinerary (e.g., 3 days), and activities of interest (e.g., museums, art galleries). The server receives this information and stores it in a database.

[1063] Step 2:

[1064] The server sends a request to an external weather forecast data source (e.g., a weather forecast API) to obtain weather forecast information. The input data includes a destination and date range specified by the user. The weather forecast API returns weather forecast information for the specified area and time period. The server stores the obtained weather forecast information in a database for analysis.

[1065] Step 3:

[1066] The server sends a request to an external traffic information data source (e.g., a traffic information API) to obtain traffic information. The input data includes the destination specified by the user. The traffic information API returns traffic conditions and public transportation operation information for the specified area. The server stores the obtained traffic information in a database for analysis.

[1067] Step 4:

[1068] The server analyzes the acquired weather forecast and traffic information. The input data includes weather forecast and traffic information. Based on this information, the server identifies factors that will affect the travel plan. For example, on days when rain is expected, the server may prioritize indoor tourist spots and consider transportation methods to avoid crowds. The analysis results are stored in a database for generating travel plans.

[1069] Step 5:

[1070] The server generates an optimal travel plan for the user based on the analysis results. The input data includes the analysis results and the user's preferences. Based on this information, the server creates a travel plan that includes tourist spots to visit, means of transportation, routes, etc. The generated travel plan is saved in a database.

[1071] Step 6:

[1072] The server sends the generated travel plan to the user's terminal and presents it to the user. The input data includes the generated travel plan. The user can review the presented plan and customize it as needed. For example, the user can make a request to change this tourist spot to another location in the presented plan. The server regenerates the plan based on the user's request and presents it to the user again.

[1073] In this way, the server, terminals, and users work together to create a system that provides optimal travel plans that take real-time information into consideration.

[1074] (Application example 2)

[1075] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1076] Conventional travel plan suggestion systems take weather forecasts and traffic information into account when presenting plans, but lack the functionality to suggest optimal delivery options that take weather and traffic conditions into account when users use food delivery services. As a result, users are at risk of delivery delays due to bad weather or traffic congestion. The present invention aims to solve this problem and provide users with the optimal delivery options.

[1077] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1078] In this invention, the server includes a means for specifying user preferences, a means for presenting a travel plan that takes into account weather and traffic congestion information, a means for making a collective reservation of facilities, accommodations, high-speed trains, rental vehicles, etc. based on the selected plan, a means for showing the schedule for the day, a means for presenting different plan patterns based on real-time information such as weather and traffic congestion, and a means for acquiring weather forecast information and traffic information and proposing the optimal delivery option, thereby enabling the user to use the optimal delivery option that takes into account weather and traffic conditions.

[1079] "Means for specifying user preferences" is a function that provides an interface for users to input or select their preferences or requests.

[1080] "A means of presenting travel plans that take into account weather and traffic information" is a function that suggests optimal travel plans to users based on weather forecast information and traffic information.

[1081] "A means of making reservations for facilities, accommodations, high-speed trains, rental vehicles, etc. all at once" is a function that allows users to make reservations for the necessary facilities and transportation means all at once based on the travel plan they select.

[1082] "Means for showing plans for the day" is a function that displays the user's schedule and plans for the day of travel.

[1083] "A means of presenting alternative plans based on real-time information such as weather and traffic congestion" is a function that suggests alternative travel plans to users based on weather and traffic information obtained in real time.

[1084] "Means of obtaining weather forecast information and traffic information and suggesting optimal delivery options" refers to a function that collects weather forecast information and traffic information and suggests optimal food delivery options to users based on that information.

[1085] A system for implementing this invention includes means for specifying user preferences, means for presenting a travel plan that takes into account weather and traffic congestion information, means for making collective reservations for facilities, accommodations, high-speed trains, rental vehicles, etc. based on the selected plan, means for showing the schedule for the day, means for presenting different plan patterns based on real-time information such as weather and traffic congestion, and means for obtaining weather forecast information and traffic information and proposing optimal delivery options.

[1086] The server provides an interface for users to specify their preferences. Through this interface, users can input or select their preferences and requests. The server then retrieves weather forecast information and traffic information, and based on that, suggests optimal travel plans for users. This is done using weather forecast APIs and traffic information APIs.

[1087] Based on the travel plan selected by the user, the server makes reservations for facilities, accommodations, high-speed trains, rental cars, etc. in one go, allowing the user to complete all necessary reservations with a single operation.

[1088] To show the schedule for the day, the server displays the user's schedule and plans for the day of travel, using the calendar API and notification functions.

[1089] In addition, the server will suggest alternative travel plans to users based on real-time information such as weather and traffic congestion, allowing users to adapt to unexpected weather changes and traffic jams.

[1090] In particular, the server uses weather forecast and traffic information APIs to collect information and suggest optimal delivery options. For example, if rain is forecast, restaurants with short delivery times will be prioritized, and if traffic congestion is expected, routes that avoid traffic congestion will be suggested.

[1091] As a concrete example, consider the case where the optimal delivery option is suggested taking into account weather forecast and traffic information when ordering food delivery in Tokyo. Below is an example of a prompt sentence to input to the generative AI model.

[1092] Example prompt sentence:

[1093] When ordering food delivery in Tokyo, consider weather and traffic forecasts to suggest the best delivery options. If rain is expected, prioritize restaurants with quick delivery times. If traffic congestion is expected, suggest routes that avoid congestion.

[1094] This way, users can enjoy the best delivery options taking into account weather and traffic conditions.

[1095] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1096] Step 1:

[1097] The server provides an interface for users to specify their preferences. Through this interface, users input their preferences and requests. The input data is sent to the server and stored as user profile information.

[1098] Step 2:

[1099] The server obtains weather forecast information and traffic information. Specifically, it uses the weather forecast API and traffic information API to collect weather forecast information and traffic information for the specified location. This information is stored on the server and used for subsequent processing.

[1100] Step 3:

[1101] The server proposes the optimal travel plan for the user based on the acquired weather and traffic information. If the weather forecast indicates rain, it will prioritize indoor tourist spots, and if the traffic information indicates congestion, it will suggest routes that avoid traffic jams. The proposed plan is sent to the user's device.

[1102] Step 4:

[1103] Based on the travel plan selected by the user, the server makes reservations for facilities, accommodations, high-speed trains, rental cars, etc. Reservation information is sent using the API of each service provider, and once the reservation is complete, confirmation information is sent to the user's device.

[1104] Step 5:

[1105] The server displays the user's schedule and plans for the day of the trip. Specifically, it uses the calendar API and notification function to display the plans for the day on the user's device, allowing the user to check their travel schedule.

[1106] Step 6:

[1107] The server proposes alternative travel plans to users based on real-time information such as weather and traffic congestion. Based on real-time weather forecasts and traffic information, the server generates the optimal alternative plan for the user and sends it to the user's device.

[1108] Step 7:

[1109] The server obtains weather forecast and traffic information and suggests optimal delivery options. It uses weather forecast and traffic information APIs to collect information, and if rain is expected, it prioritizes restaurants with short delivery times. If traffic congestion is expected, it suggests routes that avoid traffic congestion. The suggested delivery options are sent to the user's device.

[1110] Example 3

[1111] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1112] Conventional travel planning systems require users to make individual reservations for each service (shops, hotels, bullet trains, rental cars, etc.), which is time-consuming, and make it difficult to keep track of the day's schedule. Furthermore, they are unable to flexibly change plans based on real-time information such as weather and traffic congestion, which can detract from the user's travel experience. To solve these problems, there is a demand for a system that allows users to easily select a travel plan and dynamically change it based on real-time information.

[1113] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1114] In this invention, the server includes means for specifying user preferences, means for presenting a travel plan that takes weather and traffic congestion information into consideration, means for making a bulk reservation for multiple services based on the selected plan, means for showing the schedule for the day, means for presenting different plan patterns based on real-time information such as weather and traffic congestion, means for dynamically changing the plan based on the real-time information, and means for notifying the user of the changed plan. This saves the user the trouble of making reservations for each service individually, allows the user to easily grasp the schedule for the day, and enables the user to flexibly change the plan based on the real-time information.

[1115] "Means for specifying user preferences" refers to a function that provides an interface for users to input their preferences and wishes when selecting a travel plan.

[1116] "Means for presenting travel plans that take into account weather and traffic information" is a function that generates and presents optimal travel plans to users based on weather forecast information and traffic information.

[1117] "A means of booking multiple services at once" is a function that allows users to book various services such as shops, hotels, bullet trains, and rental cars all at once based on the travel plan they select.

[1118] "Means for showing the schedule for the day" is a function that displays the schedule that the user needs to do on the day of the trip in a list format or the like.

[1119] "Means of presenting alternative plans based on real-time information" refers to a function that suggests alternative travel plans to users based on real-time information such as weather and traffic congestion.

[1120] The "means for dynamically changing plans based on real-time information" is a function that automatically changes an existing travel plan in accordance with acquired real-time information.

[1121] "Means for notifying the user of the changed plan" is a function for notifying the user of the changed travel plan.

[1122] The present invention relates to a system that allows a user to select a travel plan and dynamically change the plan based on real-time information. A specific embodiment of this system will be described below.

[1123] System configuration

[1124] Hardware

[1125] Server: High-performance server (e.g. Dell PowerEdge R740)

[1126] Device: Smartphone (e.g. iPhone 13)

[1127] software

[1128] Database Management System: MySQL

[1129] API integration tool: Postman

[1130] Mobile Application: React Native

[1131] Weather information API: OpenWeatherMap

[1132] Traffic Information API: Google Maps API

[1133] Program processing

[1134] A means of specifying user preferences

[1135] A user selects a travel plan using the mobile application on the device. For example, the user selects a "Tokyo sightseeing plan" and enters details such as the travel dates and number of people.

[1136] A means of presenting travel plans that take weather and traffic information into account

[1137] The server retrieves data from weather and traffic information APIs and generates an optimal travel plan for the user. For example, if fine weather is expected, it will present a plan that includes many outdoor tourist spots.

[1138] A way to book multiple services at once

[1139] The server sends a request to each service's reservation API based on the plan selected by the user. For example, to a hotel reservation API, it sends information such as the date of stay and number of people to confirm the reservation. To a Shinkansen reservation API, it sends information such as the departure point, destination, and departure time to reserve a ticket.

[1140] A way to show the schedule for the day

[1141] The server generates a schedule for the day based on the user's travel plan and sends it to the device. The device then displays the schedule information received from the server to the user. For example, it displays a list of tourist spots to visit in the morning, lunch spots, and tourist spots to visit in the afternoon.

[1142] A means of presenting alternative plans based on real-time information

[1143] The server retrieves real-time data from weather and traffic information APIs and suggests alternative travel plans to users. For example, if rain is expected in the afternoon, it suggests changing outdoor tourist spots to indoor facilities.

[1144] A means to dynamically change plans based on real-time information

[1145] The server automatically modifies existing travel plans based on real-time information it receives, for example, suggesting alternative routes or destinations if traffic congestion occurs.

[1146] How will users be notified of the changed plan?

[1147] The server then sends the changed plan to the device, and the device notifies the user of the changed plan. For example, if the afternoon sightseeing spot is changed to an indoor facility, that information is displayed on the mobile application screen.

[1148] Specific examples

[1149] The user opens the mobile application, selects the "Tokyo Sightseeing Plan," and enters the travel dates as "December 1st to December 3rd, 2023." The server sends a request to the hotel reservation API for "December 1st to December 3rd, 2023, for 2 people" to confirm the reservation. The server sends a request to the Shinkansen reservation API for "Tokyo Station to Kyoto Station, departing December 1st, 2023 at 9:00 AM" to reserve the ticket. The server generates an itinerary such as "December 1st, 2023, 10:00 AM: Visit Tokyo Tower, 12:00 PM: Lunch in Ginza, 2:00 PM: Visit Sensoji Temple" and sends it to the device. The device displays "December 1st, 2023, 10:00 AM: Visit Tokyo Tower, 12:00 PM: Lunch in Ginza, 2:00 PM: Visit Sensoji Temple" on the mobile application screen. The server retrieves information from the weather information API that indicates "rain will start in the afternoon on December 1, 2023," and generates a proposal to change an afternoon visit to Sensoji Temple to "visit the Tokyo National Museum at 2 PM." The server sends the revised plan to the device, and the device displays "visit the Tokyo National Museum at 2 PM" on the mobile application screen.

[1150] Prompt Sentence Examples

[1151] "Please develop a system that can make reservations for shops, hotels, bullet trains, rental cars, etc. all at once based on the travel plan selected by the user. Please also include a function that shows the schedule for the day and a function that presents different plans based on real-time information such as weather and traffic congestion."

[1152] In this way, the present invention makes the user's travel experience smoother and can flexibly respond to real-time situations. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1153] Step 1:

[1154] The user selects a travel plan.

[1155] Input: A user uses a mobile application on their device to enter details such as a travel plan (e.g., Tokyo sightseeing plan), travel dates (e.g., December 1st to December 3rd, 2023), and number of people (e.g., 2 people).

[1156] Data processing: The terminal formats the information entered by the user for transmission to the server.

[1157] Output: The formatted travel plan information is sent to the server.

[1158] Specific operation: The user selects "Tokyo Sightseeing Plan" on the mobile application screen, enters the travel dates and number of people, and presses the "Submit" button.

[1159] Step 2:

[1160] The server makes reservations for each service in bulk based on the selected plan.

[1161] Input: The server receives travel plan information sent by the user.

[1162] Data processing: The server generates appropriate requests to each service's reservation API. For example, a hotel reservation API generates a request including information such as the date of stay and number of people, and a Shinkansen reservation API generates a request including information such as the departure point, destination, and departure time.

[1163] Output: The reservation for each service is confirmed and the reservation confirmation information is returned to the server.

[1164] Specific operation: The server sends a request to the hotel reservation API for "December 1st to December 3rd, 2023, for 2 people" to confirm the reservation. It also sends a request to the Shinkansen reservation API for "Tokyo Station to Kyoto Station, departing December 1st, 2023 at 9:00 AM" to reserve the ticket.

[1165] Step 3:

[1166] The server generates a schedule for the day and sends it to the terminal.

[1167] Input: The server receives reservation confirmation information for each confirmed service.

[1168] Data processing: The server generates a schedule for the day based on the user's travel plan, such as a list of tourist spots to visit in the morning, lunch spots, and tourist spots in the afternoon.

[1169] Output: The generated schedule information for the day is sent to the terminal.

[1170] Specific operation: The server generates a schedule such as "December 1, 2023, 10:00 AM: Visit Tokyo Tower, 12:00 PM: Lunch in Ginza, 2:00 PM: Visit Sensoji Temple" and sends it to the terminal.

[1171] Step 4:

[1172] The terminal displays the schedule for the day to the user.

[1173] Input: The device receives the schedule information for the day from the server.

[1174] Data processing: The terminal formats the received schedule information for display to the user.

[1175] Output: The formatted appointment information is displayed on the mobile application screen.

[1176] Specific operation: The device displays the following on the mobile application screen: "December 1, 2023, 10:00 AM: Visit Tokyo Tower, 12:00 PM: Lunch in Ginza, 2:00 PM: Visit Sensoji Temple."

[1177] Step 5:

[1178] The server gets real-time information and changes the plan as needed.

[1179] Input: The server retrieves real-time data from weather and traffic APIs.

[1180] Data processing: The server evaluates the existing itinerary based on the acquired real-time information and generates suggested changes if necessary. For example, if rain is predicted for the afternoon, it will suggest changing outdoor tourist attractions to indoor facilities.

[1181] Output: The proposed changes are generated and sent to the terminal.

[1182] Specific operation: The server retrieves information from the weather information API that says "It will rain from the afternoon on December 1, 2023," and generates a proposal to change the afternoon visit to Sensoji Temple to "2:00 PM: Visit to Tokyo National Museum."

[1183] Step 6:

[1184] The server transmits the changed plan to the terminal, which displays it to the user.

[1185] Input: The changed plan information generated by the server is sent to the device.

[1186] Data processing: The device formats the received changed plan information for display to the user.

[1187] Output: The formatted modified plan information is displayed on the mobile application screen.

[1188] Specific behavior: The device displays "2:00 PM: Visit Tokyo National Museum" on the mobile application screen.

[1189] (Application example 3)

[1190] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1191] Conventional travel planning systems require users to make individual reservations for restaurants, hotels, bullet trains, rental cars, etc., and they also have the problem of making it difficult to manage schedules for the day or change plans based on real-time information such as weather and traffic congestion. Furthermore, they lack the functionality to simultaneously book food delivery from multiple restaurants, manage schedules for the day, and change delivery times and destinations depending on weather and traffic conditions. This reduces user convenience and makes it difficult to plan trips and meals efficiently.

[1192] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1193] In this invention, the server includes means for specifying user preferences, means for presenting travel plans that take weather and traffic information into consideration, means for making collective reservations for restaurants, hotels, bullet trains, rental cars, etc. based on the selected plan, means for showing the schedule for the day, means for presenting alternative plans based on real-time information such as weather and traffic, means for making collective reservations for food delivery from multiple restaurants, means for managing the schedule for the day, and means for changing delivery times and destinations according to weather and traffic conditions. This allows users to efficiently plan trips and meals and flexibly change plans based on real-time information.

[1194] "Means for specifying user preferences" is a function that provides an interface for users to input or select their preferences or wishes.

[1195] "Means of presenting travel plans that take into account weather and traffic information" is a function that suggests optimal travel plans to users based on weather forecast information and traffic information.

[1196] "A means of making bulk reservations for shops, hotels, bullet trains, rental cars, etc. based on a selected plan" refers to a function that allows users to make bulk reservations for related services based on the travel plan they select.

[1197] "Means for showing plans for the day" is a function that displays the plans and schedule that the user should follow on the day of the trip.

[1198] "A means of presenting alternative plans based on real-time information such as weather and traffic congestion" is a function that suggests alternative travel plans to users depending on changes in weather and traffic conditions.

[1199] "Means for reserving food delivery from multiple restaurants at once" is a function that allows users to reserve food delivery from multiple restaurants at once.

[1200] "Means for managing the day's schedule" is a function that manages and displays the user's schedule and plans for the day.

[1201] "Means for changing delivery times and destinations depending on weather and traffic conditions" refers to a function that adjusts food delivery times and destinations based on real-time weather and traffic information.

[1202] A system for implementing this invention includes means for specifying user preferences, means for presenting a travel plan that takes into account weather and traffic congestion information, means for making collective reservations for restaurants, hotels, bullet trains, rental cars, etc. based on the selected plan, means for showing the schedule for the day, means for presenting different plan patterns based on real-time information such as weather and traffic congestion, means for making collective reservations for food delivery from multiple restaurants, means for managing the schedule for the day, and means for changing delivery times and destinations depending on weather and traffic conditions.

[1203] 1. System Program

[1204] The system is implemented using Python. Specifically, it uses the Weather API and Traffic API to obtain weather and traffic information, and generates optimal plans based on user preferences and real-time information. It also has the ability to book food deliveries from multiple restaurants at once, manage the schedule for the day, and change delivery times and destinations as needed.

[1205] 2. Program Processing

[1206] The server uses the following hardware and software:

[1207] Hardware: Smartphone

[1208] Software: Python, Weather API, Traffic API

[1209] The server receives input from the user and obtains weather and traffic information. Based on this, it generates travel plans and food delivery plans that suit the user's preferences. The generated plans are displayed on the user's smartphone, allowing the user to review and select. Based on the selected plan, the server makes reservations for shops, hotels, bullet trains, rental cars, etc. all at once, managing the day's schedule. It also makes suggestions to change the plan as needed based on real-time weather and traffic information.

[1210] 3. Specific Examples

[1211] For example, consider a case where a user orders "pizza" from "Restaurant A" at 12:00 and "sushi" from "Restaurant B" at 13:00. If it is raining and traffic is heavy, the server will adjust the delivery time to 30 minutes and 15 minutes later, respectively. This information is notified to the user's smartphone in real time.

[1212] Example prompts to input to a generative AI model:

[1213] Build an application that allows users to book food delivery from multiple restaurants at once, manage their schedules for the day, and adjust delivery times and destinations depending on weather and traffic conditions. Using Python, implement a feature that uses the Weather and Traffic APIs to adjust delivery times if it's raining or traffic is heavy.

[1214] In this way, users can efficiently plan their trips and meals, and have the flexibility to change their plans based on real-time information.

[1215] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1216] Step 1:

[1217] The user uses the terminal to input their preferences and wishes.

[1218] Input: User preferences and wishes (e.g., travel destination, type of meal, budget, etc.)

[1219] Output: The user's preferences and wishes are sent to the server.

[1220] How it works: The user opens the smartphone application and inputs their preferences and wishes, such as travel destination, type of meal, budget, etc. This information is sent to the server.

[1221] Step 2:

[1222] The server retrieves weather and traffic information.

[1223] Input: User preferences, wishes, current location

[1224] Output: Weather and traffic information

[1225] Specific operation: The server uses the Weather API and Traffic API to obtain weather and traffic information based on the user's current location.

[1226] Step 3:

[1227] The server generates optimal travel plans and food delivery plans based on user preferences and real-time information.

[1228] Input: User preferences and wishes, weather information, traffic information

[1229] Output: Optimal travel plans or food delivery plans

[1230] Specific operation: The server takes into account the acquired weather and traffic information and generates travel plans and food delivery plans that suit the user's preferences. For example, if rain is expected, it will suggest indoor tourist spots.

[1231] Step 4:

[1232] The server transmits the generated plan to the user's terminal.

[1233] Input: The best travel plans or food delivery plans

[1234] Output: The plan as it appears on the user's device

[1235] Specific operation: The server sends the generated plan to the user's smartphone, and the user can review and select it.

[1236] Step 5:

[1237] Based on the plan selected by the user, the server makes reservations for shops, hotels, bullet trains, rental cars, etc. all at once.

[1238] Input: The plan selected by the user

[1239] Output: Reservation confirmation information

[1240] Specific operation: When the user selects a plan, the server makes reservations for shops, hotels, bullet trains, rental cars, etc. all at once and sends reservation confirmation information to the user.

[1241] Step 6:

[1242] The server manages the schedule for the day and displays it on the user's terminal.

[1243] Input: Reservation confirmation information, schedule for the day

[1244] Output: Today's schedule

[1245] Specific operation: The server creates a schedule for the day based on the reservation confirmation information and displays it on the user's smartphone.

[1246] Step 7:

[1247] The server will suggest changes to your plan as needed based on real-time weather and traffic information.

[1248] Input: Real-time weather and traffic information

[1249] Output: Change proposal

[1250] How it works: The server uses the Weather API and Traffic API to obtain real-time information and sends suggestions for changing the plan to the user's smartphone as needed. For example, if there is traffic congestion, it suggests delaying the delivery time.

[1251] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1252] "Example 1"

[1253] In one embodiment of the present invention, a system is provided that includes an emotion engine that recognizes a user's emotions. The system recognizes emotions from the user's facial expressions, tone of voice, text input, etc., and uses this information to generate a travel plan. For example, if the user expresses joy, the system captures this information and suggests activities, meals, accommodations, etc. that the user would like. Also, if the user expresses anxiety or confusion, the system captures this information and provides more detailed information and support.

[1254] "Example 2"

[1255] Another embodiment of the present invention provides a travel plan that takes into account the output of the emotion engine. Specifically, the system recognizes the user's emotion and adjusts the travel plan accordingly. For example, if the user expresses joy, the system suggests a more active plan. On the other hand, if the user expresses anxiety or confusion, the system suggests a more relaxed plan or a plan that provides more detailed information.

[1256] "Example 3"

[1257] Furthermore, another embodiment of the present invention provides a plan modification suggestion based on the output of the emotion engine. Specifically, the system recognizes the user's emotions in real time and suggests plan modifications based on the emotions. For example, if the user expresses stress or frustration during the trip, the system captures this information and suggests plan modifications. The suggestions may include activities, meals, accommodations, etc. that better match the user's current emotions.

[1258] The processing flow of each embodiment will be described below.

[1259] "Example 1"

[1260] Step 1: Recognize emotions from the user's facial expressions, tone of voice, text input, etc.

[1261] Step 2: Based on the recognized emotional information, suggest activities, meals, accommodations, etc. that the user may prefer.

[1262] Step 3: If the user expresses anxiety or confusion, provide more information or support.

[1263] "Example 2"

[1264] Step 1: Recognize the user's emotions.

[1265] Step 2: Adjust your travel plans according to the emotions you recognize.

[1266] Step 3: If the user is showing signs of happiness, suggest a more active plan.

[1267] Step 4: If the user expresses anxiety or confusion, suggest a more relaxed plan or one that provides more detailed information.

[1268] "Example 3"

[1269] Step 1: Recognize user emotions in real time.

[1270] Step 2: Suggest changes to the plan based on the emotions you identify.

[1271] Step 3: If the user expresses stress or dissatisfaction during their trip, capture that information and suggest changes to the plan.

[1272] Step 4: The suggestions will include activities, meals, accommodations, etc. that better match the user's current emotions.

[1273] Example 1

[1274] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1275] While conventional travel planning systems can take into account user preferences, weather, and traffic information, they have the problem of not being able to adjust plans to take the user's emotions into account. This makes it difficult to maximize the user's satisfaction during their trip. Furthermore, when changing plans based on real-time information, the system is unable to reflect the user's emotions.

[1276] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1277] In this invention, the server includes a means for specifying user preferences, a means for presenting a travel plan that takes into account weather and traffic congestion information, a means for making a collective reservation of facilities, accommodations, transportation, etc. based on the selected plan, a means for showing the schedule for the day, a means for presenting different plan patterns based on real-time information such as weather and traffic congestion, a means for recognizing the user's emotions, and a means for adjusting the travel plan based on the recognized emotions, thereby making it possible to provide an optimal travel plan that takes into account the user's emotions.

[1278] "Means for specifying user preferences" refers to means for providing an interface for users to input travel destinations, preferred meals, types of accommodation, means of transportation, etc.

[1279] The "means for presenting travel plans that take into account weather and traffic information" refers to a means for acquiring weather forecast information and traffic information, and generating and presenting an optimal travel plan based on that information.

[1280] "A means of making a collective reservation of facilities, accommodations, transportation, etc. based on a selected plan" means a means of making a collective reservation of related facilities, accommodations, transportation, etc. based on a travel plan selected by the user.

[1281] The "means for showing the schedule for the day" is a means for displaying the user's schedule and activities for the day of travel.

[1282] "A means for presenting alternative plans based on real-time information such as weather and traffic congestion" refers to a means for changing an existing travel plan and presenting an alternative plan based on weather and traffic information obtained in real time.

[1283] "Means for recognizing user emotions" refers to a means for analyzing and recognizing emotions from the user's facial expressions, tone of voice, text input, etc.

[1284] The "means for adjusting the travel plan based on the recognized emotions" is a means for adjusting the contents of the travel plan based on the results of the user's emotion analysis, thereby increasing user satisfaction.

[1285] The present invention is a system for providing a travel plan that takes into account the preferences and emotions of a user. A specific embodiment of this system will be described below.

[1286] First, the user uses a device to input information such as the travel destination, preferred meals, type of accommodation, and mode of transportation. The device can be a smartphone or a PC. The user then accesses a dedicated web form and enters the necessary information.

[1287] Next, the server receives the user's input and stores it in a database, typically a database management system such as MySQL. The server receives the information entered by the user in real time and stores it in the database.

[1288] The server then launches the emotion engine, which is software for analyzing the user's emotions and uses emotion recognition APIs such as Microsoft Azure Cognitive Services. The server sends the user's facial expressions, tone of voice, and text input to the emotion engine, which then analyzes their emotions.

[1289] The emotion engine analyzes the user's emotions and returns the results to the server, which then generates a travel plan based on that information. For example, if a user wants to travel to Hawaii, specifies that they like seafood, and expresses joy, the server will suggest popular seafood restaurants and activities in Hawaii.

[1290] The server then presents the generated travel plan to the user, who can then review the details of the proposed plan through their device. Specifically, the plan details are displayed to the user through a web page or application. The user can review the information and adjust the plan as needed.

[1291] As a concrete example, consider a case where a user wishes to take a trip to Hawaii and selects seafood as their preferred food. When the user smiles through the camera, the emotion engine recognizes that the user is expressing a happy emotion. Based on this information, the server suggests popular seafood restaurants and activities in Hawaii.

[1292] Example prompts to input to a generative AI model:

[1293] The user indicated that they would like to travel to Hawaii and that they like seafood. They smile, which is recognized as expressing the emotion of happiness. Use this information to suggest recommended seafood restaurants and activities in Hawaii.

[1294] In this way, the server provides the best travel plan based on the user's preferences and feelings.

[1295] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1296] Step 1:

[1297] The user enters their preferences.

[1298] Using a terminal, the user inputs information such as travel destination, preferred meals, type of accommodation, and mode of transportation. The input information is then sent from the terminal to the server. Specifically, the user enters the information into a dedicated web form through a smartphone or PC browser and presses the send button. Examples of input data include "Destination: Hawaii," "Meals: Seafood," "Accommodation: Hotel," and "Mode of transportation: Rental car."

[1299] Step 2:

[1300] The server receives the user's input.

[1301] The server receives the information entered by the user and saves it in a database. The input data is stored in a MySQL database on the server. Specifically, the server receives an HTTP request, extracts the user's input data from the request body, and executes an INSERT query to save it in the database. For example, data such as "Destination: Hawaii," "Meal: Seafood," "Accommodation: Hotel," and "Transportation: Rental Car" are saved.

[1302] Step 3:

[1303] The server starts the emotion engine.

[1304] The server launches an emotion engine to analyze the user's emotions. The emotion engine is software for analyzing the user's facial expressions, tone of voice, text input, etc. Specifically, the server calls an emotion recognition API and sends the user's input data. For example, when using the emotion recognition API of Microsoft Azure Cognitive Services, authentication is performed using an API key, and the user's facial expression data and voice data are sent.

[1305] Step 4:

[1306] The server analyzes the user's emotions

[1307] The server receives the analysis results returned from the emotion engine. The analysis results include the user's emotional state (happiness, sadness, surprise, etc.). Specifically, the server analyzes the JSON format data returned from the emotion recognition API and extracts the user's emotional state. For example, data such as "Emotion: joy" may be returned.

[1308] Step 5:

[1309] The server generates the itinerary.

[1310] The server generates an optimal travel plan based on the user's preferences and the results of emotion analysis. Specifically, it runs an algorithm that combines the user's input data with emotion data to create a travel plan. For example, if a user requests a trip to Hawaii, specifies that they like seafood, and expresses an emotion of joy, the server will suggest popular seafood restaurants and activities in Hawaii. The generated plan will include restaurant names, addresses, ratings, menu details, and more.

[1311] Step 6:

[1312] The server presents the generated plan to the user.

[1313] The server presents the generated travel plan to the user. Specifically, the server displays the plan details to the user through a web page or application. The user can then check the details of the proposed plan through their device. For example, a list of seafood restaurants in Hawaii and detailed information about activities may be displayed. The user can review the information and adjust the plan as necessary.

[1314] (Application example 1)

[1315] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1316] Conventional food delivery systems have the problem that they do not take into account the user's preferences and emotions when making suggestions, making it difficult for users to choose meals that satisfy them. In addition, they do not provide appropriate support when users are anxious or confused, which leads to a poor user experience.

[1317] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1318] In this invention, the server includes a means for specifying a user's preferences, a means for recognizing the user's emotions, a means for making optimal suggestions based on the recognized emotions, and a means for providing detailed information and support when the user is anxious or confused. This enables optimal food delivery suggestions that take the user's preferences and emotions into consideration, improving the user experience.

[1319] "Means for specifying user preferences" refers to an interface that allows users to input their preferred dishes, ingredients, allergy information, etc.

[1320] "A means of presenting travel plans that take into account weather and traffic information" is a function that suggests optimal travel plans to users based on weather forecast information and traffic information.

[1321] "A means of making bulk reservations for shops, accommodations, transportation, etc. based on a selected plan" refers to a function that allows users to make bulk reservations for related services based on the travel plan they select.

[1322] The "means for showing the schedule for the day" is a function for displaying the user's schedule for the day of travel.

[1323] "A means of presenting alternative plans based on real-time information such as weather and traffic congestion" is a function that suggests alternative plans to users based on weather and traffic information obtained in real time.

[1324] "Means for recognizing user emotions" refers to a system for analyzing emotions from a user's facial expressions, tone of voice, text input, etc.

[1325] "Means for making optimal suggestions based on recognized emotions" is a function that suggests dishes and services that the user is likely to enjoy based on the user's emotional data.

[1326] "Means to provide detailed information and support when users are anxious or confused" refers to a function that provides detailed information and customer support when users express feelings of anxiety or confusion.

[1327] A system for implementing the present invention includes means for specifying user preferences, means for recognizing the user's emotions, means for making optimal suggestions based on the recognized emotions, and means for providing detailed information and support when the user is anxious or confused.

[1328] 1. System Program

[1329] The system is implemented using the following hardware and software.

[1330] Hardware

[1331] Smartphone: Provides the user interface and camera functionality.

[1332] Server: Runs the data processing and proposal system.

[1333] software

[1334] OpenCV: An image processing library used to analyze the user's facial expressions.

[1335] Keras: A deep learning library used to run emotion recognition models.

[1336] TextBlob: A text analysis library used to analyze sentiment from user text input.

[1337] 2. Program processing explanation

[1338] A means of specifying user preferences

[1339] Users input their preferred dishes, ingredients, allergy information, etc. through a smartphone application, which allows the system to understand the user's basic preferences.

[1340] A means of recognizing user emotions

[1341] The smartphone camera captures the user's facial expression and performs face detection using OpenCV. The detected face area is input into the Keras emotion recognition model to analyze the user's emotion. If the user inputs text, TextBlob is used to analyze the emotion from the text.

[1342] A means of making optimal recommendations based on perceived emotions

[1343] Based on the recognized emotion data, the system suggests dishes and restaurants that the user is likely to enjoy. For example, if the user smiles, the system recognizes the emotion of "happiness" and suggests restaurants and dishes that the user might like.

[1344] A way to provide further information and support if users are worried or confused

[1345] If the user expresses anxiety or confusion, the system will provide detailed cooking information and customer support. For example, if the user types "I'm tired today," the system will recognize the negative emotion and suggest relaxing dishes and delivery services.

[1346] 3. Examples and prompts

[1347] Specific examples

[1348] When users smile into their smartphone camera, the app recognizes the emotion "happiness" and suggests restaurants and dishes the user might like.

[1349] When a user types "I'm tired today" in the text input, the app recognizes the "negative" emotion and suggests relaxing meals and delivery services.

[1350] Prompt Sentence Examples

[1351] When a user smiles into the smartphone camera, the app should recognize the emotion "happiness" and suggest restaurants and dishes that the user might like.

[1352]

[1353] If a user types "I'm tired today" in the text input, the app should recognize the "negative" emotion and suggest relaxing meals and delivery services.

[1354] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1355] Step 1:

[1356] Users launch the smartphone application and enter their preferred dishes, ingredients, allergy information, etc.

[1357] Input: User preferences and allergy information

[1358] Output: User preference data

[1359] What it does: A user enters information through the application's interface using text boxes and check boxes, and the data is sent to a server and stored as a user profile.

[1360] Step 2:

[1361] The user shows their facial expression to the smartphone camera.

[1362] Input: Camera image

[1363] Output: Face image data

[1364] Specific operation: The smartphone camera captures the user's face and acquires video data in real time. The acquired video data is then used to extract the face area using a face detection algorithm (OpenCV).

[1365] Step 3:

[1366] The server receives the facial image data and analyzes the user's emotions using an emotion recognition model (Keras).

[1367] Input: Face image data

[1368] Output: Emotion data

[1369] How it works: The extracted facial image data is converted to grayscale and fed into an emotion recognition model. The model analyzes the image data and identifies the user's emotions (happiness, sadness, surprise, etc.).

[1370] Step 4:

[1371] When a user inputs text, the server receives the text data and analyzes the sentiment using a text analysis library (TextBlob).

[1372] Input: Text data

[1373] Output: Emotion data

[1374] What it does: When a user enters text into a text box in an application, it is sent to a server, which uses TextBlob to analyze the sentiment of the text and classify it as positive, negative, or neutral.

[1375] Step 5:

[1376] The server will suggest the best dishes and restaurants based on the recognized emotional data and the user's preference data.

[1377] Input: Emotion data, user preference data

[1378] Output: Proposal data

[1379] How it works: The server compares the emotion data with the user's preference data to select dishes and restaurants that the user is likely to enjoy. The selected suggestions are then sent to the user's smartphone.

[1380] Step 6:

[1381] If the user expresses anxiety or confusion, the server will provide detailed information and customer support.

[1382] Input: Emotion data

[1383] Output: Support data

[1384] How it works: The server analyzes the user's emotional data and, if it determines that the user is anxious or confused, provides detailed recipe information and customer support contact information, allowing the user to use the service with peace of mind.

[1385] Example 2

[1386] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1387] Conventional travel planning systems do not adequately consider weather and traffic information when presenting plans, and do not adjust plans based on user emotions. Therefore, to increase user satisfaction, flexible planning that takes real-time information and user emotions into account is required.

[1388] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1389] In this invention, the server includes a means for specifying user preferences, a means for presenting a travel plan that takes into account weather and traffic congestion information, a means for making a collective reservation of facilities, accommodations, transportation, etc. based on the selected plan, a means for showing the schedule for the day, a means for presenting different plan patterns based on real-time information such as weather and traffic congestion, and a means for analyzing the user's emotions and adjusting the travel plan based on those emotions. This makes it possible to provide flexible and satisfying travel plans that take into account the user's preferences, real-time information, and even the user's emotions.

[1390] A "means for specifying user preferences" is an interface through which a user can input information such as travel destination, dates, and desired activities.

[1391] "Means for presenting travel plans that take into account weather and traffic information" is a function for generating and presenting optimal travel plans to users based on acquired weather forecast information and traffic information.

[1392] "A means of making bulk reservations for facilities, accommodations, transportation, etc. based on a selected plan" is a function that allows users to make bulk reservations for related facilities, accommodations, and transportation based on the travel plan selected by the user.

[1393] The "means for showing the plans for the day" is a function that allows the user to display the plans that they will carry out on the day of their trip and provide detailed information.

[1394] "A means of presenting alternative plans based on real-time information such as weather and traffic congestion" is a function that suggests alternative travel plans to users based on weather and traffic information obtained in real time.

[1395] "Means for analyzing the user's emotions and adjusting the travel plan based on those emotions" is a function that analyzes the user's facial expressions and voice and adjusts the travel plan based on those emotions.

[1396] The "means for acquiring weather forecast information" is a function for acquiring weather forecast data from a weather information providing service.

[1397] The "means for acquiring traffic information" is a function for acquiring traffic condition data from a traffic information service.

[1398] "Means for analyzing the user's facial expressions and voice" refers to a function for analyzing the user's facial expressions and voice data and identifying emotions.

[1399] MODE FOR CARRYING OUT THE INVENTION

[1400] The present invention provides a system that provides flexible and satisfying travel plans that take into account user preferences, real-time information, and even user emotions. Specific embodiments of this system are described below.

[1401] System configuration

[1402] The system includes a means for specifying user preferences, a means for presenting travel plans that take weather and traffic congestion information into consideration, a means for making reservations for facilities, accommodations, transportation, etc. all at once based on the selected plan, a means for showing the schedule for the day, a means for presenting different plan variations based on real-time information such as weather and traffic congestion, and a means for analyzing the user's emotions and adjusting the travel plan based on those emotions.

[1403] Hardware and software used

[1404] Server: A central processing unit for data acquisition, analysis, and plan generation.

[1405] Device: The device (e.g., smartphone, tablet) where you enter information and view your plan.

[1406] API: A weather information service for obtaining weather forecast information (e.g., the Japan Meteorological Agency's API), or a traffic information service for obtaining traffic information (e.g., Google Maps API).

[1407] Emotion engine: Software for analyzing a user's facial expressions and voice (e.g., Microsoft Azure Cognitive Services).

[1408] Program processing

[1409] 1. Accepting user input

[1410] Users input information such as travel destination, itinerary, and desired activities into the device, which then transmits this information to the server.

[1411] 2. Get weather forecast information

[1412] The server uses the weather information provider's API to obtain weather forecast information for the travel date specified by the user. For example, the server obtains weather information using a URL such as "https: / / api.weather.com / v3 / wx / forecast / daily / 5day?geocode=35.6895,139.6917&format=json&apiKey=YOUR_API_KEY".

[1413] 3. Get traffic information

[1414] The server uses the API of the traffic information service to obtain traffic information to the destination specified by the user. For example, the server obtains traffic information using a URL such as "https: / / maps.googleapis.com / maps / api / directions / json?origin=Tokyo&destination=Kyoto&key=YOUR_API_KEY".

[1415] 4. Analyze user emotions with an emotion engine

[1416] The device captures the user's facial expressions and voice using a camera and microphone and sends them to the emotion engine, which analyzes the user's emotions and sends the results to the server.

[1417] 5. Generate a travel plan

[1418] The server generates an optimal travel plan based on the acquired weather forecast information, traffic information, and the results of user emotion analysis. For example, if rain is predicted, the server generates a plan that includes indoor sightseeing spots. If the user expresses joy, the server generates a plan that includes active activities.

[1419] 6. Present the generated itinerary to the user

[1420] The server sends the generated travel plan to the device, which displays the plan to the user and provides detailed information and recommended routes. The user can review the presented plan and make corrections or additions as needed.

[1421] Specific examples

[1422] If it's going to rain on the day the user is planning to travel, the server will offer the following plan:

[1423] Visiting indoor art galleries and museums

[1424] Shopping at the mall

[1425] Indoor activities (e.g. bowling, karaoke)

[1426] It also suggests routes and travel methods to avoid congestion based on traffic information. For example, if major roads are congested, the server will recommend using public transport.

[1427] If the user is happy, the server suggests the following active plans:

[1428] Outdoor activities (e.g. hiking, cycling)

[1429] Amusement park visit

[1430] Watching sporting events

[1431] On the other hand, if the user expresses anxiety or confusion, the server suggests a more relaxed plan:

[1432] Visiting hot springs and spas

[1433] Relaxing at the cafe

[1434] Sightseeing on a guided tour

[1435] Prompt Sentence Examples

[1436] An example of a prompt to input to a generative AI model is as follows:

[1437] "If it's going to rain on the day a user is planning a trip, suggest itineraries that include indoor tourist attractions. Also, if major roads are congested, create itineraries that encourage people to use public transportation."

[1438]

[1439] "If the user is expressing joy, suggest an active itinerary. If the user is expressing anxiety or confusion, create a relaxing itinerary or one that provides detailed information."

[1440] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1441] Step 1:

[1442] The user inputs information such as the travel destination, itinerary, and desired activities into the terminal. The terminal then sends this information to the server. The input data includes the destination (e.g., Kyoto), itinerary (e.g., October 15, 2023), and desired activities (e.g., sightseeing). The server receives this data and proceeds to the next processing step.

[1443] Step 2:

[1444] The server uses the weather information service's API to obtain weather forecast information for the travel itinerary specified by the user. For example, the server obtains weather information using a URL such as "https: / / api.weather.com / v3 / wx / forecast / daily / 5day?geocode=35.6895,139.6917&format=json&apiKey=YOUR_API_KEY". The input data is the destination's latitude and longitude and travel date, and the output data is the weather forecast information for the specified travel date. The server saves the obtained weather forecast information and proceeds to the next processing step.

[1445] Step 3:

[1446] The server uses the API of the traffic information service to obtain traffic information to the destination specified by the user. For example, the server obtains traffic information using a URL such as "https: / / maps.googleapis.com / maps / api / directions / json?origin=Tokyo&destination=Kyoto&key=YOUR_API_KEY". The input data is the departure point and destination, and the output data is traffic information for the specified route. The server saves the obtained traffic information and proceeds to the next processing step.

[1447] Step 4:

[1448] The device captures the user's facial expressions and voice using a camera and microphone and sends them to the emotion engine. The emotion engine analyzes the user's emotions and sends the results to the server. The input data is the user's facial expressions and voice data, and the output data is the analyzed emotion information. The server saves the acquired emotion information and proceeds to the next processing step.

[1449] Step 5:

[1450] The server generates an optimal travel plan based on the acquired weather forecast information, traffic information, and the results of user emotion analysis. For example, if rain is predicted, the server generates a plan that includes indoor tourist attractions. If the user expresses joy, the server generates a plan that includes active activities. The input data are weather forecast information, traffic information, and emotion information, and the output data is the generated travel plan. The server saves the generated travel plan and proceeds to the next processing step.

[1451] Step 6:

[1452] The server sends the generated travel plan to the terminal. The terminal displays the plan to the user and provides detailed information and recommended routes. The input data is the generated travel plan, and the output data is the plan information displayed to the user. The user can review the presented plan and make corrections or additions as necessary.

[1453] (Application example 2)

[1454] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1455] Conventional travel plan suggestion systems consider weather forecasts and traffic information when presenting plans, but lack the flexibility to respond based on user emotions and real-time information.Furthermore, in food delivery, optimal suggestions are not made based on weather, traffic conditions, or user emotions, making it difficult to improve user satisfaction.

[1456] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1457] In this invention, the server includes a means for specifying a user's preferences, a means for presenting a travel plan that takes into account weather and traffic congestion information, a means for making a collective reservation of facilities, accommodations, transportation, vehicles, etc. based on the selected plan, a means for showing the schedule for the day, a means for presenting different plan patterns based on real-time information such as weather and traffic congestion, a means for acquiring weather forecast information and traffic information and proposing optimal delivery times and routes, and a means for recognizing the user's emotions and proposing meals according to the emotions. This enables flexible travel plan presentation and optimization of food delivery based on the user's emotions and real-time information.

[1458] A "means for specifying user preferences" is an interface or function that allows a user to input or select their preferences or wishes.

[1459] "A means of presenting travel plans that take into account weather and traffic information" is a function that suggests optimal travel plans to users based on weather forecast information and traffic information.

[1460] "A means of booking facilities, accommodations, transportation, vehicles, etc. all at once" is a function for booking related facilities and services all at once based on the selected travel plan.

[1461] The "means for showing plans for the day" is a function that allows the user to display the plans and schedule that the user will carry out on the day of the trip.

[1462] "A means of presenting alternative plans based on real-time information such as weather and traffic congestion" is a function that suggests alternative travel plans based on weather and traffic conditions obtained in real time.

[1463] "Means of obtaining weather forecast information and traffic information and proposing optimal delivery times and routes" is a function that collects weather forecast information and traffic information and, based on that, proposes optimal delivery times and routes to users.

[1464] "Means for recognizing the user's emotions and suggesting meals according to those emotions" is a function that analyzes the user's emotions and suggests the optimal meal according to those emotions.

[1465] A system for implementing this invention includes means for specifying user preferences, means for presenting a travel plan that takes weather and traffic congestion information into consideration, means for making collective reservations for facilities, accommodations, transportation, vehicles, etc. based on the selected plan, means for showing the schedule for the day, means for presenting different plan patterns based on real-time information such as weather and traffic congestion, means for acquiring weather forecast information and traffic information and proposing optimal delivery times and routes, and means for recognizing the user's emotions and proposing meals according to the emotions.

[1466] Program processing explanation

[1467] Hardware used

[1468] Smartphone

[1469] Software used

[1470] Python

[1471] Weather API (e.g. WeatherAPI)

[1472] Traffic API (e.g. TrafficAPI)

[1473] Data processing and calculation

[1474] The server first provides an interface for users to specify their preferences. The preference data entered by the user is sent to the server and stored. The server then uses the Weather API and Traffic API to obtain weather forecast information and traffic information. This allows the server to collect weather forecast information and traffic information for the specified location.

[1475] The server generates an optimal travel plan based on the collected weather forecast and traffic information and presents it to the user. Based on the plan selected by the user, the server makes a bulk reservation of related facilities and services (e.g., accommodation, transportation, vehicles, etc.).

[1476] In addition, the server provides an interface for showing the current day's schedule, displaying the user's plans and schedule for the day of travel. Based on real-time weather and traffic conditions, the server suggests alternative travel plans.

[1477] The server also suggests optimal delivery times and routes based on weather forecasts and traffic information. To recognize user emotions, it uses an emotion analysis algorithm to analyze emotions from user input. Based on the analysis results, the server suggests the optimal meal according to the emotion.

[1478] Specific examples

[1479] For example, if a user types, "I'm so happy today!", the server uses a sentiment analysis algorithm to recognize the user's emotion as "joy." The server then suggests, "You seem happy, so I recommend a special dessert."

[1480] Prompt Sentence Examples

[1481] location = 'Tokyo'

[1482] user_input = 'I'm so happy today!'

[1483] print(suggest_delivery_plan(location, user_input))

[1484] In this way, a smart food delivery and travel plan presentation system can be realized that combines weather forecast information, traffic information, and emotion recognition.

[1485] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1486] Step 1:

[1487] Specifying user preferences

[1488] Users input their preferences and wishes through a smartphone interface, which is then sent to a server and stored in a database.

[1489] Input: User preferences and wishes (e.g., types of food, travel destinations)

[1490] Output: User preference data stored on the server

[1491] Step 2:

[1492] Obtaining weather and traffic information

[1493] The server uses the Weather API and Traffic API to retrieve weather forecast and traffic information for the specified location.

[1494] Input: A specified location (e.g. Tokyo)

[1495] Output: Weather forecast and traffic information

[1496] Step 3:

[1497] Generate a travel plan

[1498] The server generates an optimal travel plan based on the acquired weather forecast and traffic information, as well as the user's preference data.

[1499] Input: Weather forecast information, traffic information, user preference data

[1500] Output: Optimal travel plan

[1501] Step 4:

[1502] Presenting your travel plan

[1503] The server presents the generated travel plans to the user, who then selects from the plans presented.

[1504] Input: Optimal travel plan

[1505] Output: The itinerary presented to the user

[1506] Step 5:

[1507] Making bulk reservations

[1508] Based on the travel plan selected by the user, the server makes a bulk reservation of related facilities and services (e.g., accommodation, transportation, vehicles, etc.).

[1509] Input: User selected travel plan

[1510] Output: Facilities and services booked together

[1511] Step 6:

[1512] Viewing today's schedule

[1513] The server provides an interface that displays the plans and schedule that the user will follow on the day of the trip.

[1514] Input: User selected travel plan

[1515] Output: Today's events and schedule

[1516] Step 7:

[1517] Plan changes suggested based on real-time information

[1518] The server suggests alternative travel plans based on real-time weather and traffic conditions.

[1519] Input: Real-time weather and traffic information

[1520] Output: Alternative travel plans

[1521] Step 8:

[1522] Delivery time and route suggestions

[1523] The server uses weather forecast and traffic information to suggest optimal delivery times and routes to users.

[1524] Input: Weather and traffic information

[1525] Output: Optimal delivery time and route

[1526] Step 9:

[1527] Emotion Recognition and Meal Suggestions

[1528] The server analyzes the user's emotions from their input and suggests the best meal based on that emotion.

[1529] Input: User emotional input (e.g., "I'm so happy today!")

[1530] Output: Emotion-based meal suggestions

[1531] For example, if a user types, "I'm so happy today!", the server will use an emotion analysis algorithm to recognize the user's emotion as "joy" and suggest, "You seem happy, so I recommend a special dessert."

[1532] Example 3

[1533] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1534] Conventional travel planning systems require users to make individual reservations for accommodations, transportation, vehicles, etc., and have the problem of making it difficult to change plans based on real-time information such as weather and traffic congestion. Furthermore, they are unable to suggest changes to plans based on the user's emotions, making it difficult to increase satisfaction during the trip.

[1535] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1536] In this invention, the server includes means for specifying user preferences, means for presenting a travel plan that takes weather and traffic congestion information into consideration, means for making a collective reservation for accommodations, transportation, vehicles, etc. based on the selected plan, means for showing the schedule for the day, means for presenting alternative plans based on real-time information such as weather and traffic congestion, and means for recognizing the user's emotions in real time and suggesting changes to the plan in accordance with the emotions. This saves the user the trouble of making individual reservations, enables flexible plan changes based on real-time information, and further increases satisfaction during the trip by receiving suggestions for plan changes in accordance with the user's emotions.

[1537] A "means for specifying user preferences" is a feature that provides an interface for users to input or select their travel preferences and wishes.

[1538] "Means for presenting travel plans that take into account weather and traffic information" refers to a function that obtains weather forecast information and traffic information, generates optimal travel plans based on that information, and presents them to the user.

[1539] "A means of making bulk reservations for accommodation, transportation, vehicles, etc. based on a selected plan" refers to a function that allows users to make bulk reservations for accommodation, transportation, vehicles, etc. based on a travel plan selected by the user.

[1540] The "means for showing the schedule for the day" is a function that generates the schedule and plans for the day based on the user's travel plan and displays them to the user.

[1541] "A means of presenting alternative plans based on real-time information such as weather and traffic congestion" refers to a function that reevaluates the current plan based on weather and traffic information obtained in real time, and generates and proposes an alternative plan to the user if necessary.

[1542] "Means of recognizing the user's emotions in real time and suggesting changes to the plan based on those emotions" refers to a function that uses sensors and cameras to recognize the user's emotions in real time and suggests optimal changes to the plan based on those emotions.

[1543] This invention is a system that allows users to select a travel plan and book accommodations, transportation, vehicles, etc. in one go based on that plan. It also has the ability to change the plan taking into account real-time information such as weather and traffic congestion, and to recognize the user's emotions in real time and suggest changes to the plan based on those emotions.

[1544] System configuration

[1545] Hardware

[1546] Server: A central processing unit for data processing and communication with various APIs.

[1547] Terminal: A device that a user operates (such as a smartphone or tablet).

[1548] Sensors and cameras: Devices for recognizing user emotions in real time.

[1549] software

[1550] Reservation management software: Software for managing reservations for accommodation, transportation, vehicles, etc. all in one place.

[1551] Weather Forecast API: An interface for obtaining weather information.

[1552] Traffic Information API: An interface for obtaining traffic conditions.

[1553] Emotion recognition software: Software used to analyze user emotions (e.g., Microsoft Azure's Emotion API).

[1554] Program processing

[1555] 1. The user selects a travel plan

[1556] The user opens the application on the device and selects one of the travel plans provided. The device then sends the information about the selected plan to the server.

[1557] 2. The server collects reservation information based on the selected plan.

[1558] The server collects the necessary reservation information (hotel, transportation, rental car, etc.) based on the plan selected by the user. The server checks the API endpoints of each service and prepares the data required for the reservation.

[1559] 3. The server makes a bulk reservation using the API of each service.

[1560] The server makes reservations in bulk using hotel booking API, transportation API, rental car booking API, etc. The server receives responses from each API and checks whether the reservations were successful.

[1561] 4. The server notifies the user of the reservation completion information.

[1562] The server generates information indicating that the reservation has been completed and notifies the user. The terminal displays a notification of the reservation completion to the user.

[1563] 5. The server generates the schedule for the day and sends it to the device.

[1564] The server generates a schedule for the day based on the user's travel plan and sends the generated schedule to the terminal.

[1565] 6. The device displays the user's schedule for the day.

[1566] The device displays the schedule for the day received from the server to the user, who then checks the displayed schedule.

[1567] 7. The server retrieves the real-time information and re-evaluates the plan.

[1568] The server retrieves real-time information from weather and traffic APIs, and reevaluates the user's plan based on the information retrieved.

[1569] 8. The server generates alternative plans as needed and proposes them to the user.

[1570] The server generates a different plan based on the results of the reevaluation and proposes the generated plan to the user.

[1571] 9. The device will recognize the user's emotions in real time.

[1572] The device uses built-in sensors and cameras to recognize the user's emotions in real time, and transmits the recognized emotion data to a server.

[1573] 10. The server suggests changes to the plan based on the emotion recognition results.

[1574] The server uses emotion recognition software to analyze the user's emotions, and based on the analysis results, the server suggests changes to the plan that are appropriate for the user's emotions.

[1575] 11. The user reviews the proposed plan and approves any changes as needed.

[1576] The user reviews the proposed plan displayed on the device and approves any changes if necessary. The device then sends the user's approval to the server and applies the new plan.

[1577] Examples and prompts

[1578] Specific examples

[1579] If the user selects "Tourism Plan A," the server will use the hotel reservation API to reserve accommodation and the Shinkansen reservation API to secure transportation.

[1580] On the day of the trip, the device will display, "You will check out of the hotel at 10:00 and plan to arrive at tourist spot B at 11:00."

[1581] If rain is forecast for the afternoon, the server will notify the user, "We suggest changing your afternoon sightseeing spot to indoor facility C."

[1582] If the user feels stressed during their trip, the server will notify them, "We suggest changing to a relaxing spa facility D."

[1583] Prompt Sentence Examples

[1584] "Please generate a program that makes hotel and Shinkansen reservations in one go for users who have selected sightseeing plan A."

[1585] "Generate a program that recognizes user emotions in real time and makes suggestions to change travel plans based on those emotions."

[1586] In this way, the system can improve user convenience and enhance satisfaction during travel. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1587] Step 1:

[1588] The user opens the application on their device and selects one of the multiple travel plans available.

[1589] Input: The ID of the itinerary selected by the user.

[1590] Output: The ID of the selected plan is sent to the server.

[1591] Specific operation: The user selects "Tourist Plan A" and the terminal sends the plan ID to the server.

[1592] Step 2:

[1593] The server collects the necessary reservation information (hotel, transportation, rental car, etc.) based on the plan selected by the user.

[1594] Input: The ID of the selected plan.

[1595] Output: Data required for booking (accommodation list, transport options, etc.).

[1596] Specific operation: The server retrieves information on accommodation and transportation related to "Tourist Plan A" from the database.

[1597] Step 3:

[1598] The server makes a bulk reservation using the API of each service.

[1599] Input: Data required for booking (accommodation list, transportation options, etc.).

[1600] Output: Booking confirmation number for each service.

[1601] Specific operation: The server sends a reservation request to the hotel reservation API and receives a reservation confirmation number in response. It also sends requests to the Shinkansen reservation API and the rental car reservation API to complete the reservation for each service.

[1602] Step 4:

[1603] The server generates information indicating that the reservation has been completed and notifies the user.

[1604] Input: Reservation confirmation number for each service.

[1605] Output: A notification message confirming the reservation is complete.

[1606] Specific operation: The server generates a message saying "Reservation completed" and sends it to the terminal, which then displays this notification to the user.

[1607] Step 5:

[1608] The server generates a schedule for the day based on the user's travel plans.

[1609] Input: User's travel plan details.

[1610] Output: Today's schedule.

[1611] Specific operation: The server generates a schedule for the day, such as "Check out of the hotel at 10:00 and plan to arrive at tourist spot B at 11:00," and sends it to the terminal.

[1612] Step 6:

[1613] The terminal displays the schedule for the day received from the server to the user.

[1614] Input: Today's schedule.

[1615] Output: The current day's agenda as displayed to the user.

[1616] Specific operation: The device displays the schedule for the day to the user, and the user confirms it.

[1617] Step 7:

[1618] The server retrieves real-time information from weather and traffic APIs.

[1619] Input: Data requests from weather and traffic APIs.

[1620] Output: Real-time weather and traffic information.

[1621] Specific operation: The server obtains the forecast of "rain in the afternoon" from the weather API and obtains the current traffic conditions from the traffic information API.

[1622] Step 8:

[1623] The server reevaluates the user's plan based on the acquired real-time information and generates a different plan if necessary.

[1624] Input: Real-time weather and traffic information.

[1625] Output: A different pattern plan.

[1626] Specific operation: The server generates a plan to change the afternoon tourist destination to indoor facility C and sends a message to the user saying, "Rain is forecast for the afternoon. We suggest changing the afternoon tourist destination to indoor facility C."

[1627] Step 9:

[1628] The device uses built-in sensors and cameras to recognize the user's emotions in real time.

[1629] Input: User's facial expression data.

[1630] Output: Recognized emotion data.

[1631] How it works: The device uses a camera to capture the user's facial expressions and sends them to emotion recognition software. The recognized emotion data is then sent to the server.

[1632] Step 10:

[1633] The server uses emotion recognition software to analyze the user's emotions.

[1634] Input: Recognized emotion data.

[1635] Output: Suggested plan changes based on emotions.

[1636] Specific operation: The server uses emotion recognition software to analyze that the user is feeling stressed, and generates and sends a message to the user saying, "We suggest you change to a more relaxing spa facility D."

[1637] Step 11:

[1638] The user reviews the proposed plan displayed on the device and approves any changes if necessary.

[1639] Input: Proposed plan.

[1640] Output: User approval.

[1641] Specific operation: The user taps the "Approve changes to Spa Facility D" button, and the device sends the approval to the server. The server applies the new plan.

[1642] (Application example 3)

[1643] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1644] Conventional travel planning systems require users to make individual reservations for shops, accommodations, transportation, vehicles, etc., and it is difficult to change plans based on real-time information such as weather and traffic congestion. Additionally, they are unable to suggest changes to plans based on the user's emotions, which means they are unable to reduce stress and frustration during travel.

[1645] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes a means for specifying the user's preferences, a means for presenting a travel plan that takes into account weather and traffic congestion information, a means for making a collective reservation of shops, accommodations, transportation, vehicles, etc. based on the selected plan, a means for showing the schedule for the day, a means for presenting alternative plans based on real-time information such as weather and traffic congestion, and a means for recognizing the user's emotions in real time and suggesting changes to the plan based on those emotions. This saves the user the trouble of making individual reservations and enables them to receive optimal plan changes based on real-time information and emotions.

[1646] "Means for specifying user preferences" is a function that provides an interface for users to input or select their preferences or wishes.

[1647] "A means of presenting travel plans that take into account weather and traffic information" is a function that suggests optimal travel plans to users based on weather forecast information and traffic information.

[1648] "A means of making bulk reservations for shops, accommodations, transportation, vehicles, etc. based on a selected plan" refers to a function that allows users to make bulk reservations for related services according to the travel plan selected by the user.

[1649] "Means for showing plans for the day" is a function that displays the plans and schedule that the user needs to complete on the day of the trip.

[1650] "A means of presenting alternative plans based on real-time information such as weather and traffic congestion" is a function that suggests alternative travel plans to users based on weather and traffic information obtained in real time.

[1651] "Means of recognizing the user's emotions in real time and suggesting changes to the plan based on those emotions" refers to a function that analyzes the user's emotional state in real time and suggests appropriate changes to the plan based on the results.

[1652] A system for implementing this invention includes means for specifying user preferences, means for presenting a travel plan that takes into account weather and traffic congestion information, means for making collective reservations for shops, accommodations, transportation, vehicles, etc. based on the selected plan, means for showing the schedule for the day, means for presenting different plan variations based on real-time information such as weather and traffic congestion, and means for recognizing the user's emotions in real time and suggesting changes to the plan in accordance with those emotions.

[1653] System program generation

[1654] The server provides an interface for users to specify their preferences and stores the preferences and wishes entered by the user in a database. It then obtains weather forecast and traffic information and generates an optimal travel plan based on that information. It makes bulk reservations for related services (shops, accommodations, transportation, vehicles, etc.) based on the plan selected by the user. It also shows the user the schedule for the day and suggests alternative plans based on real-time weather and traffic information. It recognizes the user's emotions in real time and suggests changes to the plan based on those emotions.

[1655] Hardware and software used

[1656] The system uses user devices such as smartphones and tablets, servers, weather forecast APIs, traffic information APIs, and emotion recognition software (e.g., Microsoft Azure Cognitive Services).The database uses an SQL database to store user preferences and reservation information.

[1657] Data processing and calculation

[1658] The server receives the user's preference data and stores it in a database. It then uses weather and traffic APIs to obtain real-time information and generates a travel plan based on that. It uses emotion recognition software to analyze the user's emotions and suggests changes to the plan based on the results.

[1659] Specific examples

[1660] For example, if a user is using food delivery in Tokyo and it's raining and the user is feeling stressed, the system will suggest indoor restaurants and cafes where they can relax.

[1661] Example prompts to input to a generative AI model:

[1662] "A user is using food delivery in Tokyo. It's raining, and the user is feeling stressed. Based on this situation, what alternative plan should the system suggest?"

[1663] In this way, users can avoid the hassle of making individual reservations and receive optimal plan changes based on real-time information and emotions.

[1664] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1665] Step 1:

[1666] The user inputs their preferences using the terminal. The terminal provides an interface for the user to input their tastes and wishes, and sends the data they input to the server. The input data includes the type of meal, budget, and favorite dishes. The server stores the received data in a database.

[1667] Step 2:

[1668] The server obtains real-time weather and traffic information using the weather forecast API and traffic information API. The server analyzes the data obtained from the API to understand the current weather and traffic conditions. The input is data from the API, and the output is the analyzed weather and traffic information.

[1669] Step 3:

[1670] The server generates an optimal travel plan based on the user's preferences and real-time weather and traffic information. The server combines the user's preference data stored in the database with the analyzed weather and traffic information to create an optimal plan for the user. The input is the user's preference data and real-time information, and the output is the generated travel plan.

[1671] Step 4:

[1672] The user selects the generated travel plan using the terminal. The terminal displays the travel plan received from the server to the user and sends the plan selected by the user to the server. The input is the travel plan from the server and the output is the plan selected by the user.

[1673] Step 5:

[1674] The server makes reservations for shops, accommodations, transportation, vehicles, etc. in bulk based on the selected plan. The server uses the reservation API of each service to make the necessary reservations in bulk. The input is the plan selected by the user, and the output is confirmation that the reservation has been completed.

[1675] Step 6:

[1676] The server shows the user the schedule for the day. Based on the generated travel plan, the server sends the user's plans and schedule for the day to the terminal. The input is the generated travel plan, and the output is the schedule information for the day.

[1677] Step 7:

[1678] The server proposes an alternative plan based on real-time weather and traffic information. The server monitors changes in weather and traffic conditions and presents an alternative plan to the user as needed. The input is real-time information, and the output is an alternative plan.

[1679] Step 8:

[1680] The server uses emotion recognition software to recognize the user's emotions in real time. The server analyzes the user's facial and voice data to understand the user's emotional state. The input is the user's facial and voice data, and the output is the analyzed emotional information.

[1681] Step 9:

[1682] The server proposes plan changes according to the user's emotions. The server proposes plan changes appropriate for the user based on the analyzed emotional information. The input is the analyzed emotional information, and the output is a plan change proposal according to the emotion.

[1683] In this way, users can avoid the hassle of making individual reservations and receive optimal plan changes based on real-time information and emotions.

[1684] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1685] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1686] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[1687] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1688] [Third embodiment]

[1689] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1690] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1691] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1692] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1693] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1694] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1695] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1696] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1697] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1698] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1699] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1700] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1701] "Example 1"

[1702] The system of the present invention has a means for receiving user preferences through a user interface, for example, the user can specify travel destinations, preferred meals, types of accommodation, means of transportation, etc.

[1703] "Example 2"

[1704] The system of the present invention also includes means for acquiring weather forecast information and traffic information. This information is taken into consideration when presenting a travel plan. For example, if rain is predicted, a plan recommending indoor tourist spots is presented. Furthermore, based on the traffic information, transportation methods and routes that avoid crowds are suggested.

[1705] "Example 3"

[1706] Furthermore, the system of the present invention has a means for making collective reservations for shops, hotels, bullet trains, rental cars, etc. based on the selected plan, which saves the user the trouble of making reservations for each service individually.

[1707] "Example 4"

[1708] The system of the present invention also has a means for displaying the schedule for the day, which allows the user to easily understand what to do on the day of travel.

[1709] "Example 5"

[1710] Furthermore, the system of the present invention has a means for presenting alternative plans based on real-time information such as weather and traffic congestion. This allows users to receive suggestions for changing their plans to accommodate unexpected changes in weather or traffic conditions. For example, if rain is predicted for the afternoon, a suggestion is made to change the afternoon sightseeing spot to an indoor facility.

[1711] The processing flow of each embodiment will be described below.

[1712] "Example 1"

[1713] Step 1: The user specifies the travel destination, preferred meals, type of accommodation, mode of transportation, etc. through the system's user interface.

[1714] Step 2: The system generates a travel plan based on the user's input, taking into account weather and traffic information.

[1715] Step 3: The system presents the generated itinerary to the user.

[1716] "Example 2"

[1717] Step 1: When the user selects a proposed travel plan, the system will make a bulk reservation for the shops, hotels, bullet trains, rental cars, etc. included in that plan.

[1718] Step 2: The system provides the reservation confirmation information to the user.

[1719] "Example 3"

[1720] Step 1: On the day of travel, the system shows the user the schedule for the day.

[1721] Step 2: The system will suggest alternative plans as needed based on real-time information such as weather and traffic congestion.

[1722] Step 3: Once the user selects a new plan, the system will make the necessary changes to the reservation.

[1723] Example 1

[1724] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1725] Conventional travel plan generation systems have difficulty automatically generating travel plans that reflect the user's preferences in detail. Furthermore, they do not adequately suggest changes to the plan that take into account real-time information such as weather and traffic congestion. Furthermore, there is a lack of technology that can generate prompts based on the user's preferences and generate travel plans using a generative AI model.

[1726] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1727] In this invention, the server includes means for generating prompt sentences based on the user's preferences and generating a travel plan using a generative AI model, means for providing the generated travel plan to the user, and means for presenting alternative plans based on real-time information such as weather and traffic congestion. This enables the automatic generation of travel plans that reflect the user's preferences in detail, and also makes it possible to suggest changes to the plan that take real-time information into consideration.

[1728] A "means for specifying user preferences" is a means for providing an interface for a user to input information such as travel destination, preferred meals, type of accommodation, and mode of transportation.

[1729] "Means for presenting travel plans that take into account weather and traffic information" refers to means for obtaining weather forecast information and traffic information and presenting optimal travel plans to users based on that information.

[1730] "A means of making a collective reservation for shops, accommodations, transportation, etc. based on a selected plan" means a means of making a collective reservation for related shops, accommodations, transportation, etc. based on a travel plan selected by the user.

[1731] The "means for showing the schedule for the day" is a means for showing the user the schedule and plans for the day of travel.

[1732] "Means for presenting alternative plans based on real-time information such as weather and traffic congestion" refers to means for presenting alternative travel plans to users based on weather and traffic information obtained in real time.

[1733] "Means for generating prompt sentences based on user preferences and generating travel plans using a generative AI model" refers to means for generating prompt sentences based on preference information input by a user, and inputting the prompt sentences into a generative AI model to generate travel plans.

[1734] "Means for providing a generated travel plan to a user" means means for providing a travel plan generated by a generative AI model to a user.

[1735] MODE FOR CARRYING OUT THE INVENTION

[1736] This invention is a system that automatically generates travel plans based on user preferences and proposes changes to the plan taking real-time information into account. The system receives user preferences through a user interface and generates an optimal travel plan using a generative AI model.

[1737] Hardware and software used

[1738] Hardware:

[1739] Server: Stores and processes data and runs generative AI models.

[1740] Device: The device (smartphone, tablet, PC, etc.) where the user enters information and views the generated itinerary.

[1741] software:

[1742] Database Management System: A system such as MySQL or PostgreSQL to store user preferences and generated itineraries.

[1743] Generative AI models: Models for generating travel plans based on user preferences, such as OpenAI's GPT-4.

[1744] Communication protocol: A protocol for sending and receiving data between a device and a server, such as an HTTP request.

[1745] Program processing

[1746] The server receives information entered by the user through their device, such as travel destinations, preferred meals, types of accommodation, and transportation methods. The received information is stored in a database. The server then generates prompt sentences based on the stored information and inputs them into the generative AI model.

[1747] The generative AI model generates a travel plan that matches the user's preferences based on the prompt text, and the generated travel plan is sent to the device via the server and provided to the user.

[1748] Specific examples

[1749] Suppose a user enters the following preferences:

[1750] Travel destination: Paris

[1751] Favorite food: French cuisine

[1752] Type of accommodation: Luxury hotel

[1753] Transportation: Plane

[1754] In this case, the server will input the following prompt into the generative AI model:

[1755] "The user wants to travel to Paris, enjoys French cuisine, stays in a luxury hotel, and travels by plane. Generate the best itinerary based on this."

[1756] Based on this prompt, the generative AI model might generate a travel plan like this:

[1757] Visit Paris's tourist attractions (Eiffel Tower, Louvre, etc.)

[1758] Dinner at a Michelin-starred French restaurant

[1759] Accommodation in a luxury hotel on the Champs-Élysées

[1760] Direct plane ticket to Paris

[1761] The generated travel plan is sent to the user's device via the server, where the user can check the plan. The server can also present different plans based on real-time information such as weather and traffic congestion.

[1762] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1763] Program processing flow

[1764] Step 1:

[1765] The user inputs their preferences through the device

[1766] Specific behavior:

[1767] The user inputs information such as travel destination, preferred meals, type of accommodation, and mode of transportation into the terminal's user interface.

[1768] input:

[1769] Travel destination (e.g. Paris)

[1770] Favorite food (e.g. French cuisine)

[1771] Type of accommodation (e.g. luxury hotel)

[1772] Transportation (e.g., airplane)

[1773] output:

[1774] User preference information is entered into the terminal.

[1775] Step 2:

[1776] The device sends the entered information to the server.

[1777] Specific behavior:

[1778] The device sends the information entered by the user to the server in JSON format using an HTTP request.

[1779] input:

[1780] User-entered preference information

[1781] output:

[1782] The data is sent to the server in JSON format.

[1783] Step 3:

[1784] The server stores the received information in a database

[1785] Specific behavior:

[1786] The server analyzes the JSON data received from the device and stores it in a database, for example, using a database management system such as MySQL or PostgreSQL.

[1787] input:

[1788] JSON data sent from the terminal

[1789] output:

[1790] A database stores user preference information.

[1791] Step 4:

[1792] The server generates a prompt based on the stored information.

[1793] Specific behavior:

[1794] The server retrieves the user's preferences from a database and generates prompts, which are textual inputs to the generative AI model.

[1795] input:

[1796] User preference information stored in a database

[1797] output:

[1798] Prompt statement (e.g., "The user wants to travel to Paris, enjoys French cuisine, stays in a luxury hotel, and travels by plane. Based on this, generate the optimal itinerary.")

[1799] Step 5:

[1800] The server inputs prompts into the generative AI model and generates a travel plan.

[1801] Specific behavior:

[1802] The server inputs the prompt sentence into a generative AI model (e.g., OpenAI's GPT-4) to generate a travel plan. The generative AI model generates a travel plan that matches the user's preferences based on the prompt sentence.

[1803] input:

[1804] Prompt statement

[1805] output:

[1806] Generated itinerary (e.g., visit to Parisian attractions, dinner at a Michelin-starred French restaurant, accommodation at a luxury hotel, and direct flight tickets to Paris)

[1807] Step 6:

[1808] The server sends the generated travel plan to the device.

[1809] Specific behavior:

[1810] The server sends the generated itinerary in JSON format to the device using an HTTP request.

[1811] input:

[1812] Generated itinerary

[1813] output:

[1814] The travel plan in JSON format is sent to the device.

[1815] Step 7:

[1816] The user checks the travel plan through the device.

[1817] Specific behavior:

[1818] The user can check the travel plan sent from the server through the terminal, and can request corrections or additions as needed after viewing the generated travel plan.

[1819] input:

[1820] Travel plans sent from the server

[1821] output:

[1822] Travel plans confirmed by the user

[1823] (Application example 1)

[1824] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1825] Conventional travel planning systems can present travel plans that take into account user preferences and real-time information, but they have the problem of not being able to suggest restaurants that take into account the user's dietary preferences and allergy information. They also lack the functionality to learn from the user's past ordering history and ratings to make more accurate suggestions. This often makes it difficult for users to find suitable restaurants during their trip.

[1826] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1827] In this invention, the server includes means for specifying user preferences, means for presenting a travel plan that takes weather and traffic congestion information into consideration, means for making collective reservations for facilities, accommodations, transportation, etc. based on the selected plan, means for showing the schedule for the day, means for presenting alternative plans based on real-time information such as weather and traffic congestion, means for receiving the user's food preferences and allergy information and suggesting optimal restaurants and menus based thereon, and means for learning the user's past ordering history and ratings to make more accurate suggestions, thereby enabling users to easily find restaurants that meet their preferences and allergies even while traveling.

[1828] A "means for specifying user preferences" is a means for providing an interface for a user to input their travel and dining preferences and requirements.

[1829] "Means for presenting travel plans that take into account weather and traffic information" refers to means for proposing optimal travel plans to users based on weather forecast information and traffic information.

[1830] "A means of reserving facilities, accommodations, transportation, etc. all at once based on the selected plan" means a means of reserving the necessary facilities, accommodations, and transportation all at once based on the travel plan selected by the user.

[1831] The "means for showing the plans for the day" is a means for displaying the schedule and plans for the user on the day of the trip.

[1832] "Means of presenting alternative plans based on real-time information such as weather and traffic congestion" refers to a means of suggesting alternative travel plans to users based on weather and traffic information obtained in real time.

[1833] "Means for receiving a user's food preferences and allergy information and suggesting the most suitable restaurant and menu based on that" refers to a means for having a user input information about their food preferences and allergies and then suggesting appropriate restaurants and menus based on that information.

[1834] "Means for learning from a user's past order history and ratings to make more accurate suggestions" refers to a means for analyzing a user's past order history and rating data and making more appropriate suggestions based on that.

[1835] To implement this invention, the following system configuration is required: The system includes means for specifying user preferences, means for presenting a travel plan that takes into account weather and traffic congestion information, means for making collective reservations for facilities, accommodations, transportation, etc. based on the selected plan, means for showing the schedule for the day, means for presenting different plan variations based on real-time information such as weather and traffic congestion, means for receiving the user's food preferences and allergy information and suggesting optimal restaurants and menus based on that information, and means for learning the user's past ordering history and ratings to make more accurate suggestions.

[1836] System Program

[1837] The system is implemented in Python using the machine learning library scikit-learn as its primary library. The user interface is provided as a smartphone application, which includes a form for entering user preferences and allergy information.

[1838] Processing Description

[1839] Hardware

[1840] Smartphone: Provides the user interface and receives user input.

[1841] Server: Processes and stores data.

[1842] software

[1843] Python: Used for data processing and implementing machine learning models.

[1844] scikit-learn: A machine learning library for learning user preferences and past order history to make suggestions.

[1845] Data processing and calculation

[1846] 1. Input of user preferences: Through a smartphone application, users input their travel destination, preferred meals, type of accommodation, mode of transportation, dietary preferences and allergy information.

[1847] 2. Data Vectorization: The input data is vectorized using TfidfVectorizer.

[1848] 3. Similarity calculation: The user preferences and restaurant menu information are vectorized and the cosine similarity is calculated.

[1849] 4. Suggestion generation: Suggest the most similar restaurants and menus to the user.

[1850] 5. Learning from past history: Learn from the user's past order history and ratings and reflect them in the next suggestion.

[1851] Specific examples

[1852] If a user specifies that they are a vegetarian and like Italian food, the system will suggest Restaurant A. The system also takes into account the user's past ordering history and ratings, improving the accuracy of the suggestions.

[1853] Prompt Sentence Examples

[1854] I'm a vegetarian and I love Italian food. I have a nut allergy. Can you recommend any restaurants?

[1855] In this way, it becomes possible to provide personalized travel plans and food delivery services based on user preferences.

[1856] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1857] Step 1:

[1858] Users launch a smartphone application and input their travel destination, preferred meals, type of accommodation, mode of transportation, dietary preferences, and allergy information. The input data is sent to the server. Examples of input data include "I'm a vegetarian and I like Italian food" and "I have a nut allergy."

[1859] Step 2:

[1860] The server analyzes the received user preference data and vectorizes it using TfidfVectorizer. By vectorizing the input data (user preferences), it can be treated as numerical data, which allows subsequent similarity calculations.

[1861] Step 3:

[1862] The server retrieves restaurant menu information from the database and similarly vectorizes it using TfidfVectorizer. By vectorizing the input data (restaurant menu information), it is converted into a format that can be compared with user preferences.

[1863] Step 4:

[1864] The server calculates the cosine similarity between the user's preference vector and the restaurant's menu vector. Using the input data (user's preference vector and restaurant's menu vector), the server calculates the similarity and identifies the restaurant with the highest similarity. This allows the server to select the restaurant that best suits the user's preferences.

[1865] Step 5:

[1866] Based on the calculation results, the server recommends the most suitable restaurant and menu to the user. It generates output data (information on the best restaurant and menu) and sends it to a smartphone application. The user can then check the recommendations through the application.

[1867] Step 6:

[1868] The user selects a restaurant and menu from the suggestions and confirms the order. The input data (user selection information) is sent to the server, and the order is processed.

[1869] Step 7:

[1870] The server stores the user's order history and ratings in a database and reflects them in the next recommendation. It learns from the input data (user's order history and ratings) and uses them to improve the accuracy of the next recommendation.

[1871] In this way, it is possible to provide personalized travel plans and food delivery services based on the user's preferences.

[1872] Example 2

[1873] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1874] Conventional travel planning systems have struggled to provide plans that fully consider user preferences and real-time weather and traffic information. There is also a demand for flexible plans that can quickly adapt to changes in weather and traffic conditions. Furthermore, there is a lack of systems that allow users to make reservations for facilities, accommodations, high-speed trains, rental cars, and more all at once. This has led to issues such as users spending a great deal of time and effort on trip planning, which can compromise the comfort of their trip.

[1875] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1876] In this invention, the server includes means for specifying user preferences, means for presenting a travel plan that takes weather and traffic information into consideration, means for making collective reservations for facilities, accommodations, high-speed trains, rental cars, etc. based on the selected plan, means for showing the schedule for the day, means for presenting different plan variations based on real-time information such as weather and traffic, means for acquiring weather forecast information, means for acquiring traffic information, means for analyzing the acquired weather forecast information and traffic information, means for generating a travel plan based on the analysis results, and means for presenting the generated travel plan to the user. This allows the user to easily obtain the optimal travel plan that takes real-time information into consideration and make the necessary reservations all at once.

[1877] A "means for specifying user preferences" is an ...

Claims

1. a means for inputting the user's travel preferences and wishes; means for generating a prompt sentence for instructing the generation of an optimal travel plan based on the inputted user's preferences and wishes; A means for generating a travel plan that matches the user's preferences and wishes using the generated prompt sentences and the generative AI model; A means for presenting the generated travel plan to a user; A means for receiving selections from a user regarding the presented travel plan; A means for making bulk reservations for related services and facilities based on a travel plan selected by a user; means for displaying an event or schedule of the selected travel plan based on the bundled services and facilities; A system including:

2. A means to obtain real-time weather forecast and traffic information for the day of travel, A means for generating and proposing alternative travel plans based on the acquired weather forecast information and traffic congestion information; The system of claim 1 further comprising:

3. A means for recognizing the emotional state of the user during the trip by analyzing the user's facial expressions and voice in real time using an emotion engine; means for suggesting changes to a travel plan based on the recognized emotional state of the user; The system of claim 1 further comprising:

Images