system

Abstract

We provide the system. [Solution] An input method for receiving information related to the user's travel, A communication means for obtaining weather information, transportation information, and accommodation information, A processing method that generates multiple travel plans based on the user's preferences and budget, based on the acquired information, A display means that provides the generated travel plan to the user and accepts their selection, A reservation method that confirms a reservation based on the user's selection, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] It is to solve the problems of reducing the time and labor required for information collection and planning that users face when planning a trip, and being able to manage the costs and risks associated with schedule changes during the trip. Also, it is to enable the provision of a personalized travel experience considering the individual preferences and past travel history of users.

Means for Solving the Problems

[0005] The present invention solves the aforementioned problems through a system that includes an input means for receiving user travel-related information, a communication means for acquiring weather information, transportation information, and accommodation information, a processing means for generating multiple travel plans based on the user's preferences and budget based on the acquired information, a display means for providing the generated travel plans to the user and accepting their selection, and a booking means for confirming the booking based on the user's selection. As a result, users can build travel plans without effort, enjoy a personalized experience, and respond quickly to changes in plans.

[0006] An "input means" is a device or interface for a user to input travel-related information and for a system to receive that information.

[0007] "Communication methods" refer to technologies that connect with external databases and APIs to obtain information such as weather, transportation, and accommodation.

[0008] The "processing means" refers to the part that, based on the acquired information, executes processes and algorithms to generate multiple travel plans based on the user's preferences and budget, and to appropriately combine them.

[0009] "Display means" refers to a device or interface for providing a generated travel plan to the user and accepting their selection.

[0010] "Reservation method" refers to a system function for confirming and managing related reservations based on the travel plan selected by the user. [Brief explanation of the drawing]

[0011] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3]This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]

[0012] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.

[0013] First, let's explain the terminology used in the following explanation.

[0014] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0015] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0016] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0017] In the following embodiments, the numbered communication I / F (Interface) is an interface that includes a communication processor and an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applicable to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), etc.

[0018] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0019] [First Embodiment]

[0020] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0021] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0022] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0023] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0024] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0025] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0026] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0027] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0028] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0029] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0030] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0031] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0032] The present invention is a system for supporting travel planning, and its purpose is to receive travel information from the user, generate an appropriate travel plan, and provide it to the user.

[0033] Overall system configuration

[0034] The system consists of the following main components: terminals for users to input travel information, various APIs that the server interacts with, and various databases.

[0035] Program processing

[0036] Input stage

[0037] The user enters basic travel information (e.g., departure date, destination, budget, preferred activities) into a form on their device. The entered information is sent to the server in JSON format.

[0038] Data acquisition and plan generation

[0039] Based on the user information received, the server accesses various APIs (e.g., weather information, flight information, accommodation information) to obtain the necessary data. The server then combines this data to generate an optimal travel plan that takes into account the user's preferences and past travel history.

[0040] User Feedback

[0041] The server returns the generated travel plan to the terminal, presenting the user with multiple options. The user can then select the most suitable plan and confirm the reservation through the terminal.

[0042] Reservations and management

[0043] The server accesses relevant booking APIs based on user selections to confirm flight and accommodation reservations. Furthermore, it calculates the costs associated with any changes to the plan and proposes alternative plans to the user.

[0044] Specific example

[0045] For example, if a user is planning a trip to Tokyo in the spring to see the cherry blossoms, they enter basic information on their device. The server retrieves spring weather forecasts for Tokyo and information on when the cherry blossoms are at their best from weather APIs and tourism databases. It then collects flight and accommodation information and generates suggested plans. Finally, it confirms the booking based on the plan selected by the user. The user can view all the information on their device, making it possible to have an enjoyable trip.

[0046] Thus, the present invention provides users with a personalized travel experience, reduces effort, and achieves high convenience.

[0047] The following describes the processing flow.

[0048] Step 1:

[0049] Users enter travel information through an interface on their device. This includes departure date, destination, budget, and preferred activities. Once the user has finished entering the information, the device constructs the information as JSON data and sends it to the server.

[0050] Step 2:

[0051] The server parses the JSON data received from the user and prepares to communicate with various APIs. This includes setting request parameters for the weather information API, flight information API, and accommodation information API. The server then sends requests to each API to retrieve information based on the user's destination and itinerary.

[0052] Step 3:

[0053] The server receives responses from the APIs and retrieves the corresponding information. For example, the weather information API provides the destination's weather forecast, the flight information API provides a list of flights, and the accommodation information API provides hotel and Airbnb availability and pricing information.

[0054] Step 4:

[0055] The server analyzes the acquired information and generates multiple travel plans based on the user's preferences and budget. Each plan specifies flight options, accommodation choices, sightseeing spots, and required budget. The plans are customized to the user's individual needs.

[0056] Step 5:

[0057] The server generates multiple travel plans and sends them to the device. The device then displays these plans to the user in an easy-to-understand visual format, allowing the user to compare different options.

[0058] Step 6:

[0059] The user selects the most suitable travel plan from the options presented and confirms their selection to the server via their device. The user's selection includes confirming their desired flights, accommodations, and activities.

[0060] Step 7:

[0061] Based on the user's selection, the server uses the relevant booking API to formally secure flights, accommodations, and necessary reservations. The server receives booking confirmation information from each connected service provider and sends it to the terminal.

[0062] Step 8:

[0063] The terminal displays booking confirmation information sent from the server to the user, informing them of the success of their travel plan and the next steps (e.g., what to do if changes are needed). Users can easily review and manage their entire travel plan on the terminal.

[0064] (Example 1)

[0065] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0066] When users plan a trip, they need to collect and organize a vast amount of information to create the optimal plan, which is a time-consuming and laborious task. Furthermore, there is a need for a system that can flexibly modify travel plans to respond to rapidly changing circumstances and instantly reflect the results. In addition, there is an expectation for personalized travel experiences based on each user's past travel history and preferences.

[0067] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0068] In this invention, the server includes information acquisition means for receiving basic travel-related information from the user, communication means for acquiring weather information, transportation information, and accommodation information from external information sources, and computational processing means for analyzing the collected information and generating multiple travel plans using AI technology based on the user's preferences and travel experience. This enables the user to quickly and efficiently obtain the optimal travel plan based on their wishes. Furthermore, by enabling flexible responses to changes and personalization, the burden on the user in planning their trip can be reduced.

[0069] "Information acquisition means" refers to a function for collecting basic travel information from users and sending it to the server.

[0070] "Communication means" refers to means of obtaining weather information, transportation information, and accommodation information from external information sources.

[0071] The "computational processing means" is a system that generates multiple travel plans using generation AI technology, taking into account the user's preferences and travel experience based on the collected data.

[0072] A "presentation means" is an interface means that provides the user with generated travel plans and allows the user to select from them.

[0073] A "reservation processing method" is the process for confirming necessary reservations based on the travel plan selected by the user.

[0074] This invention realizes a system that streamlines the user's travel planning process and provides a personalized travel experience. This system operates through the interaction of the user, terminal, and server.

[0075] Users enter basic travel information via their device. This device can be a standard computer or smartphone, utilizing a dedicated application or web interface. Through this interface, information such as departure date, destination, budget, and preferred activities is collected and sent to the server in JSON format.

[0076] The server is equipped with an advanced generative AI model and accesses various APIs (weather information API, flight information API, accommodation information API, etc.) to collect relevant data based on information received from the user. The collected data is analyzed by the AI ​​model and generates an optimal travel plan based on the user's preferences and past travel history. Specifically, the AI ​​model creates a plan using prompts such as "Generate the optimal travel plan based on the user's requests."

[0077] The generated travel plans are sent from the server to the terminal and displayed on the user's screen as multiple options. The user can compare these plans and choose the best one.

[0078] Based on the selected travel plan, the server uses the relevant booking API to confirm flight and accommodation reservations. Once the reservations are complete, the information is sent back to the device, allowing the user to review their travel plans.

[0079] This system allows users to quickly obtain travel plans tailored to their preferences, significantly reducing the effort involved in planning. Furthermore, even if plans change, the server quickly proposes a new plan, enabling flexible travel planning.

[0080] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0081] Step 1:

[0082] Users enter basic travel information into a terminal application or web interface. This includes items such as departure date, destination, budget, and preferred activities. The entered information is converted to JSON format by the terminal and sent to the server. This input forms the basis for subsequent data processing.

[0083] Step 2:

[0084] The server receives information sent by the user and accesses various external sources to collect necessary data. Specifically, it sends requests to weather information APIs, flight information APIs, and accommodation information APIs to obtain information on destination weather, available flights, and accommodations. The server then filters and aggregates this data appropriately based on the user's requests to prepare for generating the optimal travel plan.

[0085] Step 3:

[0086] The server uses a generative AI model based on the collected data to generate the optimal travel plan for the user's conditions. During this process, the AI ​​model uses prompts such as "Generate the optimal travel plan based on the user's conditions." The generated plan is personalized, taking into account the user's past travel history and current preferences. The output consists of multiple travel plan options.

[0087] Step 4:

[0088] The server sends the generated travel plans to the user's device. The user reviews the multiple plans displayed on the device's screen and compares the details of each plan. Here, an intuitive user interface is crucial to enhancing the user experience, and a design that allows for intuitive access to information is adopted.

[0089] Step 5:

[0090] The user operates the device to select the most ideal travel plan from those presented. Based on the selected plan, the booking process is immediately initiated.

[0091] Step 6:

[0092] The server accesses relevant booking APIs based on the plan selected by the user to confirm flight and accommodation reservations. This process generates booking confirmation information, which is then sent to the user's device. The user can then view the booking details on their device and make changes as needed. This step requires the server to respond quickly, dynamically generating and providing new plans in case of any changes to the user's schedule.

[0093] (Application Example 1)

[0094] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0095] Traditional travel planning systems required users to create travel plans based on information they gathered themselves, which presented challenges in terms of time and effort. Furthermore, they struggled to flexibly accommodate changes in plans and to provide optimal sightseeing plans based on real-time constraints.

[0096] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0097] In this invention, the server includes an input device that receives information related to the user's travel, a communication device that acquires weather data, transportation data, and accommodation data, a processing device that generates multiple travel plans based on the user's preferences and budget based on the acquired data, a display device that provides the generated travel plans to the user and accepts their selection, a reservation device that confirms the reservation based on the user's selection, and a plan provision device that guides smartphone users to the most suitable sightseeing plan in real time. As a result, users can easily create a travel plan optimized to their preferences and budget and receive sightseeing guidance in real time.

[0098] An "input device" is a device used to receive travel-related information from the user.

[0099] A "communication device" is a device used to acquire weather data, transportation data, and accommodation data.

[0100] A "processing device" is a device that generates multiple travel plans based on the user's preferences and budget, using acquired data.

[0101] A "display device" is a device that provides the user with a generated travel plan and accepts their selections.

[0102] A "reservation device" is a device used to confirm a reservation based on the user's selection.

[0103] A "planning device" is a device that guides smartphone users to the most suitable sightseeing plan in real time.

[0104] The system that realizes this invention receives travel-related information from the user via a terminal, including a smartphone. Based on this information, the server obtains weather data, transportation data, and accommodation data from various APIs. This generates multiple travel plans that take into account the user's preferences and budget.

[0105] Specifically, the server uses a programming language such as Python to access a RESTful API and collect the necessary data. The requests library is used for this purpose. The collected data is processed on the server, and multiple optimized travel plans are generated.

[0106] Users can view their travel plans on a display device on their terminal and select their preferred plan. Based on the selected travel plan, the server confirms the reservation and provides further information to the user through a communication service.

[0107] Furthermore, the planning device guides smartphone users to the most suitable sightseeing plans in real time. This allows travelers to instantly receive plans based on the latest information and to quickly respond if they need to change their plans.

[0108] For example, if a user wants to see cherry blossoms in Tokyo, the server will suggest the best possible viewing date based on weather data and provide information on relevant flights and accommodations.

[0109] The following is an example of a prompt statement generated using a generative AI model.

[0110] "A user is planning a trip. Their destination is Tokyo, and they are interested in cherry blossom viewing. Based on the current weather and traffic conditions, please suggest the best cherry blossom viewing plan for the user."

[0111] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0112] Step 1:

[0113] The user enters travel information using a device. The user enters the departure date, destination, budget, and preferred activities into a form on the device. The entered data is converted to JSON format and sent to the server. In this step, the input is the user's travel information, and the output is the information data sent to the server.

[0114] Step 2:

[0115] The server analyzes the received user information and retrieves necessary data from various APIs. Specifically, it obtains destination weather data from the weather API, flight information from the transportation API, and accommodation information from the accommodation API. The server sends HTTP requests to these APIs and receives the data returned in JSON format. The input consists of user information and the response data from the retrieved APIs, and the output is a collection of all the data necessary for processing.

[0116] Step 3:

[0117] The server processes data to generate the optimal travel plan for the user based on the acquired data. To generate a plan that suits the user's preferences and budget constraints, it simulates multiple plans considering weather, flight availability, and accommodation availability. In this step, the input is a collection of acquired travel-related data, and the output is multiple proposed travel plans.

[0118] Step 4:

[0119] The generated travel plan is sent to the terminal and displayed to the user. The user can select the best plan from the multiple plans presented. To accept the selection, the terminal sends the selected plan information to the server through the user interface. The input for this step is the travel plan data, and the output is the selected travel plan.

[0120] Step 5:

[0121] The server confirms the necessary reservations based on the user's selected travel plan. It calls relevant reservation APIs and performs the required procedures to secure flight and accommodation bookings. The input is the selected travel plan, and the output is the confirmed reservation information.

[0122] Step 6:

[0123] The smartphone-based travel planning device uses a generating AI model to guide users to the most suitable travel plan in real time. The server updates the plan in real time, taking into account newly acquired traffic and event information. The input for this step is continuously updated environmental data, and the output is a travel plan that reflects the latest real-time information.

[0124] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0125] This invention is a system that proposes the optimal travel plan to users when they plan a trip, taking into account their individual preferences and emotional state, and aims to improve the user experience in particular by incorporating an emotion engine.

[0126] Overall system configuration

[0127] The system consists of the following main components: The user inputs information via the device, and the emotion engine acquires information through the camera and microphone. The server processes this information and retrieves necessary data from external APIs to generate a travel plan. The generated plan is finally returned to the device, and the user selects the plan.

[0128] Program processing

[0129] Input stage

[0130] The user enters travel information such as departure date, destination, and budget through an interface on their device. At this point, the emotion engine captures the user's facial expressions and voice and analyzes their emotions. The device then sends this information to the server.

[0131] Data acquisition and plan generation

[0132] The server retrieves necessary travel information using APIs such as weather information APIs and flight information APIs, based on input information and data from the emotion engine. The server designs the optimal travel plan, taking into account the user's preferences and emotional information. Based on emotional information, it provides options that fit the user's current emotions, such as plans that emphasize relaxation or plans that focus on activities.

[0133] User Feedback

[0134] Multiple travel plans generated by the server are sent to the device. The device presents the plans to the user, displaying detailed plan information, including prices and itineraries, in an easy-to-read format. Based on the sentiment analysis results, the user selects the most suitable plan from the suggested options, using their feedback.

[0135] Reservations and management

[0136] After the user selects a plan, the server uses an external booking API to confirm flight and accommodation reservations. The emotion engine monitors the user's emotions throughout the trip and suggests alternative plans in real time if changes to the plan are needed.

[0137] Specific example

[0138] If a user is feeling stressed and wants to relax, the emotion engine identifies this state. The server then offers plans that include relaxing pastoral environments, spa resort stays, and other options. Users can select from these plans and easily plan a trip that helps reduce stress.

[0139] In this way, this system allows users to easily obtain travel plans that are more tailored to their needs and emotions. This improves the quality of travel and makes it possible to provide a more satisfying experience.

[0140] The following describes the processing flow.

[0141] Step 1:

[0142] The user enters basic travel information (departure point, destination, dates, budget, etc.) on the device. The device converts the entered information into JSON format and prepares to send it to the server. During this process, the emotion engine captures the user's facial expressions and voice and analyzes their current emotional state. The user presses the submit button when they have finished entering the information.

[0143] Step 2:

[0144] The device sends the user's travel information and sentiment data to the server in JSON format. The device confirms that the transmission is complete and displays a success message to the user.

[0145] Step 3:

[0146] The server analyzes the received user information and sentiment data. The server queries various APIs to collect data such as weather, flights, and accommodations based on the entered travel information. Each API query may include parameters based on sentiment data.

[0147] Step 4:

[0148] The server integrates the information returned from the API and generates multiple travel plans. The server then fine-tunes the plan options based on the user's emotional state. For example, if relaxation is needed, the server prioritizes plans that include quiet tourist attractions and relaxing activities.

[0149] Step 5:

[0150] The server sends the generated plan to the device. The device visually displays multiple travel plans suitable for the user, allowing the user to compare them. Each plan includes information such as budget, main experiences, and recommended activities.

[0151] Step 6:

[0152] The user compares the displayed travel plans and selects their preferred plan. The selection information is sent to the server via the device. The emotion engine then receives further user feedback and may offer new suggestions if adjustments are needed.

[0153] Step 7:

[0154] The server uses various booking APIs based on the user's selection to confirm bookings for flights, accommodations, and required activities. After receiving booking confirmation, the server sends updated information to the device.

[0155] Step 8:

[0156] The terminal receives booking confirmation information from the server and displays it to the user. The user can confirm that the booking is confirmed as planned and proceed to the next step (preparing for departure) if necessary. The emotion engine also checks the user's emotions during the trip and suggests additional support or new plans if needed.

[0157] (Example 2)

[0158] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0159] Traditional travel planning systems provided plans based on user preferences and budgets, but failed to consider the user's emotional state. Therefore, it was difficult to provide a satisfying experience for users seeking stress relief and relaxation. There is a need to solve this problem and provide travel plans tailored to each user's individual preferences and emotional state.

[0160] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0161] In this invention, the server includes an input means using a terminal to receive information related to the user's travel, an information acquisition means using an emotion analysis device to analyze the user's emotional state, and a processing means using a generative AI model to generate a plurality of personalized travel plans based on the acquired information and the user's emotional analysis. This makes it possible to provide a travel plan that matches the user's emotional state.

[0162] "Input methods using terminals" refers to devices and interfaces for users to input travel-related information, and the means by which this information is appropriately transmitted to the system.

[0163] An "emotion analysis device" is a technology or device that acquires a user's facial expressions and voice data and analyzes the user's emotional state based on that data.

[0164] "Communication means" refers to network communication means used to obtain data such as weather information, transportation information, and facility information from external sources.

[0165] A "generative AI model" is an artificial intelligence model used to create personalized travel plans based on user input information and emotional states.

[0166] "Processing means" refers to a function or device that uses acquired information to perform specific calculations or procedures and derive the desired results.

[0167] "Display means" refers to a display or other display device used to present the generated travel plan to the user.

[0168] A "booking method" refers to a method or system for confirming reservations for accommodations, transportation, etc., based on the travel plan selected by the user.

[0169] This invention is a system that provides users with more personalized travel plans when they are planning a trip. Specifically, it aims to easily generate travel plans that take into account the user's emotional state.

[0170] The user uses a terminal to input basic travel information. The terminal receives the user's departure date, destination, and budget, and uses an emotion analysis device to obtain emotional data from the user's facial expressions and voice. This allows for real-time analysis of the user's current emotional state.

[0171] The server receives information transmitted from the terminal and simultaneously acquires necessary data using external communication methods. This data includes weather information, transportation information, and accommodation information, which are obtained via the network. The server then uses a generative AI model to generate a travel plan based on the user's input and emotional data. This generative AI model can design a plan that is adapted to the user's emotional state.

[0172] For example, if the emotion analysis system determines that a user has been working for a long time and desires relaxation, the server will generate a plan that includes travel destinations and activities specifically designed for relaxation. Furthermore, by presenting a variety of options, users can easily choose the plan that best suits them.

[0173] Once a travel plan is generated, the device displays it to the user. The user can compare the displayed plans and select the one that best suits their needs and mood. Based on the user's selection, the server then uses booking methods to confirm reservations for accommodation and transportation.

[0174] A concrete example of a prompt message in this invention is that if the user inputs something like, "I want to relax, I want a nature-rich environment, and my budget is under 300,000 yen," the system can provide a travel plan that matches these inputs.

[0175] This allows users to easily obtain travel plans that match their emotional state, greatly improving the quality and satisfaction of their trips.

[0176] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0177] Step 1:

[0178] The user enters basic travel information through the terminal's interface. Specifically, they enter information such as the departure date, destination, budget, and purpose of travel, and the terminal aggregates this information. The entered data is formatted and sent to the server in preparation for the next processing step.

[0179] Step 2:

[0180] The device uses an emotion analysis device to capture the user's facial expressions and voice. This allows for real-time analysis of the user's emotional state and provides the analysis results. The emotional data obtained through this analysis is important for more accurately reflecting the user's travel needs and requests. The emotional data, along with the user's input information, is sent to the server.

[0181] Step 3:

[0182] Based on the user information and sentiment data received, the server uses communication methods to obtain external weather information, transportation information, and accommodation information. In this acquisition process, the server uses specific APIs to retrieve the latest information from relevant databases and formats it in a format suitable for the user's trip.

[0183] Step 4:

[0184] The server uses a generative AI model to generate travel plans that take into account the user's preferences and emotional state. A specific algorithm combines acquired information with user input and emotional data to design multiple plans that suit the user's purpose and emotions. This process involves data analysis and optimization to construct recommended travel options.

[0185] Step 5:

[0186] The generated travel plan is sent from the server to the terminal and presented to the user from the terminal. The terminal displays the plan in an easy-to-understand format, including detailed pricing and itinerary. The user compares and considers the presented plans and selects the one that best suits their needs.

[0187] Step 6:

[0188] Once a user selects a plan, the server uses a booking system to confirm reservations for accommodation, transportation, and other services. This process utilizes an external API to accurately input the user's chosen reservation information and verify it in real time. Upon completion of the reservation, confirmation information is generated and sent to the user via their device.

[0189] (Application Example 2)

[0190] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0191] In recent years, with the increasing demand for diverse travel styles, there has been a lack of travel plans tailored to users' individual emotional states and preferences. As a result, users experience increased stress and hassle when planning trips, and may have less satisfying experiences. Furthermore, while there is a need for flexible plan changes during the trip based on the user's emotional state, methods for achieving this in real time are still underdeveloped.

[0192] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0193] In this invention, the server includes information acquisition means for receiving information related to the user's travel, communication means for acquiring weather information, transportation information, and accommodation information, and plan generation means for generating multiple travel plans based on the acquired information and emotional information, as well as the user's preferences, budget, and emotional state. This makes it possible to flexibly provide travel plans that are tailored to the user's emotional state and individual preferences.

[0194] "Information acquisition means" refers to devices or methods that have the function of receiving travel-related information from users.

[0195] "Communication means" refers to devices and methods for obtaining weather information, transportation information, and accommodation information from external sources.

[0196] A "plan generation means" is a device or method that has the function of designing multiple travel plans that take into account the user's preferences, budget, and emotional state, based on acquired information and emotional information.

[0197] "Presentation means" refers to a display device or method for presenting a generated travel plan to the user in an easily viewable format and for accepting selections.

[0198] A "confirmation method" refers to a device or method that has the function of confirming various travel arrangements and reservations based on the user's selection.

[0199] The program to implement this system mainly consists of a server, a user terminal, and an emotion analysis device. The server receives travel-related information from the user through information acquisition means. This includes basic information such as departure date, destination, and budget. Furthermore, the emotion analysis device acquires emotional information from the user's facial expressions and voice using a camera and microphone.

[0200] Based on the acquired data, the server uses communication methods to obtain weather information, transportation information, and accommodation information from external APIs. Next, using a plan generation method, it generates multiple optimal travel plans based on the acquired information, user preferences, and emotional state. At this time, it is possible to analyze the data using a generation AI model and select the plan that is best suited to the user.

[0201] The generated travel plans are presented to the user in an easy-to-view format through the device's display mechanism. The user can choose a plan from the presented options that matches their emotional state. After selection, the server uses a confirmation mechanism to make the reservation and complete the travel arrangements.

[0202] For example, if a user is presented with the message, "How about a nearby hot spring spa resort? We can also arrange a healing session," on their device, the user can select this plan and confirm the reservation. This results in a travel plan that aligns with the user's emotions.

[0203] An example of a prompt message could be, "If the user is feeling stressed, generate a travel plan that provides relaxation." Based on this prompt, the server automatically selects an appropriate plan and provides it to the user.

[0204] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0205] Step 1:

[0206] The terminal receives basic travel information from the user. The user enters the departure date, destination, and budget into the terminal's interface. The terminal then formats this information and prepares it for transmission to the server.

[0207] Step 2:

[0208] An emotion analysis device uses a camera and microphone to capture the user's facial expressions and voice, and generates emotional information. The input is real-time video and audio data, which the emotion analysis device analyzes to identify the category of emotion. As output, it generates the user's emotional state (e.g., relaxed, stressed, excited) and sends it to the server via the terminal.

[0209] Step 3:

[0210] The server accesses external APIs based on travel and sentiment information received from the device to retrieve relevant weather, transportation, and accommodation information. Specifically, it uses destination and date / time information sent from the device to retrieve the respective information from third-party APIs. The retrieved information is stored in a database for use in subsequent steps.

[0211] Step 4:

[0212] Based on the information acquired by the server, a travel plan is designed using a plan generation method. Here, a generation AI model is used to generate multiple plans that take into account the user's emotional state and budget. The input consists of collected travel information and emotional information, which are analyzed through a planning algorithm and output as the optimal travel plan.

[0213] Step 5:

[0214] The server sends the generated travel plan to the terminal. The terminal displays the received plan in an easy-to-read format for the user. The user selects the plan they like best. Here, the plan details are displayed, and the selection is made through user input. The output is the plan selected by the user.

[0215] Step 6:

[0216] The server uses an external booking service API to confirm the necessary reservation based on the plan selected by the user. The input is the selected plan information, and the output generates an actual reservation confirmation and details, including flight and accommodation confirmations.

[0217] Step 7:

[0218] During the trip, the server continuously receives updated emotional information from the emotion analysis device and, if necessary, uses a generating AI model to suggest alternative plans in real time. The input is the user's emotional information during the trip, and the output is the presentation of proposed plan changes as needed.

[0219] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0220] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0221] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0222] [Second Embodiment]

[0223] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0224] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0225] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0226] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0227] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0228] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0229] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0230] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0231] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0232] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0233] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0234] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0235] The present invention is a system for supporting travel planning, and its purpose is to receive travel information from the user, generate an appropriate travel plan, and provide it to the user.

[0236] Overall system configuration

[0237] The system consists of the following main components: terminals for users to input travel information, various APIs that the server interacts with, and various databases.

[0238] Program processing

[0239] Input stage

[0240] The user enters basic travel information (e.g., departure date, destination, budget, preferred activities) into a form on their device. The entered information is sent to the server in JSON format.

[0241] Data acquisition and plan generation

[0242] Based on the user information received, the server accesses various APIs (e.g., weather information, flight information, accommodation information) to obtain the necessary data. The server then combines this data to generate an optimal travel plan that takes into account the user's preferences and past travel history.

[0243] User Feedback

[0244] The server returns the generated travel plan to the terminal, presenting the user with multiple options. The user can then select the most suitable plan and confirm the reservation through the terminal.

[0245] Reservations and management

[0246] The server accesses relevant booking APIs based on user selections to confirm flight and accommodation reservations. Furthermore, it calculates the costs associated with any changes to the plan and proposes alternative plans to the user.

[0247] Specific example

[0248] For example, if a user is planning a trip to Tokyo in the spring to see the cherry blossoms, they enter basic information on their device. The server retrieves spring weather forecasts for Tokyo and information on when the cherry blossoms are at their best from weather APIs and tourism databases. It then collects flight and accommodation information and generates suggested plans. Finally, it confirms the booking based on the plan selected by the user. The user can view all the information on their device, making it possible to have an enjoyable trip.

[0249] Thus, the present invention provides users with a personalized travel experience, reduces effort, and achieves high convenience.

[0250] The following describes the processing flow.

[0251] Step 1:

[0252] Users enter travel information through an interface on their device. This includes departure date, destination, budget, and preferred activities. Once the user has finished entering the information, the device constructs the information as JSON data and sends it to the server.

[0253] Step 2:

[0254] The server parses the JSON data received from the user and prepares to communicate with various APIs. This includes setting request parameters for the weather information API, flight information API, and accommodation information API. The server then sends requests to each API to retrieve information based on the user's destination and itinerary.

[0255] Step 3:

[0256] The server receives responses from the APIs and retrieves the corresponding information. For example, the weather information API provides the destination's weather forecast, the flight information API provides a list of flights, and the accommodation information API provides hotel and Airbnb availability and pricing information.

[0257] Step 4:

[0258] The server analyzes the acquired information and generates multiple travel plans based on the user's preferences and budget. Each plan specifies flight options, accommodation choices, sightseeing spots, and required budget. The plans are customized to the user's individual needs.

[0259] Step 5:

[0260] The server generates multiple travel plans and sends them to the device. The device then displays these plans to the user in an easy-to-understand visual format, allowing the user to compare different options.

[0261] Step 6:

[0262] The user selects the most suitable travel plan from the options presented and confirms their selection to the server via their device. The user's selection includes confirming their desired flights, accommodations, and activities.

[0263] Step 7:

[0264] Based on the user's selection, the server uses the relevant booking API to formally secure flights, accommodations, and necessary reservations. The server receives booking confirmation information from each connected service provider and sends it to the terminal.

[0265] Step 8:

[0266] The terminal displays booking confirmation information sent from the server to the user, informing them of the success of their travel plan and the next steps (e.g., what to do if changes are needed). Users can easily review and manage their entire travel plan on the terminal.

[0267] (Example 1)

[0268] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0269] When users plan a trip, they need to collect and organize a vast amount of information to create the optimal plan, which is a time-consuming and laborious task. Furthermore, there is a need for a system that can flexibly modify travel plans to respond to rapidly changing circumstances and instantly reflect the results. In addition, there is an expectation for personalized travel experiences based on each user's past travel history and preferences.

[0270] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0271] In this invention, the server includes information acquisition means for receiving basic travel-related information from the user, communication means for acquiring weather information, transportation information, and accommodation information from external information sources, and computational processing means for analyzing the collected information and generating multiple travel plans using AI technology based on the user's preferences and travel experience. This enables the user to quickly and efficiently obtain the optimal travel plan based on their wishes. Furthermore, by enabling flexible responses to changes and personalization, the burden on the user in planning their trip can be reduced.

[0272] "Information acquisition means" refers to a function for collecting basic travel information from users and sending it to the server.

[0273] "Communication means" refers to means of obtaining weather information, transportation information, and accommodation information from external information sources.

[0274] The "computational processing means" is a system that generates multiple travel plans using generation AI technology, taking into account the user's preferences and travel experience based on the collected data.

[0275] A "presentation means" is an interface means that provides the user with generated travel plans and allows the user to select from them.

[0276] A "reservation processing method" is the process for confirming necessary reservations based on the travel plan selected by the user.

[0277] This invention realizes a system that streamlines the user's travel planning process and provides a personalized travel experience. This system operates through the interaction of the user, terminal, and server.

[0278] The user inputs basic travel information via a terminal. The terminal is a general computer or smartphone and uses a dedicated application or web interface. Through this interface, information such as departure date, destination, budget, preferred activities, etc. is collected and sent to the server in JSON format.

[0279] The server is equipped with an advanced generative AI model. Based on the information received from the user, it accesses various APIs (weather information API, flight information API, accommodation information API, etc.) to collect relevant data. The collected data is analyzed by the AI model to generate an optimal travel plan based on the user's preferences and past travel history. Specifically, the AI model creates the plan using a prompt sentence such as "Generate an optimal travel plan based on the user's desires."

[0280] The generated travel plan is sent from the server to the terminal and displayed as multiple options on the user's screen. The user can compare and consider these plans and select the optimal one.

[0281] Based on the selected travel plan, the server uses the relevant reservation API to confirm reservations for flights and accommodation facilities. When the reservation is completed, the information is sent back to the terminal again, and the user can check the travel plan.

[0282] With this system, the user can quickly obtain a travel plan according to their preferences, and it is realized that the labor in the planning is greatly reduced. Also, even if there is a change in the schedule, the server quickly proposes a new plan, enabling a flexible travel plan.

[0283] The flow of the specific process in Example 1 will be described using FIG. 11.

[0284] Step 1:

[0285] The user inputs the basic travel information into the application or web interface of the terminal. This includes items such as departure date, destination, budget, preferred activities, etc. The input information is converted into JSON format by the terminal and sent to the server. This input forms the basis for subsequent data processing.

[0286] Step 2:

[0287] The server receives the information sent by the user and accesses various external information sources to collect the necessary data. Specifically, requests are sent to the weather information API, flight information API, and accommodation information API to obtain the weather at the destination, available flights, and information on staying facilities. The server prepares to generate an optimal travel plan by appropriately filtering and aggregating these data based on the user's requirements.

[0288] Step 3:

[0289] The server uses the generated AI model based on the collected data to generate an optimal travel plan for the user's conditions. In this process, the AI model uses a prompt sentence such as "Generate an optimal travel plan based on the user's conditions". The generated plan will be personalized considering the user's past travel history and current preferences. What is output are multiple travel plan options.

[0290] Step 4:

[0291] The server sends the generated travel plan to the terminal. The user checks the multiple plans displayed on the terminal screen and compares and considers the details of each plan. Here, an intuitive user interface is important to enhance the user experience, and a design that allows intuitive access to information is adopted.

[0292] Step 5:

[0293] The user operates the device to select the most ideal travel plan from those presented. Based on the selected plan, the booking process is immediately initiated.

[0294] Step 6:

[0295] The server accesses relevant booking APIs based on the plan selected by the user to confirm flight and accommodation reservations. This process generates booking confirmation information, which is then sent to the user's device. The user can then view the booking details on their device and make changes as needed. This step requires the server to respond quickly, dynamically generating and providing new plans in case of any changes to the user's schedule.

[0296] (Application Example 1)

[0297] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0298] Traditional travel planning systems required users to create travel plans based on information they gathered themselves, which presented challenges in terms of time and effort. Furthermore, they struggled to flexibly accommodate changes in plans and to provide optimal sightseeing plans based on real-time constraints.

[0299] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0300] In this invention, the server includes an input device that receives information related to the user's trip, a communication device that acquires weather data, transportation means data, and accommodation data, a processing device that generates a plurality of travel plans based on the acquired data and the user's preferences and budget, a display device that provides the generated travel plans to the user and accepts selections, and a reservation device that finalizes reservations based on the user's selections, and a plan providing device that guides the user of a smartphone with an optimal sightseeing plan in real time. As a result, the user can easily create a travel plan optimized for their preferences and budget and can receive sightseeing guidance in real time.

[0301] The "input device" is a device for receiving information related to a trip from the user.

[0302] The "communication device" is a device for acquiring weather data, transportation means data, and accommodation data.

[0303] The "processing device" is a device for generating a plurality of travel plans based on the acquired data and the user's preferences and budget.

[0304] The "display device" is a device for providing the generated travel plans to the user and accepting selections.

[0305] The "reservation device" is a device for finalizing reservations based on the user's selections.

[0306] The "plan providing device" is a device for guiding the user of a smartphone with an optimal sightseeing plan in real time.

[0307] The system that realizes this invention receives information related to a trip from the user through a terminal including a smartphone. The server acquires weather data, transportation means data, and accommodation data from various APIs based on that information. Thereby, a plurality of travel plans considering the user's preferences and budget are generated.

[0308] Specifically, the server uses a programming language such as Python to access a RESTful API and collect the necessary data. The requests library is used for this purpose. The collected data is processed on the server, and multiple optimized travel plans are generated.

[0309] Users can view their travel plans on a display device on their terminal and select their preferred plan. Based on the selected travel plan, the server confirms the reservation and provides further information to the user through a communication service.

[0310] Furthermore, the planning device guides smartphone users to the most suitable sightseeing plans in real time. This allows travelers to instantly receive plans based on the latest information and to quickly respond if they need to change their plans.

[0311] For example, if a user wants to see cherry blossoms in Tokyo, the server will suggest the best possible viewing date based on weather data and provide information on relevant flights and accommodations.

[0312] The following is an example of a prompt statement generated using a generative AI model.

[0313] "A user is planning a trip. Their destination is Tokyo, and they are interested in cherry blossom viewing. Based on the current weather and traffic conditions, please suggest the best cherry blossom viewing plan for the user."

[0314] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0315] Step 1:

[0316] The user enters travel information using a device. The user enters the departure date, destination, budget, and preferred activities into a form on the device. The entered data is converted to JSON format and sent to the server. In this step, the input is the user's travel information, and the output is the information data sent to the server.

[0317] Step 2:

[0318] The server analyzes the received user information and retrieves necessary data from various APIs. Specifically, it obtains destination weather data from the weather API, flight information from the transportation API, and accommodation information from the accommodation API. The server sends HTTP requests to these APIs and receives the data returned in JSON format. The input consists of user information and the response data from the retrieved APIs, and the output is a collection of all the data necessary for processing.

[0319] Step 3:

[0320] The server processes data to generate the optimal travel plan for the user based on the acquired data. To generate a plan that suits the user's preferences and budget constraints, it simulates multiple plans considering weather, flight availability, and accommodation availability. In this step, the input is a collection of acquired travel-related data, and the output is multiple proposed travel plans.

[0321] Step 4:

[0322] The generated travel plan is sent to the terminal and displayed to the user. The user can select the best plan from the multiple plans presented. To accept the selection, the terminal sends the selected plan information to the server through the user interface. The input for this step is the travel plan data, and the output is the selected travel plan.

[0323] Step 5:

[0324] The server confirms the necessary reservations based on the user's selected travel plan. It calls relevant reservation APIs and performs the required procedures to secure flight and accommodation bookings. The input is the selected travel plan, and the output is the confirmed reservation information.

[0325] Step 6:

[0326] The smartphone-based travel planning device uses a generating AI model to guide users to the most suitable travel plan in real time. The server updates the plan in real time, taking into account newly acquired traffic and event information. The input for this step is continuously updated environmental data, and the output is a travel plan that reflects the latest real-time information.

[0327] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0328] This invention is a system that proposes the optimal travel plan to users when they plan a trip, taking into account their individual preferences and emotional state, and aims to improve the user experience in particular by incorporating an emotion engine.

[0329] Overall system configuration

[0330] The system consists of the following main components: The user inputs information via the device, and the emotion engine acquires information through the camera and microphone. The server processes this information and retrieves necessary data from external APIs to generate a travel plan. The generated plan is finally returned to the device, and the user selects the plan.

[0331] Program processing

[0332] Input stage

[0333] The user enters travel information such as departure date, destination, and budget through an interface on their device. At this point, the emotion engine captures the user's facial expressions and voice and analyzes their emotions. The device then sends this information to the server.

[0334] Data acquisition and plan generation

[0335] The server retrieves necessary travel information using APIs such as weather information APIs and flight information APIs, based on input information and data from the emotion engine. The server designs the optimal travel plan, taking into account the user's preferences and emotional information. Based on emotional information, it provides options that fit the user's current emotions, such as plans that emphasize relaxation or plans that focus on activities.

[0336] User Feedback

[0337] Multiple travel plans generated by the server are sent to the device. The device presents the plans to the user, displaying detailed plan information, including prices and itineraries, in an easy-to-read format. Based on the sentiment analysis results, the user selects the most suitable plan from the suggested options, using their feedback.

[0338] Reservations and management

[0339] After the user selects a plan, the server uses an external booking API to confirm flight and accommodation reservations. The emotion engine monitors the user's emotions throughout the trip and suggests alternative plans in real time if changes to the plan are needed.

[0340] Specific example

[0341] If a user is feeling stressed and wants to relax, the emotion engine identifies this state. The server then offers plans that include relaxing pastoral environments, spa resort stays, and other options. Users can select from these plans and easily plan a trip that helps reduce stress.

[0342] In this way, this system allows users to easily obtain travel plans that are more tailored to their needs and emotions. This improves the quality of travel and makes it possible to provide a more satisfying experience.

[0343] The following describes the processing flow.

[0344] Step 1:

[0345] The user enters basic travel information (departure point, destination, dates, budget, etc.) on the device. The device converts the entered information into JSON format and prepares to send it to the server. During this process, the emotion engine captures the user's facial expressions and voice and analyzes their current emotional state. The user presses the submit button when they have finished entering the information.

[0346] Step 2:

[0347] The device sends the user's travel information and sentiment data to the server in JSON format. The device confirms that the transmission is complete and displays a success message to the user.

[0348] Step 3:

[0349] The server analyzes the received user information and sentiment data. The server queries various APIs to collect data such as weather, flights, and accommodations based on the entered travel information. Each API query may include parameters based on sentiment data.

[0350] Step 4:

[0351] The server integrates the information returned from the API and generates multiple travel plans. The server then fine-tunes the plan options based on the user's emotional state. For example, if relaxation is needed, the server prioritizes plans that include quiet tourist attractions and relaxing activities.

[0352] Step 5:

[0353] The server sends the generated plan to the device. The device visually displays multiple travel plans suitable for the user, allowing the user to compare them. Each plan includes information such as budget, main experiences, and recommended activities.

[0354] Step 6:

[0355] The user compares the displayed travel plans and selects their preferred plan. The selection information is sent to the server via the device. The emotion engine then receives further user feedback and may offer new suggestions if adjustments are needed.

[0356] Step 7:

[0357] The server uses various booking APIs based on the user's selection to confirm bookings for flights, accommodations, and required activities. After receiving booking confirmation, the server sends updated information to the device.

[0358] Step 8:

[0359] The terminal receives booking confirmation information from the server and displays it to the user. The user can confirm that the booking is confirmed as planned and proceed to the next step (preparing for departure) if necessary. The emotion engine also checks the user's emotions during the trip and suggests additional support or new plans if needed.

[0360] (Example 2)

[0361] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0362] Traditional travel planning systems provided plans based on user preferences and budgets, but failed to consider the user's emotional state. Therefore, it was difficult to provide a satisfying experience for users seeking stress relief and relaxation. There is a need to solve this problem and provide travel plans tailored to each user's individual preferences and emotional state.

[0363] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0364] In this invention, the server includes an input means using a terminal to receive information related to the user's travel, an information acquisition means using an emotion analysis device to analyze the user's emotional state, and a processing means using a generative AI model to generate a plurality of personalized travel plans based on the acquired information and the user's emotional analysis. This makes it possible to provide a travel plan that matches the user's emotional state.

[0365] "Input methods using terminals" refers to devices and interfaces for users to input travel-related information, and the means by which this information is appropriately transmitted to the system.

[0366] An "emotion analysis device" is a technology or device that acquires a user's facial expressions and voice data and analyzes the user's emotional state based on that data.

[0367] "Communication means" refers to network communication means used to obtain data such as weather information, transportation information, and facility information from external sources.

[0368] A "generative AI model" is an artificial intelligence model used to create personalized travel plans based on user input information and emotional states.

[0369] "Processing means" refers to a function or device that uses acquired information to perform specific calculations or procedures and derive the desired results.

[0370] "Display means" refers to a display or other display device used to present the generated travel plan to the user.

[0371] A "booking method" refers to a method or system for confirming reservations for accommodations, transportation, etc., based on the travel plan selected by the user.

[0372] This invention is a system that provides users with more personalized travel plans when they are planning a trip. Specifically, it aims to easily generate travel plans that take into account the user's emotional state.

[0373] The user uses a terminal to input basic travel information. The terminal receives the user's departure date, destination, and budget, and uses an emotion analysis device to obtain emotional data from the user's facial expressions and voice. This allows for real-time analysis of the user's current emotional state.

[0374] The server receives information transmitted from the terminal and simultaneously acquires necessary data using external communication methods. This data includes weather information, transportation information, and accommodation information, which are obtained via the network. The server then uses a generative AI model to generate a travel plan based on the user's input and emotional data. This generative AI model can design a plan that is adapted to the user's emotional state.

[0375] For example, if the emotion analysis system determines that a user has been working for a long time and desires relaxation, the server will generate a plan that includes travel destinations and activities specifically designed for relaxation. Furthermore, by presenting a variety of options, users can easily choose the plan that best suits them.

[0376] Once a travel plan is generated, the device displays it to the user. The user can compare the displayed plans and select the one that best suits their needs and mood. Based on the user's selection, the server then uses booking methods to confirm reservations for accommodation and transportation.

[0377] A concrete example of a prompt message in this invention is that if the user inputs something like, "I want to relax, I want a nature-rich environment, and my budget is under 300,000 yen," the system can provide a travel plan that matches these inputs.

[0378] This allows users to easily obtain travel plans that match their emotional state, greatly improving the quality and satisfaction of their trips.

[0379] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0380] Step 1:

[0381] The user enters basic travel information through the terminal's interface. Specifically, they enter information such as the departure date, destination, budget, and purpose of travel, and the terminal aggregates this information. The entered data is formatted and sent to the server in preparation for the next processing step.

[0382] Step 2:

[0383] The device uses an emotion analysis device to capture the user's facial expressions and voice. This allows for real-time analysis of the user's emotional state and provides the analysis results. The emotional data obtained through this analysis is important for more accurately reflecting the user's travel needs and requests. The emotional data, along with the user's input information, is sent to the server.

[0384] Step 3:

[0385] Based on the user information and sentiment data received, the server uses communication methods to obtain external weather information, transportation information, and accommodation information. In this acquisition process, the server uses specific APIs to retrieve the latest information from relevant databases and formats it in a format suitable for the user's trip.

[0386] Step 4:

[0387] The server uses a generative AI model to generate travel plans that take into account the user's preferences and emotional state. A specific algorithm combines acquired information with user input and emotional data to design multiple plans that suit the user's purpose and emotions. This process involves data analysis and optimization to construct recommended travel options.

[0388] Step 5:

[0389] The generated travel plan is sent from the server to the terminal and presented to the user from the terminal. The terminal displays the plan in an easy-to-understand format, including detailed pricing and itinerary. The user compares and considers the presented plans and selects the one that best suits their needs.

[0390] Step 6:

[0391] Once a user selects a plan, the server uses a booking system to confirm reservations for accommodation, transportation, and other services. This process utilizes an external API to accurately input the user's chosen reservation information and verify it in real time. Upon completion of the reservation, confirmation information is generated and sent to the user via their device.

[0392] (Application Example 2)

[0393] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the smart glasses 214 as the "terminal".

[0394] In recent years, with the increasing demand for diverse travel styles, there has been a lack of travel plans tailored to users' individual emotional states and preferences. As a result, users experience increased stress and hassle when planning trips, and may have less satisfying experiences. Furthermore, while there is a need for flexible plan changes during the trip based on the user's emotional state, methods for achieving this in real time are still underdeveloped.

[0395] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0396] In this invention, the server includes information acquisition means for receiving information related to the user's travel, communication means for acquiring weather information, transportation information, and accommodation information, and plan generation means for generating multiple travel plans based on the acquired information and emotional information, as well as the user's preferences, budget, and emotional state. This makes it possible to flexibly provide travel plans that are tailored to the user's emotional state and individual preferences.

[0397] "Information acquisition means" refers to devices or methods that have the function of receiving travel-related information from users.

[0398] "Communication means" refers to devices and methods for obtaining weather information, transportation information, and accommodation information from external sources.

[0399] A "plan generation means" is a device or method that has the function of designing multiple travel plans that take into account the user's preferences, budget, and emotional state, based on acquired information and emotional information.

[0400] "Presentation means" refers to a display device or method for presenting a generated travel plan to the user in an easily viewable format and for accepting selections.

[0401] A "confirmation method" refers to a device or method that has the function of confirming various travel arrangements and reservations based on the user's selection.

[0402] The program to implement this system mainly consists of a server, a user terminal, and an emotion analysis device. The server receives travel-related information from the user through information acquisition means. This includes basic information such as departure date, destination, and budget. Furthermore, the emotion analysis device acquires emotional information from the user's facial expressions and voice using a camera and microphone.

[0403] Based on the acquired data, the server uses communication methods to obtain weather information, transportation information, and accommodation information from external APIs. Next, using a plan generation method, it generates multiple optimal travel plans based on the acquired information, user preferences, and emotional state. At this time, it is possible to analyze the data using a generation AI model and select the plan that is best suited to the user.

[0404] The generated travel plans are presented to the user in an easy-to-view format through the device's display mechanism. The user can choose a plan from the presented options that matches their emotional state. After selection, the server uses a confirmation mechanism to make the reservation and complete the travel arrangements.

[0405] For example, if a user is presented with the message, "How about a nearby hot spring spa resort? We can also arrange a healing session," on their device, the user can select this plan and confirm the reservation. This results in a travel plan that aligns with the user's emotions.

[0406] An example of a prompt message could be, "If the user is feeling stressed, generate a travel plan that provides relaxation." Based on this prompt, the server automatically selects an appropriate plan and provides it to the user.

[0407] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0408] Step 1:

[0409] The terminal receives basic travel information from the user. The user enters the departure date, destination, and budget into the terminal's interface. The terminal then formats this information and prepares it for transmission to the server.

[0410] Step 2:

[0411] An emotion analysis device uses a camera and microphone to capture the user's facial expressions and voice, and generates emotional information. The input is real-time video and audio data, which the emotion analysis device analyzes to identify the category of emotion. As output, it generates the user's emotional state (e.g., relaxed, stressed, excited) and sends it to the server via the terminal.

[0412] Step 3:

[0413] The server accesses external APIs based on travel and sentiment information received from the device to retrieve relevant weather, transportation, and accommodation information. Specifically, it uses destination and date / time information sent from the device to retrieve the respective information from third-party APIs. The retrieved information is stored in a database for use in subsequent steps.

[0414] Step 4:

[0415] Based on the information acquired by the server, a travel plan is designed using a plan generation method. Here, a generation AI model is used to generate multiple plans that take into account the user's emotional state and budget. The input consists of collected travel information and emotional information, which are analyzed through a planning algorithm and output as the optimal travel plan.

[0416] Step 5:

[0417] The server sends the generated travel plan to the terminal. The terminal displays the received plan in an easy-to-read format for the user. The user selects the plan they like best. Here, the plan details are displayed, and the selection is made through user input. The output is the plan selected by the user.

[0418] Step 6:

[0419] The server uses an external booking service API to confirm the necessary reservation based on the plan selected by the user. The input is the selected plan information, and the output generates an actual reservation confirmation and details, including flight and accommodation confirmations.

[0420] Step 7:

[0421] During the trip, the server continuously receives updated emotional information from the emotion analysis device and, if necessary, uses a generating AI model to suggest alternative plans in real time. The input is the user's emotional information during the trip, and the output is the presentation of proposed plan changes as needed.

[0422] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0423] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0424] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0425] [Third Embodiment]

[0426] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0427] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0428] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0429] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0430] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0431] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0432] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0433] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0434] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0435] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0436] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0437] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0438] The present invention is a system for supporting travel planning, and its purpose is to receive travel information from the user, generate an appropriate travel plan, and provide it to the user.

[0439] Overall system configuration

[0440] The system consists of the following main components: terminals for users to input travel information, various APIs that the server interacts with, and various databases.

[0441] Program processing

[0442] Input stage

[0443] The user enters basic travel information (e.g., departure date, destination, budget, preferred activities) into a form on their device. The entered information is sent to the server in JSON format.

[0444] Data acquisition and plan generation

[0445] Based on the user information received, the server accesses various APIs (e.g., weather information, flight information, accommodation information) to obtain the necessary data. The server then combines this data to generate an optimal travel plan that takes into account the user's preferences and past travel history.

[0446] User Feedback

[0447] The server returns the generated travel plan to the terminal, presenting the user with multiple options. The user can then select the most suitable plan and confirm the reservation through the terminal.

[0448] Reservations and management

[0449] The server accesses relevant booking APIs based on user selections to confirm flight and accommodation reservations. Furthermore, it calculates the costs associated with any changes to the plan and proposes alternative plans to the user.

[0450] Specific example

[0451] For example, if a user is planning a trip to Tokyo in the spring to see the cherry blossoms, they enter basic information on their device. The server retrieves spring weather forecasts for Tokyo and information on when the cherry blossoms are at their best from weather APIs and tourism databases. It then collects flight and accommodation information and generates suggested plans. Finally, it confirms the booking based on the plan selected by the user. The user can view all the information on their device, making it possible to have an enjoyable trip.

[0452] Thus, the present invention provides users with a personalized travel experience, reduces effort, and achieves high convenience.

[0453] The following describes the processing flow.

[0454] Step 1:

[0455] Users enter travel information through an interface on their device. This includes departure date, destination, budget, and preferred activities. Once the user has finished entering the information, the device constructs the information as JSON data and sends it to the server.

[0456] Step 2:

[0457] The server parses the JSON data received from the user and prepares to communicate with various APIs. This includes setting request parameters for the weather information API, flight information API, and accommodation information API. The server then sends requests to each API to retrieve information based on the user's destination and itinerary.

[0458] Step 3:

[0459] The server receives responses from the APIs and retrieves the corresponding information. For example, the weather information API provides the destination's weather forecast, the flight information API provides a list of flights, and the accommodation information API provides hotel and Airbnb availability and pricing information.

[0460] Step 4:

[0461] The server analyzes the acquired information and generates multiple travel plans based on the user's preferences and budget. Each plan specifies flight options, accommodation choices, sightseeing spots, and required budget. The plans are customized to the user's individual needs.

[0462] Step 5:

[0463] The server generates multiple travel plans and sends them to the device. The device then displays these plans to the user in an easy-to-understand visual format, allowing the user to compare different options.

[0464] Step 6:

[0465] The user selects the most suitable travel plan from the options presented and confirms their selection to the server via their device. The user's selection includes confirming their desired flights, accommodations, and activities.

[0466] Step 7:

[0467] Based on the user's selection, the server uses the relevant booking API to formally secure flights, accommodations, and necessary reservations. The server receives booking confirmation information from each connected service provider and sends it to the terminal.

[0468] Step 8:

[0469] The terminal displays booking confirmation information sent from the server to the user, informing them of the success of their travel plan and the next steps (e.g., what to do if changes are needed). Users can easily review and manage their entire travel plan on the terminal.

[0470] (Example 1)

[0471] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0472] When users plan a trip, they need to collect and organize a vast amount of information to create the optimal plan, which is a time-consuming and laborious task. Furthermore, there is a need for a system that can flexibly modify travel plans to respond to rapidly changing circumstances and instantly reflect the results. In addition, there is an expectation for personalized travel experiences based on each user's past travel history and preferences.

[0473] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0474] In this invention, the server includes information acquisition means for receiving basic travel-related information from the user, communication means for acquiring weather information, transportation information, and accommodation information from external information sources, and computational processing means for analyzing the collected information and generating multiple travel plans using AI technology based on the user's preferences and travel experience. This enables the user to quickly and efficiently obtain the optimal travel plan based on their wishes. Furthermore, by enabling flexible responses to changes and personalization, the burden on the user in planning their trip can be reduced.

[0475] "Information acquisition means" refers to a function for collecting basic travel information from users and sending it to the server.

[0476] "Communication means" refers to means of obtaining weather information, transportation information, and accommodation information from external information sources.

[0477] The "computational processing means" is a system that generates multiple travel plans using generation AI technology, taking into account the user's preferences and travel experience based on the collected data.

[0478] A "presentation means" is an interface means that provides the user with generated travel plans and allows the user to select from them.

[0479] A "reservation processing method" is the process for confirming necessary reservations based on the travel plan selected by the user.

[0480] This invention realizes a system that streamlines the user's travel planning process and provides a personalized travel experience. This system operates through the interaction of the user, terminal, and server.

[0481] Users enter basic travel information via their device. This device can be a standard computer or smartphone, utilizing a dedicated application or web interface. Through this interface, information such as departure date, destination, budget, and preferred activities is collected and sent to the server in JSON format.

[0482] The server is equipped with an advanced generative AI model and accesses various APIs (weather information API, flight information API, accommodation information API, etc.) to collect relevant data based on information received from the user. The collected data is analyzed by the AI ​​model and generates an optimal travel plan based on the user's preferences and past travel history. Specifically, the AI ​​model creates a plan using prompts such as "Generate the optimal travel plan based on the user's requests."

[0483] The generated travel plans are sent from the server to the terminal and displayed on the user's screen as multiple options. The user can compare these plans and choose the best one.

[0484] Based on the selected travel plan, the server uses the relevant booking API to confirm flight and accommodation reservations. Once the reservations are complete, the information is sent back to the device, allowing the user to review their travel plans.

[0485] This system allows users to quickly obtain travel plans tailored to their preferences, significantly reducing the effort involved in planning. Furthermore, even if plans change, the server quickly proposes a new plan, enabling flexible travel planning.

[0486] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0487] Step 1:

[0488] Users enter basic travel information into a terminal application or web interface. This includes items such as departure date, destination, budget, and preferred activities. The entered information is converted to JSON format by the terminal and sent to the server. This input forms the basis for subsequent data processing.

[0489] Step 2:

[0490] The server receives information sent by the user and accesses various external sources to collect necessary data. Specifically, it sends requests to weather information APIs, flight information APIs, and accommodation information APIs to obtain information on destination weather, available flights, and accommodations. The server then filters and aggregates this data appropriately based on the user's requests to prepare for generating the optimal travel plan.

[0491] Step 3:

[0492] The server uses a generative AI model based on the collected data to generate the optimal travel plan for the user's conditions. During this process, the AI ​​model uses prompts such as "Generate the optimal travel plan based on the user's conditions." The generated plan is personalized, taking into account the user's past travel history and current preferences. The output consists of multiple travel plan options.

[0493] Step 4:

[0494] The server sends the generated travel plans to the user's device. The user reviews the multiple plans displayed on the device's screen and compares the details of each plan. Here, an intuitive user interface is crucial to enhancing the user experience, and a design that allows for intuitive access to information is adopted.

[0495] Step 5:

[0496] The user operates the device to select the most ideal travel plan from those presented. Based on the selected plan, the booking process is immediately initiated.

[0497] Step 6:

[0498] The server accesses relevant booking APIs based on the plan selected by the user to confirm flight and accommodation reservations. This process generates booking confirmation information, which is then sent to the user's device. The user can then view the booking details on their device and make changes as needed. This step requires the server to respond quickly, dynamically generating and providing new plans in case of any changes to the user's schedule.

[0499] (Application Example 1)

[0500] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0501] Traditional travel planning systems required users to create travel plans based on information they gathered themselves, which presented challenges in terms of time and effort. Furthermore, they struggled to flexibly accommodate changes in plans and to provide optimal sightseeing plans based on real-time constraints.

[0502] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0503] In this invention, the server includes an input device that receives information related to the user's travel, a communication device that acquires weather data, transportation data, and accommodation data, a processing device that generates multiple travel plans based on the user's preferences and budget based on the acquired data, a display device that provides the generated travel plans to the user and accepts their selection, a reservation device that confirms the reservation based on the user's selection, and a plan provision device that guides smartphone users to the most suitable sightseeing plan in real time. As a result, users can easily create a travel plan optimized to their preferences and budget and receive sightseeing guidance in real time.

[0504] An "input device" is a device used to receive travel-related information from the user.

[0505] A "communication device" is a device used to acquire weather data, transportation data, and accommodation data.

[0506] A "processing device" is a device that generates multiple travel plans based on the user's preferences and budget, using acquired data.

[0507] A "display device" is a device that provides the user with a generated travel plan and accepts their selections.

[0508] A "reservation device" is a device used to confirm a reservation based on the user's selection.

[0509] A "planning device" is a device that guides smartphone users to the most suitable sightseeing plan in real time.

[0510] The system that realizes this invention receives travel-related information from the user via a terminal, including a smartphone. Based on this information, the server obtains weather data, transportation data, and accommodation data from various APIs. This generates multiple travel plans that take into account the user's preferences and budget.

[0511] Specifically, the server uses a programming language such as Python to access a RESTful API and collect the necessary data. The requests library is used for this purpose. The collected data is processed on the server, and multiple optimized travel plans are generated.

[0512] Users can view their travel plans on a display device on their terminal and select their preferred plan. Based on the selected travel plan, the server confirms the reservation and provides further information to the user through a communication service.

[0513] Furthermore, the planning device guides smartphone users to the most suitable sightseeing plans in real time. This allows travelers to instantly receive plans based on the latest information and to quickly respond if they need to change their plans.

[0514] For example, if a user wants to see cherry blossoms in Tokyo, the server will suggest the best possible viewing date based on weather data and provide information on relevant flights and accommodations.

[0515] The following is an example of a prompt statement generated using a generative AI model.

[0516] "A user is planning a trip. Their destination is Tokyo, and they are interested in cherry blossom viewing. Based on the current weather and traffic conditions, please suggest the best cherry blossom viewing plan for the user."

[0517] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0518] Step 1:

[0519] The user enters travel information using a device. The user enters the departure date, destination, budget, and preferred activities into a form on the device. The entered data is converted to JSON format and sent to the server. In this step, the input is the user's travel information, and the output is the information data sent to the server.

[0520] Step 2:

[0521] The server analyzes the received user information and retrieves necessary data from various APIs. Specifically, it obtains destination weather data from the weather API, flight information from the transportation API, and accommodation information from the accommodation API. The server sends HTTP requests to these APIs and receives the data returned in JSON format. The input consists of user information and the response data from the retrieved APIs, and the output is a collection of all the data necessary for processing.

[0522] Step 3:

[0523] The server processes data to generate the optimal travel plan for the user based on the acquired data. To generate a plan that suits the user's preferences and budget constraints, it simulates multiple plans considering weather, flight availability, and accommodation availability. In this step, the input is a collection of acquired travel-related data, and the output is multiple proposed travel plans.

[0524] Step 4:

[0525] The generated travel plan is sent to the terminal and displayed to the user. The user can select the best plan from the multiple plans presented. To accept the selection, the terminal sends the selected plan information to the server through the user interface. The input for this step is the travel plan data, and the output is the selected travel plan.

[0526] Step 5:

[0527] The server confirms the necessary reservations based on the user's selected travel plan. It calls relevant reservation APIs and performs the required procedures to secure flight and accommodation bookings. The input is the selected travel plan, and the output is the confirmed reservation information.

[0528] Step 6:

[0529] The smartphone-based travel planning device uses a generating AI model to guide users to the most suitable travel plan in real time. The server updates the plan in real time, taking into account newly acquired traffic and event information. The input for this step is continuously updated environmental data, and the output is a travel plan that reflects the latest real-time information.

[0530] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0531] This invention is a system that proposes the optimal travel plan to users when they plan a trip, taking into account their individual preferences and emotional state, and aims to improve the user experience in particular by incorporating an emotion engine.

[0532] Overall system configuration

[0533] The system consists of the following main components: The user inputs information via the device, and the emotion engine acquires information through the camera and microphone. The server processes this information and retrieves necessary data from external APIs to generate a travel plan. The generated plan is finally returned to the device, and the user selects the plan.

[0534] Program processing

[0535] Input stage

[0536] The user enters travel information such as departure date, destination, and budget through an interface on their device. At this point, the emotion engine captures the user's facial expressions and voice and analyzes their emotions. The device then sends this information to the server.

[0537] Data acquisition and plan generation

[0538] The server retrieves necessary travel information using APIs such as weather information APIs and flight information APIs, based on input information and data from the emotion engine. The server designs the optimal travel plan, taking into account the user's preferences and emotional information. Based on emotional information, it provides options that fit the user's current emotions, such as plans that emphasize relaxation or plans that focus on activities.

[0539] User Feedback

[0540] Multiple travel plans generated by the server are sent to the device. The device presents the plans to the user, displaying detailed plan information, including prices and itineraries, in an easy-to-read format. Based on the sentiment analysis results, the user selects the most suitable plan from the suggested options, using their feedback.

[0541] Reservations and management

[0542] After the user selects a plan, the server uses an external booking API to confirm flight and accommodation reservations. The emotion engine monitors the user's emotions throughout the trip and suggests alternative plans in real time if changes to the plan are needed.

[0543] Specific example

[0544] If a user is feeling stressed and wants to relax, the emotion engine identifies this state. The server then offers plans that include relaxing pastoral environments, spa resort stays, and other options. Users can select from these plans and easily plan a trip that helps reduce stress.

[0545] In this way, this system allows users to easily obtain travel plans that are more tailored to their needs and emotions. This improves the quality of travel and makes it possible to provide a more satisfying experience.

[0546] The following describes the processing flow.

[0547] Step 1:

[0548] The user enters basic travel information (departure point, destination, dates, budget, etc.) on the device. The device converts the entered information into JSON format and prepares to send it to the server. During this process, the emotion engine captures the user's facial expressions and voice and analyzes their current emotional state. The user presses the submit button when they have finished entering the information.

[0549] Step 2:

[0550] The device sends the user's travel information and sentiment data to the server in JSON format. The device confirms that the transmission is complete and displays a success message to the user.

[0551] Step 3:

[0552] The server analyzes the received user information and sentiment data. The server queries various APIs to collect data such as weather, flights, and accommodations based on the entered travel information. Each API query may include parameters based on sentiment data.

[0553] Step 4:

[0554] The server integrates the information returned from the API and generates multiple travel plans. The server then fine-tunes the plan options based on the user's emotional state. For example, if relaxation is needed, the server prioritizes plans that include quiet tourist attractions and relaxing activities.

[0555] Step 5:

[0556] The server sends the generated plan to the device. The device visually displays multiple travel plans suitable for the user, allowing the user to compare them. Each plan includes information such as budget, main experiences, and recommended activities.

[0557] Step 6:

[0558] The user compares the displayed travel plans and selects their preferred plan. The selection information is sent to the server via the device. The emotion engine then receives further user feedback and may offer new suggestions if adjustments are needed.

[0559] Step 7:

[0560] The server uses various booking APIs based on the user's selection to confirm bookings for flights, accommodations, and required activities. After receiving booking confirmation, the server sends updated information to the device.

[0561] Step 8:

[0562] The terminal receives booking confirmation information from the server and displays it to the user. The user can confirm that the booking is confirmed as planned and proceed to the next step (preparing for departure) if necessary. The emotion engine also checks the user's emotions during the trip and suggests additional support or new plans if needed.

[0563] (Example 2)

[0564] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0565] Traditional travel planning systems provided plans based on user preferences and budgets, but failed to consider the user's emotional state. Therefore, it was difficult to provide a satisfying experience for users seeking stress relief and relaxation. There is a need to solve this problem and provide travel plans tailored to each user's individual preferences and emotional state.

[0566] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0567] In this invention, the server includes an input means using a terminal to receive information related to the user's travel, an information acquisition means using an emotion analysis device to analyze the user's emotional state, and a processing means using a generative AI model to generate a plurality of personalized travel plans based on the acquired information and the user's emotional analysis. This makes it possible to provide a travel plan that matches the user's emotional state.

[0568] "Input methods using terminals" refers to devices and interfaces for users to input travel-related information, and the means by which this information is appropriately transmitted to the system.

[0569] An "emotion analysis device" is a technology or device that acquires a user's facial expressions and voice data and analyzes the user's emotional state based on that data.

[0570] "Communication means" refers to network communication means used to obtain data such as weather information, transportation information, and facility information from external sources.

[0571] A "generative AI model" is an artificial intelligence model used to create personalized travel plans based on user input information and emotional states.

[0572] "Processing means" refers to a function or device that uses acquired information to perform specific calculations or procedures and derive the desired results.

[0573] "Display means" refers to a display or other display device used to present the generated travel plan to the user.

[0574] A "booking method" refers to a method or system for confirming reservations for accommodations, transportation, etc., based on the travel plan selected by the user.

[0575] This invention is a system that provides users with more personalized travel plans when they are planning a trip. Specifically, it aims to easily generate travel plans that take into account the user's emotional state.

[0576] The user uses a terminal to input basic travel information. The terminal receives the user's departure date, destination, and budget, and uses an emotion analysis device to obtain emotional data from the user's facial expressions and voice. This allows for real-time analysis of the user's current emotional state.

[0577] The server receives information transmitted from the terminal and simultaneously acquires necessary data using external communication methods. This data includes weather information, transportation information, and accommodation information, which are obtained via the network. The server then uses a generative AI model to generate a travel plan based on the user's input and emotional data. This generative AI model can design a plan that is adapted to the user's emotional state.

[0578] For example, if the emotion analysis system determines that a user has been working for a long time and desires relaxation, the server will generate a plan that includes travel destinations and activities specifically designed for relaxation. Furthermore, by presenting a variety of options, users can easily choose the plan that best suits them.

[0579] Once a travel plan is generated, the device displays it to the user. The user can compare the displayed plans and select the one that best suits their needs and mood. Based on the user's selection, the server then uses booking methods to confirm reservations for accommodation and transportation.

[0580] A concrete example of a prompt message in this invention is that if the user inputs something like, "I want to relax, I want a nature-rich environment, and my budget is under 300,000 yen," the system can provide a travel plan that matches these inputs.

[0581] This allows users to easily obtain travel plans that match their emotional state, greatly improving the quality and satisfaction of their trips.

[0582] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0583] Step 1:

[0584] The user enters basic travel information through the terminal's interface. Specifically, they enter information such as the departure date, destination, budget, and purpose of travel, and the terminal aggregates this information. The entered data is formatted and sent to the server in preparation for the next processing step.

[0585] Step 2:

[0586] The device uses an emotion analysis device to capture the user's facial expressions and voice. This allows for real-time analysis of the user's emotional state and provides the analysis results. The emotional data obtained through this analysis is important for more accurately reflecting the user's travel needs and requests. The emotional data, along with the user's input information, is sent to the server.

[0587] Step 3:

[0588] Based on the user information and sentiment data received, the server uses communication methods to obtain external weather information, transportation information, and accommodation information. In this acquisition process, the server uses specific APIs to retrieve the latest information from relevant databases and formats it in a format suitable for the user's trip.

[0589] Step 4:

[0590] The server uses a generative AI model to generate travel plans that take into account the user's preferences and emotional state. A specific algorithm combines acquired information with user input and emotional data to design multiple plans that suit the user's purpose and emotions. This process involves data analysis and optimization to construct recommended travel options.

[0591] Step 5:

[0592] The generated travel plan is sent from the server to the terminal and presented to the user from the terminal. The terminal displays the plan in an easy-to-understand format, including detailed pricing and itinerary. The user compares and considers the presented plans and selects the one that best suits their needs.

[0593] Step 6:

[0594] Once a user selects a plan, the server uses a booking system to confirm reservations for accommodation, transportation, and other services. This process utilizes an external API to accurately input the user's chosen reservation information and verify it in real time. Upon completion of the reservation, confirmation information is generated and sent to the user via their device.

[0595] (Application Example 2)

[0596] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0597] In recent years, with the increasing demand for diverse travel styles, there has been a lack of travel plans tailored to users' individual emotional states and preferences. As a result, users experience increased stress and hassle when planning trips, and may have less satisfying experiences. Furthermore, while there is a need for flexible plan changes during the trip based on the user's emotional state, methods for achieving this in real time are still underdeveloped.

[0598] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0599] In this invention, the server includes information acquisition means for receiving information related to the user's travel, communication means for acquiring weather information, transportation information, and accommodation information, and plan generation means for generating multiple travel plans based on the acquired information and emotional information, as well as the user's preferences, budget, and emotional state. This makes it possible to flexibly provide travel plans that are tailored to the user's emotional state and individual preferences.

[0600] "Information acquisition means" refers to devices or methods that have the function of receiving travel-related information from users.

[0601] "Communication means" refers to devices and methods for obtaining weather information, transportation information, and accommodation information from external sources.

[0602] A "plan generation means" is a device or method that has the function of designing multiple travel plans that take into account the user's preferences, budget, and emotional state, based on acquired information and emotional information.

[0603] "Presentation means" refers to a display device or method for presenting a generated travel plan to the user in an easily viewable format and for accepting selections.

[0604] A "confirmation method" refers to a device or method that has the function of confirming various travel arrangements and reservations based on the user's selection.

[0605] The program to implement this system mainly consists of a server, a user terminal, and an emotion analysis device. The server receives travel-related information from the user through information acquisition means. This includes basic information such as departure date, destination, and budget. Furthermore, the emotion analysis device acquires emotional information from the user's facial expressions and voice using a camera and microphone.

[0606] Based on the acquired data, the server uses communication methods to obtain weather information, transportation information, and accommodation information from external APIs. Next, using a plan generation method, it generates multiple optimal travel plans based on the acquired information, user preferences, and emotional state. At this time, it is possible to analyze the data using a generation AI model and select the plan that is best suited to the user.

[0607] The generated travel plans are presented to the user in an easy-to-view format through the device's display mechanism. The user can choose a plan from the presented options that matches their emotional state. After selection, the server uses a confirmation mechanism to make the reservation and complete the travel arrangements.

[0608] For example, if a user is presented with the message, "How about a nearby hot spring spa resort? We can also arrange a healing session," on their device, the user can select this plan and confirm the reservation. This results in a travel plan that aligns with the user's emotions.

[0609] An example of a prompt message could be, "If the user is feeling stressed, generate a travel plan that provides relaxation." Based on this prompt, the server automatically selects an appropriate plan and provides it to the user.

[0610] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0611] Step 1:

[0612] The terminal receives basic travel information from the user. The user enters the departure date, destination, and budget into the terminal's interface. The terminal then formats this information and prepares it for transmission to the server.

[0613] Step 2:

[0614] An emotion analysis device uses a camera and microphone to capture the user's facial expressions and voice, and generates emotional information. The input is real-time video and audio data, which the emotion analysis device analyzes to identify the category of emotion. As output, it generates the user's emotional state (e.g., relaxed, stressed, excited) and sends it to the server via the terminal.

[0615] Step 3:

[0616] The server accesses external APIs based on travel and sentiment information received from the device to retrieve relevant weather, transportation, and accommodation information. Specifically, it uses destination and date / time information sent from the device to retrieve the respective information from third-party APIs. The retrieved information is stored in a database for use in subsequent steps.

[0617] Step 4:

[0618] Based on the information acquired by the server, a travel plan is designed using a plan generation method. Here, a generation AI model is used to generate multiple plans that take into account the user's emotional state and budget. The input consists of collected travel information and emotional information, which are analyzed through a planning algorithm and output as the optimal travel plan.

[0619] Step 5:

[0620] The server sends the generated travel plan to the terminal. The terminal displays the received plan in an easy-to-read format for the user. The user selects the plan they like best. Here, the plan details are displayed, and the selection is made through user input. The output is the plan selected by the user.

[0621] Step 6:

[0622] The server uses an external booking service API to confirm the necessary reservation based on the plan selected by the user. The input is the selected plan information, and the output generates an actual reservation confirmation and details, including flight and accommodation confirmations.

[0623] Step 7:

[0624] During the trip, the server continuously receives updated emotional information from the emotion analysis device and, if necessary, uses a generating AI model to suggest alternative plans in real time. The input is the user's emotional information during the trip, and the output is the presentation of proposed plan changes as needed.

[0625] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0626] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0627] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0628] [Fourth Embodiment]

[0629] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0630] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0631] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0632] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0633] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0634] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0635] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0636] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0637] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0638] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0639] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0640] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0641] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0642] The present invention is a system for supporting travel planning, and its purpose is to receive travel information from the user, generate an appropriate travel plan, and provide it to the user.

[0643] Overall system configuration

[0644] The system consists of the following main components: terminals for users to input travel information, various APIs that the server interacts with, and various databases.

[0645] Program processing

[0646] Input stage

[0647] The user enters basic travel information (e.g., departure date, destination, budget, preferred activities) into a form on their device. The entered information is sent to the server in JSON format.

[0648] Data acquisition and plan generation

[0649] Based on the user information received, the server accesses various APIs (e.g., weather information, flight information, accommodation information) to obtain the necessary data. The server then combines this data to generate an optimal travel plan that takes into account the user's preferences and past travel history.

[0650] User Feedback

[0651] The server returns the generated travel plan to the terminal, presenting the user with multiple options. The user can then select the most suitable plan and confirm the reservation through the terminal.

[0652] Reservations and management

[0653] The server accesses relevant booking APIs based on user selections to confirm flight and accommodation reservations. Furthermore, it calculates the costs associated with any changes to the plan and proposes alternative plans to the user.

[0654] Specific example

[0655] For example, if a user is planning a trip to Tokyo in the spring to see the cherry blossoms, they enter basic information on their device. The server retrieves spring weather forecasts for Tokyo and information on when the cherry blossoms are at their best from weather APIs and tourism databases. It then collects flight and accommodation information and generates suggested plans. Finally, it confirms the booking based on the plan selected by the user. The user can view all the information on their device, making it possible to have an enjoyable trip.

[0656] Thus, the present invention provides users with a personalized travel experience, reduces effort, and achieves high convenience.

[0657] The following describes the processing flow.

[0658] Step 1:

[0659] Users enter travel information through an interface on their device. This includes departure date, destination, budget, and preferred activities. Once the user has finished entering the information, the device constructs the information as JSON data and sends it to the server.

[0660] Step 2:

[0661] The server parses the JSON data received from the user and prepares to communicate with various APIs. This includes setting request parameters for the weather information API, flight information API, and accommodation information API. The server then sends requests to each API to retrieve information based on the user's destination and itinerary.

[0662] Step 3:

[0663] The server receives responses from the APIs and retrieves the corresponding information. For example, the weather information API provides the destination's weather forecast, the flight information API provides a list of flights, and the accommodation information API provides hotel and Airbnb availability and pricing information.

[0664] Step 4:

[0665] The server analyzes the acquired information and generates multiple travel plans based on the user's preferences and budget. Each plan specifies flight options, accommodation choices, sightseeing spots, and required budget. The plans are customized to the user's individual needs.

[0666] Step 5:

[0667] The server generates multiple travel plans and sends them to the device. The device then displays these plans to the user in an easy-to-understand visual format, allowing the user to compare different options.

[0668] Step 6:

[0669] The user selects the most suitable travel plan from the options presented and confirms their selection to the server via their device. The user's selection includes confirming their desired flights, accommodations, and activities.

[0670] Step 7:

[0671] Based on the user's selection, the server uses the relevant booking API to formally secure flights, accommodations, and necessary reservations. The server receives booking confirmation information from each connected service provider and sends it to the terminal.

[0672] Step 8:

[0673] The terminal displays booking confirmation information sent from the server to the user, informing them of the success of their travel plan and the next steps (e.g., what to do if changes are needed). Users can easily review and manage their entire travel plan on the terminal.

[0674] (Example 1)

[0675] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0676] When users plan a trip, they need to collect and organize a vast amount of information to create the optimal plan, which is a time-consuming and laborious task. Furthermore, there is a need for a system that can flexibly modify travel plans to respond to rapidly changing circumstances and instantly reflect the results. In addition, there is an expectation for personalized travel experiences based on each user's past travel history and preferences.

[0677] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0678] In this invention, the server includes information acquisition means for receiving basic travel-related information from the user, communication means for acquiring weather information, transportation information, and accommodation information from external information sources, and computational processing means for analyzing the collected information and generating multiple travel plans using AI technology based on the user's preferences and travel experience. This enables the user to quickly and efficiently obtain the optimal travel plan based on their wishes. Furthermore, by enabling flexible responses to changes and personalization, the burden on the user in planning their trip can be reduced.

[0679] "Information acquisition means" refers to a function for collecting basic travel information from users and sending it to the server.

[0680] "Communication means" refers to means of obtaining weather information, transportation information, and accommodation information from external information sources.

[0681] The "computational processing means" is a system that generates multiple travel plans using generation AI technology, taking into account the user's preferences and travel experience based on the collected data.

[0682] A "presentation means" is an interface means that provides the user with generated travel plans and allows the user to select from them.

[0683] A "reservation processing method" is the process for confirming necessary reservations based on the travel plan selected by the user.

[0684] This invention realizes a system that streamlines the user's travel planning process and provides a personalized travel experience. This system operates through the interaction of the user, terminal, and server.

[0685] Users enter basic travel information via their device. This device can be a standard computer or smartphone, utilizing a dedicated application or web interface. Through this interface, information such as departure date, destination, budget, and preferred activities is collected and sent to the server in JSON format.

[0686] The server is equipped with an advanced generative AI model and accesses various APIs (weather information API, flight information API, accommodation information API, etc.) to collect relevant data based on information received from the user. The collected data is analyzed by the AI ​​model and generates an optimal travel plan based on the user's preferences and past travel history. Specifically, the AI ​​model creates a plan using prompts such as "Generate the optimal travel plan based on the user's requests."

[0687] The generated travel plans are sent from the server to the terminal and displayed on the user's screen as multiple options. The user can compare these plans and choose the best one.

[0688] Based on the selected travel plan, the server uses the relevant booking API to confirm flight and accommodation reservations. Once the reservations are complete, the information is sent back to the device, allowing the user to review their travel plans.

[0689] This system allows users to quickly obtain travel plans tailored to their preferences, significantly reducing the effort involved in planning. Furthermore, even if plans change, the server quickly proposes a new plan, enabling flexible travel planning.

[0690] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0691] Step 1:

[0692] Users enter basic travel information into a terminal application or web interface. This includes items such as departure date, destination, budget, and preferred activities. The entered information is converted to JSON format by the terminal and sent to the server. This input forms the basis for subsequent data processing.

[0693] Step 2:

[0694] The server receives information sent by the user and accesses various external sources to collect necessary data. Specifically, it sends requests to weather information APIs, flight information APIs, and accommodation information APIs to obtain information on destination weather, available flights, and accommodations. The server then filters and aggregates this data appropriately based on the user's requests to prepare for generating the optimal travel plan.

[0695] Step 3:

[0696] The server uses a generative AI model based on the collected data to generate the optimal travel plan for the user's conditions. During this process, the AI ​​model uses prompts such as "Generate the optimal travel plan based on the user's conditions." The generated plan is personalized, taking into account the user's past travel history and current preferences. The output consists of multiple travel plan options.

[0697] Step 4:

[0698] The server sends the generated travel plans to the user's device. The user reviews the multiple plans displayed on the device's screen and compares the details of each plan. Here, an intuitive user interface is crucial to enhancing the user experience, and a design that allows for intuitive access to information is adopted.

[0699] Step 5:

[0700] The user operates the device to select the most ideal travel plan from those presented. Based on the selected plan, the booking process is immediately initiated.

[0701] Step 6:

[0702] The server accesses relevant booking APIs based on the plan selected by the user to confirm flight and accommodation reservations. This process generates booking confirmation information, which is then sent to the user's device. The user can then view the booking details on their device and make changes as needed. This step requires the server to respond quickly, dynamically generating and providing new plans in case of any changes to the user's schedule.

[0703] (Application Example 1)

[0704] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0705] Traditional travel planning systems required users to create travel plans based on information they gathered themselves, which presented challenges in terms of time and effort. Furthermore, they struggled to flexibly accommodate changes in plans and to provide optimal sightseeing plans based on real-time constraints.

[0706] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0707] In this invention, the server includes an input device that receives information related to the user's travel, a communication device that acquires weather data, transportation data, and accommodation data, a processing device that generates multiple travel plans based on the user's preferences and budget based on the acquired data, a display device that provides the generated travel plans to the user and accepts their selection, a reservation device that confirms the reservation based on the user's selection, and a plan provision device that guides smartphone users to the most suitable sightseeing plan in real time. As a result, users can easily create a travel plan optimized to their preferences and budget and receive sightseeing guidance in real time.

[0708] An "input device" is a device used to receive travel-related information from the user.

[0709] A "communication device" is a device used to acquire weather data, transportation data, and accommodation data.

[0710] A "processing device" is a device that generates multiple travel plans based on the user's preferences and budget, using acquired data.

[0711] A "display device" is a device that provides the user with a generated travel plan and accepts their selections.

[0712] A "reservation device" is a device used to confirm a reservation based on the user's selection.

[0713] A "planning device" is a device that guides smartphone users to the most suitable sightseeing plan in real time.

[0714] The system that realizes this invention receives travel-related information from the user via a terminal, including a smartphone. Based on this information, the server obtains weather data, transportation data, and accommodation data from various APIs. This generates multiple travel plans that take into account the user's preferences and budget.

[0715] Specifically, the server uses a programming language such as Python to access a RESTful API and collect the necessary data. The requests library is used for this purpose. The collected data is processed on the server, and multiple optimized travel plans are generated.

[0716] Users can view their travel plans on a display device on their terminal and select their preferred plan. Based on the selected travel plan, the server confirms the reservation and provides further information to the user through a communication service.

[0717] Furthermore, the planning device guides smartphone users to the most suitable sightseeing plans in real time. This allows travelers to instantly receive plans based on the latest information and to quickly respond if they need to change their plans.

[0718] For example, if a user wants to see cherry blossoms in Tokyo, the server will suggest the best possible viewing date based on weather data and provide information on relevant flights and accommodations.

[0719] The following is an example of a prompt statement generated using a generative AI model.

[0720] "A user is planning a trip. Their destination is Tokyo, and they are interested in cherry blossom viewing. Based on the current weather and traffic conditions, please suggest the best cherry blossom viewing plan for the user."

[0721] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0722] Step 1:

[0723] The user enters travel information using a device. The user enters the departure date, destination, budget, and preferred activities into a form on the device. The entered data is converted to JSON format and sent to the server. In this step, the input is the user's travel information, and the output is the information data sent to the server.

[0724] Step 2:

[0725] The server analyzes the received user information and retrieves necessary data from various APIs. Specifically, it obtains destination weather data from the weather API, flight information from the transportation API, and accommodation information from the accommodation API. The server sends HTTP requests to these APIs and receives the data returned in JSON format. The input consists of user information and the response data from the retrieved APIs, and the output is a collection of all the data necessary for processing.

[0726] Step 3:

[0727] The server processes data to generate the optimal travel plan for the user based on the acquired data. To generate a plan that suits the user's preferences and budget constraints, it simulates multiple plans considering weather, flight availability, and accommodation availability. In this step, the input is a collection of acquired travel-related data, and the output is multiple proposed travel plans.

[0728] Step 4:

[0729] The generated travel plan is sent to the terminal and displayed to the user. The user can select the best plan from the multiple plans presented. To accept the selection, the terminal sends the selected plan information to the server through the user interface. The input for this step is the travel plan data, and the output is the selected travel plan.

[0730] Step 5:

[0731] The server confirms the necessary reservations based on the user's selected travel plan. It calls relevant reservation APIs and performs the required procedures to secure flight and accommodation bookings. The input is the selected travel plan, and the output is the confirmed reservation information.

[0732] Step 6:

[0733] The smartphone-based travel planning device uses a generating AI model to guide users to the most suitable travel plan in real time. The server updates the plan in real time, taking into account newly acquired traffic and event information. The input for this step is continuously updated environmental data, and the output is a travel plan that reflects the latest real-time information.

[0734] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0735] This invention is a system that proposes the optimal travel plan to users when they plan a trip, taking into account their individual preferences and emotional state, and aims to improve the user experience in particular by incorporating an emotion engine.

[0736] Overall system configuration

[0737] The system consists of the following main components: The user inputs information via the device, and the emotion engine acquires information through the camera and microphone. The server processes this information and retrieves necessary data from external APIs to generate a travel plan. The generated plan is finally returned to the device, and the user selects the plan.

[0738] Program processing

[0739] Input stage

[0740] The user enters travel information such as departure date, destination, and budget through an interface on their device. At this point, the emotion engine captures the user's facial expressions and voice and analyzes their emotions. The device then sends this information to the server.

[0741] Data acquisition and plan generation

[0742] The server retrieves necessary travel information using APIs such as weather information APIs and flight information APIs, based on input information and data from the emotion engine. The server designs the optimal travel plan, taking into account the user's preferences and emotional information. Based on emotional information, it provides options that fit the user's current emotions, such as plans that emphasize relaxation or plans that focus on activities.

[0743] User Feedback

[0744] Multiple travel plans generated by the server are sent to the device. The device presents the plans to the user, displaying detailed plan information, including prices and itineraries, in an easy-to-read format. Based on the sentiment analysis results, the user selects the most suitable plan from the suggested options, using their feedback.

[0745] Reservations and management

[0746] After the user selects a plan, the server uses an external booking API to confirm flight and accommodation reservations. The emotion engine monitors the user's emotions throughout the trip and suggests alternative plans in real time if changes to the plan are needed.

[0747] Specific example

[0748] If a user is feeling stressed and wants to relax, the emotion engine identifies this state. The server then offers plans that include relaxing pastoral environments, spa resort stays, and other options. Users can select from these plans and easily plan a trip that helps reduce stress.

[0749] In this way, this system allows users to easily obtain travel plans that are more tailored to their needs and emotions. This improves the quality of travel and makes it possible to provide a more satisfying experience.

[0750] The following describes the processing flow.

[0751] Step 1:

[0752] The user enters basic travel information (departure point, destination, dates, budget, etc.) on the device. The device converts the entered information into JSON format and prepares to send it to the server. During this process, the emotion engine captures the user's facial expressions and voice and analyzes their current emotional state. The user presses the submit button when they have finished entering the information.

[0753] Step 2:

[0754] The device sends the user's travel information and sentiment data to the server in JSON format. The device confirms that the transmission is complete and displays a success message to the user.

[0755] Step 3:

[0756] The server analyzes the received user information and sentiment data. The server queries various APIs to collect data such as weather, flights, and accommodations based on the entered travel information. Each API query may include parameters based on sentiment data.

[0757] Step 4:

[0758] The server integrates the information returned from the API and generates multiple travel plans. The server then fine-tunes the plan options based on the user's emotional state. For example, if relaxation is needed, the server prioritizes plans that include quiet tourist attractions and relaxing activities.

[0759] Step 5:

[0760] The server sends the generated plan to the device. The device visually displays multiple travel plans suitable for the user, allowing the user to compare them. Each plan includes information such as budget, main experiences, and recommended activities.

[0761] Step 6:

[0762] The user compares the displayed travel plans and selects their preferred plan. The selection information is sent to the server via the device. The emotion engine then receives further user feedback and may offer new suggestions if adjustments are needed.

[0763] Step 7:

[0764] The server uses various booking APIs based on the user's selection to confirm bookings for flights, accommodations, and required activities. After receiving booking confirmation, the server sends updated information to the device.

[0765] Step 8:

[0766] The terminal receives booking confirmation information from the server and displays it to the user. The user can confirm that the booking is confirmed as planned and proceed to the next step (preparing for departure) if necessary. The emotion engine also checks the user's emotions during the trip and suggests additional support or new plans if needed.

[0767] (Example 2)

[0768] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0769] Traditional travel planning systems provided plans based on user preferences and budgets, but failed to consider the user's emotional state. Therefore, it was difficult to provide a satisfying experience for users seeking stress relief and relaxation. There is a need to solve this problem and provide travel plans tailored to each user's individual preferences and emotional state.

[0770] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0771] In this invention, the server includes an input means using a terminal to receive information related to the user's travel, an information acquisition means using an emotion analysis device to analyze the user's emotional state, and a processing means using a generative AI model to generate a plurality of personalized travel plans based on the acquired information and the user's emotional analysis. This makes it possible to provide a travel plan that matches the user's emotional state.

[0772] "Input methods using terminals" refers to devices and interfaces for users to input travel-related information, and the means by which this information is appropriately transmitted to the system.

[0773] An "emotion analysis device" is a technology or device that acquires a user's facial expressions and voice data and analyzes the user's emotional state based on that data.

[0774] "Communication means" refers to network communication means used to obtain data such as weather information, transportation information, and facility information from external sources.

[0775] A "generative AI model" is an artificial intelligence model used to create personalized travel plans based on user input information and emotional states.

[0776] "Processing means" refers to a function or device that uses acquired information to perform specific calculations or procedures and derive the desired results.

[0777] "Display means" refers to a display or other display device used to present the generated travel plan to the user.

[0778] A "booking method" refers to a method or system for confirming reservations for accommodations, transportation, etc., based on the travel plan selected by the user.

[0779] This invention is a system that provides users with more personalized travel plans when they are planning a trip. Specifically, it aims to easily generate travel plans that take into account the user's emotional state.

[0780] The user uses a terminal to input basic travel information. The terminal receives the user's departure date, destination, and budget, and uses an emotion analysis device to obtain emotional data from the user's facial expressions and voice. This allows for real-time analysis of the user's current emotional state.

[0781] The server receives information transmitted from the terminal and simultaneously acquires necessary data using external communication methods. This data includes weather information, transportation information, and accommodation information, which are obtained via the network. The server then uses a generative AI model to generate a travel plan based on the user's input and emotional data. This generative AI model can design a plan that is adapted to the user's emotional state.

[0782] For example, if the emotion analysis system determines that a user has been working for a long time and desires relaxation, the server will generate a plan that includes travel destinations and activities specifically designed for relaxation. Furthermore, by presenting a variety of options, users can easily choose the plan that best suits them.

[0783] Once a travel plan is generated, the device displays it to the user. The user can compare the displayed plans and select the one that best suits their needs and mood. Based on the user's selection, the server then uses booking methods to confirm reservations for accommodation and transportation.

[0784] A concrete example of a prompt message in this invention is that if the user inputs something like, "I want to relax, I want a nature-rich environment, and my budget is under 300,000 yen," the system can provide a travel plan that matches these inputs.

[0785] This allows users to easily obtain travel plans that match their emotional state, greatly improving the quality and satisfaction of their trips.

[0786] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0787] Step 1:

[0788] The user enters basic travel information through the terminal's interface. Specifically, they enter information such as the departure date, destination, budget, and purpose of travel, and the terminal aggregates this information. The entered data is formatted and sent to the server in preparation for the next processing step.

[0789] Step 2:

[0790] The device uses an emotion analysis device to capture the user's facial expressions and voice. This allows for real-time analysis of the user's emotional state and provides the analysis results. The emotional data obtained through this analysis is important for more accurately reflecting the user's travel needs and requests. The emotional data, along with the user's input information, is sent to the server.

[0791] Step 3:

[0792] Based on the user information and sentiment data received, the server uses communication methods to obtain external weather information, transportation information, and accommodation information. In this acquisition process, the server uses specific APIs to retrieve the latest information from relevant databases and formats it in a format suitable for the user's trip.

[0793] Step 4:

[0794] The server uses a generative AI model to generate travel plans that take into account the user's preferences and emotional state. A specific algorithm combines acquired information with user input and emotional data to design multiple plans that suit the user's purpose and emotions. This process involves data analysis and optimization to construct recommended travel options.

[0795] Step 5:

[0796] The generated travel plan is sent from the server to the terminal and presented to the user from the terminal. The terminal displays the plan in an easy-to-understand format, including detailed pricing and itinerary. The user compares and considers the presented plans and selects the one that best suits their needs.

[0797] Step 6:

[0798] Once a user selects a plan, the server uses a booking system to confirm reservations for accommodation, transportation, and other services. This process utilizes an external API to accurately input the user's chosen reservation information and verify it in real time. Upon completion of the reservation, confirmation information is generated and sent to the user via their device.

[0799] (Application Example 2)

[0800] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0801] In recent years, with the increasing demand for diverse travel styles, there has been a lack of travel plans tailored to users' individual emotional states and preferences. As a result, users experience increased stress and hassle when planning trips, and may have less satisfying experiences. Furthermore, while there is a need for flexible plan changes during the trip based on the user's emotional state, methods for achieving this in real time are still underdeveloped.

[0802] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0803] In this invention, the server includes information acquisition means for receiving information related to the user's travel, communication means for acquiring weather information, transportation information, and accommodation information, and plan generation means for generating multiple travel plans based on the acquired information and emotional information, as well as the user's preferences, budget, and emotional state. This makes it possible to flexibly provide travel plans that are tailored to the user's emotional state and individual preferences.

[0804] "Information acquisition means" refers to devices or methods that have the function of receiving travel-related information from users.

[0805] "Communication means" refers to devices and methods for obtaining weather information, transportation information, and accommodation information from external sources.

[0806] A "plan generation means" is a device or method that has the function of designing multiple travel plans that take into account the user's preferences, budget, and emotional state, based on acquired information and emotional information.

[0807] "Presentation means" refers to a display device or method for presenting a generated travel plan to the user in an easily viewable format and for accepting selections.

[0808] A "confirmation method" refers to a device or method that has the function of confirming various travel arrangements and reservations based on the user's selection.

[0809] The program to implement this system mainly consists of a server, a user terminal, and an emotion analysis device. The server receives travel-related information from the user through information acquisition means. This includes basic information such as departure date, destination, and budget. Furthermore, the emotion analysis device acquires emotional information from the user's facial expressions and voice using a camera and microphone.

[0810] Based on the acquired data, the server uses communication methods to obtain weather information, transportation information, and accommodation information from external APIs. Next, using a plan generation method, it generates multiple optimal travel plans based on the acquired information, user preferences, and emotional state. At this time, it is possible to analyze the data using a generation AI model and select the plan that is best suited to the user.

[0811] The generated travel plans are presented to the user in an easy-to-view format through the device's display mechanism. The user can choose a plan from the presented options that matches their emotional state. After selection, the server uses a confirmation mechanism to make the reservation and complete the travel arrangements.

[0812] For example, if a user is presented with the message, "How about a nearby hot spring spa resort? We can also arrange a healing session," on their device, the user can select this plan and confirm the reservation. This results in a travel plan that aligns with the user's emotions.

[0813] An example of a prompt message could be, "If the user is feeling stressed, generate a travel plan that provides relaxation." Based on this prompt, the server automatically selects an appropriate plan and provides it to the user.

[0814] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0815] Step 1:

[0816] The terminal receives basic travel information from the user. The user enters the departure date, destination, and budget into the terminal's interface. The terminal then formats this information and prepares it for transmission to the server.

[0817] Step 2:

[0818] An emotion analysis device uses a camera and microphone to capture the user's facial expressions and voice, and generates emotional information. The input is real-time video and audio data, which the emotion analysis device analyzes to identify the category of emotion. As output, it generates the user's emotional state (e.g., relaxed, stressed, excited) and sends it to the server via the terminal.

[0819] Step 3:

[0820] The server accesses external APIs based on travel and sentiment information received from the device to retrieve relevant weather, transportation, and accommodation information. Specifically, it uses destination and date / time information sent from the device to retrieve the respective information from third-party APIs. The retrieved information is stored in a database for use in subsequent steps.

[0821] Step 4:

[0822] Based on the information acquired by the server, a travel plan is designed using a plan generation method. Here, a generation AI model is used to generate multiple plans that take into account the user's emotional state and budget. The input consists of collected travel information and emotional information, which are analyzed through a planning algorithm and output as the optimal travel plan.

[0823] Step 5:

[0824] The server sends the generated travel plan to the terminal. The terminal displays the received plan in an easy-to-read format for the user. The user selects the plan they like best. Here, the plan details are displayed, and the selection is made through user input. The output is the plan selected by the user.

[0825] Step 6:

[0826] The server uses an external booking service API to confirm the necessary reservation based on the plan selected by the user. The input is the selected plan information, and the output generates an actual reservation confirmation and details, including flight and accommodation confirmations.

[0827] Step 7:

[0828] During the trip, the server continuously receives updated emotional information from the emotion analysis device and, if necessary, uses a generating AI model to suggest alternative plans in real time. The input is the user's emotional information during the trip, and the output is the presentation of proposed plan changes as needed.

[0829] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0830] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0831] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0832] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0833] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0834] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0835] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0836] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0837] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0838] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0839] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0840] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0841] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0842] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0843] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0844] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0845] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0846] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0847] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0848] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0849] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0850] The following is further disclosed regarding the embodiments described above.

[0851] (Claim 1)

[0852] An input method for receiving information related to the user's travel,

[0853] A communication means for obtaining weather information, transportation information, and accommodation information,

[0854] A processing method that generates multiple travel plans based on the user's preferences and budget, based on the acquired information,

[0855] A display means that provides the generated travel plan to the user and accepts their selection,

[0856] A reservation method that confirms a reservation based on the user's selection,

[0857] A system that includes this.

[0858] (Claim 2)

[0859] The system according to claim 1, which performs a process to recalculate the costs and risks when a change is made to the selected travel plan.

[0860] (Claim 3)

[0861] The system according to claim 1, wherein the input means collects information that is individually optimized based on the user's past travel history and preferences.

[0862] "Example 1"

[0863] (Claim 1)

[0864] A means of obtaining information to receive basic travel-related information from users,

[0865] A communication means for obtaining weather information, transportation information, and accommodation information from external sources,

[0866] A computational processing means that analyzes collected information based on the user's preferences and travel experience and generates multiple travel plans using AI technology,

[0867] A presentation means that presents the generated travel plan to the user and allows them to make a selection,

[0868] A reservation processing means that confirms the reservation based on the user's selection,

[0869] A system that includes this.

[0870] (Claim 2)

[0871] The system according to claim 1, which recalculates the costs and risks and makes a new proposal when a change is made to the selected travel plan.

[0872] (Claim 3)

[0873] The system according to claim 1, wherein the information acquisition means collects information that is individually optimized based on the user's past travel history and preferences.

[0874] "Application Example 1"

[0875] (Claim 1)

[0876] An input device that receives information related to the user's travel,

[0877] A communication device that acquires weather data, transportation data, and accommodation data,

[0878] A processing device that generates multiple travel plans based on user preferences and budget, based on acquired data,

[0879] A display device that provides the user with a generated travel plan and accepts their selection,

[0880] A reservation device that confirms reservations based on user selections,

[0881] A planning device that guides smartphone users to the optimal sightseeing plan in real time,

[0882] A system that includes this.

[0883] (Claim 2)

[0884] The system according to claim 1, wherein the communication device performs a process to recalculate the costs and risks when a change is made to the selected travel plan.

[0885] (Claim 3)

[0886] The system according to claim 1, wherein the input device performs individually optimized data collection based on the user's past travel history and preferences.

[0887] "Example 2 of combining an emotion engine"

[0888] (Claim 1)

[0889] An input method using a terminal that receives information related to the user's travel,

[0890] Information acquisition means using an emotion analysis device for analyzing the emotional state of a user,

[0891] A communication means for obtaining weather information, transportation information, and facility information,

[0892] A processing method using a generative AI model that generates multiple personalized travel plans based on acquired information and user sentiment analysis,

[0893] A display means that displays the generated travel plan on the terminal and accepts selections from the user,

[0894] A reservation method that confirms a reservation based on the user's selection,

[0895] A system that includes this.

[0896] (Claim 2)

[0897] The system according to claim 1, comprising means for continuously monitoring the emotional state of a user during travel and dynamically changing the travel plan as needed.

[0898] (Claim 3)

[0899] The system according to claim 1, which collects information best suited to the user's preferences and emotional state based on the sentiment analysis results and performs optimization processing to provide travel plan options.

[0900] "Application example 2 when combining with an emotional engine"

[0901] (Claim 1)

[0902] A means of obtaining information to receive information related to the user's travel,

[0903] A communication means for obtaining weather information, transportation information, and accommodation information,

[0904] A plan generation means that generates multiple travel plans based on the user's preferences, budget, and emotional state, based on acquired information and emotional information.

[0905] A presentation method that provides users with generated travel plans and accepts their selections,

[0906] A confirmation method for confirming a reservation based on the user's selection,

[0907] A system that includes this.

[0908] (Claim 2)

[0909] The system according to claim 1, further comprising communication means for recalculating costs and risks when changes are made to the selected travel plan.

[0910] (Claim 3)

[0911] The system according to claim 1, wherein the input means collects individually optimized information, including emotional information, based on the user's past travel history and preferences. [Explanation of symbols]

[0912] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. An input method for receiving information related to the user's travel, A communication means for obtaining weather information, transportation information, and accommodation information, A processing method that generates multiple travel plans based on the user's preferences and budget, based on the acquired information, A display means that provides the generated travel plan to the user and accepts their selection, A reservation method that confirms the reservation based on the user's selection, A system that includes this.

2. The system according to claim 1, which performs a process to recalculate the costs and risks when a change is made to the selected travel plan regarding the means of communication.

3. The system according to claim 1, wherein the input means collects information that is individually optimized based on the user's past travel history and preferences.

Images