system

Abstract

A system is provided.SOLUTION: A system comprising: means for receiving information regarding a travel destination, a schedule, a budget, and a preference input by a user; means for collecting related information such as transportation, accommodation, and a tourist spot of the travel destination from a database or an external API based on the received information; means for filtering and prioritizing the collected information based on a condition of the user; means for automatically generating an optimal travel plan based on the filtered and prioritized information; and means for presenting the generated travel plan to the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Current travel services struggle to provide a service that integrates all the elements of a user's desired trip (transportation, accommodation, tourist destinations, etc.), forcing users to either use expensive tours from travel agencies or book each element individually. This increases the user's workload and limits their options at the planning stage. This invention aims to solve these problems by providing individual travelers with an optimal integrated travel plan, while promoting the diversification of travel dates and destinations, thereby leveling out travel demand across society. [Means for solving the problem]

[0005] This invention solves the above-mentioned problems by providing a system including: means for receiving information on travel destinations, itineraries, budgets, and preferences input by a user; means for collecting related information on transportation, accommodations, tourist attractions, etc. at the travel destination from a database or external API based on the received information; means for filtering and prioritizing the collected information based on the user's conditions; means for automatically generating an optimal travel plan based on the filtered and prioritized information; and means for presenting the generated travel plan to the user. The system further includes means for customizing the travel plan presented by the user, finalizing the plan and making reservations, and means for providing the user with navigation and support information in real time during the trip, thereby improving the user experience.

[0006] "User" means an individual traveller seeking to use a travel plan.

[0007] "Travel destination" refers to the city or region the user plans to visit.

[0008] "Dates" refers to the specific start and end dates of the trip desired by the User.

[0009] "Budget" refers to the total amount of money a user can spend on a trip.

[0010] "Preferences" refer to the types of activities and places a user wants to enjoy while traveling.

[0011] "Means for receiving information" refers to an interface for obtaining various information input by a user.

[0012] "Database" refers to a system that stores travel-related information that matches a user's desired conditions.

[0013] "External API" means an interface that enables communication with external data sources that provide travel-related information.

[0014] "Filtering" refers to the process of selecting collected information that matches the user's criteria.

[0015] "Prioritization" refers to the act of ranking selected information based on user preferences and constraints.

[0016] "Automatic generation means" refers to an algorithm that creates a travel plan based on filtered and prioritized information.

[0017] The "presentation means" refers to an interface for displaying the generated travel plan to the user.

[0018] "Customization" refers to a user making changes or adjustments to a proposed travel plan.

[0019] "Means for making reservations" refers to a system that makes reservations for various services (transportation, accommodation, admission to tourist attractions, etc.) based on a confirmed travel plan.

[0020] "Navigation and Support Information" means real-time travel directions and travel-related information provided to a User during a Trip. [Brief explanation of the drawings]

[0021] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0022] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0023] First, the terms used in the following description will be explained.

[0024] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0025] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0026] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0027] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0028] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0029] [First embodiment]

[0030] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0031] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0032] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0033] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0034] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0035] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0036] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0037] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0038] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0039] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0040] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0041] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0042] In the embodiment of the present invention, the configuration and functions of the travel proposal package system are realized using a plurality of servers and user terminals. The specific contents are described below.

[0043] System Configuration

[0044] The system mainly consists of the following elements:

[0045] 1. User device: The device where the traveler enters input and receives the final itinerary. This can include a PC or smartphone.

[0046] 2. Server: Collects travel-related information, filters, prioritizes, generates plans, confirms reservations, and provides navigation information.

[0047] Specific program content

[0048] Entering user information

[0049] Users enter their travel destination, dates, budget, and preferences (type of activity, type of tourist attraction, etc.) into a configuration form.

[0050] The device formats the input information and sends it to the server, including the user's unique ID in the request.

[0051] Data collection and analysis

[0052] Based on the received user information, the server retrieves information on related transportation, accommodation, and tourist attractions from a database and external API.

[0053] The server parses the collected information and filters it based on user criteria, for example, to find available flights and accommodations within a budget.

[0054] The server then prioritizes the filtered data based on the user's preferences and begins to generate the ideal itinerary.

[0055] Generate a plan

[0056] The server automatically generates a travel plan by combining the best flights, hotels, and tourist attractions. For example, if a user inputs that they prioritize cultural attractions, the server will generate a plan that includes spots such as Sensoji Temple and Ueno Park.

[0057] The server assembles the generated travel plans into a package and creates an itinerary and a price quote.

[0058] Presenting the plan

[0059] The server formats the generated travel plan in a user-friendly format and sends it to the user's terminal.

[0060] The device will display the plan to the user, providing a detailed description and breakdown of the costs.

[0061] User confirmation and booking

[0062] Users can review the proposed travel plan and customize it as needed.

[0063] The terminal again sends the user's customization request to the server.

[0064] The server regenerates the final plan and checks if all conditions are met, then confirms the booking of services (flights, hotels, tickets, etc.).

[0065] Navigation and Support

[0066] The server provides real-time navigation information during the trip, such as public transport connections and access to tourist attractions.

[0067] The device displays this information to the user and provides navigation and support during the journey.

[0068] Specific examples

[0069] Example 1: Family trip

[0070] The user enters a plan for a family of four visiting Tokyo for seven days with a budget of 300,000 yen, prioritizing major tourist destinations and including activities for the kids.

[0071] The server collects and filters data based on these criteria, selecting family-friendly tourist destinations such as Disneyland and Tokyo Skytree.

[0072] The server generates a plan that combines the best flights, hotels, and tourist attractions and presents it to the user.

[0073] Users can confirm the plan and confirm the reservation, and real-time navigation information will be provided to their device during the trip.

[0074] Example 2: Business Travel

[0075] The user is planning a two-day trip to Tokyo to attend a business meeting, with a budget of 150,000 yen, and prioritizes comfortable accommodation and transportation.

[0076] Based on these conditions, the server collects information on flights, business hotels, and meeting rooms.

[0077] The server generates the optimal plan and presents it to the user.

[0078] Users can confirm and customize their plans and confirm their reservations. On the day of the meeting, they follow the navigation information provided by the server.

[0079] This allows users to enjoy an efficient and satisfying travel experience, providing an integrated service from planning to execution.

[0080] The processing flow will be explained below.

[0081] Step 1:

[0082] Users enter their travel destination, dates, budget, and preferences (type of activity, type of tourist attraction, etc.) into an input form on their device.

[0083] Step 2:

[0084] The device formats the entered information and sends a request to the server, including the user's unique ID.

[0085] Step 3:

[0086] The server analyzes the received user information to identify travel destinations, dates, budgets, and preferences.

[0087] Step 4:

[0088] The server collects relevant travel data (transportation, accommodation, tourist attractions, etc.) from an internal database and external APIs and temporarily stores it.

[0089] Step 5:

[0090] The server filters the collected travel data based on the user's criteria, extracting only the options available within their budget.

[0091] Step 6:

[0092] The server then prioritizes the filtered data based on the user's preferences: for example, if a user likes "cultural spots," that data will be ranked higher.

[0093] Step 7:

[0094] The server then uses the filtered and prioritized information to automatically generate an optimal travel plan, including an itinerary including flights, hotels, and tourist attractions.

[0095] Step 8:

[0096] The server formats the generated travel plan in a user-friendly format and sends it to the terminal.

[0097] Step 9:

[0098] The device displays the proposed itinerary to the user, including detailed descriptions and a breakdown of the costs.

[0099] Step 10:

[0100] Users can review the proposed itinerary and make changes or additions as needed, such as changing accommodation to a different hotel.

[0101] Step 11:

[0102] The terminal sends the user's customization request to the server.

[0103] Step 12:

[0104] The server regenerates the final plan reflecting the customized requirements and verifies that all conditions are met.

[0105] Step 13:

[0106] The server finalizes various services (flight, hotel, tourist attraction reservations, etc.) based on the final travel plan.

[0107] Step 14:

[0108] The server provides real-time navigation information for the travel period, such as public transport timetables and access information to tourist attractions.

[0109] Step 15:

[0110] The server sends navigation information to the terminal at appropriate times during the journey.

[0111] Step 16:

[0112] The device will display real-time navigation information to the user, guiding them to their next destination and transportation options, such as the next train to catch and transit information.

[0113] Step 17:

[0114] Users navigate based on the displayed navigation information and enjoy their trip as planned.

[0115] Example 1

[0116] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0117] Conventional travel planning systems have difficulty generating appropriate travel plans based on user input, and lack real-time navigation information and support during the trip. As a result, users often experience inconvenience due to a lack of consistent support from trip planning to trip execution. This system aims to solve these issues and provide users with an efficient and satisfying travel experience.

[0118] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0119] In this invention, the server includes means for receiving information on travel destinations, itineraries, budgets, and preferences input by a user, means for formatting the received information into JSON format and sending it to the server, means for collecting related information on travel destinations, accommodations, tourist attractions, etc. from a database or external API based on the received information, means for analyzing the collected information and filtering and prioritizing it based on the user's conditions, means for automatically generating an optimal travel plan based on the filtered and prioritized information and converting it into JSON format, and means for formatting the generated travel plan in a user-friendly UI format and sending and displaying it on the user's terminal, thereby enabling users to receive intuitive and consistent travel planning and support.

[0120] "Destination" means a specific geographic location that a User wishes to visit.

[0121] "Dates" refers to the period from the start date to the end date for which the User plans to travel.

[0122] "Budget" means the total amount of money that you plan to spend on your trip.

[0123] "Preferences" refers to a user's preferences regarding the types of activities and tourist destinations they seek while traveling.

[0124] "User Device" means the device on which a User enters input and receives the final itinerary, including a PC or smartphone.

[0125] "Server" refers to the computer system that is the core of the travel proposal package system, and is the device that collects and analyzes data and generates travel plans.

[0126] A "database" refers to a collection of data that is systematically organized to make it easy to access, manage, and update.

[0127] An "external API" refers to an interface for linking data and functions with external systems and services.

[0128] "Filtering" refers to the process of selecting collected information that meets the user's criteria.

[0129] "Prioritization" refers to the process of prioritizing and selecting from the filtered data the data that best meets the user's requirements.

[0130] "Travel Plan" refers to a detailed travel plan automatically generated based on the user's input information and analysis results.

[0131] "Navigation information" refers to information that allows a user to receive instructions regarding routes and means of transportation to a destination while traveling.

[0132] "Support Information" means information to provide additional help or assistance that a User may require during their Travel.

[0133] In the embodiment of the present invention, the configuration and functions of the travel proposal package system are realized using a plurality of servers and user terminals.

[0134] System Configuration

[0135] User Device

[0136] Users use devices such as PCs or smartphones to input their travel destination, dates, budget, and preferences.

[0137] The terminal formats the information entered by the user into JSON format and sends it to the server.

[0138] server

[0139] The server receives information sent from the user's device, including data about travel destinations, itineraries, budgets, and preferences.

[0140] Based on the received information, the server collects relevant information about the travel destination, such as transportation, accommodation, and tourist attractions, from a database or external API, such as a MySQL database or Google Places API.

[0141] The server analyzes, filters, and prioritizes the collected information, using machine learning models and data processing libraries such as Scikit-learn and Pandas.

[0142] The server automatically generates an optimal travel plan based on the filtered and prioritized information and converts it into JSON format. The generated travel plan is implemented using the Django framework and Flask.

[0143] The server formats the generated travel plans in a user-friendly UI format and sends and displays them on the user's device. React.js and HTML templates are used as front-end technologies.

[0144] Specific examples

[0145] Example 1: Family trip

[0146] The user plans a seven-day trip to Tokyo for a family of four, inputting a budget of 300,000 yen, major tourist attractions, and desired activities for children.

[0147] The server collects data based on these conditions and selects family-friendly tourist destinations such as Disneyland and Skytree.

[0148] The server generates a plan that combines the best flights, hotels, and tourist attractions and presents it to the user.

[0149] Users can confirm the plan and confirm the reservation, and real-time navigation information will be provided to their device during the trip.

[0150] Example 2: Business Travel

[0151] A user plans a two-day trip for a business meeting in Tokyo, with a budget of 150,000 yen, and prioritizes comfortable accommodation and transportation.

[0152] The server collects data based on these conditions and retrieves flight, business hotel, and conference room information.

[0153] The server generates the optimal plan and presents it to the user.

[0154] The user checks and customizes the plan and confirms the reservation. On the day of the meeting, the user follows the navigation information provided by the server.

[0155] Prompt Sentence Examples

[0156] For a family trip: "We're a family of four traveling to Tokyo for 7 days with a budget of ¥300,000, including major tourist attractions and activities for the kids."

[0157] For business travel: "I'm traveling for two days for a business meeting in Tokyo. My budget is ¥150,000, and I'd like comfortable accommodation and transportation."

[0158] In this way, the entire system can consistently support the user's travel experience. In particular, the function that quickly and accurately analyzes the information entered by the user and generates and provides the optimal travel plan based on the results can greatly improve the user experience from travel planning to execution.

[0159] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0160] Step 1:

[0161] The user enters information about the travel destination, itinerary, budget, and preferences into the device's configuration form. The input information includes the following: travel destination (e.g., Tokyo), itinerary (e.g., December 1st to 7th, 2023), budget (e.g., 300,000 yen), and preferences (e.g., family-friendly, cultural tourist destinations). The device formats this information into JSON format and sends it to the server. JSON data is generated based on the input data and output in the following format:

[0162] json

[0163] {

[0164] "destination": "Tokyo",

[0165] "date_range": "2023-12-01 to 2023-12-07",

[0166] "budget": 300000,

[0167] "preferences": {

[0168] "category": "family",

[0169] "interests": ["cultural"]

[0170] }

[0171] }

[0172] Step 2:

[0173] The server receives a request in JSON format sent from the device. This information includes the user's travel destination, itinerary, budget, and preferences. The server analyzes this data and, based on it, collects relevant information about transportation (e.g., flights), accommodation, and tourist attractions from databases and external APIs (e.g., MySQL database, Google Places API). Based on the input data, the server generates SQL queries and HTTP requests, collects the retrieved data, and outputs it in the following format:

[0174] json

[0175] {

[0176] "flights": [{"flight_number": "NH123", "departure": "2023-12-01", "price": 50000}],

[0177] "hotels": [{"name": "Tokyo Hotel", "price": 100000}],

[0178] "attractions": [{"name": "Sensoji Temple", "category": "cultural"}]

[0179] }

[0180] Step 3:

[0181] The server analyzes the acquired information using machine learning models and rule-based filtering algorithms to extract information that meets the user's criteria. For example, it processes the data using Scikit-learn or Pandas. Based on the results of filtering and prioritization, it outputs the required data as follows:

[0182] json

[0183] {

[0184] "filtered_flights": [{"flight_number": "NH123", "departure": "2023-12-01", "price": 50000}],

[0185] "filtered_hotels": [{"name": "Tokyo Hotel", "price": 100000}],

[0186] "filtered_attractions": [{"name": "Sensoji Temple", "category": "cultural"}]

[0187] }

[0188] Step 4:

[0189] The server automatically generates a travel plan based on the filtered and prioritized data. For example, the plan generation logic can be implemented using the Django framework or Flask. The generated travel plan is converted into JSON format and output as follows:

[0190] json

[0191] {

[0192] "trip_plan": {

[0193] "flights": [{"flight_number": "NH123", "departure": "2023-12-01", "price": 50000}],

[0194] "hotels": [{"name": "Tokyo Hotel", "price": 100000}],

[0195] "attractions": [{"name": "Sensoji Temple", "category": "cultural"}]

[0196] }

[0197] }

[0198] Step 5:

[0199] The server formats the generated travel plan into a user-friendly UI format and sends it to the user's device. The front-end is implemented using HTML templates and React.js. The display on the user's device looks like this:

[0200] Flight information

[0201] Flight number: NH123

[0202] Departure date: 2023-12-01

[0203] Price: 50,000 yen

[0204] Hotel Information

[0205] Hotel name: Tokyo Hotel

[0206] Price: 100,000 yen

[0207] Tourist information

[0208] Tourist attraction: Sensoji Temple

[0209] Category: Cultural

[0210] Step 6:

[0211] The user checks the presented travel plan and customizes it as needed. For example, if they want to change the flight time, they enter the customization information through the device's UI and send it back to the server. Enter and send the following customization information:

[0212] json

[0213] {

[0214] "customization": {

[0215] "flights": {

[0216] "change": true,

[0217] "preferred_time": "morning"

[0218] }

[0219] }

[0220] }

[0221] Step 7:

[0222] When the server receives the customization request, it re-collects the information and re-generates the itinerary to suit the user's preferences. For example, it collects new flight information and re-filters and re-prioritizes it. It then generates the final itinerary and proceeds with the booking process, for example, by using the Stripe API to confirm payment. It then outputs the new itinerary as follows:

[0223] json

[0224] {

[0225] "trip_plan": {

[0226] "flights": [{"flight_number": "NH124", "departure": "2023-12-01", "price": 55000}],

[0227] "hotels": [{"name": "Tokyo Hotel", "price": 100000}],

[0228] "attractions": [{"name": "Sensoji Temple", "category": "cultural"}]

[0229] }

[0230] }

[0231] Step 8:

[0232] The server provides real-time navigation information to the user during the trip. The server obtains the navigation information using Google Maps API or similar and sends it to the user's device in JSON format. The user can then use the device to check their current location and the route to their destination. The following is an example of the navigation information:

[0233] json

[0234] {

[0235] "navigation": {

[0236] "current_location": "Tokyo Station",

[0237] "destination": "Sensoji Temple",

[0238] "route": "Take the JR Yamanote Line to Ueno, then transfer to the Ginza Line and get off at Asakusa"

[0239] }

[0240] }

[0241] In this way, the entire system supports the user's travel experience consistently.

[0242] (Application example 1)

[0243] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0244] Conventional travel recommendation systems not only require a lot of time and effort for users to plan their trips, but also often lack detailed information about the destination. They also lack the means to simulate real-life travel experiences in advance, making it difficult to respond to actual situations at the destination. Furthermore, they lack real-time navigation and support information, which can cause stress during the trip.

[0245] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0246] In this invention, the server includes means for receiving information on travel destinations, itineraries, budgets, and preferences input by a user, means for collecting related information on transportation, accommodations, tourist attractions, etc. at the travel destination from a database or external API based on the received information, means for filtering and prioritizing the collected information based on the user's conditions, means for automatically generating an optimal travel plan based on the filtered and prioritized information, means for presenting the generated travel plan to the user, and means for providing a travel experience in a virtual space using a virtual reality device based on the user's preferences. This allows the user to simulate a detailed trip, efficiently plan their trip, and receive real-time navigation and support information during their actual trip.

[0247] A "user device" is a device on which a traveler enters information and receives the final travel plan, and includes PCs, smartphones, VR devices, etc.

[0248] "Server" means a computer system that collects travel-related information, filters, prioritizes, generates plans, confirms reservations, and provides navigation information.

[0249] A "virtual reality device" is a device that allows users to have a realistic experience in a virtual space, and includes VR head-mounted displays.

[0250] "User Conditions" refers to information entered by the User regarding travel destination, dates, budget, and preferences.

[0251] "Filtering" is the process of removing unnecessary data from collected information and selecting appropriate data based on the user's conditions.

[0252] "Prioritization" is the process of assigning importance and priority to filtered information based on the user's preferences and conditions.

[0253] A "trip plan" is a server-generated planning package that includes suggestions for optimal itineraries, transportation, accommodations, sightseeing spots, and even activities.

[0254] "Navigation information" refers to real-time information needed during the trip, such as information on transportation transfers and how to access tourist attractions.

[0255] This invention relates to a travel package proposal system using a virtual reality device, and aims to efficiently support users in planning their travels.

[0256] System Configuration

[0257] The present invention mainly comprises the following elements:

[0258] 1. User device: The device where travelers input and receive the final itinerary. This can include PCs, smartphones, VR head-mounted displays, etc.

[0259] 2. Server: A computer system that collects travel-related information, filters, prioritizes, generates plans, confirms reservations, and provides navigation information.

[0260] 3. Virtual reality devices: Devices that allow users to experience reality in a virtual space. These include VR head-mounted displays.

[0261] Entering user information

[0262] The user enters the travel destination, itinerary, budget, and preferences (e.g., type of activity, type of tourist attraction) into a setting form on the device. The device formats the entered information and sends it to the server. This request includes the user's unique ID. For example, an example input might be, "Please suggest a travel plan for a family of four to Tokyo for 7 days. The budget is 300,000 yen, and priority should be given to major tourist attractions and activities for children."

[0263] Data collection and analysis

[0264] The server retrieves relevant information on transportation, accommodation, and tourist attractions from databases and external APIs based on the received user information. The server analyzes the collected information and filters it based on the user's criteria. For example, it may extract available flights and accommodations within a user's budget. The server then prioritizes the filtered data based on the user's preferences to generate an ideal travel plan.

[0265] Generate and present a plan

[0266] The server automatically generates a travel plan by combining optimal flights, hotels, and tourist attractions. For example, if a user selects cultural attractions, a plan including Sensoji Temple and Ueno Park will be generated. The server then compiles the generated travel plan into a package, creating an itinerary and a price estimate. The server then formats the plan in a user-friendly format and sends it to the user's device. The device then displays the plan to the user, providing a detailed description and a price breakdown.

[0267] Virtual Travel Experience

[0268] Users can experience the presented travel plan in a virtual space through a VR head-mounted display, allowing them to simulate local tourist attractions, hotel conditions, and transportation options before traveling.

[0269] User confirmation and booking, real-time navigation

[0270] The user reviews the presented travel plan and customizes it as necessary. The device then sends the user's customization request back to the server, which then regenerates the final plan. After all conditions are met, the server confirms the reservation of various services (flights, hotels, admission tickets, etc.). The server also provides real-time navigation information for the duration of the trip. The device displays this information to the user and provides ground support during the trip.

[0271] Specific examples

[0272] For example, if a family of four is visiting Tokyo, the user can use the VR head-mounted display to experience visiting selected tourist spots, such as Sensoji Temple and Disneyland, in advance in a virtual space. The user can also check the optimal route in real time based on navigation information from the server. Real-time navigation includes information such as, "The next train you should take departs from Station YY on the XX line."

[0273] In this way, users can efficiently plan their trips while performing detailed simulations of their trips, and receive real-time support during the actual trip.

[0274] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0275] Step 1:

[0276] User input of travel information

[0277] Users use a device (PC, smartphone, VR device, etc.) to input their travel destination, dates, budget, and preferences (for example, "Please suggest a travel plan for a family of four to Tokyo for 7 days. The budget is 300,000 yen, and priority should be given to major tourist spots and activities for children.").

[0278] Input: Travel destination, dates, budget, preferences

[0279] Output: Formatted user information data

[0280] How it works: The device formats the information entered by the user and sends it to the server as a single data package.

[0281] Step 2:

[0282] Data collection and filtering

[0283] Based on the received user information, the server uses an internal database and external APIs to collect related information such as transportation, accommodation, and tourist destinations.

[0284] Input: Formatted user information data

[0285] Output: A list of collected travel-related information

[0286] How it works: The server issues database queries and API requests, filtering and prioritizing the collected information based on user criteria, such as finding accommodations and flights within a budget.

[0287] Step 3:

[0288] Generate a travel plan

[0289] The server automatically generates an optimal travel plan based on the filtered and prioritized information.

[0290] Input: Filtered and prioritized information

[0291] Output: An automatically generated itinerary

[0292] How it works: The server uses AI algorithms to generate a travel plan that combines the best flights, hotels, and attractions based on the user's preferences and requirements.

[0293] Step 4:

[0294] Virtual experience of the plan

[0295] Using a VR head-mounted display, users can experience the presented travel plan in a virtual space.

[0296] Input: Auto-generated itinerary

[0297] Output: A travel experience in a virtual space

[0298] How it works: The device renders the generated plan into a VR space, allowing users to virtually experience local tourist attractions and accommodations.

[0299] Step 5:

[0300] Let users review and customize their plans

[0301] Users can review the proposed itinerary and customize it as needed, for example by changing accommodations or adding tourist attractions.

[0302] Input: Customization Request

[0303] Output: Final itinerary

[0304] Operation: The terminal sends the user's customization request to the server, which then regenerates the final plan based on it.

[0305] Step 6:

[0306] Confirm your travel plan

[0307] After the final travel plan is confirmed, the server makes reservations for various services (flights, hotels, tickets, etc.).

[0308] Input: Final itinerary

[0309] Output: Confirmation of reservation

[0310] Operation: The server sends a reservation request to each service provider, and receives and stores confirmation of the reservation.

[0311] Step 7:

[0312] Providing real-time navigation information

[0313] The server provides real-time navigation information (such as transportation transfer information and access methods to tourist attractions) during the trip.

[0314] Input: Real-time data during the trip

[0315] Output: Navigation information

[0316] How it works: The server collects real-time data on transportation and tourist attractions and sends it to the user's device as navigation information. The user then moves around according to this information.

[0317] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0318] In an embodiment of the present invention, an emotion engine is combined with a travel package system to recognize user emotions and reflect them in the generation and provision of travel plans. The system includes a server and a user terminal, and creates an optimal travel plan based on the traveler's requirements and provides support during the trip.

[0319] System Configuration

[0320] The system mainly consists of the following elements:

[0321] 1. User device: The device where travelers input information and receive travel plans. This can be a PC or smartphone.

[0322] 2. Server: Collects travel-related information, filters and prioritizes it, generates and presents the optimal plan, and processes user emotion information using an emotion engine.

[0323] 3. Emotion engine: Recognizes the user's emotional state from text input, voice data, feedback during navigation, etc., and provides information based on that.

[0324] Specific program content

[0325] Entering user information

[0326] Users enter their travel destination, itinerary, budget, and preferences (type of activity, type of tourist spot, etc.) into an input form on the device. Emotions (joy, anticipation, anxiety, etc.) at the time of input are also recorded.

[0327] The device formats the input information and sends a request including emotion data to the server.

[0328] Data collection and analysis

[0329] The server analyzes the received user information to identify travel destinations, dates, budgets, and preferences, while the emotion engine analyzes the user's emotional state and uses the results to generate travel plans.

[0330] The server collects relevant travel data (transportation, accommodation, tourist attractions, etc.) from an internal database and external APIs and temporarily stores it.

[0331] Filtering and Prioritization

[0332] The server filters the collected travel data based on the user's criteria, extracting only the options available within their budget.

[0333] The server prioritizes the filtered data based on the user's preferences and emotional data. For example, if the user indicates that they want to relax, relaxing tourist spots and accommodations will be prioritized.

[0334] Generate a plan

[0335] The server then uses the filtered and prioritized information to automatically generate an optimal travel plan, including an itinerary including flights, hotels, and tourist attractions.

[0336] The server formats the generated travel plan in a user-friendly format and sends it to the terminal.

[0337] Presenting the plan

[0338] The device displays the proposed itinerary to the user, including detailed descriptions and a breakdown of the costs.

[0339] User confirmation and booking

[0340] Users can review the proposed itinerary and make changes or additions as needed, such as changing accommodation to a different hotel.

[0341] The terminal again sends the user's customization request to the server.

[0342] The server regenerates the final plan reflecting the customized requirements and verifies that all conditions are met.

[0343] The server confirms various services (flight, hotel, tourist attraction reservations, etc.) based on the final plan.

[0344] Real-time navigation and support

[0345] The server provides real-time navigation information for the travel period, such as public transport timetables and access information to tourist attractions.

[0346] The server uses an emotion engine to monitor the user's emotional data during the trip and provide support information according to their emotions. For example, if a stressful situation is detected during the trip, it will suggest relaxation spots.

[0347] The device displays this information to the user in real time and guides them to their next destination and means of transportation.

[0348] Specific examples

[0349] Example 1: Family trip

[0350] A user enters a budget of 300,000 yen for a 7-day trip to Tokyo with a family of four. The emotion engine detects "expectations" as they enter the information.

[0351] Based on these conditions, the server generates a plan that includes family-friendly tourist spots such as Disneyland and Skytree.

[0352] The server presents the generated plan to the user, who then confirms it.

[0353] Users confirm their plans and make reservations, and during the trip, the emotion engine monitors the user's emotions and provides real-time navigation and support information.

[0354] Example 2: Business Travel

[0355] The user is planning a two-day trip to Tokyo for a business meeting. The budget is 150,000 yen, and comfort is important for accommodation and transportation. The emotion engine also detects "tension" when typing.

[0356] Based on these conditions, the server collects and generates information on flights, business hotels, and meeting rooms.

[0357] The server generates the optimal plan and presents it to the user.

[0358] Users can review and customize their plans and confirm their bookings, while the emotion engine monitors their tension during the trip and recommends relaxation facilities and comfortable transportation options.

[0359] This allows the system of the present invention to take user emotions into account and provide a more customized travel experience. By incorporating an emotion engine, we can further increase user satisfaction and realize a service that integrates the entire process from planning to execution of a trip.

[0360] The processing flow will be explained below.

[0361] Step 1:

[0362] Users enter their travel destination, itinerary, budget, and preferences (type of activity, type of tourist spot, etc.) into an input form on their device. The emotion engine also recognizes the user's emotions (joy, anticipation, anxiety, etc.) through text input, voice data, and facial recognition.

[0363] Step 2:

[0364] The device formats the input travel information and emotion data and sends it to the server as a request, which includes the user's unique ID.

[0365] Step 3:

[0366] The server analyzes the received user information to identify travel destination, itinerary, budget, preferences, and emotional state.

[0367] Step 4:

[0368] The server collects relevant travel data (transportation, accommodation, tourist attractions, etc.) from an internal database and external APIs and temporarily stores it.

[0369] Step 5:

[0370] The server filters the collected travel data based on the user's criteria, extracting only the options available within their budget.

[0371] Step 6:

[0372] The server prioritizes the filtered data based on an emotion engine: for example, if a user wants to "relax" and is feeling "anxious," quiet accommodations and relaxation spots will be prioritized.

[0373] Step 7:

[0374] The server then automatically generates an optimal travel plan based on the prioritized information, specifically creating an itinerary including flights, hotels, and tourist attractions.

[0375] Step 8:

[0376] The server formats the generated travel plan in a user-friendly format and sends it to the terminal.

[0377] Step 9:

[0378] The device displays a proposed itinerary to the user, including an itinerary, detailed descriptions of each item, and a breakdown of costs.

[0379] Step 10:

[0380] Users can review the proposed itinerary and customize it as needed, possibly changing accommodations or selecting additional tourist destinations.

[0381] Step 11:

[0382] The terminal reformats the user's customization request and sends it to the server.

[0383] Step 12:

[0384] The server creates a regeneration plan that reflects the customized request and verifies that all conditions are met.

[0385] Step 13:

[0386] The server confirms various services (flight, hotel, tourist attraction reservations, etc.) based on the finalized travel plan.

[0387] Step 14:

[0388] The server provides real-time navigation information for the duration of the trip, such as public transport timetables and access information to tourist attractions.

[0389] Step 15:

[0390] The server uses an emotion engine to monitor the user's emotional state in real time while traveling, and if the user is feeling stressed, it will suggest relaxation spots or places to rest and eat.

[0391] Step 16:

[0392] The server sends navigation information and emotional support information to the device at the appropriate time.

[0393] Step 17:

[0394] The device displays real-time navigation and support information to users, guiding them to their next destination and transportation options.

[0395] Step 18:

[0396] Users can move based on the displayed navigation and support information, enjoying their trip as planned and continuing their travel experience with peace of mind.

[0397] In this way, this system takes into account the user's emotions to provide optimal travel plans and provides a comfortable travel experience through real-time support during the trip.

[0398] Example 2

[0399] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0400] Conventional travel suggestion systems generate itineraries based on user input information, but do not provide plans that take the user's emotions into consideration. As a result, they lack flexible support that addresses emotions such as anxiety, stress, and anticipation that users may experience while traveling. The present invention aims to solve this problem by providing a system that improves user satisfaction by providing itineraries that take the user's emotions into consideration.

[0401] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving information on travel destinations, itineraries, budgets, preferences, and emotional state input by the user, means for collecting related information on transportation, accommodations, tourist spots, etc. at the travel destination from a database or an external interface based on the received information and emotional state, and means for filtering and prioritizing the collected information based on the user's conditions and emotional state. This makes it possible to generate and provide an optimal travel plan according to the user's emotions.

[0402] "User" means a user of the system who inputs travel plans and receives the information provided.

[0403] "Emotional state" refers to the emotional state a user feels when entering their travel plans or during their trip, and includes joy, anticipation, tension, anxiety, etc.

[0404] "Transportation" means the means of transportation used by a User to reach a Travel Destination, including, but not limited to, airplanes, trains, buses, and taxis.

[0405] "Accommodation" refers to facilities where users can stay at their travel destinations, including hotels, hostels, inns, and guesthouses.

[0406] "Tourist destinations" refers to the places and activities that users plan to visit during their travels, including museums, theme parks, natural parks, historical buildings, etc.

[0407] "Database" means an information system for storing and managing travel-related information.

[0408] "External interface" refers to a connection means for obtaining information from an external data source, including APIs.

[0409] "Filtering" refers to the process of extracting information from received data that meets a user's criteria.

[0410] "Prioritization" refers to the process of determining the importance of extracted information based on the user's preferences and emotional state.

[0411] A "travel plan" refers to a plan that summarizes the travel schedule, places to visit, accommodation, transportation, etc.

[0412] The travel proposal package system of this invention is a system that improves user satisfaction by providing travel plans that reflect the user's emotions. The system is mainly composed of a server and a user's terminal, and the specific processing is as follows.

[0413] Entering user information

[0414] Users use a PC or smartphone application to input information such as travel destination, itinerary, budget, preferences, etc. At the same time, the user's emotional state (e.g., "expectation," "anxiety," etc.) is also recorded.

[0415] The device formats the input information and sends a request containing emotion data to the server. This formatting process converts the information in the data input form into a data structure such as JSON.

[0416] Data collection and analysis

[0417] The server analyzes the received user information, specifically identifying travel destination, itinerary, budget, preferences, and emotional state.

[0418] The server uses an internal database and external APIs (e.g., Google Maps API, TripAdvisor API) to collect relevant travel data (transportation, accommodation, tourist spots, etc.) and temporarily stores it in storage. It also uses an emotion engine to analyze the user's emotional state and use it to create plans.

[0419] Data filtering and prioritization

[0420] The server then filters the collected travel data based on the user's criteria, extracting only the options available within their budget.

[0421] The server then prioritizes the filtered data based on the user's preferences and emotional state. For example, if the user indicates they want to relax, relaxation spots and accommodations will be prioritized.

[0422] Generate and present a plan

[0423] The server uses the prioritized data to generate an optimal itinerary, combining flights, hotels, and attractions into a single itinerary.

[0424] The server formats the generated itinerary and sends it to the backend terminal in a user-friendly format, where the user can view it.

[0425] User customization

[0426] The user reviews the proposed travel plan and makes any necessary changes, such as requesting a change of accommodation to a different hotel.

[0427] The terminal sends the user's change request to the server.

[0428] The server regenerates the final plan reflecting the requested changes and verifies that the conditions are met.

[0429] The server will make flight and hotel reservations based on the final confirmed plan.

[0430] Real-time navigation and support

[0431] The server provides real-time information during the trip, such as public transport timetables and access information to tourist spots.

[0432] The server uses an emotion engine to monitor the user's emotional state while traveling, and if it detects stress or other conditions, it will present relaxation spots and support information.

[0433] The device displays this information to the user in real time and guides them to their next destination and means of transportation.

[0434] Example prompt sentences

[0435] For family trips:

[0436] "I'm planning a seven-day trip to Tokyo for my family of four. My budget is 300,000 yen, and the emotion engine detected "expectations" when I entered the information. I'd like the app to generate an optimal itinerary that includes family-friendly tourist spots."

[0437] For business travel:

[0438] "I'm planning a two-day trip for a business meeting in Tokyo. My budget is 150,000 yen, and the emotion engine detected 'tension' when I entered it. I'd like the app to generate an optimal itinerary including business-friendly hotels and transportation."

[0439] In this way, the system of the present invention takes into account the user's feelings, flexibly changes the travel plan, and provides support in real time.

[0440] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0441] Step 1:

[0442] Users input details about their trip, such as destination, itinerary, budget, and preferences, via PC or smartphone, as well as their emotional state. Specific input examples include "Planning a family trip to Tokyo for 7 days, budget 300,000 yen, preferring family-friendly tourist spots, emotional state is anticipation."

[0443] Input: Travel destination, dates, budget, preferences, emotional state

[0444] Output: Formatted request data (e.g., JSON format)

[0445] The device formats the input information and sends a request including emotion data to the server.

[0446] Step 2:

[0447] The server analyzes the received user information, specifically extracting travel destination, itinerary, budget, preferences, and emotional state from the received data and passing them to the analysis module.

[0448] Input: Formatted request data (e.g., JSON format)

[0449] Output: Analysis results (travel destination, schedule, budget, preferences, emotional state)

[0450] The server uses an internal database and external APIs (such as Google Maps API, TripAdvisor API) to collect relevant travel data and store it in temporary storage.

[0451] Input: Analysis results

[0452] Output: Collected travel data (transportation, accommodation, tourist destination information)

[0453] Step 3:

[0454] The server filters the collected travel data based on the user's criteria, extracting available options within the user's budget and filtering based on the user's input and emotional state.

[0455] Input: Collected travel data

[0456] Output: filtered trip data

[0457] The server then prioritizes the filtered data based on the user's preferences and emotional state: for example, if a user expresses "expectations," family-friendly tourist destinations and accommodations will be displayed at the top.

[0458] Input: filtered travel data, user conditions and emotional state

[0459] Output: prioritized trip data

[0460] Step 4:

[0461] The server then uses the prioritized data to generate an optimal travel plan, specifically a detailed itinerary including flights, hotels, and attractions.

[0462] Input: Prioritized travel data

[0463] Output: Generated itinerary

[0464] The server formats the generated itinerary and sends it to the terminal in a user-friendly format.

[0465] Step 5:

[0466] The device displays the generated itinerary to the user, including a detailed description and a breakdown of costs. The user can review the itinerary and make changes or additions as needed, such as changing the accommodation to a different hotel.

[0467] Input: Generated itinerary

[0468] Output: User change request

[0469] The user reviews the proposed plan and notifies the device of any necessary changes, which are then sent back to the server.

[0470] Step 6:

[0471] The server regenerates the final plan reflecting the user's changes and verifies that all conditions are met. The server confirms the final plan that meets all conditions and books flights and accommodations.

[0472] Input: User change request

[0473] Output: Final confirmed plan

[0474] Step 7:

[0475] During the trip, the server provides real-time information on public transport timetables and access to tourist attractions. In addition, the emotion engine monitors the user's emotional state during the trip and presents support information such as relaxation spots if a stressful situation is detected.

[0476] Input: Real-time data, emotional state

[0477] Output: Real-time navigation information, support information

[0478] The device displays this real-time information to the user and guides them to their next destination and means of transportation.

[0479] Input: Real-time navigation information, support information

[0480] Output: Information presented to the user

[0481] The above are the specific processing steps of the program.

[0482] (Application example 2)

[0483] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0484] Conventional food delivery systems are unable to provide optimal ordering suggestions based on the user's emotional state, making it difficult to fully increase user satisfaction. Furthermore, there is a lack of a way for users to automatically generate optimal plans based on their budget, preferences, and delivery time, making it difficult to achieve an efficient ordering process.

[0485] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for receiving information regarding delivery destination, delivery time, budget, and preferences entered by the user; means for collecting related information such as delivery destination restaurants, dishes, and delivery services from a database or external API based on the received information; means for filtering and prioritizing the collected information based on the user's conditions and emotional state; means for automatically generating an optimal food delivery plan based on the filtered and prioritized information; and means for presenting the generated food delivery plan to the user. This makes it possible to propose a food delivery plan customized according to the user's emotional state.

[0486] "Delivery destination" is information indicating the location where the user wants to receive food delivery.

[0487] "Delivery time" is information indicating the estimated arrival time of the food delivery desired by the user.

[0488] "Budget" is information that indicates the amount of money a user can spend on food delivery.

[0489] "Preferences" refers to information that indicates the user's preferences and predilection for ingredients, cuisine, and restaurants.

[0490] "Means for receiving information" refers to the functionality of the device or software that allows information entered by the user regarding delivery destination, delivery time, budget, and preferences to be input into the system.

[0491] "Means of collection" refers to the functionality of the device or software that allows the system to obtain the relevant information it needs from a database or external API.

[0492] "Filtering and prioritization means" refers to the device or software functions that sort and sort collected information based on the user's criteria and emotional state.

[0493] "Means for automatic generation" refers to the functionality of a device or software that automatically creates an optimal food delivery plan based on filtered and prioritized information.

[0494] The "means for presenting" refers to the function of the device or software that displays the generated food delivery plan to the user and allows the user to confirm or customize it.

[0495] The system for implementing this invention aims to automatically generate and provide an optimal food delivery plan based on the user's emotional state. This system is mainly composed of components such as a server, a user terminal, and an emotion engine.

[0496] System Configuration

[0497] User Device

[0498] A device, such as a smartphone, where a user inputs information and receives a food delivery plan. The user device provides a form for inputting information about delivery destination, delivery time, budget, and preferences, and processes and transmits the input to a server.

[0499] server

[0500] The server analyzes the received user information and collects relevant information from the database and external APIs. It uses an emotion engine to analyze the user's emotional state, filters and prioritizes data based on the results, and automatically generates an optimal food delivery plan and sends it to the user's device.

[0501] Emotion Engine

[0502] The emotion engine recognizes the emotional state of the user from their input and voice data and reflects this in the food delivery plan, using software such as IBM Watson and Affectiva for sentiment analysis.

[0503] Processing steps

[0504] Receiving and analyzing

[0505] The server analyzes the information received from the user's device, such as delivery destination, delivery time, budget, and preferences, and uses an emotion engine to analyze the user's emotional state and stores the analysis results in a database.

[0506] Data collection

[0507] The server collects information on restaurants, dishes, and delivery services that match the user's criteria from external APIs and internal databases, and the collected data is temporarily stored on the server.

[0508] Filtering and Prioritization

[0509] The server filters the collected data based on the user's conditions (budget, preferences) and emotional state, and prioritizes and selects the most appropriate information based on the user's emotions.

[0510] Generate a plan

[0511] The server automatically generates the optimal food delivery plan based on the filtered and prioritized information, specifically creating a customized plan that combines food selection, restaurant, and delivery time.

[0512] Presenting and confirming the plan

[0513] The generated food delivery plan is formatted in a user-friendly format and sent to the user's device. The user can review the plan and customize it as needed. The final plan is confirmed by the server, and the order is sent to the restaurant.

[0514] Specific examples

[0515] Example of a tired user

[0516] Let's say a user requests "pizza" in the input form, with a budget of "2,000 yen" and a delivery time of "within 30 minutes." The emotion engine analyzes the user's emotional state as "tired." In this case, the app will prioritize restaurants that serve pizza suitable for relaxation and adjust the delivery time to suit the user's preferences.

[0517] Prompt Sentence Examples

[0518] Information you enter:

[0519] Cuisine: Pizza

[0520] Delivery time: within 30 minutes

[0521] Budget: 2000 yen

[0522] Emotion-based suggestions:

[0523] The emotion engine detects that the user is tired and suggests a restaurant that serves pizza, perfect for relaxation.

[0524] The system will enable the provision of customized food delivery plans based on the user's emotional state.

[0525] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0526] Step 1:

[0527] The user inputs information about the delivery address, delivery time, budget, and preferences. The input information also includes the user's emotional state. The input data is organized and formatted by the device. Specifically, the user provides this information using a smartphone application by text input or voice input. This results in the input data of the delivery address, delivery time, budget, preferences, and emotional state.

[0528] Step 2:

[0529] The device sends the input information to the server. The emotion engine also works at the same time, analyzing the user's emotional state from their voice and text data. The analysis results are sent to the server. Specifically, the device sends this data to the server using an HTTP request. The output is JSON data that includes the user's delivery address, delivery time, budget, preferences, and emotional state.

[0530] Step 3:

[0531] The server analyzes the received data and collects relevant information. The server collects information about the restaurant, food, and delivery service from a database and external APIs. Specifically, the server retrieves data using SQL queries and API requests. Through this process, the server collects information related to the delivery destination, delivery time, budget, preferences, and emotional state.

[0532] Step 4:

[0533] The server filters the collected data and prioritizes it based on the user's criteria and emotional state. The filtering selects only information that matches the user's budget, preferences, and delivery time. Then, it sets priorities based on the emotional state. Specifically, the server uses an algorithm based on the output of the emotion engine to filter and sort the data. The output is an optimized list of candidate information.

[0534] Step 5:

[0535] The server automatically generates an optimal food delivery plan based on the filtered and prioritized information. The generated plan includes specific dishes, restaurants, and delivery times. Specifically, the server combines this information and constructs the plan in a user-friendly format. The output is the optimal food delivery plan data.

[0536] Step 6:

[0537] The server sends the generated food delivery plan to the user terminal. Specifically, the server uses an HTTP response to send the plan data to the user terminal. This allows the user terminal to receive the plan and present it to the user.

[0538] Step 7:

[0539] The user reviews the presented food delivery plan and customizes it as necessary. The device then sends the user's change request back to the server. Specifically, the user edits each element of the plan on the application, saves the results, and sends them to the server. The output is the customized food delivery plan data.

[0540] Step 8:

[0541] The server regenerates the final plan reflecting the user's customized requirements and ensures that all conditions are met. Specifically, the server runs the filtering, prioritization, and plan generation processes again. The output is the final food delivery plan data.

[0542] Step 9:

[0543] The server determines various services based on the final plan and arranges delivery. Specifically, the server sends the order to the restaurant and processes the delivery service. The output is the determined order information and delivery arrangement information.

[0544] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0545] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0546] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0547] [Second embodiment]

[0548] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0549] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0550] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0551] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0552] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0553] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0554] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0555] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0556] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0557] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0558] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0559] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0560] In the embodiment of the present invention, the configuration and functions of the travel proposal package system are realized using a plurality of servers and user terminals. The specific contents are described below.

[0561] System Configuration

[0562] The system mainly consists of the following elements:

[0563] 1. User device: The device where the traveler enters input and receives the final itinerary. This can include a PC or smartphone.

[0564] 2. Server: Collects travel-related information, filters, prioritizes, generates plans, confirms reservations, and provides navigation information.

[0565] Specific program content

[0566] Entering user information

[0567] Users enter their travel destination, dates, budget, and preferences (type of activity, type of tourist attraction, etc.) into a configuration form.

[0568] The device formats the input information and sends it to the server, including the user's unique ID in the request.

[0569] Data collection and analysis

[0570] Based on the received user information, the server retrieves information on related transportation, accommodation, and tourist attractions from a database and external API.

[0571] The server parses the collected information and filters it based on user criteria, for example, to find available flights and accommodations within a budget.

[0572] The server then prioritizes the filtered data based on the user's preferences and begins to generate the ideal itinerary.

[0573] Generate a plan

[0574] The server automatically generates a travel plan by combining the best flights, hotels, and tourist attractions. For example, if a user inputs that they prioritize cultural attractions, the server will generate a plan that includes spots such as Sensoji Temple and Ueno Park.

[0575] The server assembles the generated travel plans into a package and creates an itinerary and a price quote.

[0576] Presenting the plan

[0577] The server formats the generated travel plan in a user-friendly format and sends it to the user's terminal.

[0578] The device will display the plan to the user, providing a detailed description and breakdown of the costs.

[0579] User confirmation and booking

[0580] Users can review the proposed travel plan and customize it as needed.

[0581] The terminal again sends the user's customization request to the server.

[0582] The server regenerates the final plan and checks if all conditions are met, then confirms the booking of services (flights, hotels, tickets, etc.).

[0583] Navigation and Support

[0584] The server provides real-time navigation information during the trip, such as public transport connections and access to tourist attractions.

[0585] The device displays this information to the user and provides navigation and support during the journey.

[0586] Specific examples

[0587] Example 1: Family trip

[0588] The user enters a plan for a family of four visiting Tokyo for seven days with a budget of 300,000 yen, prioritizing major tourist destinations and including activities for the kids.

[0589] The server collects and filters data based on these criteria, selecting family-friendly tourist destinations such as Disneyland and Tokyo Skytree.

[0590] The server generates a plan that combines the best flights, hotels, and tourist attractions and presents it to the user.

[0591] Users can confirm the plan and confirm the reservation, and real-time navigation information will be provided to their device during the trip.

[0592] Example 2: Business Travel

[0593] The user is planning a two-day trip to Tokyo to attend a business meeting, with a budget of 150,000 yen, and prioritizes comfortable accommodation and transportation.

[0594] Based on these conditions, the server collects information on flights, business hotels, and meeting rooms.

[0595] The server generates the optimal plan and presents it to the user.

[0596] Users can confirm and customize their plans and confirm their reservations. On the day of the meeting, they follow the navigation information provided by the server.

[0597] This allows users to enjoy an efficient and satisfying travel experience, providing an integrated service from planning to execution.

[0598] The processing flow will be explained below.

[0599] Step 1:

[0600] Users enter their travel destination, dates, budget, and preferences (type of activity, type of tourist attraction, etc.) into an input form on their device.

[0601] Step 2:

[0602] The device formats the entered information and sends a request to the server, including the user's unique ID.

[0603] Step 3:

[0604] The server analyzes the received user information to identify travel destinations, dates, budgets, and preferences.

[0605] Step 4:

[0606] The server collects relevant travel data (transportation, accommodation, tourist attractions, etc.) from an internal database and external APIs and temporarily stores it.

[0607] Step 5:

[0608] The server filters the collected travel data based on the user's criteria, extracting only the options available within their budget.

[0609] Step 6:

[0610] The server then prioritizes the filtered data based on the user's preferences: for example, if a user likes "cultural spots," that data will be ranked higher.

[0611] Step 7:

[0612] The server then uses the filtered and prioritized information to automatically generate an optimal travel plan, including an itinerary including flights, hotels, and tourist attractions.

[0613] Step 8:

[0614] The server formats the generated travel plan in a user-friendly format and sends it to the terminal.

[0615] Step 9:

[0616] The device displays the proposed itinerary to the user, including detailed descriptions and a breakdown of the costs.

[0617] Step 10:

[0618] Users can review the proposed itinerary and make changes or additions as needed, such as changing accommodation to a different hotel.

[0619] Step 11:

[0620] The terminal sends the user's customization request to the server.

[0621] Step 12:

[0622] The server regenerates the final plan reflecting the customized requirements and verifies that all conditions are met.

[0623] Step 13:

[0624] The server finalizes various services (flight, hotel, tourist attraction reservations, etc.) based on the final travel plan.

[0625] Step 14:

[0626] The server provides real-time navigation information for the travel period, such as public transport timetables and access information to tourist attractions.

[0627] Step 15:

[0628] The server sends navigation information to the terminal at appropriate times during the journey.

[0629] Step 16:

[0630] The device will display real-time navigation information to the user, guiding them to their next destination and transportation options, such as the next train to catch and transit information.

[0631] Step 17:

[0632] Users navigate based on the displayed navigation information and enjoy their trip as planned.

[0633] Example 1

[0634] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0635] Conventional travel planning systems have difficulty generating appropriate travel plans based on user input, and lack real-time navigation information and support during the trip. As a result, users often experience inconvenience due to a lack of consistent support from trip planning to trip execution. This system aims to solve these issues and provide users with an efficient and satisfying travel experience.

[0636] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0637] In this invention, the server includes means for receiving information on travel destinations, itineraries, budgets, and preferences input by a user, means for formatting the received information into JSON format and sending it to the server, means for collecting related information on travel destinations, accommodations, tourist attractions, etc. from a database or external API based on the received information, means for analyzing the collected information and filtering and prioritizing it based on the user's conditions, means for automatically generating an optimal travel plan based on the filtered and prioritized information and converting it into JSON format, and means for formatting the generated travel plan in a user-friendly UI format and sending and displaying it on the user's terminal, thereby enabling users to receive intuitive and consistent travel planning and support.

[0638] "Destination" means a specific geographic location that a User wishes to visit.

[0639] "Dates" refers to the period from the start date to the end date for which the User plans to travel.

[0640] "Budget" means the total amount of money that you plan to spend on your trip.

[0641] "Preferences" refers to a user's preferences regarding the types of activities and tourist destinations they seek while traveling.

[0642] "User Device" means the device on which a User enters input and receives the final itinerary, including a PC or smartphone.

[0643] "Server" refers to the computer system that is the core of the travel proposal package system, and is the device that collects and analyzes data and generates travel plans.

[0644] A "database" refers to a collection of data that is systematically organized to make it easy to access, manage, and update.

[0645] An "external API" refers to an interface for linking data and functions with external systems and services.

[0646] "Filtering" refers to the process of selecting collected information that meets the user's criteria.

[0647] "Prioritization" refers to the process of prioritizing and selecting from the filtered data the data that best meets the user's requirements.

[0648] "Travel Plan" refers to a detailed travel plan automatically generated based on the user's input information and analysis results.

[0649] "Navigation information" refers to information that allows a user to receive instructions regarding routes and means of transportation to a destination while traveling.

[0650] "Support Information" means information to provide additional help or assistance that a User may require during their Travel.

[0651] In the embodiment of the present invention, the configuration and functions of the travel proposal package system are realized using a plurality of servers and user terminals.

[0652] System Configuration

[0653] User Device

[0654] Users use devices such as PCs or smartphones to input their travel destination, dates, budget, and preferences.

[0655] The terminal formats the information entered by the user into JSON format and sends it to the server.

[0656] server

[0657] The server receives information sent from the user's device, including data about travel destinations, itineraries, budgets, and preferences.

[0658] Based on the received information, the server collects relevant information about the travel destination, such as transportation, accommodation, and tourist attractions, from a database or external API, such as a MySQL database or Google Places API.

[0659] The server analyzes, filters, and prioritizes the collected information, using machine learning models and data processing libraries such as Scikit-learn and Pandas.

[0660] The server automatically generates an optimal travel plan based on the filtered and prioritized information and converts it into JSON format. The generated travel plan is implemented using the Django framework and Flask.

[0661] The server formats the generated travel plans in a user-friendly UI format and sends and displays them on the user's device. React.js and HTML templates are used as front-end technologies.

[0662] Specific examples

[0663] Example 1: Family trip

[0664] The user plans a seven-day trip to Tokyo for a family of four, inputting a budget of 300,000 yen, major tourist attractions, and desired activities for children.

[0665] The server collects data based on these conditions and selects family-friendly tourist destinations such as Disneyland and Skytree.

[0666] The server generates a plan that combines the best flights, hotels, and tourist attractions and presents it to the user.

[0667] Users can confirm the plan and confirm the reservation, and real-time navigation information will be provided to their device during the trip.

[0668] Example 2: Business Travel

[0669] A user plans a two-day trip for a business meeting in Tokyo, with a budget of 150,000 yen, and prioritizes comfortable accommodation and transportation.

[0670] The server collects data based on these conditions and retrieves flight, business hotel, and conference room information.

[0671] The server generates the optimal plan and presents it to the user.

[0672] The user checks and customizes the plan and confirms the reservation. On the day of the meeting, the user follows the navigation information provided by the server.

[0673] Prompt Sentence Examples

[0674] For a family trip: "We're a family of four traveling to Tokyo for 7 days with a budget of ¥300,000, including major tourist attractions and activities for the kids."

[0675] For business travel: "I'm traveling for two days for a business meeting in Tokyo. My budget is ¥150,000, and I'd like comfortable accommodation and transportation."

[0676] In this way, the entire system can consistently support the user's travel experience. In particular, the function that quickly and accurately analyzes the information entered by the user and generates and provides the optimal travel plan based on the results can greatly improve the user experience from travel planning to execution.

[0677] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0678] Step 1:

[0679] The user enters information about the travel destination, itinerary, budget, and preferences into the device's configuration form. The input information includes the following: travel destination (e.g., Tokyo), itinerary (e.g., December 1st to 7th, 2023), budget (e.g., 300,000 yen), and preferences (e.g., family-friendly, cultural tourist destinations). The device formats this information into JSON format and sends it to the server. JSON data is generated based on the input data and output in the following format:

[0680] json

[0681] {

[0682] "destination": "Tokyo",

[0683] "date_range": "2023-12-01 to 2023-12-07",

[0684] "budget": 300000,

[0685] "preferences": {

[0686] "category": "family",

[0687] "interests": ["cultural"]

[0688] }

[0689] }

[0690] Step 2:

[0691] The server receives a request in JSON format sent from the device. This information includes the user's travel destination, itinerary, budget, and preferences. The server analyzes this data and, based on it, collects relevant information about transportation (e.g., flights), accommodation, and tourist attractions from databases and external APIs (e.g., MySQL database, Google Places API). Based on the input data, the server generates SQL queries and HTTP requests, collects the retrieved data, and outputs it in the following format:

[0692] json

[0693] {

[0694] "flights": [{"flight_number": "NH123", "departure": "2023-12-01", "price": 50000}],

[0695] "hotels": [{"name": "Tokyo Hotel", "price": 100000}],

[0696] "attractions": [{"name": "Sensoji Temple", "category": "cultural"}]

[0697] }

[0698] Step 3:

[0699] The server analyzes the acquired information using machine learning models and rule-based filtering algorithms to extract information that meets the user's criteria. For example, it processes the data using Scikit-learn or Pandas. Based on the results of filtering and prioritization, it outputs the required data as follows:

[0700] json

[0701] {

[0702] "filtered_flights": [{"flight_number": "NH123", "departure": "2023-12-01", "price": 50000}],

[0703] "filtered_hotels": [{"name": "Tokyo Hotel", "price": 100000}],

[0704] "filtered_attractions": [{"name": "Sensoji Temple", "category": "cultural"}]

[0705] }

[0706] Step 4:

[0707] The server automatically generates a travel plan based on the filtered and prioritized data. For example, the plan generation logic can be implemented using the Django framework or Flask. The generated travel plan is converted into JSON format and output as follows:

[0708] json

[0709] {

[0710] "trip_plan": {

[0711] "flights": [{"flight_number": "NH123", "departure": "2023-12-01", "price": 50000}],

[0712] "hotels": [{"name": "Tokyo Hotel", "price": 100000}],

[0713] "attractions": [{"name": "Sensoji Temple", "category": "cultural"}]

[0714] }

[0715] }

[0716] Step 5:

[0717] The server formats the generated travel plan into a user-friendly UI format and sends it to the user's device. The front-end is implemented using HTML templates and React.js. The display on the user's device looks like this:

[0718] Flight information

[0719] Flight number: NH123

[0720] Departure date: 2023-12-01

[0721] Price: 50,000 yen

[0722] Hotel Information

[0723] Hotel name: Tokyo Hotel

[0724] Price: 100,000 yen

[0725] Tourist information

[0726] Tourist attraction: Sensoji Temple

[0727] Category: Cultural

[0728] Step 6:

[0729] The user checks the presented travel plan and customizes it as needed. For example, if they want to change the flight time, they enter the customization information through the device's UI and send it back to the server. Enter and send the following customization information:

[0730] json

[0731] {

[0732] "customization": {

[0733] "flights": {

[0734] "change": true,

[0735] "preferred_time": "morning"

[0736] }

[0737] }

[0738] }

[0739] Step 7:

[0740] When the server receives the customization request, it re-collects the information and re-generates the itinerary to suit the user's preferences. For example, it collects new flight information and re-filters and re-prioritizes it. It then generates the final itinerary and proceeds with the booking process, for example, by using the Stripe API to confirm payment. It then outputs the new itinerary as follows:

[0741] json

[0742] {

[0743] "trip_plan": {

[0744] "flights": [{"flight_number": "NH124", "departure": "2023-12-01", "price": 55000}],

[0745] "hotels": [{"name": "Tokyo Hotel", "price": 100000}],

[0746] "attractions": [{"name": "Sensoji Temple", "category": "cultural"}]

[0747] }

[0748] }

[0749] Step 8:

[0750] The server provides real-time navigation information to the user during the trip. The server obtains the navigation information using Google Maps API or similar and sends it to the user's device in JSON format. The user can then use the device to check their current location and the route to their destination. The following is an example of the navigation information:

[0751] json

[0752] {

[0753] "navigation": {

[0754] "current_location": "Tokyo Station",

[0755] "destination": "Sensoji Temple",

[0756] "route": "Take the JR Yamanote Line to Ueno, then transfer to the Ginza Line and get off at Asakusa"

[0757] }

[0758] }

[0759] In this way, the entire system supports the user's travel experience consistently.

[0760] (Application example 1)

[0761] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0762] Conventional travel recommendation systems not only require a lot of time and effort for users to plan their trips, but also often lack detailed information about the destination. They also lack the means to simulate real-life travel experiences in advance, making it difficult to respond to actual situations at the destination. Furthermore, they lack real-time navigation and support information, which can cause stress during the trip.

[0763] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0764] In this invention, the server includes means for receiving information on travel destinations, itineraries, budgets, and preferences input by a user, means for collecting related information on transportation, accommodations, tourist attractions, etc. at the travel destination from a database or external API based on the received information, means for filtering and prioritizing the collected information based on the user's conditions, means for automatically generating an optimal travel plan based on the filtered and prioritized information, means for presenting the generated travel plan to the user, and means for providing a travel experience in a virtual space using a virtual reality device based on the user's preferences. This allows the user to simulate a detailed trip, efficiently plan their trip, and receive real-time navigation and support information during their actual trip.

[0765] A "user device" is a device on which a traveler enters information and receives the final travel plan, and includes PCs, smartphones, VR devices, etc.

[0766] "Server" means a computer system that collects travel-related information, filters, prioritizes, generates plans, confirms reservations, and provides navigation information.

[0767] A "virtual reality device" is a device that allows users to have a realistic experience in a virtual space, and includes VR head-mounted displays.

[0768] "User Conditions" refers to information entered by the User regarding travel destination, dates, budget, and preferences.

[0769] "Filtering" is the process of removing unnecessary data from collected information and selecting appropriate data based on the user's conditions.

[0770] "Prioritization" is the process of assigning importance and priority to filtered information based on the user's preferences and conditions.

[0771] A "trip plan" is a server-generated planning package that includes suggestions for optimal itineraries, transportation, accommodations, sightseeing spots, and even activities.

[0772] "Navigation information" refers to real-time information needed during the trip, such as information on transportation transfers and how to access tourist attractions.

[0773] This invention relates to a travel package proposal system using a virtual reality device, and aims to efficiently support users in planning their travels.

[0774] System Configuration

[0775] The present invention mainly comprises the following elements:

[0776] 1. User device: The device where travelers input and receive the final itinerary. This can include PCs, smartphones, VR head-mounted displays, etc.

[0777] 2. Server: A computer system that collects travel-related information, filters, prioritizes, generates plans, confirms reservations, and provides navigation information.

[0778] 3. Virtual reality devices: Devices that allow users to experience reality in a virtual space. These include VR head-mounted displays.

[0779] Entering user information

[0780] The user enters the travel destination, itinerary, budget, and preferences (e.g., type of activity, type of tourist attraction) into a setting form on the device. The device formats the entered information and sends it to the server. This request includes the user's unique ID. For example, an example input might be, "Please suggest a travel plan for a family of four to Tokyo for 7 days. The budget is 300,000 yen, and priority should be given to major tourist attractions and activities for children."

[0781] Data collection and analysis

[0782] The server retrieves relevant information on transportation, accommodation, and tourist attractions from databases and external APIs based on the received user information. The server analyzes the collected information and filters it based on the user's criteria. For example, it may extract available flights and accommodations within a user's budget. The server then prioritizes the filtered data based on the user's preferences to generate an ideal travel plan.

[0783] Generate and present a plan

[0784] The server automatically generates a travel plan by combining optimal flights, hotels, and tourist attractions. For example, if a user selects cultural attractions, a plan including Sensoji Temple and Ueno Park will be generated. The server then compiles the generated travel plan into a package, creating an itinerary and a price estimate. The server then formats the plan in a user-friendly format and sends it to the user's device. The device then displays the plan to the user, providing a detailed description and a price breakdown.

[0785] Virtual Travel Experience

[0786] Users can experience the presented travel plan in a virtual space through a VR head-mounted display, allowing them to simulate local tourist attractions, hotel conditions, and transportation options before traveling.

[0787] User confirmation and booking, real-time navigation

[0788] The user reviews the presented travel plan and customizes it as necessary. The device then sends the user's customization request back to the server, which then regenerates the final plan. After all conditions are met, the server confirms the reservation of various services (flights, hotels, admission tickets, etc.). The server also provides real-time navigation information for the duration of the trip. The device displays this information to the user and provides ground support during the trip.

[0789] Specific examples

[0790] For example, if a family of four is visiting Tokyo, the user can use the VR head-mounted display to experience visiting selected tourist spots, such as Sensoji Temple and Disneyland, in advance in a virtual space. The user can also check the optimal route in real time based on navigation information from the server. Real-time navigation includes information such as, "The next train you should take departs from Station YY on the XX line."

[0791] In this way, users can efficiently plan their trips while performing detailed simulations of their trips, and receive real-time support during the actual trip.

[0792] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0793] Step 1:

[0794] User input of travel information

[0795] Users use a device (PC, smartphone, VR device, etc.) to input their travel destination, dates, budget, and preferences (for example, "Please suggest a travel plan for a family of four to Tokyo for 7 days. The budget is 300,000 yen, and priority should be given to major tourist spots and activities for children.").

[0796] Input: Travel destination, dates, budget, preferences

[0797] Output: Formatted user information data

[0798] How it works: The device formats the information entered by the user and sends it to the server as a single data package.

[0799] Step 2:

[0800] Data collection and filtering

[0801] Based on the received user information, the server uses an internal database and external APIs to collect related information such as transportation, accommodation, and tourist destinations.

[0802] Input: Formatted user information data

[0803] Output: A list of collected travel-related information

[0804] How it works: The server issues database queries and API requests, filtering and prioritizing the collected information based on user criteria, such as finding accommodations and flights within a budget.

[0805] Step 3:

[0806] Generate a travel plan

[0807] The server automatically generates an optimal travel plan based on the filtered and prioritized information.

[0808] Input: Filtered and prioritized information

[0809] Output: An automatically generated itinerary

[0810] How it works: The server uses AI algorithms to generate a travel plan that combines the best flights, hotels, and attractions based on the user's preferences and requirements.

[0811] Step 4:

[0812] Virtual experience of the plan

[0813] Using a VR head-mounted display, users can experience the presented travel plan in a virtual space.

[0814] Input: Auto-generated itinerary

[0815] Output: A travel experience in a virtual space

[0816] How it works: The device renders the generated plan into a VR space, allowing users to virtually experience local tourist attractions and accommodations.

[0817] Step 5:

[0818] Let users review and customize their plans

[0819] Users can review the proposed itinerary and customize it as needed, for example by changing accommodations or adding tourist attractions.

[0820] Input: Customization Request

[0821] Output: Final itinerary

[0822] Operation: The terminal sends the user's customization request to the server, which then regenerates the final plan based on it.

[0823] Step 6:

[0824] Confirm your travel plan

[0825] After the final travel plan is confirmed, the server makes reservations for various services (flights, hotels, tickets, etc.).

[0826] Input: Final itinerary

[0827] Output: Confirmation of reservation

[0828] Operation: The server sends a reservation request to each service provider, and receives and stores confirmation of the reservation.

[0829] Step 7:

[0830] Providing real-time navigation information

[0831] The server provides real-time navigation information (such as transportation transfer information and access methods to tourist attractions) during the trip.

[0832] Input: Real-time data during the trip

[0833] Output: Navigation information

[0834] How it works: The server collects real-time data on transportation and tourist attractions and sends it to the user's device as navigation information. The user then moves around according to this information.

[0835] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0836] In an embodiment of the present invention, an emotion engine is combined with a travel package system to recognize user emotions and reflect them in the generation and provision of travel plans. The system includes a server and a user terminal, and creates an optimal travel plan based on the traveler's requirements and provides support during the trip.

[0837] System Configuration

[0838] The system mainly consists of the following elements:

[0839] 1. User device: The device where travelers input information and receive travel plans. This can be a PC or smartphone.

[0840] 2. Server: Collects travel-related information, filters and prioritizes it, generates and presents the optimal plan, and processes user emotion information using an emotion engine.

[0841] 3. Emotion engine: Recognizes the user's emotional state from text input, voice data, feedback during navigation, etc., and provides information based on that.

[0842] Specific program content

[0843] Entering user information

[0844] Users enter their travel destination, itinerary, budget, and preferences (type of activity, type of tourist spot, etc.) into an input form on the device. Emotions (joy, anticipation, anxiety, etc.) at the time of input are also recorded.

[0845] The device formats the input information and sends a request including emotion data to the server.

[0846] Data collection and analysis

[0847] The server analyzes the received user information to identify travel destinations, dates, budgets, and preferences, while the emotion engine analyzes the user's emotional state and uses the results to generate travel plans.

[0848] The server collects relevant travel data (transportation, accommodation, tourist attractions, etc.) from an internal database and external APIs and temporarily stores it.

[0849] Filtering and Prioritization

[0850] The server filters the collected travel data based on the user's criteria, extracting only the options available within their budget.

[0851] The server prioritizes the filtered data based on the user's preferences and emotional data. For example, if the user indicates that they want to relax, relaxing tourist spots and accommodations will be prioritized.

[0852] Generate a plan

[0853] The server then uses the filtered and prioritized information to automatically generate an optimal travel plan, including an itinerary including flights, hotels, and tourist attractions.

[0854] The server formats the generated travel plan in a user-friendly format and sends it to the terminal.

[0855] Presenting the plan

[0856] The device displays the proposed itinerary to the user, including detailed descriptions and a breakdown of the costs.

[0857] User confirmation and booking

[0858] Users can review the proposed itinerary and make changes or additions as needed, such as changing accommodation to a different hotel.

[0859] The terminal again sends the user's customization request to the server.

[0860] The server regenerates the final plan reflecting the customized requirements and verifies that all conditions are met.

[0861] The server confirms various services (flight, hotel, tourist attraction reservations, etc.) based on the final plan.

[0862] Real-time navigation and support

[0863] The server provides real-time navigation information for the travel period, such as public transport timetables and access information to tourist attractions.

[0864] The server uses an emotion engine to monitor the user's emotional data during the trip and provide support information according to their emotions. For example, if a stressful situation is detected during the trip, it will suggest relaxation spots.

[0865] The device displays this information to the user in real time and guides them to their next destination and means of transportation.

[0866] Specific examples

[0867] Example 1: Family trip

[0868] A user enters a budget of 300,000 yen for a 7-day trip to Tokyo with a family of four. The emotion engine detects "expectations" as they enter the information.

[0869] Based on these conditions, the server generates a plan that includes family-friendly tourist spots such as Disneyland and Skytree.

[0870] The server presents the generated plan to the user, who then confirms it.

[0871] Users confirm their plans and make reservations, and during the trip, the emotion engine monitors the user's emotions and provides real-time navigation and support information.

[0872] Example 2: Business Travel

[0873] The user is planning a two-day trip to Tokyo for a business meeting. The budget is 150,000 yen, and comfort is important for accommodation and transportation. The emotion engine also detects "tension" when typing.

[0874] Based on these conditions, the server collects and generates information on flights, business hotels, and meeting rooms.

[0875] The server generates the optimal plan and presents it to the user.

[0876] Users can review and customize their plans and confirm their bookings, while the emotion engine monitors their tension during the trip and recommends relaxation facilities and comfortable transportation options.

[0877] This allows the system of the present invention to take user emotions into account and provide a more customized travel experience. By incorporating an emotion engine, we can further increase user satisfaction and realize a service that integrates the entire process from planning to execution of a trip.

[0878] The processing flow will be explained below.

[0879] Step 1:

[0880] Users enter their travel destination, itinerary, budget, and preferences (type of activity, type of tourist spot, etc.) into an input form on their device. The emotion engine also recognizes the user's emotions (joy, anticipation, anxiety, etc.) through text input, voice data, and facial recognition.

[0881] Step 2:

[0882] The device formats the input travel information and emotion data and sends it to the server as a request, which includes the user's unique ID.

[0883] Step 3:

[0884] The server analyzes the received user information to identify travel destination, itinerary, budget, preferences, and emotional state.

[0885] Step 4:

[0886] The server collects relevant travel data (transportation, accommodation, tourist attractions, etc.) from an internal database and external APIs and temporarily stores it.

[0887] Step 5:

[0888] The server filters the collected travel data based on the user's criteria, extracting only the options available within their budget.

[0889] Step 6:

[0890] The server prioritizes the filtered data based on an emotion engine: for example, if a user wants to "relax" and is feeling "anxious," quiet accommodations and relaxation spots will be prioritized.

[0891] Step 7:

[0892] The server then automatically generates an optimal travel plan based on the prioritized information, specifically creating an itinerary including flights, hotels, and tourist attractions.

[0893] Step 8:

[0894] The server formats the generated travel plan in a user-friendly format and sends it to the terminal.

[0895] Step 9:

[0896] The device displays a proposed itinerary to the user, including an itinerary, detailed descriptions of each item, and a breakdown of costs.

[0897] Step 10:

[0898] Users can review the proposed itinerary and customize it as needed, possibly changing accommodations or selecting additional tourist destinations.

[0899] Step 11:

[0900] The terminal reformats the user's customization request and sends it to the server.

[0901] Step 12:

[0902] The server creates a regeneration plan that reflects the customized request and verifies that all conditions are met.

[0903] Step 13:

[0904] The server confirms various services (flight, hotel, tourist attraction reservations, etc.) based on the finalized travel plan.

[0905] Step 14:

[0906] The server provides real-time navigation information for the duration of the trip, such as public transport timetables and access information to tourist attractions.

[0907] Step 15:

[0908] The server uses an emotion engine to monitor the user's emotional state in real time while traveling, and if the user is feeling stressed, it will suggest relaxation spots or places to rest and eat.

[0909] Step 16:

[0910] The server sends navigation information and emotional support information to the device at the appropriate time.

[0911] Step 17:

[0912] The device displays real-time navigation and support information to users, guiding them to their next destination and transportation options.

[0913] Step 18:

[0914] Users can move based on the displayed navigation and support information, enjoying their trip as planned and continuing their travel experience with peace of mind.

[0915] In this way, this system takes into account the user's emotions to provide optimal travel plans and provides a comfortable travel experience through real-time support during the trip.

[0916] Example 2

[0917] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0918] Conventional travel suggestion systems generate itineraries based on user input information, but do not provide plans that take the user's emotions into consideration. As a result, they lack flexible support that addresses emotions such as anxiety, stress, and anticipation that users may experience while traveling. The present invention aims to solve this problem by providing a system that improves user satisfaction by providing itineraries that take the user's emotions into consideration.

[0919] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving information on travel destinations, itineraries, budgets, preferences, and emotional state input by the user, means for collecting related information on transportation, accommodations, tourist spots, etc. at the travel destination from a database or an external interface based on the received information and emotional state, and means for filtering and prioritizing the collected information based on the user's conditions and emotional state. This makes it possible to generate and provide an optimal travel plan according to the user's emotions.

[0920] "User" means a user of the system who inputs travel plans and receives the information provided.

[0921] "Emotional state" refers to the emotional state a user feels when entering their travel plans or during their trip, and includes joy, anticipation, tension, anxiety, etc.

[0922] "Transportation" means the means of transportation used by a User to reach a Travel Destination, including, but not limited to, airplanes, trains, buses, and taxis.

[0923] "Accommodation" refers to facilities where users can stay at their travel destinations, including hotels, hostels, inns, and guesthouses.

[0924] "Tourist destinations" refers to the places and activities that users plan to visit during their travels, including museums, theme parks, natural parks, historical buildings, etc.

[0925] "Database" means an information system for storing and managing travel-related information.

[0926] "External interface" refers to a connection means for obtaining information from an external data source, including APIs.

[0927] "Filtering" refers to the process of extracting information from received data that meets a user's criteria.

[0928] "Prioritization" refers to the process of determining the importance of extracted information based on the user's preferences and emotional state.

[0929] A "travel plan" refers to a plan that summarizes the travel schedule, places to visit, accommodation, transportation, etc.

[0930] The travel proposal package system of this invention is a system that improves user satisfaction by providing travel plans that reflect the user's emotions. The system is mainly composed of a server and a user's terminal, and the specific processing is as follows.

[0931] Entering user information

[0932] Users use a PC or smartphone application to input information such as travel destination, itinerary, budget, preferences, etc. At the same time, the user's emotional state (e.g., "expectation," "anxiety," etc.) is also recorded.

[0933] The device formats the input information and sends a request containing emotion data to the server. This formatting process converts the information in the data input form into a data structure such as JSON.

[0934] Data collection and analysis

[0935] The server analyzes the received user information, specifically identifying travel destination, itinerary, budget, preferences, and emotional state.

[0936] The server uses an internal database and external APIs (e.g., Google Maps API, TripAdvisor API) to collect relevant travel data (transportation, accommodation, tourist spots, etc.) and temporarily stores it in storage. It also uses an emotion engine to analyze the user's emotional state and use it to create plans.

[0937] Data filtering and prioritization

[0938] The server then filters the collected travel data based on the user's criteria, extracting only the options available within their budget.

[0939] The server then prioritizes the filtered data based on the user's preferences and emotional state. For example, if the user indicates they want to relax, relaxation spots and accommodations will be prioritized.

[0940] Generate and present a plan

[0941] The server uses the prioritized data to generate an optimal itinerary, combining flights, hotels, and attractions into a single itinerary.

[0942] The server formats the generated itinerary and sends it to the backend terminal in a user-friendly format, where the user can view it.

[0943] User customization

[0944] The user reviews the proposed travel plan and makes any necessary changes, such as requesting a change of accommodation to a different hotel.

[0945] The terminal sends the user's change request to the server.

[0946] The server regenerates the final plan reflecting the requested changes and verifies that the conditions are met.

[0947] The server will make flight and hotel reservations based on the final confirmed plan.

[0948] Real-time navigation and support

[0949] The server provides real-time information during the trip, such as public transport timetables and access information to tourist spots.

[0950] The server uses an emotion engine to monitor the user's emotional state while traveling, and if it detects stress or other conditions, it will present relaxation spots and support information.

[0951] The device displays this information to the user in real time and guides them to their next destination and means of transportation.

[0952] Example prompt sentences

[0953] For family trips:

[0954] "I'm planning a seven-day trip to Tokyo for my family of four. My budget is 300,000 yen, and the emotion engine detected "expectations" when I entered the information. I'd like the app to generate an optimal itinerary that includes family-friendly tourist spots."

[0955] For business travel:

[0956] "I'm planning a two-day trip for a business meeting in Tokyo. My budget is 150,000 yen, and the emotion engine detected 'tension' when I entered it. I'd like the app to generate an optimal itinerary including business-friendly hotels and transportation."

[0957] In this way, the system of the present invention takes into account the user's feelings, flexibly changes the travel plan, and provides support in real time.

[0958] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0959] Step 1:

[0960] Users input details about their trip, such as destination, itinerary, budget, and preferences, via PC or smartphone, as well as their emotional state. Specific input examples include "Planning a family trip to Tokyo for 7 days, budget 300,000 yen, preferring family-friendly tourist spots, emotional state is anticipation."

[0961] Input: Travel destination, dates, budget, preferences, emotional state

[0962] Output: Formatted request data (e.g., JSON format)

[0963] The device formats the input information and sends a request including emotion data to the server.

[0964] Step 2:

[0965] The server analyzes the received user information, specifically extracting travel destination, itinerary, budget, preferences, and emotional state from the received data and passing them to the analysis module.

[0966] Input: Formatted request data (e.g., JSON format)

[0967] Output: Analysis results (travel destination, schedule, budget, preferences, emotional state)

[0968] The server uses an internal database and external APIs (such as Google Maps API, TripAdvisor API) to collect relevant travel data and store it in temporary storage.

[0969] Input: Analysis results

[0970] Output: Collected travel data (transportation, accommodation, tourist destination information)

[0971] Step 3:

[0972] The server filters the collected travel data based on the user's criteria, extracting available options within the user's budget and filtering based on the user's input and emotional state.

[0973] Input: Collected travel data

[0974] Output: filtered trip data

[0975] The server then prioritizes the filtered data based on the user's preferences and emotional state: for example, if a user expresses "expectations," family-friendly tourist destinations and accommodations will be displayed at the top.

[0976] Input: filtered travel data, user conditions and emotional state

[0977] Output: prioritized trip data

[0978] Step 4:

[0979] The server then uses the prioritized data to generate an optimal travel plan, specifically a detailed itinerary including flights, hotels, and attractions.

[0980] Input: Prioritized travel data

[0981] Output: Generated itinerary

[0982] The server formats the generated itinerary and sends it to the terminal in a user-friendly format.

[0983] Step 5:

[0984] The device displays the generated itinerary to the user, including a detailed description and a breakdown of costs. The user can review the itinerary and make changes or additions as needed, such as changing the accommodation to a different hotel.

[0985] Input: Generated itinerary

[0986] Output: User change request

[0987] The user reviews the proposed plan and notifies the device of any necessary changes, which are then sent back to the server.

[0988] Step 6:

[0989] The server regenerates the final plan reflecting the user's changes and verifies that all conditions are met. The server confirms the final plan that meets all conditions and books flights and accommodations.

[0990] Input: User change request

[0991] Output: Final confirmed plan

[0992] Step 7:

[0993] During the trip, the server provides real-time information on public transport timetables and access to tourist attractions. In addition, the emotion engine monitors the user's emotional state during the trip and presents support information such as relaxation spots if a stressful situation is detected.

[0994] Input: Real-time data, emotional state

[0995] Output: Real-time navigation information, support information

[0996] The device displays this real-time information to the user and guides them to their next destination and means of transportation.

[0997] Input: Real-time navigation information, support information

[0998] Output: Information presented to the user

[0999] The above are the specific processing steps of the program.

[1000] (Application example 2)

[1001] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1002] Conventional food delivery systems are unable to provide optimal ordering suggestions based on the user's emotional state, making it difficult to fully increase user satisfaction. Furthermore, there is a lack of a way for users to automatically generate optimal plans based on their budget, preferences, and delivery time, making it difficult to achieve an efficient ordering process.

[1003] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for receiving information regarding delivery destination, delivery time, budget, and preferences entered by the user; means for collecting related information such as delivery destination restaurants, dishes, and delivery services from a database or external API based on the received information; means for filtering and prioritizing the collected information based on the user's conditions and emotional state; means for automatically generating an optimal food delivery plan based on the filtered and prioritized information; and means for presenting the generated food delivery plan to the user. This makes it possible to propose a food delivery plan customized according to the user's emotional state.

[1004] "Delivery destination" is information indicating the location where the user wants to receive food delivery.

[1005] "Delivery time" is information indicating the estimated arrival time of the food delivery desired by the user.

[1006] "Budget" is information that indicates the amount of money a user can spend on food delivery.

[1007] "Preferences" refers to information that indicates the user's preferences and predilection for ingredients, cuisine, and restaurants.

[1008] "Means for receiving information" refers to the functionality of the device or software that allows information entered by the user regarding delivery destination, delivery time, budget, and preferences to be input into the system.

[1009] "Means of collection" refers to the functionality of the device or software that allows the system to obtain the relevant information it needs from a database or external API.

[1010] "Filtering and prioritization means" refers to the device or software functions that sort and sort collected information based on the user's criteria and emotional state.

[1011] "Means for automatic generation" refers to the functionality of a device or software that automatically creates an optimal food delivery plan based on filtered and prioritized information.

[1012] The "means for presenting" refers to the function of the device or software that displays the generated food delivery plan to the user and allows the user to confirm or customize it.

[1013] The system for implementing this invention aims to automatically generate and provide an optimal food delivery plan based on the user's emotional state. This system is mainly composed of components such as a server, a user terminal, and an emotion engine.

[1014] System Configuration

[1015] User Device

[1016] A device, such as a smartphone, where a user inputs information and receives a food delivery plan. The user device provides a form for inputting information about delivery destination, delivery time, budget, and preferences, and processes and transmits the input to a server.

[1017] server

[1018] The server analyzes the received user information and collects relevant information from the database and external APIs. It uses an emotion engine to analyze the user's emotional state, filters and prioritizes data based on the results, and automatically generates an optimal food delivery plan and sends it to the user's device.

[1019] Emotion Engine

[1020] The emotion engine recognizes the emotional state of the user from their input and voice data and reflects this in the food delivery plan, using software such as IBM Watson and Affectiva for sentiment analysis.

[1021] Processing steps

[1022] Receiving and analyzing

[1023] The server analyzes the information received from the user's device, such as delivery destination, delivery time, budget, and preferences, and uses an emotion engine to analyze the user's emotional state and stores the analysis results in a database.

[1024] Data collection

[1025] The server collects information on restaurants, dishes, and delivery services that match the user's criteria from external APIs and internal databases, and the collected data is temporarily stored on the server.

[1026] Filtering and Prioritization

[1027] The server filters the collected data based on the user's conditions (budget, preferences) and emotional state, and prioritizes and selects the most appropriate information based on the user's emotions.

[1028] Generate a plan

[1029] The server automatically generates the optimal food delivery plan based on the filtered and prioritized information, specifically creating a customized plan that combines food selection, restaurant, and delivery time.

[1030] Presenting and confirming the plan

[1031] The generated food delivery plan is formatted in a user-friendly format and sent to the user's device. The user can review the plan and customize it as needed. The final plan is confirmed by the server, and the order is sent to the restaurant.

[1032] Specific examples

[1033] Example of a tired user

[1034] Let's say a user requests "pizza" in the input form, with a budget of "2,000 yen" and a delivery time of "within 30 minutes." The emotion engine analyzes the user's emotional state as "tired." In this case, the app will prioritize restaurants that serve pizza suitable for relaxation and adjust the delivery time to suit the user's preferences.

[1035] Prompt Sentence Examples

[1036] Information you enter:

[1037] Cuisine: Pizza

[1038] Delivery time: within 30 minutes

[1039] Budget: 2000 yen

[1040] Emotion-based suggestions:

[1041] The emotion engine detects that the user is tired and suggests a restaurant that serves pizza, perfect for relaxation.

[1042] The system will enable the provision of customized food delivery plans based on the user's emotional state.

[1043] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1044] Step 1:

[1045] The user inputs information about the delivery address, delivery time, budget, and preferences. The input information also includes the user's emotional state. The input data is organized and formatted by the device. Specifically, the user provides this information using a smartphone application by text input or voice input. This results in the input data of the delivery address, delivery time, budget, preferences, and emotional state.

[1046] Step 2:

[1047] The device sends the input information to the server. The emotion engine also works at the same time, analyzing the user's emotional state from their voice and text data. The analysis results are sent to the server. Specifically, the device sends this data to the server using an HTTP request. The output is JSON data that includes the user's delivery address, delivery time, budget, preferences, and emotional state.

[1048] Step 3:

[1049] The server analyzes the received data and collects relevant information. The server collects information about the restaurant, food, and delivery service from a database and external APIs. Specifically, the server retrieves data using SQL queries and API requests. Through this process, the server collects information related to the delivery destination, delivery time, budget, preferences, and emotional state.

[1050] Step 4:

[1051] The server filters the collected data and prioritizes it based on the user's criteria and emotional state. The filtering selects only information that matches the user's budget, preferences, and delivery time. Then, it sets priorities based on the emotional state. Specifically, the server uses an algorithm based on the output of the emotion engine to filter and sort the data. The output is an optimized list of candidate information.

[1052] Step 5:

[1053] The server automatically generates an optimal food delivery plan based on the filtered and prioritized information. The generated plan includes specific dishes, restaurants, and delivery times. Specifically, the server combines this information and constructs the plan in a user-friendly format. The output is the optimal food delivery plan data.

[1054] Step 6:

[1055] The server sends the generated food delivery plan to the user terminal. Specifically, the server uses an HTTP response to send the plan data to the user terminal. This allows the user terminal to receive the plan and present it to the user.

[1056] Step 7:

[1057] The user reviews the presented food delivery plan and customizes it as necessary. The device then sends the user's change request back to the server. Specifically, the user edits each element of the plan on the application, saves the results, and sends them to the server. The output is the customized food delivery plan data.

[1058] Step 8:

[1059] The server regenerates the final plan reflecting the user's customized requirements and ensures that all conditions are met. Specifically, the server runs the filtering, prioritization, and plan generation processes again. The output is the final food delivery plan data.

[1060] Step 9:

[1061] The server determines various services based on the final plan and arranges delivery. Specifically, the server sends the order to the restaurant and processes the delivery service. The output is the determined order information and delivery arrangement information.

[1062] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1063] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1064] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1065] [Third embodiment]

[1066] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1067] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1068] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1069] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1070] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1071] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1072] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1073] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1074] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1075] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1076] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1077] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1078] In the embodiment of the present invention, the configuration and functions of the travel proposal package system are realized using a plurality of servers and user terminals. The specific contents are described below.

[1079] System Configuration

[1080] The system mainly consists of the following elements:

[1081] 1. User device: The device where the traveler enters input and receives the final itinerary. This can include a PC or smartphone.

[1082] 2. Server: Collects travel-related information, filters, prioritizes, generates plans, confirms reservations, and provides navigation information.

[1083] Specific program content

[1084] Entering user information

[1085] Users enter their travel destination, dates, budget, and preferences (type of activity, type of tourist attraction, etc.) into a configuration form.

[1086] The device formats the input information and sends it to the server, including the user's unique ID in the request.

[1087] Data collection and analysis

[1088] Based on the received user information, the server retrieves information on related transportation, accommodation, and tourist attractions from a database and external API.

[1089] The server parses the collected information and filters it based on user criteria, for example, to find available flights and accommodations within a budget.

[1090] The server then prioritizes the filtered data based on the user's preferences and begins to generate the ideal itinerary.

[1091] Generate a plan

[1092] The server automatically generates a travel plan by combining the best flights, hotels, and tourist attractions. For example, if a user inputs that they prioritize cultural attractions, the server will generate a plan that includes spots such as Sensoji Temple and Ueno Park.

[1093] The server assembles the generated travel plans into a package and creates an itinerary and a price quote.

[1094] Presenting the plan

[1095] The server formats the generated travel plan in a user-friendly format and sends it to the user's terminal.

[1096] The device will display the plan to the user, providing a detailed description and breakdown of the costs.

[1097] User confirmation and booking

[1098] Users can review the proposed travel plan and customize it as needed.

[1099] The terminal again sends the user's customization request to the server.

[1100] The server regenerates the final plan and checks if all conditions are met, then confirms the booking of services (flights, hotels, tickets, etc.).

[1101] Navigation and Support

[1102] The server provides real-time navigation information during the trip, such as public transport connections and access to tourist attractions.

[1103] The device displays this information to the user and provides navigation and support during the journey.

[1104] Specific examples

[1105] Example 1: Family trip

[1106] The user enters a plan for a family of four visiting Tokyo for seven days with a budget of 300,000 yen, prioritizing major tourist destinations and including activities for the kids.

[1107] The server collects and filters data based on these criteria, selecting family-friendly tourist destinations such as Disneyland and Tokyo Skytree.

[1108] The server generates a plan that combines the best flights, hotels, and tourist attractions and presents it to the user.

[1109] Users can confirm the plan and confirm the reservation, and real-time navigation information will be provided to their device during the trip.

[1110] Example 2: Business Travel

[1111] The user is planning a two-day trip to Tokyo to attend a business meeting, with a budget of 150,000 yen, and prioritizes comfortable accommodation and transportation.

[1112] Based on these conditions, the server collects information on flights, business hotels, and meeting rooms.

[1113] The server generates the optimal plan and presents it to the user.

[1114] Users can confirm and customize their plans and confirm their reservations. On the day of the meeting, they follow the navigation information provided by the server.

[1115] This allows users to enjoy an efficient and satisfying travel experience, providing an integrated service from planning to execution.

[1116] The processing flow will be explained below.

[1117] Step 1:

[1118] Users enter their travel destination, dates, budget, and preferences (type of activity, type of tourist attraction, etc.) into an input form on their device.

[1119] Step 2:

[1120] The device formats the entered information and sends a request to the server, including the user's unique ID.

[1121] Step 3:

[1122] The server analyzes the received user information to identify travel destinations, dates, budgets, and preferences.

[1123] Step 4:

[1124] The server collects relevant travel data (transportation, accommodation, tourist attractions, etc.) from an internal database and external APIs and temporarily stores it.

[1125] Step 5:

[1126] The server filters the collected travel data based on the user's criteria, extracting only the options available within their budget.

[1127] Step 6:

[1128] The server then prioritizes the filtered data based on the user's preferences: for example, if a user likes "cultural spots," that data will be ranked higher.

[1129] Step 7:

[1130] The server then uses the filtered and prioritized information to automatically generate an optimal travel plan, including an itinerary including flights, hotels, and tourist attractions.

[1131] Step 8:

[1132] The server formats the generated travel plan in a user-friendly format and sends it to the terminal.

[1133] Step 9:

[1134] The device displays the proposed itinerary to the user, including detailed descriptions and a breakdown of the costs.

[1135] Step 10:

[1136] Users can review the proposed itinerary and make changes or additions as needed, such as changing accommodation to a different hotel.

[1137] Step 11:

[1138] The terminal sends the user's customization request to the server.

[1139] Step 12:

[1140] The server regenerates the final plan reflecting the customized requirements and verifies that all conditions are met.

[1141] Step 13:

[1142] The server finalizes various services (flight, hotel, tourist attraction reservations, etc.) based on the final travel plan.

[1143] Step 14:

[1144] The server provides real-time navigation information for the travel period, such as public transport timetables and access information to tourist attractions.

[1145] Step 15:

[1146] The server sends navigation information to the terminal at appropriate times during the journey.

[1147] Step 16:

[1148] The device will display real-time navigation information to the user, guiding them to their next destination and transportation options, such as the next train to catch and transit information.

[1149] Step 17:

[1150] Users navigate based on the displayed navigation information and enjoy their trip as planned.

[1151] Example 1

[1152] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1153] Conventional travel planning systems have difficulty generating appropriate travel plans based on user input, and lack real-time navigation information and support during the trip. As a result, users often experience inconvenience due to a lack of consistent support from trip planning to trip execution. This system aims to solve these issues and provide users with an efficient and satisfying travel experience.

[1154] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1155] In this invention, the server includes means for receiving information on travel destinations, itineraries, budgets, and preferences input by a user, means for formatting the received information into JSON format and sending it to the server, means for collecting related information on travel destinations, accommodations, tourist attractions, etc. from a database or external API based on the received information, means for analyzing the collected information and filtering and prioritizing it based on the user's conditions, means for automatically generating an optimal travel plan based on the filtered and prioritized information and converting it into JSON format, and means for formatting the generated travel plan in a user-friendly UI format and sending and displaying it on the user's terminal, thereby enabling users to receive intuitive and consistent travel planning and support.

[1156] "Destination" means a specific geographic location that a User wishes to visit.

[1157] "Dates" refers to the period from the start date to the end date for which the User plans to travel.

[1158] "Budget" means the total amount of money that you plan to spend on your trip.

[1159] "Preferences" refers to a user's preferences regarding the types of activities and tourist destinations they seek while traveling.

[1160] "User Device" means the device on which a User enters input and receives the final itinerary, including a PC or smartphone.

[1161] "Server" refers to the computer system that is the core of the travel proposal package system, and is the device that collects and analyzes data and generates travel plans.

[1162] A "database" refers to a collection of data that is systematically organized to make it easy to access, manage, and update.

[1163] An "external API" refers to an interface for linking data and functions with external systems and services.

[1164] "Filtering" refers to the process of selecting collected information that meets the user's criteria.

[1165] "Prioritization" refers to the process of prioritizing and selecting from the filtered data the data that best meets the user's requirements.

[1166] "Travel Plan" refers to a detailed travel plan automatically generated based on the user's input information and analysis results.

[1167] "Navigation information" refers to information that allows a user to receive instructions regarding routes and means of transportation to a destination while traveling.

[1168] "Support Information" means information to provide additional help or assistance that a User may require during their Travel.

[1169] In the embodiment of the present invention, the configuration and functions of the travel proposal package system are realized using a plurality of servers and user terminals.

[1170] System Configuration

[1171] User Device

[1172] Users use devices such as PCs or smartphones to input their travel destination, dates, budget, and preferences.

[1173] The terminal formats the information entered by the user into JSON format and sends it to the server.

[1174] server

[1175] The server receives information sent from the user's device, including data about travel destinations, itineraries, budgets, and preferences.

[1176] Based on the received information, the server collects relevant information about the travel destination, such as transportation, accommodation, and tourist attractions, from a database or external API, such as a MySQL database or Google Places API.

[1177] The server analyzes, filters, and prioritizes the collected information, using machine learning models and data processing libraries such as Scikit-learn and Pandas.

[1178] The server automatically generates an optimal travel plan based on the filtered and prioritized information and converts it into JSON format. The generated travel plan is implemented using the Django framework and Flask.

[1179] The server formats the generated travel plans in a user-friendly UI format and sends and displays them on the user's device. React.js and HTML templates are used as front-end technologies.

[1180] Specific examples

[1181] Example 1: Family trip

[1182] The user plans a seven-day trip to Tokyo for a family of four, inputting a budget of 300,000 yen, major tourist attractions, and desired activities for children.

[1183] The server collects data based on these conditions and selects family-friendly tourist destinations such as Disneyland and Skytree.

[1184] The server generates a plan that combines the best flights, hotels, and tourist attractions and presents it to the user.

[1185] Users can confirm the plan and confirm the reservation, and real-time navigation information will be provided to their device during the trip.

[1186] Example 2: Business Travel

[1187] A user plans a two-day trip for a business meeting in Tokyo, with a budget of 150,000 yen, and prioritizes comfortable accommodation and transportation.

[1188] The server collects data based on these conditions and retrieves flight, business hotel, and conference room information.

[1189] The server generates the optimal plan and presents it to the user.

[1190] The user checks and customizes the plan and confirms the reservation. On the day of the meeting, the user follows the navigation information provided by the server.

[1191] Prompt Sentence Examples

[1192] For a family trip: "We're a family of four traveling to Tokyo for 7 days with a budget of ¥300,000, including major tourist attractions and activities for the kids."

[1193] For business travel: "I'm traveling for two days for a business meeting in Tokyo. My budget is ¥150,000, and I'd like comfortable accommodation and transportation."

[1194] In this way, the entire system can consistently support the user's travel experience. In particular, the function that quickly and accurately analyzes the information entered by the user and generates and provides the optimal travel plan based on the results can greatly improve the user experience from travel planning to execution.

[1195] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1196] Step 1:

[1197] The user enters information about the travel destination, itinerary, budget, and preferences into the device's configuration form. The input information includes the following: travel destination (e.g., Tokyo), itinerary (e.g., December 1st to 7th, 2023), budget (e.g., 300,000 yen), and preferences (e.g., family-friendly, cultural tourist destinations). The device formats this information into JSON format and sends it to the server. JSON data is generated based on the input data and output in the following format:

[1198] json

[1199] {

[1200] "destination": "Tokyo",

[1201] "date_range": "2023-12-01 to 2023-12-07",

[1202] "budget": 300000,

[1203] "preferences": {

[1204] "category": "family",

[1205] "interests": ["cultural"]

[1206] }

[1207] }

[1208] Step 2:

[1209] The server receives a request in JSON format sent from the device. This information includes the user's travel destination, itinerary, budget, and preferences. The server analyzes this data and, based on it, collects relevant information about transportation (e.g., flights), accommodation, and tourist attractions from databases and external APIs (e.g., MySQL database, Google Places API). Based on the input data, the server generates SQL queries and HTTP requests, collects the retrieved data, and outputs it in the following format:

[1210] json

[1211] {

[1212] "flights": [{"flight_number": "NH123", "departure": "2023-12-01", "price": 50000}],

[1213] "hotels": [{"name": "Tokyo Hotel", "price": 100000}],

[1214] "attractions": [{"name": "Sensoji Temple", "category": "cultural"}]

[1215] }

[1216] Step 3:

[1217] The server analyzes the acquired information using machine learning models and rule-based filtering algorithms to extract information that meets the user's criteria. For example, it processes the data using Scikit-learn or Pandas. Based on the results of filtering and prioritization, it outputs the required data as follows:

[1218] json

[1219] {

[1220] "filtered_flights": [{"flight_number": "NH123", "departure": "2023-12-01", "price": 50000}],

[1221] "filtered_hotels": [{"name": "Tokyo Hotel", "price": 100000}],

[1222] "filtered_attractions": [{"name": "Sensoji Temple", "category": "cultural"}]

[1223] }

[1224] Step 4:

[1225] The server automatically generates a travel plan based on the filtered and prioritized data. For example, the plan generation logic can be implemented using the Django framework or Flask. The generated travel plan is converted into JSON format and output as follows:

[1226] json

[1227] {

[1228] "trip_plan": {

[1229] "flights": [{"flight_number": "NH123", "departure": "2023-12-01", "price": 50000}],

[1230] "hotels": [{"name": "Tokyo Hotel", "price": 100000}],

[1231] "attractions": [{"name": "Sensoji Temple", "category": "cultural"}]

[1232] }

[1233] }

[1234] Step 5:

[1235] The server formats the generated travel plan into a user-friendly UI format and sends it to the user's device. The front-end is implemented using HTML templates and React.js. The display on the user's device looks like this:

[1236] Flight information

[1237] Flight number: NH123

[1238] Departure date: 2023-12-01

[1239] Price: 50,000 yen

[1240] Hotel Information

[1241] Hotel name: Tokyo Hotel

[1242] Price: 100,000 yen

[1243] Tourist information

[1244] Tourist attraction: Sensoji Temple

[1245] Category: Cultural

[1246] Step 6:

[1247] The user checks the presented travel plan and customizes it as needed. For example, if they want to change the flight time, they enter the customization information through the device's UI and send it back to the server. Enter and send the following customization information:

[1248] json

[1249] {

[1250] "customization": {

[1251] "flights": {

[1252] "change": true,

[1253] "preferred_time": "morning"

[1254] }

[1255] }

[1256] }

[1257] Step 7:

[1258] When the server receives the customization request, it re-collects the information and re-generates the itinerary to suit the user's preferences. For example, it collects new flight information and re-filters and re-prioritizes it. It then generates the final itinerary and proceeds with the booking process, for example, by using the Stripe API to confirm payment. It then outputs the new itinerary as follows:

[1259] json

[1260] {

[1261] "trip_plan": {

[1262] "flights": [{"flight_number": "NH124", "departure": "2023-12-01", "price": 55000}],

[1263] "hotels": [{"name": "Tokyo Hotel", "price": 100000}],

[1264] "attractions": [{"name": "Sensoji Temple", "category": "cultural"}]

[1265] }

[1266] }

[1267] Step 8:

[1268] The server provides real-time navigation information to the user during the trip. The server obtains the navigation information using Google Maps API or similar and sends it to the user's device in JSON format. The user can then use the device to check their current location and the route to their destination. The following is an example of the navigation information:

[1269] json

[1270] {

[1271] "navigation": {

[1272] "current_location": "Tokyo Station",

[1273] "destination": "Sensoji Temple",

[1274] "route": "Take the JR Yamanote Line to Ueno, then transfer to the Ginza Line and get off at Asakusa"

[1275] }

[1276] }

[1277] In this way, the entire system supports the user's travel experience consistently.

[1278] (Application example 1)

[1279] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1280] Conventional travel recommendation systems not only require a lot of time and effort for users to plan their trips, but also often lack detailed information about the destination. They also lack the means to simulate real-life travel experiences in advance, making it difficult to respond to actual situations at the destination. Furthermore, they lack real-time navigation and support information, which can cause stress during the trip.

[1281] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1282] In this invention, the server includes means for receiving information on travel destinations, itineraries, budgets, and preferences input by a user, means for collecting related information on transportation, accommodations, tourist attractions, etc. at the travel destination from a database or external API based on the received information, means for filtering and prioritizing the collected information based on the user's conditions, means for automatically generating an optimal travel plan based on the filtered and prioritized information, means for presenting the generated travel plan to the user, and means for providing a travel experience in a virtual space using a virtual reality device based on the user's preferences. This allows the user to simulate a detailed trip, efficiently plan their trip, and receive real-time navigation and support information during their actual trip.

[1283] A "user device" is a device on which a traveler enters information and receives the final travel plan, and includes PCs, smartphones, VR devices, etc.

[1284] "Server" means a computer system that collects travel-related information, filters, prioritizes, generates plans, confirms reservations, and provides navigation information.

[1285] A "virtual reality device" is a device that allows users to have a realistic experience in a virtual space, and includes VR head-mounted displays.

[1286] "User Conditions" refers to information entered by the User regarding travel destination, dates, budget, and preferences.

[1287] "Filtering" is the process of removing unnecessary data from collected information and selecting appropriate data based on the user's conditions.

[1288] "Prioritization" is the process of assigning importance and priority to filtered information based on the user's preferences and conditions.

[1289] A "trip plan" is a server-generated planning package that includes suggestions for optimal itineraries, transportation, accommodations, sightseeing spots, and even activities.

[1290] "Navigation information" refers to real-time information needed during the trip, such as information on transportation transfers and how to access tourist attractions.

[1291] This invention relates to a travel package proposal system using a virtual reality device, and aims to efficiently support users in planning their travels.

[1292] System Configuration

[1293] The present invention mainly comprises the following elements:

[1294] 1. User device: The device where travelers input and receive the final itinerary. This can include PCs, smartphones, VR head-mounted displays, etc.

[1295] 2. Server: A computer system that collects travel-related information, filters, prioritizes, generates plans, confirms reservations, and provides navigation information.

[1296] 3. Virtual reality devices: Devices that allow users to experience reality in a virtual space. These include VR head-mounted displays.

[1297] Entering user information

[1298] The user enters the travel destination, itinerary, budget, and preferences (e.g., type of activity, type of tourist attraction) into a setting form on the device. The device formats the entered information and sends it to the server. This request includes the user's unique ID. For example, an example input might be, "Please suggest a travel plan for a family of four to Tokyo for 7 days. The budget is 300,000 yen, and priority should be given to major tourist attractions and activities for children."

[1299] Data collection and analysis

[1300] The server retrieves relevant information on transportation, accommodation, and tourist attractions from databases and external APIs based on the received user information. The server analyzes the collected information and filters it based on the user's criteria. For example, it may extract available flights and accommodations within a user's budget. The server then prioritizes the filtered data based on the user's preferences to generate an ideal travel plan.

[1301] Generate and present a plan

[1302] The server automatically generates a travel plan by combining optimal flights, hotels, and tourist attractions. For example, if a user selects cultural attractions, a plan including Sensoji Temple and Ueno Park will be generated. The server then compiles the generated travel plan into a package, creating an itinerary and a price estimate. The server then formats the plan in a user-friendly format and sends it to the user's device. The device then displays the plan to the user, providing a detailed description and a price breakdown.

[1303] Virtual Travel Experience

[1304] Users can experience the presented travel plan in a virtual space through a VR head-mounted display, allowing them to simulate local tourist attractions, hotel conditions, and transportation options before traveling.

[1305] User confirmation and booking, real-time navigation

[1306] The user reviews the presented travel plan and customizes it as necessary. The device then sends the user's customization request back to the server, which then regenerates the final plan. After all conditions are met, the server confirms the reservation of various services (flights, hotels, admission tickets, etc.). The server also provides real-time navigation information for the duration of the trip. The device displays this information to the user and provides ground support during the trip.

[1307] Specific examples

[1308] For example, if a family of four is visiting Tokyo, the user can use the VR head-mounted display to experience visiting selected tourist spots, such as Sensoji Temple and Disneyland, in advance in a virtual space. The user can also check the optimal route in real time based on navigation information from the server. Real-time navigation includes information such as, "The next train you should take departs from Station YY on the XX line."

[1309] In this way, users can efficiently plan their trips while performing detailed simulations of their trips, and receive real-time support during the actual trip.

[1310] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1311] Step 1:

[1312] User input of travel information

[1313] Users use a device (PC, smartphone, VR device, etc.) to input their travel destination, dates, budget, and preferences (for example, "Please suggest a travel plan for a family of four to Tokyo for 7 days. The budget is 300,000 yen, and priority should be given to major tourist spots and activities for children.").

[1314] Input: Travel destination, dates, budget, preferences

[1315] Output: Formatted user information data

[1316] How it works: The device formats the information entered by the user and sends it to the server as a single data package.

[1317] Step 2:

[1318] Data collection and filtering

[1319] Based on the received user information, the server uses an internal database and external APIs to collect related information such as transportation, accommodation, and tourist destinations.

[1320] Input: Formatted user information data

[1321] Output: A list of collected travel-related information

[1322] How it works: The server issues database queries and API requests, filtering and prioritizing the collected information based on user criteria, such as finding accommodations and flights within a budget.

[1323] Step 3:

[1324] Generate a travel plan

[1325] The server automatically generates an optimal travel plan based on the filtered and prioritized information.

[1326] Input: Filtered and prioritized information

[1327] Output: An automatically generated itinerary

[1328] How it works: The server uses AI algorithms to generate a travel plan that combines the best flights, hotels, and attractions based on the user's preferences and requirements.

[1329] Step 4:

[1330] Virtual experience of the plan

[1331] Using a VR head-mounted display, users can experience the presented travel plan in a virtual space.

[1332] Input: Auto-generated itinerary

[1333] Output: A travel experience in a virtual space

[1334] How it works: The device renders the generated plan into a VR space, allowing users to virtually experience local tourist attractions and accommodations.

[1335] Step 5:

[1336] Let users review and customize their plans

[1337] Users can review the proposed itinerary and customize it as needed, for example by changing accommodations or adding tourist attractions.

[1338] Input: Customization Request

[1339] Output: Final itinerary

[1340] Operation: The terminal sends the user's customization request to the server, which then regenerates the final plan based on it.

[1341] Step 6:

[1342] Confirm your travel plan

[1343] After the final travel plan is confirmed, the server makes reservations for various services (flights, hotels, tickets, etc.).

[1344] Input: Final itinerary

[1345] Output: Confirmation of reservation

[1346] Operation: The server sends a reservation request to each service provider, and receives and stores confirmation of the reservation.

[1347] Step 7:

[1348] Providing real-time navigation information

[1349] The server provides real-time navigation information (such as transportation transfer information and access methods to tourist attractions) during the trip.

[1350] Input: Real-time data during the trip

[1351] Output: Navigation information

[1352] How it works: The server collects real-time data on transportation and tourist attractions and sends it to the user's device as navigation information. The user then moves around according to this information.

[1353] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1354] In an embodiment of the present invention, an emotion engine is combined with a travel package system to recognize user emotions and reflect them in the generation and provision of travel plans. The system includes a server and a user terminal, and creates an optimal travel plan based on the traveler's requirements and provides support during the trip.

[1355] System Configuration

[1356] The system mainly consists of the following elements:

[1357] 1. User device: The device where travelers input information and receive travel plans. This can be a PC or smartphone.

[1358] 2. Server: Collects travel-related information, filters and prioritizes it, generates and presents the optimal plan, and processes user emotion information using an emotion engine.

[1359] 3. Emotion engine: Recognizes the user's emotional state from text input, voice data, feedback during navigation, etc., and provides information based on that.

[1360] Specific program content

[1361] Entering user information

[1362] Users enter their travel destination, itinerary, budget, and preferences (type of activity, type of tourist spot, etc.) into an input form on the device. Emotions (joy, anticipation, anxiety, etc.) at the time of input are also recorded.

[1363] The device formats the input information and sends a request including emotion data to the server.

[1364] Data collection and analysis

[1365] The server analyzes the received user information to identify travel destinations, dates, budgets, and preferences, while the emotion engine analyzes the user's emotional state and uses the results to generate travel plans.

[1366] The server collects relevant travel data (transportation, accommodation, tourist attractions, etc.) from an internal database and external APIs and temporarily stores it.

[1367] Filtering and Prioritization

[1368] The server filters the collected travel data based on the user's criteria, extracting only the options available within their budget.

[1369] The server prioritizes the filtered data based on the user's preferences and emotional data. For example, if the user indicates that they want to relax, relaxing tourist spots and accommodations will be prioritized.

[1370] Generate a plan

[1371] The server then uses the filtered and prioritized information to automatically generate an optimal travel plan, including an itinerary including flights, hotels, and tourist attractions.

[1372] The server formats the generated travel plan in a user-friendly format and sends it to the terminal.

[1373] Presenting the plan

[1374] The device displays the proposed itinerary to the user, including detailed descriptions and a breakdown of the costs.

[1375] User confirmation and booking

[1376] Users can review the proposed itinerary and make changes or additions as needed, such as changing accommodation to a different hotel.

[1377] The terminal again sends the user's customization request to the server.

[1378] The server regenerates the final plan reflecting the customized requirements and verifies that all conditions are met.

[1379] The server confirms various services (flight, hotel, tourist attraction reservations, etc.) based on the final plan.

[1380] Real-time navigation and support

[1381] The server provides real-time navigation information for the travel period, such as public transport timetables and access information to tourist attractions.

[1382] The server uses an emotion engine to monitor the user's emotional data during the trip and provide support information according to their emotions. For example, if a stressful situation is detected during the trip, it will suggest relaxation spots.

[1383] The device displays this information to the user in real time and guides them to their next destination and means of transportation.

[1384] Specific examples

[1385] Example 1: Family trip

[1386] A user enters a budget of 300,000 yen for a 7-day trip to Tokyo with a family of four. The emotion engine detects "expectations" as they enter the information.

[1387] Based on these conditions, the server generates a plan that includes family-friendly tourist spots such as Disneyland and Skytree.

[1388] The server presents the generated plan to the user, who then confirms it.

[1389] Users confirm their plans and make reservations, and during the trip, the emotion engine monitors the user's emotions and provides real-time navigation and support information.

[1390] Example 2: Business Travel

[1391] The user is planning a two-day trip to Tokyo for a business meeting. The budget is 150,000 yen, and comfort is important for accommodation and transportation. The emotion engine also detects "tension" when typing.

[1392] Based on these conditions, the server collects and generates information on flights, business hotels, and meeting rooms.

[1393] The server generates the optimal plan and presents it to the user.

[1394] Users can review and customize their plans and confirm their bookings, while the emotion engine monitors their tension during the trip and recommends relaxation facilities and comfortable transportation options.

[1395] This allows the system of the present invention to take user emotions into account and provide a more customized travel experience. By incorporating an emotion engine, we can further increase user satisfaction and realize a service that integrates the entire process from planning to execution of a trip.

[1396] The processing flow will be explained below.

[1397] Step 1:

[1398] Users enter their travel destination, itinerary, budget, and preferences (type of activity, type of tourist spot, etc.) into an input form on their device. The emotion engine also recognizes the user's emotions (joy, anticipation, anxiety, etc.) through text input, voice data, and facial recognition.

[1399] Step 2:

[1400] The device formats the input travel information and emotion data and sends it to the server as a request, which includes the user's unique ID.

[1401] Step 3:

[1402] The server analyzes the received user information to identify travel destination, itinerary, budget, preferences, and emotional state.

[1403] Step 4:

[1404] The server collects relevant travel data (transportation, accommodation, tourist attractions, etc.) from an internal database and external APIs and temporarily stores it.

[1405] Step 5:

[1406] The server filters the collected travel data based on the user's criteria, extracting only the options available within their budget.

[1407] Step 6:

[1408] The server prioritizes the filtered data based on an emotion engine: for example, if a user wants to "relax" and is feeling "anxious," quiet accommodations and relaxation spots will be prioritized.

[1409] Step 7:

[1410] The server then automatically generates an optimal travel plan based on the prioritized information, specifically creating an itinerary including flights, hotels, and tourist attractions.

[1411] Step 8:

[1412] The server formats the generated travel plan in a user-friendly format and sends it to the terminal.

[1413] Step 9:

[1414] The device displays a proposed itinerary to the user, including an itinerary, detailed descriptions of each item, and a breakdown of costs.

[1415] Step 10:

[1416] Users can review the proposed itinerary and customize it as needed, possibly changing accommodations or selecting additional tourist destinations.

[1417] Step 11:

[1418] The terminal reformats the user's customization request and sends it to the server.

[1419] Step 12:

[1420] The server creates a regeneration plan that reflects the customized request and verifies that all conditions are met.

[1421] Step 13:

[1422] The server confirms various services (flight, hotel, tourist attraction reservations, etc.) based on the finalized travel plan.

[1423] Step 14:

[1424] The server provides real-time navigation information for the duration of the trip, such as public transport timetables and access information to tourist attractions.

[1425] Step 15:

[1426] The server uses an emotion engine to monitor the user's emotional state in real time while traveling, and if the user is feeling stressed, it will suggest relaxation spots or places to rest and eat.

[1427] Step 16:

[1428] The server sends navigation information and emotional support information to the device at the appropriate time.

[1429] Step 17:

[1430] The device displays real-time navigation and support information to users, guiding them to their next destination and transportation options.

[1431] Step 18:

[1432] Users can move based on the displayed navigation and support information, enjoying their trip as planned and continuing their travel experience with peace of mind.

[1433] In this way, this system takes into account the user's emotions to provide optimal travel plans and provides a comfortable travel experience through real-time support during the trip.

[1434] Example 2

[1435] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1436] Conventional travel suggestion systems generate itineraries based on user input information, but do not provide plans that take the user's emotions into consideration. As a result, they lack flexible support that addresses emotions such as anxiety, stress, and anticipation that users may experience while traveling. The present invention aims to solve this problem by providing a system that improves user satisfaction by providing itineraries that take the user's emotions into consideration.

[1437] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving information on travel destinations, itineraries, budgets, preferences, and emotional state input by the user, means for collecting related information on transportation, accommodations, tourist spots, etc. at the travel destination from a database or an external interface based on the received information and emotional state, and means for filtering and prioritizing the collected information based on the user's conditions and emotional state. This makes it possible to generate and provide an optimal travel plan according to the user's emotions.

[1438] "User" means a user of the system who inputs travel plans and receives the information provided.

[1439] "Emotional state" refers to the emotional state a user feels when entering their travel plans or during their trip, and includes joy, anticipation, tension, anxiety, etc.

[1440] "Transportation" means the means of transportation used by a User to reach a Travel Destination, including, but not limited to, airplanes, trains, buses, and taxis.

[1441] "Accommodation" refers to facilities where users can stay at their travel destinations, including hotels, hostels, inns, and guesthouses.

[1442] "Tourist destinations" refers to the places and activities that users plan to visit during their travels, including museums, theme parks, natural parks, historical buildings, etc.

[1443] "Database" means an information system for storing and managing travel-related information.

[1444] "External interface" refers to a connection means for obtaining information from an external data source, including APIs.

[1445] "Filtering" refers to the process of extracting information from received data that meets a user's criteria.

[1446] "Prioritization" refers to the process of determining the importance of extracted information based on the user's preferences and emotional state.

[1447] A "travel plan" refers to a plan that summarizes the travel schedule, places to visit, accommodation, transportation, etc.

[1448] The travel proposal package system of this invention is a system that improves user satisfaction by providing travel plans that reflect the user's emotions. The system is mainly composed of a server and a user's terminal, and the specific processing is as follows.

[1449] Entering user information

[1450] Users use a PC or smartphone application to input information such as travel destination, itinerary, budget, preferences, etc. At the same time, the user's emotional state (e.g., "expectation," "anxiety," etc.) is also recorded.

[1451] The device formats the input information and sends a request containing emotion data to the server. This formatting process converts the information in the data input form into a data structure such as JSON.

[1452] Data collection and analysis

[1453] The server analyzes the received user information, specifically identifying travel destination, itinerary, budget, preferences, and emotional state.

[1454] The server uses an internal database and external APIs (e.g., Google Maps API, TripAdvisor API) to collect relevant travel data (transportation, accommodation, tourist spots, etc.) and temporarily stores it in storage. It also uses an emotion engine to analyze the user's emotional state and use it to create plans.

[1455] Data filtering and prioritization

[1456] The server then filters the collected travel data based on the user's criteria, extracting only the options available within their budget.

[1457] The server then prioritizes the filtered data based on the user's preferences and emotional state. For example, if the user indicates they want to relax, relaxation spots and accommodations will be prioritized.

[1458] Generate and present a plan

[1459] The server uses the prioritized data to generate an optimal itinerary, combining flights, hotels, and attractions into a single itinerary.

[1460] The server formats the generated itinerary and sends it to the backend terminal in a user-friendly format, where the user can view it.

[1461] User customization

[1462] The user reviews the proposed travel plan and makes any necessary changes, such as requesting a change of accommodation to a different hotel.

[1463] The terminal sends the user's change request to the server.

[1464] The server regenerates the final plan reflecting the requested changes and verifies that the conditions are met.

[1465] The server will make flight and hotel reservations based on the final confirmed plan.

[1466] Real-time navigation and support

[1467] The server provides real-time information during the trip, such as public transport timetables and access information to tourist spots.

[1468] The server uses an emotion engine to monitor the user's emotional state while traveling, and if it detects stress or other conditions, it will present relaxation spots and support information.

[1469] The device displays this information to the user in real time and guides them to their next destination and means of transportation.

[1470] Example prompt sentences

[1471] For family trips:

[1472] "I'm planning a seven-day trip to Tokyo for my family of four. My budget is 300,000 yen, and the emotion engine detected "expectations" when I entered the information. I'd like the app to generate an optimal itinerary that includes family-friendly tourist spots."

[1473] For business travel:

[1474] "I'm planning a two-day trip for a business meeting in Tokyo. My budget is 150,000 yen, and the emotion engine detected 'tension' when I entered it. I'd like the app to generate an optimal itinerary including business-friendly hotels and transportation."

[1475] In this way, the system of the present invention takes into account the user's feelings, flexibly changes the travel plan, and provides support in real time.

[1476] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1477] Step 1:

[1478] Users input details about their trip, such as destination, itinerary, budget, and preferences, via PC or smartphone, as well as their emotional state. Specific input examples include "Planning a family trip to Tokyo for 7 days, budget 300,000 yen, preferring family-friendly tourist spots, emotional state is anticipation."

[1479] Input: Travel destination, dates, budget, preferences, emotional state

[1480] Output: Formatted request data (e.g., JSON format)

[1481] The device formats the input information and sends a request including emotion data to the server.

[1482] Step 2:

[1483] The server analyzes the received user information, specifically extracting travel destination, itinerary, budget, preferences, and emotional state from the received data and passing them to the analysis module.

[1484] Input: Formatted request data (e.g., JSON format)

[1485] Output: Analysis results (travel destination, schedule, budget, preferences, emotional state)

[1486] The server uses an internal database and external APIs (such as Google Maps API, TripAdvisor API) to collect relevant travel data and store it in temporary storage.

[1487] Input: Analysis results

[1488] Output: Collected travel data (transportation, accommodation, tourist destination information)

[1489] Step 3:

[1490] The server filters the collected travel data based on the user's criteria, extracting available options within the user's budget and filtering based on the user's input and emotional state.

[1491] Input: Collected travel data

[1492] Output: filtered trip data

[1493] The server then prioritizes the filtered data based on the user's preferences and emotional state: for example, if a user expresses "expectations," family-friendly tourist destinations and accommodations will be displayed at the top.

[1494] Input: filtered travel data, user conditions and emotional state

[1495] Output: prioritized trip data

[1496] Step 4:

[1497] The server then uses the prioritized data to generate an optimal travel plan, specifically a detailed itinerary including flights, hotels, and attractions.

[1498] Input: Prioritized travel data

[1499] Output: Generated itinerary

[1500] The server formats the generated itinerary and sends it to the terminal in a user-friendly format.

[1501] Step 5:

[1502] The device displays the generated itinerary to the user, including a detailed description and a breakdown of costs. The user can review the itinerary and make changes or additions as needed, such as changing the accommodation to a different hotel.

[1503] Input: Generated itinerary

[1504] Output: User change request

[1505] The user reviews the proposed plan and notifies the device of any necessary changes, which are then sent back to the server.

[1506] Step 6:

[1507] The server regenerates the final plan reflecting the user's changes and verifies that all conditions are met. The server confirms the final plan that meets all conditions and books flights and accommodations.

[1508] Input: User change request

[1509] Output: Final confirmed plan

[1510] Step 7:

[1511] During the trip, the server provides real-time information on public transport timetables and access to tourist attractions. In addition, the emotion engine monitors the user's emotional state during the trip and presents support information such as relaxation spots if a stressful situation is detected.

[1512] Input: Real-time data, emotional state

[1513] Output: Real-time navigation information, support information

[1514] The device displays this real-time information to the user and guides them to their next destination and means of transportation.

[1515] Input: Real-time navigation information, support information

[1516] Output: Information presented to the user

[1517] The above are the specific processing steps of the program.

[1518] (Application example 2)

[1519] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1520] Conventional food delivery systems are unable to provide optimal ordering suggestions based on the user's emotional state, making it difficult to fully increase user satisfaction. Furthermore, there is a lack of a way for users to automatically generate optimal plans based on their budget, preferences, and delivery time, making it difficult to achieve an efficient ordering process.

[1521] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for receiving information regarding delivery destination, delivery time, budget, and preferences entered by the user; means for collecting related information such as delivery destination restaurants, dishes, and delivery services from a database or external API based on the received information; means for filtering and prioritizing the collected information based on the user's conditions and emotional state; means for automatically generating an optimal food delivery plan based on the filtered and prioritized information; and means for presenting the generated food delivery plan to the user. This makes it possible to propose a food delivery plan customized according to the user's emotional state.

[1522] "Delivery destination" is information indicating the location where the user wants to receive food delivery.

[1523] "Delivery time" is information indicating the estimated arrival time of the food delivery desired by the user.

[1524] "Budget" is information that indicates the amount of money a user can spend on food delivery.

[1525] "Preferences" refers to information that indicates the user's preferences and predilection for ingredients, cuisine, and restaurants.

[1526] "Means for receiving information" refers to the functionality of the device or software that allows information entered by the user regarding delivery destination, delivery time, budget, and preferences to be input into the system.

[1527] "Means of collection" refers to the functionality of the device or software that allows the system to obtain the relevant information it needs from a database or external API.

[1528] "Filtering and prioritization means" refers to the device or software functions that sort and sort collected information based on the user's criteria and emotional state.

[1529] "Means for automatic generation" refers to the functionality of a device or software that automatically creates an optimal food delivery plan based on filtered and prioritized information.

[1530] The "means for presenting" refers to the function of the device or software that displays the generated food delivery plan to the user and allows the user to confirm or customize it.

[1531] The system for implementing this invention aims to automatically generate and provide an optimal food delivery plan based on the user's emotional state. This system is mainly composed of components such as a server, a user terminal, and an emotion engine.

[1532] System Configuration

[1533] User Device

[1534] A device, such as a smartphone, where a user inputs information and receives a food delivery plan. The user device provides a form for inputting information about delivery destination, delivery time, budget, and preferences, and processes and transmits the input to a server.

[1535] server

[1536] The server analyzes the received user information and collects relevant information from the database and external APIs. It uses an emotion engine to analyze the user's emotional state, filters and prioritizes data based on the results, and automatically generates an optimal food delivery plan and sends it to the user's device.

[1537] Emotion Engine

[1538] The emotion engine recognizes the emotional state of the user from their input and voice data and reflects this in the food delivery plan, using software such as IBM Watson and Affectiva for sentiment analysis.

[1539] Processing steps

[1540] Receiving and analyzing

[1541] The server analyzes the information received from the user's device, such as delivery destination, delivery time, budget, and preferences, and uses an emotion engine to analyze the user's emotional state and stores the analysis results in a database.

[1542] Data collection

[1543] The server collects information on restaurants, dishes, and delivery services that match the user's criteria from external APIs and internal databases, and the collected data is temporarily stored on the server.

[1544] Filtering and Prioritization

[1545] The server filters the collected data based on the user's conditions (budget, preferences) and emotional state, and prioritizes and selects the most appropriate information based on the user's emotions.

[1546] Generate a plan

[1547] The server automatically generates the optimal food delivery plan based on the filtered and prioritized information, specifically creating a customized plan that combines food selection, restaurant, and delivery time.

[1548] Presenting and confirming the plan

[1549] The generated food delivery plan is formatted in a user-friendly format and sent to the user's device. The user can review the plan and customize it as needed. The final plan is confirmed by the server, and the order is sent to the restaurant.

[1550] Specific examples

[1551] Example of a tired user

[1552] Let's say a user requests "pizza" in the input form, with a budget of "2,000 yen" and a delivery time of "within 30 minutes." The emotion engine analyzes the user's emotional state as "tired." In this case, the app will prioritize restaurants that serve pizza suitable for relaxation and adjust the delivery time to suit the user's preferences.

[1553] Prompt Sentence Examples

[1554] Information you enter:

[1555] Cuisine: Pizza

[1556] Delivery time: within 30 minutes

[1557] Budget: 2000 yen

[1558] Emotion-based suggestions:

[1559] The emotion engine detects that the user is tired and suggests a restaurant that serves pizza, perfect for relaxation.

[1560] The system will enable the provision of customized food delivery plans based on the user's emotional state.

[1561] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1562] Step 1:

[1563] The user inputs information about the delivery address, delivery time, budget, and preferences. The input information also includes the user's emotional state. The input data is organized and formatted by the device. Specifically, the user provides this information using a smartphone application by text input or voice input. This results in the input data of the delivery address, delivery time, budget, preferences, and emotional state.

[1564] Step 2:

[1565] The device sends the input information to the server. The emotion engine also works at the same time, analyzing the user's emotional state from their voice and text data. The analysis results are sent to the server. Specifically, the device sends this data to the server using an HTTP request. The output is JSON data that includes the user's delivery address, delivery time, budget, preferences, and emotional state.

[1566] Step 3:

[1567] The server analyzes the received data and collects relevant information. The server collects information about the restaurant, food, and delivery service from a database and external APIs. Specifically, the server retrieves data using SQL queries and API requests. Through this process, the server collects information related to the delivery destination, delivery time, budget, preferences, and emotional state.

[1568] Step 4:

[1569] The server filters the collected data and prioritizes it based on the user's criteria and emotional state. The filtering selects only information that matches the user's budget, preferences, and delivery time. Then, it sets priorities based on the emotional state. Specifically, the server uses an algorithm based on the output of the emotion engine to filter and sort the data. The output is an optimized list of candidate information.

[1570] Step 5:

[1571] The server automatically generates an optimal food delivery plan based on the filtered and prioritized information. The generated plan includes specific dishes, restaurants, and delivery times. Specifically, the server combines this information and constructs the plan in a user-friendly format. The output is the optimal food delivery plan data.

[1572] Step 6:

[1573] The server sends the generated food delivery plan to the user terminal. Specifically, the server uses an HTTP response to send the plan data to the user terminal. This allows the user terminal to receive the plan and present it to the user.

[1574] Step 7:

[1575] The user reviews the presented food delivery plan and customizes it as necessary. The device then sends the user's change request back to the server. Specifically, the user edits each element of the plan on the application, saves the results, and sends them to the server. The output is the customized food delivery plan data.

[1576] Step 8:

[1577] The server regenerates the final plan reflecting the user's customized requirements and ensures that all conditions are met. Specifically, the server runs the filtering, prioritization, and plan generation processes again. The output is the final food delivery plan data.

[1578] Step 9:

[1579] The server determines various services based on the final plan and arranges delivery. Specifically, the server sends the order to the restaurant and processes the delivery service. The output is the determined order information and delivery arrangement information.

[1580] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1581] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1582] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1583] [Fourth embodiment]

[1584] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1585] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1586] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1587] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1588] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1589] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1590] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1591] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1592] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1593] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1594] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1595] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1596] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1597] In the embodiment of the present invention, the configuration and functions of the travel proposal package system are realized using a plurality of servers and user terminals. The specific contents are described below.

[1598] System Configuration

[1599] The system mainly consists of the following elements:

[1600] 1. User device: The device where the traveler enters input and receives the final itinerary. This can include a PC or smartphone.

[1601] 2. Server: Collects travel-related information, filters, prioritizes, generates plans, confirms reservations, and provides navigation information.

[1602] Specific program content

[1603] Entering user information

[1604] Users enter their travel destination, dates, budget, and preferences (type of activity, type of tourist attraction, etc.) into a configuration form.

[1605] The device formats the input information and sends it to the server, including the user's unique ID in the request.

[1606] Data collection and analysis

[1607] Based on the received user information, the server retrieves information on related transportation, accommodation, and tourist attractions from a database and external API.

[1608] The server parses the collected information and filters it based on user criteria, for example, to find available flights and accommodations within a budget.

[1609] The server then prioritizes the filtered data based on the user's preferences and begins to generate the ideal itinerary.

[1610] Generate a plan

[1611] The server automatically generates a travel plan by combining the best flights, hotels, and tourist attractions. For example, if a user inputs that they prioritize cultural attractions, the server will generate a plan that includes spots such as Sensoji Temple and Ueno Park.

[1612] The server assembles the generated travel plans into a package and creates an itinerary and a price quote.

[1613] Presenting the plan

[1614] The server formats the generated travel plan in a user-friendly format and sends it to the user's terminal.

[1615] The device will display the plan to the user, providing a detailed description and breakdown of the costs.

[1616] User confirmation and booking

[1617] Users can review the proposed travel plan and customize it as needed.

[1618] The terminal again sends the user's customization request to the server.

[1619] The server regenerates the final plan and checks if all conditions are met, then confirms the booking of services (flights, hotels, tickets, etc.).

[1620] Navigation and Support

[1621] The server provides real-time navigation information during the trip, such as public transport connections and access to tourist attractions.

[1622] The device displays this information to the user and provides navigation and support during the journey.

[1623] Specific examples

[1624] Example 1: Family trip

[1625] The user enters a plan for a family of four visiting Tokyo for seven days with a budget of 300,000 yen, prioritizing major tourist destinations and including activities for the kids.

[1626] The server collects and filters data based on these criteria, selecting family-friendly tourist destinations such as Disneyland and Tokyo Skytree.

[1627] The server generates a plan that combines the best flights, hotels, and tourist attractions and presents it to the user.

[1628] Users can confirm the plan and confirm the reservation, and real-time navigation information will be provided to their device during the trip.

[1629] Example 2: Business Travel

[1630] The user is planning a two-day trip to Tokyo to attend a business meeting, with a budget of 150,000 yen, and prioritizes comfortable accommodation and transportation.

[1631] Based on these conditions, the server collects information on flights, business hotels, and meeting rooms.

[1632] The server generates the optimal plan and presents it to the user.

[1633] Users can confirm and customize their plans and confirm their reservations. On the day of the meeting, they follow the navigation information provided by the server.

[1634] This allows users to enjoy an efficient and satisfying travel experience, providing an integrated service from planning to execution.

[1635] The processing flow will be explained below.

[1636] Step 1:

[1637] Users enter their travel destination, dates, budget, and preferences (type of activity, type of tourist attraction, etc.) into an input form on their device.

[1638] Step 2:

[1639] The device formats the entered information and sends a request to the server, including the user's unique ID.

[1640] Step 3:

[1641] The server analyzes the received user information to identify travel destinations, dates, budgets, and preferences.

[1642] Step 4:

[1643] The server collects relevant travel data (transportation, accommodation, tourist attractions, etc.) from an internal database and external APIs and temporarily stores it.

[1644] Step 5:

[1645] The server filters the collected travel data based on the user's criteria, extracting only the options available within their budget.

[1646] Step 6:

[1647] The server then prioritizes the filtered data based on the user's preferences: for example, if a user likes "cultural spots," that data will be ranked higher.

[1648] Step 7:

[1649] The server then uses the filtered and prioritized information to automatically generate an optimal travel plan, including an itinerary including flights, hotels, and tourist attractions.

[1650] Step 8:

[1651] The server formats the generated travel plan in a user-friendly format and sends it to the terminal.

[1652] Step 9:

[1653] The device displays the proposed itinerary to the user, including detailed descriptions and a breakdown of the costs.

[1654] Step 10:

[1655] Users can review the proposed itinerary and make changes or additions as needed, such as changing accommodation to a different hotel.

[1656] Step 11:

[1657] The terminal sends the user's customization request to the server.

[1658] Step 12:

[1659] The server regenerates the final plan reflecting the customized requirements and verifies that all conditions are met.

[1660] Step 13:

[1661] The server finalizes various services (flight, hotel, tourist attraction reservations, etc.) based on the final travel plan.

[1662] Step 14:

[1663] The server provides real-time navigation information for the travel period, such as public transport timetables and access information to tourist attractions.

[1664] Step 15:

[1665] The server sends navigation information to the terminal at appropriate times during the journey.

[1666] Step 16:

[1667] The device will display real-time navigation information to the user, guiding them to their next destination and transportation options, such as the next train to catch and transit information.

[1668] Step 17:

[1669] Users navigate based on the displayed navigation information and enjoy their trip as planned.

[1670] Example 1

[1671] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1672] Conventional travel planning systems have difficulty generating appropriate travel plans based on user input, and lack real-time navigation information and support during the trip. As a result, users often experience inconvenience due to a lack of consistent support from trip planning to trip execution. This system aims to solve these issues and provide users with an efficient and satisfying travel experience.

[1673] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1674] In this invention, the server includes means for receiving information on travel destinations, itineraries, budgets, and preferences input by a user, means for formatting the received information into JSON format and sending it to the server, means for collecting related information on travel destinations, accommodations, tourist attractions, etc. from a database or external API based on the received information, means for analyzing the collected information and filtering and prioritizing it based on the user's conditions, means for automatically generating an optimal travel plan based on the filtered and prioritized information and converting it into JSON format, and means for formatting the generated travel plan in a user-friendly UI format and sending and displaying it on the user's terminal, thereby enabling users to receive intuitive and consistent travel planning and support.

[1675] "Destination" means a specific geographic location that a User wishes to visit.

[1676] "Dates" refers to the period from the start date to the end date for which the User plans to travel.

[1677] "Budget" means the total amount of money that you plan to spend on your trip.

[1678] "Preferences" refers to a user's preferences regarding the types of activities and tourist destinations they seek while traveling.

[1679] "User Device" means the device on which a User enters input and receives the final itinerary, including a PC or smartphone.

[1680] "Server" refers to the computer system that is the core of the travel proposal package system, and is the device that collects and analyzes data and generates travel plans.

[1681] A "database" refers to a collection of data that is systematically organized to make it easy to access, manage, and update.

[1682] An "external API" refers to an interface for linking data and functions with external systems and services.

[1683] "Filtering" refers to the process of selecting collected information that meets the user's criteria.

[1684] "Prioritization" refers to the process of prioritizing and selecting from the filtered data the data that best meets the user's requirements.

[1685] "Travel Plan" refers to a detailed travel plan automatically generated based on the user's input information and analysis results.

[1686] "Navigation information" refers to information that allows a user to receive instructions regarding routes and means of transportation to a destination while traveling.

[1687] "Support Information" means information to provide additional help or assistance that a User may require during their Travel.

[1688] In the embodiment of the present invention, the configuration and functions of the travel proposal package system are realized using a plurality of servers and user terminals.

[1689] System Configuration

[1690] User Device

[1691] Users use devices such as PCs or smartphones to input their travel destination, dates, budget, and preferences.

[1692] The terminal formats the information entered by the user into JSON format and sends it to the server.

[1693] server

[1694] The server receives information sent from the user's device, including data about travel destinations, itineraries, budgets, and preferences.

[1695] Based on the received information, the server collects relevant information about the travel destination, such as transportation, accommodation, and tourist attractions, from a database or external API, such as a MySQL database or Google Places API.

[1696] The server analyzes, filters, and prioritizes the collected information, using machine learning models and data processing libraries such as Scikit-learn and Pandas.

[1697] The server automatically generates an optimal travel plan based on the filtered and prioritized information and converts it into JSON format. The generated travel plan is implemented using the Django framework and Flask.

[1698] The server formats the generated travel plans in a user-friendly UI format and sends and displays them on the user's device. React.js and HTML templates are used as front-end technologies.

[1699] Specific examples

[1700] Example 1: Family trip

[1701] The user plans a seven-day trip to Tokyo for a family of four, inputting a budget of 300,000 yen, major tourist attractions, and desired activities for children.

[1702] The server collects data based on these conditions and selects family-friendly tourist destinations such as Disneyland and Skytree.

[1703] The server generates a plan that combines the best flights, hotels, and tourist attractions and presents it to the user.

[1704] Users can confirm the plan and confirm the reservation, and real-time navigation information will be provided to their device during the trip.

[1705] Example 2: Business Travel

[1706] A user plans a two-day trip for a business meeting in Tokyo, with a budget of 150,000 yen, and prioritizes comfortable accommodation and transportation.

[1707] The server collects data based on these conditions and retrieves flight, business hotel, and conference room information.

[1708] The server generates the optimal plan and presents it to the user.

[1709] The user checks and customizes the plan and confirms the reservation. On the day of the meeting, the user follows the navigation information provided by the server.

[1710] Prompt Sentence Examples

[1711] For a family trip: "We're a family of four traveling to Tokyo for 7 days with a budget of ¥300,000, including major tourist attractions and activities for the kids."

[1712] For business travel: "I'm traveling for two days for a business meeting in Tokyo. My budget is ¥150,000, and I'd like comfortable accommodation and transportation."

[1713] In this way, the entire system can consistently support the user's travel experience. In particular, the function that quickly and accurately analyzes the information entered by the user and generates and provides the optimal travel plan based on the results can greatly improve the user experience from travel planning to execution.

[1714] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1715] Step 1:

[1716] The user enters information about the travel destination, itinerary, budget, and preferences into the device's configuration form. The input information includes the following: travel destination (e.g., Tokyo), itinerary (e.g., December 1st to 7th, 2023), budget (e.g., 300,000 yen), and preferences (e.g., family-friendly, cultural tourist destinations). The device formats this information into JSON format and sends it to the server. JSON data is generated based on the input data and output in the following format:

[1717] json

[1718] {

[1719] "destination": "Tokyo",

[1720] "date_range": "2023-12-01 to 2023-12-07",

[1721] "budget": 300000,

[1722] "preferences": {

[1723] "category": "family",

[1724] "interests": ["cultural"]

[1725] }

[1726] }

[1727] Step 2:

[1728] The server receives a request in JSON format sent from the device. This information includes the user's travel destination, itinerary, budget, and preferences. The server analyzes this data and, based on it, collects relevant information about transportation (e.g., flights), accommodation, and tourist attractions from databases and external APIs (e.g., MySQL database, Google Places API). Based on the input data, the server generates SQL queries and HTTP requests, collects the retrieved data, and outputs it in the following format:

[1729] json

[1730] {

[1731] "flights": [{"flight_number": "NH123", "departure": "2023-12-01", "price": 50000}],

[1732] "hotels": [{"name": "Tokyo Hotel", "price": 100000}],

[1733] "attractions": [{"name": "Sensoji Temple", "category": "cultural"}]

[1734] }

[1735] Step 3:

[1736] The server analyzes the acquired information using machine learning models and rule-based filtering algorithms to extract information that meets the user's criteria. For example, it processes the data using Scikit-learn or Pandas. Based on the results of filtering and prioritization, it outputs the required data as follows:

[1737] json

[1738] {

[1739] "filtered_flights": [{"flight_number": "NH123", "departure": "2023-12-01", "price": 50000}],

[1740] "filtered_hotels": [{"name": "Tokyo Hotel", "price": 100000}],

[1741] "filtered_attractions": [{"name": "Sensoji Temple", "category": "cultural"}]

[1742] }

[1743] Step 4:

[1744] The server automatically generates a travel plan based on the filtered and prioritized data. For example, the plan generation logic can be implemented using the Django framework or Flask. The generated travel plan is converted into JSON format and output as follows:

[1745] json

[1746] {

[1747] "trip_plan": {

[1748] "flights": [{"flight_number": "NH123", "departure": "2023-12-01", "price": 50000}],

[1749] "hotels": [{"name": "Tokyo Hotel", "price": 100000}],

[1750] "attractions": [{"name": "Sensoji Temple", "category": "cultural"}]

[1751] }

[1752] }

[1753] Step 5:

[1754] The server formats the generated travel plan into a user-friendly UI format and sends it to the user's device. The front-end is implemented using HTML templates and React.js. The display on the user's device looks like this:

[1755] Flight information

[1756] Flight number: NH123

[1757] Departure date: 2023-12-01

[1758] Price: 50,000 yen

[1759] Hotel Information

[1760] Hotel name: Tokyo Hotel

[1761] Price: 100,000 yen

[1762] Tourist information

[1763] Tourist attraction: Sensoji Temple

[1764] Category: Cultural

[1765] Step 6:

[1766] The user checks the presented travel plan and customizes it as needed. For example, if they want to change the flight time, they enter the customization information through the device's UI and send it back to the server. Enter and send the following customization information:

[1767] json

[1768] {

[1769] "customization": {

[1770] "flights": {

[1771] "change": true,

[1772] "preferred_time": "morning"

[1773] }

[1774] }

[1775] }

[1776] Step 7:

[1777] When the server receives the customization request, it re-collects the information and re-generates the itinerary to suit the user's preferences. For example, it collects new flight information and re-filters and re-prioritizes it. It then generates the final itinerary and proceeds with the booking process, for example, by using the Stripe API to confirm payment. It then outputs the new itinerary as follows:

[1778] json

[1779] {

[1780] "trip_plan": {

[1781] "flights": [{"flight_number": "NH124", "departure": "2023-12-01", "price": 55000}],

[1782] "hotels": [{"name": "Tokyo Hotel", "price": 100000}],

[1783] "attractions": [{"name": "Sensoji Temple", "category": "cultural"}]

[1784] }

[1785] }

[1786] Step 8:

[1787] The server provides real-time navigation information to the user during the trip. The server obtains the navigation information using Google Maps API or similar and sends it to the user's device in JSON format. The user can then use the device to check their current location and the route to their destination. The following is an example of the navigation information:

[1788] json

[1789] {

[1790] "navigation": {

[1791] "current_location": "Tokyo Station",

[1792] "destination": "Sensoji Temple",

[1793] "route": "Take the JR Yamanote Line to Ueno, then transfer to the Ginza Line and get off at Asakusa"

[1794] }

[1795] }

[1796] In this way, the entire system supports the user's travel experience consistently.

[1797] (Application example 1)

[1798] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1799] Conventional travel recommendation systems not only require a lot of time and effort for users to plan their trips, but also often lack detailed information about the destination. They also lack the means to simulate real-life travel experiences in advance, making it difficult to respond to actual situations at the destination. Furthermore, they lack real-time navigation and support information, which can cause stress during the trip.

[1800] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1801] In this invention, the server includes means for receiving information on travel destinations, itineraries, budgets, and preferences input by a user, means for collecting related information on transportation, accommodations, tourist attractions, etc. at the travel destination from a database or external API based on the received information, means for filtering and prioritizing the collected information based on the user's conditions, means for automatically generating an optimal travel plan based on the filtered and prioritized information, means for presenting the generated travel plan to the user, and means for providing a travel experience in a virtual space using a virtual reality device based on the user's preferences. This allows the user to simulate a detailed trip, efficiently plan their trip, and receive real-time navigation and support information during their actual trip.

[1802] A "user device" is a device on which a traveler enters information and receives the final travel plan, and includes PCs, smartphones, VR devices, etc.

[1803] "Server" means a computer system that collects travel-related information, filters, prioritizes, generates plans, confirms reservations, and provides navigation information.

[1804] A "virtual reality device" is a device that allows users to have a realistic experience in a virtual space, and includes VR head-mounted displays.

[1805] "User Conditions" refers to information entered by the User regarding travel destination, dates, budget, and preferences.

[1806] "Filtering" is the process of removing unnecessary data from collected information and selecting appropriate data based on the user's conditions.

[1807] "Prioritization" is the process of assigning importance and priority to filtered information based on the user's preferences and conditions.

[1808] A "trip plan" is a server-generated planning package that includes suggestions for optimal itineraries, transportation, accommodations, sightseeing spots, and even activities.

[1809] "Navigation information" refers to real-time information needed during the trip, such as information on transportation transfers and how to access tourist attractions.

[1810] This invention relates to a travel package proposal system using a virtual reality device, and aims to efficiently support users in planning their travels.

[1811] System Configuration

[1812] The present invention mainly comprises the following elements:

[1813] 1. User device: The device where travelers input and receive the final itinerary. This can include PCs, smartphones, VR head-mounted displays, etc.

[1814] 2. Server: A computer system that collects travel-related information, filters, prioritizes, generates plans, confirms reservations, and provides navigation information.

[1815] 3. Virtual reality devices: Devices that allow users to experience reality in a virtual space. These include VR head-mounted displays.

[1816] Entering user information

[1817] The user enters the travel destination, itinerary, budget, and preferences (e.g., type of activity, type of tourist attraction) into a setting form on the device. The device formats the entered information and sends it to the server. This request includes the user's unique ID. For example, an example input might be, "Please suggest a travel plan for a family of four to Tokyo for 7 days. The budget is 300,000 yen, and priority should be given to major tourist attractions and activities for children."

[1818] Data collection and analysis

[1819] The server retrieves relevant information on transportation, accommodation, and tourist attractions from databases and external APIs based on the received user information. The server analyzes the collected information and filters it based on the user's criteria. For example, it may extract available flights and accommodations within a user's budget. The server then prioritizes the filtered data based on the user's preferences to generate an ideal travel plan.

[1820] Generate and present a plan

[1821] The server automatically generates a travel plan by combining optimal flights, hotels, and tourist attractions. For example, if a user selects cultural attractions, a plan including Sensoji Temple and Ueno Park will be generated. The server then compiles the generated travel plan into a package, creating an itinerary and a price estimate. The server then formats the plan in a user-friendly format and sends it to the user's device. The device then displays the plan to the user, providing a detailed description and a price breakdown.

[1822] Virtual Travel Experience

[1823] Users can experience the presented travel plan in a virtual space through a VR head-mounted display, allowing them to simulate local tourist attractions, hotel conditions, and transportation options before traveling.

[1824] User confirmation and booking, real-time navigation

[1825] The user reviews the presented travel plan and customizes it as necessary. The device then sends the user's customization request back to the server, which then regenerates the final plan. After all conditions are met, the server confirms the reservation of various services (flights, hotels, admission tickets, etc.). The server also provides real-time navigation information for the duration of the trip. The device displays this information to the user and provides ground support during the trip.

[1826] Specific examples

[1827] For example, if a family of four is visiting Tokyo, the user can use the VR head-mounted display to experience visiting selected tourist spots, such as Sensoji Temple and Disneyland, in advance in a virtual space. The user can also check the optimal route in real time based on navigation information from the server. Real-time navigation includes information such as, "The next train you should take departs from Station YY on the XX line."

[1828] In this way, users can efficiently plan their trips while performing detailed simulations of their trips, and receive real-time support during the actual trip.

[1829] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1830] Step 1:

[1831] User input of travel information

[1832] Users use a device (PC, smartphone, VR device, etc.) to input their travel destination, dates, budget, and preferences (for example, "Please suggest a travel plan for a family of four to Tokyo for 7 days. The budget is 300,000 yen, and priority should be given to major tourist spots and activities for children.").

[1833] Input: Travel destination, dates, budget, preferences

[1834] Output: Formatted user information data

[1835] How it works: The device formats the information entered by the user and sends it to the server as a single data package.

[1836] Step 2:

[1837] Data collection and filtering

[1838] Based on the received user information, the server uses an internal database and external APIs to collect related information such as transportation, accommodation, and tourist destinations.

[1839] Input: Formatted user information data

[1840] Output: A list of collected travel-related information

[1841] How it works: The server issues database queries and API requests, filtering and prioritizing the collected information based on user criteria, such as finding accommodations and flights within a budget.

[1842] Step 3:

[1843] Generate a travel plan

[1844] The server automatically generates an optimal travel plan based on the filtered and prioritized information.

[1845] Input: Filtered and prioritized information

[1846] Output: An automatically generated itinerary

[1847] How it works: The server uses AI algorithms to generate a travel plan that combines the best flights, hotels, and attractions based on the user's preferences and requirements.

[1848] Step 4:

[1849] Virtual experience of the plan

[1850] Using a VR head-mounted display, users can experience the presented travel plan in a virtual space.

[1851] Input: Auto-generated itinerary

[1852] Output: A travel experience in a virtual space

[1853] How it works: The device renders the generated plan into a VR space, allowing users to virtually experience local tourist attractions and accommodations.

[1854] Step 5:

[1855] Let users review and customize their plans

[1856] Users can review the proposed itinerary and customize it as needed, for example by changing accommodations or adding tourist attractions.

[1857] Input: Customization Request

[1858] Output: Final itinerary

[1859] Operation: The terminal sends the user's customization request to the server, which then regenerates the final plan based on it.

[1860] Step 6:

[1861] Confirm your travel plan

[1862] After the final travel plan is confirmed, the server makes reservations for various services (flights, hotels, tickets, etc.).

[1863] Input: Final itinerary

[1864] Output: Confirmation of reservation

[1865] Operation: The server sends a reservation request to each service provider, and receives and stores confirmation of the reservation.

[1866] Step 7:

[1867] Providing real-time navigation information

[1868] The server provides real-time navigation information (such as transportation transfer information and access methods to tourist attractions) during the trip.

[1869] Input: Real-time data during the trip

[1870] Output: Navigation information

[1871] How it works: The server collects real-time data on transportation and tourist attractions and sends it to the user's device as navigation information. The user then moves around according to this information.

[1872] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1873] In an embodiment of the present invention, an emotion engine is combined with a travel package system to recognize user emotions and reflect them in the generation and provision of travel plans. The system includes a server and a user terminal, and creates an optimal travel plan based on the traveler's requirements and provides support during the trip.

[1874] System Configuration

[1875] The system mainly consists of the following elements:

[1876] 1. User device: The device where travelers input information and receive travel plans. This can be a PC or smartphone.

[1877] 2. Server: Collects travel-related information, filters and prioritizes it, generates and presents the optimal plan, and processes user emotion information using an emotion engine.

[1878] 3. Emotion engine: Recognizes the user's emotional state from text input, voice data, feedback during navigation, etc., and provides information based on that.

[1879] Specific program content

[1880] Entering user information

[1881] Users enter their travel destination, itinerary, budget, and preferences (type of activity, type of tourist spot, etc.) into an input form on the device. Emotions (joy, anticipation, anxiety, etc.) at the time of input are also recorded.

[1882] The device formats the input information and sends a request including emotion data to the server.

[1883] Data collection and analysis

[1884] The server analyzes the received user information to identify travel destinations, dates, budgets, and preferences, while the emotion engine analyzes the user's emotional state and uses the results to generate travel plans.

[1885] The server collects relevant travel data (transportation, accommodation, tourist attractions, etc.) from an internal database and external APIs and temporarily stores it.

[1886] Filtering and Prioritization

[1887] The server filters the collected travel data based on the user's criteria, extracting only the options available within their budget.

[1888] The server prioritizes the filtered data based on the user's preferences and emotional data. For example, if the user indicates that they want to relax, relaxing tourist spots and accommodations will be prioritized.

[1889] Generate a plan

[1890] The server then uses the filtered and prioritized information to automatically generate an optimal travel plan, including an itinerary including flights, hotels, and tourist attractions.

[1891] The server formats the generated travel plan in a user-friendly format and sends it to the terminal.

[1892] Presenting the plan

[1893] The device displays the proposed itinerary to the user, including detailed descriptions and a breakdown of the costs.

[1894] User confirmation and booking

[1895] Users can review the proposed itinerary and make changes or additions as needed, such as changing accommodation to a different hotel.

[1896] The terminal again sends the user's customization request to the server.

[1897] The server regenerates the final plan reflecting the customized requirements and verifies that all conditions are met.

[1898] The server confirms various services (flight, hotel, tourist attraction reservations, etc.) based on the final plan.

[1899] Real-time navigation and support

[1900] The server provides real-time navigation information for the travel period, such as public transport timetables and access information to tourist attractions.

[1901] The server uses an emotion engine to monitor the user's emotional data during the trip and provide support information according to their emotions. For example, if a stressful situation is detected during the trip, it will suggest relaxation spots.

[1902] The device displays this information to the user in real time and guides them to their next destination and means of transportation.

[1903] Specific examples

[1904] Example 1: Family trip

[1905] A user enters a budget of 300,000 yen for a 7-day trip to Tokyo with a family of four. The emotion engine detects "expectations" as they enter the information.

[1906] Based on these conditions, the server generates a plan that includes family-friendly tourist spots such as Disneyland and Skytree.

[1907] The server presents the generated plan to the user, who then confirms it.

[1908] Users confirm their plans and make reservations, and during the trip, the emotion engine monitors the user's emotions and provides real-time navigation and support information.

[1909] Example 2: Business Travel

[1910] The user is planning a two-day trip to Tokyo for a business meeting. The budget is 150,000 yen, and comfort is important for accommodation and transportation. The emotion engine also detects "tension" when typing.

[1911] Based on these conditions, the server collects and generates information on flights, business hotels, and meeting rooms.

[1912] The server generates the optimal plan and presents it to the user.

[1913] Users can review and customize their plans and confirm their bookings, while the emotion engine monitors their tension during the trip and recommends relaxation facilities and comfortable transportation options.

[1914] This allows the system of the present invention to take user emotions into account and provide a more customized travel experience. By incorporating an emotion engine, we can further increase user satisfaction and realize a service that integrates the entire process from planning to execution of a trip.

[1915] The processing flow will be explained below.

[1916] Step 1:

[1917] Users enter their travel destination, itinerary, budget, and preferences (type of activity, type of tourist spot, etc.) into an input form on their device. The emotion engine also recognizes the user's emotions (joy, anticipation, anxiety, etc.) through text input, voice data, and facial recognition.

[1918] Step 2:

[1919] The device formats the input travel information and emotion data and sends it to the server as a request, which includes the user's unique ID.

[1920] Step 3:

[1921] The server analyzes the received user information to identify travel destination, itinerary, budget, preferences, and emotional state.

[1922] Step 4:

[1923] The server collects relevant travel data (transportation, accommodation, tourist attractions, etc.) from an internal database and external APIs and temporarily stores it.

[1924] Step 5:

[1925] The server filters the collected travel data based on the user's criteria, extracting only the options available within their budget.

[1926] Step 6:

[1927] The server prioritizes the filtered data based on an emotion engine: for example, if a user wants to "relax" and is feeling "anxious," quiet accommodations and relaxation spots will be prioritized.

[1928] Step 7:

[1929] The server then automatically generates an optimal travel plan based on the prioritized information, specifically creating an itinerary including flights, hotels, and tourist attractions.

[1930] Step 8:

[1931] The server formats the generated travel plan in a user-friendly format and sends it to the terminal.

[1932] Step 9:

[1933] The device displays a proposed itinerary to the user, including an itinerary, detailed descriptions of each item, and a breakdown of costs.

[1934] Step 10:

[1935] Users can review the proposed itinerary and customize it as needed, possibly changing accommodations or selecting additional tourist destinations.

[1936] Step 11:

[1937] The terminal reformats the user's customization request and sends it to the server.

[1938] Step 12:

[1939] The server creates a regeneration plan that reflects the customized request and verifies that all conditions are met.

[1940] Step 13:

[1941] The server confirms various services (flight, hotel, tourist attraction reservations, etc.) based on the finalized travel plan.

[1942] Step 14:

[1943] The server provides real-time navigation information for the duration of the trip, such as public transport timetables and access information to tourist attractions.

[1944] Step 15:

[1945] The server uses an emotion engine to monitor the user's emotional state in real time while traveling, and if the user is feeling stressed, it will suggest relaxation spots or places to rest and eat.

[1946] Step 16:

[1947] The server sends navigation information and emotional support information to the device at the appropriate time.

[1948] Step 17:

[1949] The device displays real-time navigation and support information to users, guiding them to their next destination and transportation options.

[1950] Step 18:

[1951] Users can move based on the displayed navigation and support information, enjoying their trip as planned and continuing their travel experience with peace of mind.

[1952] In this way, this system takes into account the user's emotions to provide optimal travel plans and provides a comfortable travel experience through real-time support during the trip.

[1953] Example 2

[1954] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1955] Conventional travel suggestion systems generate itineraries based on user input information, but do not provide plans that take the user's emotions into consideration. As a result, they lack flexible support that addresses emotions such as anxiety, stress, and anticipation that users may experience while traveling. The present invention aims to solve this problem by providing a system that improves user satisfaction by providing itineraries that take the user's emotions into consideration.

[1956] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving information on travel destinations, itineraries, budgets, preferences, and emotional state input by the user, means for collecting related information on transportation, accommodations, tourist spots, etc. at the travel destination from a database or an external interface based on the received information and emotional state, and means for filtering and prioritizing the collected information based on the user's conditions and emotional state. This makes it possible to generate and provide an optimal travel plan according to the user's emotions.

[1957] "User" means a user of the system who inputs travel plans and receives the information provided.

[1958] "Emotional state" refers to the emotional state a user feels when entering their travel plans or during their trip, and includes joy, anticipation, tension, anxiety, etc.

[1959] "Transportation" means the means of transportation used by a User to reach a Travel Destination, including, but not limited to, airplanes, trains, buses, and taxis.

[1960] "Accommodation" refers to facilities where users can stay at their travel destinations, including hotels, hostels, inns, and guesthouses.

[1961] "Tourist destinations" refers to the places and activities that users plan to visit during their travels, including museums, theme parks, natural parks, historical buildings, etc.

[1962] "Database" means an information system for storing and managing travel-related information.

[1963] "External interface" refers to a connection means for obtaining information from an external data source, including APIs.

[1964] "Filtering" refers to the process of extracting information from received data that meets a user's criteria.

[1965] "Prioritization" refers to the process of determining the importance of extracted information based on the user's preferences and emotional state.

[1966] A "travel plan" refers to a plan that summarizes the travel schedule, places to visit, accommodation, transportation, etc.

[1967] The travel proposal package system of this invention is a system that improves user satisfaction by providing travel plans that reflect the user's emotions. The system is mainly composed of a server and a user's terminal, and the specific processing is as follows.

[1968] Entering user information

[1969] Users use a PC or smartphone application to input information such as travel destination, itinerary, budget, preferences, etc. At the same time, the user's emotional state (e.g., "expectation," "anxiety," etc.) is also recorded.

[1970] The device formats the input information and sends a request containing emotion data to the server. This formatting process converts the information in the data input form into a data structure such as JSON.

[1971] Data collection and analysis

[1972] The server analyzes the received user information, specifically identifying travel destination, itinerary, budget, preferences, and emotional state.

[1973] The server uses an internal database and external APIs (e.g., Google Maps API, TripAdvisor API) to collect relevant travel data (transportation, accommodation, tourist spots, etc.) and temporarily stores it in storage. It also uses an emotion engine to analyze the user's emotional state and use it to create plans.

[1974] Data filtering and prioritization

[1975] The server then filters the collected travel data based on the user's criteria, extracting only the options available within their budget.

[1976] The server then prioritizes the filtered data based on the user's preferences and emotional state. For example, if the user indicates they want to relax, relaxation spots and accommodations will be prioritized.

[1977] Generate and present a plan

[1978] The server uses the prioritized data to generate an optimal itinerary, combining flights, hotels, and attractions into a single itinerary.

[1979] The server formats the generated itinerary and sends it to the backend terminal in a user-friendly format, where the user can view it.

[1980] User customization

[1981] The user reviews the proposed travel plan and makes any necessary changes, such as requesting a change of accommodation to a different hotel.

[1982] The terminal sends the user's change request to the server.

[1983] The server regenerates the final plan reflecting the requested changes and verifies that the conditions are met.

[1984] The server will make flight and hotel reservations based on the final confirmed plan.

[1985] Real-time navigation and support

[1986] The server provides real-time information during the trip, such as public transport timetables and access information to tourist spots.

[1987] The server uses an emotion engine to monitor the user's emotional state while traveling, and if it detects stress or other conditions, it will present relaxation spots and support information.

[1988] The device displays this information to the user in real time and guides them to their next destination and means of transportation.

[1989] Example prompt sentences

[1990] For family trips:

[1991] "I'm planning a seven-day trip to Tokyo for my family of four. My budget is 300,000 yen, and the emotion engine detected "expectations" when I entered the information. I'd like the app to generate an optimal itinerary that includes family-friendly tourist spots."

[1992] For business travel:

[1993] "I'm planning a two-day trip for a business meeting in Tokyo. My budget is 150,000 yen, and the emotion engine detected 'tension' when I entered it. I'd like the app to generate an optimal itinerary including business-friendly hotels and transportation."

[1994] In this way, the system of the present invention takes into account the user's feelings, flexibly changes the travel plan, and provides support in real time.

[1995] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1996] Step 1:

[1997] Users input details about their trip, such as destination, itinerary, budget, and preferences, via PC or smartphone, as well as their emotional state. Specific input examples include "Planning a family trip to Tokyo for 7 days, budget 300,000 yen, preferring family-friendly tourist spots, emotional state is anticipation."

[1998] Input: Travel destination, dates, budget, preferences, emotional state

[1999] Output: Formatted request data (e.g., JSON format)

[2000] The device formats the input information and sends a request including emotion data to the server.

[2001] Step 2:

[2002] The server analyzes the received user information, specifically extracting travel destination, itinerary, budget, preferences, and emotional state from the received data and passing them to the analysis module.

[2003] Input: Formatted request data (e.g., JSON format)

[2004] Output: Analysis results (travel destination, schedule, budget, preferences, emotional state)

[2005] The server uses an internal database and external APIs (such as Google Maps API, TripAdvisor API) to collect relevant travel data and store it in temporary storage.

[2006] Input: Analysis results

[2007] Output: Collected travel data (transportation, accommodation, tourist destination information)

[2008] Step 3:

[2009] The server filters the collected travel data based on the user's criteria, extracting available options within the user's budget and filtering based on the user's input and emotional state.

[2010] Input: Collected travel data

[2011] Output: filtered trip data

[2012] The server then prioritizes the filtered data based on the user's preferences and emotional state: for example, if a user expresses "expectations," family-friendly tourist destinations and accommodations will be displayed at the top.

[2013] Input: filtered travel data, user conditions and emotional state

[2014] Output: prioritized trip data

[2015] Step 4:

[2016] The server then uses the prioritized data to generate an optimal travel plan, specifically a detailed itinerary including flights, hotels, and attractions.

[2017] Input: Prioritized travel data

[2018] Output: Generated itinerary

[2019] The server formats the generated itinerary and sends it to the terminal in a user-friendly format.

[2020] Step 5:

[2021] The device displays the generated itinerary to the user, including a detailed description and a breakdown of costs. The user can review the itinerary and make changes or additions as needed, such as changing the accommodation to a different hotel.

[2022] Input: Generated itinerary

[2023] Output: User change request

[2024] The user reviews the proposed plan and notifies the device of any necessary changes, which are then sent back to the server.

[2025] Step 6:

[2026] The server regenerates the final plan reflecting the user's changes and verifies that all conditions are met. The server confirms the final plan that meets all conditions and books flights and accommodations.

[2027] Input: User change request

[2028] Output: Final confirmed plan

[2029] Step 7:

[2030] During the trip, the server provides real-time information on public transport timetables and access to tourist attractions. In addition, the emotion engine monitors the user's emotional state during the trip and presents support information such as relaxation spots if a stressful situation is detected.

[2031] Input: Real-time data, emotional state

[2032] Output: Real-time navigation information, support information

[2033] The device displays this real-time information to the user and guides them to their next destination and means of transportation.

[2034] Input: Real-time navigation information, support information

[2035] Output: Information presented to the user

[2036] The above are the specific processing steps of the program.

[2037] (Application example 2)

[2038] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2039] Conventional food delivery systems are unable to provide optimal ordering suggestions based on the user's emotional state, making it difficult to fully increase user satisfaction. Furthermore, there is a lack of a way for users to automatically generate optimal plans based on their budget, preferences, and delivery time, making it difficult to achieve an efficient ordering process.

[2040] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for receiving information regarding delivery destination, delivery time, budget, and preferences entered by the user; means for collecting related information such as delivery destination restaurants, dishes, and delivery services from a database or external API based on the received information; means for filtering and prioritizing the collected information based on the user's conditions and emotional state; means for automatically generating an optimal food delivery plan based on the filtered and prioritized information; and means for presenting the generated food delivery plan to the user. This makes it possible to propose a food delivery plan customized according to the user's emotional state.

[2041] "Delivery destination" is information indicating the location where the user wants to receive food delivery.

[2042] "Delivery time" is information indicating the estimated arrival time of the food delivery desired by the user.

[2043] "Budget" is information that indicates the amount of money a user can spend on food delivery.

[2044] "Preferences" refers to information that indicates the user's preferences and predilection for ingredients, cuisine, and restaurants.

[2045] "Means for receiving information" refers to the functionality of the device or software that allows information entered by the user regarding delivery destination, delivery time, budget, and preferences to be input into the system.

[2046] "Means of collection" refers to the functionality of the device or software that allows the system to obtain the relevant information it needs from a database or external API.

[2047] "Filtering and prioritization means" refers to the device or software functions that sort and sort collected information based on the user's criteria and emotional state.

[2048] "Means for automatic generation" refers to the functionality of a device or software that automatically creates an optimal food delivery plan based on filtered and prioritized information.

[2049] The "means for presenting" refers to the function of the device or software that displays the generated food delivery plan to the user and allows the user to confirm or customize it.

[2050] The system for implementing this invention aims to automatically generate and provide an optimal food delivery plan based on the user's emotional state. This system is mainly composed of components such as a server, a user terminal, and an emotion engine.

[2051] System Configuration

[2052] User Device

[2053] A device, such as a smartphone, where a user inputs information and receives a food delivery plan. The user device provides a form for inputting information about delivery destination, delivery time, budget, and preferences, and processes and transmits the input to a server.

[2054] server

[2055] The server analyzes the received user information and collects relevant information from the database and external APIs. It uses an emotion engine to analyze the user's emotional state, filters and prioritizes data based on the results, and automatically generates an optimal food delivery plan and sends it to the user's device.

[2056] Emotion Engine

[2057] The emotion engine recognizes the emotional state of the user from their input and voice data and reflects this in the food delivery plan, using software such as IBM Watson and Affectiva for sentiment analysis.

[2058] Processing steps

[2059] Receiving and analyzing

[2060] The server analyzes the information received from the user's device, such as delivery destination, delivery time, budget, and preferences, and uses an emotion engine to analyze the user's emotional state and stores the analysis results in a database.

[2061] Data collection

[2062] The server collects information on restaurants, dishes, and delivery services that match the user's criteria from external APIs and internal databases, and the collected data is temporarily stored on the server.

[2063] Filtering and Prioritization

[2064] The server filters the collected data based on the user's conditions (budget, preferences) and emotional state, and prioritizes and selects the most appropriate information based on the user's emotions.

[2065] Generate a plan

[2066] The server automatically generates the optimal food delivery plan based on the filtered and prioritized information, specifically creating a customized plan that combines food selection, restaurant, and delivery time.

[2067] Presenting and confirming the plan

[2068] The generated food delivery plan is formatted in a user-friendly format and sent to the user's device. The user can review the plan and customize it as needed. The final plan is confirmed by the server, and the order is sent to the restaurant.

[2069] Specific examples

[2070] Example of a tired user

[2071] Let's say a user requests "pizza" in the input form, with a budget of "2,000 yen" and a delivery time of "within 30 minutes." The emotion engine analyzes the user's emotional state as "tired." In this case, the app will prioritize restaurants that serve pizza suitable for relaxation and adjust the delivery time to suit the user's preferences.

[2072] Prompt Sentence Examples

[2073] Information you enter:

[2074] Cuisine: Pizza

[2075] Delivery time: within 30 minutes

[2076] Budget: 2000 yen

[2077] Emotion-based suggestions:

[2078] The emotion engine detects that the user is tired and suggests a restaurant that serves pizza, perfect for relaxation.

[2079] The system will enable the provision of customized food delivery plans based on the user's emotional state.

[2080] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2081] Step 1:

[2082] The user inputs information about the delivery address, delivery time, budget, and preferences. The input information also includes the user's emotional state. The input data is organized and formatted by the device. Specifically, the user provides this information using a smartphone application by text input or voice input. This results in the input data of the delivery address, delivery time, budget, preferences, and emotional state.

[2083] Step 2:

[2084] The device sends the input information to the server. The emotion engine also works at the same time, analyzing the user's emotional state from their voice and text data. The analysis results are sent to the server. Specifically, the device sends this data to the server using an HTTP request. The output is JSON data that includes the user's delivery address, delivery time, budget, preferences, and emotional state.

[2085] Step 3:

[2086] The server analyzes the received data and collects relevant information. The server collects information about the restaurant, food, and delivery service from a database and external APIs. Specifically, the server retrieves data using SQL queries and API requests. Through this process, the server collects information related to the delivery destination, delivery time, budget, preferences, and emotional state.

[2087] Step 4:

[2088] The server filters the collected data and prioritizes it based on the user's criteria and emotional state. The filtering selects only information that matches the user's budget, preferences, and delivery time. Then, it sets priorities based on the emotional state. Specifically, the server uses an algorithm based on the output of the emotion engine to filter and sort the data. The output is an optimized list of candidate information.

[2089] Step 5:

[2090] The server automatically generates an optimal food delivery plan based on the filtered and prioritized information. The generated plan includes specific dishes, restaurants, and delivery times. Specifically, the server combines this information and constructs the plan in a user-friendly format. The output is the optimal food delivery plan data.

[2091] Step 6:

[2092] The server sends the generated food delivery plan to the user terminal. Specifically, the server uses an HTTP response to send the plan data to the user terminal. This allows the user terminal to receive the plan and present it to the user.

[2093] Step 7:

[2094] The user reviews the presented food delivery plan and customizes it as necessary. The device then sends the user's change request back to the server. Specifically, the user edits each element of the plan on the application, saves the results, and sends them to the server. The output is the customized food delivery plan data.

[2095] Step 8:

[2096] The server regenerates the final plan reflecting the user's customized requirements and ensures that all conditions are met. Specifically, the server runs the filtering, prioritization, and plan generation processes again. The output is the final food delivery plan data.

[2097] Step 9:

[2098] The server determines various services based on the final plan and arranges delivery. Specifically, the server sends the order to the restaurant and processes the delivery service. The output is the determined order information and delivery arrangement information.

[2099] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2100] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2101] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2102] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2103] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2104] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2105] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2106] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2107] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2108] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2109] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2110] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2111] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2112] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2113] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2114] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2115] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2116] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2117] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2118] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2119] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2120] The following is further disclosed regarding the above embodiment.

[2121] (Claim 1)

[2122] means for receiving information about travel destination, itinerary, budget, and preferences entered by a user;

[2123] Based on the received information, a means for collecting relevant information such as transportation, accommodation, and tourist attractions at the travel destination from a database or external API;

[2124] A means for filtering and prioritizing the collected information based on user criteria; and

[2125] A means for automatically generating optimal travel plans based on the filtered and prioritized information;

[2126] means for presenting the generated travel plan to a user;

[2127] A system including:

[2128] (Claim 2)

[2129] 10. The system of claim 1, further comprising means for customizing a travel plan submitted by a user, finalizing the plan, and making a reservation.

[2130] (Claim 3)

[2131] 10. The system of claim 1, further comprising means for providing real-time navigation and support information to the user during the trip.

[2132] "Example 1"

[2133] (Claim 1)

[2134] means for receiving information about travel destination, itinerary, budget, and preferences entered by a user;

[2135] A means of formatting the received information into JSON format and sending it to the server;

[2136] Based on the received information, a means for collecting relevant information such as transportation, accommodation, and tourist attractions at the travel destination from a database or external API;

[2137] A means for analyzing the collected information and filtering and prioritizing it based on user criteria;

[2138] A method to automatically generate optimal travel plans based on filtered and prioritized information and convert them into JSON format;

[2139] A means for formatting the generated travel plan in a user-friendly UI format and sending and displaying it on the user's device;

[2140] A system including:

[2141] (Claim 2)

[2142] 10. The system of claim 1, further comprising means for customizing the travel plan submitted by the user, regenerating a final plan based on the resubmitted information, and confirming and booking the reservation.

[2143] (Claim 3)

[2144] 10. The system of claim 1, further comprising means for obtaining navigation information from an external API and for determining a user's current location using a GPS function to provide the user with real-time navigation and support information during the trip.

[2145] "Application Example 1"

[2146] (Claim 1)

[2147] means for receiving information about travel destination, itinerary, budget, and preferences entered by a user;

[2148] Based on the received information, a means for collecting relevant information such as transportation, accommodation, and tourist attractions at the travel destination from a database or external API;

[2149] A means for filtering and prioritizing the collected information based on user criteria; and

[2150] A means for automatically generating optimal travel plans based on the filtered and prioritized information;

[2151] means for presenting the generated travel plan to a user;

[2152] a means for providing a travel experience in a virtual space through a virtual reality device based on user preferences;

[2153] A system including:

[2154] (Claim 2)

[2155] 10. The system of claim 1, further comprising means for customizing a travel plan submitted by a user, finalizing the plan, and making a reservation.

[2156] (Claim 3)

[2157] 10. The system of claim 1, further comprising means for providing real-time navigation and support information to the user during the trip.

[2158] "Example 2: Combining Emotion Engines"

[2159] (Claim 1)

[2160] means for receiving information input by a user regarding travel destination, itinerary, budget, preferences, and emotional state;

[2161] means for collecting relevant information such as transportation, accommodation, and tourist attractions of the travel destination from a database or an external interface based on the received information and emotional state;

[2162] means for filtering and prioritizing the collected information based on the user's condition and emotional state;

[2163] A means for automatically generating an optimal travel plan based on the filtered and prioritized information; and

[2164] means for presenting the generated travel plan to a user;

[2165] A system including:

[2166] (Claim 2)

[2167] 10. The system of claim 1, further comprising means for customizing a travel plan submitted by a user, finalizing the plan, and making a reservation.

[2168] (Claim 3)

[2169] 10. The system of claim 1, further comprising means for providing real-time route guidance and assistance information to the user during the trip.

[2170] "Application example 2 when combining emotion engines"

[2171] (Claim 1)

[2172] means for receiving information entered by a user regarding delivery destination, delivery time, budget, and preferences;

[2173] A means for collecting relevant information such as the restaurant, food, and delivery service from a database or external API based on the received information;

[2174] means for filtering and prioritizing the collected information based on the user's condition and emotional state;

[2175] A means for automatically generating optimal food delivery plans based on filtered and prioritized information;

[2176] A means for presenting the generated food delivery plan to the user;

[2177] A system including:

[2178] (Claim 2)

[2179] 10. The system of claim 1, further comprising means for customizing the food delivery plan submitted by the user, finalizing the plan, and placing the order.

[2180] (Claim 3)

[2181] ...

Claims

1. means for receiving information about travel destination, itinerary, budget, and preferences entered by a user; Based on the received information, a means for collecting relevant information such as transportation, accommodation, and tourist attractions at the travel destination from a database or external API; A means for filtering and prioritizing the collected information based on user criteria; and A means for automatically generating optimal travel plans based on the filtered and prioritized information; means for presenting the generated travel plan to a user; A system including:

2. 10. The system of claim 1, further comprising means for customizing a travel plan submitted by a user, finalizing the plan, and making a reservation.

3. 10. The system of claim 1, further comprising means for providing real-time navigation and support information to the user during the trip.

Images