system

Abstract

A system is provided.SOLUTION: A system comprising: means for receiving travel detail information input by a user; means for transmitting the received travel detail information to a server; means for generating optimal travel plan candidates by referring to an internal database or an external API based on the information received by the server; means for evaluating the generated travel plan candidates and determining a most suitable travel plan; and means for transmitting the determined travel plan to a terminal and displaying the travel plan to the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] When planning a trip, many people need to arrange a wide range of factors, such as accommodation, transportation, activities, and meals, and comparing and considering each of these can be extremely time-consuming. This can also be a major obstacle for people who are not good at arranging trips or who are short on time. These issues can prevent them from finding the optimal travel plan, resulting in lower travel satisfaction. The objective of this invention is to automatically provide efficient and optimal travel plans to people who have difficulty planning trips and face these challenges. [Means for solving the problem]

[0005] The travel plan creation support system of the present invention includes: means for receiving detailed travel information entered by a user; means for transmitting the received detailed travel information to a server; means for referencing an internal database or external API based on the information received by the server to generate optimal travel plan candidates; means for evaluating the generated travel plan candidates and determining the most suitable travel plan; and means for transmitting the determined travel plan to a terminal and displaying it to the user. This system allows users to easily obtain the optimal travel plan simply by entering the necessary information, enabling efficient travel planning.

[0006] "User" means a person who uses the System to create a travel plan.

[0007] "Travel details" refers to all information related to the trip, such as travel timing, budget, travel companion information, and points of interest.

[0008] "Terminal" means the device (e.g., PC, smartphone, tablet) through which a User enters their travel details and communicates with the Server.

[0009] "Server" refers to the central system that analyzes the received data and generates and evaluates the itinerary.

[0010] "Internal database" refers to data storage that stores data used within the system.

[0011] An "external API" refers to an application programming interface for accessing external services or databases and obtaining necessary information.

[0012] "Best-fit itinerary candidates" refers to multiple itineraries generated based on the details entered by the user.

[0013] "Evaluation" refers to the process of comparing and analyzing the generated travel plan options and selecting the one that best meets the user's preferences.

[0014] "Travel Plan" means a plan that includes detailed travel arrangements, including accommodation, transportation, activities, and meals.

[0015] "Display" refers to visually presenting the contents of the generated travel plan on the user's terminal. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] The present invention relates to a travel plan creation support system that allows users to easily obtain efficient and optimal travel plans. The system includes a terminal where users input detailed travel information, a server that processes and analyzes the input information, and a series of means for presenting optimal travel plans to users.

[0038] First, users enter details about their trip, including travel timing, budget, travel companions, and preferences, into an input form on the device. These details might include, for example, "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[0039] The device then sends the entered information to the server, where it is converted to JSON format and sent as an HTTP request.

[0040] The server analyzes the received data and generates optimal travel plan suggestions by referencing an internal database or external API. In the process, it obtains a list of hotels that match the travel timing, a list of transportation options that fit within the budget, and a list of facilities and services that match the user's preferences.

[0041] The server then generates multiple candidate plans based on the acquired information and evaluates each one. During the evaluation process, a generative AI model is used to select the travel plan that best suits the user's input requirements. This selection process takes into account factors such as hotel ratings, transportation convenience, and the attractiveness of activities.

[0042] Finally, the server sends the optimized itinerary to the terminal, which then displays the detailed itinerary to the user, including specific hotel names, transportation options, prices, and activity details.

[0043] For example, if a user inputs criteria such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location," the server will search for and evaluate the best hotels, transportation options, and activities based on these criteria, and generate and present the following itinerary:

[0044] Hotel name: Mountain Resort Hotel

[0045] Transportation: Private car (free parking) or local rental car

[0046] Activities: Nature walks, hiking, local attractions

[0047] Price: 95,000 yen (breakfast buffet included, pets allowed)

[0048] In this way, the system provides users with efficient and optimal travel plans and simplifies their planning.

[0049] The processing flow will be explained below.

[0050] Step 1:

[0051] Users enter detailed information about their trip into an input form on their device, such as travel timing, budget, travel companions, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains, etc.).

[0052] Step 2:

[0053] The terminal converts the information entered by the user into JSON format, which is then sent to the server as an HTTP request.

[0054] Step 3:

[0055] The server receives the HTTP request and parses the JSON data, which is then recognized as travel timing, budget, travel companion information, and preferences.

[0056] Step 4:

[0057] The server retrieves the following information from an internal database or external API:

[0058] A list of hotels available at a given time

[0059] A list of transportation options available within your budget

[0060] A list of activities and services that match your preferences

[0061] Step 5:

[0062] The server generates optimal travel plan candidates based on the acquired information, including combinations of multiple hotels, transportation options, and activities.

[0063] Step 6:

[0064] The server evaluates the generated candidate plans to select the plan that best meets the user's requirements. Evaluation criteria include hotel ratings, convenience of transportation, and attractiveness of activities.

[0065] Step 7:

[0066] The server selects the travel plan with the highest rating and generates the data in JSON format, which is then sent to the user's device as an HTTP response.

[0067] Step 8:

[0068] The device then analyzes the received itinerary data and displays a detailed itinerary to the user, including hotel information, transportation options, fares, and a list of activities.

[0069] Step 9:

[0070] Users can check the displayed travel plans and make reservations or arrangements as necessary. Through all these steps, users can easily obtain an efficient and optimal travel plan.

[0071] Example 1

[0072] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0073] When planning a trip, users must consider various factors and gather a lot of information, which takes time and effort, making it difficult to find the best plan.

[0074] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0075] In this invention, the server includes means for receiving detailed travel information entered by a user, means for converting the received detailed travel information into JSON format and sending it to the server as an HTTP request, means for the server to analyze the received information, refer to an internal database or an external API, and generate optimal travel plan candidates, means for evaluating the generated travel plan candidates using a generative AI model and determining the most suitable travel plan, and means for sending the determined travel plan to a terminal and displaying it to the user, thereby enabling the user to easily and quickly find the optimal travel plan.

[0076] "User" refers to any individual or organization that uses the System to create travel plans.

[0077] "Travel details" refers to specific information about the trip entered by the user, such as travel timing, budget, travel companion information, and points of interest.

[0078] "Terminal" refers to a device such as a computer or smartphone through which a user enters travel details and exchanges information with the server.

[0079] "JSON format" stands for JavaScript Object Notation and refers to a lightweight data exchange format that is easy for humans and machines to read.

[0080] An "HTTP request" refers to the way a client requests data from a server using the Hypertext Transfer Protocol.

[0081] "Server" refers to the equipment or system that receives and processes information sent by users and generates and evaluates optimal travel plans by referencing internal databases or external APIs.

[0082] "Internal database" refers to a database stored within the server, which stores various information used to create travel plans.

[0083] An "external API" refers to an application programming interface provided by an external service, and is an interface that allows a server to communicate with an external service and obtain information.

[0084] "Candidate travel plans" refers to multiple travel plan options generated by the server based on the information analyzed.

[0085] "Generative AI model" refers to an algorithm or computational model that uses artificial intelligence technology to evaluate potential travel plans and select the best one.

[0086] "Send to terminal" refers to the act of sending the travel plan generated by the server to the user's terminal as data.

[0087] "Display to user" refers to the act of presenting the transmitted travel plan in a form that can be viewed by the user on the device.

[0088] The present invention relates to a travel plan creation support system that allows users to easily obtain efficient and optimal travel plans. The system includes a terminal where users input detailed travel information, a server that processes and analyzes the input information, and a series of means for presenting optimal travel plans to users.

[0089] First, the user enters detailed information about the trip into the device. These details include the timing of the trip, budget, travel companions, and points of interest. Specifically, the user enters conditions such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[0090] The device then converts the input information into JSON format and sends it to the server as an HTTP request. The software used by the device can include Python, JavaScript, or an HTTP client library.

[0091] The server analyzes the information it receives and generates optimal travel plan suggestions by referencing an internal database or external API. The software used by the server includes an SQL database (e.g., MySQL) and an API management tool (e.g., Postman). This process obtains a list of hotels that match the travel timing, a list of transportation options available within the budget, and a list of facilities and services that match the customer's preferences.

[0092] The server then uses a generative AI model to generate multiple candidate plans based on the acquired information and evaluates each plan. This evaluation process selects the travel plan that best fits the user's input requirements. Specifically, it takes into account hotel ratings, the convenience of transportation, and the attractiveness of activities. The AI ​​model used by the server includes PyTorch and TensorFlow.

[0093] Finally, the server sends the optimized itinerary to the device, which then displays the detailed itinerary to the user, including specific hotel names, transportation options, prices, and activity details. The software used by the device includes a web browser (e.g., Google Chrome) and a display framework (e.g., React.js).

[0094] For example, if a user inputs criteria such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location," the server will search for and evaluate the best hotels, transportation options, and activities based on these criteria, and generate and present the following itinerary:

[0095] Hotel name: Mountain Resort Hotel

[0096] Transportation: Private car (free parking) or local rental car

[0097] Activities: Nature walks, hiking, local attractions

[0098] Price: 95,000 yen (breakfast buffet included, pets allowed)

[0099] Example prompt for a generative AI model:

[0100] Please suggest the best travel plan based on "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[0101] In this way, the system can provide users with efficient and optimal travel plans and simplify their travel planning.

[0102] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0103] Step 1:

[0104] The user enters the details of the trip into the terminal.

[0105] Examples of input: "Mid-August," "Budget 100,000 yen," "Family of 4," "Breakfast buffet," "Pet-friendly hotel," "Mountain location," etc.

[0106] The terminal receives this information and stores it temporarily in its internal memory.

[0107] Step 2:

[0108] The terminal converts the information received from the user into JSON format and sends it to the server as an HTTP request.

[0109] The software used is Python, JavaScript, or an HTTP client library.

[0110] Input: Trip details entered by the user

[0111] Data processing: Converting trip details into JSON format

[0112] Output: Trip details converted to JSON format

[0113] Example of operation: Generate and send JSON data like {"date":"Mid-August", "budget":100000, "companions":4, "preferences":["Breakfast buffet", "Pets allowed", "Mountain"]}.

[0114] Step 3:

[0115] The server parses the JSON data received from the terminal.

[0116] Analyze the contents of the JSON data and extract the necessary information.

[0117] Input: JSON data sent from the terminal

[0118] Data Operations: Parsing JSON data and extracting information

[0119] Output: Parsed trip details

[0120] Working example: Using Python's standard library, parse a JSON object and get the required information.

[0121] Step 4:

[0122] The server references an internal database or external API based on the analyzed information.

[0123] Get a list of hotels, transportation options, and activities that fit your travel timing, budget, and preferences.

[0124] Input: Parsed trip details

[0125] Data retrieval: using database queries and external API requests

[0126] Output: A list of hotels, transportation options, and activities.

[0127] Example of how it works: Executes a SQL query like SELECT FROM hotels WHERE location='mountain' AND pet_friendly=true to retrieve information from the database, and also makes an external API request to retrieve the latest information.

[0128] Step 5:

[0129] The server generates multiple travel plan options based on the acquired information.

[0130] A generative AI model is used to evaluate each candidate plan.

[0131] Input: List of retrieved hotels, transportation options, and activities

[0132] Data Computing: Generating and Evaluating Travel Plans Using Generative AI Models

[0133] Output: Multiple itinerary candidates with high rating scores

[0134] Example of operation: For each candidate plan, the AI ​​model calculates a score like {"hotel_score":8.5, "transportation_score":9.0, "activity_score":9.2}, and the plan with the highest overall rating is selected.

[0135] Step 6:

[0136] The server converts the optimal travel plan into JSON format and sends it to the terminal.

[0137] Input: Highest rated itinerary

[0138] Data processing: Convert travel plans into JSON format

[0139] Output: Optimal travel plans converted to JSON format

[0140] Example of operation: Generate and send data such as {"hotel_name":"Mountain resort hotel", "transportation":"Private car", "total_cost":95000, "activities":["Nature walk", "Hiking"]}.

[0141] Step 7:

[0142] The terminal displays the optimal travel plan received from the server to the user.

[0143] Input: JSON travel plan data received from the server

[0144] Data processing: Convert JSON data to HTML format

[0145] Output: A user-visible representation of the itinerary

[0146] Example of operation: Display details on a web page such as "Hotel name: Mountain resort hotel", "Transportation method: Private car", "Total cost: 95,000 yen", and "Activities: Nature walks, hiking".

[0147] Through the above steps, users can efficiently obtain the optimal travel plan and simplify their travel planning.

[0148] (Application example 1)

[0149] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0150] Conventional travel planning systems only present optimal travel plans based on detailed information entered by the user, but have the problem of not allowing users to virtually experience the travel destination. As a result, users have no way to experience whether the proposed travel plan actually matches their preferences, which can lead to a decrease in satisfaction and the hassle of changing plans. Therefore, there is a need for a function that allows users to virtually experience a travel destination before actually visiting it.

[0151] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0152] In this invention, the server includes means for receiving detailed travel information entered by a user, means for transmitting the received detailed travel information to the server, means for referencing an internal database or an external API based on the information received by the server to generate optimal travel plan candidates, means for evaluating the generated travel plan candidates and determining the most suitable travel plan, means for transmitting the determined travel plan to a terminal and displaying it to the user, and means for providing a virtual tour function that allows the user to virtually experience a travel destination, thereby enabling the user to virtually experience a travel destination before actually visiting and select a plan that suits their preferences.

[0153] "User" means any person who uses the System to input travel details and obtain optimal travel plans.

[0154] "Travel details" refers to all data about the trip entered by the user, such as travel timing information, budget information, travel companion information, and preference information.

[0155] "Server" refers to the computer system that processes and analyzes the travel details received from the user and generates optimal travel plan suggestions by referencing an internal database or external API.

[0156] An "internal database" is a database stored on a server that contains hotel information, transportation information, and the like used to generate travel plans.

[0157] "External API" means an interface to an external data source that the server accesses to obtain information needed to generate a travel itinerary.

[0158] "Best itinerary suggestions" means multiple itinerary suggestions generated based on the details entered by the user.

[0159] "Evaluation" refers to the process of comparing the generated travel plan candidates and selecting the plan that best suits the user.

[0160] "Determined Travel Plan" means the most suitable travel plan selected based on the evaluation.

[0161] "Terminal" means the device through which a User enters their travel details and on which their travel plans are ultimately displayed.

[0162] The "virtual tour function" allows users to virtually experience a travel destination before actually visiting it.

[0163] The present invention relates to a system that allows users to easily obtain efficient and optimal travel plans. The system includes a terminal where users input detailed travel information, a server that processes and analyzes the input information, and a series of means for presenting optimal travel plans to users.

[0164] First, the user enters detailed information about the trip using the device. These details include the timing of the trip, budget, travel companions, and preferences. For example, the user can enter conditions such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[0165] The device converts the entered details into JSON format and sends it as an HTTP request to the server. The server then analyzes the received information and generates optimal travel plan suggestions by referencing an internal database and external API. In the process, it obtains a list of accommodations that match the travel timing, a list of transportation options available within the user's budget, and a list of facilities and services that match the user's preferences.

[0166] The server evaluates the generated itinerary candidates and selects the one that best meets the user's requirements. This selection process takes into account hotel ratings, transportation convenience, and activity attractiveness. A generative AI model is used in this evaluation process. The generative AI model selects the itinerary that best meets the user's input criteria.

[0167] The selected itinerary is then sent back to the device from the server, where a detailed itinerary is displayed to the user, including specific accommodations, transportation options, prices, and activity details.

[0168] Furthermore, this system has a virtual tour function that allows users to virtually experience the travel destinations they want to visit. This function has the advantage of allowing users to visually check the validity of their travel plans before actually visiting them.

[0169] For example, if a user inputs criteria such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location," the server will search for and evaluate the best accommodations, transportation options, and activities based on these criteria, and generate and present the following itinerary:

[0170] Accommodation name: Mountain resort hotel

[0171] Transportation: Private car (free parking) or local rental car

[0172] Activities: Nature walks, hiking, local attractions

[0173] Price: 95,000 yen (breakfast buffet included, pets allowed)

[0174] An example prompt has the following format:

[0175] Generate a virtual travel plan. Please choose the best plan based on the following criteria:

[0176] Timing: Mid-August

[0177] Budget: 100,000 yen

[0178] Accompanying persons: 4 family members

[0179] Specialties: Breakfast buffet, pet-friendly hotel, mountain location

[0180] In this way, the system of the present invention provides users with efficient and optimal travel plans and simplifies the planning process.

[0181] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0182] Step 1:

[0183] The user uses the device to input detailed information about the trip, including the timing, budget, travel companions, and preferences. For example, "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[0184] Input: Travel timing, budget, travel companions, points of interest

[0185] Output: Trip details entered

[0186] Step 2:

[0187] The device converts the entered travel details into JSON format, then sends it to the server as an HTTP request. During this conversion and transmission process, the device formats the data and communicates with the network.

[0188] Input: Trip details entered by the user

[0189] Output: JSON format data sent to the server

[0190] Step 3:

[0191] The server then parses the trip details it receives, consulting internal databases and external APIs to retrieve a list of accommodations, transportation options, and activities that match the user's criteria.

[0192] Input: Trip details received from the device (JSON format)

[0193] Output: A list of accommodations, transportation options, and activities that match the user's criteria

[0194] Step 4:

[0195] The server generates multiple travel plan options based on the acquired information, processing the data to generate the best options based on travel timing, budget, and preferences.

[0196] Input: List of accommodations, transportation, and activities

[0197] Output: Multiple itinerary candidates generated

[0198] Step 5:

[0199] The server selects the optimal plan from the generated travel plan candidates using a generative AI model. This model evaluates the plan to select the one that best suits the user's input criteria.

[0200] Input: Multiple travel plan options

[0201] Output: The optimal travel plan selected by the generative AI model

[0202] Step 6:

[0203] The server converts the selected optimal travel plan back into JSON format and sends it to the terminal as an HTTP response. During this process, the server performs data conversion and sends the response.

[0204] Input: Selected optimal travel plan

[0205] Output: Optimized itinerary in JSON format sent to the device

[0206] Step 7:

[0207] The terminal visually displays the received optimal travel plan to the user, and also uses a virtual tour function to allow the user to virtually experience the proposed travel destinations. This function allows the user to visually confirm the validity of the travel plan.

[0208] Input: Optimal travel plan received from the server (JSON format)

[0209] Output: A concrete itinerary and virtual tour experience displayed to the user

[0210] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0211] This invention combines an emotion engine with a travel plan creation support system that enables users to easily obtain efficient and optimal travel plans. This system includes a terminal where users input detailed travel information, a server that processes and analyzes the input information, and a series of means for presenting optimal travel plans to users, and further includes an emotion engine that recognizes the user's emotions and adjusts the plan accordingly.

[0212] First, the user enters detailed information about the trip into an input form on the device, such as the timing of the trip, budget, travel companions, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains, etc.).

[0213] The emotion engine also works to analyze the user's emotions in real time from their facial expressions and voice. The analyzed emotions are classified into categories such as "happiness," "surprise," and "anxiety." This information is included in the trip details sent from the device to the server.

[0214] Next, the device converts the information entered by the user and the emotional data obtained by the emotion engine into JSON format and sends it to the server as an HTTP request.

[0215] The server receives the HTTP request and parses the JSON data, which is then recognized as travel timing, budget, travel companion information, preferences, and even user sentiment.

[0216] The server retrieves the following information from an internal database or external API:

[0217] A list of hotels available at a given time

[0218] A list of transportation options available within your budget

[0219] A list of activities and services that match your preferences

[0220] The server generates optimal travel plan candidates based on the acquired information. This process also takes into account the user's emotional data. For example, if the user expresses anxiety, plans that include elements that reduce stress will be evaluated. Conversely, if the user expresses joy, plans that include elements that reinforce that emotion will be prioritized.

[0221] The server then evaluates the generated candidate plans and selects the most suitable one. The evaluation process relies on data from the emotion engine, such as hotel ratings, transportation convenience, activity attractiveness, and adjustments based on the user's emotion data.

[0222] Finally, the server sends the optimized itinerary to the device, which then analyzes the received itinerary data and displays a detailed itinerary to the user, including hotel information, transportation options, fares, and a list of activities.

[0223] For example, if a user specifies the following in their input method:

[0224] "Travel timing: Mid-August"

[0225] "Budget: 100,000 yen"

[0226] "Family of 4"

[0227] "Breakfast buffet"

[0228] "Pet-friendly hotel"

[0229] "Mountain location"

[0230] Furthermore, if the emotion engine detects the emotion of "anxiety" while the user is typing, the server will take that into consideration and provide a plan that includes a relaxing environment and reassuring services. As a result, the following travel plan will be generated and presented to the user:

[0231] Hotel name: Mountain Relax Resort Hotel

[0232] Transportation: Private car (free parking) or local rental car

[0233] Activities: Nature walks, hiking, local attractions

[0234] Price: 95,000 yen (breakfast buffet included, pets allowed)

[0235] In this way, the system provides optimal travel plans that take the user's emotions into account and simplifies the planning process.

[0236] The processing flow will be explained below.

[0237] Step 1:

[0238] The user enters the details of the trip into the input form on the terminal, such as the timing of the trip, budget, travel companion information, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains).

[0239] Step 2:

[0240] The device acquires the user's input information. The emotion engine then analyzes the user's emotions in real time from their facial expressions and voice when they input information. The emotion engine classifies emotions into categories such as "happiness," "surprise," and "anxiety."

[0241] Step 3:

[0242] The device converts the acquired travel details and the emotion data analyzed by the emotion engine into JSON format, and then sends the converted data to the server as an HTTP request.

[0243] Step 4:

[0244] The server receives the HTTP request and parses the JSON data, which is then recognized as travel timing, budget, travel companion information, preferences, and user sentiment information.

[0245] Step 5:

[0246] The server retrieves the following information from an internal database or external API:

[0247] A list of hotels available at a given time

[0248] A list of transportation options available within your budget

[0249] A list of activities and services that match your preferences

[0250] Step 6:

[0251] The server generates optimal travel plan candidates based on the acquired information. In this process, it takes into account the user's emotional data. For example, if the user expresses anxiety, it will prioritize plans that include a relaxing environment and reassuring services. Conversely, if the user expresses joy, it will prioritize plans that reinforce those emotions.

[0252] Step 7:

[0253] The server evaluates the generated candidate plans. The evaluation process includes adjustments based on hotel rating scores, transportation convenience, activity attractiveness, and user sentiment data. The server uses an AI model to evaluate and select the most suitable travel plan.

[0254] Step 8:

[0255] The server determines the optimal travel plan based on the ratings and generates the data in JSON format, which is then sent to the user's device as an HTTP response.

[0256] Step 9:

[0257] The device then analyzes the received itinerary data and displays a detailed itinerary to the user, including specific hotel names, transportation options, prices, and activity details.

[0258] Step 10:

[0259] The user can then review the displayed itinerary and make reservations or arrangements as necessary. Through all these steps, the user can obtain an efficient and optimal itinerary that is tailored based on their emotions.

[0260] Example 2

[0261] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0262] Conventional travel planning systems do not take user emotions into account when generating plans, which leaves the user experience unsatisfied. In particular, plans that ignore users' emotions, such as anxiety and joy, make it difficult to provide an optimal travel experience. Furthermore, conventional systems create plans based solely on detailed information provided by the user, which means they cannot fully satisfy the user's complex needs and desires.

[0263] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving detailed travel information entered by the user and emotion data analyzed in real time, and generating optimal travel plan candidates by referencing an internal database or an external API; means for evaluating the generated travel plan candidates and determining the most suitable travel plan taking the user's emotion data into consideration; and means for transmitting the determined travel plan to the terminal and displaying it to the user. This makes it possible to provide an optimal travel plan that reflects the user's emotions, significantly improving the user experience.

[0264] 1. "User" means an entity that uses this system to make travel plans.

[0265] 2. "Travel details" refers to information about travel plans provided by users, such as travel timing, budget, travel companion information, and points of interest.

[0266] 3. "Emotional data" refers to emotional information analyzed in real time from the user's facial expressions and voice, and is classified into categories such as "joy," "surprise," and "anxiety."

[0267] 4. "Terminal" means a device through which a user inputs travel details and transmits emotion data, including a PC, smartphone, tablet, etc.

[0268] 5. "Server" means an information processing device including hardware and software that receives detailed travel information and emotion data sent from a terminal and generates, evaluates, and determines the optimal travel plan based on this information.

[0269] 6. "Means for receiving" refers to the function by which the server receives detailed travel information and emotion data sent from the terminal.

[0270] 7. "Means of reference" refers to the function that allows the server to obtain the necessary data from an internal database or external API.

[0271] 8. "Means for generating potential itineraries" means the algorithms and processes for generating multiple itineraries based on the received information.

[0272] 9. "Means for evaluation" refers to a function for selecting the optimal plan from multiple generated travel plans based on the user's emotional data and other evaluation criteria.

[0273] 10. "Transmission means" is a function for transmitting the travel plan determined by the server to the terminal.

[0274] 11. "Display means" refers to the function by which the terminal visually presents the travel plan received by the terminal to the user.

[0275] 12. "Internal Database" means data storage that accumulates travel-related information for reference by the Server when generating travel plans.

[0276] 13. "External API" means an application program interface that allows a server to obtain necessary information from external services.

[0277] 14. "Accommodation information" refers to information about hotels, guesthouses, etc. that is used when creating travel plans.

[0278] 15. "Transportation Information" means information about the transportation options available during a trip.

[0279] 16. "Activity Information" means information about sightseeing and leisure activities that can be done at a travel destination.

[0280] The present invention is a travel plan creation support system that allows users to easily obtain efficient and optimal travel plans, and by combining it with an emotion engine, provides travel plans that take user emotions into consideration. The following describes in detail the embodiments of the present invention.

[0281] First, the user enters the details of their trip using a device (e.g., PC, smartphone, tablet). This information includes the timing of the trip, budget, travel companion information, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains). An emotion engine is then applied to detect the user's facial expressions and voice in real time. Emotion analysis is performed using facial recognition software (e.g., OpenCV) and voice analysis software (e.g., Google Speech-to-Text API), and the emotional data is classified into categories such as "happiness," "surprise," and "anxiety."

[0282] Next, the device converts the travel details entered by the user and the emotion data analyzed by the emotion engine into JSON format and sends it to the server as an HTTP request, using JavaScript or Python libraries to generate a JSON object and sending it to the server using the POST method.

[0283] The server processes the HTTP request received from the device and analyzes the JSON data sent. This analysis extracts travel timing, budget, travel companion information, preferences, and emotional data. A Python framework (e.g., Flask, Django) is used for analysis to parse the request data and extract various pieces of information.

[0284] The server then accesses an internal database (e.g. MySQL, PostgreSQL) or an external API (e.g. Google Places API, Skyscanner API) to retrieve the following information:

[0285] A list of accommodations available at a specified time

[0286] A list of transportation options available within your budget

[0287] A list of activities and services that match your preferences

[0288] The server then uses this information to generate optimal travel plan suggestions. It uses Python's Pandas and Numpy to process the data and apply algorithms to create an appropriate plan. It also takes into account the user's emotional data and incorporates elements that correspond to their emotions (e.g., relaxing elements if they indicate anxiety, exciting elements if they indicate joy) into the plan.

[0289] The generated itinerary candidates are evaluated based on emotional data and evaluation criteria (e.g., accommodation rating, convenience of transportation, attractiveness of activities). The most suitable itinerary is then selected. The server again sends the selected itinerary to the terminal as an HTTP response in JSON format.

[0290] The device parses the received itinerary data and displays a detailed itinerary to the user on the screen, clearly displaying accommodation information, transportation options, prices, and activity lists using HTML, CSS, and JavaScript.

[0291] For example, if the user enters the following criteria:

[0292] Travel time: Mid-August

[0293] Budget: 100,000 yen

[0294] family of 4

[0295] Breakfast buffet

[0296] Pet-friendly hotels

[0297] Mountain location

[0298] Furthermore, if the emotion engine detects the emotion of "anxiety," the server will take that into consideration and provide a plan that includes a relaxing environment and reassuring services. As a result, the following travel plan is generated and presented to the user:

[0299] Accommodation name: Mountain Relax Resort Hotel

[0300] Transportation: Private car (free parking) or local rental car

[0301] Activities: Nature walks, hiking, local attractions

[0302] Price: 95,000 yen (breakfast buffet included, pets allowed)

[0303] In this way, the system of the present invention provides an optimal travel plan that reflects the user's feelings, simplifying travel planning.

[0304] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0305] Step 1: User enters trip details

[0306] Users enter their trip schedule, budget, travel companion information, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains) into an input form on their device. At the same time, the emotion engine analyzes the user's facial expressions and voice, collecting emotional data in real time. Specifically, it uses a webcam and microphone to classify emotional data into categories such as "happiness," "surprise," and "anxiety" using facial recognition software (e.g., OpenCV) and voice analysis software (e.g., Google Speech-to-Text API). Input: Detailed trip information and the user's facial expressions and voice. Output: Detailed trip information and emotional data.

[0307] Step 2: The device sends the trip details and emotion data to the server.

[0308] The device converts the travel details entered by the user and the emotion data obtained by the emotion engine into JSON format and sends it to the server as an HTTP request. Specifically, it uses JavaScript or Python libraries to create a JSON object and sends it to the server using the POST method. Input: User's travel details and emotion data. Output: HTTP request sent to the server.

[0309] Step 3: The server receives and analyzes the user's travel details and emotion data.

[0310] The server receives the HTTP request sent from the device and parses the JSON data. Using a Python framework (e.g., Flask, Django), it parses the request data and extracts the travel timing, budget, travel companion information, points of interest, and emotional data. Input: JSON data sent as an HTTP request. Output: Parsed trip details and emotional data.

[0311] Step 4: The server retrieves the necessary information by consulting an internal database or external API.

[0312] The server queries an internal database (e.g., MySQL, PostgreSQL) or an external API (e.g., Google Places API, Skyscanner API) to retrieve a list of available accommodations for a specified time, transportation options available within a budget, and activities and services that match specific preferences. Input: Parsed trip details and sentiment data. Output: Retrieved accommodation information, transportation information, and activity information.

[0313] Step 5: The server generates optimal itinerary candidates

[0314] The server generates optimal travel plan candidates based on the acquired information. During this process, it uses Python libraries (e.g., Pandas, Numpy) to apply algorithms to process the data. It also takes into account the user's emotional data and generates a plan that includes elements that correspond to those emotions. Input: Acquired accommodation information, transportation information, activity information, and emotional data. Output: Multiple travel plan candidates.

[0315] Step 6: The server evaluates the generated itinerary candidates and selects the best one.

[0316] The server evaluates the generated travel plan candidates and selects the most suitable one. The evaluation process is based on emotional data and evaluation criteria (e.g., rating score of accommodation, convenience of transportation, attractiveness of activities). Input: Multiple travel plan candidates. Output: Selected optimal travel plan.

[0317] Step 7: The server sends the selected travel plan to the terminal.

[0318] The server sends the selected optimal travel plan to the terminal as an HTTP response in JSON format. Input: The selected optimal travel plan. Output: The HTTP response sent to the terminal.

[0319] Step 8: The device displays the received itinerary to the user.

[0320] The terminal analyzes the travel plan data received from the server and displays a detailed travel plan on the screen for the user. The display uses HTML, CSS, and JavaScript to visually show accommodation information, transportation options, fares, and activity lists. Input: Travel plan data sent as an HTTP response from the server. Output: A detailed travel plan displayed to the user.

[0321] Example: If the user enters the following criteria:

[0322] Travel time: Mid-August

[0323] Budget: 100,000 yen

[0324] family of 4

[0325] Breakfast buffet

[0326] Pet-friendly hotels

[0327] Mountain location

[0328] Furthermore, if the emotion engine detects the emotion of "anxiety," the server will take that into consideration and provide a plan that includes a relaxing environment and reassuring services. As a result, the following travel plan is generated and presented to the user:

[0329] Accommodation name: Mountain Relax Resort Hotel

[0330] Transportation: Private car (free parking) or local rental car

[0331] Activities: Nature walks, hiking, local attractions

[0332] Price: 95,000 yen (breakfast buffet included, pets allowed)

[0333] (Application example 2)

[0334] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0335] The present invention aims to provide a means for improving the in-store shopping experience. Conventional shopping systems often make it difficult for users to find an optimal plan that matches their emotions and preferences, resulting in a dissatisfying shopping experience. Furthermore, there is a problem in that appropriate measures cannot be taken when users feel anxious or stressed. Therefore, there is a need for a system that analyzes users' emotions in real time and adjusts the shopping plan accordingly.

[0336] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving detailed shopping information entered by the user, means for analyzing emotion data and adjusting the shopping plan based on the analysis results, and means for obtaining the adjusted shopping plan from an external API. This makes it possible to provide an optimal shopping plan based on the user's emotions.

[0337] "User" means a person who uses the system to create travel plans or shopping plans.

[0338] A "server" is a device that processes information received from users and generates and provides optimal plans by referencing external databases and APIs.

[0339] "Travel details" refers to all the information necessary for planning a trip, such as the timing of the trip, budget, travel companions, and points of interest.

[0340] "Emotional data" refers to information about emotions analyzed from the user's facial expressions and voice.

[0341] "Shopping Plan" means a suggestion that shows optimal shopping progression and choices when a user is shopping.

[0342] An "external API" is an interface for obtaining information by connecting with other systems or databases.

[0343] "Adjustment" refers to the process of optimizing a plan or proposal based on specific conditions and information.

[0344] To implement this invention, the following system configuration and program are required. The system mainly consists of a user terminal, a server, and an external API. In a specific embodiment of the invention, the user inputs detailed shopping or travel information into the terminal, and the input information is sent to the server. The server generates an optimal plan based on the received information and finally displays this plan on the user terminal. Furthermore, the generated plan is adjusted according to the user's emotions through analysis using an emotion engine.

[0345] Hardware and software configuration

[0346] The user terminals are devices such as smartphones and tablets, equipped with a screen for inputting travel and shopping details, a camera and microphone for capturing emotion data, and an emotion engine installed if necessary.

[0347] The server is a high-performance computer used for information analysis and data processing. Its main software components include "EmotionEngine" for emotion analysis, and "ShoppingAPI" and "TravelAPI" for generating shopping and travel plans. These APIs are used to connect with external databases and services to obtain the necessary information.

[0348] Specific examples

[0349] 1. Collecting User Input

[0350] The user uses the device to input detailed shopping information (store to visit, budget, desired product category, points of interest, etc.) For example, "Store: Department Store A," "Budget: 20,000 yen," "Category: Fashion," "Points of interest: Stylish jacket, casual shoes."

[0351] 2. Emotion Data Analysis

[0352] Using the device's camera and microphone, the user's real-time facial expressions and voice are analyzed, and emotional data such as "anxiety" and "joy" is obtained by the emotion engine.

[0353] 3. Sending data to the server

[0354] The shopping details and sentiment data entered by the user are converted into JSON format and sent to the server as an HTTP request.

[0355] 4. Plan generation and adjustment

[0356] The server analyzes the received data and generates an optimal shopping plan by referencing an external API. During this process, the plan is adjusted based on the user's emotional data. For example, if the emotional data indicates "anxiety," measures such as allocating time for consultation with a staff member may be included.

[0357] 5. Displaying the best plan to users

[0358] The adjusted optimal shopping plan is sent to the user's device and displayed to the user.

[0359] Prompt Sentence Examples

[0360] Generate the best shopping plan based on the following criteria:

[0361] 1. Shopping location: Department Store A

[0362] 2. Budget: 20,000 yen

[0363] 3. Product Category: Fashion

[0364] 4. User preferences: Stylish jackets, casual shoes

[0365] 5. User's current emotion: Anxiety

[0366] In the above-described embodiment, the present invention provides optimal shopping plans and travel plans according to the user's emotions.

[0367] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0368] Step 1:

[0369] The user uses the terminal to input detailed shopping information, including the store they plan to visit, their budget, product category, and preferences. For example, they might input information such as "Store: Department Store A," "Budget: 20,000 yen," "Category: Fashion," and "Preferences: A stylish jacket and casual shoes."

[0370] Input: Shopping details (store, budget, category, points of interest)

[0371] Output: User's shopping details stored on the device

[0372] Step 2:

[0373] The device's camera and microphone are used to analyze the user's real-time facial expressions and voice. The emotion engine acquires the user's emotional data (e.g., "anxiety" or "joy"), and emotional data is generated based on the analysis results.

[0374] Input: User's facial expressions and voice

[0375] Output: User emotion data (categories such as "anxiety" or "joy")

[0376] Step 3:

[0377] The shopping details entered by the user and the acquired sentiment data are converted into JSON format, which is then sent to the server as an HTTP request.

[0378] Input: Shopping details, emotion data

[0379] Output: JSON formatted data sent to the server

[0380] Step 4:

[0381] The server receives the HTTP request and parses the JSON data, which is then recognized as shopping details (store, budget, category, preferences) and sentiment data.

[0382] Input: JSON format data (shopping details, emotion data)

[0383] Output: Parsed shopping details, sentiment data

[0384] Step 5:

[0385] The server uses an external API (Shopping API) to generate optimal shopping plan suggestions based on the analyzed data. This process takes into account the user's emotional data. For example, if the user expresses "anxiety," elements with a relaxing effect will be added to the plan.

[0386] Input: Parsed shopping details, sentiment data

[0387] Output: Best shopping plan suggestions

[0388] Step 6:

[0389] The server evaluates the generated shopping plan candidates and determines the most suitable plan based on the emotional data. The evaluation criteria include general product information, price, special offers, and adjustments based on the user's emotional data.

[0390] Input: Optimal shopping plan candidates, sentiment data

[0391] Output: The best shopping plan

[0392] Step 7:

[0393] The server converts the most suitable shopping plan into JSON format and sends it to the user's device, where the user can view the displayed shopping plan.

[0394] Input: Best shopping plan

[0395] Output: Shopping plan sent to the user's device

[0396] Through these steps, users are provided with an optimal shopping plan that takes into account their emotional data in real time, improving their shopping experience.

[0397] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0398] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0399] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0400] [Second embodiment]

[0401] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0402] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0403] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0404] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0405] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0406] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0407] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0408] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0409] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0410] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0411] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0412] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0413] The present invention relates to a travel plan creation support system that allows users to easily obtain efficient and optimal travel plans. The system includes a terminal where users input detailed travel information, a server that processes and analyzes the input information, and a series of means for presenting optimal travel plans to users.

[0414] First, users enter details about their trip, including travel timing, budget, travel companions, and preferences, into an input form on the device. These details might include, for example, "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[0415] The device then sends the entered information to the server, where it is converted to JSON format and sent as an HTTP request.

[0416] The server analyzes the received data and generates optimal travel plan suggestions by referencing an internal database or external API. In the process, it obtains a list of hotels that match the travel timing, a list of transportation options that fit within the budget, and a list of facilities and services that match the user's preferences.

[0417] The server then generates multiple candidate plans based on the acquired information and evaluates each one. During the evaluation process, a generative AI model is used to select the travel plan that best suits the user's input requirements. This selection process takes into account factors such as hotel ratings, transportation convenience, and the attractiveness of activities.

[0418] Finally, the server sends the optimized itinerary to the terminal, which then displays the detailed itinerary to the user, including specific hotel names, transportation options, prices, and activity details.

[0419] For example, if a user inputs criteria such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location," the server will search for and evaluate the best hotels, transportation options, and activities based on these criteria, and generate and present the following itinerary:

[0420] Hotel name: Mountain Resort Hotel

[0421] Transportation: Private car (free parking) or local rental car

[0422] Activities: Nature walks, hiking, local attractions

[0423] Price: 95,000 yen (breakfast buffet included, pets allowed)

[0424] In this way, the system provides users with efficient and optimal travel plans and simplifies their planning.

[0425] The processing flow will be explained below.

[0426] Step 1:

[0427] Users enter detailed information about their trip into an input form on their device, such as travel timing, budget, travel companions, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains, etc.).

[0428] Step 2:

[0429] The terminal converts the information entered by the user into JSON format, which is then sent to the server as an HTTP request.

[0430] Step 3:

[0431] The server receives the HTTP request and parses the JSON data, which is then recognized as travel timing, budget, travel companion information, and preferences.

[0432] Step 4:

[0433] The server retrieves the following information from an internal database or external API:

[0434] A list of hotels available at a given time

[0435] A list of transportation options available within your budget

[0436] A list of activities and services that match your preferences

[0437] Step 5:

[0438] The server generates optimal travel plan candidates based on the acquired information, including combinations of multiple hotels, transportation options, and activities.

[0439] Step 6:

[0440] The server evaluates the generated candidate plans to select the plan that best meets the user's requirements. Evaluation criteria include hotel ratings, convenience of transportation, and attractiveness of activities.

[0441] Step 7:

[0442] The server selects the travel plan with the highest rating and generates the data in JSON format, which is then sent to the user's device as an HTTP response.

[0443] Step 8:

[0444] The device then analyzes the received itinerary data and displays a detailed itinerary to the user, including hotel information, transportation options, fares, and a list of activities.

[0445] Step 9:

[0446] Users can check the displayed travel plans and make reservations or arrangements as necessary. Through all these steps, users can easily obtain an efficient and optimal travel plan.

[0447] Example 1

[0448] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0449] When planning a trip, users must consider various factors and gather a lot of information, which takes time and effort, making it difficult to find the best plan.

[0450] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0451] In this invention, the server includes means for receiving detailed travel information entered by a user, means for converting the received detailed travel information into JSON format and sending it to the server as an HTTP request, means for the server to analyze the received information, refer to an internal database or an external API, and generate optimal travel plan candidates, means for evaluating the generated travel plan candidates using a generative AI model and determining the most suitable travel plan, and means for sending the determined travel plan to a terminal and displaying it to the user, thereby enabling the user to easily and quickly find the optimal travel plan.

[0452] "User" refers to any individual or organization that uses the System to create travel plans.

[0453] "Travel details" refers to specific information about the trip entered by the user, such as travel timing, budget, travel companion information, and points of interest.

[0454] "Terminal" refers to a device such as a computer or smartphone through which a user enters travel details and exchanges information with the server.

[0455] "JSON format" stands for JavaScript Object Notation and refers to a lightweight data exchange format that is easy for humans and machines to read.

[0456] An "HTTP request" refers to the way a client requests data from a server using the Hypertext Transfer Protocol.

[0457] "Server" refers to the equipment or system that receives and processes information sent by users and generates and evaluates optimal travel plans by referencing internal databases or external APIs.

[0458] "Internal database" refers to a database stored within the server, which stores various information used to create travel plans.

[0459] An "external API" refers to an application programming interface provided by an external service, and is an interface that allows a server to communicate with an external service and obtain information.

[0460] "Candidate travel plans" refers to multiple travel plan options generated by the server based on the information analyzed.

[0461] "Generative AI model" refers to an algorithm or computational model that uses artificial intelligence technology to evaluate potential travel plans and select the best one.

[0462] "Send to terminal" refers to the act of sending the travel plan generated by the server to the user's terminal as data.

[0463] "Display to user" refers to the act of presenting the transmitted travel plan in a form that can be viewed by the user on the device.

[0464] The present invention relates to a travel plan creation support system that allows users to easily obtain efficient and optimal travel plans. The system includes a terminal where users input detailed travel information, a server that processes and analyzes the input information, and a series of means for presenting optimal travel plans to users.

[0465] First, the user enters detailed information about the trip into the device. These details include the timing of the trip, budget, travel companions, and points of interest. Specifically, the user enters conditions such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[0466] The device then converts the input information into JSON format and sends it to the server as an HTTP request. The software used by the device can include Python, JavaScript, or an HTTP client library.

[0467] The server analyzes the information it receives and generates optimal travel plan suggestions by referencing an internal database or external API. The software used by the server includes an SQL database (e.g., MySQL) and an API management tool (e.g., Postman). This process obtains a list of hotels that match the travel timing, a list of transportation options available within the budget, and a list of facilities and services that match the customer's preferences.

[0468] The server then uses a generative AI model to generate multiple candidate plans based on the acquired information and evaluates each plan. This evaluation process selects the travel plan that best fits the user's input requirements. Specifically, it takes into account hotel ratings, the convenience of transportation, and the attractiveness of activities. The AI ​​model used by the server includes PyTorch and TensorFlow.

[0469] Finally, the server sends the optimized itinerary to the device, which then displays the detailed itinerary to the user, including specific hotel names, transportation options, prices, and activity details. The software used by the device includes a web browser (e.g., Google Chrome) and a display framework (e.g., React.js).

[0470] For example, if a user inputs criteria such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location," the server will search for and evaluate the best hotels, transportation options, and activities based on these criteria, and generate and present the following itinerary:

[0471] Hotel name: Mountain Resort Hotel

[0472] Transportation: Private car (free parking) or local rental car

[0473] Activities: Nature walks, hiking, local attractions

[0474] Price: 95,000 yen (breakfast buffet included, pets allowed)

[0475] Example prompt for a generative AI model:

[0476] Please suggest the best travel plan based on "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[0477] In this way, the system can provide users with efficient and optimal travel plans and simplify their travel planning.

[0478] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0479] Step 1:

[0480] The user enters the details of the trip into the terminal.

[0481] Examples of input: "Mid-August," "Budget 100,000 yen," "Family of 4," "Breakfast buffet," "Pet-friendly hotel," "Mountain location," etc.

[0482] The terminal receives this information and stores it temporarily in its internal memory.

[0483] Step 2:

[0484] The terminal converts the information received from the user into JSON format and sends it to the server as an HTTP request.

[0485] The software used is Python, JavaScript, or an HTTP client library.

[0486] Input: Trip details entered by the user

[0487] Data processing: Converting trip details into JSON format

[0488] Output: Trip details converted to JSON format

[0489] Example of operation: Generate and send JSON data like {"date":"Mid-August", "budget":100000, "companions":4, "preferences":["Breakfast buffet", "Pets allowed", "Mountain"]}.

[0490] Step 3:

[0491] The server parses the JSON data received from the terminal.

[0492] Analyze the contents of the JSON data and extract the necessary information.

[0493] Input: JSON data sent from the terminal

[0494] Data Operations: Parsing JSON data and extracting information

[0495] Output: Parsed trip details

[0496] Working example: Using Python's standard library, parse a JSON object and get the required information.

[0497] Step 4:

[0498] The server references an internal database or external API based on the analyzed information.

[0499] Get a list of hotels, transportation options, and activities that fit your travel timing, budget, and preferences.

[0500] Input: Parsed trip details

[0501] Data retrieval: using database queries and external API requests

[0502] Output: A list of hotels, transportation options, and activities.

[0503] Example of how it works: Executes a SQL query like SELECT FROM hotels WHERE location='mountain' AND pet_friendly=true to retrieve information from the database, and also makes an external API request to retrieve the latest information.

[0504] Step 5:

[0505] The server generates multiple travel plan options based on the acquired information.

[0506] A generative AI model is used to evaluate each candidate plan.

[0507] Input: List of retrieved hotels, transportation options, and activities

[0508] Data Computing: Generating and Evaluating Travel Plans Using Generative AI Models

[0509] Output: Multiple itinerary candidates with high rating scores

[0510] Example of operation: For each candidate plan, the AI ​​model calculates a score like {"hotel_score":8.5, "transportation_score":9.0, "activity_score":9.2}, and the plan with the highest overall rating is selected.

[0511] Step 6:

[0512] The server converts the optimal travel plan into JSON format and sends it to the terminal.

[0513] Input: Highest rated itinerary

[0514] Data processing: Convert travel plans into JSON format

[0515] Output: Optimal travel plans converted to JSON format

[0516] Example of operation: Generate and send data such as {"hotel_name":"Mountain resort hotel", "transportation":"Private car", "total_cost":95000, "activities":["Nature walk", "Hiking"]}.

[0517] Step 7:

[0518] The terminal displays the optimal travel plan received from the server to the user.

[0519] Input: JSON travel plan data received from the server

[0520] Data processing: Convert JSON data to HTML format

[0521] Output: A user-visible representation of the itinerary

[0522] Example of operation: Display details on a web page such as "Hotel name: Mountain resort hotel", "Transportation method: Private car", "Total cost: 95,000 yen", and "Activities: Nature walks, hiking".

[0523] Through the above steps, users can efficiently obtain the optimal travel plan and simplify their travel planning.

[0524] (Application example 1)

[0525] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0526] Conventional travel planning systems only present optimal travel plans based on detailed information entered by the user, but have the problem of not allowing users to virtually experience the travel destination. As a result, users have no way to experience whether the proposed travel plan actually matches their preferences, which can lead to a decrease in satisfaction and the hassle of changing plans. Therefore, there is a need for a function that allows users to virtually experience a travel destination before actually visiting it.

[0527] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0528] In this invention, the server includes means for receiving detailed travel information entered by a user, means for transmitting the received detailed travel information to the server, means for referencing an internal database or an external API based on the information received by the server to generate optimal travel plan candidates, means for evaluating the generated travel plan candidates and determining the most suitable travel plan, means for transmitting the determined travel plan to a terminal and displaying it to the user, and means for providing a virtual tour function that allows the user to virtually experience a travel destination, thereby enabling the user to virtually experience a travel destination before actually visiting and select a plan that suits their preferences.

[0529] "User" means any person who uses the System to input travel details and obtain optimal travel plans.

[0530] "Travel details" refers to all data about the trip entered by the user, such as travel timing information, budget information, travel companion information, and preference information.

[0531] "Server" refers to the computer system that processes and analyzes the travel details received from the user and generates optimal travel plan suggestions by referencing an internal database or external API.

[0532] An "internal database" is a database stored on a server that contains hotel information, transportation information, and the like used to generate travel plans.

[0533] "External API" means an interface to an external data source that the server accesses to obtain information needed to generate a travel itinerary.

[0534] "Best itinerary suggestions" means multiple itinerary suggestions generated based on the details entered by the user.

[0535] "Evaluation" refers to the process of comparing the generated travel plan candidates and selecting the plan that best suits the user.

[0536] "Determined Travel Plan" means the most suitable travel plan selected based on the evaluation.

[0537] "Terminal" means the device through which a User enters their travel details and on which their travel plans are ultimately displayed.

[0538] The "virtual tour function" allows users to virtually experience a travel destination before actually visiting it.

[0539] The present invention relates to a system that allows users to easily obtain efficient and optimal travel plans. The system includes a terminal where users input detailed travel information, a server that processes and analyzes the input information, and a series of means for presenting optimal travel plans to users.

[0540] First, the user enters detailed information about the trip using the device. These details include the timing of the trip, budget, travel companions, and preferences. For example, the user can enter conditions such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[0541] The device converts the entered details into JSON format and sends it as an HTTP request to the server. The server then analyzes the received information and generates optimal travel plan suggestions by referencing an internal database and external API. In the process, it obtains a list of accommodations that match the travel timing, a list of transportation options available within the user's budget, and a list of facilities and services that match the user's preferences.

[0542] The server evaluates the generated itinerary candidates and selects the one that best meets the user's requirements. This selection process takes into account hotel ratings, transportation convenience, and activity attractiveness. A generative AI model is used in this evaluation process. The generative AI model selects the itinerary that best meets the user's input criteria.

[0543] The selected itinerary is then sent back to the device from the server, where a detailed itinerary is displayed to the user, including specific accommodations, transportation options, prices, and activity details.

[0544] Furthermore, this system has a virtual tour function that allows users to virtually experience the travel destinations they want to visit. This function has the advantage of allowing users to visually check the validity of their travel plans before actually visiting them.

[0545] For example, if a user inputs criteria such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location," the server will search for and evaluate the best accommodations, transportation options, and activities based on these criteria, and generate and present the following itinerary:

[0546] Accommodation name: Mountain resort hotel

[0547] Transportation: Private car (free parking) or local rental car

[0548] Activities: Nature walks, hiking, local attractions

[0549] Price: 95,000 yen (breakfast buffet included, pets allowed)

[0550] An example prompt has the following format:

[0551] Generate a virtual travel plan. Please choose the best plan based on the following criteria:

[0552] Timing: Mid-August

[0553] Budget: 100,000 yen

[0554] Accompanying persons: 4 family members

[0555] Specialties: Breakfast buffet, pet-friendly hotel, mountain location

[0556] In this way, the system of the present invention provides users with efficient and optimal travel plans and simplifies the planning process.

[0557] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0558] Step 1:

[0559] The user uses the device to input detailed information about the trip, including the timing, budget, travel companions, and preferences. For example, "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[0560] Input: Travel timing, budget, travel companions, points of interest

[0561] Output: Trip details entered

[0562] Step 2:

[0563] The device converts the entered travel details into JSON format, then sends it to the server as an HTTP request. During this conversion and transmission process, the device formats the data and communicates with the network.

[0564] Input: Trip details entered by the user

[0565] Output: JSON format data sent to the server

[0566] Step 3:

[0567] The server then parses the trip details it receives, consulting internal databases and external APIs to retrieve a list of accommodations, transportation options, and activities that match the user's criteria.

[0568] Input: Trip details received from the device (JSON format)

[0569] Output: A list of accommodations, transportation options, and activities that match the user's criteria

[0570] Step 4:

[0571] The server generates multiple travel plan options based on the acquired information, processing the data to generate the best options based on travel timing, budget, and preferences.

[0572] Input: List of accommodations, transportation, and activities

[0573] Output: Multiple itinerary candidates generated

[0574] Step 5:

[0575] The server selects the optimal plan from the generated travel plan candidates using a generative AI model. This model evaluates the plan to select the one that best suits the user's input criteria.

[0576] Input: Multiple travel plan options

[0577] Output: The optimal travel plan selected by the generative AI model

[0578] Step 6:

[0579] The server converts the selected optimal travel plan back into JSON format and sends it to the terminal as an HTTP response. During this process, the server performs data conversion and sends the response.

[0580] Input: Selected optimal travel plan

[0581] Output: Optimized itinerary in JSON format sent to the device

[0582] Step 7:

[0583] The terminal visually displays the received optimal travel plan to the user, and also uses a virtual tour function to allow the user to virtually experience the proposed travel destinations. This function allows the user to visually confirm the validity of the travel plan.

[0584] Input: Optimal travel plan received from the server (JSON format)

[0585] Output: A concrete itinerary and virtual tour experience displayed to the user

[0586] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0587] This invention combines an emotion engine with a travel plan creation support system that enables users to easily obtain efficient and optimal travel plans. This system includes a terminal where users input detailed travel information, a server that processes and analyzes the input information, and a series of means for presenting optimal travel plans to users, and further includes an emotion engine that recognizes the user's emotions and adjusts the plan accordingly.

[0588] First, the user enters detailed information about the trip into an input form on the device, such as the timing of the trip, budget, travel companions, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains, etc.).

[0589] The emotion engine also works to analyze the user's emotions in real time from their facial expressions and voice. The analyzed emotions are classified into categories such as "happiness," "surprise," and "anxiety." This information is included in the trip details sent from the device to the server.

[0590] Next, the device converts the information entered by the user and the emotional data obtained by the emotion engine into JSON format and sends it to the server as an HTTP request.

[0591] The server receives the HTTP request and parses the JSON data, which is then recognized as travel timing, budget, travel companion information, preferences, and even user sentiment.

[0592] The server retrieves the following information from an internal database or external API:

[0593] A list of hotels available at a given time

[0594] A list of transportation options available within your budget

[0595] A list of activities and services that match your preferences

[0596] The server generates optimal travel plan candidates based on the acquired information. This process also takes into account the user's emotional data. For example, if the user expresses anxiety, plans that include elements that reduce stress will be evaluated. Conversely, if the user expresses joy, plans that include elements that reinforce that emotion will be prioritized.

[0597] The server then evaluates the generated candidate plans and selects the most suitable one. The evaluation process relies on data from the emotion engine, such as hotel ratings, transportation convenience, activity attractiveness, and adjustments based on the user's emotion data.

[0598] Finally, the server sends the optimized itinerary to the device, which then analyzes the received itinerary data and displays a detailed itinerary to the user, including hotel information, transportation options, fares, and a list of activities.

[0599] For example, if a user specifies the following in their input method:

[0600] "Travel timing: Mid-August"

[0601] "Budget: 100,000 yen"

[0602] "Family of 4"

[0603] "Breakfast buffet"

[0604] "Pet-friendly hotel"

[0605] "Mountain location"

[0606] Furthermore, if the emotion engine detects the emotion of "anxiety" while the user is typing, the server will take that into consideration and provide a plan that includes a relaxing environment and reassuring services. As a result, the following travel plan will be generated and presented to the user:

[0607] Hotel name: Mountain Relax Resort Hotel

[0608] Transportation: Private car (free parking) or local rental car

[0609] Activities: Nature walks, hiking, local attractions

[0610] Price: 95,000 yen (breakfast buffet included, pets allowed)

[0611] In this way, the system provides optimal travel plans that take the user's emotions into account and simplifies the planning process.

[0612] The processing flow will be explained below.

[0613] Step 1:

[0614] The user enters the details of the trip into the input form on the terminal, such as the timing of the trip, budget, travel companion information, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains).

[0615] Step 2:

[0616] The device acquires the user's input information. The emotion engine then analyzes the user's emotions in real time from their facial expressions and voice when they input information. The emotion engine classifies emotions into categories such as "happiness," "surprise," and "anxiety."

[0617] Step 3:

[0618] The device converts the acquired travel details and the emotion data analyzed by the emotion engine into JSON format, and then sends the converted data to the server as an HTTP request.

[0619] Step 4:

[0620] The server receives the HTTP request and parses the JSON data, which is then recognized as travel timing, budget, travel companion information, preferences, and user sentiment information.

[0621] Step 5:

[0622] The server retrieves the following information from an internal database or external API:

[0623] A list of hotels available at a given time

[0624] A list of transportation options available within your budget

[0625] A list of activities and services that match your preferences

[0626] Step 6:

[0627] The server generates optimal travel plan candidates based on the acquired information. In this process, it takes into account the user's emotional data. For example, if the user expresses anxiety, it will prioritize plans that include a relaxing environment and reassuring services. Conversely, if the user expresses joy, it will prioritize plans that reinforce those emotions.

[0628] Step 7:

[0629] The server evaluates the generated candidate plans. The evaluation process includes adjustments based on hotel rating scores, transportation convenience, activity attractiveness, and user sentiment data. The server uses an AI model to evaluate and select the most suitable travel plan.

[0630] Step 8:

[0631] The server determines the optimal travel plan based on the ratings and generates the data in JSON format, which is then sent to the user's device as an HTTP response.

[0632] Step 9:

[0633] The device then analyzes the received itinerary data and displays a detailed itinerary to the user, including specific hotel names, transportation options, prices, and activity details.

[0634] Step 10:

[0635] The user can then review the displayed itinerary and make reservations or arrangements as necessary. Through all these steps, the user can obtain an efficient and optimal itinerary that is tailored based on their emotions.

[0636] Example 2

[0637] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0638] Conventional travel planning systems do not take user emotions into account when generating plans, which leaves the user experience unsatisfied. In particular, plans that ignore users' emotions, such as anxiety and joy, make it difficult to provide an optimal travel experience. Furthermore, conventional systems create plans based solely on detailed information provided by the user, which means they cannot fully satisfy the user's complex needs and desires.

[0639] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving detailed travel information entered by the user and emotion data analyzed in real time, and generating optimal travel plan candidates by referencing an internal database or an external API; means for evaluating the generated travel plan candidates and determining the most suitable travel plan taking the user's emotion data into consideration; and means for transmitting the determined travel plan to the terminal and displaying it to the user. This makes it possible to provide an optimal travel plan that reflects the user's emotions, significantly improving the user experience.

[0640] 1. "User" means an entity that uses this system to make travel plans.

[0641] 2. "Travel details" refers to information about travel plans provided by users, such as travel timing, budget, travel companion information, and points of interest.

[0642] 3. "Emotional data" refers to emotional information analyzed in real time from the user's facial expressions and voice, and is classified into categories such as "joy," "surprise," and "anxiety."

[0643] 4. "Terminal" means a device through which a user inputs travel details and transmits emotion data, including a PC, smartphone, tablet, etc.

[0644] 5. "Server" means an information processing device including hardware and software that receives detailed travel information and emotion data sent from a terminal and generates, evaluates, and determines the optimal travel plan based on this information.

[0645] 6. "Means for receiving" refers to the function by which the server receives detailed travel information and emotion data sent from the terminal.

[0646] 7. "Means of reference" refers to the function that allows the server to obtain the necessary data from an internal database or external API.

[0647] 8. "Means for generating potential itineraries" means the algorithms and processes for generating multiple itineraries based on the received information.

[0648] 9. "Means for evaluation" refers to a function for selecting the optimal plan from multiple generated travel plans based on the user's emotional data and other evaluation criteria.

[0649] 10. "Transmission means" is a function for transmitting the travel plan determined by the server to the terminal.

[0650] 11. "Display means" refers to the function by which the terminal visually presents the travel plan received by the terminal to the user.

[0651] 12. "Internal Database" means data storage that accumulates travel-related information for reference by the Server when generating travel plans.

[0652] 13. "External API" means an application program interface that allows a server to obtain necessary information from external services.

[0653] 14. "Accommodation information" refers to information about hotels, guesthouses, etc. that is used when creating travel plans.

[0654] 15. "Transportation Information" means information about the transportation options available during a trip.

[0655] 16. "Activity Information" means information about sightseeing and leisure activities that can be done at a travel destination.

[0656] The present invention is a travel plan creation support system that allows users to easily obtain efficient and optimal travel plans, and by combining it with an emotion engine, provides travel plans that take user emotions into consideration. The following describes in detail the embodiments of the present invention.

[0657] First, the user enters the details of their trip using a device (e.g., PC, smartphone, tablet). This information includes the timing of the trip, budget, travel companion information, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains). An emotion engine is then applied to detect the user's facial expressions and voice in real time. Emotion analysis is performed using facial recognition software (e.g., OpenCV) and voice analysis software (e.g., Google Speech-to-Text API), and the emotional data is classified into categories such as "happiness," "surprise," and "anxiety."

[0658] Next, the device converts the travel details entered by the user and the emotion data analyzed by the emotion engine into JSON format and sends it to the server as an HTTP request, using JavaScript or Python libraries to generate a JSON object and sending it to the server using the POST method.

[0659] The server processes the HTTP request received from the device and analyzes the JSON data sent. This analysis extracts travel timing, budget, travel companion information, preferences, and emotional data. A Python framework (e.g., Flask, Django) is used for analysis to parse the request data and extract various pieces of information.

[0660] The server then accesses an internal database (e.g. MySQL, PostgreSQL) or an external API (e.g. Google Places API, Skyscanner API) to retrieve the following information:

[0661] A list of accommodations available at a specified time

[0662] A list of transportation options available within your budget

[0663] A list of activities and services that match your preferences

[0664] The server then uses this information to generate optimal travel plan suggestions. It uses Python's Pandas and Numpy to process the data and apply algorithms to create an appropriate plan. It also takes into account the user's emotional data and incorporates elements that correspond to their emotions (e.g., relaxing elements if they indicate anxiety, exciting elements if they indicate joy) into the plan.

[0665] The generated itinerary candidates are evaluated based on emotional data and evaluation criteria (e.g., accommodation rating, convenience of transportation, attractiveness of activities). The most suitable itinerary is then selected. The server again sends the selected itinerary to the terminal as an HTTP response in JSON format.

[0666] The device parses the received itinerary data and displays a detailed itinerary to the user on the screen, clearly displaying accommodation information, transportation options, prices, and activity lists using HTML, CSS, and JavaScript.

[0667] For example, if the user enters the following criteria:

[0668] Travel time: Mid-August

[0669] Budget: 100,000 yen

[0670] family of 4

[0671] Breakfast buffet

[0672] Pet-friendly hotels

[0673] Mountain location

[0674] Furthermore, if the emotion engine detects the emotion of "anxiety," the server will take that into consideration and provide a plan that includes a relaxing environment and reassuring services. As a result, the following travel plan is generated and presented to the user:

[0675] Accommodation name: Mountain Relax Resort Hotel

[0676] Transportation: Private car (free parking) or local rental car

[0677] Activities: Nature walks, hiking, local attractions

[0678] Price: 95,000 yen (breakfast buffet included, pets allowed)

[0679] In this way, the system of the present invention provides an optimal travel plan that reflects the user's feelings, simplifying travel planning.

[0680] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0681] Step 1: User enters trip details

[0682] Users enter their trip schedule, budget, travel companion information, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains) into an input form on their device. At the same time, the emotion engine analyzes the user's facial expressions and voice, collecting emotional data in real time. Specifically, it uses a webcam and microphone to classify emotional data into categories such as "happiness," "surprise," and "anxiety" using facial recognition software (e.g., OpenCV) and voice analysis software (e.g., Google Speech-to-Text API). Input: Detailed trip information and the user's facial expressions and voice. Output: Detailed trip information and emotional data.

[0683] Step 2: The device sends the trip details and emotion data to the server.

[0684] The device converts the travel details entered by the user and the emotion data obtained by the emotion engine into JSON format and sends it to the server as an HTTP request. Specifically, it uses JavaScript or Python libraries to create a JSON object and sends it to the server using the POST method. Input: User's travel details and emotion data. Output: HTTP request sent to the server.

[0685] Step 3: The server receives and analyzes the user's travel details and emotion data.

[0686] The server receives the HTTP request sent from the device and parses the JSON data. Using a Python framework (e.g., Flask, Django), it parses the request data and extracts the travel timing, budget, travel companion information, points of interest, and emotional data. Input: JSON data sent as an HTTP request. Output: Parsed trip details and emotional data.

[0687] Step 4: The server retrieves the necessary information by consulting an internal database or external API.

[0688] The server queries an internal database (e.g., MySQL, PostgreSQL) or an external API (e.g., Google Places API, Skyscanner API) to retrieve a list of available accommodations for a specified time, transportation options available within a budget, and activities and services that match specific preferences. Input: Parsed trip details and sentiment data. Output: Retrieved accommodation information, transportation information, and activity information.

[0689] Step 5: The server generates optimal itinerary candidates

[0690] The server generates optimal travel plan candidates based on the acquired information. During this process, it uses Python libraries (e.g., Pandas, Numpy) to apply algorithms to process the data. It also takes into account the user's emotional data and generates a plan that includes elements that correspond to those emotions. Input: Acquired accommodation information, transportation information, activity information, and emotional data. Output: Multiple travel plan candidates.

[0691] Step 6: The server evaluates the generated itinerary candidates and selects the best one.

[0692] The server evaluates the generated travel plan candidates and selects the most suitable one. The evaluation process is based on emotional data and evaluation criteria (e.g., rating score of accommodation, convenience of transportation, attractiveness of activities). Input: Multiple travel plan candidates. Output: Selected optimal travel plan.

[0693] Step 7: The server sends the selected travel plan to the terminal.

[0694] The server sends the selected optimal travel plan to the terminal as an HTTP response in JSON format. Input: The selected optimal travel plan. Output: The HTTP response sent to the terminal.

[0695] Step 8: The device displays the received itinerary to the user.

[0696] The terminal analyzes the travel plan data received from the server and displays a detailed travel plan on the screen for the user. The display uses HTML, CSS, and JavaScript to visually show accommodation information, transportation options, fares, and activity lists. Input: Travel plan data sent as an HTTP response from the server. Output: A detailed travel plan displayed to the user.

[0697] Example: If the user enters the following criteria:

[0698] Travel time: Mid-August

[0699] Budget: 100,000 yen

[0700] family of 4

[0701] Breakfast buffet

[0702] Pet-friendly hotels

[0703] Mountain location

[0704] Furthermore, if the emotion engine detects the emotion of "anxiety," the server will take that into consideration and provide a plan that includes a relaxing environment and reassuring services. As a result, the following travel plan is generated and presented to the user:

[0705] Accommodation name: Mountain Relax Resort Hotel

[0706] Transportation: Private car (free parking) or local rental car

[0707] Activities: Nature walks, hiking, local attractions

[0708] Price: 95,000 yen (breakfast buffet included, pets allowed)

[0709] (Application example 2)

[0710] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0711] The present invention aims to provide a means for improving the in-store shopping experience. Conventional shopping systems often make it difficult for users to find an optimal plan that matches their emotions and preferences, resulting in a dissatisfying shopping experience. Furthermore, there is a problem in that appropriate measures cannot be taken when users feel anxious or stressed. Therefore, there is a need for a system that analyzes users' emotions in real time and adjusts the shopping plan accordingly.

[0712] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving detailed shopping information entered by the user, means for analyzing emotion data and adjusting the shopping plan based on the analysis results, and means for obtaining the adjusted shopping plan from an external API. This makes it possible to provide an optimal shopping plan based on the user's emotions.

[0713] "User" means a person who uses the system to create travel plans or shopping plans.

[0714] A "server" is a device that processes information received from users and generates and provides optimal plans by referencing external databases and APIs.

[0715] "Travel details" refers to all the information necessary for planning a trip, such as the timing of the trip, budget, travel companions, and points of interest.

[0716] "Emotional data" refers to information about emotions analyzed from the user's facial expressions and voice.

[0717] "Shopping Plan" means a suggestion that shows optimal shopping progression and choices when a user is shopping.

[0718] An "external API" is an interface for obtaining information by connecting with other systems or databases.

[0719] "Adjustment" refers to the process of optimizing a plan or proposal based on specific conditions and information.

[0720] To implement this invention, the following system configuration and program are required. The system mainly consists of a user terminal, a server, and an external API. In a specific embodiment of the invention, the user inputs detailed shopping or travel information into the terminal, and the input information is sent to the server. The server generates an optimal plan based on the received information and finally displays this plan on the user terminal. Furthermore, the generated plan is adjusted according to the user's emotions through analysis using an emotion engine.

[0721] Hardware and software configuration

[0722] The user terminals are devices such as smartphones and tablets, equipped with a screen for inputting travel and shopping details, a camera and microphone for capturing emotion data, and an emotion engine installed if necessary.

[0723] The server is a high-performance computer used for information analysis and data processing. Its main software components include "EmotionEngine" for emotion analysis, and "ShoppingAPI" and "TravelAPI" for generating shopping and travel plans. These APIs are used to connect with external databases and services to obtain the necessary information.

[0724] Specific examples

[0725] 1. Collecting User Input

[0726] The user uses the device to input detailed shopping information (store to visit, budget, desired product category, points of interest, etc.) For example, "Store: Department Store A," "Budget: 20,000 yen," "Category: Fashion," "Points of interest: Stylish jacket, casual shoes."

[0727] 2. Emotion Data Analysis

[0728] Using the device's camera and microphone, the user's real-time facial expressions and voice are analyzed, and emotional data such as "anxiety" and "joy" is obtained by the emotion engine.

[0729] 3. Sending data to the server

[0730] The shopping details and sentiment data entered by the user are converted into JSON format and sent to the server as an HTTP request.

[0731] 4. Plan generation and adjustment

[0732] The server analyzes the received data and generates an optimal shopping plan by referencing an external API. During this process, the plan is adjusted based on the user's emotional data. For example, if the emotional data indicates "anxiety," measures such as allocating time for consultation with a staff member may be included.

[0733] 5. Displaying the best plan to users

[0734] The adjusted optimal shopping plan is sent to the user's device and displayed to the user.

[0735] Prompt Sentence Examples

[0736] Generate the best shopping plan based on the following criteria:

[0737] 1. Shopping location: Department Store A

[0738] 2. Budget: 20,000 yen

[0739] 3. Product Category: Fashion

[0740] 4. User preferences: Stylish jackets, casual shoes

[0741] 5. User's current emotion: Anxiety

[0742] In the above-described embodiment, the present invention provides optimal shopping plans and travel plans according to the user's emotions.

[0743] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0744] Step 1:

[0745] The user uses the terminal to input detailed shopping information, including the store they plan to visit, their budget, product category, and preferences. For example, they might input information such as "Store: Department Store A," "Budget: 20,000 yen," "Category: Fashion," and "Preferences: A stylish jacket and casual shoes."

[0746] Input: Shopping details (store, budget, category, points of interest)

[0747] Output: User's shopping details stored on the device

[0748] Step 2:

[0749] The device's camera and microphone are used to analyze the user's real-time facial expressions and voice. The emotion engine acquires the user's emotional data (e.g., "anxiety" or "joy"), and emotional data is generated based on the analysis results.

[0750] Input: User's facial expressions and voice

[0751] Output: User emotion data (categories such as "anxiety" or "joy")

[0752] Step 3:

[0753] The shopping details entered by the user and the acquired sentiment data are converted into JSON format, which is then sent to the server as an HTTP request.

[0754] Input: Shopping details, emotion data

[0755] Output: JSON formatted data sent to the server

[0756] Step 4:

[0757] The server receives the HTTP request and parses the JSON data, which is then recognized as shopping details (store, budget, category, preferences) and sentiment data.

[0758] Input: JSON format data (shopping details, emotion data)

[0759] Output: Parsed shopping details, sentiment data

[0760] Step 5:

[0761] The server uses an external API (Shopping API) to generate optimal shopping plan suggestions based on the analyzed data. This process takes into account the user's emotional data. For example, if the user expresses "anxiety," elements with a relaxing effect will be added to the plan.

[0762] Input: Parsed shopping details, sentiment data

[0763] Output: Best shopping plan suggestions

[0764] Step 6:

[0765] The server evaluates the generated shopping plan candidates and determines the most suitable plan based on the emotional data. The evaluation criteria include general product information, price, special offers, and adjustments based on the user's emotional data.

[0766] Input: Optimal shopping plan candidates, sentiment data

[0767] Output: The best shopping plan

[0768] Step 7:

[0769] The server converts the most suitable shopping plan into JSON format and sends it to the user's device, where the user can view the displayed shopping plan.

[0770] Input: Best shopping plan

[0771] Output: Shopping plan sent to the user's device

[0772] Through these steps, users are provided with an optimal shopping plan that takes into account their emotional data in real time, improving their shopping experience.

[0773] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0774] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0775] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0776] [Third embodiment]

[0777] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0778] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0779] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0780] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0781] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0782] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0783] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0784] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0785] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0786] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0787] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0788] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0789] The present invention relates to a travel plan creation support system that allows users to easily obtain efficient and optimal travel plans. The system includes a terminal where users input detailed travel information, a server that processes and analyzes the input information, and a series of means for presenting optimal travel plans to users.

[0790] First, users enter details about their trip, including travel timing, budget, travel companions, and preferences, into an input form on the device. These details might include, for example, "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[0791] The device then sends the entered information to the server, where it is converted to JSON format and sent as an HTTP request.

[0792] The server analyzes the received data and generates optimal travel plan suggestions by referencing an internal database or external API. In the process, it obtains a list of hotels that match the travel timing, a list of transportation options that fit within the budget, and a list of facilities and services that match the user's preferences.

[0793] The server then generates multiple candidate plans based on the acquired information and evaluates each one. During the evaluation process, a generative AI model is used to select the travel plan that best suits the user's input requirements. This selection process takes into account factors such as hotel ratings, transportation convenience, and the attractiveness of activities.

[0794] Finally, the server sends the optimized itinerary to the terminal, which then displays the detailed itinerary to the user, including specific hotel names, transportation options, prices, and activity details.

[0795] For example, if a user inputs criteria such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location," the server will search for and evaluate the best hotels, transportation options, and activities based on these criteria, and generate and present the following itinerary:

[0796] Hotel name: Mountain Resort Hotel

[0797] Transportation: Private car (free parking) or local rental car

[0798] Activities: Nature walks, hiking, local attractions

[0799] Price: 95,000 yen (breakfast buffet included, pets allowed)

[0800] In this way, the system provides users with efficient and optimal travel plans and simplifies their planning.

[0801] The processing flow will be explained below.

[0802] Step 1:

[0803] Users enter detailed information about their trip into an input form on their device, such as travel timing, budget, travel companions, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains, etc.).

[0804] Step 2:

[0805] The terminal converts the information entered by the user into JSON format, which is then sent to the server as an HTTP request.

[0806] Step 3:

[0807] The server receives the HTTP request and parses the JSON data, which is then recognized as travel timing, budget, travel companion information, and preferences.

[0808] Step 4:

[0809] The server retrieves the following information from an internal database or external API:

[0810] A list of hotels available at a given time

[0811] A list of transportation options available within your budget

[0812] A list of activities and services that match your preferences

[0813] Step 5:

[0814] The server generates optimal travel plan candidates based on the acquired information, including combinations of multiple hotels, transportation options, and activities.

[0815] Step 6:

[0816] The server evaluates the generated candidate plans to select the plan that best meets the user's requirements. Evaluation criteria include hotel ratings, convenience of transportation, and attractiveness of activities.

[0817] Step 7:

[0818] The server selects the travel plan with the highest rating and generates the data in JSON format, which is then sent to the user's device as an HTTP response.

[0819] Step 8:

[0820] The device then analyzes the received itinerary data and displays a detailed itinerary to the user, including hotel information, transportation options, fares, and a list of activities.

[0821] Step 9:

[0822] Users can check the displayed travel plans and make reservations or arrangements as necessary. Through all these steps, users can easily obtain an efficient and optimal travel plan.

[0823] Example 1

[0824] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0825] When planning a trip, users must consider various factors and gather a lot of information, which takes time and effort, making it difficult to find the best plan.

[0826] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0827] In this invention, the server includes means for receiving detailed travel information entered by a user, means for converting the received detailed travel information into JSON format and sending it to the server as an HTTP request, means for the server to analyze the received information, refer to an internal database or an external API, and generate optimal travel plan candidates, means for evaluating the generated travel plan candidates using a generative AI model and determining the most suitable travel plan, and means for sending the determined travel plan to a terminal and displaying it to the user, thereby enabling the user to easily and quickly find the optimal travel plan.

[0828] "User" refers to any individual or organization that uses the System to create travel plans.

[0829] "Travel details" refers to specific information about the trip entered by the user, such as travel timing, budget, travel companion information, and points of interest.

[0830] "Terminal" refers to a device such as a computer or smartphone through which a user enters travel details and exchanges information with the server.

[0831] "JSON format" stands for JavaScript Object Notation and refers to a lightweight data exchange format that is easy for humans and machines to read.

[0832] An "HTTP request" refers to the way a client requests data from a server using the Hypertext Transfer Protocol.

[0833] "Server" refers to the equipment or system that receives and processes information sent by users and generates and evaluates optimal travel plans by referencing internal databases or external APIs.

[0834] "Internal database" refers to a database stored within the server, which stores various information used to create travel plans.

[0835] An "external API" refers to an application programming interface provided by an external service, and is an interface that allows a server to communicate with an external service and obtain information.

[0836] "Candidate travel plans" refers to multiple travel plan options generated by the server based on the information analyzed.

[0837] "Generative AI model" refers to an algorithm or computational model that uses artificial intelligence technology to evaluate potential travel plans and select the best one.

[0838] "Send to terminal" refers to the act of sending the travel plan generated by the server to the user's terminal as data.

[0839] "Display to user" refers to the act of presenting the transmitted travel plan in a form that can be viewed by the user on the device.

[0840] The present invention relates to a travel plan creation support system that allows users to easily obtain efficient and optimal travel plans. The system includes a terminal where users input detailed travel information, a server that processes and analyzes the input information, and a series of means for presenting optimal travel plans to users.

[0841] First, the user enters detailed information about the trip into the device. These details include the timing of the trip, budget, travel companions, and points of interest. Specifically, the user enters conditions such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[0842] The device then converts the input information into JSON format and sends it to the server as an HTTP request. The software used by the device can include Python, JavaScript, or an HTTP client library.

[0843] The server analyzes the information it receives and generates optimal travel plan suggestions by referencing an internal database or external API. The software used by the server includes an SQL database (e.g., MySQL) and an API management tool (e.g., Postman). This process obtains a list of hotels that match the travel timing, a list of transportation options available within the budget, and a list of facilities and services that match the customer's preferences.

[0844] The server then uses a generative AI model to generate multiple candidate plans based on the acquired information and evaluates each plan. This evaluation process selects the travel plan that best fits the user's input requirements. Specifically, it takes into account hotel ratings, the convenience of transportation, and the attractiveness of activities. The AI ​​model used by the server includes PyTorch and TensorFlow.

[0845] Finally, the server sends the optimized itinerary to the device, which then displays the detailed itinerary to the user, including specific hotel names, transportation options, prices, and activity details. The software used by the device includes a web browser (e.g., Google Chrome) and a display framework (e.g., React.js).

[0846] For example, if a user inputs criteria such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location," the server will search for and evaluate the best hotels, transportation options, and activities based on these criteria, and generate and present the following itinerary:

[0847] Hotel name: Mountain Resort Hotel

[0848] Transportation: Private car (free parking) or local rental car

[0849] Activities: Nature walks, hiking, local attractions

[0850] Price: 95,000 yen (breakfast buffet included, pets allowed)

[0851] Example prompt for a generative AI model:

[0852] Please suggest the best travel plan based on "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[0853] In this way, the system can provide users with efficient and optimal travel plans and simplify their travel planning.

[0854] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0855] Step 1:

[0856] The user enters the details of the trip into the terminal.

[0857] Examples of input: "Mid-August," "Budget 100,000 yen," "Family of 4," "Breakfast buffet," "Pet-friendly hotel," "Mountain location," etc.

[0858] The terminal receives this information and stores it temporarily in its internal memory.

[0859] Step 2:

[0860] The terminal converts the information received from the user into JSON format and sends it to the server as an HTTP request.

[0861] The software used is Python, JavaScript, or an HTTP client library.

[0862] Input: Trip details entered by the user

[0863] Data processing: Converting trip details into JSON format

[0864] Output: Trip details converted to JSON format

[0865] Example of operation: Generate and send JSON data like {"date":"Mid-August", "budget":100000, "companions":4, "preferences":["Breakfast buffet", "Pets allowed", "Mountain"]}.

[0866] Step 3:

[0867] The server parses the JSON data received from the terminal.

[0868] Analyze the contents of the JSON data and extract the necessary information.

[0869] Input: JSON data sent from the terminal

[0870] Data Operations: Parsing JSON data and extracting information

[0871] Output: Parsed trip details

[0872] Working example: Using Python's standard library, parse a JSON object and get the required information.

[0873] Step 4:

[0874] The server references an internal database or external API based on the analyzed information.

[0875] Get a list of hotels, transportation options, and activities that fit your travel timing, budget, and preferences.

[0876] Input: Parsed trip details

[0877] Data retrieval: using database queries and external API requests

[0878] Output: A list of hotels, transportation options, and activities.

[0879] Example of how it works: Executes a SQL query like SELECT FROM hotels WHERE location='mountain' AND pet_friendly=true to retrieve information from the database, and also makes an external API request to retrieve the latest information.

[0880] Step 5:

[0881] The server generates multiple travel plan options based on the acquired information.

[0882] A generative AI model is used to evaluate each candidate plan.

[0883] Input: List of retrieved hotels, transportation options, and activities

[0884] Data Computing: Generating and Evaluating Travel Plans Using Generative AI Models

[0885] Output: Multiple itinerary candidates with high rating scores

[0886] Example of operation: For each candidate plan, the AI ​​model calculates a score like {"hotel_score":8.5, "transportation_score":9.0, "activity_score":9.2}, and the plan with the highest overall rating is selected.

[0887] Step 6:

[0888] The server converts the optimal travel plan into JSON format and sends it to the terminal.

[0889] Input: Highest rated itinerary

[0890] Data processing: Convert travel plans into JSON format

[0891] Output: Optimal travel plans converted to JSON format

[0892] Example of operation: Generate and send data such as {"hotel_name":"Mountain resort hotel", "transportation":"Private car", "total_cost":95000, "activities":["Nature walk", "Hiking"]}.

[0893] Step 7:

[0894] The terminal displays the optimal travel plan received from the server to the user.

[0895] Input: JSON travel plan data received from the server

[0896] Data processing: Convert JSON data to HTML format

[0897] Output: A user-visible representation of the itinerary

[0898] Example of operation: Display details on a web page such as "Hotel name: Mountain resort hotel", "Transportation method: Private car", "Total cost: 95,000 yen", and "Activities: Nature walks, hiking".

[0899] Through the above steps, users can efficiently obtain the optimal travel plan and simplify their travel planning.

[0900] (Application example 1)

[0901] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0902] Conventional travel planning systems only present optimal travel plans based on detailed information entered by the user, but have the problem of not allowing users to virtually experience the travel destination. As a result, users have no way to experience whether the proposed travel plan actually matches their preferences, which can lead to a decrease in satisfaction and the hassle of changing plans. Therefore, there is a need for a function that allows users to virtually experience a travel destination before actually visiting it.

[0903] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0904] In this invention, the server includes means for receiving detailed travel information entered by a user, means for transmitting the received detailed travel information to the server, means for referencing an internal database or an external API based on the information received by the server to generate optimal travel plan candidates, means for evaluating the generated travel plan candidates and determining the most suitable travel plan, means for transmitting the determined travel plan to a terminal and displaying it to the user, and means for providing a virtual tour function that allows the user to virtually experience a travel destination, thereby enabling the user to virtually experience a travel destination before actually visiting and select a plan that suits their preferences.

[0905] "User" means any person who uses the System to input travel details and obtain optimal travel plans.

[0906] "Travel details" refers to all data about the trip entered by the user, such as travel timing information, budget information, travel companion information, and preference information.

[0907] "Server" refers to the computer system that processes and analyzes the travel details received from the user and generates optimal travel plan suggestions by referencing an internal database or external API.

[0908] An "internal database" is a database stored on a server that contains hotel information, transportation information, and the like used to generate travel plans.

[0909] "External API" means an interface to an external data source that the server accesses to obtain information needed to generate a travel itinerary.

[0910] "Best itinerary suggestions" means multiple itinerary suggestions generated based on the details entered by the user.

[0911] "Evaluation" refers to the process of comparing the generated travel plan candidates and selecting the plan that best suits the user.

[0912] "Determined Travel Plan" means the most suitable travel plan selected based on the evaluation.

[0913] "Terminal" means the device through which a User enters their travel details and on which their travel plans are ultimately displayed.

[0914] The "virtual tour function" allows users to virtually experience a travel destination before actually visiting it.

[0915] The present invention relates to a system that allows users to easily obtain efficient and optimal travel plans. The system includes a terminal where users input detailed travel information, a server that processes and analyzes the input information, and a series of means for presenting optimal travel plans to users.

[0916] First, the user enters detailed information about the trip using the device. These details include the timing of the trip, budget, travel companions, and preferences. For example, the user can enter conditions such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[0917] The device converts the entered details into JSON format and sends it as an HTTP request to the server. The server then analyzes the received information and generates optimal travel plan suggestions by referencing an internal database and external API. In the process, it obtains a list of accommodations that match the travel timing, a list of transportation options available within the user's budget, and a list of facilities and services that match the user's preferences.

[0918] The server evaluates the generated itinerary candidates and selects the one that best meets the user's requirements. This selection process takes into account hotel ratings, transportation convenience, and activity attractiveness. A generative AI model is used in this evaluation process. The generative AI model selects the itinerary that best meets the user's input criteria.

[0919] The selected itinerary is then sent back to the device from the server, where a detailed itinerary is displayed to the user, including specific accommodations, transportation options, prices, and activity details.

[0920] Furthermore, this system has a virtual tour function that allows users to virtually experience the travel destinations they want to visit. This function has the advantage of allowing users to visually check the validity of their travel plans before actually visiting them.

[0921] For example, if a user inputs criteria such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location," the server will search for and evaluate the best accommodations, transportation options, and activities based on these criteria, and generate and present the following itinerary:

[0922] Accommodation name: Mountain resort hotel

[0923] Transportation: Private car (free parking) or local rental car

[0924] Activities: Nature walks, hiking, local attractions

[0925] Price: 95,000 yen (breakfast buffet included, pets allowed)

[0926] An example prompt has the following format:

[0927] Generate a virtual travel plan. Please choose the best plan based on the following criteria:

[0928] Timing: Mid-August

[0929] Budget: 100,000 yen

[0930] Accompanying persons: 4 family members

[0931] Specialties: Breakfast buffet, pet-friendly hotel, mountain location

[0932] In this way, the system of the present invention provides users with efficient and optimal travel plans and simplifies the planning process.

[0933] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0934] Step 1:

[0935] The user uses the device to input detailed information about the trip, including the timing, budget, travel companions, and preferences. For example, "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[0936] Input: Travel timing, budget, travel companions, points of interest

[0937] Output: Trip details entered

[0938] Step 2:

[0939] The device converts the entered travel details into JSON format, then sends it to the server as an HTTP request. During this conversion and transmission process, the device formats the data and communicates with the network.

[0940] Input: Trip details entered by the user

[0941] Output: JSON format data sent to the server

[0942] Step 3:

[0943] The server then parses the trip details it receives, consulting internal databases and external APIs to retrieve a list of accommodations, transportation options, and activities that match the user's criteria.

[0944] Input: Trip details received from the device (JSON format)

[0945] Output: A list of accommodations, transportation options, and activities that match the user's criteria

[0946] Step 4:

[0947] The server generates multiple travel plan options based on the acquired information, processing the data to generate the best options based on travel timing, budget, and preferences.

[0948] Input: List of accommodations, transportation, and activities

[0949] Output: Multiple itinerary candidates generated

[0950] Step 5:

[0951] The server selects the optimal plan from the generated travel plan candidates using a generative AI model. This model evaluates the plan to select the one that best suits the user's input criteria.

[0952] Input: Multiple travel plan options

[0953] Output: The optimal travel plan selected by the generative AI model

[0954] Step 6:

[0955] The server converts the selected optimal travel plan back into JSON format and sends it to the terminal as an HTTP response. During this process, the server performs data conversion and sends the response.

[0956] Input: Selected optimal travel plan

[0957] Output: Optimized itinerary in JSON format sent to the device

[0958] Step 7:

[0959] The terminal visually displays the received optimal travel plan to the user, and also uses a virtual tour function to allow the user to virtually experience the proposed travel destinations. This function allows the user to visually confirm the validity of the travel plan.

[0960] Input: Optimal travel plan received from the server (JSON format)

[0961] Output: A concrete itinerary and virtual tour experience displayed to the user

[0962] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0963] This invention combines an emotion engine with a travel plan creation support system that enables users to easily obtain efficient and optimal travel plans. This system includes a terminal where users input detailed travel information, a server that processes and analyzes the input information, and a series of means for presenting optimal travel plans to users, and further includes an emotion engine that recognizes the user's emotions and adjusts the plan accordingly.

[0964] First, the user enters detailed information about the trip into an input form on the device, such as the timing of the trip, budget, travel companions, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains, etc.).

[0965] The emotion engine also works to analyze the user's emotions in real time from their facial expressions and voice. The analyzed emotions are classified into categories such as "happiness," "surprise," and "anxiety." This information is included in the trip details sent from the device to the server.

[0966] Next, the device converts the information entered by the user and the emotional data obtained by the emotion engine into JSON format and sends it to the server as an HTTP request.

[0967] The server receives the HTTP request and parses the JSON data, which is then recognized as travel timing, budget, travel companion information, preferences, and even user sentiment.

[0968] The server retrieves the following information from an internal database or external API:

[0969] A list of hotels available at a given time

[0970] A list of transportation options available within your budget

[0971] A list of activities and services that match your preferences

[0972] The server generates optimal travel plan candidates based on the acquired information. This process also takes into account the user's emotional data. For example, if the user expresses anxiety, plans that include elements that reduce stress will be evaluated. Conversely, if the user expresses joy, plans that include elements that reinforce that emotion will be prioritized.

[0973] The server then evaluates the generated candidate plans and selects the most suitable one. The evaluation process relies on data from the emotion engine, such as hotel ratings, transportation convenience, activity attractiveness, and adjustments based on the user's emotion data.

[0974] Finally, the server sends the optimized itinerary to the device, which then analyzes the received itinerary data and displays a detailed itinerary to the user, including hotel information, transportation options, fares, and a list of activities.

[0975] For example, if a user specifies the following in their input method:

[0976] "Travel timing: Mid-August"

[0977] "Budget: 100,000 yen"

[0978] "Family of 4"

[0979] "Breakfast buffet"

[0980] "Pet-friendly hotel"

[0981] "Mountain location"

[0982] Furthermore, if the emotion engine detects the emotion of "anxiety" while the user is typing, the server will take that into consideration and provide a plan that includes a relaxing environment and reassuring services. As a result, the following travel plan will be generated and presented to the user:

[0983] Hotel name: Mountain Relax Resort Hotel

[0984] Transportation: Private car (free parking) or local rental car

[0985] Activities: Nature walks, hiking, local attractions

[0986] Price: 95,000 yen (breakfast buffet included, pets allowed)

[0987] In this way, the system provides optimal travel plans that take the user's emotions into account and simplifies the planning process.

[0988] The processing flow will be explained below.

[0989] Step 1:

[0990] The user enters the details of the trip into the input form on the terminal, such as the timing of the trip, budget, travel companion information, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains).

[0991] Step 2:

[0992] The device acquires the user's input information. The emotion engine then analyzes the user's emotions in real time from their facial expressions and voice when they input information. The emotion engine classifies emotions into categories such as "happiness," "surprise," and "anxiety."

[0993] Step 3:

[0994] The device converts the acquired travel details and the emotion data analyzed by the emotion engine into JSON format, and then sends the converted data to the server as an HTTP request.

[0995] Step 4:

[0996] The server receives the HTTP request and parses the JSON data, which is then recognized as travel timing, budget, travel companion information, preferences, and user sentiment information.

[0997] Step 5:

[0998] The server retrieves the following information from an internal database or external API:

[0999] A list of hotels available at a given time

[1000] A list of transportation options available within your budget

[1001] A list of activities and services that match your preferences

[1002] Step 6:

[1003] The server generates optimal travel plan candidates based on the acquired information. In this process, it takes into account the user's emotional data. For example, if the user expresses anxiety, it will prioritize plans that include a relaxing environment and reassuring services. Conversely, if the user expresses joy, it will prioritize plans that reinforce those emotions.

[1004] Step 7:

[1005] The server evaluates the generated candidate plans. The evaluation process includes adjustments based on hotel rating scores, transportation convenience, activity attractiveness, and user sentiment data. The server uses an AI model to evaluate and select the most suitable travel plan.

[1006] Step 8:

[1007] The server determines the optimal travel plan based on the ratings and generates the data in JSON format, which is then sent to the user's device as an HTTP response.

[1008] Step 9:

[1009] The device then analyzes the received itinerary data and displays a detailed itinerary to the user, including specific hotel names, transportation options, prices, and activity details.

[1010] Step 10:

[1011] The user can then review the displayed itinerary and make reservations or arrangements as necessary. Through all these steps, the user can obtain an efficient and optimal itinerary that is tailored based on their emotions.

[1012] Example 2

[1013] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1014] Conventional travel planning systems do not take user emotions into account when generating plans, which leaves the user experience unsatisfied. In particular, plans that ignore users' emotions, such as anxiety and joy, make it difficult to provide an optimal travel experience. Furthermore, conventional systems create plans based solely on detailed information provided by the user, which means they cannot fully satisfy the user's complex needs and desires.

[1015] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving detailed travel information entered by the user and emotion data analyzed in real time, and generating optimal travel plan candidates by referencing an internal database or an external API; means for evaluating the generated travel plan candidates and determining the most suitable travel plan taking the user's emotion data into consideration; and means for transmitting the determined travel plan to the terminal and displaying it to the user. This makes it possible to provide an optimal travel plan that reflects the user's emotions, significantly improving the user experience.

[1016] 1. "User" means an entity that uses this system to make travel plans.

[1017] 2. "Travel details" refers to information about travel plans provided by users, such as travel timing, budget, travel companion information, and points of interest.

[1018] 3. "Emotional data" refers to emotional information analyzed in real time from the user's facial expressions and voice, and is classified into categories such as "joy," "surprise," and "anxiety."

[1019] 4. "Terminal" means a device through which a user inputs travel details and transmits emotion data, including a PC, smartphone, tablet, etc.

[1020] 5. "Server" means an information processing device including hardware and software that receives detailed travel information and emotion data sent from a terminal and generates, evaluates, and determines the optimal travel plan based on this information.

[1021] 6. "Means for receiving" refers to the function by which the server receives detailed travel information and emotion data sent from the terminal.

[1022] 7. "Means of reference" refers to the function that allows the server to obtain the necessary data from an internal database or external API.

[1023] 8. "Means for generating potential itineraries" means the algorithms and processes for generating multiple itineraries based on the received information.

[1024] 9. "Means for evaluation" refers to a function for selecting the optimal plan from multiple generated travel plans based on the user's emotional data and other evaluation criteria.

[1025] 10. "Transmission means" is a function for transmitting the travel plan determined by the server to the terminal.

[1026] 11. "Display means" refers to the function by which the terminal visually presents the travel plan received by the terminal to the user.

[1027] 12. "Internal Database" means data storage that accumulates travel-related information for reference by the Server when generating travel plans.

[1028] 13. "External API" means an application program interface that allows a server to obtain necessary information from external services.

[1029] 14. "Accommodation information" refers to information about hotels, guesthouses, etc. that is used when creating travel plans.

[1030] 15. "Transportation Information" means information about the transportation options available during a trip.

[1031] 16. "Activity Information" means information about sightseeing and leisure activities that can be done at a travel destination.

[1032] The present invention is a travel plan creation support system that allows users to easily obtain efficient and optimal travel plans, and by combining it with an emotion engine, provides travel plans that take user emotions into consideration. The following describes in detail the embodiments of the present invention.

[1033] First, the user enters the details of their trip using a device (e.g., PC, smartphone, tablet). This information includes the timing of the trip, budget, travel companion information, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains). An emotion engine is then applied to detect the user's facial expressions and voice in real time. Emotion analysis is performed using facial recognition software (e.g., OpenCV) and voice analysis software (e.g., Google Speech-to-Text API), and the emotional data is classified into categories such as "happiness," "surprise," and "anxiety."

[1034] Next, the device converts the travel details entered by the user and the emotion data analyzed by the emotion engine into JSON format and sends it to the server as an HTTP request, using JavaScript or Python libraries to generate a JSON object and sending it to the server using the POST method.

[1035] The server processes the HTTP request received from the device and analyzes the JSON data sent. This analysis extracts travel timing, budget, travel companion information, preferences, and emotional data. A Python framework (e.g., Flask, Django) is used for analysis to parse the request data and extract various pieces of information.

[1036] The server then accesses an internal database (e.g. MySQL, PostgreSQL) or an external API (e.g. Google Places API, Skyscanner API) to retrieve the following information:

[1037] A list of accommodations available at a specified time

[1038] A list of transportation options available within your budget

[1039] A list of activities and services that match your preferences

[1040] The server then uses this information to generate optimal travel plan suggestions. It uses Python's Pandas and Numpy to process the data and apply algorithms to create an appropriate plan. It also takes into account the user's emotional data and incorporates elements that correspond to their emotions (e.g., relaxing elements if they indicate anxiety, exciting elements if they indicate joy) into the plan.

[1041] The generated itinerary candidates are evaluated based on emotional data and evaluation criteria (e.g., accommodation rating, convenience of transportation, attractiveness of activities). The most suitable itinerary is then selected. The server again sends the selected itinerary to the terminal as an HTTP response in JSON format.

[1042] The device parses the received itinerary data and displays a detailed itinerary to the user on the screen, clearly displaying accommodation information, transportation options, prices, and activity lists using HTML, CSS, and JavaScript.

[1043] For example, if the user enters the following criteria:

[1044] Travel time: Mid-August

[1045] Budget: 100,000 yen

[1046] family of 4

[1047] Breakfast buffet

[1048] Pet-friendly hotels

[1049] Mountain location

[1050] Furthermore, if the emotion engine detects the emotion of "anxiety," the server will take that into consideration and provide a plan that includes a relaxing environment and reassuring services. As a result, the following travel plan is generated and presented to the user:

[1051] Accommodation name: Mountain Relax Resort Hotel

[1052] Transportation: Private car (free parking) or local rental car

[1053] Activities: Nature walks, hiking, local attractions

[1054] Price: 95,000 yen (breakfast buffet included, pets allowed)

[1055] In this way, the system of the present invention provides an optimal travel plan that reflects the user's feelings, simplifying travel planning.

[1056] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1057] Step 1: User enters trip details

[1058] Users enter their trip schedule, budget, travel companion information, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains) into an input form on their device. At the same time, the emotion engine analyzes the user's facial expressions and voice, collecting emotional data in real time. Specifically, it uses a webcam and microphone to classify emotional data into categories such as "happiness," "surprise," and "anxiety" using facial recognition software (e.g., OpenCV) and voice analysis software (e.g., Google Speech-to-Text API). Input: Detailed trip information and the user's facial expressions and voice. Output: Detailed trip information and emotional data.

[1059] Step 2: The device sends the trip details and emotion data to the server.

[1060] The device converts the travel details entered by the user and the emotion data obtained by the emotion engine into JSON format and sends it to the server as an HTTP request. Specifically, it uses JavaScript or Python libraries to create a JSON object and sends it to the server using the POST method. Input: User's travel details and emotion data. Output: HTTP request sent to the server.

[1061] Step 3: The server receives and analyzes the user's travel details and emotion data.

[1062] The server receives the HTTP request sent from the device and parses the JSON data. Using a Python framework (e.g., Flask, Django), it parses the request data and extracts the travel timing, budget, travel companion information, points of interest, and emotional data. Input: JSON data sent as an HTTP request. Output: Parsed trip details and emotional data.

[1063] Step 4: The server retrieves the necessary information by consulting an internal database or external API.

[1064] The server queries an internal database (e.g., MySQL, PostgreSQL) or an external API (e.g., Google Places API, Skyscanner API) to retrieve a list of available accommodations for a specified time, transportation options available within a budget, and activities and services that match specific preferences. Input: Parsed trip details and sentiment data. Output: Retrieved accommodation information, transportation information, and activity information.

[1065] Step 5: The server generates optimal itinerary candidates

[1066] The server generates optimal travel plan candidates based on the acquired information. During this process, it uses Python libraries (e.g., Pandas, Numpy) to apply algorithms to process the data. It also takes into account the user's emotional data and generates a plan that includes elements that correspond to those emotions. Input: Acquired accommodation information, transportation information, activity information, and emotional data. Output: Multiple travel plan candidates.

[1067] Step 6: The server evaluates the generated itinerary candidates and selects the best one.

[1068] The server evaluates the generated travel plan candidates and selects the most suitable one. The evaluation process is based on emotional data and evaluation criteria (e.g., rating score of accommodation, convenience of transportation, attractiveness of activities). Input: Multiple travel plan candidates. Output: Selected optimal travel plan.

[1069] Step 7: The server sends the selected travel plan to the terminal.

[1070] The server sends the selected optimal travel plan to the terminal as an HTTP response in JSON format. Input: The selected optimal travel plan. Output: The HTTP response sent to the terminal.

[1071] Step 8: The device displays the received itinerary to the user.

[1072] The terminal analyzes the travel plan data received from the server and displays a detailed travel plan on the screen for the user. The display uses HTML, CSS, and JavaScript to visually show accommodation information, transportation options, fares, and activity lists. Input: Travel plan data sent as an HTTP response from the server. Output: A detailed travel plan displayed to the user.

[1073] Example: If the user enters the following criteria:

[1074] Travel time: Mid-August

[1075] Budget: 100,000 yen

[1076] family of 4

[1077] Breakfast buffet

[1078] Pet-friendly hotels

[1079] Mountain location

[1080] Furthermore, if the emotion engine detects the emotion of "anxiety," the server will take that into consideration and provide a plan that includes a relaxing environment and reassuring services. As a result, the following travel plan is generated and presented to the user:

[1081] Accommodation name: Mountain Relax Resort Hotel

[1082] Transportation: Private car (free parking) or local rental car

[1083] Activities: Nature walks, hiking, local attractions

[1084] Price: 95,000 yen (breakfast buffet included, pets allowed)

[1085] (Application example 2)

[1086] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1087] The present invention aims to provide a means for improving the in-store shopping experience. Conventional shopping systems often make it difficult for users to find an optimal plan that matches their emotions and preferences, resulting in a dissatisfying shopping experience. Furthermore, there is a problem in that appropriate measures cannot be taken when users feel anxious or stressed. Therefore, there is a need for a system that analyzes users' emotions in real time and adjusts the shopping plan accordingly.

[1088] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving detailed shopping information entered by the user, means for analyzing emotion data and adjusting the shopping plan based on the analysis results, and means for obtaining the adjusted shopping plan from an external API. This makes it possible to provide an optimal shopping plan based on the user's emotions.

[1089] "User" means a person who uses the system to create travel plans or shopping plans.

[1090] A "server" is a device that processes information received from users and generates and provides optimal plans by referencing external databases and APIs.

[1091] "Travel details" refers to all the information necessary for planning a trip, such as the timing of the trip, budget, travel companions, and points of interest.

[1092] "Emotional data" refers to information about emotions analyzed from the user's facial expressions and voice.

[1093] "Shopping Plan" means a suggestion that shows optimal shopping progression and choices when a user is shopping.

[1094] An "external API" is an interface for obtaining information by connecting with other systems or databases.

[1095] "Adjustment" refers to the process of optimizing a plan or proposal based on specific conditions and information.

[1096] To implement this invention, the following system configuration and program are required. The system mainly consists of a user terminal, a server, and an external API. In a specific embodiment of the invention, the user inputs detailed shopping or travel information into the terminal, and the input information is sent to the server. The server generates an optimal plan based on the received information and finally displays this plan on the user terminal. Furthermore, the generated plan is adjusted according to the user's emotions through analysis using an emotion engine.

[1097] Hardware and software configuration

[1098] The user terminals are devices such as smartphones and tablets, equipped with a screen for inputting travel and shopping details, a camera and microphone for capturing emotion data, and an emotion engine installed if necessary.

[1099] The server is a high-performance computer used for information analysis and data processing. Its main software components include "EmotionEngine" for emotion analysis, and "ShoppingAPI" and "TravelAPI" for generating shopping and travel plans. These APIs are used to connect with external databases and services to obtain the necessary information.

[1100] Specific examples

[1101] 1. Collecting User Input

[1102] The user uses the device to input detailed shopping information (store to visit, budget, desired product category, points of interest, etc.) For example, "Store: Department Store A," "Budget: 20,000 yen," "Category: Fashion," "Points of interest: Stylish jacket, casual shoes."

[1103] 2. Emotion Data Analysis

[1104] Using the device's camera and microphone, the user's real-time facial expressions and voice are analyzed, and emotional data such as "anxiety" and "joy" is obtained by the emotion engine.

[1105] 3. Sending data to the server

[1106] The shopping details and sentiment data entered by the user are converted into JSON format and sent to the server as an HTTP request.

[1107] 4. Plan generation and adjustment

[1108] The server analyzes the received data and generates an optimal shopping plan by referencing an external API. During this process, the plan is adjusted based on the user's emotional data. For example, if the emotional data indicates "anxiety," measures such as allocating time for consultation with a staff member may be included.

[1109] 5. Displaying the best plan to users

[1110] The adjusted optimal shopping plan is sent to the user's device and displayed to the user.

[1111] Prompt Sentence Examples

[1112] Generate the best shopping plan based on the following criteria:

[1113] 1. Shopping location: Department Store A

[1114] 2. Budget: 20,000 yen

[1115] 3. Product Category: Fashion

[1116] 4. User preferences: Stylish jackets, casual shoes

[1117] 5. User's current emotion: Anxiety

[1118] In the above-described embodiment, the present invention provides optimal shopping plans and travel plans according to the user's emotions.

[1119] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1120] Step 1:

[1121] The user uses the terminal to input detailed shopping information, including the store they plan to visit, their budget, product category, and preferences. For example, they might input information such as "Store: Department Store A," "Budget: 20,000 yen," "Category: Fashion," and "Preferences: A stylish jacket and casual shoes."

[1122] Input: Shopping details (store, budget, category, points of interest)

[1123] Output: User's shopping details stored on the device

[1124] Step 2:

[1125] The device's camera and microphone are used to analyze the user's real-time facial expressions and voice. The emotion engine acquires the user's emotional data (e.g., "anxiety" or "joy"), and emotional data is generated based on the analysis results.

[1126] Input: User's facial expressions and voice

[1127] Output: User emotion data (categories such as "anxiety" or "joy")

[1128] Step 3:

[1129] The shopping details entered by the user and the acquired sentiment data are converted into JSON format, which is then sent to the server as an HTTP request.

[1130] Input: Shopping details, emotion data

[1131] Output: JSON formatted data sent to the server

[1132] Step 4:

[1133] The server receives the HTTP request and parses the JSON data, which is then recognized as shopping details (store, budget, category, preferences) and sentiment data.

[1134] Input: JSON format data (shopping details, emotion data)

[1135] Output: Parsed shopping details, sentiment data

[1136] Step 5:

[1137] The server uses an external API (Shopping API) to generate optimal shopping plan suggestions based on the analyzed data. This process takes into account the user's emotional data. For example, if the user expresses "anxiety," elements with a relaxing effect will be added to the plan.

[1138] Input: Parsed shopping details, sentiment data

[1139] Output: Best shopping plan suggestions

[1140] Step 6:

[1141] The server evaluates the generated shopping plan candidates and determines the most suitable plan based on the emotional data. The evaluation criteria include general product information, price, special offers, and adjustments based on the user's emotional data.

[1142] Input: Optimal shopping plan candidates, sentiment data

[1143] Output: The best shopping plan

[1144] Step 7:

[1145] The server converts the most suitable shopping plan into JSON format and sends it to the user's device, where the user can view the displayed shopping plan.

[1146] Input: Best shopping plan

[1147] Output: Shopping plan sent to the user's device

[1148] Through these steps, users are provided with an optimal shopping plan that takes into account their emotional data in real time, improving their shopping experience.

[1149] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1150] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1151] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1152] [Fourth embodiment]

[1153] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1154] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1155] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1156] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1157] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1158] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1159] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1160] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1161] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1162] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1163] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1164] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1165] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1166] The present invention relates to a travel plan creation support system that allows users to easily obtain efficient and optimal travel plans. The system includes a terminal where users input detailed travel information, a server that processes and analyzes the input information, and a series of means for presenting optimal travel plans to users.

[1167] First, users enter details about their trip, including travel timing, budget, travel companions, and preferences, into an input form on the device. These details might include, for example, "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[1168] The device then sends the entered information to the server, where it is converted to JSON format and sent as an HTTP request.

[1169] The server analyzes the received data and generates optimal travel plan suggestions by referencing an internal database or external API. In the process, it obtains a list of hotels that match the travel timing, a list of transportation options that fit within the budget, and a list of facilities and services that match the user's preferences.

[1170] The server then generates multiple candidate plans based on the acquired information and evaluates each one. During the evaluation process, a generative AI model is used to select the travel plan that best suits the user's input requirements. This selection process takes into account factors such as hotel ratings, transportation convenience, and the attractiveness of activities.

[1171] Finally, the server sends the optimized itinerary to the terminal, which then displays the detailed itinerary to the user, including specific hotel names, transportation options, prices, and activity details.

[1172] For example, if a user inputs criteria such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location," the server will search for and evaluate the best hotels, transportation options, and activities based on these criteria, and generate and present the following itinerary:

[1173] Hotel name: Mountain Resort Hotel

[1174] Transportation: Private car (free parking) or local rental car

[1175] Activities: Nature walks, hiking, local attractions

[1176] Price: 95,000 yen (breakfast buffet included, pets allowed)

[1177] In this way, the system provides users with efficient and optimal travel plans and simplifies their planning.

[1178] The processing flow will be explained below.

[1179] Step 1:

[1180] Users enter detailed information about their trip into an input form on their device, such as travel timing, budget, travel companions, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains, etc.).

[1181] Step 2:

[1182] The terminal converts the information entered by the user into JSON format, which is then sent to the server as an HTTP request.

[1183] Step 3:

[1184] The server receives the HTTP request and parses the JSON data, which is then recognized as travel timing, budget, travel companion information, and preferences.

[1185] Step 4:

[1186] The server retrieves the following information from an internal database or external API:

[1187] A list of hotels available at a given time

[1188] A list of transportation options available within your budget

[1189] A list of activities and services that match your preferences

[1190] Step 5:

[1191] The server generates optimal travel plan candidates based on the acquired information, including combinations of multiple hotels, transportation options, and activities.

[1192] Step 6:

[1193] The server evaluates the generated candidate plans to select the plan that best meets the user's requirements. Evaluation criteria include hotel ratings, convenience of transportation, and attractiveness of activities.

[1194] Step 7:

[1195] The server selects the travel plan with the highest rating and generates the data in JSON format, which is then sent to the user's device as an HTTP response.

[1196] Step 8:

[1197] The device then analyzes the received itinerary data and displays a detailed itinerary to the user, including hotel information, transportation options, fares, and a list of activities.

[1198] Step 9:

[1199] Users can check the displayed travel plans and make reservations or arrangements as necessary. Through all these steps, users can easily obtain an efficient and optimal travel plan.

[1200] Example 1

[1201] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1202] When planning a trip, users must consider various factors and gather a lot of information, which takes time and effort, making it difficult to find the best plan.

[1203] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1204] In this invention, the server includes means for receiving detailed travel information entered by a user, means for converting the received detailed travel information into JSON format and sending it to the server as an HTTP request, means for the server to analyze the received information, refer to an internal database or an external API, and generate optimal travel plan candidates, means for evaluating the generated travel plan candidates using a generative AI model and determining the most suitable travel plan, and means for sending the determined travel plan to a terminal and displaying it to the user, thereby enabling the user to easily and quickly find the optimal travel plan.

[1205] "User" refers to any individual or organization that uses the System to create travel plans.

[1206] "Travel details" refers to specific information about the trip entered by the user, such as travel timing, budget, travel companion information, and points of interest.

[1207] "Terminal" refers to a device such as a computer or smartphone through which a user enters travel details and exchanges information with the server.

[1208] "JSON format" stands for JavaScript Object Notation and refers to a lightweight data exchange format that is easy for humans and machines to read.

[1209] An "HTTP request" refers to the way a client requests data from a server using the Hypertext Transfer Protocol.

[1210] "Server" refers to the equipment or system that receives and processes information sent by users and generates and evaluates optimal travel plans by referencing internal databases or external APIs.

[1211] "Internal database" refers to a database stored within the server, which stores various information used to create travel plans.

[1212] An "external API" refers to an application programming interface provided by an external service, and is an interface that allows a server to communicate with an external service and obtain information.

[1213] "Candidate travel plans" refers to multiple travel plan options generated by the server based on the information analyzed.

[1214] "Generative AI model" refers to an algorithm or computational model that uses artificial intelligence technology to evaluate potential travel plans and select the best one.

[1215] "Send to terminal" refers to the act of sending the travel plan generated by the server to the user's terminal as data.

[1216] "Display to user" refers to the act of presenting the transmitted travel plan in a form that can be viewed by the user on the device.

[1217] The present invention relates to a travel plan creation support system that allows users to easily obtain efficient and optimal travel plans. The system includes a terminal where users input detailed travel information, a server that processes and analyzes the input information, and a series of means for presenting optimal travel plans to users.

[1218] First, the user enters detailed information about the trip into the device. These details include the timing of the trip, budget, travel companions, and points of interest. Specifically, the user enters conditions such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[1219] The device then converts the input information into JSON format and sends it to the server as an HTTP request. The software used by the device can include Python, JavaScript, or an HTTP client library.

[1220] The server analyzes the information it receives and generates optimal travel plan suggestions by referencing an internal database or external API. The software used by the server includes an SQL database (e.g., MySQL) and an API management tool (e.g., Postman). This process obtains a list of hotels that match the travel timing, a list of transportation options available within the budget, and a list of facilities and services that match the customer's preferences.

[1221] The server then uses a generative AI model to generate multiple candidate plans based on the acquired information and evaluates each plan. This evaluation process selects the travel plan that best fits the user's input requirements. Specifically, it takes into account hotel ratings, the convenience of transportation, and the attractiveness of activities. The AI ​​model used by the server includes PyTorch and TensorFlow.

[1222] Finally, the server sends the optimized itinerary to the device, which then displays the detailed itinerary to the user, including specific hotel names, transportation options, prices, and activity details. The software used by the device includes a web browser (e.g., Google Chrome) and a display framework (e.g., React.js).

[1223] For example, if a user inputs criteria such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location," the server will search for and evaluate the best hotels, transportation options, and activities based on these criteria, and generate and present the following itinerary:

[1224] Hotel name: Mountain Resort Hotel

[1225] Transportation: Private car (free parking) or local rental car

[1226] Activities: Nature walks, hiking, local attractions

[1227] Price: 95,000 yen (breakfast buffet included, pets allowed)

[1228] Example prompt for a generative AI model:

[1229] Please suggest the best travel plan based on "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[1230] In this way, the system can provide users with efficient and optimal travel plans and simplify their travel planning.

[1231] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1232] Step 1:

[1233] The user enters the details of the trip into the terminal.

[1234] Examples of input: "Mid-August," "Budget 100,000 yen," "Family of 4," "Breakfast buffet," "Pet-friendly hotel," "Mountain location," etc.

[1235] The terminal receives this information and stores it temporarily in its internal memory.

[1236] Step 2:

[1237] The terminal converts the information received from the user into JSON format and sends it to the server as an HTTP request.

[1238] The software used is Python, JavaScript, or an HTTP client library.

[1239] Input: Trip details entered by the user

[1240] Data processing: Converting trip details into JSON format

[1241] Output: Trip details converted to JSON format

[1242] Example of operation: Generate and send JSON data like {"date":"Mid-August", "budget":100000, "companions":4, "preferences":["Breakfast buffet", "Pets allowed", "Mountain"]}.

[1243] Step 3:

[1244] The server parses the JSON data received from the terminal.

[1245] Analyze the contents of the JSON data and extract the necessary information.

[1246] Input: JSON data sent from the terminal

[1247] Data Operations: Parsing JSON data and extracting information

[1248] Output: Parsed trip details

[1249] Working example: Using Python's standard library, parse a JSON object and get the required information.

[1250] Step 4:

[1251] The server references an internal database or external API based on the analyzed information.

[1252] Get a list of hotels, transportation options, and activities that fit your travel timing, budget, and preferences.

[1253] Input: Parsed trip details

[1254] Data retrieval: using database queries and external API requests

[1255] Output: A list of hotels, transportation options, and activities.

[1256] Example of how it works: Executes a SQL query like SELECT FROM hotels WHERE location='mountain' AND pet_friendly=true to retrieve information from the database, and also makes an external API request to retrieve the latest information.

[1257] Step 5:

[1258] The server generates multiple travel plan options based on the acquired information.

[1259] A generative AI model is used to evaluate each candidate plan.

[1260] Input: List of retrieved hotels, transportation options, and activities

[1261] Data Computing: Generating and Evaluating Travel Plans Using Generative AI Models

[1262] Output: Multiple itinerary candidates with high rating scores

[1263] Example of operation: For each candidate plan, the AI ​​model calculates a score like {"hotel_score":8.5, "transportation_score":9.0, "activity_score":9.2}, and the plan with the highest overall rating is selected.

[1264] Step 6:

[1265] The server converts the optimal travel plan into JSON format and sends it to the terminal.

[1266] Input: Highest rated itinerary

[1267] Data processing: Convert travel plans into JSON format

[1268] Output: Optimal travel plans converted to JSON format

[1269] Example of operation: Generate and send data such as {"hotel_name":"Mountain resort hotel", "transportation":"Private car", "total_cost":95000, "activities":["Nature walk", "Hiking"]}.

[1270] Step 7:

[1271] The terminal displays the optimal travel plan received from the server to the user.

[1272] Input: JSON travel plan data received from the server

[1273] Data processing: Convert JSON data to HTML format

[1274] Output: A user-visible representation of the itinerary

[1275] Example of operation: Display details on a web page such as "Hotel name: Mountain resort hotel", "Transportation method: Private car", "Total cost: 95,000 yen", and "Activities: Nature walks, hiking".

[1276] Through the above steps, users can efficiently obtain the optimal travel plan and simplify their travel planning.

[1277] (Application example 1)

[1278] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1279] Conventional travel planning systems only present optimal travel plans based on detailed information entered by the user, but have the problem of not allowing users to virtually experience the travel destination. As a result, users have no way to experience whether the proposed travel plan actually matches their preferences, which can lead to a decrease in satisfaction and the hassle of changing plans. Therefore, there is a need for a function that allows users to virtually experience a travel destination before actually visiting it.

[1280] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1281] In this invention, the server includes means for receiving detailed travel information entered by a user, means for transmitting the received detailed travel information to the server, means for referencing an internal database or an external API based on the information received by the server to generate optimal travel plan candidates, means for evaluating the generated travel plan candidates and determining the most suitable travel plan, means for transmitting the determined travel plan to a terminal and displaying it to the user, and means for providing a virtual tour function that allows the user to virtually experience a travel destination, thereby enabling the user to virtually experience a travel destination before actually visiting and select a plan that suits their preferences.

[1282] "User" means any person who uses the System to input travel details and obtain optimal travel plans.

[1283] "Travel details" refers to all data about the trip entered by the user, such as travel timing information, budget information, travel companion information, and preference information.

[1284] "Server" refers to the computer system that processes and analyzes the travel details received from the user and generates optimal travel plan suggestions by referencing an internal database or external API.

[1285] An "internal database" is a database stored on a server that contains hotel information, transportation information, and the like used to generate travel plans.

[1286] "External API" means an interface to an external data source that the server accesses to obtain information needed to generate a travel itinerary.

[1287] "Best itinerary suggestions" means multiple itinerary suggestions generated based on the details entered by the user.

[1288] "Evaluation" refers to the process of comparing the generated travel plan candidates and selecting the plan that best suits the user.

[1289] "Determined Travel Plan" means the most suitable travel plan selected based on the evaluation.

[1290] "Terminal" means the device through which a User enters their travel details and on which their travel plans are ultimately displayed.

[1291] The "virtual tour function" allows users to virtually experience a travel destination before actually visiting it.

[1292] The present invention relates to a system that allows users to easily obtain efficient and optimal travel plans. The system includes a terminal where users input detailed travel information, a server that processes and analyzes the input information, and a series of means for presenting optimal travel plans to users.

[1293] First, the user enters detailed information about the trip using the device. These details include the timing of the trip, budget, travel companions, and preferences. For example, the user can enter conditions such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[1294] The device converts the entered details into JSON format and sends it as an HTTP request to the server. The server then analyzes the received information and generates optimal travel plan suggestions by referencing an internal database and external API. In the process, it obtains a list of accommodations that match the travel timing, a list of transportation options available within the user's budget, and a list of facilities and services that match the user's preferences.

[1295] The server evaluates the generated itinerary candidates and selects the one that best meets the user's requirements. This selection process takes into account hotel ratings, transportation convenience, and activity attractiveness. A generative AI model is used in this evaluation process. The generative AI model selects the itinerary that best meets the user's input criteria.

[1296] The selected itinerary is then sent back to the device from the server, where a detailed itinerary is displayed to the user, including specific accommodations, transportation options, prices, and activity details.

[1297] Furthermore, this system has a virtual tour function that allows users to virtually experience the travel destinations they want to visit. This function has the advantage of allowing users to visually check the validity of their travel plans before actually visiting them.

[1298] For example, if a user inputs criteria such as "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location," the server will search for and evaluate the best accommodations, transportation options, and activities based on these criteria, and generate and present the following itinerary:

[1299] Accommodation name: Mountain resort hotel

[1300] Transportation: Private car (free parking) or local rental car

[1301] Activities: Nature walks, hiking, local attractions

[1302] Price: 95,000 yen (breakfast buffet included, pets allowed)

[1303] An example prompt has the following format:

[1304] Generate a virtual travel plan. Please choose the best plan based on the following criteria:

[1305] Timing: Mid-August

[1306] Budget: 100,000 yen

[1307] Accompanying persons: 4 family members

[1308] Specialties: Breakfast buffet, pet-friendly hotel, mountain location

[1309] In this way, the system of the present invention provides users with efficient and optimal travel plans and simplifies the planning process.

[1310] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1311] Step 1:

[1312] The user uses the device to input detailed information about the trip, including the timing, budget, travel companions, and preferences. For example, "mid-August," "budget of 100,000 yen," "family of four," "breakfast buffet," "pet-friendly hotel," and "mountain location."

[1313] Input: Travel timing, budget, travel companions, points of interest

[1314] Output: Trip details entered

[1315] Step 2:

[1316] The device converts the entered travel details into JSON format, then sends it to the server as an HTTP request. During this conversion and transmission process, the device formats the data and communicates with the network.

[1317] Input: Trip details entered by the user

[1318] Output: JSON format data sent to the server

[1319] Step 3:

[1320] The server then parses the trip details it receives, consulting internal databases and external APIs to retrieve a list of accommodations, transportation options, and activities that match the user's criteria.

[1321] Input: Trip details received from the device (JSON format)

[1322] Output: A list of accommodations, transportation options, and activities that match the user's criteria

[1323] Step 4:

[1324] The server generates multiple travel plan options based on the acquired information, processing the data to generate the best options based on travel timing, budget, and preferences.

[1325] Input: List of accommodations, transportation, and activities

[1326] Output: Multiple itinerary candidates generated

[1327] Step 5:

[1328] The server selects the optimal plan from the generated travel plan candidates using a generative AI model. This model evaluates the plan to select the one that best suits the user's input criteria.

[1329] Input: Multiple travel plan options

[1330] Output: The optimal travel plan selected by the generative AI model

[1331] Step 6:

[1332] The server converts the selected optimal travel plan back into JSON format and sends it to the terminal as an HTTP response. During this process, the server performs data conversion and sends the response.

[1333] Input: Selected optimal travel plan

[1334] Output: Optimized itinerary in JSON format sent to the device

[1335] Step 7:

[1336] The terminal visually displays the received optimal travel plan to the user, and also uses a virtual tour function to allow the user to virtually experience the proposed travel destinations. This function allows the user to visually confirm the validity of the travel plan.

[1337] Input: Optimal travel plan received from the server (JSON format)

[1338] Output: A concrete itinerary and virtual tour experience displayed to the user

[1339] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1340] This invention combines an emotion engine with a travel plan creation support system that enables users to easily obtain efficient and optimal travel plans. This system includes a terminal where users input detailed travel information, a server that processes and analyzes the input information, and a series of means for presenting optimal travel plans to users, and further includes an emotion engine that recognizes the user's emotions and adjusts the plan accordingly.

[1341] First, the user enters detailed information about the trip into an input form on the device, such as the timing of the trip, budget, travel companions, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains, etc.).

[1342] The emotion engine also works to analyze the user's emotions in real time from their facial expressions and voice. The analyzed emotions are classified into categories such as "happiness," "surprise," and "anxiety." This information is included in the trip details sent from the device to the server.

[1343] Next, the device converts the information entered by the user and the emotional data obtained by the emotion engine into JSON format and sends it to the server as an HTTP request.

[1344] The server receives the HTTP request and parses the JSON data, which is then recognized as travel timing, budget, travel companion information, preferences, and even user sentiment.

[1345] The server retrieves the following information from an internal database or external API:

[1346] A list of hotels available at a given time

[1347] A list of transportation options available within your budget

[1348] A list of activities and services that match your preferences

[1349] The server generates optimal travel plan candidates based on the acquired information. This process also takes into account the user's emotional data. For example, if the user expresses anxiety, plans that include elements that reduce stress will be evaluated. Conversely, if the user expresses joy, plans that include elements that reinforce that emotion will be prioritized.

[1350] The server then evaluates the generated candidate plans and selects the most suitable one. The evaluation process relies on data from the emotion engine, such as hotel ratings, transportation convenience, activity attractiveness, and adjustments based on the user's emotion data.

[1351] Finally, the server sends the optimized itinerary to the device, which then analyzes the received itinerary data and displays a detailed itinerary to the user, including hotel information, transportation options, fares, and a list of activities.

[1352] For example, if a user specifies the following in their input method:

[1353] "Travel timing: Mid-August"

[1354] "Budget: 100,000 yen"

[1355] "Family of 4"

[1356] "Breakfast buffet"

[1357] "Pet-friendly hotel"

[1358] "Mountain location"

[1359] Furthermore, if the emotion engine detects the emotion of "anxiety" while the user is typing, the server will take that into consideration and provide a plan that includes a relaxing environment and reassuring services. As a result, the following travel plan will be generated and presented to the user:

[1360] Hotel name: Mountain Relax Resort Hotel

[1361] Transportation: Private car (free parking) or local rental car

[1362] Activities: Nature walks, hiking, local attractions

[1363] Price: 95,000 yen (breakfast buffet included, pets allowed)

[1364] In this way, the system provides optimal travel plans that take the user's emotions into account and simplifies the planning process.

[1365] The processing flow will be explained below.

[1366] Step 1:

[1367] The user enters the details of the trip into the input form on the terminal, such as the timing of the trip, budget, travel companion information, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains).

[1368] Step 2:

[1369] The device acquires the user's input information. The emotion engine then analyzes the user's emotions in real time from their facial expressions and voice when they input information. The emotion engine classifies emotions into categories such as "happiness," "surprise," and "anxiety."

[1370] Step 3:

[1371] The device converts the acquired travel details and the emotion data analyzed by the emotion engine into JSON format, and then sends the converted data to the server as an HTTP request.

[1372] Step 4:

[1373] The server receives the HTTP request and parses the JSON data, which is then recognized as travel timing, budget, travel companion information, preferences, and user sentiment information.

[1374] Step 5:

[1375] The server retrieves the following information from an internal database or external API:

[1376] A list of hotels available at a given time

[1377] A list of transportation options available within your budget

[1378] A list of activities and services that match your preferences

[1379] Step 6:

[1380] The server generates optimal travel plan candidates based on the acquired information. In this process, it takes into account the user's emotional data. For example, if the user expresses anxiety, it will prioritize plans that include a relaxing environment and reassuring services. Conversely, if the user expresses joy, it will prioritize plans that reinforce those emotions.

[1381] Step 7:

[1382] The server evaluates the generated candidate plans. The evaluation process includes adjustments based on hotel rating scores, transportation convenience, activity attractiveness, and user sentiment data. The server uses an AI model to evaluate and select the most suitable travel plan.

[1383] Step 8:

[1384] The server determines the optimal travel plan based on the ratings and generates the data in JSON format, which is then sent to the user's device as an HTTP response.

[1385] Step 9:

[1386] The device then analyzes the received itinerary data and displays a detailed itinerary to the user, including specific hotel names, transportation options, prices, and activity details.

[1387] Step 10:

[1388] The user can then review the displayed itinerary and make reservations or arrangements as necessary. Through all these steps, the user can obtain an efficient and optimal itinerary that is tailored based on their emotions.

[1389] Example 2

[1390] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1391] Conventional travel planning systems do not take user emotions into account when generating plans, which leaves the user experience unsatisfied. In particular, plans that ignore users' emotions, such as anxiety and joy, make it difficult to provide an optimal travel experience. Furthermore, conventional systems create plans based solely on detailed information provided by the user, which means they cannot fully satisfy the user's complex needs and desires.

[1392] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving detailed travel information entered by the user and emotion data analyzed in real time, and generating optimal travel plan candidates by referencing an internal database or an external API; means for evaluating the generated travel plan candidates and determining the most suitable travel plan taking the user's emotion data into consideration; and means for transmitting the determined travel plan to the terminal and displaying it to the user. This makes it possible to provide an optimal travel plan that reflects the user's emotions, significantly improving the user experience.

[1393] 1. "User" means an entity that uses this system to make travel plans.

[1394] 2. "Travel details" refers to information about travel plans provided by users, such as travel timing, budget, travel companion information, and points of interest.

[1395] 3. "Emotional data" refers to emotional information analyzed in real time from the user's facial expressions and voice, and is classified into categories such as "joy," "surprise," and "anxiety."

[1396] 4. "Terminal" means a device through which a user inputs travel details and transmits emotion data, including a PC, smartphone, tablet, etc.

[1397] 5. "Server" means an information processing device including hardware and software that receives detailed travel information and emotion data sent from a terminal and generates, evaluates, and determines the optimal travel plan based on this information.

[1398] 6. "Means for receiving" refers to the function by which the server receives detailed travel information and emotion data sent from the terminal.

[1399] 7. "Means of reference" refers to the function that allows the server to obtain the necessary data from an internal database or external API.

[1400] 8. "Means for generating potential itineraries" means the algorithms and processes for generating multiple itineraries based on the received information.

[1401] 9. "Means for evaluation" refers to a function for selecting the optimal plan from multiple generated travel plans based on the user's emotional data and other evaluation criteria.

[1402] 10. "Transmission means" is a function for transmitting the travel plan determined by the server to the terminal.

[1403] 11. "Display means" refers to the function by which the terminal visually presents the travel plan received by the terminal to the user.

[1404] 12. "Internal Database" means data storage that accumulates travel-related information for reference by the Server when generating travel plans.

[1405] 13. "External API" means an application program interface that allows a server to obtain necessary information from external services.

[1406] 14. "Accommodation information" refers to information about hotels, guesthouses, etc. that is used when creating travel plans.

[1407] 15. "Transportation Information" means information about the transportation options available during a trip.

[1408] 16. "Activity Information" means information about sightseeing and leisure activities that can be done at a travel destination.

[1409] The present invention is a travel plan creation support system that allows users to easily obtain efficient and optimal travel plans, and by combining it with an emotion engine, provides travel plans that take user emotions into consideration. The following describes in detail the embodiments of the present invention.

[1410] First, the user enters the details of their trip using a device (e.g., PC, smartphone, tablet). This information includes the timing of the trip, budget, travel companion information, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains). An emotion engine is then applied to detect the user's facial expressions and voice in real time. Emotion analysis is performed using facial recognition software (e.g., OpenCV) and voice analysis software (e.g., Google Speech-to-Text API), and the emotional data is classified into categories such as "happiness," "surprise," and "anxiety."

[1411] Next, the device converts the travel details entered by the user and the emotion data analyzed by the emotion engine into JSON format and sends it to the server as an HTTP request, using JavaScript or Python libraries to generate a JSON object and sending it to the server using the POST method.

[1412] The server processes the HTTP request received from the device and analyzes the JSON data sent. This analysis extracts travel timing, budget, travel companion information, preferences, and emotional data. A Python framework (e.g., Flask, Django) is used for analysis to parse the request data and extract various pieces of information.

[1413] The server then accesses an internal database (e.g. MySQL, PostgreSQL) or an external API (e.g. Google Places API, Skyscanner API) to retrieve the following information:

[1414] A list of accommodations available at a specified time

[1415] A list of transportation options available within your budget

[1416] A list of activities and services that match your preferences

[1417] The server then uses this information to generate optimal travel plan suggestions. It uses Python's Pandas and Numpy to process the data and apply algorithms to create an appropriate plan. It also takes into account the user's emotional data and incorporates elements that correspond to their emotions (e.g., relaxing elements if they indicate anxiety, exciting elements if they indicate joy) into the plan.

[1418] The generated itinerary candidates are evaluated based on emotional data and evaluation criteria (e.g., accommodation rating, convenience of transportation, attractiveness of activities). The most suitable itinerary is then selected. The server again sends the selected itinerary to the terminal as an HTTP response in JSON format.

[1419] The device parses the received itinerary data and displays a detailed itinerary to the user on the screen, clearly displaying accommodation information, transportation options, prices, and activity lists using HTML, CSS, and JavaScript.

[1420] For example, if the user enters the following criteria:

[1421] Travel time: Mid-August

[1422] Budget: 100,000 yen

[1423] family of 4

[1424] Breakfast buffet

[1425] Pet-friendly hotels

[1426] Mountain location

[1427] Furthermore, if the emotion engine detects the emotion of "anxiety," the server will take that into consideration and provide a plan that includes a relaxing environment and reassuring services. As a result, the following travel plan is generated and presented to the user:

[1428] Accommodation name: Mountain Relax Resort Hotel

[1429] Transportation: Private car (free parking) or local rental car

[1430] Activities: Nature walks, hiking, local attractions

[1431] Price: 95,000 yen (breakfast buffet included, pets allowed)

[1432] In this way, the system of the present invention provides an optimal travel plan that reflects the user's feelings, simplifying travel planning.

[1433] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1434] Step 1: User enters trip details

[1435] Users enter their trip schedule, budget, travel companion information, and preferences (e.g., breakfast buffet, pet-friendly, location with mountains) into an input form on their device. At the same time, the emotion engine analyzes the user's facial expressions and voice, collecting emotional data in real time. Specifically, it uses a webcam and microphone to classify emotional data into categories such as "happiness," "surprise," and "anxiety" using facial recognition software (e.g., OpenCV) and voice analysis software (e.g., Google Speech-to-Text API). Input: Detailed trip information and the user's facial expressions and voice. Output: Detailed trip information and emotional data.

[1436] Step 2: The device sends the trip details and emotion data to the server.

[1437] The device converts the travel details entered by the user and the emotion data obtained by the emotion engine into JSON format and sends it to the server as an HTTP request. Specifically, it uses JavaScript or Python libraries to create a JSON object and sends it to the server using the POST method. Input: User's travel details and emotion data. Output: HTTP request sent to the server.

[1438] Step 3: The server receives and analyzes the user's travel details and emotion data.

[1439] The server receives the HTTP request sent from the device and parses the JSON data. Using a Python framework (e.g., Flask, Django), it parses the request data and extracts the travel timing, budget, travel companion information, points of interest, and emotional data. Input: JSON data sent as an HTTP request. Output: Parsed trip details and emotional data.

[1440] Step 4: The server retrieves the necessary information by consulting an internal database or external API.

[1441] The server queries an internal database (e.g., MySQL, PostgreSQL) or an external API (e.g., Google Places API, Skyscanner API) to retrieve a list of available accommodations for a specified time, transportation options available within a budget, and activities and services that match specific preferences. Input: Parsed trip details and sentiment data. Output: Retrieved accommodation information, transportation information, and activity information.

[1442] Step 5: The server generates optimal itinerary candidates

[1443] The server generates optimal travel plan candidates based on the acquired information. During this process, it uses Python libraries (e.g., Pandas, Numpy) to apply algorithms to process the data. It also takes into account the user's emotional data and generates a plan that includes elements that correspond to those emotions. Input: Acquired accommodation information, transportation information, activity information, and emotional data. Output: Multiple travel plan candidates.

[1444] Step 6: The server evaluates the generated itinerary candidates and selects the best one.

[1445] The server evaluates the generated travel plan candidates and selects the most suitable one. The evaluation process is based on emotional data and evaluation criteria (e.g., rating score of accommodation, convenience of transportation, attractiveness of activities). Input: Multiple travel plan candidates. Output: Selected optimal travel plan.

[1446] Step 7: The server sends the selected travel plan to the terminal.

[1447] The server sends the selected optimal travel plan to the terminal as an HTTP response in JSON format. Input: The selected optimal travel plan. Output: The HTTP response sent to the terminal.

[1448] Step 8: The device displays the received itinerary to the user.

[1449] The terminal analyzes the travel plan data received from the server and displays a detailed travel plan on the screen for the user. The display uses HTML, CSS, and JavaScript to visually show accommodation information, transportation options, fares, and activity lists. Input: Travel plan data sent as an HTTP response from the server. Output: A detailed travel plan displayed to the user.

[1450] Example: If the user enters the following criteria:

[1451] Travel time: Mid-August

[1452] Budget: 100,000 yen

[1453] family of 4

[1454] Breakfast buffet

[1455] Pet-friendly hotels

[1456] Mountain location

[1457] Furthermore, if the emotion engine detects the emotion of "anxiety," the server will take that into consideration and provide a plan that includes a relaxing environment and reassuring services. As a result, the following travel plan is generated and presented to the user:

[1458] Accommodation name: Mountain Relax Resort Hotel

[1459] Transportation: Private car (free parking) or local rental car

[1460] Activities: Nature walks, hiking, local attractions

[1461] Price: 95,000 yen (breakfast buffet included, pets allowed)

[1462] (Application example 2)

[1463] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1464] The present invention aims to provide a means for improving the in-store shopping experience. Conventional shopping systems often make it difficult for users to find an optimal plan that matches their emotions and preferences, resulting in a dissatisfying shopping experience. Furthermore, there is a problem in that appropriate measures cannot be taken when users feel anxious or stressed. Therefore, there is a need for a system that analyzes users' emotions in real time and adjusts the shopping plan accordingly.

[1465] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving detailed shopping information entered by the user, means for analyzing emotion data and adjusting the shopping plan based on the analysis results, and means for obtaining the adjusted shopping plan from an external API. This makes it possible to provide an optimal shopping plan based on the user's emotions.

[1466] "User" means a person who uses the system to create travel plans or shopping plans.

[1467] A "server" is a device that processes information received from users and generates and provides optimal plans by referencing external databases and APIs.

[1468] "Travel details" refers to all the information necessary for planning a trip, such as the timing of the trip, budget, travel companions, and points of interest.

[1469] "Emotional data" refers to information about emotions analyzed from the user's facial expressions and voice.

[1470] "Shopping Plan" means a suggestion that shows optimal shopping progression and choices when a user is shopping.

[1471] An "external API" is an interface for obtaining information by connecting with other systems or databases.

[1472] "Adjustment" refers to the process of optimizing a plan or proposal based on specific conditions and information.

[1473] To implement this invention, the following system configuration and program are required. The system mainly consists of a user terminal, a server, and an external API. In a specific embodiment of the invention, the user inputs detailed shopping or travel information into the terminal, and the input information is sent to the server. The server generates an optimal plan based on the received information and finally displays this plan on the user terminal. Furthermore, the generated plan is adjusted according to the user's emotions through analysis using an emotion engine.

[1474] Hardware and software configuration

[1475] The user terminals are devices such as smartphones and tablets, equipped with a screen for inputting travel and shopping details, a camera and microphone for capturing emotion data, and an emotion engine installed if necessary.

[1476] The server is a high-performance computer used for information analysis and data processing. Its main software components include "EmotionEngine" for emotion analysis, and "ShoppingAPI" and "TravelAPI" for generating shopping and travel plans. These APIs are used to connect with external databases and services to obtain the necessary information.

[1477] Specific examples

[1478] 1. Collecting User Input

[1479] The user uses the device to input detailed shopping information (store to visit, budget, desired product category, points of interest, etc.) For example, "Store: Department Store A," "Budget: 20,000 yen," "Category: Fashion," "Points of interest: Stylish jacket, casual shoes."

[1480] 2. Emotion Data Analysis

[1481] Using the device's camera and microphone, the user's real-time facial expressions and voice are analyzed, and emotional data such as "anxiety" and "joy" is obtained by the emotion engine.

[1482] 3. Sending data to the server

[1483] The shopping details and sentiment data entered by the user are converted into JSON format and sent to the server as an HTTP request.

[1484] 4. Plan generation and adjustment

[1485] The server analyzes the received data and generates an optimal shopping plan by referencing an external API. During this process, the plan is adjusted based on the user's emotional data. For example, if the emotional data indicates "anxiety," measures such as allocating time for consultation with a staff member may be included.

[1486] 5. Displaying the best plan to users

[1487] The adjusted optimal shopping plan is sent to the user's device and displayed to the user.

[1488] Prompt Sentence Examples

[1489] Generate the best shopping plan based on the following criteria:

[1490] 1. Shopping location: Department Store A

[1491] 2. Budget: 20,000 yen

[1492] 3. Product Category: Fashion

[1493] 4. User preferences: Stylish jackets, casual shoes

[1494] 5. User's current emotion: Anxiety

[1495] In the above-described embodiment, the present invention provides optimal shopping plans and travel plans according to the user's emotions.

[1496] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1497] Step 1:

[1498] The user uses the terminal to input detailed shopping information, including the store they plan to visit, their budget, product category, and preferences. For example, they might input information such as "Store: Department Store A," "Budget: 20,000 yen," "Category: Fashion," and "Preferences: A stylish jacket and casual shoes."

[1499] Input: Shopping details (store, budget, category, points of interest)

[1500] Output: User's shopping details stored on the device

[1501] Step 2:

[1502] The device's camera and microphone are used to analyze the user's real-time facial expressions and voice. The emotion engine acquires the user's emotional data (e.g., "anxiety" or "joy"), and emotional data is generated based on the analysis results.

[1503] Input: User's facial expressions and voice

[1504] Output: User emotion data (categories such as "anxiety" or "joy")

[1505] Step 3:

[1506] The shopping details entered by the user and the acquired sentiment data are converted into JSON format, which is then sent to the server as an HTTP request.

[1507] Input: Shopping details, emotion data

[1508] Output: JSON formatted data sent to the server

[1509] Step 4:

[1510] The server receives the HTTP request and parses the JSON data, which is then recognized as shopping details (store, budget, category, preferences) and sentiment data.

[1511] Input: JSON format data (shopping details, emotion data)

[1512] Output: Parsed shopping details, sentiment data

[1513] Step 5:

[1514] The server uses an external API (Shopping API) to generate optimal shopping plan suggestions based on the analyzed data. This process takes into account the user's emotional data. For example, if the user expresses "anxiety," elements with a relaxing effect will be added to the plan.

[1515] Input: Parsed shopping details, sentiment data

[1516] Output: Best shopping plan suggestions

[1517] Step 6:

[1518] The server evaluates the generated shopping plan candidates and determines the most suitable plan based on the emotional data. The evaluation criteria include general product information, price, special offers, and adjustments based on the user's emotional data.

[1519] Input: Optimal shopping plan candidates, sentiment data

[1520] Output: The best shopping plan

[1521] Step 7:

[1522] The server converts the most suitable shopping plan into JSON format and sends it to the user's device, where the user can view the displayed shopping plan.

[1523] Input: Best shopping plan

[1524] Output: Shopping plan sent to the user's device

[1525] Through these steps, users are provided with an optimal shopping plan that takes into account their emotional data in real time, improving their shopping experience.

[1526] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1527] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1528] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1529] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1530] FIG. 9 illustrates an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and behaviors arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1531] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1532] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1533] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1534] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1535] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1536] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1537] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1538] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1539] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1540] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1541] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1542] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1543] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1544] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1545] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1546] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1547] The following is further disclosed regarding the above embodiment.

[1548] (Claim 1)

[1549] a means of receiving the user's entered travel details;

[1550] means for transmitting the received travel details to a server;

[1551] A means for generating optimal travel plan candidates by referencing an internal database or external API based on the information received by the server;

[1552] a means for evaluating the generated candidate travel plans and determining the most suitable travel plan;

[1553] means for transmitting the determined travel plan to the terminal and displaying it to the user;

[1554] A system including:

[1555] (Claim 2)

[1556] 2. The system according to claim 1, wherein the detailed travel information includes travel timing information, budget information, travel companion information, and preference point information.

[1557] (Claim 3)

[1558] The system of claim 1, which obtains hotel information, transportation information, and activity information based on reference to an internal database or an external API.

[1559] "Example 1"

[1560] (Claim 1)

[1561] a means of receiving the user's entered travel details;

[1562] A means to convert the received trip details into JSON format and send it to the server as an HTTP request;

[1563] The server analyzes the received information, references the internal database and external API, and generates optimal travel plan suggestions.

[1564] A means for evaluating candidate travel plans generated using the generative AI model and determining the most suitable travel plan; and

[1565] means for transmitting the determined travel plan to the terminal and displaying it to the user;

[1566] A system including:

[1567] (Claim 2)

[1568] 2. The system according to claim 1, wherein the detailed travel information includes travel timing information, budget information, travel companion information, and preference point information.

[1569] (Claim 3)

[1570] The system according to claim 1, which obtains accommodation information, transportation information, and activity information based on reference to an internal database or an external API.

[1571] "Application Example 1"

[1572] (Claim 1)

[1573] a means of receiving the user's entered travel details;

[1574] means for transmitting the received travel details to a server;

[1575] A means for generating optimal travel plan candidates by referencing an internal database or external API based on the information received by the server;

[1576] a means for evaluating the generated candidate travel plans and determining the most suitable travel plan;

[1577] means for transmitting the determined travel plan to the terminal and displaying it to the user;

[1578] A means for providing a virtual tour function that allows users to virtually experience a travel destination;

[1579] A system including:

[1580] (Claim 2)

[1581] 2. The system according to claim 1, wherein the detailed travel information includes travel timing information, budget information, travel companion information, and preference point information.

[1582] (Claim 3)

[1583] The system according to claim 1, which acquires accommodation information, transportation information, and activity information based on reference to an internal database or an external API.

[1584] "Example 2: Combining Emotion Engines"

[1585] (Claim 1)

[1586] a means of receiving the user's entered travel details;

[1587] means for transmitting the received travel details and real-time analyzed emotion data to a server;

[1588] A means for generating optimal travel plan candidates by referencing an internal database or external API based on the information received by the server;

[1589] a means for evaluating the generated travel plan candidates and determining the most suitable travel plan taking into account the user's sentiment data;

[1590] means for transmitting the determined travel plan to the terminal and displaying it to the user;

[1591] A system including:

[1592] (Claim 2)

[1593] 2. The system according to claim 1, wherein the detailed travel information includes travel timing information, budget information, travel companion information, and preference point information.

[1594] (Claim 3)

[1595] The system according to claim 1, which acquires accommodation information, transportation information, and activity information based on reference to an internal database or an external API.

[1596] "Application example 2 when combining emotion engines"

[1597] New Claims

[1598] (Claim 1)

[1599] a means of receiving the user's entered travel details;

[1600] means for transmitting the received travel details to a server;

[1601] A means for generating optimal travel plan candidates by referencing an internal database or external API based on the information received by the server;

[1602] a means for evaluating the generated candidate travel plans and determining the most suitable travel plan;

[1603] means for transmitting the determined travel plan to the terminal and displaying it to the user;

[1604] A means for analyzing user sentiment data and adjusting shopping plans based on the analysis results;

[1605] A means to retrieve the adjusted shopping plan from an external API;

[1606] A system including:

[1607] (Claim 2)

[1608] 2. The system according to claim 1, wherein the detailed travel information includes travel timing information, budget information, travel companion information, and preference point information.

[1609] (Claim 3)

[1610] 10. The system of claim 1, wherein hotel information, transportation information, activity information, and shopping information are obtained based on reference to an internal database or an external API. [Explanation of symbols]

[1611] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a means of receiving the user's entered travel details; means for transmitting the received travel details to a server; A means for generating optimal travel plan candidates by referencing an internal database or external API based on the information received by the server; a means for evaluating the generated candidate travel plans and determining the most suitable travel plan; means for transmitting the determined travel plan to the terminal and displaying it to the user; A system including:

2. The system according to claim 1 , wherein the detailed travel information includes travel timing information, budget information, travel companion information, and preference point information.

3. The system according to claim 1, wherein hotel information, transportation information, and activity information are acquired by referencing an internal database or an external API.

Images