System

Abstract

A system is provided.SOLUTION: Means for obtaining user-input information, means for creating and updating a profile based on past travel history and user preferences, means for generating an individually optimized travel plan using a generative AI model, means for obtaining real-time up-to-date tourist information, events, and reviews from the Internet, means for generating an optimized travel plan within an inputted budget, and means for presenting the generated travel plan to the user; The system includes a means for enabling customization, a means for collectively reserving accommodation facilities, transportation means, and activities based on a plan approved by a user, and a means for allowing the user to confirm and finally adjust reservation contents.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Planning a trip is a complex and time-consuming task, requiring users to manually search and compare destinations, tourist information, accommodations, and transportation details. Budget management is also crucial, but this process is time-consuming and often requires out-of-date information. Traditional travel planning systems and services struggle to provide optimal recommendations because they are unable to consider individual user preferences or past travel history, and lack the ability to update information in real time. To address these challenges, a system was needed that could automate and individually optimize trip planning, providing users with the best possible travel plans. [Means for solving the problem]

[0005] The present invention provides a travel planning system that includes means for acquiring user input information, means for creating and updating a profile based on past travel history and user preferences, means for generating an individually optimized travel plan using a generative AI model, means for acquiring the latest tourist information, events, and reviews from the Internet in real time, means for generating an optimized travel plan within an input budget, means for presenting the generated travel plan to the user and enabling customization, means for booking accommodations, transportation, and activities all at once based on the plan approved by the user, and means for allowing the user to confirm and finalize the reservation details. In this way, the present invention automatically generates an efficient and personalized travel plan based on the user's individual needs and the latest information, significantly reducing cumbersome manual work and providing a more comfortable travel experience.

[0006] "User-entered information" refers collectively to information provided by a user to the system, including travel destination, duration, budget, interests, etc.

[0007] A "profile" is a collection of data that describes a user's characteristics, based on the user's past travel history, preferences, etc.

[0008] A "generative AI model" refers to an algorithm or program that uses artificial intelligence to automatically generate the optimal travel plan for a user.

[0009] "Travel Plan" means a plan for a User's trip that includes details such as the specific itinerary, attractions, restaurants, accommodations, and transportation.

[0010] "Real-time, up-to-date tourist information, events, and reviews" refers to the latest data and ratings about travel destinations that are continuously retrieved from the Internet.

[0011] "Budget-optimized travel plan" refers to the most efficient and effective travel plan within the budget set by the user.

[0012] "Customization" refers to the user editing and adjusting the proposed itinerary to suit their own preferences and needs.

[0013] "Bulk booking solution" refers to a system or method for booking all your accommodation, transportation, activities, and other essential items in one place.

[0014] "Means for confirmation and final adjustment" refers to a function that allows the user to confirm the reservation details and make final adjustments if necessary. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11]FIG. 3 is a sequence diagram illustrating a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] The present invention is a travel planning system for efficiently and individually optimizing a user's travel plan. The configuration and operation of the system will be described below as a specific embodiment for carrying out the present invention.

[0037] System configuration:

[0038] 1. Obtaining user input information

[0039] Users enter basic information about their trip into the device, such as destination, duration, budget, and specific interests (e.g., visiting museums).

[0040] The terminal collects the input information and transmits it to the server.

[0041] Example: User enters "Tokyo, 5 days, budget 100,000 yen, museum visit."

[0042] 2. Creating and updating your profile

[0043] The server retrieves the user's past travel history and preferences from a database and combines them with newly entered information to create or update a user profile.

[0044] Example: The server updates a user's profile based on the data that "the user enjoyed visiting art museums in Kyoto in the past."

[0045] 3. Generate a travel plan

[0046] The server uses a generative AI model to automatically generate a travel plan based on the user's current profile and input information, including attractions, restaurants, activities, accommodations, and transportation options.

[0047] Example: The server creates a plan including tourist attractions, places to eat, and activities based on the conditions "visiting art museums in Tokyo," "budget within 100,000 yen," and "5 days."

[0048] 4. Obtaining real-time information

[0049] The server obtains the latest tourist information, events, restaurant reviews, and other information about the destination in real time via the Internet and reflects this information in the generated plan.

[0050] Example: The server obtains information such as "A special exhibition is being held at the Ueno Art Museum" and "A new cafe has opened in Ginza" and adds them to the plan.

[0051] 5. Optimizing within your budget

[0052] The server generates an optimized travel plan within the user's budget, calculating the breakdown of costs and adjusting them so that the plan does not exceed the user's budget.

[0053] Example: The server calculates the cost of accommodation, transportation, meals, museum admission fees, etc., and adjusts the total cost to stay within 100,000 yen.

[0054] 6. Providing and customizing travel plans

[0055] The terminal presents the generated travel plan to the user, allowing the user to review and customize the plan contents.

[0056] Users can review the proposed itinerary and edit or adjust it as needed.

[0057] Example: A user customizes a proposed plan by, for example, changing the lunch location on day 2 or adding a new art gallery on day 4.

[0058] 7. Bulk booking processing

[0059] The server makes all reservations for accommodation, transportation, activities, etc. based on the plan confirmed by the user.

[0060] Example: A server centralizes hotel reservations, train ticket bookings, museum ticket purchases, etc.

[0061] 8. Confirmation and final adjustments

[0062] The server sends all reservation confirmation information to the terminal.

[0063] The terminal displays the reservation details to the user and presents a confirmation screen.

[0064] The user then finalizes the reservation and makes any necessary adjustments.

[0065] Example: The terminal displays "Hotel reservation: confirmed," "Train ticket: confirmed," and "Museum ticket: confirmed," and you click "OK" in response to the confirmation message "Are you sure about this?"

[0066] In this way, the travel planning system of the present invention efficiently generates personalized travel plans that meet the user's needs, manages budgets while reflecting real-time information, and performs all reservation procedures in one go, thereby significantly reducing the user's travel planning workload and providing a comfortable travel experience.

[0067] The processing flow will be explained below.

[0068] Step 1:

[0069] The user inputs the travel destination, duration, budget, and interests (e.g., visiting museums) into the device. The device acquires this information and sends it to the server.

[0070] Step 2:

[0071] The server receives the entered information, retrieves the user's past travel history and preferences from a database, and combines the newly entered information with the previous data to create or update the user profile.

[0072] Step 3:

[0073] The server uses a generative AI model to generate a personalized itinerary based on the updated user profile and input, which includes details on attractions, restaurants, activities, accommodation, transportation, and more.

[0074] Step 4:

[0075] The server obtains the latest tourist information, events, restaurant reviews, and other information about the destination in real time via the Internet and reflects this information in the generated plan.

[0076] Step 5:

[0077] The server generates an optimized travel plan within the user's budget, calculating the breakdown of expenses and adjusting the plan to stay within the budget.

[0078] Step 6:

[0079] The server sends the generated travel plan to the terminal, which provides the user with an interface to display and customize the plan.

[0080] Step 7:

[0081] The user checks the presented travel plan and customizes it as necessary. The device saves the user's editing operations and sends the data to the server.

[0082] Step 8:

[0083] Once the user finalizes their travel plans, the server makes all reservations for accommodation, transportation, activities, etc. in one go.

[0084] Step 9:

[0085] The server sends all reservation confirmation information to the terminal, which displays the reservation details to the user and presents a confirmation screen, where the user can finally review the reservation details and make any final adjustments if necessary.

[0086] Example 1

[0087] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0088] Current travel planning systems struggle to efficiently and individually optimize users' travel plans. They also lack the ability to reflect real-time information, manage budgets, and process reservations in bulk. Furthermore, they lack the ability to validate user input and integrate it with past travel history, resulting in travel plans that cannot fully meet users' needs.

[0089] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0090] In this invention, the server includes means for acquiring user-input information, means for creating and updating a profile based on past travel history and user preferences, means for generating an individually optimized travel plan using a generative AI model, means for acquiring the latest tourist information, events, and reviews from the Internet in real time, means for generating an optimized travel plan within an input budget, means for presenting the generated travel plan to the user and enabling customization, means for booking accommodations, transportation, and activities all at once based on the plan approved by the user, means for allowing the user to confirm and finalize the reservation details, means for verifying user information and sending it to the server in a correct format, means for acquiring past travel history and user preferences from a database, and means for inputting prompt statements to the generative AI model. This enables efficient generation of personalized travel plans tailored to user needs, reflecting real-time information, budget management, and batch booking processing.

[0091] "User-entered information" refers to data that a user enters into a terminal, including basic information about the trip (destination, duration, budget, interests, etc.).

[0092] "Profile" refers to a user's individual information that is generated and updated by integrating the user's past travel history and preferences with current input information.

[0093] A "generative AI model" is an artificial intelligence model that automatically generates optimal travel plans based on input prompts.

[0094] "Real-time information" refers to the latest tourist information, events, reviews, etc. obtained via the Internet.

[0095] A "budget-optimized travel plan" is a travel plan generated by adjusting various expenses within the budget set by the user.

[0096] "Customization" means the act of a user editing or adjusting the content of a presented travel plan.

[0097] "Bulk booking" refers to the process of booking accommodation, transportation, activities, etc. all at once based on a user's confirmed travel plans.

[0098] "Final adjustment" refers to the act of the user finally checking the reservation details and making any necessary changes.

[0099] "User information validation" refers to the process of ensuring that the information entered by the user is in the correct format.

[0100] "Database" refers to a system for managing and storing information such as a user's past travel history and preferences.

[0101] A "prompt sentence" is a specific instruction sentence that is input into a generative AI model.

[0102] The present invention is a travel planning system for efficiently and individually optimizing a user's travel plans. The system allows the user to input basic travel information, and automatically generates a travel plan tailored to individual needs based on that information. The following describes the configuration and operation of the system as a specific embodiment of the present invention.

[0103] System configuration:

[0104] 1. Obtaining user input information

[0105] Users enter basic information about their trip (destination, duration, budget, interests) into an input form on their device.

[0106] The terminal validates the entered information to ensure it is in the correct format, then transmits it to the server.

[0107] Hardware and software used:

[0108] Hardware: Personal computers, smartphones, servers

[0109] Software: web browsers, database management systems (e.g., MySQL), generative AI models (e.g., OpenAI GPT-4)

[0110] Specific working example:

[0111] 1. Obtaining user input information

[0112] When a user enters "Tokyo, 5 days, budget 100,000 yen, museum visit" into the form on their device and clicks the "Submit" button, the device sends this information to the server.

[0113] 2. Creating and updating your profile

[0114] The server accesses the database with the received user information to retrieve the user's past travel history and preferences, and combines the newly entered information with existing data to create or update an updated user profile.

[0115] Example: The server retrieves data from the travel history table, such as "I enjoyed visiting museums in Kyoto in the past," and adds new information, such as "Tokyo, 5 days, visiting museums."

[0116] 3. Generate a travel plan

[0117] The server uses a generative AI model (e.g., GPT-4) and inputs the user's latest profile and input information as prompts into the AI ​​model.

[0118] Examples of prompts:

[0119] I'd like to create a travel plan. Please suggest a plan for a trip to Tokyo based on the following criteria:

[0120] Destination: Tokyo

[0121] Trip duration: 5 days

[0122] Budget: 100,000 yen

[0123] Interests: Visiting art museums, stylish cafes

[0124] thank you.

[0125] The generative AI model generates an optimal travel plan based on these prompts and returns it to the server.

[0126] 4. Obtaining real-time information

[0127] The server retrieves the latest tourist information, event information, and restaurant reviews about the destination via the Internet using an API (e.g., Google Places API).

[0128] Example: The server uses the Google Places API to retrieve information about "art museums in Tokyo" and adds new special exhibition information and newly opened cafes to the plan.

[0129] 5. Optimizing within your budget

[0130] The server calculates the total cost of each element (accommodation, transportation, meals, etc.) to generate an optimized travel plan within the user's set budget.

[0131] Example: The server will show the breakdown of expenses calculated (e.g., accommodation 50,000 yen, transportation 20,000 yen, meals 15,000 yen, museum admission 15,000 yen) and adjust the amount to fit within a budget of 100,000 yen.

[0132] 6. Providing and customizing travel plans

[0133] The terminal presents the generated travel plan to the user, allowing the user to review and customize the plan contents.

[0134] Example: The device screen displays "Day 2: Museum of Art in Ueno" and "Lunch: Cafe in Ginza," and the user adjusts the location of lunch on day 2 to the new cafe.

[0135] 7. Bulk booking processing

[0136] The server executes various reservations in bulk based on the plan confirmed by the user, and connects with each reservation system using an API.

[0137] Example: The server executes "Hotel reservation," "Train ticket arrangement," and "Museum ticket purchase" and obtains the reservation ID for each.

[0138] 8. Confirmation and final adjustments

[0139] The server sends all reservation confirmation information to the terminal.

[0140] The device will then present the user with a final confirmation screen, allowing them to review the reservation and make any final adjustments if necessary.

[0141] Example: A list such as "Hotel reservation: confirmed" or "Museum tickets: confirmed" will be displayed on the terminal, and the user will click the "Accept" button along with the message "Are you sure about this?"

[0142] In this way, the travel planning system of the present invention efficiently generates personalized travel plans tailored to the user's needs, manages budgets while reflecting real-time information, and handles all booking procedures in one place, thereby significantly reducing the user's travel planning workload and providing a comfortable travel experience.

[0143] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0144] Step 1: Obtaining User Input Information

[0145] The user enters basic travel information (destination, duration, budget, interests) into the input form on the device.

[0146] Input: User enters "Tokyo, 5 days, budget ¥100,000, museum visit."

[0147] The terminal validates the information entered to ensure it is in the correct format.

[0148] After confirmation, the terminal transmits the input information to the server.

[0149] Output: The user's trip information is sent to the server.

[0150] Specific behavior: The user enters travel information into a form on the device and clicks the "Submit" button.

[0151] Step 2: Create and update your profile

[0152] The server accesses a database based on the received user information to obtain the user's past travel history and preferences.

[0153] Input: User's travel information sent to the server.

[0154] The server merges the newly entered information with existing data to create or update an updated user profile.

[0155] Output: A new user profile is created and updated.

[0156] Specific operation: The server retrieves data from the travel history table, such as "I enjoyed visiting art museums in Kyoto in the past," and adds new information, such as "Tokyo, 5 days, visiting art museums."

[0157] Step 3: Generate a travel plan

[0158] The server uses the generative AI model and inputs the user's latest profile and input information as prompts into the AI ​​model.

[0159] Input: A prompt containing your latest user profile and travel information.

[0160] The generative AI model generates an optimal travel plan based on the prompts and returns it to the server.

[0161] Output: Optimized trip plan.

[0162] Specific operation: The server prompts the generated AI model with the input information "visiting art museums in Tokyo," "five days," and "budget of 100,000 yen," and queries the AI.

[0163] Step 4: Get real-time information

[0164] The server uses an API to obtain the latest tourist information, event information, and restaurant reviews about the destination via the Internet.

[0165] Input: A request from the server to retrieve information about "Tokyo museums" and "events" from the API.

[0166] The server integrates and reflects the acquired real-time information into the travel plan.

[0167] Output: A trip plan reflecting real-time information.

[0168] Specific operation: The server uses the Google Places API to get the latest tourist spot information and add it to the plan.

[0169] Step 5: Optimize within your budget

[0170] The server calculates the total cost of each element (accommodation, transportation, meals, etc.) to generate an optimized travel plan within the user's set budget.

[0171] Input: The cost of each element of your travel plan.

[0172] The server adjusts each element to keep costs within budget.

[0173] Output: An adjusted budgeted travel plan.

[0174] Specific operation: The server displays the calculated breakdown of expenses (e.g., accommodation 50,000 yen, transportation 20,000 yen, meals 15,000 yen, museum admission 15,000 yen), and adjusts the budget to stay within 100,000 yen.

[0175] Step 6: Present and customize your itinerary

[0176] The terminal presents the generated itinerary to the user.

[0177] Input: Adjusted travel plans.

[0178] The user can review the displayed plan and use the editor to edit and adjust the content as needed.

[0179] Output: A travel plan customized by the user.

[0180] Specific operation: The device screen displays "Day 2: Ueno Art Museum" and "Lunch: Ginza Cafe," and the user customizes the location, such as "changing the lunch location for day 2 to a new cafe."

[0181] Step 7: Bulk booking process

[0182] The server executes various reservations in bulk based on the plan confirmed by the user, and connects with each reservation system using an API.

[0183] Input: Finalized plan information.

[0184] The server receives confirmation from each reservation system and compiles the confirmed reservations.

[0185] Output: Reservation IDs for various services booked together.

[0186] Specific operation: The server executes "hotel reservation," "train ticket arrangement," and "museum ticket purchase" and obtains the reservation ID for each.

[0187] Step 8: Review and finalize

[0188] The server sends all reservation confirmation information to the terminal.

[0189] Input: Reservation ID information for various services.

[0190] The terminal displays a final confirmation screen to the user.

[0191] The user reviews the reservation, makes any final adjustments if necessary, and then clicks final approval.

[0192] Output: Final confirmed and adjusted itinerary.

[0193] Specific operation: A list such as "Hotel reservation: confirmed" or "Museum tickets: confirmed" will be displayed on the terminal, and the user will click the "Accept" button along with the message "Are you sure about this?"

[0194] (Application example 1)

[0195] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0196] Traditional travel planning systems offer a limited user experience. While they can update information in real time and optimize within budget, they lack a way for users to visually confirm their plans. Furthermore, they cannot experience the generated plans in virtual reality, limiting user options.

[0197] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0198] In this invention, the server includes: means for acquiring user-input information; means for creating and updating a profile based on past travel history and user preferences; means for generating an individually optimized travel plan using a generative AI model; means for acquiring the latest tourist information, events, and reviews from the Internet in real time; means for generating an optimized travel plan within an input budget; means for presenting the generated travel plan to the user and enabling customization; means for booking accommodations, transportation, and activities all at once based on the plan approved by the user; means for allowing the user to confirm and finalize the reservation details; and means for experiencing the generated travel plan in virtual reality through smart glasses. This allows users to visually check their travel plan and combine it with real-time information to create a more accurate plan. Furthermore, using smart glasses to experience the travel plan in virtual reality allows users to visualize the plan, expanding their options and realizing more satisfying travel plans.

[0199] "User-Entered Information" means information about destination, duration, budget, and particular interests provided by a User for travel planning purposes.

[0200] "Past travel history" refers to data about a user's previous trips, including records of places visited, dates, and activities experienced.

[0201] "User preferences" refers to information that reflects the places, activities, and preferences that a user is particularly interested in when traveling.

[0202] A "profile" is data that indicates a user's travel tendencies and characteristics, based on the user's past travel history and preferences.

[0203] A "generative AI model" is an artificial intelligence model that automatically generates optimized travel plans based on input data.

[0204] "Real-time tourist information, events, and reviews obtained from the Internet" refers to data that collects the latest information about a destination online in real time.

[0205] A "budget-optimized travel plan" is a travel plan that is tailored to meet the user's preferences and requests to the greatest extent possible within the budget set by the user.

[0206] "Presenting and customizing generated travel plans" refers to the function that displays the travel plan created by the generative AI model to the user and allows the user to change or modify its contents.

[0207] "Comprehensive accommodation, transport and activity booking" is the process of booking accommodation, transport and destination activities in one go based on a confirmed travel plan.

[0208] "Confirm and finalize reservation details" is the process by which a user confirms their final travel plans and makes any final changes or adjustments, if necessary.

[0209] "Experiencing the generated travel plan in virtual reality through smart glasses" means visually experiencing the travel plan in a virtual reality environment using smart glasses.

[0210] The present invention provides a travel planning system for enabling users to efficiently and individually optimize their travel plans, and in particular, allows users to experience their travel plans in virtual reality using smart glasses. Detailed embodiments of the system are described below.

[0211] System configuration

[0212] 1. Obtaining user input information

[0213] The device provides an interface for users to enter basic information about their trip (destination, duration, budget, specific interests), which is then sent to the server.

[0214] 2. Creating and updating your profile

[0215] The server retrieves the user's past travel history and preferences from the database and combines them with the latest input information to create and update a user profile, generating data that reflects the user's tastes and travel habits.

[0216] 3. Generate a travel plan

[0217] The server uses a generative AI model (e.g., GPT-4 or BERT) to automatically generate a travel plan based on the latest user profile and input information, including attractions, restaurants, activities, accommodations, and transportation.

[0218] 4. Obtaining real-time information

[0219] The server retrieves the latest tourist information, events, and reviews about the destination in real time via the Internet and reflects them in the generated plan, allowing users to use plans based on the most up-to-date information.

[0220] 5. Optimizing within your budget

[0221] The server generates an optimized travel plan within the user's budget, calculating the breakdown of expenses and adjusting the plan to stay within the budget.

[0222] 6. Providing and customizing travel plans

[0223] The device presents the generated travel plan to the user, allowing the user to review and customize the plan's contents. The user can also edit and adjust the presented plan.

[0224] 7. Bulk booking processing

[0225] The server makes all reservations for accommodation, transportation, activities, etc. based on the plan confirmed by the user.

[0226] 8. Confirmation and final adjustments

[0227] The server sends all reservation confirmation information to the terminal, which displays the reservation details to the user and provides a confirmation screen for the user to review and adjust.

[0228] 9. Virtual Reality Experiences

[0229] The device allows users to experience the generated travel plan in virtual reality through smart glasses, allowing them to visually check the plan and experience the atmosphere of the destination in advance.

[0230] Hardware and software used

[0231] VR Engine: Use Unity3D or Unreal Engine to render virtual reality.

[0232] AI models: GPT-4 (OpenAI) and BERT (Google) are used to generate itineraries.

[0233] Network API: Use the Google Places API and Yelp API to get the latest tourist information, events, and reviews.

[0234] Specific examples

[0235] Consider a case where a user wears smart glasses and generates a travel plan for "Tokyo, 5 days, budget of 100,000 yen, visiting art museums." The user can view the generated plan in virtual reality through the smart glasses, visually experiencing a special exhibition at an art museum in Ueno or a new cafe in Ginza.

[0236] Example prompt sentence:

[0237] Generate a personalized itinerary based on "Tokyo, 5 days, budget of ¥100,000, museums," including attractions, restaurants, activities, accommodations, and transportation.

[0238] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0239] Step 1:

[0240] The device obtains basic travel information from the user (destination, duration, budget, interests, etc.).

[0241] Input: The user enters information such as "Tokyo, 5 days, budget 100,000 yen, museum visit" into the device interface.

[0242] Output: The device sends the acquired information to the server.

[0243] Step 2:

[0244] The server creates and updates a profile based on the user's past travel history and preferences.

[0245] Input: The server retrieves the user's past travel history and preferences from a database and receives newly entered information.

[0246] Data processing: Combine your past travel history with the information you provide to create and update a new user profile.

[0247] Output: Generate an updated profile, ready to be passed to the AI ​​model.

[0248] Step 3:

[0249] The server uses a generative AI model to generate an individually optimized itinerary.

[0250] Input: Your most recent user profile and input information.

[0251] Data computation: Generative AI models (e.g., GPT-4 and BERT) are used to generate an optimal itinerary based on a user profile and input information. The prompt is "Generate a personalized itinerary based on Tokyo, 5 days, budget of 100,000 yen, and museum visits."

[0252] Output: The plan includes attractions, restaurants, activities, accommodations, and transportation. Store the generated travel plan and send it to the next step.

[0253] Step 4:

[0254] The server retrieves the latest tourist information, events and reviews in real time from the Internet.

[0255] Input: Generated itinerary and up-to-date information from the internet.

[0256] Data processing: Use network APIs (e.g., Google Places API or Yelp API) to obtain real-time tourist information, events, and reviews for the destinations listed in the plan.

[0257] Output: An updated itinerary with the latest information merged.

[0258] Step 5:

[0259] The server generates an optimized travel plan within the budget set by the user.

[0260] Input: Updated travel plans and user-set budget.

[0261] Data calculation: Calculate the cost of each tourist attraction, restaurant, accommodation, and transportation, and optimize it within your budget.

[0262] Output: A final itinerary adjusted to fit within your budget.

[0263] Step 6:

[0264] The terminal presents the generated itinerary to the user and allows customization.

[0265] Input: Optimized travel plan.

[0266] Output: The plan contents are displayed on the device. If the user edits or adjusts the plan, the edits are sent to the server.

[0267] Step 7:

[0268] The server makes reservations for accommodation, transportation, and activities all at once based on the plan approved by the user.

[0269] Input: Final approved travel plans.

[0270] Data operations: Performing hotel, transport and activity reservations and retrieving reservation confirmation information.

[0271] Output: Generate reservation confirmation information and a confirmation code and send them to the terminal.

[0272] Step 8:

[0273] The server sends all reservation confirmation information to the terminal, which allows the user to confirm and finalize the reservation details.

[0274] Input: Confirmation of reservation information.

[0275] Output: The reservation details are displayed on the device, and the user can make final confirmation and send any necessary adjustments to the server.

[0276] Step 9:

[0277] The device allows users to experience the generated travel plan in virtual reality through smart glasses.

[0278] Input: Your final confirmed travel plans.

[0279] Data processing: Rendering the itinerary in a virtual reality environment using a VR engine (e.g. Unity3D or Unreal Engine).

[0280] Output: Through smart glasses, the user visually experiences the travel plan in virtual reality.

[0281] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0282] The present invention is a system that recognizes a user's emotions and provides a travel plan based on those emotions. By combining a conventional travel planning system with an emotion engine, the system provides a more personalized experience for users. The following describes the configuration and operation of the system as a specific embodiment for implementing the present invention.

[0283] System configuration:

[0284] 1. Obtaining user input information

[0285] Users enter basic information about their trip into the device, such as destination, duration, budget, and specific interests (such as visiting museums).

[0286] The terminal acquires this information and transmits it to the server.

[0287] Example: User enters "Tokyo, 5 days, budget 100,000 yen, museum visit."

[0288] 2. Creating and updating your profile

[0289] The server retrieves the user's past travel history and preferences from a database and combines them with newly entered information to create or update a user profile.

[0290] Example: The server updates a user's profile based on the data that "the user enjoyed visiting art museums in Kyoto in the past."

[0291] 3. Acquiring Emotion Data

[0292] The device includes an emotion engine for acquiring the user's emotion data and recognizes emotions from the user's facial expressions, voice, etc.

[0293] The terminal transmits the acquired emotion data to the server.

[0294] Example: When a user reviews a plan, their facial expression and tone of voice can be used to identify emotions such as "excited" or "relaxed."

[0295] 4. Generate a travel plan

[0296] The server uses a generative AI model to create a personalized itinerary based on the latest user profile, input information, and sentiment data, including attractions, restaurants, activities, accommodations, and transportation options.

[0297] Example: The server creates a plan including tourist attractions, places to eat, and activities based on the conditions "visiting art museums in Tokyo," "budget within 100,000 yen," "5 days," and "user is excited."

[0298] 5. Obtaining real-time information

[0299] The server obtains the latest tourist information, events, restaurant reviews, and other information about the destination in real time via the Internet and reflects this information in the generated plan.

[0300] Example: The server obtains information such as "A special exhibition is being held at the Ueno Art Museum" and "A new cafe has opened in Ginza" and adds them to the plan.

[0301] 6. Optimize within your budget

[0302] The server generates an optimized travel plan within the user's budget, calculating the breakdown of expenses and adjusting the plan to stay within the budget.

[0303] Example: The server calculates the cost of accommodation, transportation, meals, museum admission fees, etc., and adjusts the total cost to stay within 100,000 yen.

[0304] 7. Providing and customizing travel plans

[0305] The terminal presents the generated travel plan to the user, allowing the user to review and customize the plan contents.

[0306] Users can review the proposed itinerary and edit or adjust it as needed.

[0307] Example: A user customizes a proposed plan by, for example, changing the lunch location on day 2 or adding a new art gallery on day 4.

[0308] 8. Bulk booking processing

[0309] The server makes all reservations for accommodation, transportation, activities, etc. based on the plan confirmed by the user.

[0310] Example: A server centralizes hotel reservations, train ticket bookings, museum ticket purchases, etc.

[0311] 9. Confirmation and final adjustments

[0312] The server sends all reservation confirmation information to the terminal.

[0313] The terminal displays the reservation details to the user and presents a confirmation screen.

[0314] The user then finalizes the reservation and makes any necessary adjustments.

[0315] Example: The terminal displays "Hotel reservation: confirmed," "Train ticket: confirmed," and "Museum ticket: confirmed," and you click "OK" in response to the confirmation message "Are you sure about this?"

[0316] In this way, the travel planning system of the present invention efficiently generates personalized travel plans that meet the user's needs, manages budgets while reflecting real-time information and emotional data, and completes reservation procedures all at once, thereby significantly reducing the user's travel planning work and providing a comfortable travel experience.

[0317] The processing flow will be explained below.

[0318] Step 1:

[0319] The user enters basic travel information (destination, duration, budget, interests) into the device, which then collects this information and sends it to the server.

[0320] Step 2:

[0321] The server receives the entered information, retrieves the user's past travel history and preferences from a database, and integrates the new information to update the user profile.

[0322] Step 3:

[0323] The device uses an emotion engine to recognize emotions from the user's facial expressions and voice, and sends the data to the server. For example, the device can recognize "excitement" or "relaxation" from the user's facial expressions while checking travel plan information.

[0324] Step 4:

[0325] The server uses a generative AI model to generate a personalized itinerary based on the latest user profile, input information, and sentiment data, including details of attractions, restaurants, activities, accommodation, and transportation.

[0326] Step 5:

[0327] The server retrieves the latest tourist information, events, restaurant reviews, and other information about the destination in real time via the Internet and reflects this information in the generated plan. Specific examples include information such as "a special exhibition being held at a certain art museum" and "a new cafe opening."

[0328] Step 6:

[0329] The server generates an optimized travel plan within the user's budget, calculating and adjusting the breakdown of each expense so that it does not exceed the budget, taking into account factors such as accommodation, transportation, meals, and museum admission fees.

[0330] Step 7:

[0331] The server sends the generated travel plan to the device, which then displays it to the user, who can review the plan and customize it to suit their preferences or preferences.

[0332] Step 8:

[0333] Once the user has completed customization and finalized the plan, the server executes the bulk booking of accommodation, transportation, activities, etc. For example, it books a hotel, arranges transportation, and purchases museum tickets.

[0334] Step 9:

[0335] The server sends all reservation confirmation information to the terminal, and the terminal displays the reservation details to the user. The user finally confirms the reservation details and makes any final adjustments as necessary. For example, a screen asking "Are you sure you want to confirm this?" is displayed, requesting approval.

[0336] In this way, the travel planning system of the present invention automatically generates a personalized and optimal travel plan while reflecting the information and emotion data entered by the user and obtaining the latest tourist information in real time.By including planning within a budget and bulk booking, it significantly reduces the burden on the user and provides a comfortable travel experience.

[0337] Example 2

[0338] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0339] Conventional travel planning systems provide travel plans based on a user's basic information and past travel history, but this alone makes it difficult to comprehensively consider user emotions, real-time information updates, budget management, etc. In addition, the process for generating individually optimized travel plans is insufficient, resulting in a lack of personalized user experience.

[0340] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for acquiring user-input information, means for creating and updating a profile based on past travel history and user preferences, means for acquiring and analyzing emotion data, means for generating an individually optimized travel plan using a generative AI model, means for acquiring the latest tourist information, events, and reviews from the Internet in real time, means for generating an optimized travel plan within an input budget, means for presenting the generated travel plan to the user and enabling customization, means for booking accommodations, transportation, and activities all at once based on the plan approved by the user, and means for allowing the user to confirm and finalize the reservation details. This allows the server to generate individually optimized travel plans that take into account the user's emotions and real-time information, enabling comprehensive budget management and bulk booking.

[0341] "Means for acquiring user-entered information" refers to a function for acquiring basic information about the trip (destination, duration, budget, interests, etc.) entered by the user from the terminal and sending it to the server.

[0342] "Means for creating and updating a profile based on past travel history and user preferences" refers to a function that retrieves a user's past travel history and preferences from a database and integrates them with newly entered information to create or update a user profile.

[0343] "Means for acquiring and analyzing emotional data" refers to a function that uses an emotion engine to recognize and analyze emotions from the user's facial expressions and voice, and sends the acquired emotional data to the server.

[0344] "Means for generating individually optimized travel plans using a generative AI model" means a function for generating optimized travel plans using a generative AI model based on a user profile, input information, and sentiment data.

[0345] "Means of obtaining the latest tourist information, events, and reviews in real time from the Internet" refers to a function that obtains the latest tourist information, events, and reviews in real time via the Internet and reflects them in travel plans.

[0346] The "means for generating an optimized travel plan within an input budget" is a function for generating an optimized travel plan within a budget set by a user and adjusting the breakdown of expenses.

[0347] "Means for presenting the generated travel plan to the user and enabling customization" refers to a function for presenting the generated travel plan to the user and allowing the user to confirm, edit, and adjust the plan.

[0348] "A means of booking accommodation, transportation, and activities all at once based on a plan approved by the user" is a function that allows users to make reservations for accommodation, transportation, activities, etc. all at once based on a travel plan approved by the user.

[0349] The "means for allowing the user to confirm and finalize the reservation details" is a function that displays all confirmed reservation information to the user, allowing the user to confirm and finalize the reservation details.

[0350] The present invention is a system that provides travel plans based on a user's basic information and emotion data. Specific embodiments for implementing the present invention will be described below, including the hardware and software used, data processing, and data calculation.

[0351] First, the user enters basic information about the trip (destination, duration, budget, interests, etc.) into the device. For example, "Tokyo, 5 days, budget 100,000 yen, visiting art museums." The device acquires this information, formats it into JSON format, and sends it to the server.

[0352] Next, the server retrieves the user's past travel history and preferences from a database (e.g., MySQL). It combines the retrieved data with the newly entered information to create or update the user profile. This is done using SQL queries to retrieve information and update the profile. For example, if there is data in the past that says, "I enjoyed visiting art museums in Kyoto," the profile can be updated based on that.

[0353] The device also runs an emotion engine (e.g., Amazon Rekognition) to acquire emotional data. The device captures the user's facial expressions and voice using a camera and microphone, and analyzes their emotions. The analysis results are sent to the server as emotional data, such as "excited" or "relaxed."

[0354] The server uses a generative AI model (e.g., GPT-4) to create a personalized, optimized itinerary based on the latest user profile, input information, and sentiment data, using prompts like the following:

[0355] Example prompt sentence:

[0356] "Generate the optimal travel plan for a 5-day trip to Tokyo's art museums, with a budget of 100,000 yen, if the user is excited."

[0357] Next, the server retrieves the latest tourist information, events, and reviews in real time from the Internet via an API (e.g., Google Places API) and incorporates this information into the travel plan. For example, it retrieves information about newly opened cafes and special exhibitions and incorporates it into the plan.

[0358] Furthermore, the server optimizes the travel plan within the user's set budget. It calculates cost elements (accommodation, transportation, meals, activities, etc.) and adjusts them so that the total cost does not exceed the budget. For example, if the budget is 100,000 yen, it will adjust accommodation and transportation costs.

[0359] The generated itinerary is presented to the user via their device. The user can review the itinerary and edit (customize) itinerary as needed. For example, they can make changes such as "changing the lunch location on the second day" or "adding a new art gallery on the fourth day."

[0360] After the travel plan is confirmed, the server makes reservations for accommodation, transportation, activities, etc. in one batch. This is done using various reservation APIs (e.g., Booking.com API, transportation reservation API). Finally, all reservation confirmation information is sent to the terminal, and the user can confirm and make final adjustments to the reservation details. The displayed reservation confirmation screen displays information such as "Hotel reservation: confirmed," "Train ticket: confirmed," and "Museum ticket: confirmed," and the user can make adjustments as necessary.

[0361] The system allows users to easily and efficiently generate personalized travel plans, ensuring an optimal travel experience that also takes into account real-time information and sentiment data.

[0362] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0363] Step 1: Obtaining User Input Information

[0364] The user enters basic information about the trip (destination, duration, budget, interests, etc.) into the device. For example, they enter information like "Tokyo, 5 days, budget 100,000 yen, visiting art museums." The device acquires this information and formats it into JSON format to send to the next process. The input information is used in the next step.

[0365] Input: Basic information about the user's trip

[0366] Output: User input information in JSON format

[0367] Step 2: Create and update your profile

[0368] The server receives the input information and retrieves the user's past travel history and preferences from a database (e.g., MySQL). For example, it retrieves information such as "I enjoyed visiting art museums in Kyoto" in the past. It then combines this data to create or update a user profile. The profile includes the newly entered information and past data.

[0369] Input: User-supplied information in JSON format, past travel history and preference data

[0370] Output: Updated user profile

[0371] Step 3: Acquire and analyze emotion data

[0372] The device uses an emotion engine (e.g., Amazon Rekognition) to capture the user's facial expressions and voice. When the user confirms a specific plan, the device analyzes their emotions through the camera and microphone. For example, it can determine if the user is smiling and expressing excitement. The acquired emotion data is sent to the server.

[0373] Input: User facial and voice data

[0374] Output: Parsed emotion data

[0375] Step 4: Generate your travel plan

[0376] The server uses a generative AI model (e.g., GPT-4) to generate an individually optimized itinerary based on the latest user profile, input information, and emotional data. The generated prompt is as follows: "Generate the optimal itinerary for visiting art museums in Tokyo, for 5 days, with a budget of 100,000 yen, if the user is excited." This results in a detailed itinerary including tourist attractions, restaurants, activities, accommodation, transportation, and more.

[0377] Input: User profile, input information, emotional data

[0378] Output: A trip plan from a generative AI model

[0379] Step 5: Get real-time information

[0380] The server uses an API (e.g., Google Places API) to obtain the latest tourist information, events, reviews, etc. of the destination in real time. For example, it obtains information about new cafe openings and special exhibitions. This information is reflected in the generated travel plan.

[0381] Input: Destination information, API query

[0382] Output: Real-time tourist information, events, and reviews

[0383] Step 6: Optimize within your budget

[0384] The server optimizes the travel plan within the user's budget by calculating accommodation, transportation, meals, and activity costs and adjusting each part of the plan based on the calculation results.

[0385] Input: Travel plan, budget information

[0386] Output: A budget-optimized itinerary

[0387] Step 7: Present and customize your itinerary

[0388] The device presents the generated itinerary to the user. The user can review the itinerary and edit (customize) it as needed. For example, the user can customize it by changing the lunch location on the second day or adding a new art gallery on the fourth day. This customization information is sent from the device to the server.

[0389] Input: Generated itinerary

[0390] Output: A travel plan customized by the user

[0391] Step 8: Bulk booking process

[0392] The server makes reservations for accommodation, transportation, activities, etc. in bulk based on the user's confirmed travel plan. For example, it makes hotel reservations, arranges train tickets, and purchases museum tickets. This process uses a booking API (e.g., Booking.com API, transportation booking API).

[0393] Input: Confirmed travel plans

[0394] Output: Confirmed reservation information

[0395] Step 9: Review and finalize

[0396] The server sends all reservation confirmation information to the terminal. The terminal displays the reservation details to the user and presents a confirmation screen. The user can review the displayed reservation details (e.g., "Hotel reservation: confirmed," "Train ticket: confirmed," "Museum ticket: confirmed") and make any necessary final adjustments.

[0397] Input: Confirmed reservation information

[0398] Output: The final reservation details confirmed and adjusted by the user

[0399] This process flow allows users to efficiently generate personalized travel plans and enjoy optimal travel plans that reflect real-time information and emotional data.

[0400] (Application example 2)

[0401] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0402] In current factory work, there is no system that can properly recognize the emotional state of workers and optimize work efficiency based on that emotional state. As a result, worker stress and a decline in motivation can have a negative impact on production efficiency. In addition, it is not possible to obtain emotional data in real time and adjust work plans based on that data. To address these issues, a system is needed that can recognize workers' emotions in real time and optimize work plans based on that data.

[0403] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0404] In this invention, the server includes means for acquiring user-input information, means for creating and updating a profile based on past history and user preferences, means for generating an individually optimized plan using a generative AI model, means for acquiring the latest information from the Internet in real time, means for generating an optimized plan within an input budget, means for presenting the generated plan to the user and enabling customization, means for reserving all necessary items in one lump sum based on the plan approved by the user, means for acquiring the user's emotions using an emotion recognition engine, means for adjusting the plan based on the user's emotion data, and means for allowing the user to confirm and finalize the reservation details. This enables appropriate work assignment and environment adjustment according to the emotional state of workers.

[0405] "User-input information" is data about a user's attributes and requests that is provided to the system.

[0406] "Past history" is a record of the activities a user has experienced to date.

[0407] "User preferences" are information that refers to personal tendencies or inclinations that a user has toward certain activities or choices.

[0408] A "profile" is a collection of data that indicates a user's characteristics, which is composed of information such as the user's past history and preferences.

[0409] A "generative AI model" is an algorithm or system that uses artificial intelligence to generate optimal results or plans based on specific input data.

[0410] "Real-time, up-to-date information" refers to the latest data based on the current situation, obtained via the Internet or other means.

[0411] A "budget-optimized plan" is a plan created to achieve the most effective results within the budget set by the user.

[0412] An "emotion recognition engine" is software and hardware that analyzes and recognizes a user's emotional state from data such as facial expressions and voice.

[0413] "Allows for customization" refers to the ability for users to freely change or adjust the plans and settings provided.

[0414] "Making a bulk reservation" refers to processing multiple reservation items at once.

[0415] "Confirm reservation details and make final adjustments" is a function that allows the user to confirm the reservation details and make final corrections or adjustments as necessary.

[0416] The present invention relates to a system that recognizes the emotional state of factory workers and optimizes work plans based on that data. Specific embodiments for carrying out the present invention are described below.

[0417] System configuration

[0418] 1. Obtaining user input information

[0419] The factory robot obtains basic information from the worker, such as shift information, responsibilities, and skill level, through the robot's input interface and sends it to the server.

[0420] 2. Creating and updating your profile

[0421] The server retrieves the worker's past work history and skill data from the database and integrates it with newly entered information to create or update the worker's profile.

[0422] 3. Acquiring Emotion Data

[0423] The factory robot uses a camera and microphone equipped with an emotion engine to capture facial expressions and voice data of workers in real time, which is then analyzed by the emotion recognition engine to determine the worker's emotional state (e.g., whether they are stressed or relaxed) and sent to a server.

[0424] 4. Generating work plans using generative AI models

[0425] The server generates a work plan using a generative AI model (such as GPT-4) based on user input information, worker profiles, and emotional data. The generative AI model used here takes into account emotional states and skill levels to optimally assign work and adjust the environment.

[0426] Example prompt sentence:

[0427] "Worker basic information: night shift, assembly line work, skill level 5. Worker emotional data: feeling stressed. Based on this, please create a plan to optimize work efficiency."

[0428] 5. Obtaining real-time information

[0429] The server obtains information about the latest work status and machine conditions within the factory in real time via the Internet and reflects this information in the generated work plan.

[0430] 6. Optimizing work efficiency

[0431] Based on the generated work plan, the server assigns appropriate work to avoid overloading workers, and adjusts according to individual situations, such as assigning less demanding work to workers who are feeling stressed.

[0432] 7. Plan presentation and customization

[0433] The factory robot presents the generated work plan to the worker, allowing the worker to freely adjust and customize it. The worker can change the plan using the interface.

[0434] 8. Bulk Schedule Processing

[0435] The server collectively schedules each task based on the plan finalized by the worker and notifies the scheduler.

[0436] 9. Confirmation and final adjustments

[0437] The server sends all schedule confirmation information to the factory robot, which then displays a confirmation screen to the worker, who then makes any final confirmations or adjustments and finalizes the schedule.

[0438] Hardware and Software Use

[0439] Hardware:

[0440] Camera and microphone with emotion engine: Captures worker emotion data.

[0441] Factory robots: Collect worker input and assist with customization.

[0442] Server: Data processing and execution of generative AI models.

[0443] software:

[0444] Emotion recognition system: Analyzes workers' facial expressions and voice data.

[0445] User profile management system: Create and update worker profiles.

[0446] Generative AI model: generating work plans.

[0447] Scheduling system: Work booking and management.

[0448] In this way, the present invention is a system that recognizes the emotional state of factory workers in real time, generates work plans based on that data, and optimizes work efficiency, thereby reducing worker stress and improving production efficiency.

[0449] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0450] Step 1:

[0451] The user enters basic information such as shift information, duties, and skill level into the terminal.

[0452] Input: Shift information (e.g., night shift), duties (e.g., assembly line work), skill level (e.g., level 5)

[0453] Output: User input information

[0454] Specific operation: The user inputs the necessary information into the input interface of the factory robot, and the robot acquires this information and sends it to the server.

[0455] Step 2:

[0456] The server retrieves the worker's past work history and skill data from the database and creates or updates a profile.

[0457] Input: User input information, past work history, skill data

[0458] Output: Updated worker profile

[0459] What it does: The server retrieves past work history and skill data from the database, integrates it with the user's new information, and updates their profile.

[0460] Step 3:

[0461] Factory robots use cameras and microphones equipped with emotion engines to capture facial expressions and voice data from workers in real time.

[0462] Input: Facial expression data and voice data of workers

[0463] Output: Emotion data

[0464] How it works: The factory robot monitors the workers while they are working, collecting data using facial camera and microphone. The emotion recognition engine analyzes the data and recognizes their emotional state.

[0465] Step 4:

[0466] The server uses a generative AI model to generate an optimal work plan based on user input information, profile data, and emotional data.

[0467] Input: User input information, profile data, emotion data

[0468] Output: Optimized work plan

[0469] How it works: The server uses this data to input prompts into a generative AI model, which then generates an optimal work plan. GPT-4 and other models are used as generative AI models.

[0470] Example prompt sentence:

[0471] "Worker basic information: night shift, assembly line work, skill level 5. Worker emotional data: feeling stressed. Based on this, please create a plan to optimize work efficiency."

[0472] Step 5:

[0473] The server obtains the latest information on work status and machine conditions within the factory in real time via the Internet and reflects this in the generated work plan.

[0474] Input: Latest work status information, machine status information

[0475] Output: Updated Work Plan

[0476] Specific operation: The server connects to the factory's systems, obtains information such as the current line operation status and machine maintenance status, and reflects this information in the optimal work plan.

[0477] Step 6:

[0478] The server presents the generated work plan to the user through the terminal, allowing the user to review and customize the plan.

[0479] Input: Generated Work Plan

[0480] Output: A work plan presented to the user

[0481] Specific operation: The terminal visualizes the work plan and displays it to the user, and provides an interface that allows the user to edit break times and work content as needed.

[0482] Step 7:

[0483] The server collectively schedules work assignments and break schedules based on the plan finalized by the user and notifies each worker.

[0484] Input: User-confirmed work plan

[0485] Output: Bulk scheduled work and notification information

[0486] Specific operation: The server sets the schedules of all workers in bulk based on the confirmed work plan and sends notifications to each worker.

[0487] Step 8:

[0488] The server transmits all confirmed schedule information to the terminal, which presents a confirmation screen to the user.

[0489] Input: Confirmed schedule information

[0490] Output: A confirmation screen presented to the user

[0491] Specific operation: The server sends schedule information to the terminal, which displays it to the user. The user then performs a final check and makes any necessary corrections.

[0492] These steps realize a system that can appropriately assign tasks and adjust the environment according to the user's emotional state.

[0493] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0494] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0495] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0496] [Second embodiment]

[0497] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0498] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0499] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0500] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0501] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0502] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0503] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0504] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0505] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0506] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0507] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0508] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0509] The present invention is a travel planning system for efficiently and individually optimizing a user's travel plan. The configuration and operation of the system will be described below as a specific embodiment for carrying out the present invention.

[0510] System configuration:

[0511] 1. Obtaining user input information

[0512] Users enter basic information about their trip into the device, such as destination, duration, budget, and specific interests (e.g., visiting museums).

[0513] The terminal collects the input information and transmits it to the server.

[0514] Example: User enters "Tokyo, 5 days, budget 100,000 yen, museum visit."

[0515] 2. Creating and updating your profile

[0516] The server retrieves the user's past travel history and preferences from a database and combines them with newly entered information to create or update a user profile.

[0517] Example: The server updates a user's profile based on the data that "the user enjoyed visiting art museums in Kyoto in the past."

[0518] 3. Generate a travel plan

[0519] The server uses a generative AI model to automatically generate a travel plan based on the user's current profile and input information, including attractions, restaurants, activities, accommodations, and transportation options.

[0520] Example: The server creates a plan including tourist attractions, places to eat, and activities based on the conditions "visiting art museums in Tokyo," "budget within 100,000 yen," and "5 days."

[0521] 4. Obtaining real-time information

[0522] The server obtains the latest tourist information, events, restaurant reviews, and other information about the destination in real time via the Internet and reflects this information in the generated plan.

[0523] Example: The server obtains information such as "A special exhibition is being held at the Ueno Art Museum" and "A new cafe has opened in Ginza" and adds them to the plan.

[0524] 5. Optimizing within your budget

[0525] The server generates an optimized travel plan within the user's budget, calculating the breakdown of costs and adjusting them so that the plan does not exceed the user's budget.

[0526] Example: The server calculates the cost of accommodation, transportation, meals, museum admission fees, etc., and adjusts the total cost to stay within 100,000 yen.

[0527] 6. Providing and customizing travel plans

[0528] The terminal presents the generated travel plan to the user, allowing the user to review and customize the plan contents.

[0529] Users can review the proposed itinerary and edit or adjust it as needed.

[0530] Example: A user customizes a proposed plan by, for example, changing the lunch location on day 2 or adding a new art gallery on day 4.

[0531] 7. Bulk booking processing

[0532] The server makes all reservations for accommodation, transportation, activities, etc. based on the plan confirmed by the user.

[0533] Example: A server centralizes hotel reservations, train ticket bookings, museum ticket purchases, etc.

[0534] 8. Confirmation and final adjustments

[0535] The server sends all reservation confirmation information to the terminal.

[0536] The terminal displays the reservation details to the user and presents a confirmation screen.

[0537] The user then finalizes the reservation and makes any necessary adjustments.

[0538] Example: The terminal displays "Hotel reservation: confirmed," "Train ticket: confirmed," and "Museum ticket: confirmed," and you click "OK" in response to the confirmation message "Are you sure about this?"

[0539] In this way, the travel planning system of the present invention efficiently generates personalized travel plans that meet the user's needs, manages budgets while reflecting real-time information, and performs all reservation procedures in one go, thereby significantly reducing the user's travel planning workload and providing a comfortable travel experience.

[0540] The processing flow will be explained below.

[0541] Step 1:

[0542] The user inputs the travel destination, duration, budget, and interests (e.g., visiting museums) into the device. The device acquires this information and sends it to the server.

[0543] Step 2:

[0544] The server receives the entered information, retrieves the user's past travel history and preferences from a database, and combines the newly entered information with the previous data to create or update the user profile.

[0545] Step 3:

[0546] The server uses a generative AI model to generate a personalized itinerary based on the updated user profile and input, which includes details on attractions, restaurants, activities, accommodation, transportation, and more.

[0547] Step 4:

[0548] The server obtains the latest tourist information, events, restaurant reviews, and other information about the destination in real time via the Internet and reflects this information in the generated plan.

[0549] Step 5:

[0550] The server generates an optimized travel plan within the user's budget, calculating the breakdown of expenses and adjusting the plan to stay within the budget.

[0551] Step 6:

[0552] The server sends the generated travel plan to the terminal, which provides the user with an interface to display and customize the plan.

[0553] Step 7:

[0554] The user checks the presented travel plan and customizes it as necessary. The device saves the user's editing operations and sends the data to the server.

[0555] Step 8:

[0556] Once the user finalizes their travel plans, the server makes all reservations for accommodation, transportation, activities, etc. in one go.

[0557] Step 9:

[0558] The server sends all reservation confirmation information to the terminal, which displays the reservation details to the user and presents a confirmation screen, where the user can finally review the reservation details and make any final adjustments if necessary.

[0559] Example 1

[0560] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0561] Current travel planning systems struggle to efficiently and individually optimize users' travel plans. They also lack the ability to reflect real-time information, manage budgets, and process reservations in bulk. Furthermore, they lack the ability to validate user input and integrate it with past travel history, resulting in travel plans that cannot fully meet users' needs.

[0562] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0563] In this invention, the server includes means for acquiring user-input information, means for creating and updating a profile based on past travel history and user preferences, means for generating an individually optimized travel plan using a generative AI model, means for acquiring the latest tourist information, events, and reviews from the Internet in real time, means for generating an optimized travel plan within an input budget, means for presenting the generated travel plan to the user and enabling customization, means for booking accommodations, transportation, and activities all at once based on the plan approved by the user, means for allowing the user to confirm and finalize the reservation details, means for verifying user information and sending it to the server in a correct format, means for acquiring past travel history and user preferences from a database, and means for inputting prompt statements to the generative AI model. This enables efficient generation of personalized travel plans tailored to user needs, reflecting real-time information, budget management, and batch booking processing.

[0564] "User-entered information" refers to data that a user enters into a terminal, including basic information about the trip (destination, duration, budget, interests, etc.).

[0565] "Profile" refers to a user's individual information that is generated and updated by integrating the user's past travel history and preferences with current input information.

[0566] A "generative AI model" is an artificial intelligence model that automatically generates optimal travel plans based on input prompts.

[0567] "Real-time information" refers to the latest tourist information, events, reviews, etc. obtained via the Internet.

[0568] A "budget-optimized travel plan" is a travel plan generated by adjusting various expenses within the budget set by the user.

[0569] "Customization" means the act of a user editing or adjusting the content of a presented travel plan.

[0570] "Bulk booking" refers to the process of booking accommodation, transportation, activities, etc. all at once based on a user's confirmed travel plans.

[0571] "Final adjustment" refers to the act of the user finally checking the reservation details and making any necessary changes.

[0572] "User information validation" refers to the process of ensuring that the information entered by the user is in the correct format.

[0573] "Database" refers to a system for managing and storing information such as a user's past travel history and preferences.

[0574] A "prompt sentence" is a specific instruction sentence that is input into a generative AI model.

[0575] The present invention is a travel planning system for efficiently and individually optimizing a user's travel plans. The system allows the user to input basic travel information, and automatically generates a travel plan tailored to individual needs based on that information. The following describes the configuration and operation of the system as a specific embodiment of the present invention.

[0576] System configuration:

[0577] 1. Obtaining user input information

[0578] Users enter basic information about their trip (destination, duration, budget, interests) into an input form on their device.

[0579] The terminal validates the entered information to ensure it is in the correct format, then transmits it to the server.

[0580] Hardware and software used:

[0581] Hardware: Personal computers, smartphones, servers

[0582] Software: web browsers, database management systems (e.g., MySQL), generative AI models (e.g., OpenAI GPT-4)

[0583] Specific working example:

[0584] 1. Obtaining user input information

[0585] When a user enters "Tokyo, 5 days, budget 100,000 yen, museum visit" into the form on their device and clicks the "Submit" button, the device sends this information to the server.

[0586] 2. Creating and updating your profile

[0587] The server accesses the database with the received user information to retrieve the user's past travel history and preferences, and combines the newly entered information with existing data to create or update an updated user profile.

[0588] Example: The server retrieves data from the travel history table, such as "I enjoyed visiting museums in Kyoto in the past," and adds new information, such as "Tokyo, 5 days, visiting museums."

[0589] 3. Generate a travel plan

[0590] The server uses a generative AI model (e.g., GPT-4) and inputs the user's latest profile and input information as prompts into the AI ​​model.

[0591] Examples of prompts:

[0592] I'd like to create a travel plan. Please suggest a plan for a trip to Tokyo based on the following criteria:

[0593] Destination: Tokyo

[0594] Trip duration: 5 days

[0595] Budget: 100,000 yen

[0596] Interests: Visiting art museums, stylish cafes

[0597] thank you.

[0598] The generative AI model generates an optimal travel plan based on these prompts and returns it to the server.

[0599] 4. Obtaining real-time information

[0600] The server retrieves the latest tourist information, event information, and restaurant reviews about the destination via the Internet using an API (e.g., Google Places API).

[0601] Example: The server uses the Google Places API to retrieve information about "art museums in Tokyo" and adds new special exhibition information and newly opened cafes to the plan.

[0602] 5. Optimizing within your budget

[0603] The server calculates the total cost of each element (accommodation, transportation, meals, etc.) to generate an optimized travel plan within the user's set budget.

[0604] Example: The server will show the breakdown of expenses calculated (e.g., accommodation 50,000 yen, transportation 20,000 yen, meals 15,000 yen, museum admission 15,000 yen) and adjust the amount to fit within a budget of 100,000 yen.

[0605] 6. Providing and customizing travel plans

[0606] The terminal presents the generated travel plan to the user, allowing the user to review and customize the plan contents.

[0607] Example: The device screen displays "Day 2: Museum of Art in Ueno" and "Lunch: Cafe in Ginza," and the user adjusts the location of lunch on day 2 to the new cafe.

[0608] 7. Bulk booking processing

[0609] The server executes various reservations in bulk based on the plan confirmed by the user, and connects with each reservation system using an API.

[0610] Example: The server executes "Hotel reservation," "Train ticket arrangement," and "Museum ticket purchase" and obtains the reservation ID for each.

[0611] 8. Confirmation and final adjustments

[0612] The server sends all reservation confirmation information to the terminal.

[0613] The device will then present the user with a final confirmation screen, allowing them to review the reservation and make any final adjustments if necessary.

[0614] Example: A list such as "Hotel reservation: confirmed" or "Museum tickets: confirmed" will be displayed on the terminal, and the user will click the "Accept" button along with the message "Are you sure about this?"

[0615] In this way, the travel planning system of the present invention efficiently generates personalized travel plans tailored to the user's needs, manages budgets while reflecting real-time information, and handles all booking procedures in one place, thereby significantly reducing the user's travel planning workload and providing a comfortable travel experience.

[0616] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0617] Step 1: Obtaining User Input Information

[0618] The user enters basic travel information (destination, duration, budget, interests) into the input form on the device.

[0619] Input: User enters "Tokyo, 5 days, budget ¥100,000, museum visit."

[0620] The terminal validates the information entered to ensure it is in the correct format.

[0621] After confirmation, the terminal transmits the input information to the server.

[0622] Output: The user's trip information is sent to the server.

[0623] Specific behavior: The user enters travel information into a form on the device and clicks the "Submit" button.

[0624] Step 2: Create and update your profile

[0625] The server accesses a database based on the received user information to obtain the user's past travel history and preferences.

[0626] Input: User's travel information sent to the server.

[0627] The server merges the newly entered information with existing data to create or update an updated user profile.

[0628] Output: A new user profile is created and updated.

[0629] Specific operation: The server retrieves data from the travel history table, such as "I enjoyed visiting art museums in Kyoto in the past," and adds new information, such as "Tokyo, 5 days, visiting art museums."

[0630] Step 3: Generate a travel plan

[0631] The server uses the generative AI model and inputs the user's latest profile and input information as prompts into the AI ​​model.

[0632] Input: A prompt containing your latest user profile and travel information.

[0633] The generative AI model generates an optimal travel plan based on the prompts and returns it to the server.

[0634] Output: Optimized trip plan.

[0635] Specific operation: The server prompts the generated AI model with the input information "visiting art museums in Tokyo," "five days," and "budget of 100,000 yen," and queries the AI.

[0636] Step 4: Get real-time information

[0637] The server uses an API to obtain the latest tourist information, event information, and restaurant reviews about the destination via the Internet.

[0638] Input: A request from the server to retrieve information about "Tokyo museums" and "events" from the API.

[0639] The server integrates and reflects the acquired real-time information into the travel plan.

[0640] Output: A trip plan reflecting real-time information.

[0641] Specific operation: The server uses the Google Places API to get the latest tourist spot information and add it to the plan.

[0642] Step 5: Optimize within your budget

[0643] The server calculates the total cost of each element (accommodation, transportation, meals, etc.) to generate an optimized travel plan within the user's set budget.

[0644] Input: The cost of each element of your travel plan.

[0645] The server adjusts each element to keep costs within budget.

[0646] Output: An adjusted budgeted travel plan.

[0647] Specific operation: The server displays the calculated breakdown of expenses (e.g., accommodation 50,000 yen, transportation 20,000 yen, meals 15,000 yen, museum admission 15,000 yen), and adjusts the budget to stay within 100,000 yen.

[0648] Step 6: Present and customize your itinerary

[0649] The terminal presents the generated itinerary to the user.

[0650] Input: Adjusted travel plans.

[0651] The user can review the displayed plan and use the editor to edit and adjust the content as needed.

[0652] Output: A travel plan customized by the user.

[0653] Specific operation: The device screen displays "Day 2: Ueno Art Museum" and "Lunch: Ginza Cafe," and the user customizes the location, such as "changing the lunch location for day 2 to a new cafe."

[0654] Step 7: Bulk booking process

[0655] The server executes various reservations in bulk based on the plan confirmed by the user, and connects with each reservation system using an API.

[0656] Input: Finalized plan information.

[0657] The server receives confirmation from each reservation system and compiles the confirmed reservations.

[0658] Output: Reservation IDs for various services booked together.

[0659] Specific operation: The server executes "hotel reservation," "train ticket arrangement," and "museum ticket purchase" and obtains the reservation ID for each.

[0660] Step 8: Review and finalize

[0661] The server sends all reservation confirmation information to the terminal.

[0662] Input: Reservation ID information for various services.

[0663] The terminal displays a final confirmation screen to the user.

[0664] The user reviews the reservation, makes any final adjustments if necessary, and then clicks final approval.

[0665] Output: Final confirmed and adjusted itinerary.

[0666] Specific operation: A list such as "Hotel reservation: confirmed" or "Museum tickets: confirmed" will be displayed on the terminal, and the user will click the "Accept" button along with the message "Are you sure about this?"

[0667] (Application example 1)

[0668] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0669] Traditional travel planning systems offer a limited user experience. While they can update information in real time and optimize within budget, they lack a way for users to visually confirm their plans. Furthermore, they cannot experience the generated plans in virtual reality, limiting user options.

[0670] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0671] In this invention, the server includes: means for acquiring user-input information; means for creating and updating a profile based on past travel history and user preferences; means for generating an individually optimized travel plan using a generative AI model; means for acquiring the latest tourist information, events, and reviews from the Internet in real time; means for generating an optimized travel plan within an input budget; means for presenting the generated travel plan to the user and enabling customization; means for booking accommodations, transportation, and activities all at once based on the plan approved by the user; means for allowing the user to confirm and finalize the reservation details; and means for experiencing the generated travel plan in virtual reality through smart glasses. This allows users to visually check their travel plan and combine it with real-time information to create a more accurate plan. Furthermore, using smart glasses to experience the travel plan in virtual reality allows users to visualize the plan, expanding their options and realizing more satisfying travel plans.

[0672] "User-Entered Information" means information about destination, duration, budget, and particular interests provided by a User for travel planning purposes.

[0673] "Past travel history" refers to data about a user's previous trips, including records of places visited, dates, and activities experienced.

[0674] "User preferences" refers to information that reflects the places, activities, and preferences that a user is particularly interested in when traveling.

[0675] A "profile" is data that indicates a user's travel tendencies and characteristics, based on the user's past travel history and preferences.

[0676] A "generative AI model" is an artificial intelligence model that automatically generates optimized travel plans based on input data.

[0677] "Real-time tourist information, events, and reviews obtained from the Internet" refers to data that collects the latest information about a destination online in real time.

[0678] A "budget-optimized travel plan" is a travel plan that is tailored to meet the user's preferences and requests to the greatest extent possible within the budget set by the user.

[0679] "Presenting and customizing generated travel plans" refers to the function that displays the travel plan created by the generative AI model to the user and allows the user to change or modify its contents.

[0680] "Comprehensive accommodation, transport and activity booking" is the process of booking accommodation, transport and destination activities in one go based on a confirmed travel plan.

[0681] "Confirm and finalize reservation details" is the process by which a user confirms their final travel plans and makes any final changes or adjustments, if necessary.

[0682] "Experiencing the generated travel plan in virtual reality through smart glasses" means visually experiencing the travel plan in a virtual reality environment using smart glasses.

[0683] The present invention provides a travel planning system for enabling users to efficiently and individually optimize their travel plans, and in particular, allows users to experience their travel plans in virtual reality using smart glasses. Detailed embodiments of the system are described below.

[0684] System configuration

[0685] 1. Obtaining user input information

[0686] The device provides an interface for users to enter basic information about their trip (destination, duration, budget, specific interests), which is then sent to the server.

[0687] 2. Creating and updating your profile

[0688] The server retrieves the user's past travel history and preferences from the database and combines them with the latest input information to create and update a user profile, generating data that reflects the user's tastes and travel habits.

[0689] 3. Generate a travel plan

[0690] The server uses a generative AI model (e.g., GPT-4 or BERT) to automatically generate a travel plan based on the latest user profile and input information, including attractions, restaurants, activities, accommodations, and transportation.

[0691] 4. Obtaining real-time information

[0692] The server retrieves the latest tourist information, events, and reviews about the destination in real time via the Internet and reflects them in the generated plan, allowing users to use plans based on the most up-to-date information.

[0693] 5. Optimizing within your budget

[0694] The server generates an optimized travel plan within the user's budget, calculating the breakdown of expenses and adjusting the plan to stay within the budget.

[0695] 6. Providing and customizing travel plans

[0696] The device presents the generated travel plan to the user, allowing the user to review and customize the plan's contents. The user can also edit and adjust the presented plan.

[0697] 7. Bulk booking processing

[0698] The server makes all reservations for accommodation, transportation, activities, etc. based on the plan confirmed by the user.

[0699] 8. Confirmation and final adjustments

[0700] The server sends all reservation confirmation information to the terminal, which displays the reservation details to the user and provides a confirmation screen for the user to review and adjust.

[0701] 9. Virtual Reality Experiences

[0702] The device allows users to experience the generated travel plan in virtual reality through smart glasses, allowing them to visually check the plan and experience the atmosphere of the destination in advance.

[0703] Hardware and software used

[0704] VR Engine: Use Unity3D or Unreal Engine to render virtual reality.

[0705] AI models: GPT-4 (OpenAI) and BERT (Google) are used to generate itineraries.

[0706] Network API: Use the Google Places API and Yelp API to get the latest tourist information, events, and reviews.

[0707] Specific examples

[0708] Consider a case where a user wears smart glasses and generates a travel plan for "Tokyo, 5 days, budget of 100,000 yen, visiting art museums." The user can view the generated plan in virtual reality through the smart glasses, visually experiencing a special exhibition at an art museum in Ueno or a new cafe in Ginza.

[0709] Example prompt sentence:

[0710] Generate a personalized itinerary based on "Tokyo, 5 days, budget of ¥100,000, museums," including attractions, restaurants, activities, accommodations, and transportation.

[0711] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0712] Step 1:

[0713] The device obtains basic travel information from the user (destination, duration, budget, interests, etc.).

[0714] Input: The user enters information such as "Tokyo, 5 days, budget 100,000 yen, museum visit" into the device interface.

[0715] Output: The device sends the acquired information to the server.

[0716] Step 2:

[0717] The server creates and updates a profile based on the user's past travel history and preferences.

[0718] Input: The server retrieves the user's past travel history and preferences from a database and receives newly entered information.

[0719] Data processing: Combine your past travel history with the information you provide to create and update a new user profile.

[0720] Output: Generate an updated profile, ready to be passed to the AI ​​model.

[0721] Step 3:

[0722] The server uses a generative AI model to generate an individually optimized itinerary.

[0723] Input: Your most recent user profile and input information.

[0724] Data computation: Generative AI models (e.g., GPT-4 and BERT) are used to generate an optimal itinerary based on a user profile and input information. The prompt is "Generate a personalized itinerary based on Tokyo, 5 days, budget of 100,000 yen, and museum visits."

[0725] Output: The plan includes attractions, restaurants, activities, accommodations, and transportation. Store the generated travel plan and send it to the next step.

[0726] Step 4:

[0727] The server retrieves the latest tourist information, events and reviews in real time from the Internet.

[0728] Input: Generated itinerary and up-to-date information from the internet.

[0729] Data processing: Use network APIs (e.g., Google Places API or Yelp API) to obtain real-time tourist information, events, and reviews for the destinations listed in the plan.

[0730] Output: An updated itinerary with the latest information merged.

[0731] Step 5:

[0732] The server generates an optimized travel plan within the budget set by the user.

[0733] Input: Updated travel plans and user-set budget.

[0734] Data calculation: Calculate the cost of each tourist attraction, restaurant, accommodation, and transportation, and optimize it within your budget.

[0735] Output: A final itinerary adjusted to fit within your budget.

[0736] Step 6:

[0737] The terminal presents the generated itinerary to the user and allows customization.

[0738] Input: Optimized travel plan.

[0739] Output: The plan contents are displayed on the device. If the user edits or adjusts the plan, the edits are sent to the server.

[0740] Step 7:

[0741] The server makes reservations for accommodation, transportation, and activities all at once based on the plan approved by the user.

[0742] Input: Final approved travel plans.

[0743] Data operations: Performing hotel, transport and activity reservations and retrieving reservation confirmation information.

[0744] Output: Generate reservation confirmation information and a confirmation code and send them to the terminal.

[0745] Step 8:

[0746] The server sends all reservation confirmation information to the terminal, which allows the user to confirm and finalize the reservation details.

[0747] Input: Confirmation of reservation information.

[0748] Output: The reservation details are displayed on the device, and the user can make final confirmation and send any necessary adjustments to the server.

[0749] Step 9:

[0750] The device allows users to experience the generated travel plan in virtual reality through smart glasses.

[0751] Input: Your final confirmed travel plans.

[0752] Data processing: Rendering the itinerary in a virtual reality environment using a VR engine (e.g. Unity3D or Unreal Engine).

[0753] Output: Through smart glasses, the user visually experiences the travel plan in virtual reality.

[0754] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0755] The present invention is a system that recognizes a user's emotions and provides a travel plan based on those emotions. By combining a conventional travel planning system with an emotion engine, the system provides a more personalized experience for users. The following describes the configuration and operation of the system as a specific embodiment for implementing the present invention.

[0756] System configuration:

[0757] 1. Obtaining user input information

[0758] Users enter basic information about their trip into the device, such as destination, duration, budget, and specific interests (such as visiting museums).

[0759] The terminal acquires this information and transmits it to the server.

[0760] Example: User enters "Tokyo, 5 days, budget 100,000 yen, museum visit."

[0761] 2. Creating and updating your profile

[0762] The server retrieves the user's past travel history and preferences from a database and combines them with newly entered information to create or update a user profile.

[0763] Example: The server updates a user's profile based on the data that "the user enjoyed visiting art museums in Kyoto in the past."

[0764] 3. Acquiring Emotion Data

[0765] The device includes an emotion engine for acquiring the user's emotion data and recognizes emotions from the user's facial expressions, voice, etc.

[0766] The terminal transmits the acquired emotion data to the server.

[0767] Example: When a user reviews a plan, their facial expression and tone of voice can be used to identify emotions such as "excited" or "relaxed."

[0768] 4. Generate a travel plan

[0769] The server uses a generative AI model to create a personalized itinerary based on the latest user profile, input information, and sentiment data, including attractions, restaurants, activities, accommodations, and transportation options.

[0770] Example: The server creates a plan including tourist attractions, places to eat, and activities based on the conditions "visiting art museums in Tokyo," "budget within 100,000 yen," "5 days," and "user is excited."

[0771] 5. Obtaining real-time information

[0772] The server obtains the latest tourist information, events, restaurant reviews, and other information about the destination in real time via the Internet and reflects this information in the generated plan.

[0773] Example: The server obtains information such as "A special exhibition is being held at the Ueno Art Museum" and "A new cafe has opened in Ginza" and adds them to the plan.

[0774] 6. Optimize within your budget

[0775] The server generates an optimized travel plan within the user's budget, calculating the breakdown of expenses and adjusting the plan to stay within the budget.

[0776] Example: The server calculates the cost of accommodation, transportation, meals, museum admission fees, etc., and adjusts the total cost to stay within 100,000 yen.

[0777] 7. Providing and customizing travel plans

[0778] The terminal presents the generated travel plan to the user, allowing the user to review and customize the plan contents.

[0779] Users can review the proposed itinerary and edit or adjust it as needed.

[0780] Example: A user customizes a proposed plan by, for example, changing the lunch location on day 2 or adding a new art gallery on day 4.

[0781] 8. Bulk booking processing

[0782] The server makes all reservations for accommodation, transportation, activities, etc. based on the plan confirmed by the user.

[0783] Example: A server centralizes hotel reservations, train ticket bookings, museum ticket purchases, etc.

[0784] 9. Confirmation and final adjustments

[0785] The server sends all reservation confirmation information to the terminal.

[0786] The terminal displays the reservation details to the user and presents a confirmation screen.

[0787] The user then finalizes the reservation and makes any necessary adjustments.

[0788] Example: The terminal displays "Hotel reservation: confirmed," "Train ticket: confirmed," and "Museum ticket: confirmed," and you click "OK" in response to the confirmation message "Are you sure about this?"

[0789] In this way, the travel planning system of the present invention efficiently generates personalized travel plans that meet the user's needs, manages budgets while reflecting real-time information and emotional data, and completes reservation procedures all at once, thereby significantly reducing the user's travel planning work and providing a comfortable travel experience.

[0790] The processing flow will be explained below.

[0791] Step 1:

[0792] The user enters basic travel information (destination, duration, budget, interests) into the device, which then collects this information and sends it to the server.

[0793] Step 2:

[0794] The server receives the entered information, retrieves the user's past travel history and preferences from a database, and integrates the new information to update the user profile.

[0795] Step 3:

[0796] The device uses an emotion engine to recognize emotions from the user's facial expressions and voice, and sends the data to the server. For example, the device can recognize "excitement" or "relaxation" from the user's facial expressions while checking travel plan information.

[0797] Step 4:

[0798] The server uses a generative AI model to generate a personalized itinerary based on the latest user profile, input information, and sentiment data, including details of attractions, restaurants, activities, accommodation, and transportation.

[0799] Step 5:

[0800] The server retrieves the latest tourist information, events, restaurant reviews, and other information about the destination in real time via the Internet and reflects this information in the generated plan. Specific examples include information such as "a special exhibition being held at a certain art museum" and "a new cafe opening."

[0801] Step 6:

[0802] The server generates an optimized travel plan within the user's budget, calculating and adjusting the breakdown of each expense so that it does not exceed the budget, taking into account factors such as accommodation, transportation, meals, and museum admission fees.

[0803] Step 7:

[0804] The server sends the generated travel plan to the device, which then displays it to the user, who can review the plan and customize it to suit their preferences or preferences.

[0805] Step 8:

[0806] Once the user has completed customization and finalized the plan, the server executes the bulk booking of accommodation, transportation, activities, etc. For example, it books a hotel, arranges transportation, and purchases museum tickets.

[0807] Step 9:

[0808] The server sends all reservation confirmation information to the terminal, and the terminal displays the reservation details to the user. The user finally confirms the reservation details and makes any final adjustments as necessary. For example, a screen asking "Are you sure you want to confirm this?" is displayed, requesting approval.

[0809] In this way, the travel planning system of the present invention automatically generates a personalized and optimal travel plan while reflecting the information and emotion data entered by the user and obtaining the latest tourist information in real time.By including planning within a budget and bulk booking, it significantly reduces the burden on the user and provides a comfortable travel experience.

[0810] Example 2

[0811] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0812] Conventional travel planning systems provide travel plans based on a user's basic information and past travel history, but this alone makes it difficult to comprehensively consider user emotions, real-time information updates, budget management, etc. In addition, the process for generating individually optimized travel plans is insufficient, resulting in a lack of personalized user experience.

[0813] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for acquiring user-input information, means for creating and updating a profile based on past travel history and user preferences, means for acquiring and analyzing emotion data, means for generating an individually optimized travel plan using a generative AI model, means for acquiring the latest tourist information, events, and reviews from the Internet in real time, means for generating an optimized travel plan within an input budget, means for presenting the generated travel plan to the user and enabling customization, means for booking accommodations, transportation, and activities all at once based on the plan approved by the user, and means for allowing the user to confirm and finalize the reservation details. This allows the server to generate individually optimized travel plans that take into account the user's emotions and real-time information, enabling comprehensive budget management and bulk booking.

[0814] "Means for acquiring user-entered information" refers to a function for acquiring basic information about the trip (destination, duration, budget, interests, etc.) entered by the user from the terminal and sending it to the server.

[0815] "Means for creating and updating a profile based on past travel history and user preferences" refers to a function that retrieves a user's past travel history and preferences from a database and integrates them with newly entered information to create or update a user profile.

[0816] "Means for acquiring and analyzing emotional data" refers to a function that uses an emotion engine to recognize and analyze emotions from the user's facial expressions and voice, and sends the acquired emotional data to the server.

[0817] "Means for generating individually optimized travel plans using a generative AI model" means a function for generating optimized travel plans using a generative AI model based on a user profile, input information, and sentiment data.

[0818] "Means of obtaining the latest tourist information, events, and reviews in real time from the Internet" refers to a function that obtains the latest tourist information, events, and reviews in real time via the Internet and reflects them in travel plans.

[0819] The "means for generating an optimized travel plan within an input budget" is a function for generating an optimized travel plan within a budget set by a user and adjusting the breakdown of expenses.

[0820] "Means for presenting the generated travel plan to the user and enabling customization" refers to a function for presenting the generated travel plan to the user and allowing the user to confirm, edit, and adjust the plan.

[0821] "A means of booking accommodation, transportation, and activities all at once based on a plan approved by the user" is a function that allows users to make reservations for accommodation, transportation, activities, etc. all at once based on a travel plan approved by the user.

[0822] The "means for allowing the user to confirm and finalize the reservation details" is a function that displays all confirmed reservation information to the user, allowing the user to confirm and finalize the reservation details.

[0823] The present invention is a system that provides travel plans based on a user's basic information and emotion data. Specific embodiments for implementing the present invention will be described below, including the hardware and software used, data processing, and data calculation.

[0824] First, the user enters basic information about the trip (destination, duration, budget, interests, etc.) into the device. For example, "Tokyo, 5 days, budget 100,000 yen, visiting art museums." The device acquires this information, formats it into JSON format, and sends it to the server.

[0825] Next, the server retrieves the user's past travel history and preferences from a database (e.g., MySQL). It combines the retrieved data with the newly entered information to create or update the user profile. This is done using SQL queries to retrieve information and update the profile. For example, if there is data in the past that says, "I enjoyed visiting art museums in Kyoto," the profile can be updated based on that.

[0826] The device also runs an emotion engine (e.g., Amazon Rekognition) to acquire emotional data. The device captures the user's facial expressions and voice using a camera and microphone, and analyzes their emotions. The analysis results are sent to the server as emotional data, such as "excited" or "relaxed."

[0827] The server uses a generative AI model (e.g., GPT-4) to create a personalized, optimized itinerary based on the latest user profile, input information, and sentiment data, using prompts like the following:

[0828] Example prompt sentence:

[0829] "Generate the optimal travel plan for a 5-day trip to Tokyo's art museums, with a budget of 100,000 yen, if the user is excited."

[0830] Next, the server retrieves the latest tourist information, events, and reviews in real time from the Internet via an API (e.g., Google Places API) and incorporates this information into the travel plan. For example, it retrieves information about newly opened cafes and special exhibitions and incorporates it into the plan.

[0831] Furthermore, the server optimizes the travel plan within the user's set budget. It calculates cost elements (accommodation, transportation, meals, activities, etc.) and adjusts them so that the total cost does not exceed the budget. For example, if the budget is 100,000 yen, it will adjust accommodation and transportation costs.

[0832] The generated itinerary is presented to the user via their device. The user can review the itinerary and edit (customize) itinerary as needed. For example, they can make changes such as "changing the lunch location on the second day" or "adding a new art gallery on the fourth day."

[0833] After the travel plan is confirmed, the server makes reservations for accommodation, transportation, activities, etc. in one batch. This is done using various reservation APIs (e.g., Booking.com API, transportation reservation API). Finally, all reservation confirmation information is sent to the terminal, and the user can confirm and make final adjustments to the reservation details. The displayed reservation confirmation screen displays information such as "Hotel reservation: confirmed," "Train ticket: confirmed," and "Museum ticket: confirmed," and the user can make adjustments as necessary.

[0834] The system allows users to easily and efficiently generate personalized travel plans, ensuring an optimal travel experience that also takes into account real-time information and sentiment data.

[0835] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0836] Step 1: Obtaining User Input Information

[0837] The user enters basic information about the trip (destination, duration, budget, interests, etc.) into the device. For example, they enter information like "Tokyo, 5 days, budget 100,000 yen, visiting art museums." The device acquires this information and formats it into JSON format to send to the next process. The input information is used in the next step.

[0838] Input: Basic information about the user's trip

[0839] Output: User input information in JSON format

[0840] Step 2: Create and update your profile

[0841] The server receives the input information and retrieves the user's past travel history and preferences from a database (e.g., MySQL). For example, it retrieves information such as "I enjoyed visiting art museums in Kyoto" in the past. It then combines this data to create or update a user profile. The profile includes the newly entered information and past data.

[0842] Input: User-supplied information in JSON format, past travel history and preference data

[0843] Output: Updated user profile

[0844] Step 3: Acquire and analyze emotion data

[0845] The device uses an emotion engine (e.g., Amazon Rekognition) to capture the user's facial expressions and voice. When the user confirms a specific plan, the device analyzes their emotions through the camera and microphone. For example, it can determine if the user is smiling and expressing excitement. The acquired emotion data is sent to the server.

[0846] Input: User facial and voice data

[0847] Output: Parsed emotion data

[0848] Step 4: Generate your travel plan

[0849] The server uses a generative AI model (e.g., GPT-4) to generate an individually optimized itinerary based on the latest user profile, input information, and emotional data. The generated prompt is as follows: "Generate the optimal itinerary for visiting art museums in Tokyo, for 5 days, with a budget of 100,000 yen, if the user is excited." This results in a detailed itinerary including tourist attractions, restaurants, activities, accommodation, transportation, and more.

[0850] Input: User profile, input information, emotional data

[0851] Output: A trip plan from a generative AI model

[0852] Step 5: Get real-time information

[0853] The server uses an API (e.g., Google Places API) to obtain the latest tourist information, events, reviews, etc. of the destination in real time. For example, it obtains information about new cafe openings and special exhibitions. This information is reflected in the generated travel plan.

[0854] Input: Destination information, API query

[0855] Output: Real-time tourist information, events, and reviews

[0856] Step 6: Optimize within your budget

[0857] The server optimizes the travel plan within the user's budget by calculating accommodation, transportation, meals, and activity costs and adjusting each part of the plan based on the calculation results.

[0858] Input: Travel plan, budget information

[0859] Output: A budget-optimized itinerary

[0860] Step 7: Present and customize your itinerary

[0861] The device presents the generated itinerary to the user. The user can review the itinerary and edit (customize) it as needed. For example, the user can customize it by changing the lunch location on the second day or adding a new art gallery on the fourth day. This customization information is sent from the device to the server.

[0862] Input: Generated itinerary

[0863] Output: A travel plan customized by the user

[0864] Step 8: Bulk booking process

[0865] The server makes reservations for accommodation, transportation, activities, etc. in bulk based on the user's confirmed travel plan. For example, it makes hotel reservations, arranges train tickets, and purchases museum tickets. This process uses a booking API (e.g., Booking.com API, transportation booking API).

[0866] Input: Confirmed travel plans

[0867] Output: Confirmed reservation information

[0868] Step 9: Review and finalize

[0869] The server sends all reservation confirmation information to the terminal. The terminal displays the reservation details to the user and presents a confirmation screen. The user can review the displayed reservation details (e.g., "Hotel reservation: confirmed," "Train ticket: confirmed," "Museum ticket: confirmed") and make any necessary final adjustments.

[0870] Input: Confirmed reservation information

[0871] Output: The final reservation details confirmed and adjusted by the user

[0872] This process flow allows users to efficiently generate personalized travel plans and enjoy optimal travel plans that reflect real-time information and emotional data.

[0873] (Application example 2)

[0874] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0875] In current factory work, there is no system that can properly recognize the emotional state of workers and optimize work efficiency based on that emotional state. As a result, worker stress and a decline in motivation can have a negative impact on production efficiency. In addition, it is not possible to obtain emotional data in real time and adjust work plans based on that data. To address these issues, a system is needed that can recognize workers' emotions in real time and optimize work plans based on that data.

[0876] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0877] In this invention, the server includes means for acquiring user-input information, means for creating and updating a profile based on past history and user preferences, means for generating an individually optimized plan using a generative AI model, means for acquiring the latest information from the Internet in real time, means for generating an optimized plan within an input budget, means for presenting the generated plan to the user and enabling customization, means for reserving all necessary items in one lump sum based on the plan approved by the user, means for acquiring the user's emotions using an emotion recognition engine, means for adjusting the plan based on the user's emotion data, and means for allowing the user to confirm and finalize the reservation details. This enables appropriate work assignment and environment adjustment according to the emotional state of workers.

[0878] "User-input information" is data about a user's attributes and requests that is provided to the system.

[0879] "Past history" is a record of the activities a user has experienced to date.

[0880] "User preferences" are information that refers to personal tendencies or inclinations that a user has toward certain activities or choices.

[0881] A "profile" is a collection of data that indicates a user's characteristics, which is composed of information such as the user's past history and preferences.

[0882] A "generative AI model" is an algorithm or system that uses artificial intelligence to generate optimal results or plans based on specific input data.

[0883] "Real-time, up-to-date information" refers to the latest data based on the current situation, obtained via the Internet or other means.

[0884] A "budget-optimized plan" is a plan created to achieve the most effective results within the budget set by the user.

[0885] An "emotion recognition engine" is software and hardware that analyzes and recognizes a user's emotional state from data such as facial expressions and voice.

[0886] "Allows for customization" refers to the ability for users to freely change or adjust the plans and settings provided.

[0887] "Making a bulk reservation" refers to processing multiple reservation items at once.

[0888] "Confirm reservation details and make final adjustments" is a function that allows the user to confirm the reservation details and make final corrections or adjustments as necessary.

[0889] The present invention relates to a system that recognizes the emotional state of factory workers and optimizes work plans based on that data. Specific embodiments for carrying out the present invention are described below.

[0890] System configuration

[0891] 1. Obtaining user input information

[0892] The factory robot obtains basic information from the worker, such as shift information, responsibilities, and skill level, through the robot's input interface and sends it to the server.

[0893] 2. Creating and updating your profile

[0894] The server retrieves the worker's past work history and skill data from the database and integrates it with newly entered information to create or update the worker's profile.

[0895] 3. Acquiring Emotion Data

[0896] The factory robot uses a camera and microphone equipped with an emotion engine to capture facial expressions and voice data of workers in real time, which is then analyzed by the emotion recognition engine to determine the worker's emotional state (e.g., whether they are stressed or relaxed) and sent to a server.

[0897] 4. Generating work plans using generative AI models

[0898] The server generates a work plan using a generative AI model (such as GPT-4) based on user input information, worker profiles, and emotional data. The generative AI model used here takes into account emotional states and skill levels to optimally assign work and adjust the environment.

[0899] Example prompt sentence:

[0900] "Worker basic information: night shift, assembly line work, skill level 5. Worker emotional data: feeling stressed. Based on this, please create a plan to optimize work efficiency."

[0901] 5. Obtaining real-time information

[0902] The server obtains information about the latest work status and machine conditions within the factory in real time via the Internet and reflects this information in the generated work plan.

[0903] 6. Optimizing work efficiency

[0904] Based on the generated work plan, the server assigns appropriate work to avoid overloading workers, and adjusts according to individual situations, such as assigning less demanding work to workers who are feeling stressed.

[0905] 7. Plan presentation and customization

[0906] The factory robot presents the generated work plan to the worker, allowing the worker to freely adjust and customize it. The worker can change the plan using the interface.

[0907] 8. Bulk Schedule Processing

[0908] The server collectively schedules each task based on the plan finalized by the worker and notifies the scheduler.

[0909] 9. Confirmation and final adjustments

[0910] The server sends all schedule confirmation information to the factory robot, which then displays a confirmation screen to the worker, who then makes any final confirmations or adjustments and finalizes the schedule.

[0911] Hardware and Software Use

[0912] Hardware:

[0913] Camera and microphone with emotion engine: Captures worker emotion data.

[0914] Factory robots: Collect worker input and assist with customization.

[0915] Server: Data processing and execution of generative AI models.

[0916] software:

[0917] Emotion recognition system: Analyzes workers' facial expressions and voice data.

[0918] User profile management system: Create and update worker profiles.

[0919] Generative AI model: generating work plans.

[0920] Scheduling system: Work booking and management.

[0921] In this way, the present invention is a system that recognizes the emotional state of factory workers in real time, generates work plans based on that data, and optimizes work efficiency, thereby reducing worker stress and improving production efficiency.

[0922] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0923] Step 1:

[0924] The user enters basic information such as shift information, duties, and skill level into the terminal.

[0925] Input: Shift information (e.g., night shift), duties (e.g., assembly line work), skill level (e.g., level 5)

[0926] Output: User input information

[0927] Specific operation: The user inputs the necessary information into the input interface of the factory robot, and the robot acquires this information and sends it to the server.

[0928] Step 2:

[0929] The server retrieves the worker's past work history and skill data from the database and creates or updates a profile.

[0930] Input: User input information, past work history, skill data

[0931] Output: Updated worker profile

[0932] What it does: The server retrieves past work history and skill data from the database, integrates it with the user's new information, and updates their profile.

[0933] Step 3:

[0934] Factory robots use cameras and microphones equipped with emotion engines to capture facial expressions and voice data from workers in real time.

[0935] Input: Facial expression data and voice data of workers

[0936] Output: Emotion data

[0937] How it works: The factory robot monitors the workers while they are working, collecting data using facial camera and microphone. The emotion recognition engine analyzes the data and recognizes their emotional state.

[0938] Step 4:

[0939] The server uses a generative AI model to generate an optimal work plan based on user input information, profile data, and emotional data.

[0940] Input: User input information, profile data, emotion data

[0941] Output: Optimized work plan

[0942] How it works: The server uses this data to input prompts into a generative AI model, which then generates an optimal work plan. GPT-4 and other models are used as generative AI models.

[0943] Example prompt sentence:

[0944] "Worker basic information: night shift, assembly line work, skill level 5. Worker emotional data: feeling stressed. Based on this, please create a plan to optimize work efficiency."

[0945] Step 5:

[0946] The server obtains the latest information on work status and machine conditions within the factory in real time via the Internet and reflects this in the generated work plan.

[0947] Input: Latest work status information, machine status information

[0948] Output: Updated Work Plan

[0949] Specific operation: The server connects to the factory's systems, obtains information such as the current line operation status and machine maintenance status, and reflects this information in the optimal work plan.

[0950] Step 6:

[0951] The server presents the generated work plan to the user through the terminal, allowing the user to review and customize the plan.

[0952] Input: Generated Work Plan

[0953] Output: A work plan presented to the user

[0954] Specific operation: The terminal visualizes the work plan and displays it to the user, and provides an interface that allows the user to edit break times and work content as needed.

[0955] Step 7:

[0956] The server collectively schedules work assignments and break schedules based on the plan finalized by the user and notifies each worker.

[0957] Input: User-confirmed work plan

[0958] Output: Bulk scheduled work and notification information

[0959] Specific operation: The server sets the schedules of all workers in bulk based on the confirmed work plan and sends notifications to each worker.

[0960] Step 8:

[0961] The server transmits all confirmed schedule information to the terminal, which presents a confirmation screen to the user.

[0962] Input: Confirmed schedule information

[0963] Output: A confirmation screen presented to the user

[0964] Specific operation: The server sends schedule information to the terminal, which displays it to the user. The user then performs a final check and makes any necessary corrections.

[0965] These steps realize a system that can appropriately assign tasks and adjust the environment according to the user's emotional state.

[0966] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0967] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0968] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0969] [Third embodiment]

[0970] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0971] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0972] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0973] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0974] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0975] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0976] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0977] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0978] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0979] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0980] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0981] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0982] The present invention is a travel planning system for efficiently and individually optimizing a user's travel plan. The configuration and operation of the system will be described below as a specific embodiment for carrying out the present invention.

[0983] System configuration:

[0984] 1. Obtaining user input information

[0985] Users enter basic information about their trip into the device, such as destination, duration, budget, and specific interests (e.g., visiting museums).

[0986] The terminal collects the input information and transmits it to the server.

[0987] Example: User enters "Tokyo, 5 days, budget 100,000 yen, museum visit."

[0988] 2. Creating and updating your profile

[0989] The server retrieves the user's past travel history and preferences from a database and combines them with newly entered information to create or update a user profile.

[0990] Example: The server updates a user's profile based on the data that "the user enjoyed visiting art museums in Kyoto in the past."

[0991] 3. Generate a travel plan

[0992] The server uses a generative AI model to automatically generate a travel plan based on the user's current profile and input information, including attractions, restaurants, activities, accommodations, and transportation options.

[0993] Example: The server creates a plan including tourist attractions, places to eat, and activities based on the conditions "visiting art museums in Tokyo," "budget within 100,000 yen," and "5 days."

[0994] 4. Obtaining real-time information

[0995] The server obtains the latest tourist information, events, restaurant reviews, and other information about the destination in real time via the Internet and reflects this information in the generated plan.

[0996] Example: The server obtains information such as "A special exhibition is being held at the Ueno Art Museum" and "A new cafe has opened in Ginza" and adds them to the plan.

[0997] 5. Optimizing within your budget

[0998] The server generates an optimized travel plan within the user's budget, calculating the breakdown of costs and adjusting them so that the plan does not exceed the user's budget.

[0999] Example: The server calculates the cost of accommodation, transportation, meals, museum admission fees, etc., and adjusts the total cost to stay within 100,000 yen.

[1000] 6. Providing and customizing travel plans

[1001] The terminal presents the generated travel plan to the user, allowing the user to review and customize the plan contents.

[1002] Users can review the proposed itinerary and edit or adjust it as needed.

[1003] Example: A user customizes a proposed plan by, for example, changing the lunch location on day 2 or adding a new art gallery on day 4.

[1004] 7. Bulk booking processing

[1005] The server makes all reservations for accommodation, transportation, activities, etc. based on the plan confirmed by the user.

[1006] Example: A server centralizes hotel reservations, train ticket bookings, museum ticket purchases, etc.

[1007] 8. Confirmation and final adjustments

[1008] The server sends all reservation confirmation information to the terminal.

[1009] The terminal displays the reservation details to the user and presents a confirmation screen.

[1010] The user then finalizes the reservation and makes any necessary adjustments.

[1011] Example: The terminal displays "Hotel reservation: confirmed," "Train ticket: confirmed," and "Museum ticket: confirmed," and you click "OK" in response to the confirmation message "Are you sure about this?"

[1012] In this way, the travel planning system of the present invention efficiently generates personalized travel plans that meet the user's needs, manages budgets while reflecting real-time information, and performs all reservation procedures in one go, thereby significantly reducing the user's travel planning workload and providing a comfortable travel experience.

[1013] The processing flow will be explained below.

[1014] Step 1:

[1015] The user inputs the travel destination, duration, budget, and interests (e.g., visiting museums) into the device. The device acquires this information and sends it to the server.

[1016] Step 2:

[1017] The server receives the entered information, retrieves the user's past travel history and preferences from a database, and combines the newly entered information with the previous data to create or update the user profile.

[1018] Step 3:

[1019] The server uses a generative AI model to generate a personalized itinerary based on the updated user profile and input, which includes details on attractions, restaurants, activities, accommodation, transportation, and more.

[1020] Step 4:

[1021] The server obtains the latest tourist information, events, restaurant reviews, and other information about the destination in real time via the Internet and reflects this information in the generated plan.

[1022] Step 5:

[1023] The server generates an optimized travel plan within the user's budget, calculating the breakdown of expenses and adjusting the plan to stay within the budget.

[1024] Step 6:

[1025] The server sends the generated travel plan to the terminal, which provides the user with an interface to display and customize the plan.

[1026] Step 7:

[1027] The user checks the presented travel plan and customizes it as necessary. The device saves the user's editing operations and sends the data to the server.

[1028] Step 8:

[1029] Once the user finalizes their travel plans, the server makes all reservations for accommodation, transportation, activities, etc. in one go.

[1030] Step 9:

[1031] The server sends all reservation confirmation information to the terminal, which displays the reservation details to the user and presents a confirmation screen, where the user can finally review the reservation details and make any final adjustments if necessary.

[1032] Example 1

[1033] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1034] Current travel planning systems struggle to efficiently and individually optimize users' travel plans. They also lack the ability to reflect real-time information, manage budgets, and process reservations in bulk. Furthermore, they lack the ability to validate user input and integrate it with past travel history, resulting in travel plans that cannot fully meet users' needs.

[1035] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1036] In this invention, the server includes means for acquiring user-input information, means for creating and updating a profile based on past travel history and user preferences, means for generating an individually optimized travel plan using a generative AI model, means for acquiring the latest tourist information, events, and reviews from the Internet in real time, means for generating an optimized travel plan within an input budget, means for presenting the generated travel plan to the user and enabling customization, means for booking accommodations, transportation, and activities all at once based on the plan approved by the user, means for allowing the user to confirm and finalize the reservation details, means for verifying user information and sending it to the server in a correct format, means for acquiring past travel history and user preferences from a database, and means for inputting prompt statements to the generative AI model. This enables efficient generation of personalized travel plans tailored to user needs, reflecting real-time information, budget management, and batch booking processing.

[1037] "User-entered information" refers to data that a user enters into a terminal, including basic information about the trip (destination, duration, budget, interests, etc.).

[1038] "Profile" refers to a user's individual information that is generated and updated by integrating the user's past travel history and preferences with current input information.

[1039] A "generative AI model" is an artificial intelligence model that automatically generates optimal travel plans based on input prompts.

[1040] "Real-time information" refers to the latest tourist information, events, reviews, etc. obtained via the Internet.

[1041] A "budget-optimized travel plan" is a travel plan generated by adjusting various expenses within the budget set by the user.

[1042] "Customization" means the act of a user editing or adjusting the content of a presented travel plan.

[1043] "Bulk booking" refers to the process of booking accommodation, transportation, activities, etc. all at once based on a user's confirmed travel plans.

[1044] "Final adjustment" refers to the act of the user finally checking the reservation details and making any necessary changes.

[1045] "User information validation" refers to the process of ensuring that the information entered by the user is in the correct format.

[1046] "Database" refers to a system for managing and storing information such as a user's past travel history and preferences.

[1047] A "prompt sentence" is a specific instruction sentence that is input into a generative AI model.

[1048] The present invention is a travel planning system for efficiently and individually optimizing a user's travel plans. The system allows the user to input basic travel information, and automatically generates a travel plan tailored to individual needs based on that information. The following describes the configuration and operation of the system as a specific embodiment of the present invention.

[1049] System configuration:

[1050] 1. Obtaining user input information

[1051] Users enter basic information about their trip (destination, duration, budget, interests) into an input form on their device.

[1052] The terminal validates the entered information to ensure it is in the correct format, then transmits it to the server.

[1053] Hardware and software used:

[1054] Hardware: Personal computers, smartphones, servers

[1055] Software: web browsers, database management systems (e.g., MySQL), generative AI models (e.g., OpenAI GPT-4)

[1056] Specific working example:

[1057] 1. Obtaining user input information

[1058] When a user enters "Tokyo, 5 days, budget 100,000 yen, museum visit" into the form on their device and clicks the "Submit" button, the device sends this information to the server.

[1059] 2. Creating and updating your profile

[1060] The server accesses the database with the received user information to retrieve the user's past travel history and preferences, and combines the newly entered information with existing data to create or update an updated user profile.

[1061] Example: The server retrieves data from the travel history table, such as "I enjoyed visiting museums in Kyoto in the past," and adds new information, such as "Tokyo, 5 days, visiting museums."

[1062] 3. Generate a travel plan

[1063] The server uses a generative AI model (e.g., GPT-4) and inputs the user's latest profile and input information as prompts into the AI ​​model.

[1064] Examples of prompts:

[1065] I'd like to create a travel plan. Please suggest a plan for a trip to Tokyo based on the following criteria:

[1066] Destination: Tokyo

[1067] Trip duration: 5 days

[1068] Budget: 100,000 yen

[1069] Interests: Visiting art museums, stylish cafes

[1070] thank you.

[1071] The generative AI model generates an optimal travel plan based on these prompts and returns it to the server.

[1072] 4. Obtaining real-time information

[1073] The server retrieves the latest tourist information, event information, and restaurant reviews about the destination via the Internet using an API (e.g., Google Places API).

[1074] Example: The server uses the Google Places API to retrieve information about "art museums in Tokyo" and adds new special exhibition information and newly opened cafes to the plan.

[1075] 5. Optimizing within your budget

[1076] The server calculates the total cost of each element (accommodation, transportation, meals, etc.) to generate an optimized travel plan within the user's set budget.

[1077] Example: The server will show the breakdown of expenses calculated (e.g., accommodation 50,000 yen, transportation 20,000 yen, meals 15,000 yen, museum admission 15,000 yen) and adjust the amount to fit within a budget of 100,000 yen.

[1078] 6. Providing and customizing travel plans

[1079] The terminal presents the generated travel plan to the user, allowing the user to review and customize the plan contents.

[1080] Example: The device screen displays "Day 2: Museum of Art in Ueno" and "Lunch: Cafe in Ginza," and the user adjusts the location of lunch on day 2 to the new cafe.

[1081] 7. Bulk booking processing

[1082] The server executes various reservations in bulk based on the plan confirmed by the user, and connects with each reservation system using an API.

[1083] Example: The server executes "Hotel reservation," "Train ticket arrangement," and "Museum ticket purchase" and obtains the reservation ID for each.

[1084] 8. Confirmation and final adjustments

[1085] The server sends all reservation confirmation information to the terminal.

[1086] The device will then present the user with a final confirmation screen, allowing them to review the reservation and make any final adjustments if necessary.

[1087] Example: A list such as "Hotel reservation: confirmed" or "Museum tickets: confirmed" will be displayed on the terminal, and the user will click the "Accept" button along with the message "Are you sure about this?"

[1088] In this way, the travel planning system of the present invention efficiently generates personalized travel plans tailored to the user's needs, manages budgets while reflecting real-time information, and handles all booking procedures in one place, thereby significantly reducing the user's travel planning workload and providing a comfortable travel experience.

[1089] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1090] Step 1: Obtaining User Input Information

[1091] The user enters basic travel information (destination, duration, budget, interests) into the input form on the device.

[1092] Input: User enters "Tokyo, 5 days, budget ¥100,000, museum visit."

[1093] The terminal validates the information entered to ensure it is in the correct format.

[1094] After confirmation, the terminal transmits the input information to the server.

[1095] Output: The user's trip information is sent to the server.

[1096] Specific behavior: The user enters travel information into a form on the device and clicks the "Submit" button.

[1097] Step 2: Create and update your profile

[1098] The server accesses a database based on the received user information to obtain the user's past travel history and preferences.

[1099] Input: User's travel information sent to the server.

[1100] The server merges the newly entered information with existing data to create or update an updated user profile.

[1101] Output: A new user profile is created and updated.

[1102] Specific operation: The server retrieves data from the travel history table, such as "I enjoyed visiting art museums in Kyoto in the past," and adds new information, such as "Tokyo, 5 days, visiting art museums."

[1103] Step 3: Generate a travel plan

[1104] The server uses the generative AI model and inputs the user's latest profile and input information as prompts into the AI ​​model.

[1105] Input: A prompt containing your latest user profile and travel information.

[1106] The generative AI model generates an optimal travel plan based on the prompts and returns it to the server.

[1107] Output: Optimized trip plan.

[1108] Specific operation: The server prompts the generated AI model with the input information "visiting art museums in Tokyo," "five days," and "budget of 100,000 yen," and queries the AI.

[1109] Step 4: Get real-time information

[1110] The server uses an API to obtain the latest tourist information, event information, and restaurant reviews about the destination via the Internet.

[1111] Input: A request from the server to retrieve information about "Tokyo museums" and "events" from the API.

[1112] The server integrates and reflects the acquired real-time information into the travel plan.

[1113] Output: A trip plan reflecting real-time information.

[1114] Specific operation: The server uses the Google Places API to get the latest tourist spot information and add it to the plan.

[1115] Step 5: Optimize within your budget

[1116] The server calculates the total cost of each element (accommodation, transportation, meals, etc.) to generate an optimized travel plan within the user's set budget.

[1117] Input: The cost of each element of your travel plan.

[1118] The server adjusts each element to keep costs within budget.

[1119] Output: An adjusted budgeted travel plan.

[1120] Specific operation: The server displays the calculated breakdown of expenses (e.g., accommodation 50,000 yen, transportation 20,000 yen, meals 15,000 yen, museum admission 15,000 yen), and adjusts the budget to stay within 100,000 yen.

[1121] Step 6: Present and customize your itinerary

[1122] The terminal presents the generated itinerary to the user.

[1123] Input: Adjusted travel plans.

[1124] The user can review the displayed plan and use the editor to edit and adjust the content as needed.

[1125] Output: A travel plan customized by the user.

[1126] Specific operation: The device screen displays "Day 2: Ueno Art Museum" and "Lunch: Ginza Cafe," and the user customizes the location, such as "changing the lunch location for day 2 to a new cafe."

[1127] Step 7: Bulk booking process

[1128] The server executes various reservations in bulk based on the plan confirmed by the user, and connects with each reservation system using an API.

[1129] Input: Finalized plan information.

[1130] The server receives confirmation from each reservation system and compiles the confirmed reservations.

[1131] Output: Reservation IDs for various services booked together.

[1132] Specific operation: The server executes "hotel reservation," "train ticket arrangement," and "museum ticket purchase" and obtains the reservation ID for each.

[1133] Step 8: Review and finalize

[1134] The server sends all reservation confirmation information to the terminal.

[1135] Input: Reservation ID information for various services.

[1136] The terminal displays a final confirmation screen to the user.

[1137] The user reviews the reservation, makes any final adjustments if necessary, and then clicks final approval.

[1138] Output: Final confirmed and adjusted itinerary.

[1139] Specific operation: A list such as "Hotel reservation: confirmed" or "Museum tickets: confirmed" will be displayed on the terminal, and the user will click the "Accept" button along with the message "Are you sure about this?"

[1140] (Application example 1)

[1141] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1142] Traditional travel planning systems offer a limited user experience. While they can update information in real time and optimize within budget, they lack a way for users to visually confirm their plans. Furthermore, they cannot experience the generated plans in virtual reality, limiting user options.

[1143] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1144] In this invention, the server includes: means for acquiring user-input information; means for creating and updating a profile based on past travel history and user preferences; means for generating an individually optimized travel plan using a generative AI model; means for acquiring the latest tourist information, events, and reviews from the Internet in real time; means for generating an optimized travel plan within an input budget; means for presenting the generated travel plan to the user and enabling customization; means for booking accommodations, transportation, and activities all at once based on the plan approved by the user; means for allowing the user to confirm and finalize the reservation details; and means for experiencing the generated travel plan in virtual reality through smart glasses. This allows users to visually check their travel plan and combine it with real-time information to create a more accurate plan. Furthermore, using smart glasses to experience the travel plan in virtual reality allows users to visualize the plan, expanding their options and realizing more satisfying travel plans.

[1145] "User-Entered Information" means information about destination, duration, budget, and particular interests provided by a User for travel planning purposes.

[1146] "Past travel history" refers to data about a user's previous trips, including records of places visited, dates, and activities experienced.

[1147] "User preferences" refers to information that reflects the places, activities, and preferences that a user is particularly interested in when traveling.

[1148] A "profile" is data that indicates a user's travel tendencies and characteristics, based on the user's past travel history and preferences.

[1149] A "generative AI model" is an artificial intelligence model that automatically generates optimized travel plans based on input data.

[1150] "Real-time tourist information, events, and reviews obtained from the Internet" refers to data that collects the latest information about a destination online in real time.

[1151] A "budget-optimized travel plan" is a travel plan that is tailored to meet the user's preferences and requests to the greatest extent possible within the budget set by the user.

[1152] "Presenting and customizing generated travel plans" refers to the function that displays the travel plan created by the generative AI model to the user and allows the user to change or modify its contents.

[1153] "Comprehensive accommodation, transport and activity booking" is the process of booking accommodation, transport and destination activities in one go based on a confirmed travel plan.

[1154] "Confirm and finalize reservation details" is the process by which a user confirms their final travel plans and makes any final changes or adjustments, if necessary.

[1155] "Experiencing the generated travel plan in virtual reality through smart glasses" means visually experiencing the travel plan in a virtual reality environment using smart glasses.

[1156] The present invention provides a travel planning system for enabling users to efficiently and individually optimize their travel plans, and in particular, allows users to experience their travel plans in virtual reality using smart glasses. Detailed embodiments of the system are described below.

[1157] System configuration

[1158] 1. Obtaining user input information

[1159] The device provides an interface for users to enter basic information about their trip (destination, duration, budget, specific interests), which is then sent to the server.

[1160] 2. Creating and updating your profile

[1161] The server retrieves the user's past travel history and preferences from the database and combines them with the latest input information to create and update a user profile, generating data that reflects the user's tastes and travel habits.

[1162] 3. Generate a travel plan

[1163] The server uses a generative AI model (e.g., GPT-4 or BERT) to automatically generate a travel plan based on the latest user profile and input information, including attractions, restaurants, activities, accommodations, and transportation.

[1164] 4. Obtaining real-time information

[1165] The server retrieves the latest tourist information, events, and reviews about the destination in real time via the Internet and reflects them in the generated plan, allowing users to use plans based on the most up-to-date information.

[1166] 5. Optimizing within your budget

[1167] The server generates an optimized travel plan within the user's budget, calculating the breakdown of expenses and adjusting the plan to stay within the budget.

[1168] 6. Providing and customizing travel plans

[1169] The device presents the generated travel plan to the user, allowing the user to review and customize the plan's contents. The user can also edit and adjust the presented plan.

[1170] 7. Bulk booking processing

[1171] The server makes all reservations for accommodation, transportation, activities, etc. based on the plan confirmed by the user.

[1172] 8. Confirmation and final adjustments

[1173] The server sends all reservation confirmation information to the terminal, which displays the reservation details to the user and provides a confirmation screen for the user to review and adjust.

[1174] 9. Virtual Reality Experiences

[1175] The device allows users to experience the generated travel plan in virtual reality through smart glasses, allowing them to visually check the plan and experience the atmosphere of the destination in advance.

[1176] Hardware and software used

[1177] VR Engine: Use Unity3D or Unreal Engine to render virtual reality.

[1178] AI models: GPT-4 (OpenAI) and BERT (Google) are used to generate itineraries.

[1179] Network API: Use the Google Places API and Yelp API to get the latest tourist information, events, and reviews.

[1180] Specific examples

[1181] Consider a case where a user wears smart glasses and generates a travel plan for "Tokyo, 5 days, budget of 100,000 yen, visiting art museums." The user can view the generated plan in virtual reality through the smart glasses, visually experiencing a special exhibition at an art museum in Ueno or a new cafe in Ginza.

[1182] Example prompt sentence:

[1183] Generate a personalized itinerary based on "Tokyo, 5 days, budget of ¥100,000, museums," including attractions, restaurants, activities, accommodations, and transportation.

[1184] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1185] Step 1:

[1186] The device obtains basic travel information from the user (destination, duration, budget, interests, etc.).

[1187] Input: The user enters information such as "Tokyo, 5 days, budget 100,000 yen, museum visit" into the device interface.

[1188] Output: The device sends the acquired information to the server.

[1189] Step 2:

[1190] The server creates and updates a profile based on the user's past travel history and preferences.

[1191] Input: The server retrieves the user's past travel history and preferences from a database and receives newly entered information.

[1192] Data processing: Combine your past travel history with the information you provide to create and update a new user profile.

[1193] Output: Generate an updated profile, ready to be passed to the AI ​​model.

[1194] Step 3:

[1195] The server uses a generative AI model to generate an individually optimized itinerary.

[1196] Input: Your most recent user profile and input information.

[1197] Data computation: Generative AI models (e.g., GPT-4 and BERT) are used to generate an optimal itinerary based on a user profile and input information. The prompt is "Generate a personalized itinerary based on Tokyo, 5 days, budget of 100,000 yen, and museum visits."

[1198] Output: The plan includes attractions, restaurants, activities, accommodations, and transportation. Store the generated travel plan and send it to the next step.

[1199] Step 4:

[1200] The server retrieves the latest tourist information, events and reviews in real time from the Internet.

[1201] Input: Generated itinerary and up-to-date information from the internet.

[1202] Data processing: Use network APIs (e.g., Google Places API or Yelp API) to obtain real-time tourist information, events, and reviews for the destinations listed in the plan.

[1203] Output: An updated itinerary with the latest information merged.

[1204] Step 5:

[1205] The server generates an optimized travel plan within the budget set by the user.

[1206] Input: Updated travel plans and user-set budget.

[1207] Data calculation: Calculate the cost of each tourist attraction, restaurant, accommodation, and transportation, and optimize it within your budget.

[1208] Output: A final itinerary adjusted to fit within your budget.

[1209] Step 6:

[1210] The terminal presents the generated itinerary to the user and allows customization.

[1211] Input: Optimized travel plan.

[1212] Output: The plan contents are displayed on the device. If the user edits or adjusts the plan, the edits are sent to the server.

[1213] Step 7:

[1214] The server makes reservations for accommodation, transportation, and activities all at once based on the plan approved by the user.

[1215] Input: Final approved travel plans.

[1216] Data operations: Performing hotel, transport and activity reservations and retrieving reservation confirmation information.

[1217] Output: Generate reservation confirmation information and a confirmation code and send them to the terminal.

[1218] Step 8:

[1219] The server sends all reservation confirmation information to the terminal, which allows the user to confirm and finalize the reservation details.

[1220] Input: Confirmation of reservation information.

[1221] Output: The reservation details are displayed on the device, and the user can make final confirmation and send any necessary adjustments to the server.

[1222] Step 9:

[1223] The device allows users to experience the generated travel plan in virtual reality through smart glasses.

[1224] Input: Your final confirmed travel plans.

[1225] Data processing: Rendering the itinerary in a virtual reality environment using a VR engine (e.g. Unity3D or Unreal Engine).

[1226] Output: Through smart glasses, the user visually experiences the travel plan in virtual reality.

[1227] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1228] The present invention is a system that recognizes a user's emotions and provides a travel plan based on those emotions. By combining a conventional travel planning system with an emotion engine, the system provides a more personalized experience for users. The following describes the configuration and operation of the system as a specific embodiment for implementing the present invention.

[1229] System configuration:

[1230] 1. Obtaining user input information

[1231] Users enter basic information about their trip into the device, such as destination, duration, budget, and specific interests (such as visiting museums).

[1232] The terminal acquires this information and transmits it to the server.

[1233] Example: User enters "Tokyo, 5 days, budget 100,000 yen, museum visit."

[1234] 2. Creating and updating your profile

[1235] The server retrieves the user's past travel history and preferences from a database and combines them with newly entered information to create or update a user profile.

[1236] Example: The server updates a user's profile based on the data that "the user enjoyed visiting art museums in Kyoto in the past."

[1237] 3. Acquiring Emotion Data

[1238] The device includes an emotion engine for acquiring the user's emotion data and recognizes emotions from the user's facial expressions, voice, etc.

[1239] The terminal transmits the acquired emotion data to the server.

[1240] Example: When a user reviews a plan, their facial expression and tone of voice can be used to identify emotions such as "excited" or "relaxed."

[1241] 4. Generate a travel plan

[1242] The server uses a generative AI model to create a personalized itinerary based on the latest user profile, input information, and sentiment data, including attractions, restaurants, activities, accommodations, and transportation options.

[1243] Example: The server creates a plan including tourist attractions, places to eat, and activities based on the conditions "visiting art museums in Tokyo," "budget within 100,000 yen," "5 days," and "user is excited."

[1244] 5. Obtaining real-time information

[1245] The server obtains the latest tourist information, events, restaurant reviews, and other information about the destination in real time via the Internet and reflects this information in the generated plan.

[1246] Example: The server obtains information such as "A special exhibition is being held at the Ueno Art Museum" and "A new cafe has opened in Ginza" and adds them to the plan.

[1247] 6. Optimize within your budget

[1248] The server generates an optimized travel plan within the user's budget, calculating the breakdown of expenses and adjusting the plan to stay within the budget.

[1249] Example: The server calculates the cost of accommodation, transportation, meals, museum admission fees, etc., and adjusts the total cost to stay within 100,000 yen.

[1250] 7. Providing and customizing travel plans

[1251] The terminal presents the generated travel plan to the user, allowing the user to review and customize the plan contents.

[1252] Users can review the proposed itinerary and edit or adjust it as needed.

[1253] Example: A user customizes a proposed plan by, for example, changing the lunch location on day 2 or adding a new art gallery on day 4.

[1254] 8. Bulk booking processing

[1255] The server makes all reservations for accommodation, transportation, activities, etc. based on the plan confirmed by the user.

[1256] Example: A server centralizes hotel reservations, train ticket bookings, museum ticket purchases, etc.

[1257] 9. Confirmation and final adjustments

[1258] The server sends all reservation confirmation information to the terminal.

[1259] The terminal displays the reservation details to the user and presents a confirmation screen.

[1260] The user then finalizes the reservation and makes any necessary adjustments.

[1261] Example: The terminal displays "Hotel reservation: confirmed," "Train ticket: confirmed," and "Museum ticket: confirmed," and you click "OK" in response to the confirmation message "Are you sure about this?"

[1262] In this way, the travel planning system of the present invention efficiently generates personalized travel plans that meet the user's needs, manages budgets while reflecting real-time information and emotional data, and completes reservation procedures all at once, thereby significantly reducing the user's travel planning work and providing a comfortable travel experience.

[1263] The processing flow will be explained below.

[1264] Step 1:

[1265] The user enters basic travel information (destination, duration, budget, interests) into the device, which then collects this information and sends it to the server.

[1266] Step 2:

[1267] The server receives the entered information, retrieves the user's past travel history and preferences from a database, and integrates the new information to update the user profile.

[1268] Step 3:

[1269] The device uses an emotion engine to recognize emotions from the user's facial expressions and voice, and sends the data to the server. For example, the device can recognize "excitement" or "relaxation" from the user's facial expressions while checking travel plan information.

[1270] Step 4:

[1271] The server uses a generative AI model to generate a personalized itinerary based on the latest user profile, input information, and sentiment data, including details of attractions, restaurants, activities, accommodation, and transportation.

[1272] Step 5:

[1273] The server retrieves the latest tourist information, events, restaurant reviews, and other information about the destination in real time via the Internet and reflects this information in the generated plan. Specific examples include information such as "a special exhibition being held at a certain art museum" and "a new cafe opening."

[1274] Step 6:

[1275] The server generates an optimized travel plan within the user's budget, calculating and adjusting the breakdown of each expense so that it does not exceed the budget, taking into account factors such as accommodation, transportation, meals, and museum admission fees.

[1276] Step 7:

[1277] The server sends the generated travel plan to the device, which then displays it to the user, who can review the plan and customize it to suit their preferences or preferences.

[1278] Step 8:

[1279] Once the user has completed customization and finalized the plan, the server executes the bulk booking of accommodation, transportation, activities, etc. For example, it books a hotel, arranges transportation, and purchases museum tickets.

[1280] Step 9:

[1281] The server sends all reservation confirmation information to the terminal, and the terminal displays the reservation details to the user. The user finally confirms the reservation details and makes any final adjustments as necessary. For example, a screen asking "Are you sure you want to confirm this?" is displayed, requesting approval.

[1282] In this way, the travel planning system of the present invention automatically generates a personalized and optimal travel plan while reflecting the information and emotion data entered by the user and obtaining the latest tourist information in real time.By including planning within a budget and bulk booking, it significantly reduces the burden on the user and provides a comfortable travel experience.

[1283] Example 2

[1284] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1285] Conventional travel planning systems provide travel plans based on a user's basic information and past travel history, but this alone makes it difficult to comprehensively consider user emotions, real-time information updates, budget management, etc. In addition, the process for generating individually optimized travel plans is insufficient, resulting in a lack of personalized user experience.

[1286] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for acquiring user-input information, means for creating and updating a profile based on past travel history and user preferences, means for acquiring and analyzing emotion data, means for generating an individually optimized travel plan using a generative AI model, means for acquiring the latest tourist information, events, and reviews from the Internet in real time, means for generating an optimized travel plan within an input budget, means for presenting the generated travel plan to the user and enabling customization, means for booking accommodations, transportation, and activities all at once based on the plan approved by the user, and means for allowing the user to confirm and finalize the reservation details. This allows the server to generate individually optimized travel plans that take into account the user's emotions and real-time information, enabling comprehensive budget management and bulk booking.

[1287] "Means for acquiring user-entered information" refers to a function for acquiring basic information about the trip (destination, duration, budget, interests, etc.) entered by the user from the terminal and sending it to the server.

[1288] "Means for creating and updating a profile based on past travel history and user preferences" refers to a function that retrieves a user's past travel history and preferences from a database and integrates them with newly entered information to create or update a user profile.

[1289] "Means for acquiring and analyzing emotional data" refers to a function that uses an emotion engine to recognize and analyze emotions from the user's facial expressions and voice, and sends the acquired emotional data to the server.

[1290] "Means for generating individually optimized travel plans using a generative AI model" means a function for generating optimized travel plans using a generative AI model based on a user profile, input information, and sentiment data.

[1291] "Means of obtaining the latest tourist information, events, and reviews in real time from the Internet" refers to a function that obtains the latest tourist information, events, and reviews in real time via the Internet and reflects them in travel plans.

[1292] The "means for generating an optimized travel plan within an input budget" is a function for generating an optimized travel plan within a budget set by a user and adjusting the breakdown of expenses.

[1293] "Means for presenting the generated travel plan to the user and enabling customization" refers to a function for presenting the generated travel plan to the user and allowing the user to confirm, edit, and adjust the plan.

[1294] "A means of booking accommodation, transportation, and activities all at once based on a plan approved by the user" is a function that allows users to make reservations for accommodation, transportation, activities, etc. all at once based on a travel plan approved by the user.

[1295] The "means for allowing the user to confirm and finalize the reservation details" is a function that displays all confirmed reservation information to the user, allowing the user to confirm and finalize the reservation details.

[1296] The present invention is a system that provides travel plans based on a user's basic information and emotion data. Specific embodiments for implementing the present invention will be described below, including the hardware and software used, data processing, and data calculation.

[1297] First, the user enters basic information about the trip (destination, duration, budget, interests, etc.) into the device. For example, "Tokyo, 5 days, budget 100,000 yen, visiting art museums." The device acquires this information, formats it into JSON format, and sends it to the server.

[1298] Next, the server retrieves the user's past travel history and preferences from a database (e.g., MySQL). It combines the retrieved data with the newly entered information to create or update the user profile. This is done using SQL queries to retrieve information and update the profile. For example, if there is data in the past that says, "I enjoyed visiting art museums in Kyoto," the profile can be updated based on that.

[1299] The device also runs an emotion engine (e.g., Amazon Rekognition) to acquire emotional data. The device captures the user's facial expressions and voice using a camera and microphone, and analyzes their emotions. The analysis results are sent to the server as emotional data, such as "excited" or "relaxed."

[1300] The server uses a generative AI model (e.g., GPT-4) to create a personalized, optimized itinerary based on the latest user profile, input information, and sentiment data, using prompts like the following:

[1301] Example prompt sentence:

[1302] "Generate the optimal travel plan for a 5-day trip to Tokyo's art museums, with a budget of 100,000 yen, if the user is excited."

[1303] Next, the server retrieves the latest tourist information, events, and reviews in real time from the Internet via an API (e.g., Google Places API) and incorporates this information into the travel plan. For example, it retrieves information about newly opened cafes and special exhibitions and incorporates it into the plan.

[1304] Furthermore, the server optimizes the travel plan within the user's set budget. It calculates cost elements (accommodation, transportation, meals, activities, etc.) and adjusts them so that the total cost does not exceed the budget. For example, if the budget is 100,000 yen, it will adjust accommodation and transportation costs.

[1305] The generated itinerary is presented to the user via their device. The user can review the itinerary and edit (customize) itinerary as needed. For example, they can make changes such as "changing the lunch location on the second day" or "adding a new art gallery on the fourth day."

[1306] After the travel plan is confirmed, the server makes reservations for accommodation, transportation, activities, etc. in one batch. This is done using various reservation APIs (e.g., Booking.com API, transportation reservation API). Finally, all reservation confirmation information is sent to the terminal, and the user can confirm and make final adjustments to the reservation details. The displayed reservation confirmation screen displays information such as "Hotel reservation: confirmed," "Train ticket: confirmed," and "Museum ticket: confirmed," and the user can make adjustments as necessary.

[1307] The system allows users to easily and efficiently generate personalized travel plans, ensuring an optimal travel experience that also takes into account real-time information and sentiment data.

[1308] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1309] Step 1: Obtaining User Input Information

[1310] The user enters basic information about the trip (destination, duration, budget, interests, etc.) into the device. For example, they enter information like "Tokyo, 5 days, budget 100,000 yen, visiting art museums." The device acquires this information and formats it into JSON format to send to the next process. The input information is used in the next step.

[1311] Input: Basic information about the user's trip

[1312] Output: User input information in JSON format

[1313] Step 2: Create and update your profile

[1314] The server receives the input information and retrieves the user's past travel history and preferences from a database (e.g., MySQL). For example, it retrieves information such as "I enjoyed visiting art museums in Kyoto" in the past. It then combines this data to create or update a user profile. The profile includes the newly entered information and past data.

[1315] Input: User-supplied information in JSON format, past travel history and preference data

[1316] Output: Updated user profile

[1317] Step 3: Acquire and analyze emotion data

[1318] The device uses an emotion engine (e.g., Amazon Rekognition) to capture the user's facial expressions and voice. When the user confirms a specific plan, the device analyzes their emotions through the camera and microphone. For example, it can determine if the user is smiling and expressing excitement. The acquired emotion data is sent to the server.

[1319] Input: User facial and voice data

[1320] Output: Parsed emotion data

[1321] Step 4: Generate your travel plan

[1322] The server uses a generative AI model (e.g., GPT-4) to generate an individually optimized itinerary based on the latest user profile, input information, and emotional data. The generated prompt is as follows: "Generate the optimal itinerary for visiting art museums in Tokyo, for 5 days, with a budget of 100,000 yen, if the user is excited." This results in a detailed itinerary including tourist attractions, restaurants, activities, accommodation, transportation, and more.

[1323] Input: User profile, input information, emotional data

[1324] Output: A trip plan from a generative AI model

[1325] Step 5: Get real-time information

[1326] The server uses an API (e.g., Google Places API) to obtain the latest tourist information, events, reviews, etc. of the destination in real time. For example, it obtains information about new cafe openings and special exhibitions. This information is reflected in the generated travel plan.

[1327] Input: Destination information, API query

[1328] Output: Real-time tourist information, events, and reviews

[1329] Step 6: Optimize within your budget

[1330] The server optimizes the travel plan within the user's budget by calculating accommodation, transportation, meals, and activity costs and adjusting each part of the plan based on the calculation results.

[1331] Input: Travel plan, budget information

[1332] Output: A budget-optimized itinerary

[1333] Step 7: Present and customize your itinerary

[1334] The device presents the generated itinerary to the user. The user can review the itinerary and edit (customize) it as needed. For example, the user can customize it by changing the lunch location on the second day or adding a new art gallery on the fourth day. This customization information is sent from the device to the server.

[1335] Input: Generated itinerary

[1336] Output: A travel plan customized by the user

[1337] Step 8: Bulk booking process

[1338] The server makes reservations for accommodation, transportation, activities, etc. in bulk based on the user's confirmed travel plan. For example, it makes hotel reservations, arranges train tickets, and purchases museum tickets. This process uses a booking API (e.g., Booking.com API, transportation booking API).

[1339] Input: Confirmed travel plans

[1340] Output: Confirmed reservation information

[1341] Step 9: Review and finalize

[1342] The server sends all reservation confirmation information to the terminal. The terminal displays the reservation details to the user and presents a confirmation screen. The user can review the displayed reservation details (e.g., "Hotel reservation: confirmed," "Train ticket: confirmed," "Museum ticket: confirmed") and make any necessary final adjustments.

[1343] Input: Confirmed reservation information

[1344] Output: The final reservation details confirmed and adjusted by the user

[1345] This process flow allows users to efficiently generate personalized travel plans and enjoy optimal travel plans that reflect real-time information and emotional data.

[1346] (Application example 2)

[1347] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1348] In current factory work, there is no system that can properly recognize the emotional state of workers and optimize work efficiency based on that emotional state. As a result, worker stress and a decline in motivation can have a negative impact on production efficiency. In addition, it is not possible to obtain emotional data in real time and adjust work plans based on that data. To address these issues, a system is needed that can recognize workers' emotions in real time and optimize work plans based on that data.

[1349] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1350] In this invention, the server includes means for acquiring user-input information, means for creating and updating a profile based on past history and user preferences, means for generating an individually optimized plan using a generative AI model, means for acquiring the latest information from the Internet in real time, means for generating an optimized plan within an input budget, means for presenting the generated plan to the user and enabling customization, means for reserving all necessary items in one lump sum based on the plan approved by the user, means for acquiring the user's emotions using an emotion recognition engine, means for adjusting the plan based on the user's emotion data, and means for allowing the user to confirm and finalize the reservation details. This enables appropriate work assignment and environment adjustment according to the emotional state of workers.

[1351] "User-input information" is data about a user's attributes and requests that is provided to the system.

[1352] "Past history" is a record of the activities a user has experienced to date.

[1353] "User preferences" are information that refers to personal tendencies or inclinations that a user has toward certain activities or choices.

[1354] A "profile" is a collection of data that indicates a user's characteristics, which is composed of information such as the user's past history and preferences.

[1355] A "generative AI model" is an algorithm or system that uses artificial intelligence to generate optimal results or plans based on specific input data.

[1356] "Real-time, up-to-date information" refers to the latest data based on the current situation, obtained via the Internet or other means.

[1357] A "budget-optimized plan" is a plan created to achieve the most effective results within the budget set by the user.

[1358] An "emotion recognition engine" is software and hardware that analyzes and recognizes a user's emotional state from data such as facial expressions and voice.

[1359] "Allows for customization" refers to the ability for users to freely change or adjust the plans and settings provided.

[1360] "Making a bulk reservation" refers to processing multiple reservation items at once.

[1361] "Confirm reservation details and make final adjustments" is a function that allows the user to confirm the reservation details and make final corrections or adjustments as necessary.

[1362] The present invention relates to a system that recognizes the emotional state of factory workers and optimizes work plans based on that data. Specific embodiments for carrying out the present invention are described below.

[1363] System configuration

[1364] 1. Obtaining user input information

[1365] The factory robot obtains basic information from the worker, such as shift information, responsibilities, and skill level, through the robot's input interface and sends it to the server.

[1366] 2. Creating and updating your profile

[1367] The server retrieves the worker's past work history and skill data from the database and integrates it with newly entered information to create or update the worker's profile.

[1368] 3. Acquiring Emotion Data

[1369] The factory robot uses a camera and microphone equipped with an emotion engine to capture facial expressions and voice data of workers in real time, which is then analyzed by the emotion recognition engine to determine the worker's emotional state (e.g., whether they are stressed or relaxed) and sent to a server.

[1370] 4. Generating work plans using generative AI models

[1371] The server generates a work plan using a generative AI model (such as GPT-4) based on user input information, worker profiles, and emotional data. The generative AI model used here takes into account emotional states and skill levels to optimally assign work and adjust the environment.

[1372] Example prompt sentence:

[1373] "Worker basic information: night shift, assembly line work, skill level 5. Worker emotional data: feeling stressed. Based on this, please create a plan to optimize work efficiency."

[1374] 5. Obtaining real-time information

[1375] The server obtains information about the latest work status and machine conditions within the factory in real time via the Internet and reflects this information in the generated work plan.

[1376] 6. Optimizing work efficiency

[1377] Based on the generated work plan, the server assigns appropriate work to avoid overloading workers, and adjusts according to individual situations, such as assigning less demanding work to workers who are feeling stressed.

[1378] 7. Plan presentation and customization

[1379] The factory robot presents the generated work plan to the worker, allowing the worker to freely adjust and customize it. The worker can change the plan using the interface.

[1380] 8. Bulk Schedule Processing

[1381] The server collectively schedules each task based on the plan finalized by the worker and notifies the scheduler.

[1382] 9. Confirmation and final adjustments

[1383] The server sends all schedule confirmation information to the factory robot, which then displays a confirmation screen to the worker, who then makes any final confirmations or adjustments and finalizes the schedule.

[1384] Hardware and Software Use

[1385] Hardware:

[1386] Camera and microphone with emotion engine: Captures worker emotion data.

[1387] Factory robots: Collect worker input and assist with customization.

[1388] Server: Data processing and execution of generative AI models.

[1389] software:

[1390] Emotion recognition system: Analyzes workers' facial expressions and voice data.

[1391] User profile management system: Create and update worker profiles.

[1392] Generative AI model: generating work plans.

[1393] Scheduling system: Work booking and management.

[1394] In this way, the present invention is a system that recognizes the emotional state of factory workers in real time, generates work plans based on that data, and optimizes work efficiency, thereby reducing worker stress and improving production efficiency.

[1395] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1396] Step 1:

[1397] The user enters basic information such as shift information, duties, and skill level into the terminal.

[1398] Input: Shift information (e.g., night shift), duties (e.g., assembly line work), skill level (e.g., level 5)

[1399] Output: User input information

[1400] Specific operation: The user inputs the necessary information into the input interface of the factory robot, and the robot acquires this information and sends it to the server.

[1401] Step 2:

[1402] The server retrieves the worker's past work history and skill data from the database and creates or updates a profile.

[1403] Input: User input information, past work history, skill data

[1404] Output: Updated worker profile

[1405] What it does: The server retrieves past work history and skill data from the database, integrates it with the user's new information, and updates their profile.

[1406] Step 3:

[1407] Factory robots use cameras and microphones equipped with emotion engines to capture facial expressions and voice data from workers in real time.

[1408] Input: Facial expression data and voice data of workers

[1409] Output: Emotion data

[1410] How it works: The factory robot monitors the workers while they are working, collecting data using facial camera and microphone. The emotion recognition engine analyzes the data and recognizes their emotional state.

[1411] Step 4:

[1412] The server uses a generative AI model to generate an optimal work plan based on user input information, profile data, and emotional data.

[1413] Input: User input information, profile data, emotion data

[1414] Output: Optimized work plan

[1415] How it works: The server uses this data to input prompts into a generative AI model, which then generates an optimal work plan. GPT-4 and other models are used as generative AI models.

[1416] Example prompt sentence:

[1417] "Worker basic information: night shift, assembly line work, skill level 5. Worker emotional data: feeling stressed. Based on this, please create a plan to optimize work efficiency."

[1418] Step 5:

[1419] The server obtains the latest information on work status and machine conditions within the factory in real time via the Internet and reflects this in the generated work plan.

[1420] Input: Latest work status information, machine status information

[1421] Output: Updated Work Plan

[1422] Specific operation: The server connects to the factory's systems, obtains information such as the current line operation status and machine maintenance status, and reflects this information in the optimal work plan.

[1423] Step 6:

[1424] The server presents the generated work plan to the user through the terminal, allowing the user to review and customize the plan.

[1425] Input: Generated Work Plan

[1426] Output: A work plan presented to the user

[1427] Specific operation: The terminal visualizes the work plan and displays it to the user, and provides an interface that allows the user to edit break times and work content as needed.

[1428] Step 7:

[1429] The server collectively schedules work assignments and break schedules based on the plan finalized by the user and notifies each worker.

[1430] Input: User-confirmed work plan

[1431] Output: Bulk scheduled work and notification information

[1432] Specific operation: The server sets the schedules of all workers in bulk based on the confirmed work plan and sends notifications to each worker.

[1433] Step 8:

[1434] The server transmits all confirmed schedule information to the terminal, which presents a confirmation screen to the user.

[1435] Input: Confirmed schedule information

[1436] Output: A confirmation screen presented to the user

[1437] Specific operation: The server sends schedule information to the terminal, which displays it to the user. The user then performs a final check and makes any necessary corrections.

[1438] These steps realize a system that can appropriately assign tasks and adjust the environment according to the user's emotional state.

[1439] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1440] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1441] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1442] [Fourth embodiment]

[1443] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1444] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1445] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1446] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1447] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1448] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1449] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1450] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1451] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1452] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1453] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1454] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1455] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1456] The present invention is a travel planning system for efficiently and individually optimizing a user's travel plan. The configuration and operation of the system will be described below as a specific embodiment for carrying out the present invention.

[1457] System configuration:

[1458] 1. Obtaining user input information

[1459] Users enter basic information about their trip into the device, such as destination, duration, budget, and specific interests (e.g., visiting museums).

[1460] The terminal collects the input information and transmits it to the server.

[1461] Example: User enters "Tokyo, 5 days, budget 100,000 yen, museum visit."

[1462] 2. Creating and updating your profile

[1463] The server retrieves the user's past travel history and preferences from a database and combines them with newly entered information to create or update a user profile.

[1464] Example: The server updates a user's profile based on the data that "the user enjoyed visiting art museums in Kyoto in the past."

[1465] 3. Generate a travel plan

[1466] The server uses a generative AI model to automatically generate a travel plan based on the user's current profile and input information, including attractions, restaurants, activities, accommodations, and transportation options.

[1467] Example: The server creates a plan including tourist attractions, places to eat, and activities based on the conditions "visiting art museums in Tokyo," "budget within 100,000 yen," and "5 days."

[1468] 4. Obtaining real-time information

[1469] The server obtains the latest tourist information, events, restaurant reviews, and other information about the destination in real time via the Internet and reflects this information in the generated plan.

[1470] Example: The server obtains information such as "A special exhibition is being held at the Ueno Art Museum" and "A new cafe has opened in Ginza" and adds them to the plan.

[1471] 5. Optimizing within your budget

[1472] The server generates an optimized travel plan within the user's budget, calculating the breakdown of costs and adjusting them so that the plan does not exceed the user's budget.

[1473] Example: The server calculates the cost of accommodation, transportation, meals, museum admission fees, etc., and adjusts the total cost to stay within 100,000 yen.

[1474] 6. Providing and customizing travel plans

[1475] The terminal presents the generated travel plan to the user, allowing the user to review and customize the plan contents.

[1476] Users can review the proposed itinerary and edit or adjust it as needed.

[1477] Example: A user customizes a proposed plan by, for example, changing the lunch location on day 2 or adding a new art gallery on day 4.

[1478] 7. Bulk booking processing

[1479] The server makes all reservations for accommodation, transportation, activities, etc. based on the plan confirmed by the user.

[1480] Example: A server centralizes hotel reservations, train ticket bookings, museum ticket purchases, etc.

[1481] 8. Confirmation and final adjustments

[1482] The server sends all reservation confirmation information to the terminal.

[1483] The terminal displays the reservation details to the user and presents a confirmation screen.

[1484] The user then finalizes the reservation and makes any necessary adjustments.

[1485] Example: The terminal displays "Hotel reservation: confirmed," "Train ticket: confirmed," and "Museum ticket: confirmed," and you click "OK" in response to the confirmation message "Are you sure about this?"

[1486] In this way, the travel planning system of the present invention efficiently generates personalized travel plans that meet the user's needs, manages budgets while reflecting real-time information, and performs all reservation procedures in one go, thereby significantly reducing the user's travel planning workload and providing a comfortable travel experience.

[1487] The processing flow will be explained below.

[1488] Step 1:

[1489] The user inputs the travel destination, duration, budget, and interests (e.g., visiting museums) into the device. The device acquires this information and sends it to the server.

[1490] Step 2:

[1491] The server receives the entered information, retrieves the user's past travel history and preferences from a database, and combines the newly entered information with the previous data to create or update the user profile.

[1492] Step 3:

[1493] The server uses a generative AI model to generate a personalized itinerary based on the updated user profile and input, which includes details on attractions, restaurants, activities, accommodation, transportation, and more.

[1494] Step 4:

[1495] The server obtains the latest tourist information, events, restaurant reviews, and other information about the destination in real time via the Internet and reflects this information in the generated plan.

[1496] Step 5:

[1497] The server generates an optimized travel plan within the user's budget, calculating the breakdown of expenses and adjusting the plan to stay within the budget.

[1498] Step 6:

[1499] The server sends the generated travel plan to the terminal, which provides the user with an interface to display and customize the plan.

[1500] Step 7:

[1501] The user checks the presented travel plan and customizes it as necessary. The device saves the user's editing operations and sends the data to the server.

[1502] Step 8:

[1503] Once the user finalizes their travel plans, the server makes all reservations for accommodation, transportation, activities, etc. in one go.

[1504] Step 9:

[1505] The server sends all reservation confirmation information to the terminal, which displays the reservation details to the user and presents a confirmation screen, where the user can finally review the reservation details and make any final adjustments if necessary.

[1506] Example 1

[1507] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1508] Current travel planning systems struggle to efficiently and individually optimize users' travel plans. They also lack the ability to reflect real-time information, manage budgets, and process reservations in bulk. Furthermore, they lack the ability to validate user input and integrate it with past travel history, resulting in travel plans that cannot fully meet users' needs.

[1509] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1510] In this invention, the server includes means for acquiring user-input information, means for creating and updating a profile based on past travel history and user preferences, means for generating an individually optimized travel plan using a generative AI model, means for acquiring the latest tourist information, events, and reviews from the Internet in real time, means for generating an optimized travel plan within an input budget, means for presenting the generated travel plan to the user and enabling customization, means for booking accommodations, transportation, and activities all at once based on the plan approved by the user, means for allowing the user to confirm and finalize the reservation details, means for verifying user information and sending it to the server in a correct format, means for acquiring past travel history and user preferences from a database, and means for inputting prompt statements to the generative AI model. This enables efficient generation of personalized travel plans tailored to user needs, reflecting real-time information, budget management, and batch booking processing.

[1511] "User-entered information" refers to data that a user enters into a terminal, including basic information about the trip (destination, duration, budget, interests, etc.).

[1512] "Profile" refers to a user's individual information that is generated and updated by integrating the user's past travel history and preferences with current input information.

[1513] A "generative AI model" is an artificial intelligence model that automatically generates optimal travel plans based on input prompts.

[1514] "Real-time information" refers to the latest tourist information, events, reviews, etc. obtained via the Internet.

[1515] A "budget-optimized travel plan" is a travel plan generated by adjusting various expenses within the budget set by the user.

[1516] "Customization" means the act of a user editing or adjusting the content of a presented travel plan.

[1517] "Bulk booking" refers to the process of booking accommodation, transportation, activities, etc. all at once based on a user's confirmed travel plans.

[1518] "Final adjustment" refers to the act of the user finally checking the reservation details and making any necessary changes.

[1519] "User information validation" refers to the process of ensuring that the information entered by the user is in the correct format.

[1520] "Database" refers to a system for managing and storing information such as a user's past travel history and preferences.

[1521] A "prompt sentence" is a specific instruction sentence that is input into a generative AI model.

[1522] The present invention is a travel planning system for efficiently and individually optimizing a user's travel plans. The system allows the user to input basic travel information, and automatically generates a travel plan tailored to individual needs based on that information. The following describes the configuration and operation of the system as a specific embodiment of the present invention.

[1523] System configuration:

[1524] 1. Obtaining user input information

[1525] Users enter basic information about their trip (destination, duration, budget, interests) into an input form on their device.

[1526] The terminal validates the entered information to ensure it is in the correct format, then transmits it to the server.

[1527] Hardware and software used:

[1528] Hardware: Personal computers, smartphones, servers

[1529] Software: web browsers, database management systems (e.g., MySQL), generative AI models (e.g., OpenAI GPT-4)

[1530] Specific working example:

[1531] 1. Obtaining user input information

[1532] When a user enters "Tokyo, 5 days, budget 100,000 yen, museum visit" into the form on their device and clicks the "Submit" button, the device sends this information to the server.

[1533] 2. Creating and updating your profile

[1534] The server accesses the database with the received user information to retrieve the user's past travel history and preferences, and combines the newly entered information with existing data to create or update an updated user profile.

[1535] Example: The server retrieves data from the travel history table, such as "I enjoyed visiting museums in Kyoto in the past," and adds new information, such as "Tokyo, 5 days, visiting museums."

[1536] 3. Generate a travel plan

[1537] The server uses a generative AI model (e.g., GPT-4) and inputs the user's latest profile and input information as prompts into the AI ​​model.

[1538] Examples of prompts:

[1539] I'd like to create a travel plan. Please suggest a plan for a trip to Tokyo based on the following criteria:

[1540] Destination: Tokyo

[1541] Trip duration: 5 days

[1542] Budget: 100,000 yen

[1543] Interests: Visiting art museums, stylish cafes

[1544] thank you.

[1545] The generative AI model generates an optimal travel plan based on these prompts and returns it to the server.

[1546] 4. Obtaining real-time information

[1547] The server retrieves the latest tourist information, event information, and restaurant reviews about the destination via the Internet using an API (e.g., Google Places API).

[1548] Example: The server uses the Google Places API to retrieve information about "art museums in Tokyo" and adds new special exhibition information and newly opened cafes to the plan.

[1549] 5. Optimizing within your budget

[1550] The server calculates the total cost of each element (accommodation, transportation, meals, etc.) to generate an optimized travel plan within the user's set budget.

[1551] Example: The server will show the breakdown of expenses calculated (e.g., accommodation 50,000 yen, transportation 20,000 yen, meals 15,000 yen, museum admission 15,000 yen) and adjust the amount to fit within a budget of 100,000 yen.

[1552] 6. Providing and customizing travel plans

[1553] The terminal presents the generated travel plan to the user, allowing the user to review and customize the plan contents.

[1554] Example: The device screen displays "Day 2: Museum of Art in Ueno" and "Lunch: Cafe in Ginza," and the user adjusts the location of lunch on day 2 to the new cafe.

[1555] 7. Bulk booking processing

[1556] The server executes various reservations in bulk based on the plan confirmed by the user, and connects with each reservation system using an API.

[1557] Example: The server executes "Hotel reservation," "Train ticket arrangement," and "Museum ticket purchase" and obtains the reservation ID for each.

[1558] 8. Confirmation and final adjustments

[1559] The server sends all reservation confirmation information to the terminal.

[1560] The device will then present the user with a final confirmation screen, allowing them to review the reservation and make any final adjustments if necessary.

[1561] Example: A list such as "Hotel reservation: confirmed" or "Museum tickets: confirmed" will be displayed on the terminal, and the user will click the "Accept" button along with the message "Are you sure about this?"

[1562] In this way, the travel planning system of the present invention efficiently generates personalized travel plans tailored to the user's needs, manages budgets while reflecting real-time information, and handles all booking procedures in one place, thereby significantly reducing the user's travel planning workload and providing a comfortable travel experience.

[1563] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1564] Step 1: Obtaining User Input Information

[1565] The user enters basic travel information (destination, duration, budget, interests) into the input form on the device.

[1566] Input: User enters "Tokyo, 5 days, budget ¥100,000, museum visit."

[1567] The terminal validates the information entered to ensure it is in the correct format.

[1568] After confirmation, the terminal transmits the input information to the server.

[1569] Output: The user's trip information is sent to the server.

[1570] Specific behavior: The user enters travel information into a form on the device and clicks the "Submit" button.

[1571] Step 2: Create and update your profile

[1572] The server accesses a database based on the received user information to obtain the user's past travel history and preferences.

[1573] Input: User's travel information sent to the server.

[1574] The server merges the newly entered information with existing data to create or update an updated user profile.

[1575] Output: A new user profile is created and updated.

[1576] Specific operation: The server retrieves data from the travel history table, such as "I enjoyed visiting art museums in Kyoto in the past," and adds new information, such as "Tokyo, 5 days, visiting art museums."

[1577] Step 3: Generate a travel plan

[1578] The server uses the generative AI model and inputs the user's latest profile and input information as prompts into the AI ​​model.

[1579] Input: A prompt containing your latest user profile and travel information.

[1580] The generative AI model generates an optimal travel plan based on the prompts and returns it to the server.

[1581] Output: Optimized trip plan.

[1582] Specific operation: The server prompts the generated AI model with the input information "visiting art museums in Tokyo," "five days," and "budget of 100,000 yen," and queries the AI.

[1583] Step 4: Get real-time information

[1584] The server uses an API to obtain the latest tourist information, event information, and restaurant reviews about the destination via the Internet.

[1585] Input: A request from the server to retrieve information about "Tokyo museums" and "events" from the API.

[1586] The server integrates and reflects the acquired real-time information into the travel plan.

[1587] Output: A trip plan reflecting real-time information.

[1588] Specific operation: The server uses the Google Places API to get the latest tourist spot information and add it to the plan.

[1589] Step 5: Optimize within your budget

[1590] The server calculates the total cost of each element (accommodation, transportation, meals, etc.) to generate an optimized travel plan within the user's set budget.

[1591] Input: The cost of each element of your travel plan.

[1592] The server adjusts each element to keep costs within budget.

[1593] Output: An adjusted budgeted travel plan.

[1594] Specific operation: The server displays the calculated breakdown of expenses (e.g., accommodation 50,000 yen, transportation 20,000 yen, meals 15,000 yen, museum admission 15,000 yen), and adjusts the budget to stay within 100,000 yen.

[1595] Step 6: Present and customize your itinerary

[1596] The terminal presents the generated itinerary to the user.

[1597] Input: Adjusted travel plans.

[1598] The user can review the displayed plan and use the editor to edit and adjust the content as needed.

[1599] Output: A travel plan customized by the user.

[1600] Specific operation: The device screen displays "Day 2: Ueno Art Museum" and "Lunch: Ginza Cafe," and the user customizes the location, such as "changing the lunch location for day 2 to a new cafe."

[1601] Step 7: Bulk booking process

[1602] The server executes various reservations in bulk based on the plan confirmed by the user, and connects with each reservation system using an API.

[1603] Input: Finalized plan information.

[1604] The server receives confirmation from each reservation system and compiles the confirmed reservations.

[1605] Output: Reservation IDs for various services booked together.

[1606] Specific operation: The server executes "hotel reservation," "train ticket arrangement," and "museum ticket purchase" and obtains the reservation ID for each.

[1607] Step 8: Review and finalize

[1608] The server sends all reservation confirmation information to the terminal.

[1609] Input: Reservation ID information for various services.

[1610] The terminal displays a final confirmation screen to the user.

[1611] The user reviews the reservation, makes any final adjustments if necessary, and then clicks final approval.

[1612] Output: Final confirmed and adjusted itinerary.

[1613] Specific operation: A list such as "Hotel reservation: confirmed" or "Museum tickets: confirmed" will be displayed on the terminal, and the user will click the "Accept" button along with the message "Are you sure about this?"

[1614] (Application example 1)

[1615] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1616] Traditional travel planning systems offer a limited user experience. While they can update information in real time and optimize within budget, they lack a way for users to visually confirm their plans. Furthermore, they cannot experience the generated plans in virtual reality, limiting user options.

[1617] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1618] In this invention, the server includes: means for acquiring user-input information; means for creating and updating a profile based on past travel history and user preferences; means for generating an individually optimized travel plan using a generative AI model; means for acquiring the latest tourist information, events, and reviews from the Internet in real time; means for generating an optimized travel plan within an input budget; means for presenting the generated travel plan to the user and enabling customization; means for booking accommodations, transportation, and activities all at once based on the plan approved by the user; means for allowing the user to confirm and finalize the reservation details; and means for experiencing the generated travel plan in virtual reality through smart glasses. This allows users to visually check their travel plan and combine it with real-time information to create a more accurate plan. Furthermore, using smart glasses to experience the travel plan in virtual reality allows users to visualize the plan, expanding their options and realizing more satisfying travel plans.

[1619] "User-Entered Information" means information about destination, duration, budget, and particular interests provided by a User for travel planning purposes.

[1620] "Past travel history" refers to data about a user's previous trips, including records of places visited, dates, and activities experienced.

[1621] "User preferences" refers to information that reflects the places, activities, and preferences that a user is particularly interested in when traveling.

[1622] A "profile" is data that indicates a user's travel tendencies and characteristics, based on the user's past travel history and preferences.

[1623] A "generative AI model" is an artificial intelligence model that automatically generates optimized travel plans based on input data.

[1624] "Real-time tourist information, events, and reviews obtained from the Internet" refers to data that collects the latest information about a destination online in real time.

[1625] A "budget-optimized travel plan" is a travel plan that is tailored to meet the user's preferences and requests to the greatest extent possible within the budget set by the user.

[1626] "Presenting and customizing generated travel plans" refers to the function that displays the travel plan created by the generative AI model to the user and allows the user to change or modify its contents.

[1627] "Comprehensive accommodation, transport and activity booking" is the process of booking accommodation, transport and destination activities in one go based on a confirmed travel plan.

[1628] "Confirm and finalize reservation details" is the process by which a user confirms their final travel plans and makes any final changes or adjustments, if necessary.

[1629] "Experiencing the generated travel plan in virtual reality through smart glasses" means visually experiencing the travel plan in a virtual reality environment using smart glasses.

[1630] The present invention provides a travel planning system for enabling users to efficiently and individually optimize their travel plans, and in particular, allows users to experience their travel plans in virtual reality using smart glasses. Detailed embodiments of the system are described below.

[1631] System configuration

[1632] 1. Obtaining user input information

[1633] The device provides an interface for users to enter basic information about their trip (destination, duration, budget, specific interests), which is then sent to the server.

[1634] 2. Creating and updating your profile

[1635] The server retrieves the user's past travel history and preferences from the database and combines them with the latest input information to create and update a user profile, generating data that reflects the user's tastes and travel habits.

[1636] 3. Generate a travel plan

[1637] The server uses a generative AI model (e.g., GPT-4 or BERT) to automatically generate a travel plan based on the latest user profile and input information, including attractions, restaurants, activities, accommodations, and transportation.

[1638] 4. Obtaining real-time information

[1639] The server retrieves the latest tourist information, events, and reviews about the destination in real time via the Internet and reflects them in the generated plan, allowing users to use plans based on the most up-to-date information.

[1640] 5. Optimizing within your budget

[1641] The server generates an optimized travel plan within the user's budget, calculating the breakdown of expenses and adjusting the plan to stay within the budget.

[1642] 6. Providing and customizing travel plans

[1643] The device presents the generated travel plan to the user, allowing the user to review and customize the plan's contents. The user can also edit and adjust the presented plan.

[1644] 7. Bulk booking processing

[1645] The server makes all reservations for accommodation, transportation, activities, etc. based on the plan confirmed by the user.

[1646] 8. Confirmation and final adjustments

[1647] The server sends all reservation confirmation information to the terminal, which displays the reservation details to the user and provides a confirmation screen for the user to review and adjust.

[1648] 9. Virtual Reality Experiences

[1649] The device allows users to experience the generated travel plan in virtual reality through smart glasses, allowing them to visually check the plan and experience the atmosphere of the destination in advance.

[1650] Hardware and software used

[1651] VR Engine: Use Unity3D or Unreal Engine to render virtual reality.

[1652] AI models: GPT-4 (OpenAI) and BERT (Google) are used to generate itineraries.

[1653] Network API: Use the Google Places API and Yelp API to get the latest tourist information, events, and reviews.

[1654] Specific examples

[1655] Consider a case where a user wears smart glasses and generates a travel plan for "Tokyo, 5 days, budget of 100,000 yen, visiting art museums." The user can view the generated plan in virtual reality through the smart glasses, visually experiencing a special exhibition at an art museum in Ueno or a new cafe in Ginza.

[1656] Example prompt sentence:

[1657] Generate a personalized itinerary based on "Tokyo, 5 days, budget of ¥100,000, museums," including attractions, restaurants, activities, accommodations, and transportation.

[1658] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1659] Step 1:

[1660] The device obtains basic travel information from the user (destination, duration, budget, interests, etc.).

[1661] Input: The user enters information such as "Tokyo, 5 days, budget 100,000 yen, museum visit" into the device interface.

[1662] Output: The device sends the acquired information to the server.

[1663] Step 2:

[1664] The server creates and updates a profile based on the user's past travel history and preferences.

[1665] Input: The server retrieves the user's past travel history and preferences from a database and receives newly entered information.

[1666] Data processing: Combine your past travel history with the information you provide to create and update a new user profile.

[1667] Output: Generate an updated profile, ready to be passed to the AI ​​model.

[1668] Step 3:

[1669] The server uses a generative AI model to generate an individually optimized itinerary.

[1670] Input: Your most recent user profile and input information.

[1671] Data computation: Generative AI models (e.g., GPT-4 and BERT) are used to generate an optimal itinerary based on a user profile and input information. The prompt is "Generate a personalized itinerary based on Tokyo, 5 days, budget of 100,000 yen, and museum visits."

[1672] Output: The plan includes attractions, restaurants, activities, accommodations, and transportation. Store the generated travel plan and send it to the next step.

[1673] Step 4:

[1674] The server retrieves the latest tourist information, events and reviews in real time from the Internet.

[1675] Input: Generated itinerary and up-to-date information from the internet.

[1676] Data processing: Use network APIs (e.g., Google Places API or Yelp API) to obtain real-time tourist information, events, and reviews for the destinations listed in the plan.

[1677] Output: An updated itinerary with the latest information merged.

[1678] Step 5:

[1679] The server generates an optimized travel plan within the budget set by the user.

[1680] Input: Updated travel plans and user-set budget.

[1681] Data calculation: Calculate the cost of each tourist attraction, restaurant, accommodation, and transportation, and optimize it within your budget.

[1682] Output: A final itinerary adjusted to fit within your budget.

[1683] Step 6:

[1684] The terminal presents the generated itinerary to the user and allows customization.

[1685] Input: Optimized travel plan.

[1686] Output: The plan contents are displayed on the device. If the user edits or adjusts the plan, the edits are sent to the server.

[1687] Step 7:

[1688] The server makes reservations for accommodation, transportation, and activities all at once based on the plan approved by the user.

[1689] Input: Final approved travel plans.

[1690] Data operations: Performing hotel, transport and activity reservations and retrieving reservation confirmation information.

[1691] Output: Generate reservation confirmation information and a confirmation code and send them to the terminal.

[1692] Step 8:

[1693] The server sends all reservation confirmation information to the terminal, which allows the user to confirm and finalize the reservation details.

[1694] Input: Confirmation of reservation information.

[1695] Output: The reservation details are displayed on the device, and the user can make final confirmation and send any necessary adjustments to the server.

[1696] Step 9:

[1697] The device allows users to experience the generated travel plan in virtual reality through smart glasses.

[1698] Input: Your final confirmed travel plans.

[1699] Data processing: Rendering the itinerary in a virtual reality environment using a VR engine (e.g. Unity3D or Unreal Engine).

[1700] Output: Through smart glasses, the user visually experiences the travel plan in virtual reality.

[1701] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1702] The present invention is a system that recognizes a user's emotions and provides a travel plan based on those emotions. By combining a conventional travel planning system with an emotion engine, the system provides a more personalized experience for users. The following describes the configuration and operation of the system as a specific embodiment for implementing the present invention.

[1703] System configuration:

[1704] 1. Obtaining user input information

[1705] Users enter basic information about their trip into the device, such as destination, duration, budget, and specific interests (such as visiting museums).

[1706] The terminal acquires this information and transmits it to the server.

[1707] Example: User enters "Tokyo, 5 days, budget 100,000 yen, museum visit."

[1708] 2. Creating and updating your profile

[1709] The server retrieves the user's past travel history and preferences from a database and combines them with newly entered information to create or update a user profile.

[1710] Example: The server updates a user's profile based on the data that "the user enjoyed visiting art museums in Kyoto in the past."

[1711] 3. Acquiring Emotion Data

[1712] The device includes an emotion engine for acquiring the user's emotion data and recognizes emotions from the user's facial expressions, voice, etc.

[1713] The terminal transmits the acquired emotion data to the server.

[1714] Example: When a user reviews a plan, their facial expression and tone of voice can be used to identify emotions such as "excited" or "relaxed."

[1715] 4. Generate a travel plan

[1716] The server uses a generative AI model to create a personalized itinerary based on the latest user profile, input information, and sentiment data, including attractions, restaurants, activities, accommodations, and transportation options.

[1717] Example: The server creates a plan including tourist attractions, places to eat, and activities based on the conditions "visiting art museums in Tokyo," "budget within 100,000 yen," "5 days," and "user is excited."

[1718] 5. Obtaining real-time information

[1719] The server obtains the latest tourist information, events, restaurant reviews, and other information about the destination in real time via the Internet and reflects this information in the generated plan.

[1720] Example: The server obtains information such as "A special exhibition is being held at the Ueno Art Museum" and "A new cafe has opened in Ginza" and adds them to the plan.

[1721] 6. Optimize within your budget

[1722] The server generates an optimized travel plan within the user's budget, calculating the breakdown of expenses and adjusting the plan to stay within the budget.

[1723] Example: The server calculates the cost of accommodation, transportation, meals, museum admission fees, etc., and adjusts the total cost to stay within 100,000 yen.

[1724] 7. Providing and customizing travel plans

[1725] The terminal presents the generated travel plan to the user, allowing the user to review and customize the plan contents.

[1726] Users can review the proposed itinerary and edit or adjust it as needed.

[1727] Example: A user customizes a proposed plan by, for example, changing the lunch location on day 2 or adding a new art gallery on day 4.

[1728] 8. Bulk booking processing

[1729] The server makes all reservations for accommodation, transportation, activities, etc. based on the plan confirmed by the user.

[1730] Example: A server centralizes hotel reservations, train ticket bookings, museum ticket purchases, etc.

[1731] 9. Confirmation and final adjustments

[1732] The server sends all reservation confirmation information to the terminal.

[1733] The terminal displays the reservation details to the user and presents a confirmation screen.

[1734] The user then finalizes the reservation and makes any necessary adjustments.

[1735] Example: The terminal displays "Hotel reservation: confirmed," "Train ticket: confirmed," and "Museum ticket: confirmed," and you click "OK" in response to the confirmation message "Are you sure about this?"

[1736] In this way, the travel planning system of the present invention efficiently generates personalized travel plans that meet the user's needs, manages budgets while reflecting real-time information and emotional data, and completes reservation procedures all at once, thereby significantly reducing the user's travel planning work and providing a comfortable travel experience.

[1737] The processing flow will be explained below.

[1738] Step 1:

[1739] The user enters basic travel information (destination, duration, budget, interests) into the device, which then collects this information and sends it to the server.

[1740] Step 2:

[1741] The server receives the entered information, retrieves the user's past travel history and preferences from a database, and integrates the new information to update the user profile.

[1742] Step 3:

[1743] The device uses an emotion engine to recognize emotions from the user's facial expressions and voice, and sends the data to the server. For example, the device can recognize "excitement" or "relaxation" from the user's facial expressions while checking travel plan information.

[1744] Step 4:

[1745] The server uses a generative AI model to generate a personalized itinerary based on the latest user profile, input information, and sentiment data, including details of attractions, restaurants, activities, accommodation, and transportation.

[1746] Step 5:

[1747] The server retrieves the latest tourist information, events, restaurant reviews, and other information about the destination in real time via the Internet and reflects this information in the generated plan. Specific examples include information such as "a special exhibition being held at a certain art museum" and "a new cafe opening."

[1748] Step 6:

[1749] The server generates an optimized travel plan within the user's budget, calculating and adjusting the breakdown of each expense so that it does not exceed the budget, taking into account factors such as accommodation, transportation, meals, and museum admission fees.

[1750] Step 7:

[1751] The server sends the generated travel plan to the device, which then displays it to the user, who can review the plan and customize it to suit their preferences or preferences.

[1752] Step 8:

[1753] Once the user has completed customization and finalized the plan, the server executes the bulk booking of accommodation, transportation, activities, etc. For example, it books a hotel, arranges transportation, and purchases museum tickets.

[1754] Step 9:

[1755] The server sends all reservation confirmation information to the terminal, and the terminal displays the reservation details to the user. The user finally confirms the reservation details and makes any final adjustments as necessary. For example, a screen asking "Are you sure you want to confirm this?" is displayed, requesting approval.

[1756] In this way, the travel planning system of the present invention automatically generates a personalized and optimal travel plan while reflecting the information and emotion data entered by the user and obtaining the latest tourist information in real time.By including planning within a budget and bulk booking, it significantly reduces the burden on the user and provides a comfortable travel experience.

[1757] Example 2

[1758] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1759] Conventional travel planning systems provide travel plans based on a user's basic information and past travel history, but this alone makes it difficult to comprehensively consider user emotions, real-time information updates, budget management, etc. In addition, the process for generating individually optimized travel plans is insufficient, resulting in a lack of personalized user experience.

[1760] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for acquiring user-input information, means for creating and updating a profile based on past travel history and user preferences, means for acquiring and analyzing emotion data, means for generating an individually optimized travel plan using a generative AI model, means for acquiring the latest tourist information, events, and reviews from the Internet in real time, means for generating an optimized travel plan within an input budget, means for presenting the generated travel plan to the user and enabling customization, means for booking accommodations, transportation, and activities all at once based on the plan approved by the user, and means for allowing the user to confirm and finalize the reservation details. This allows the server to generate individually optimized travel plans that take into account the user's emotions and real-time information, enabling comprehensive budget management and bulk booking.

[1761] "Means for acquiring user-entered information" refers to a function for acquiring basic information about the trip (destination, duration, budget, interests, etc.) entered by the user from the terminal and sending it to the server.

[1762] "Means for creating and updating a profile based on past travel history and user preferences" refers to a function that retrieves a user's past travel history and preferences from a database and integrates them with newly entered information to create or update a user profile.

[1763] "Means for acquiring and analyzing emotional data" refers to a function that uses an emotion engine to recognize and analyze emotions from the user's facial expressions and voice, and sends the acquired emotional data to the server.

[1764] "Means for generating individually optimized travel plans using a generative AI model" means a function for generating optimized travel plans using a generative AI model based on a user profile, input information, and sentiment data.

[1765] "Means of obtaining the latest tourist information, events, and reviews in real time from the Internet" refers to a function that obtains the latest tourist information, events, and reviews in real time via the Internet and reflects them in travel plans.

[1766] The "means for generating an optimized travel plan within an input budget" is a function for generating an optimized travel plan within a budget set by a user and adjusting the breakdown of expenses.

[1767] "Means for presenting the generated travel plan to the user and enabling customization" refers to a function for presenting the generated travel plan to the user and allowing the user to confirm, edit, and adjust the plan.

[1768] "A means of booking accommodation, transportation, and activities all at once based on a plan approved by the user" is a function that allows users to make reservations for accommodation, transportation, activities, etc. all at once based on a travel plan approved by the user.

[1769] The "means for allowing the user to confirm and finalize the reservation details" is a function that displays all confirmed reservation information to the user, allowing the user to confirm and finalize the reservation details.

[1770] The present invention is a system that provides travel plans based on a user's basic information and emotion data. Specific embodiments for implementing the present invention will be described below, including the hardware and software used, data processing, and data calculation.

[1771] First, the user enters basic information about the trip (destination, duration, budget, interests, etc.) into the device. For example, "Tokyo, 5 days, budget 100,000 yen, visiting art museums." The device acquires this information, formats it into JSON format, and sends it to the server.

[1772] Next, the server retrieves the user's past travel history and preferences from a database (e.g., MySQL). It combines the retrieved data with the newly entered information to create or update the user profile. This is done using SQL queries to retrieve information and update the profile. For example, if there is data in the past that says, "I enjoyed visiting art museums in Kyoto," the profile can be updated based on that.

[1773] The device also runs an emotion engine (e.g., Amazon Rekognition) to acquire emotional data. The device captures the user's facial expressions and voice using a camera and microphone, and analyzes their emotions. The analysis results are sent to the server as emotional data, such as "excited" or "relaxed."

[1774] The server uses a generative AI model (e.g., GPT-4) to create a personalized, optimized itinerary based on the latest user profile, input information, and sentiment data, using prompts like the following:

[1775] Example prompt sentence:

[1776] "Generate the optimal travel plan for a 5-day trip to Tokyo's art museums, with a budget of 100,000 yen, if the user is excited."

[1777] Next, the server retrieves the latest tourist information, events, and reviews in real time from the Internet via an API (e.g., Google Places API) and incorporates this information into the travel plan. For example, it retrieves information about newly opened cafes and special exhibitions and incorporates it into the plan.

[1778] Furthermore, the server optimizes the travel plan within the user's set budget. It calculates cost elements (accommodation, transportation, meals, activities, etc.) and adjusts them so that the total cost does not exceed the budget. For example, if the budget is 100,000 yen, it will adjust accommodation and transportation costs.

[1779] The generated itinerary is presented to the user via their device. The user can review the itinerary and edit (customize) itinerary as needed. For example, they can make changes such as "changing the lunch location on the second day" or "adding a new art gallery on the fourth day."

[1780] After the travel plan is confirmed, the server makes reservations for accommodation, transportation, activities, etc. in one batch. This is done using various reservation APIs (e.g., Booking.com API, transportation reservation API). Finally, all reservation confirmation information is sent to the terminal, and the user can confirm and make final adjustments to the reservation details. The displayed reservation confirmation screen displays information such as "Hotel reservation: confirmed," "Train ticket: confirmed," and "Museum ticket: confirmed," and the user can make adjustments as necessary.

[1781] The system allows users to easily and efficiently generate personalized travel plans, ensuring an optimal travel experience that also takes into account real-time information and sentiment data.

[1782] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1783] Step 1: Obtaining User Input Information

[1784] The user enters basic information about the trip (destination, duration, budget, interests, etc.) into the device. For example, they enter information like "Tokyo, 5 days, budget 100,000 yen, visiting art museums." The device acquires this information and formats it into JSON format to send to the next process. The input information is used in the next step.

[1785] Input: Basic information about the user's trip

[1786] Output: User input information in JSON format

[1787] Step 2: Create and update your profile

[1788] The server receives the input information and retrieves the user's past travel history and preferences from a database (e.g., MySQL). For example, it retrieves information such as "I enjoyed visiting art museums in Kyoto" in the past. It then combines this data to create or update a user profile. The profile includes the newly entered information and past data.

[1789] Input: User-supplied information in JSON format, past travel history and preference data

[1790] Output: Updated user profile

[1791] Step 3: Acquire and analyze emotion data

[1792] The device uses an emotion engine (e.g., Amazon Rekognition) to capture the user's facial expressions and voice. When the user confirms a specific plan, the device analyzes their emotions through the camera and microphone. For example, it can determine if the user is smiling and expressing excitement. The acquired emotion data is sent to the server.

[1793] Input: User facial and voice data

[1794] Output: Parsed emotion data

[1795] Step 4: Generate your travel plan

[1796] The server uses a generative AI model (e.g., GPT-4) to generate an individually optimized itinerary based on the latest user profile, input information, and emotional data. The generated prompt is as follows: "Generate the optimal itinerary for visiting art museums in Tokyo, for 5 days, with a budget of 100,000 yen, if the user is excited." This results in a detailed itinerary including tourist attractions, restaurants, activities, accommodation, transportation, and more.

[1797] Input: User profile, input information, emotional data

[1798] Output: A trip plan from a generative AI model

[1799] Step 5: Get real-time information

[1800] The server uses an API (e.g., Google Places API) to obtain the latest tourist information, events, reviews, etc. of the destination in real time. For example, it obtains information about new cafe openings and special exhibitions. This information is reflected in the generated travel plan.

[1801] Input: Destination information, API query

[1802] Output: Real-time tourist information, events, and reviews

[1803] Step 6: Optimize within your budget

[1804] The server optimizes the travel plan within the user's budget by calculating accommodation, transportation, meals, and activity costs and adjusting each part of the plan based on the calculation results.

[1805] Input: Travel plan, budget information

[1806] Output: A budget-optimized itinerary

[1807] Step 7: Present and customize your itinerary

[1808] The device presents the generated itinerary to the user. The user can review the itinerary and edit (customize) it as needed. For example, the user can customize it by changing the lunch location on the second day or adding a new art gallery on the fourth day. This customization information is sent from the device to the server.

[1809] Input: Generated itinerary

[1810] Output: A travel plan customized by the user

[1811] Step 8: Bulk booking process

[1812] The server makes reservations for accommodation, transportation, activities, etc. in bulk based on the user's confirmed travel plan. For example, it makes hotel reservations, arranges train tickets, and purchases museum tickets. This process uses a booking API (e.g., Booking.com API, transportation booking API).

[1813] Input: Confirmed travel plans

[1814] Output: Confirmed reservation information

[1815] Step 9: Review and finalize

[1816] The server sends all reservation confirmation information to the terminal. The terminal displays the reservation details to the user and presents a confirmation screen. The user can review the displayed reservation details (e.g., "Hotel reservation: confirmed," "Train ticket: confirmed," "Museum ticket: confirmed") and make any necessary final adjustments.

[1817] Input: Confirmed reservation information

[1818] Output: The final reservation details confirmed and adjusted by the user

[1819] This process flow allows users to efficiently generate personalized travel plans and enjoy optimal travel plans that reflect real-time information and emotional data.

[1820] (Application example 2)

[1821] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1822] In current factory work, there is no system that can properly recognize the emotional state of workers and optimize work efficiency based on that emotional state. As a result, worker stress and a decline in motivation can have a negative impact on production efficiency. In addition, it is not possible to obtain emotional data in real time and adjust work plans based on that data. To address these issues, a system is needed that can recognize workers' emotions in real time and optimize work plans based on that data.

[1823] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1824] In this invention, the server includes means for acquiring user-input information, means for creating and updating a profile based on past history and user preferences, means for generating an individually optimized plan using a generative AI model, means for acquiring the latest information from the Internet in real time, means for generating an optimized plan within an input budget, means for presenting the generated plan to the user and enabling customization, means for reserving all necessary items in one lump sum based on the plan approved by the user, means for acquiring the user's emotions using an emotion recognition engine, means for adjusting the plan based on the user's emotion data, and means for allowing the user to confirm and finalize the reservation details. This enables appropriate work assignment and environment adjustment according to the emotional state of workers.

[1825] "User-input information" is data about a user's attributes and requests that is provided to the system.

[1826] "Past history" is a record of the activities a user has experienced to date.

[1827] "User preferences" are information that refers to personal tendencies or inclinations that a user has toward certain activities or choices.

[1828] A "profile" is a collection of data that indicates a user's characteristics, which is composed of information such as the user's past history and preferences.

[1829] A "generative AI model" is an algorithm or system that uses artificial intelligence to generate optimal results or plans based on specific input data.

[1830] "Real-time, up-to-date information" refers to the latest data based on the current situation, obtained via the Internet or other means.

[1831] A "budget-optimized plan" is a plan created to achieve the most effective results within the budget set by the user.

[1832] An "emotion recognition engine" is software and hardware that analyzes and recognizes a user's emotional state from data such as facial expressions and voice.

[1833] "Allows for customization" refers to the ability for users to freely change or adjust the plans and settings provided.

[1834] "Making a bulk reservation" refers to processing multiple reservation items at once.

[1835] "Confirm reservation details and make final adjustments" is a function that allows the user to confirm the reservation details and make final corrections or adjustments as necessary.

[1836] The present invention relates to a system that recognizes the emotional state of factory workers and optimizes work plans based on that data. Specific embodiments for carrying out the present invention are described below.

[1837] System configuration

[1838] 1. Obtaining user input information

[1839] The factory robot obtains basic information from the worker, such as shift information, responsibilities, and skill level, through the robot's input interface and sends it to the server.

[1840] 2. Creating and updating your profile

[1841] The server retrieves the worker's past work history and skill data from the database and integrates it with newly entered information to create or update the worker's profile.

[1842] 3. Acquiring Emotion Data

[1843] The factory robot uses a camera and microphone equipped with an emotion engine to capture facial expressions and voice data of workers in real time, which is then analyzed by the emotion recognition engine to determine the worker's emotional state (e.g., whether they are stressed or relaxed) and sent to a server.

[1844] 4. Generating work plans using generative AI models

[1845] The server generates a work plan using a generative AI model (such as GPT-4) based on user input information, worker profiles, and emotional data. The generative AI model used here takes into account emotional states and skill levels to optimally assign work and adjust the environment.

[1846] Example prompt sentence:

[1847] "Worker basic information: night shift, assembly line work, skill level 5. Worker emotional data: feeling stressed. Based on this, please create a plan to optimize work efficiency."

[1848] 5. Obtaining real-time information

[1849] The server obtains information about the latest work status and machine conditions within the factory in real time via the Internet and reflects this information in the generated work plan.

[1850] 6. Optimizing work efficiency

[1851] Based on the generated work plan, the server assigns appropriate work to avoid overloading workers, and adjusts according to individual situations, such as assigning less demanding work to workers who are feeling stressed.

[1852] 7. Plan presentation and customization

[1853] The factory robot presents the generated work plan to the worker, allowing the worker to freely adjust and customize it. The worker can change the plan using the interface.

[1854] 8. Bulk Schedule Processing

[1855] The server collectively schedules each task based on the plan finalized by the worker and notifies the scheduler.

[1856] 9. Confirmation and final adjustments

[1857] The server sends all schedule confirmation information to the factory robot, which then displays a confirmation screen to the worker, who then makes any final confirmations or adjustments and finalizes the schedule.

[1858] Hardware and Software Use

[1859] Hardware:

[1860] Camera and microphone with emotion engine: Captures worker emotion data.

[1861] Factory robots: Collect worker input and assist with customization.

[1862] Server: Data processing and execution of generative AI models.

[1863] software:

[1864] Emotion recognition system: Analyzes workers' facial expressions and voice data.

[1865] User profile management system: Create and update worker profiles.

[1866] Generative AI model: generating work plans.

[1867] Scheduling system: Work booking and management.

[1868] In this way, the present invention is a system that recognizes the emotional state of factory workers in real time, generates work plans based on that data, and optimizes work efficiency, thereby reducing worker stress and improving production efficiency.

[1869] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1870] Step 1:

[1871] The user enters basic information such as shift information, duties, and skill level into the terminal.

[1872] Input: Shift information (e.g., night shift), duties (e.g., assembly line work), skill level (e.g., level 5)

[1873] Output: User input information

[1874] Specific operation: The user inputs the necessary information into the input interface of the factory robot, and the robot acquires this information and sends it to the server.

[1875] Step 2:

[1876] The server retrieves the worker's past work history and skill data from the database and creates or updates a profile.

[1877] Input: User input information, past work history, skill data

[1878] Output: Updated worker profile

[1879] What it does: The server retrieves past work history and skill data from the database, integrates it with the user's new information, and updates their profile.

[1880] Step 3:

[1881] Factory robots use cameras and microphones equipped with emotion engines to capture facial expressions and voice data from workers in real time.

[1882] Input: Facial expression data and voice data of workers

[1883] Output: Emotion data

[1884] How it works: The factory robot monitors the workers while they are working, collecting data using facial camera and microphone. The emotion recognition engine analyzes the data and recognizes their emotional state.

[1885] Step 4:

[1886] The server uses a generative AI model to generate an optimal work plan based on user input information, profile data, and emotional data.

[1887] Input: User input information, profile data, emotion data

[1888] Output: Optimized work plan

[1889] How it works: The server uses this data to input prompts into a generative AI model, which then generates an optimal work plan. GPT-4 and other models are used as generative AI models.

[1890] Example prompt sentence:

[1891] "Worker basic information: night shift, assembly line work, skill level 5. Worker emotional data: feeling stressed. Based on this, please create a plan to optimize work efficiency."

[1892] Step 5:

[1893] The server obtains the latest information on work status and machine conditions within the factory in real time via the Internet and reflects this in the generated work plan.

[1894] Input: Latest work status information, machine status information

[1895] Output: Updated Work Plan

[1896] Specific operation: The server connects to the factory's systems, obtains information such as the current line operation status and machine maintenance status, and reflects this information in the optimal work plan.

[1897] Step 6:

[1898] The server presents the generated work plan to the user through the terminal, allowing the user to review and customize the plan.

[1899] Input: Generated Work Plan

[1900] Output: A work plan presented to the user

[1901] Specific operation: The terminal visualizes the work plan and displays it to the user, and provides an interface that allows the user to edit break times and work content as needed.

[1902] Step 7:

[1903] The server collectively schedules work assignments and break schedules based on the plan finalized by the user and notifies each worker.

[1904] Input: User-confirmed work plan

[1905] Output: Bulk scheduled work and notification information

[1906] Specific operation: The server sets the schedules of all workers in bulk based on the confirmed work plan and sends notifications to each worker.

[1907] Step 8:

[1908] The server transmits all confirmed schedule information to the terminal, which presents a confirmation screen to the user.

[1909] Input: Confirmed schedule information

[1910] Output: A confirmation screen presented to the user

[1911] Specific operation: The server sends schedule information to the terminal, which displays it to the user. The user then performs a final check and makes any necessary corrections.

[1912] These steps realize a system that can appropriately assign tasks and adjust the environment according to the user's emotional state.

[1913] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1914] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1915] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1916] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1917] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1918] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1919] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1920] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1921] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1922] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1923] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1924] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1925] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1926] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1927] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1928] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1929] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1930] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1931] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1932] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1933] All publications, patent applications, and te...

Claims

1. a means for obtaining user input information; A means to create and update a profile based on past travel history and user preferences; a means for generating a personalized optimized itinerary using a generative AI model; and A means of obtaining real-time, up-to-date tourist information, events, and reviews from the Internet; A means for generating an optimized travel plan within an input budget; a means for presenting the generated itinerary to a user and enabling customization; A way to book accommodation, transportation and activities all at once based on a plan approved by the user; A means for users to confirm and finalize their reservations; A system including:

2. 10. The system of claim 1, further comprising means for updating the generated itinerary in real time.

3. The system according to claim 1, further comprising means for automatically calculating a breakdown of costs based on user-entered information and generating an optimized travel plan within a budget.

Images