System

Abstract

A system is provided.SOLUTION: A system comprising: means for receiving a travel request from a user; means for generating an optimal travel plan based on the request; means for reserving accommodations and transportation based on the generated travel plan; means for providing local directions and tourist information on the day of the trip; and means for collecting user feedback after the trip to improve service.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Planning a trip today takes a lot of time and effort, and it can become a hassle. As a result, the enjoyment of travel itself is diminished, and many people are reluctant to plan trips at all. Labor shortages in the travel industry are also a serious problem, causing website management and local guide labor costs to soar. Furthermore, when traveling abroad, language barriers exist, and many people find it difficult to communicate with locals. To solve these issues, simplify the process from trip planning to execution, and provide travel services that more people can enjoy, we need to fundamentally rethink our current travel planning and support methods. [Means for solving the problem]

[0005] The present invention provides a system that includes a means for receiving travel preferences from users, a means for generating an optimal travel plan based on those preferences, a means for booking accommodations and transportation based on the generated travel plan, a means for providing on-site directions and tourist information on the day of the trip, and a means for collecting user feedback and improving services after the trip. This system provides real-time guidance based on user input and includes a multilingual interpretation function, allowing users to receive support in their local language while traveling abroad. Furthermore, this system can be used on a variety of platforms, including smartphone apps, websites, and wearable devices. It can be operated internally or provided to external companies, allowing each company to utilize AI intelligence to enhance customer service. This system efficiently solves many of the challenges of modern travel planning and provides an environment where people can rediscover the joy of travel.

[0006] "User" refers to an individual or organization that uses this system.

[0007] "Travel preferences" refers to travel requirements entered by a user into the system, such as travel destination, available dates, budget, and special interests.

[0008] "Means for generating travel plans" refers to algorithms and software that generate optimal travel schedules, accommodations, transportation options, tourist attractions, etc. based on user input.

[0009] "Accommodation" refers to the place where users stay during their trip, such as a hotel, private inn, or guesthouse.

[0010] "Transportation" refers to the means of transportation used during a trip, such as airplanes, trains, buses, and taxis.

[0011] "Means of reservation" refers to the program or API interface for reserving accommodation, transportation, etc. online, or the server system that processes this information.

[0012] "Directions" refers to route information, maps, and navigation services to help users reach their destination.

[0013] "Tourist destination guide" refers to a service that provides information on tourist spots, famous places, and facilities at travel destinations.

[0014] "Means of collecting feedback" refers to surveys and interactive interfaces used to collect opinions, ratings, impressions, etc. from users.

[0015] "Means for improving services" refers to the algorithms and development processes used to analyze collected feedback and improve the system's functionality and the itineraries it offers.

[0016] "Real-time guidance" means route guidance and other travel assistance information provided immediately based on a user's current location and circumstances.

[0017] "Multilingual interpretation" refers to translation algorithms and software features that facilitate communication between different languages.

[0018] A "smartphone app" refers to a software application that can be used on a smartphone.

[0019] "Website" means a collection of web pages providing information and services available over the Internet.

[0020] "Wearable devices" refer to electronic devices that can be worn, such as smartwatches and smart glasses.

[0021] "Platform" refers to an underlying hardware and software environment that serves a specific purpose or function.

[0022] "AI intelligence" refers to a system that uses artificial intelligence technology to automatically analyze data and make decisions and perform processing.

[0023] "External companies" refer to external organizations and companies that have business partnerships with this system.

[0024] "Enhancing customer service" refers to measures and system improvements to improve the quality and efficiency of customer service. [Brief explanation of the drawings]

[0025] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram illustrating a processing flow of the data processing system according to the first embodiment. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0026] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0027] First, the terms used in the following description will be explained.

[0028] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0029] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0030] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0031] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0032] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0033] [First embodiment]

[0034] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0035] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0036] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0037] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0038] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0039] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0040] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0041] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0042] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0043] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0044] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0045] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0046] System Overview

[0047] The invention is an AI-based system that supports the entire travel process, from trip planning and execution to collecting feedback and improving services. Users can access travel arrangements and on-site support through a smartphone app, website, or wearable device.

[0048] Initial settings and obtaining user preferences

[0049] A user launches an app, website, or wearable device and the system first asks the user for basic information, such as their travel destination, desired dates, and budget.

[0050] The user types, "I want to go to Okinawa."

[0051] The server receives this information and then generates questions to obtain detailed conditions (e.g., schedule, budget, interests, etc.) and sends them to the terminal.

[0052] The device prompts the user with specific questions.

[0053] The user answers, "The last week of June, my budget is under 100,000 yen."

[0054] Generate a travel plan

[0055] The server searches the database based on the conditions obtained from the user and generates the optimal travel plan.

[0056] The plan includes potential accommodation, transportation options and tourist destinations.

[0057] The server sends the generated plan to the terminal.

[0058] The device will prompt the user, "Are you sure you want to proceed with this plan?"

[0059] The user reviews the plan and selects "Yes."

[0060] Reservation Processing

[0061] The server processes the reservation request for the relevant accommodation and transportation based on the plan selected by the user.

[0062] Upon completion of each reservation, reservation details (e.g. reservation number, dates, price, etc.) are generated.

[0063] The server sends the reservation confirmation information to the terminal.

[0064] The device will display the details of the completed booking to the user.

[0065] Local support

[0066] On the day of travel, the user simply launches the application again and the system begins providing real-time support.

[0067] The server obtains the user's current location and travel schedule.

[0068] The device displays real-time directions, transfer information, and tourist information.

[0069] When users visit tourist spots, the system provides additional information and recommendations.

[0070] Feedback and Service Improvement

[0071] After the trip is completed, the system asks the user to provide feedback.

[0072] The device displays a survey such as "Were you satisfied with your trip?"

[0073] The user enters and submits feedback.

[0074] The server collects feedback data and analyzes it to improve the service.

[0075] The server uses the analysis results to improve the algorithm for generating travel plans for future trips.

[0076] Specific use cases

[0077] For example, if a user inputs their desire to "go to Okinawa," the system will interactively obtain detailed requirements and propose the optimal travel plan. On the day of the trip, real-time route guidance and tourist information will be provided via smartphone, and in the case of overseas travel, an interpretation function will also be available to overcome language barriers. After the trip, feedback will be collected through a questionnaire, and the quality of the service will be improved based on this.

[0078] In this way, the present invention is a system that comprehensively supports travel from planning to implementation and feedback, allowing users to have an easy and more enjoyable travel experience.

[0079] The processing flow will be explained below.

[0080] Program processing steps

[0081] 1. Travel plan consultation and proposal

[0082] Step 1:

[0083] The user opens a smartphone app, website, or wearable device and enters their travel wishes.

[0084] Example: "I want to go to Okinawa."

[0085] Step 2:

[0086] The server receives the user's input and stores it as initial data.

[0087] Step 3:

[0088] The device will prompt the user with detailed questions such as "When would you like to travel?"

[0089] Step 4:

[0090] The user answers detailed questions (e.g., travel dates, budget, special interests, etc.).

[0091] Step 5:

[0092] The server analyzes the user's responses and collects information on available hotels, transportation options, and tourist attractions.

[0093] Step 6:

[0094] The server uses this data to generate and present the optimal travel plan.

[0095] Step 7:

[0096] The device displays the generated itinerary to the user.

[0097] For example: "Are you sure you want to go ahead with this plan?"

[0098] Step 8:

[0099] The user reviews and selects the plan.

[0100] 2. Processing and Confirmation of Bookings

[0101] Step 9:

[0102] The user selects the best suggested travel plan and begins the booking process.

[0103] Step 10:

[0104] The server processes hotel and transportation reservations based on the plan selected by the user.

[0105] Step 11:

[0106] The server generates confirmation information (reservation number, detailed schedule, fee, etc.) after the reservation is completed and sends it to the terminal.

[0107] Step 12:

[0108] The device will notify the user of the reservation completion confirmation and display details.

[0109] 3. Support and guidance on the day

[0110] Step 13:

[0111] The user activates the service on the day of travel and requests support.

[0112] Step 14:

[0113] The server obtains the user's location and status, predicts their next move, and prepares for it.

[0114] Step 15:

[0115] The device displays and navigates transfer directions and routes from your current location.

[0116] Step 16:

[0117] The device will provide information about tourist destinations the user will visit and recommended spots.

[0118] Step 17:

[0119] The server will provide real-time restaurant recommendations and flexible support depending on the user's situation.

[0120] 4. Post-trip feedback and improvements

[0121] Step 18:

[0122] A screen will be available for users to provide feedback after completing their trip.

[0123] Step 19:

[0124] The device displays a survey to the user, such as "Were you satisfied with your trip?"

[0125] Step 20:

[0126] Users complete surveys and provide feedback.

[0127] Step 21:

[0128] Analyze the feedback collected by our servers to identify areas for improvement of our services.

[0129] Step 22:

[0130] The server reflects the feedback results in future travel plan generation algorithms and support functions.

[0131] This allows users to plan and execute trips simply and efficiently, and businesses to enhance customer service.

[0132] Example 1

[0133] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0134] Today's travelers are expected to efficiently and smoothly complete the entire process, from planning to execution and feedback on their trips. In particular, there is a lack of systems that provide comprehensive support, from selecting and booking a travel destination, to on-site support, and even post-trip feedback. Furthermore, while local guides using real-time location information and multilingual interpretation functions are important elements for travelers, current systems do not adequately provide these features. This creates problems for travelers, resulting in the time and effort they waste during the planning and execution processes.

[0135] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0136] In this invention, the server includes a means for receiving travel requests from users, a means for generating an optimal travel plan, a means for booking accommodations and transportation based on the generated travel plan, a means for providing local navigation and tourist information, and a means for collecting user feedback and improving services. This allows travelers to easily receive comprehensive travel support, providing a more comfortable and efficient travel experience. Furthermore, by including a means for providing real-time guidance using the user's location information and a multilingual interpretation function, inconveniences at the travel destination can be eliminated, resulting in a more fulfilling trip.

[0137] "User" refers to a person who uses the system to assist in travel planning and execution.

[0138] "Preferences" refers to information about a user's travel-related requests, such as destination, schedule, and budget.

[0139] "Travel Plan" refers to a travel schedule generated based on the user's preferences, including details of accommodation, transportation, tourist attractions, etc.

[0140] "Reservation" refers to the process of reserving accommodation and transportation in advance based on travel plans.

[0141] "Navigation" refers to providing users with directions and transportation information to reach their destinations on-site.

[0142] "Tourist destination information" refers to data that includes details such as the destination's attractions, recommended spots, and how to get there.

[0143] "Feedback" refers to opinions provided by users after a trip regarding their satisfaction with the trip and areas for improvement.

[0144] "Real-time" refers to the immediate processing and delivery of data or information in the current time.

[0145] "Guide" refers to providing information and support that users need during their travels.

[0146] "Multilingual" refers to the ability to provide information in different languages ​​to users who speak different languages.

[0147] "Interpretation function" refers to the function of translating conversations and text between different languages.

[0148] "System" refers to the integrated set of hardware and software that generates travel plans, provides bookings, provides on-site support, and collects feedback.

[0149] This invention is an AI-based system that supports all travel processes, from trip planning and execution to feedback collection and service improvement. Users can make trip arrangements and receive on-site support through a smartphone app, website, or wearable device. The system consists of the following hardware and software:

[0150] Hardware

[0151] Server: A central server that processes information from users and generates travel plans. It is equipped with a high-performance processor and large memory capacity.

[0152] Terminal: A smartphone, PC, or wearable device that serves as the user interface and has communication capabilities to communicate with the server.

[0153] software

[0154] Application: A smartphone app or website interface that a user installs, collects user input, and sends it to a server.

[0155] Database: Stores detailed data on accommodation, transportation and tourist destinations.

[0156] Navigation system: A module that provides local directions and transit information.

[0157] Generative AI model: An AI model for generating optimal travel plans based on user preferences.

[0158] Data processing and calculation

[0159] The server analyzes the travel preference data received from the user and uses a generative AI model to create an optimal travel plan, which queries a database to gather detailed information such as accommodation, transportation, and tourist attractions, and then generates a plan that meets the user's requirements.

[0160] For example, if a user inputs "I want to go to Okinawa," the server receives this information and then obtains detailed conditions (e.g., dates, budget, interests, etc.). Based on this, it generates an optimal travel plan and presents it to the user. Once the user confirms the plan and completes the reservation, the server provides navigation information as on-site support on the day of the trip.

[0161] Specific use cases

[0162] For example, if a user inputs their desire to "go to Okinawa," the system will interactively obtain detailed requirements and propose the optimal travel plan. On the day of the trip, real-time route guidance and tourist information will be provided via smartphone, and in the case of overseas travel, an interpretation function will also be available to overcome language barriers. After the trip, feedback will be collected through a questionnaire, and the quality of the service will be improved based on this.

[0163] Prompt Sentence Examples

[0164] By inputting prompt sentences like the one below into the generative AI model, it is possible to create the optimal travel plan based on the user's wishes.

[0165] "Please create the best travel plan for Okinawa. The date is the last week of June, and the budget is within 100,000 yen. Please propose a plan that includes information on accommodation, transportation, and tourist attractions."

[0166] To implement this invention, various hardware and software such as servers, terminals, applications, databases, navigation systems, and generative AI models must be appropriately combined to provide consistent travel support based on user preferences, allowing travelers to comfortably navigate the entire process from planning to execution.

[0167] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0168] Step 1:

[0169] The user launches a smartphone app, website, or wearable device. The user inputs a request, such as "I want to go to Okinawa." The request is sent from the device to the server.

[0170] Input: User's travel wishes (e.g., "I want to go to Okinawa")

[0171] Output: Travel preference data received by the server

[0172] Step 2:

[0173] The server receives the user's input and generates a question asking the user for additional detailed conditions, which is then sent to the terminal.

[0174] Input: Travel preference data received by the server

[0175] Output: A question asking for detailed conditions to be sent to the device (e.g., "When are your travel dates?", "What is your budget?")

[0176] Step 3:

[0177] The terminal displays the questions received from the server to the user, who then enters detailed conditions such as dates and budget and submits the request.

[0178] Input: Questions asking for detailed conditions from the server

[0179] Output: User's detailed condition response (e.g., "Last week of June", "Budget is within 100,000 yen")

[0180] Step 4:

[0181] The server searches the database to collect the necessary data based on the detailed conditions received from the user, and the generative AI model then generates the optimal travel plan based on the collected data.

[0182] Input: User's detailed condition data

[0183] Output: Optimal itinerary (e.g., list of accommodations, transportation options, and tourist attractions)

[0184] Step 5:

[0185] The server sends the generated travel plan to the terminal, which displays the proposed plan to the user and asks for confirmation.

[0186] Input: Optimal travel plan data

[0187] Output: A plan confirmation message to the user displayed on the device (e.g., "Are you sure you want to proceed with this plan?")

[0188] Step 6:

[0189] The user confirms the proposed travel plan and selects "Yes." The selected plan is sent from the device to the server.

[0190] Input: Confirmation of travel plan selected by user

[0191] Output: User selection data sent to the server

[0192] Step 7:

[0193] The server processes the reservation requests for accommodation and transportation based on the user's selected plan. After each reservation is completed, reservation details are generated.

[0194] Input: Travel plan information selected by the user

[0195] Output: Reservation confirmation information (e.g. reservation number, date, price)

[0196] Step 8:

[0197] The server sends the reservation confirmation information to the terminal, which displays the reservation details to the user.

[0198] Input: Reservation confirmation information

[0199] Output: Reservation details displayed on the device (e.g., accommodation name, check-in date, price)

[0200] Step 9:

[0201] On the day of the trip, the user launches the application again. The server uses the GPS to obtain the user's current location and checks the trip schedule.

[0202] Input: User application launch, current location information

[0203] Output: Real-time support data based on travel schedule and current location

[0204] Step 10:

[0205] The device displays directions and tourist information to the user based on real-time support data from the server.

[0206] Input: Real-time support data

[0207] Output: Directions information, tourist spot information (e.g., route from current location to tourist spot, recommended spots)

[0208] Step 11:

[0209] After the trip is over, the device displays a survey asking for feedback from the user, who then enters and submits the feedback.

[0210] Input: Feedback Survey

[0211] Output: User feedback data (e.g., satisfaction, areas for improvement)

[0212] Step 12:

[0213] The server collects feedback data from users and analyzes it to improve the service, and then refines the algorithm for generating future travel plans.

[0214] Input: User feedback data

[0215] Output: Analysis results and algorithm improvements based on them

[0216] (Application example 1)

[0217] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0218] There is a need to eliminate the complexity of travel planning and the inconvenience of being on-site, allowing users to plan and execute trips more easily and enjoyably. In particular, it is important to enable users to experience their destinations in advance through a virtual environment at home, allowing them to more concretely imagine and select their actual travel plans. In addition, a system is needed to collect feedback after the trip and improve the accuracy of future travel plans.

[0219] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0220] In this invention, the server includes means for receiving travel requests from a user, means for generating an optimal travel plan, and means for reserving accommodations and transportation based on the generated travel plan, thereby providing a simulated travel destination experience within a virtual environment and enabling users to reserve travel plans from the virtual environment.

[0221] "User" refers to a person who plans, makes reservations, and receives on-site support through this system.

[0222] "Preferences" refers to the travel requests, such as the travel destination, itinerary, and budget, proposed by the user.

[0223] "Travel plan" refers to a plan generated based on the user's preferences, including suggestions for accommodation, transportation, tourist attractions, etc.

[0224] "Accommodation" refers to hotels, inns, and other lodging facilities where users can stay at their travel destinations.

[0225] "Transportation" refers to the means of transportation, such as trains, buses, and airplanes, that users use to travel to their travel destinations.

[0226] "Route guidance" refers to a service that tells users the best route to their destination on the day of their trip.

[0227] "Tourist destination guide" refers to a service that provides information about tourist destinations and recommended spots that users visit.

[0228] "Feedback" refers to opinions and impressions collected from users after the trip has ended.

[0229] "Service improvement" refers to improving systems and proposal processes based on collected feedback.

[0230] A "virtual environment" refers to a computer-generated virtual space that simulates a real-life travel destination.

[0231] A "simulation experience" refers to an experience that allows users to test-visit real-world travel destinations within a virtual environment.

[0232] "Reservation" refers to the act of a user reserving accommodation and transportation based on a travel plan.

[0233] The present invention is an AI-based travel assistance system that supports everything from trip planning to execution, feedback collection, and service improvement. Specific embodiments of this system are described below.

[0234] System Overview

[0235] The system of this invention mainly consists of a server, a terminal, and a user. The server receives requests from the user and generates and provides the optimal travel plan. The terminal refers to a smartphone or a head-mounted display (HMD), through which the user interacts with the system.

[0236] Initial settings and obtaining user preferences

[0237] When a user starts up the device, the server generates questions to obtain basic information such as the travel destination, desired dates, and budget, and sends them to the device. The device displays these questions to the user, who then enters conditions such as "I want to go to Okinawa" and "The last week of June, budget within 100,000 yen." This allows the server to receive the user's basic preferences.

[0238] Generate a travel plan

[0239] The server generates an optimal travel plan from its internal database based on the received requests. This plan includes accommodation, transportation, and tourist attractions, and is presented to the user via the terminal. Once the user confirms and accepts the plan, the reservation process begins.

[0240] Reservation Processing

[0241] The server will make reservations for the relevant accommodations and transportation based on the plan selected by the user. Once the reservation is complete, a reservation number and detailed information will be generated and sent to the terminal. The terminal will display this to the user and help them prepare for the day of their trip.

[0242] Local support and virtual environments

[0243] On the day of the trip, the user restarts the device, and the server retrieves the user's current location and travel schedule. The device displays real-time route directions, transfer information, and tourist spot information. A simulation experience is also provided within the virtual environment, allowing users to virtually experience tourist spots and accommodations before actually visiting them.

[0244] Feedback and Service Improvement

[0245] After the trip is completed, the system asks the user for feedback. The user answers a questionnaire via their device, and the server collects and analyzes the feedback. Based on the results of this analysis, the system improves the algorithm for generating future travel plans and enhances the quality of the service.

[0246] Hardware and software used

[0247] Hardware: Smartphone, Head-Mounted Display (HMD)

[0248] Software: Flask (API server construction), JSON (data management), database (travel destination information management)

[0249] Examples and prompts

[0250] For example, if a user inputs their desire to "go to Tokyo," the system will provide a virtual tour experience of Tokyo's tourist attractions, accommodations, and transportation options. Using the HMD, users can visit tourist spots such as Sensoji Temple, Roppongi Hills, and Disneyland in advance.

[0251] Example prompt sentence:

[0252] The user has entered a desire to "go to Okinawa." The system processes the user's request through the following steps:

[0253] 1. Receive user input.

[0254] 2. Generate a travel plan based on the specified location.

[0255] 3. Present the generated plan to the user.

[0256] 4. The user checks the plan and makes a reservation.

[0257] 5. Send the reservation details to the user.

[0258] Please suggest the following travel destination: [Tokyo, Osaka, Kyoto]

[0259] In this way, the system of the present invention comprehensively supports everything from trip planning and execution to feedback collection and even advance experience of travel destinations through a virtual environment.

[0260] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0261] Step 1:

[0262] The user starts up the device and inputs their desired travel destination, schedule, budget, etc. The user's input is sent to the server by the device. Specifically, the user inputs "I want to go to Okinawa" and "The last week of June, budget is within 100,000 yen," and the data is transferred from the device to the server. The input data is sent to the server in JSON format, and the server receives the data.

[0263] Step 2:

[0264] The server analyzes the user's input data and generates a travel plan based on their preferences. At this time, the server searches its internal database to select the most suitable accommodations, transportation options, tourist attractions, etc. Specifically, the server executes the search query and generates a travel plan for "Okinawa." The output is JSON data for the travel plan, which includes a list of accommodations, transportation options, and tourist attractions.

[0265] Step 3:

[0266] The server sends the generated travel plan to the terminal, which then displays it to the user. The user selects the plan they prefer from the presented plans. Specifically, the travel plan is displayed in list format on the terminal screen, and the user selects "Hotel A," "Tourist Spot B," etc. by clicking on it. The input is the user's selection information, and the output is JSON data of the selected plan.

[0267] Step 4:

[0268] Based on the plan selected by the user, the server sends a reservation request for accommodation and transportation. The server processes each reservation according to the plan and generates a reservation number and detailed information. Specifically, the server calls the reservation API, confirms the reservation at "Hotel A," and generates a reservation number. The input is the user's selection information, and the output is JSON data of the reservation details (reservation number, dates, price, etc.).

[0269] Step 5:

[0270] The server sends reservation confirmation information to the terminal, and the terminal displays the reservation completion details to the user. Specifically, the reservation completion screen is displayed on the terminal, and detailed information (e.g. reservation number 123456, hotel A, price 80,000 yen) is presented. The input is the reservation confirmation data from the server, and the output is the detailed information displayed on the terminal screen.

[0271] Step 6:

[0272] On the day of travel, the user restarts the device, and the server obtains the user's current location and travel schedule. The device then displays route and transfer information in real time. Specifically, the device's GPS function is used to obtain the current location, and the server calls the map API to provide route guidance. The input is current location data, and the output is route guidance information.

[0273] Step 7:

[0274] After the trip, the server sends a questionnaire to the device requesting feedback, and the device displays the questionnaire to the user. The user enters and submits the feedback. Specifically, the device displays a questionnaire screen, and the feedback entered by the user is sent to the server. The input is the user's feedback data, and the output is analysis data stored on the server.

[0275] Step 8:

[0276] The server analyzes the collected feedback data and processes it to improve the service. This data is used to improve the travel plan generation algorithm for future trips. Specifically, the server aggregates the feedback data and builds new plan generation logic through an analytical algorithm. The input is the feedback data, and the output is an improved plan generation algorithm.

[0277] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0278] System Overview

[0279] This invention is an AI-based system that supports all travel-related processes, from trip planning and execution to collecting feedback and improving services. Its unique feature is that it combines an emotion engine that recognizes users' emotions to provide customized travel support based on their emotional state. Users can access travel arrangements and on-site support through a smartphone app, website, or wearable device.

[0280] Initial settings and obtaining user preferences

[0281] A user launches an app, website, or wearable device and the system first asks the user for basic information, such as their travel destination, desired dates, and budget.

[0282] The user types, "I want to go to Okinawa."

[0283] The server receives this information and then generates questions to obtain detailed conditions (e.g., schedule, budget, interests, etc.) and sends them to the terminal.

[0284] The device prompts the user with specific questions.

[0285] The user answers, "The last week of June, my budget is under 100,000 yen."

[0286] Emotion Recognition and Travel Plan Generation

[0287] The server searches the database based on the conditions obtained from the user and generates the optimal travel plan.

[0288] The emotion engine analyzes the user's facial expressions, voice, and input actions to determine their current emotional state.

[0289] The travel plan generated by the server is compared with the analysis results of the emotion engine to select the plan that best suits the user's emotional state.

[0290] The server sends the selected plan to the device.

[0291] The device will prompt the user, "Are you sure you want to proceed with this plan?"

[0292] The user reviews the plan and selects "Yes."

[0293] Reservation Processing

[0294] The server processes the reservation request for the relevant accommodation and transportation based on the plan selected by the user.

[0295] Upon completion of each reservation, reservation details (e.g. reservation number, dates, price, etc.) are generated.

[0296] The server sends the reservation confirmation information to the terminal.

[0297] The device will display the details of the completed booking to the user.

[0298] Local support

[0299] On the day of travel, the user simply launches the application again and the system begins providing real-time support.

[0300] The server obtains the user's current location and travel schedule.

[0301] The device displays real-time directions, transfer information, and tourist information.

[0302] The emotion engine continues to monitor the user's current emotional state and provides more friendly guidance or additional support if it determines they are feeling anxious or stressed.

[0303] When users visit tourist spots, the system provides additional information and recommendations.

[0304] Based on the emotion engine's judgment, the device may also make special suggestions to boost the user's mood.

[0305] Feedback and Service Improvement

[0306] After the trip is completed, the system asks the user to provide feedback.

[0307] The device displays a survey such as "Were you satisfied with your trip?"

[0308] The user enters and submits feedback.

[0309] The server collects feedback data and analyzes it to improve the service.

[0310] The emotion engine analyzes the user's emotional state at the time of feedback and evaluates the content of the feedback from an emotional perspective.

[0311] Based on the analysis results, the server improves the entire system, including the emotion engine, and reflects this in the travel plan generation algorithm for future trips.

[0312] Specific use cases

[0313] For example, if a user inputs their desire to "go to Okinawa," the system will obtain detailed conditions through a dialogue. On the day of the trip, real-time route guidance and tourist information will be provided via smartphone, and if the emotion engine detects anxiety or stress, special support will be offered. For overseas trips, an interpretation function is also available to overcome language barriers. After the trip, feedback will be collected through a questionnaire, and the quality of the service will be improved based on the analysis results of the emotion engine.

[0314] In this way, the present invention is a system that comprehensively supports travel from planning to implementation and feedback, and in particular provides customized services that take into account the user's emotional state, allowing users to have an easy and more enjoyable travel experience.

[0315] The processing flow will be explained below.

[0316] Specific processing steps of the program

[0317] 1. Travel plan consultation and proposal

[0318] Step 1:

[0319] The user opens a smartphone app, website, or wearable device and enters their travel wishes.

[0320] Example: "I want to go to Okinawa."

[0321] Step 2:

[0322] The server receives the user's input and stores it as initial data.

[0323] Step 3:

[0324] The terminal displays a question to the user asking for detailed conditions, such as "When would you like to travel?"

[0325] Step 4:

[0326] The user answers detailed criteria (e.g., travel dates, budget, special interests, etc.).

[0327] Step 5:

[0328] The server analyzes the user's responses and collects information on available accommodation, transportation options, and tourist destinations.

[0329] Step 6:

[0330] The server activates an emotion engine that analyzes the user's facial expressions and tone of voice while they are typing to determine their emotional state.

[0331] Step 7:

[0332] The server generates and presents optimal travel plans based on the collected data and emotional state.

[0333] Step 8:

[0334] The terminal displays the generated travel plan to the user.

[0335] For example: "Are you sure you want to go ahead with this plan?"

[0336] Step 9:

[0337] The user checks the plan and selects it.

[0338] 2. Processing and Confirmation of Bookings

[0339] Step 10:

[0340] The user selects the most suitable travel plan from the suggestions and begins the booking process.

[0341] Step 11:

[0342] The server processes reservations for accommodation and transportation based on the plan selected by the user.

[0343] Step 12:

[0344] The server generates confirmation information (reservation number, detailed schedule, fee, etc.) after the reservation is completed and sends it to the terminal.

[0345] Step 13:

[0346] The terminal notifies the user of the reservation completion confirmation and displays the details.

[0347] 3. Support and guidance on the day

[0348] Step 14:

[0349] The user activates the service on the day of travel and requests support.

[0350] Step 15:

[0351] The server obtains the user's location and status, predicts their next move, and prepares for it.

[0352] Step 16:

[0353] The device displays and navigates transfer directions and routes from your current location.

[0354] Step 17:

[0355] The device provides information about tourist destinations the user is visiting and recommended spots.

[0356] Step 18:

[0357] The server uses an emotion engine to monitor the user's real-time emotional state, and if the user feels anxious or stressed, it provides more friendly guidance or additional support.

[0358] Step 19:

[0359] The server will introduce restaurants and provide flexible support in real time depending on the user's situation.

[0360] 4. Post-trip feedback and improvements

[0361] Step 20:

[0362] A screen is provided for users to provide feedback after completing their trip.

[0363] Step 21:

[0364] The terminal displays a questionnaire to the user, such as "Were you satisfied with your trip?"

[0365] Step 22:

[0366] Users complete surveys and provide feedback.

[0367] Step 23:

[0368] Analyze the feedback collected by our servers to identify areas for improvement of our services.

[0369] Step 24:

[0370] The server uses an emotion engine to analyze the user's emotional state at the time of feedback and reflects it in the next travel plan.

[0371] Step 25:

[0372] Based on the analysis results, the server reflects the feedback results in the travel plan generation algorithm and support functions.

[0373] This allows users to plan and carry out trips simply and efficiently, and companies can improve the quality of their customer service. The introduction of the emotion engine provides customized support according to the user's emotional state, resulting in a more fulfilling travel experience.

[0374] Example 2

[0375] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0376] Conventional travel support systems provide basic functions such as generating travel plans based on user preferences, booking, and on-site support, but they lack customization based on the user's emotional state, which leads to a lack of user satisfaction. Furthermore, services are typically improved after collecting feedback, making it difficult to provide real-time support and support.

[0377] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for receiving travel requests from a user, a means for generating an optimal travel plan, a means for booking accommodations and transportation, a means for providing on-site directions and tourist information, a means for recognizing the user's emotional state and providing a customized travel plan, and a means for collecting feedback and improving services. This makes it possible to provide a customized travel plan and real-time support based on the user's emotional state.

[0378] "User" refers to an individual or group who uses the system to plan their trip or receive on-site support.

[0379] "Preferences" refers to travel requests and conditions such as destination, schedule, budget, and interests that users input into the system.

[0380] "Travel Plan" refers to the optimal travel proposal including tourist attractions, accommodation, transportation, schedule, etc.

[0381] "Emotional state" refers to the psychological state and mood that is analyzed from the user's facial expressions, voice, input actions, etc.

[0382] "Customization" refers to the adjustment and modification of travel plans and services provided to suit the user's individual wishes and emotional state.

[0383] "Feedback" refers to information such as ratings, opinions, and comments collected from users after their trip.

[0384] "Server" refers to the computer system that runs the entire system and performs core functions such as generating travel plans, processing reservations, and analyzing sentiment.

[0385] "Terminal" refers to devices such as smartphones, tablets, PCs, and wearable devices that users use to operate the system.

[0386] "Real-time guidance" refers to support such as route guidance, transfer information, and tourist information that is provided instantly based on the user's current location and situation.

[0387] "Multilingual interpretation function" refers to a function that translates between different languages ​​so that users can receive support in their local language while traveling abroad.

[0388] The present invention is an AI-based system that generates an optimal travel plan based on a user's preferences when planning a trip, provides real-time assistance during the trip, and collects feedback after the trip to improve services. Specific embodiments of this system are described below.

[0389] Hardware and software used

[0390] This system uses devices such as smartphones, tablets, PCs, and wearable devices to receive user operations. The server is used to operate the system and perform core functions such as generating travel plans, processing reservations, and analyzing emotions. The emotion engine is an AI model used to analyze the user's emotional state from their facial expressions, voice, and input actions. This emotion engine collects data using a facial recognition camera and microphone.

[0391] System Overview

[0392] The system includes the following means:

[0393] A method for receiving travel requests from users: Users input their travel destination, schedule, budget, and other requests into their terminal.

[0394] Means for generating an optimal travel plan based on preferences: A server receives input information and searches a database to generate an optimal travel plan.

[0395] A means for reserving accommodation and transportation: The server reserves accommodation and transportation based on the selected travel plan.

[0396] A means of providing local directions and tourist information: The device provides real-time guidance services based on the user's location information while traveling.

[0397] A means of recognizing emotional states and providing customized itineraries: The emotion engine monitors the user's emotional state and optimizes the itinerary and guidance content according to the emotions.

[0398] A means of collecting feedback and improving services: Feedback is collected after the trip is completed and used to improve the entire system.

[0399] Examples of specific examples and prompts

[0400] When a user wants to plan a trip, they might enter the following prompt into their terminal:

[0401] "I'd like to make travel plans. I'd like to go to Okinawa. Do you have any plans for the last week of June? My budget is within 100,000 yen. Also, please let me know about the local support functions."

[0402] A server receiving this prompt should process it as follows:

[0403] First, the system receives the user's desired information, then generates additional questions based on that information to ask for more detailed information. These questions are then sent to the terminal, where the user can enter their details.

[0404] Based on the details entered, the server uses an emotion engine to analyze the user's emotional state, for example by analyzing the user's facial expressions and tone of voice using a facial recognition camera and a voice recognition microphone.

[0405] Combining the results of the sentiment analysis with the user's requirements, the server generates an optimal travel plan from its database, including parameters such as accommodation, flight information, and tourist spot suggestions.

[0406] The travel plans generated in this way are then compared with the results of the emotion engine to select the most suitable one and send it to the device, which then displays a confirmation message asking, "Are you sure you want to proceed with this plan?"

[0407] Feedback is collected and real-time guidance and support is provided, including multilingual interpretation.

[0408] In this way, the present invention is a system that provides a customized travel experience that takes into account the user's emotional state and realizes service improvement through real-time assistance and feedback.

[0409] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0410] Step 1: Initial setup and obtaining user preferences

[0411] The user starts up the device and starts planning a trip. Input: Basic information such as travel destination (e.g., "I want to go to Okinawa"), schedule, and budget.

[0412] The server receives the input information and then generates questions to obtain more detailed conditions. Examples include questions like "What are your travel dates?" and "What is your budget?"

[0413] The server generates a question and sends it to the terminal.

[0414] The device displays the question to the user. Output: The options "What are your travel dates?"

[0415] The user enters detailed information (e.g., "last week of June" and "budget within 100,000 yen").

[0416] Step 2: Emotion recognition and itinerary generation

[0417] The server searches the database based on the conditions obtained from the user and generates the optimal travel plan. Input: Detailed information (travel destination, schedule, budget, etc.). Data processing: Search the database and generate the optimal travel plan. Output: Candidate travel plans.

[0418] The server starts the emotion engine and analyzes the user's facial expressions, voice, and input actions to determine the current emotional state. Input: facial expression images, voice data. Data calculation: analysis of emotional state. Output: analysis results (relief, anxiety, excitement, etc.).

[0419] The travel plan generated by the server is compared with the analysis results of the emotion engine to select the plan that best suits the user's emotional state. Input: Travel plan candidates and emotion analysis results. Data processing: Selection of the optimal plan. Output: Optimal travel plan.

[0420] The server sends the selected plan to the device.

[0421] The device will ask the user for confirmation: "Are you sure you want to proceed with this plan?" Output: Confirmation message.

[0422] The user reviews the plan and selects "Yes."

[0423] Step 3: Reservation Processing

[0424] The server processes the reservation request for accommodation and transportation based on the plan selected by the user. Input: Selected travel plan. Data processing: Sending the request to the reservation system.

[0425] Once each reservation is completed, details such as the associated reservation number, dates, and price are generated. Output: Reservation confirmation information.

[0426] The server sends the reservation confirmation information to the terminal.

[0427] The terminal displays the reservation completion details to the user. Output: Reservation confirmation message.

[0428] Step 4: Local support

[0429] The user launches the application again on the day of travel.

[0430] The server obtains the user's current location information and travel schedule and starts real-time support. Input: Current location information. Data processing: Preparation for real-time support. Output: Support information.

[0431] The terminal displays real-time route guidance, transfer information, tourist information, etc. Output: Real-time guidance message.

[0432] The server continues to run the emotion engine and monitors the user's current emotional state. Input: facial expression, voice, and movement data. Data calculation: real-time emotion analysis. Output: emotion analysis results.

[0433] If anxiety or stress is detected, the server will provide more friendly guidance or additional support. Input: Sentiment analysis results. Data processing: Generation of additional support. Output: Additional guidance message.

[0434] When a user visits a tourist spot or restaurant, the server provides additional information and recommended spots. Input: Data of visited places. Data processing: Generation of additional information. Output: Recommended information.

[0435] The device will make special suggestions to boost the user's mood based on the emotion engine's judgment. Output: Special suggestion message.

[0436] Step 5: Feedback and Service Improvement

[0437] After the trip ends, the device displays a survey such as, "Were you satisfied with your trip?"

[0438] The user enters and submits feedback. Input: Feedback data. Output: Feedback message.

[0439] The server collects feedback data and analyzes it to improve the service. Input: Feedback data. Data processing: Feedback analysis. Output: Analysis results.

[0440] The server improves the service based on the sentiment analysis results and reflects them in future travel plan generation. Input: Analysis results. Data processing: Algorithm improvement. Output: Improved travel plan generation algorithm.

[0441] Through the above steps, the present invention is a system that provides a customized travel experience based on the user's emotional state and realizes service improvement through real-time assistance and feedback.

[0442] (Application example 2)

[0443] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0444] Conventional travel support systems are limited to generating itineraries based on user-specified criteria and providing basic on-site support. However, they lack the ability to respond to users' emotional states and real-time needs, and do not provide sufficient personalized support, especially during the shopping experience in physical stores. Therefore, there is a need for systems that can reduce the inconvenience and stress users experience while traveling or shopping in physical stores and provide more satisfying support.

[0445] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving travel requests from a user, means for generating an optimal travel plan, means for booking accommodations and transportation based on the generated travel plan, means for providing local route guidance and tourist information on the day of the trip, means for analyzing the user's emotional state in real time during the trip and providing customized support based thereon, means for collecting user feedback after the trip and improving services, means for providing real-time guidance using the user's location information and emotional state, and means for recommending products and providing special support based on the emotional analysis when the user shops in physical stores during the trip. This makes it possible to provide customized support according to the user's emotional state and meet real-time needs.

[0446] The "means for receiving travel requests from users" refers to an interface through which users input information such as desired travel destination, schedule, budget, etc., and the system receives that information.

[0447] A "means for generating an optimal travel plan" is an algorithm or process for automatically designing an optimal travel plan for a user based on travel data collected from the user.

[0448] "Means for reserving accommodation and transportation based on the generated travel plan" is a function for automatically reserving accommodation and transportation based on the travel plan generated by the system.

[0449] "Means of providing local directions and tourist information on the day of travel" is a function that provides real-time directions to the destination and tourist information when travelers arrive at their travel destination.

[0450] "Means of analyzing the user's emotional state in real time while traveling and providing customized support based on that" refers to algorithms and sensor technology that analyzes the user's facial expressions and behavior to recognize their emotions and provide optimal support and suggestions based on that state.

[0451] "Means of collecting user feedback after the trip and improving services" refers to the process of collecting impressions and opinions from users after the trip and using that data to improve the quality of services.

[0452] "Means for providing real-time guidance using the user's location information and emotional state" refers to technology that tracks the user's current location and emotional state in real time and provides optimal information and guidance based on that.

[0453] "A means of providing product recommendations and special support based on emotional analysis when users shop in physical stores while traveling" is a function that analyzes the user's emotional state while shopping in a store and provides optimal product recommendations and additional support.

[0454] System configuration

[0455] This invention is a system that uses emotion analysis to provide product recommendations and special support when a user is shopping at a physical store while traveling. Specifically, it has the following configuration.

[0456] A method for receiving travel requests from users: Users input desired information such as travel destination, schedule, budget, etc. using a smartphone or computer. This information is received by the server and stored in a database.

[0457] Means for generating optimal travel plans: The server uses an algorithm to generate optimal travel plans based on the received desired information. The generated plans include information on accommodations, transportation, and tourist spots.

[0458] A means for reserving accommodation and transportation based on the generated travel plan: The server automatically reserves accommodation and transportation based on the generated travel plan. The reservation details are sent to the user's terminal.

[0459] A method for providing local route guidance and tourist information on the day of travel: On the day of travel, users launch the application on their smartphones. The server provides real-time route guidance and tourist information.

[0460] A means of analyzing the user's emotional state in real time while traveling and providing customized support based on that: The server performs emotional analysis through the user's camera and microphone, analyzing the user's facial expressions, voice, and behavioral data to determine the user's emotional state.

[0461] A means to collect user feedback after the trip and improve the service: After the trip is over, the application displays a questionnaire to the user and collects their feedback. The server analyzes this information and uses it to improve the service.

[0462] A method for providing real-time guidance using the user's location information and emotional state: The server provides real-time guidance information based on the user's location information and emotional state. Location information is obtained using technologies such as GPS.

[0463] A means of providing product recommendations and special support based on sentiment analysis when users shop in physical stores while traveling: When users shop in stores, the server recommends products and provides special support based on the results of sentiment analysis.

[0464] System Operation

[0465] 1. Initial Setup:

[0466] The server receives the desired information from the user and stores it in a database.

[0467] The server uses an algorithm to generate an optimal travel plan and makes reservations for accommodation and transportation.

[0468] 2. On the day of travel:

[0469] The server monitors the user's location and emotional state in real time and provides appropriate guidance and tourist information.

[0470] An emotion analysis engine collects data from the user's camera and microphone to determine their emotional state.

[0471] 3. In-store shopping support:

[0472] When a user shops in a store, the server recommends products based on the results of sentiment analysis.

[0473] Provide special assistance as needed (e.g., providing coupons, directing store associates).

[0474] 4. After the trip:

[0475] The server collects feedback from users and analyzes the content using a sentiment analysis engine.

[0476] The analysis results will be used to improve services.

[0477] Specific examples

[0478] If a user selects "Okinawa" as their travel destination, the server will generate a travel plan and make reservations for accommodation and flights. When the user goes shopping at a physical store during their trip, the server will analyze the user's emotions through cameras and microphones and recommend appropriate products. It will also provide special support if it detects stress or anxiety. After the trip, feedback will be collected through a survey to help improve the service.

[0479] Example prompt for a generative AI model:

[0480] "We are developing a smartphone app that uses an emotion engine to analyze users' emotions in real time when they enter a physical store and provides appropriate support and product information. When a user is in a happy mood, the system will recommend products that they might be interested in, and when they are anxious, it will provide friendly guidance. Please tell us the specific requirements for the use scenarios and functions of this app."

[0481] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0482] Step 1:

[0483] The user inputs their desired travel destination, itinerary, budget, etc. into their smartphone or PC. The device then sends this data to the server. The input is the user's desired information (destination, itinerary, budget), and the output is the desired information that is saved on the server.

[0484] Step 2:

[0485] The server generates an optimal travel plan based on the received information. It uses an algorithm to search a database of accommodations, transportation options, and tourist attractions to select the optimal combination. The input is the user's desired information, and the output is the generated travel plan.

[0486] Step 3:

[0487] The server makes reservations for accommodation and transportation based on the generated itinerary. It communicates with the reservation system via API and automatically makes the necessary reservations. The input is the generated itinerary, and the output is reservation confirmation information.

[0488] Step 4:

[0489] On the day of the trip, the user launches the app on their smartphone. The server obtains the user's location information and travel schedule in real time and provides route guidance and tourist information. The inputs are the user's location information and travel schedule, and the output is real-time guidance information.

[0490] Step 5:

[0491] The server analyzes the user's emotional state in real time through a camera and microphone. The emotion analysis engine recognizes facial expressions and analyzes voice to determine the user's emotional state. The input is the user's facial expression data and voice data, and the output is the analyzed emotional state.

[0492] Step 6:

[0493] The server provides customized support based on the analysis results. When users shop in physical stores, product recommendations and special support (e.g., coupons and sales assistant guidance) are provided. The inputs are the analyzed emotional state and a product database, and the output is recommended product information and special support.

[0494] Step 7:

[0495] After the trip, the app displays a feedback questionnaire for the user. The feedback entered by the user is sent to the server. Based on this data, the server analyzes the feedback using a sentiment analysis engine and uses it to improve the service. The input is the user's feedback information, and the output is the analysis results and improvement data.

[0496] Step 8:

[0497] The server integrates all feedback and sentiment analysis results and reflects them in future itinerary generation algorithms and in-store support customization. The input is the integrated feedback data, and the output is an improved service algorithm.

[0498] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0499] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0500] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0501] [Second embodiment]

[0502] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0503] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0504] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0505] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0506] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0507] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0508] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0509] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0510] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0511] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0512] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0513] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0514] System Overview

[0515] The invention is an AI-based system that supports the entire travel process, from trip planning and execution to collecting feedback and improving services. Users can access travel arrangements and on-site support through a smartphone app, website, or wearable device.

[0516] Initial settings and obtaining user preferences

[0517] A user launches an app, website, or wearable device and the system first asks the user for basic information, such as their travel destination, desired dates, and budget.

[0518] The user types, "I want to go to Okinawa."

[0519] The server receives this information and then generates questions to obtain detailed conditions (e.g., schedule, budget, interests, etc.) and sends them to the terminal.

[0520] The device prompts the user with specific questions.

[0521] The user answers, "The last week of June, my budget is under 100,000 yen."

[0522] Generate a travel plan

[0523] The server searches the database based on the conditions obtained from the user and generates the optimal travel plan.

[0524] The plan includes potential accommodation, transportation options and tourist destinations.

[0525] The server sends the generated plan to the terminal.

[0526] The device will prompt the user, "Are you sure you want to proceed with this plan?"

[0527] The user reviews the plan and selects "Yes."

[0528] Reservation Processing

[0529] The server processes the reservation request for the relevant accommodation and transportation based on the plan selected by the user.

[0530] Upon completion of each reservation, reservation details (e.g. reservation number, dates, price, etc.) are generated.

[0531] The server sends the reservation confirmation information to the terminal.

[0532] The device will display the details of the completed booking to the user.

[0533] Local support

[0534] On the day of travel, the user simply launches the application again and the system begins providing real-time support.

[0535] The server obtains the user's current location and travel schedule.

[0536] The device displays real-time directions, transfer information, and tourist information.

[0537] When users visit tourist spots, the system provides additional information and recommendations.

[0538] Feedback and Service Improvement

[0539] After the trip is completed, the system asks the user to provide feedback.

[0540] The device displays a survey such as "Were you satisfied with your trip?"

[0541] The user enters and submits feedback.

[0542] The server collects feedback data and analyzes it to improve the service.

[0543] The server uses the analysis results to improve the algorithm for generating travel plans for future trips.

[0544] Specific use cases

[0545] For example, if a user inputs their desire to "go to Okinawa," the system will interactively obtain detailed requirements and propose the optimal travel plan. On the day of the trip, real-time route guidance and tourist information will be provided via smartphone, and in the case of overseas travel, an interpretation function will also be available to overcome language barriers. After the trip, feedback will be collected through a questionnaire, and the quality of the service will be improved based on this.

[0546] In this way, the present invention is a system that comprehensively supports travel from planning to implementation and feedback, allowing users to have an easy and more enjoyable travel experience.

[0547] The processing flow will be explained below.

[0548] Program processing steps

[0549] 1. Travel plan consultation and proposal

[0550] Step 1:

[0551] The user opens a smartphone app, website, or wearable device and enters their travel wishes.

[0552] Example: "I want to go to Okinawa."

[0553] Step 2:

[0554] The server receives the user's input and stores it as initial data.

[0555] Step 3:

[0556] The device will prompt the user with detailed questions such as "When would you like to travel?"

[0557] Step 4:

[0558] The user answers detailed questions (e.g., travel dates, budget, special interests, etc.).

[0559] Step 5:

[0560] The server analyzes the user's responses and collects information on available hotels, transportation options, and tourist attractions.

[0561] Step 6:

[0562] The server uses this data to generate and present the optimal travel plan.

[0563] Step 7:

[0564] The device displays the generated itinerary to the user.

[0565] For example: "Are you sure you want to go ahead with this plan?"

[0566] Step 8:

[0567] The user reviews and selects the plan.

[0568] 2. Processing and Confirmation of Bookings

[0569] Step 9:

[0570] The user selects the best suggested travel plan and begins the booking process.

[0571] Step 10:

[0572] The server processes hotel and transportation reservations based on the plan selected by the user.

[0573] Step 11:

[0574] The server generates confirmation information (reservation number, detailed schedule, fee, etc.) after the reservation is completed and sends it to the terminal.

[0575] Step 12:

[0576] The device will notify the user of the reservation completion confirmation and display details.

[0577] 3. Support and guidance on the day

[0578] Step 13:

[0579] The user activates the service on the day of travel and requests support.

[0580] Step 14:

[0581] The server obtains the user's location and status, predicts their next move, and prepares for it.

[0582] Step 15:

[0583] The device displays and navigates transfer directions and routes from your current location.

[0584] Step 16:

[0585] The device will provide information about tourist destinations the user will visit and recommended spots.

[0586] Step 17:

[0587] The server will provide real-time restaurant recommendations and flexible support depending on the user's situation.

[0588] 4. Post-trip feedback and improvements

[0589] Step 18:

[0590] A screen will be available for users to provide feedback after completing their trip.

[0591] Step 19:

[0592] The device displays a survey to the user, such as "Were you satisfied with your trip?"

[0593] Step 20:

[0594] Users complete surveys and provide feedback.

[0595] Step 21:

[0596] Analyze the feedback collected by our servers to identify areas for improvement of our services.

[0597] Step 22:

[0598] The server reflects the feedback results in future travel plan generation algorithms and support functions.

[0599] This allows users to plan and execute trips simply and efficiently, and businesses to enhance customer service.

[0600] Example 1

[0601] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0602] Today's travelers are expected to efficiently and smoothly complete the entire process, from planning to execution and feedback on their trips. In particular, there is a lack of systems that provide comprehensive support, from selecting and booking a travel destination, to on-site support, and even post-trip feedback. Furthermore, while local guides using real-time location information and multilingual interpretation functions are important elements for travelers, current systems do not adequately provide these features. This creates problems for travelers, resulting in the time and effort they waste during the planning and execution processes.

[0603] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0604] In this invention, the server includes a means for receiving travel requests from users, a means for generating an optimal travel plan, a means for booking accommodations and transportation based on the generated travel plan, a means for providing local navigation and tourist information, and a means for collecting user feedback and improving services. This allows travelers to easily receive comprehensive travel support, providing a more comfortable and efficient travel experience. Furthermore, by including a means for providing real-time guidance using the user's location information and a multilingual interpretation function, inconveniences at the travel destination can be eliminated, resulting in a more fulfilling trip.

[0605] "User" refers to a person who uses the system to assist in travel planning and execution.

[0606] "Preferences" refers to information about a user's travel-related requests, such as destination, schedule, and budget.

[0607] "Travel Plan" refers to a travel schedule generated based on the user's preferences, including details of accommodation, transportation, tourist attractions, etc.

[0608] "Reservation" refers to the process of reserving accommodation and transportation in advance based on travel plans.

[0609] "Navigation" refers to providing users with directions and transportation information to reach their destinations on-site.

[0610] "Tourist destination information" refers to data that includes details such as the destination's attractions, recommended spots, and how to get there.

[0611] "Feedback" refers to opinions provided by users after a trip regarding their satisfaction with the trip and areas for improvement.

[0612] "Real-time" refers to the immediate processing and delivery of data or information in the current time.

[0613] "Guide" refers to providing information and support that users need during their travels.

[0614] "Multilingual" refers to the ability to provide information in different languages ​​to users who speak different languages.

[0615] "Interpretation function" refers to the function of translating conversations and text between different languages.

[0616] "System" refers to the integrated set of hardware and software that generates travel plans, provides bookings, provides on-site support, and collects feedback.

[0617] This invention is an AI-based system that supports all travel processes, from trip planning and execution to feedback collection and service improvement. Users can make trip arrangements and receive on-site support through a smartphone app, website, or wearable device. The system consists of the following hardware and software:

[0618] Hardware

[0619] Server: A central server that processes information from users and generates travel plans. It is equipped with a high-performance processor and large memory capacity.

[0620] Terminal: A smartphone, PC, or wearable device that serves as the user interface and has communication capabilities to communicate with the server.

[0621] software

[0622] Application: A smartphone app or website interface that a user installs, collects user input, and sends it to a server.

[0623] Database: Stores detailed data on accommodation, transportation and tourist destinations.

[0624] Navigation system: A module that provides local directions and transit information.

[0625] Generative AI model: An AI model for generating optimal travel plans based on user preferences.

[0626] Data processing and calculation

[0627] The server analyzes the travel preference data received from the user and uses a generative AI model to create an optimal travel plan, which queries a database to gather detailed information such as accommodation, transportation, and tourist attractions, and then generates a plan that meets the user's requirements.

[0628] For example, if a user inputs "I want to go to Okinawa," the server receives this information and then obtains detailed conditions (e.g., dates, budget, interests, etc.). Based on this, it generates an optimal travel plan and presents it to the user. Once the user confirms the plan and completes the reservation, the server provides navigation information as on-site support on the day of the trip.

[0629] Specific use cases

[0630] For example, if a user inputs their desire to "go to Okinawa," the system will interactively obtain detailed requirements and propose the optimal travel plan. On the day of the trip, real-time route guidance and tourist information will be provided via smartphone, and in the case of overseas travel, an interpretation function will also be available to overcome language barriers. After the trip, feedback will be collected through a questionnaire, and the quality of the service will be improved based on this.

[0631] Prompt Sentence Examples

[0632] By inputting prompt sentences like the one below into the generative AI model, it is possible to create the optimal travel plan based on the user's wishes.

[0633] "Please create the best travel plan for Okinawa. The date is the last week of June, and the budget is within 100,000 yen. Please propose a plan that includes information on accommodation, transportation, and tourist attractions."

[0634] To implement this invention, various hardware and software such as servers, terminals, applications, databases, navigation systems, and generative AI models must be appropriately combined to provide consistent travel support based on user preferences, allowing travelers to comfortably navigate the entire process from planning to execution.

[0635] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0636] Step 1:

[0637] The user launches a smartphone app, website, or wearable device. The user inputs a request, such as "I want to go to Okinawa." The request is sent from the device to the server.

[0638] Input: User's travel wishes (e.g., "I want to go to Okinawa")

[0639] Output: Travel preference data received by the server

[0640] Step 2:

[0641] The server receives the user's input and generates a question asking the user for additional detailed conditions, which is then sent to the terminal.

[0642] Input: Travel preference data received by the server

[0643] Output: A question asking for detailed conditions to be sent to the device (e.g., "When are your travel dates?", "What is your budget?")

[0644] Step 3:

[0645] The terminal displays the questions received from the server to the user, who then enters detailed conditions such as dates and budget and submits the request.

[0646] Input: Questions asking for detailed conditions from the server

[0647] Output: User's detailed condition response (e.g., "Last week of June", "Budget is within 100,000 yen")

[0648] Step 4:

[0649] The server searches the database to collect the necessary data based on the detailed conditions received from the user, and the generative AI model then generates the optimal travel plan based on the collected data.

[0650] Input: User's detailed condition data

[0651] Output: Optimal itinerary (e.g., list of accommodations, transportation options, and tourist attractions)

[0652] Step 5:

[0653] The server sends the generated travel plan to the terminal, which displays the proposed plan to the user and asks for confirmation.

[0654] Input: Optimal travel plan data

[0655] Output: A plan confirmation message to the user displayed on the device (e.g., "Are you sure you want to proceed with this plan?")

[0656] Step 6:

[0657] The user confirms the proposed travel plan and selects "Yes." The selected plan is sent from the device to the server.

[0658] Input: Confirmation of travel plan selected by user

[0659] Output: User selection data sent to the server

[0660] Step 7:

[0661] The server processes the reservation requests for accommodation and transportation based on the user's selected plan. After each reservation is completed, reservation details are generated.

[0662] Input: Travel plan information selected by the user

[0663] Output: Reservation confirmation information (e.g. reservation number, date, price)

[0664] Step 8:

[0665] The server sends the reservation confirmation information to the terminal, which displays the reservation details to the user.

[0666] Input: Reservation confirmation information

[0667] Output: Reservation details displayed on the device (e.g., accommodation name, check-in date, price)

[0668] Step 9:

[0669] On the day of the trip, the user launches the application again. The server uses the GPS to obtain the user's current location and checks the trip schedule.

[0670] Input: User application launch, current location information

[0671] Output: Real-time support data based on travel schedule and current location

[0672] Step 10:

[0673] The device displays directions and tourist information to the user based on real-time support data from the server.

[0674] Input: Real-time support data

[0675] Output: Directions information, tourist spot information (e.g., route from current location to tourist spot, recommended spots)

[0676] Step 11:

[0677] After the trip is over, the device displays a survey asking for feedback from the user, who then enters and submits the feedback.

[0678] Input: Feedback Survey

[0679] Output: User feedback data (e.g., satisfaction, areas for improvement)

[0680] Step 12:

[0681] The server collects feedback data from users and analyzes it to improve the service, and then refines the algorithm for generating future travel plans.

[0682] Input: User feedback data

[0683] Output: Analysis results and algorithm improvements based on them

[0684] (Application example 1)

[0685] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0686] There is a need to eliminate the complexity of travel planning and the inconvenience of being on-site, allowing users to plan and execute trips more easily and enjoyably. In particular, it is important to enable users to experience their destinations in advance through a virtual environment at home, allowing them to more concretely imagine and select their actual travel plans. In addition, a system is needed to collect feedback after the trip and improve the accuracy of future travel plans.

[0687] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0688] In this invention, the server includes means for receiving travel requests from a user, means for generating an optimal travel plan, and means for reserving accommodations and transportation based on the generated travel plan, thereby providing a simulated travel destination experience within a virtual environment and enabling users to reserve travel plans from the virtual environment.

[0689] "User" refers to a person who plans, makes reservations, and receives on-site support through this system.

[0690] "Preferences" refers to the travel requests, such as the travel destination, itinerary, and budget, proposed by the user.

[0691] "Travel plan" refers to a plan generated based on the user's preferences, including suggestions for accommodation, transportation, tourist attractions, etc.

[0692] "Accommodation" refers to hotels, inns, and other lodging facilities where users can stay at their travel destinations.

[0693] "Transportation" refers to the means of transportation, such as trains, buses, and airplanes, that users use to travel to their travel destinations.

[0694] "Route guidance" refers to a service that tells users the best route to their destination on the day of their trip.

[0695] "Tourist destination guide" refers to a service that provides information about tourist destinations and recommended spots that users visit.

[0696] "Feedback" refers to opinions and impressions collected from users after the trip has ended.

[0697] "Service improvement" refers to improving systems and proposal processes based on collected feedback.

[0698] A "virtual environment" refers to a computer-generated virtual space that simulates a real-life travel destination.

[0699] A "simulation experience" refers to an experience that allows users to test-visit real-world travel destinations within a virtual environment.

[0700] "Reservation" refers to the act of a user reserving accommodation and transportation based on a travel plan.

[0701] The present invention is an AI-based travel assistance system that supports everything from trip planning to execution, feedback collection, and service improvement. Specific embodiments of this system are described below.

[0702] System Overview

[0703] The system of this invention mainly consists of a server, a terminal, and a user. The server receives requests from the user and generates and provides the optimal travel plan. The terminal refers to a smartphone or a head-mounted display (HMD), through which the user interacts with the system.

[0704] Initial settings and obtaining user preferences

[0705] When a user starts up the device, the server generates questions to obtain basic information such as the travel destination, desired dates, and budget, and sends them to the device. The device displays these questions to the user, who then enters conditions such as "I want to go to Okinawa" and "The last week of June, budget within 100,000 yen." This allows the server to receive the user's basic preferences.

[0706] Generate a travel plan

[0707] The server generates an optimal travel plan from its internal database based on the received requests. This plan includes accommodation, transportation, and tourist attractions, and is presented to the user via the terminal. Once the user confirms and accepts the plan, the reservation process begins.

[0708] Reservation Processing

[0709] The server will make reservations for the relevant accommodations and transportation based on the plan selected by the user. Once the reservation is complete, a reservation number and detailed information will be generated and sent to the terminal. The terminal will display this to the user and help them prepare for the day of their trip.

[0710] Local support and virtual environments

[0711] On the day of the trip, the user restarts the device, and the server retrieves the user's current location and travel schedule. The device displays real-time route directions, transfer information, and tourist spot information. A simulation experience is also provided within the virtual environment, allowing users to virtually experience tourist spots and accommodations before actually visiting them.

[0712] Feedback and Service Improvement

[0713] After the trip is completed, the system asks the user for feedback. The user answers a questionnaire via their device, and the server collects and analyzes the feedback. Based on the results of this analysis, the system improves the algorithm for generating future travel plans and enhances the quality of the service.

[0714] Hardware and software used

[0715] Hardware: Smartphone, Head-Mounted Display (HMD)

[0716] Software: Flask (API server construction), JSON (data management), database (travel destination information management)

[0717] Examples and prompts

[0718] For example, if a user inputs their desire to "go to Tokyo," the system will provide a virtual tour experience of Tokyo's tourist attractions, accommodations, and transportation options. Using the HMD, users can visit tourist spots such as Sensoji Temple, Roppongi Hills, and Disneyland in advance.

[0719] Example prompt sentence:

[0720] The user has entered a desire to "go to Okinawa." The system processes the user's request through the following steps:

[0721] 1. Receive user input.

[0722] 2. Generate a travel plan based on the specified location.

[0723] 3. Present the generated plan to the user.

[0724] 4. The user checks the plan and makes a reservation.

[0725] 5. Send the reservation details to the user.

[0726] Please suggest the following travel destination: [Tokyo, Osaka, Kyoto]

[0727] In this way, the system of the present invention comprehensively supports everything from trip planning and execution to feedback collection and even advance experience of travel destinations through a virtual environment.

[0728] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0729] Step 1:

[0730] The user starts up the device and inputs their desired travel destination, schedule, budget, etc. The user's input is sent to the server by the device. Specifically, the user inputs "I want to go to Okinawa" and "The last week of June, budget is within 100,000 yen," and the data is transferred from the device to the server. The input data is sent to the server in JSON format, and the server receives the data.

[0731] Step 2:

[0732] The server analyzes the user's input data and generates a travel plan based on their preferences. At this time, the server searches its internal database to select the most suitable accommodations, transportation options, tourist attractions, etc. Specifically, the server executes the search query and generates a travel plan for "Okinawa." The output is JSON data for the travel plan, which includes a list of accommodations, transportation options, and tourist attractions.

[0733] Step 3:

[0734] The server sends the generated travel plan to the terminal, which then displays it to the user. The user selects the plan they prefer from the presented plans. Specifically, the travel plan is displayed in list format on the terminal screen, and the user selects "Hotel A," "Tourist Spot B," etc. by clicking on it. The input is the user's selection information, and the output is JSON data of the selected plan.

[0735] Step 4:

[0736] Based on the plan selected by the user, the server sends a reservation request for accommodation and transportation. The server processes each reservation according to the plan and generates a reservation number and detailed information. Specifically, the server calls the reservation API, confirms the reservation at "Hotel A," and generates a reservation number. The input is the user's selection information, and the output is JSON data of the reservation details (reservation number, dates, price, etc.).

[0737] Step 5:

[0738] The server sends reservation confirmation information to the terminal, and the terminal displays the reservation completion details to the user. Specifically, the reservation completion screen is displayed on the terminal, and detailed information (e.g. reservation number 123456, hotel A, price 80,000 yen) is presented. The input is the reservation confirmation data from the server, and the output is the detailed information displayed on the terminal screen.

[0739] Step 6:

[0740] On the day of travel, the user restarts the device, and the server obtains the user's current location and travel schedule. The device then displays route and transfer information in real time. Specifically, the device's GPS function is used to obtain the current location, and the server calls the map API to provide route guidance. The input is current location data, and the output is route guidance information.

[0741] Step 7:

[0742] After the trip, the server sends a questionnaire to the device requesting feedback, and the device displays the questionnaire to the user. The user enters and submits the feedback. Specifically, the device displays a questionnaire screen, and the feedback entered by the user is sent to the server. The input is the user's feedback data, and the output is analysis data stored on the server.

[0743] Step 8:

[0744] The server analyzes the collected feedback data and processes it to improve the service. This data is used to improve the travel plan generation algorithm for future trips. Specifically, the server aggregates the feedback data and builds new plan generation logic through an analytical algorithm. The input is the feedback data, and the output is an improved plan generation algorithm.

[0745] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0746] System Overview

[0747] This invention is an AI-based system that supports all travel-related processes, from trip planning and execution to collecting feedback and improving services. Its unique feature is that it combines an emotion engine that recognizes users' emotions to provide customized travel support based on their emotional state. Users can access travel arrangements and on-site support through a smartphone app, website, or wearable device.

[0748] Initial settings and obtaining user preferences

[0749] A user launches an app, website, or wearable device and the system first asks the user for basic information, such as their travel destination, desired dates, and budget.

[0750] The user types, "I want to go to Okinawa."

[0751] The server receives this information and then generates questions to obtain detailed conditions (e.g., schedule, budget, interests, etc.) and sends them to the terminal.

[0752] The device prompts the user with specific questions.

[0753] The user answers, "The last week of June, my budget is under 100,000 yen."

[0754] Emotion Recognition and Travel Plan Generation

[0755] The server searches the database based on the conditions obtained from the user and generates the optimal travel plan.

[0756] The emotion engine analyzes the user's facial expressions, voice, and input actions to determine their current emotional state.

[0757] The travel plan generated by the server is compared with the analysis results of the emotion engine to select the plan that best suits the user's emotional state.

[0758] The server sends the selected plan to the device.

[0759] The device will prompt the user, "Are you sure you want to proceed with this plan?"

[0760] The user reviews the plan and selects "Yes."

[0761] Reservation Processing

[0762] The server processes the reservation request for the relevant accommodation and transportation based on the plan selected by the user.

[0763] Upon completion of each reservation, reservation details (e.g. reservation number, dates, price, etc.) are generated.

[0764] The server sends the reservation confirmation information to the terminal.

[0765] The device will display the details of the completed booking to the user.

[0766] Local support

[0767] On the day of travel, the user simply launches the application again and the system begins providing real-time support.

[0768] The server obtains the user's current location and travel schedule.

[0769] The device displays real-time directions, transfer information, and tourist information.

[0770] The emotion engine continues to monitor the user's current emotional state and provides more friendly guidance or additional support if it determines they are feeling anxious or stressed.

[0771] When users visit tourist spots, the system provides additional information and recommendations.

[0772] Based on the emotion engine's judgment, the device may also make special suggestions to boost the user's mood.

[0773] Feedback and Service Improvement

[0774] After the trip is completed, the system asks the user to provide feedback.

[0775] The device displays a survey such as "Were you satisfied with your trip?"

[0776] The user enters and submits feedback.

[0777] The server collects feedback data and analyzes it to improve the service.

[0778] The emotion engine analyzes the user's emotional state at the time of feedback and evaluates the content of the feedback from an emotional perspective.

[0779] Based on the analysis results, the server improves the entire system, including the emotion engine, and reflects this in the travel plan generation algorithm for future trips.

[0780] Specific use cases

[0781] For example, if a user inputs their desire to "go to Okinawa," the system will obtain detailed conditions through a dialogue. On the day of the trip, real-time route guidance and tourist information will be provided via smartphone, and if the emotion engine detects anxiety or stress, special support will be offered. For overseas trips, an interpretation function is also available to overcome language barriers. After the trip, feedback will be collected through a questionnaire, and the quality of the service will be improved based on the analysis results of the emotion engine.

[0782] In this way, the present invention is a system that comprehensively supports travel from planning to implementation and feedback, and in particular provides customized services that take into account the user's emotional state, allowing users to have an easy and more enjoyable travel experience.

[0783] The processing flow will be explained below.

[0784] Specific processing steps of the program

[0785] 1. Travel plan consultation and proposal

[0786] Step 1:

[0787] The user opens a smartphone app, website, or wearable device and enters their travel wishes.

[0788] Example: "I want to go to Okinawa."

[0789] Step 2:

[0790] The server receives the user's input and stores it as initial data.

[0791] Step 3:

[0792] The terminal displays a question to the user asking for detailed conditions, such as "When would you like to travel?"

[0793] Step 4:

[0794] The user answers detailed criteria (e.g., travel dates, budget, special interests, etc.).

[0795] Step 5:

[0796] The server analyzes the user's responses and collects information on available accommodation, transportation options, and tourist destinations.

[0797] Step 6:

[0798] The server activates an emotion engine that analyzes the user's facial expressions and tone of voice while they are typing to determine their emotional state.

[0799] Step 7:

[0800] The server generates and presents optimal travel plans based on the collected data and emotional state.

[0801] Step 8:

[0802] The terminal displays the generated travel plan to the user.

[0803] For example: "Are you sure you want to go ahead with this plan?"

[0804] Step 9:

[0805] The user checks the plan and selects it.

[0806] 2. Processing and Confirmation of Bookings

[0807] Step 10:

[0808] The user selects the most suitable travel plan from the suggestions and begins the booking process.

[0809] Step 11:

[0810] The server processes reservations for accommodation and transportation based on the plan selected by the user.

[0811] Step 12:

[0812] The server generates confirmation information (reservation number, detailed schedule, fee, etc.) after the reservation is completed and sends it to the terminal.

[0813] Step 13:

[0814] The terminal notifies the user of the reservation completion confirmation and displays the details.

[0815] 3. Support and guidance on the day

[0816] Step 14:

[0817] The user activates the service on the day of travel and requests support.

[0818] Step 15:

[0819] The server obtains the user's location and status, predicts their next move, and prepares for it.

[0820] Step 16:

[0821] The device displays and navigates transfer directions and routes from your current location.

[0822] Step 17:

[0823] The device provides information about tourist destinations the user is visiting and recommended spots.

[0824] Step 18:

[0825] The server uses an emotion engine to monitor the user's real-time emotional state, and if the user feels anxious or stressed, it provides more friendly guidance or additional support.

[0826] Step 19:

[0827] The server will introduce restaurants and provide flexible support in real time depending on the user's situation.

[0828] 4. Post-trip feedback and improvements

[0829] Step 20:

[0830] A screen is provided for users to provide feedback after completing their trip.

[0831] Step 21:

[0832] The terminal displays a questionnaire to the user, such as "Were you satisfied with your trip?"

[0833] Step 22:

[0834] Users complete surveys and provide feedback.

[0835] Step 23:

[0836] Analyze the feedback collected by our servers to identify areas for improvement of our services.

[0837] Step 24:

[0838] The server uses an emotion engine to analyze the user's emotional state at the time of feedback and reflects it in the next travel plan.

[0839] Step 25:

[0840] Based on the analysis results, the server reflects the feedback results in the travel plan generation algorithm and support functions.

[0841] This allows users to plan and carry out trips simply and efficiently, and companies can improve the quality of their customer service. The introduction of the emotion engine provides customized support according to the user's emotional state, resulting in a more fulfilling travel experience.

[0842] Example 2

[0843] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0844] Conventional travel support systems provide basic functions such as generating travel plans based on user preferences, booking, and on-site support, but they lack customization based on the user's emotional state, which leads to a lack of user satisfaction. Furthermore, services are typically improved after collecting feedback, making it difficult to provide real-time support and support.

[0845] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for receiving travel requests from a user, a means for generating an optimal travel plan, a means for booking accommodations and transportation, a means for providing on-site directions and tourist information, a means for recognizing the user's emotional state and providing a customized travel plan, and a means for collecting feedback and improving services. This makes it possible to provide a customized travel plan and real-time support based on the user's emotional state.

[0846] "User" refers to an individual or group who uses the system to plan their trip or receive on-site support.

[0847] "Preferences" refers to travel requests and conditions such as destination, schedule, budget, and interests that users input into the system.

[0848] "Travel Plan" refers to the optimal travel proposal including tourist attractions, accommodation, transportation, schedule, etc.

[0849] "Emotional state" refers to the psychological state and mood that is analyzed from the user's facial expressions, voice, input actions, etc.

[0850] "Customization" refers to the adjustment and modification of travel plans and services provided to suit the user's individual wishes and emotional state.

[0851] "Feedback" refers to information such as ratings, opinions, and comments collected from users after their trip.

[0852] "Server" refers to the computer system that runs the entire system and performs core functions such as generating travel plans, processing reservations, and analyzing sentiment.

[0853] "Terminal" refers to devices such as smartphones, tablets, PCs, and wearable devices that users use to operate the system.

[0854] "Real-time guidance" refers to support such as route guidance, transfer information, and tourist information that is provided instantly based on the user's current location and situation.

[0855] "Multilingual interpretation function" refers to a function that translates between different languages ​​so that users can receive support in their local language while traveling abroad.

[0856] The present invention is an AI-based system that generates an optimal travel plan based on a user's preferences when planning a trip, provides real-time assistance during the trip, and collects feedback after the trip to improve services. Specific embodiments of this system are described below.

[0857] Hardware and software used

[0858] This system uses devices such as smartphones, tablets, PCs, and wearable devices to receive user operations. The server is used to operate the system and perform core functions such as generating travel plans, processing reservations, and analyzing emotions. The emotion engine is an AI model used to analyze the user's emotional state from their facial expressions, voice, and input actions. This emotion engine collects data using a facial recognition camera and microphone.

[0859] System Overview

[0860] The system includes the following means:

[0861] A method for receiving travel requests from users: Users input their travel destination, schedule, budget, and other requests into their terminal.

[0862] Means for generating an optimal travel plan based on preferences: A server receives input information and searches a database to generate an optimal travel plan.

[0863] A means for reserving accommodation and transportation: The server reserves accommodation and transportation based on the selected travel plan.

[0864] A means of providing local directions and tourist information: The device provides real-time guidance services based on the user's location information while traveling.

[0865] A means of recognizing emotional states and providing customized itineraries: The emotion engine monitors the user's emotional state and optimizes the itinerary and guidance content according to the emotions.

[0866] A means of collecting feedback and improving services: Feedback is collected after the trip is completed and used to improve the entire system.

[0867] Examples of specific examples and prompts

[0868] When a user wants to plan a trip, they might enter the following prompt into their terminal:

[0869] "I'd like to make travel plans. I'd like to go to Okinawa. Do you have any plans for the last week of June? My budget is within 100,000 yen. Also, please let me know about the local support functions."

[0870] A server receiving this prompt should process it as follows:

[0871] First, the system receives the user's desired information, then generates additional questions based on that information to ask for more detailed information. These questions are then sent to the terminal, where the user can enter their details.

[0872] Based on the details entered, the server uses an emotion engine to analyze the user's emotional state, for example by analyzing the user's facial expressions and tone of voice using a facial recognition camera and a voice recognition microphone.

[0873] Combining the results of the sentiment analysis with the user's requirements, the server generates an optimal travel plan from its database, including parameters such as accommodation, flight information, and tourist spot suggestions.

[0874] The travel plans generated in this way are then compared with the results of the emotion engine to select the most suitable one and send it to the device, which then displays a confirmation message asking, "Are you sure you want to proceed with this plan?"

[0875] Feedback is collected and real-time guidance and support is provided, including multilingual interpretation.

[0876] In this way, the present invention is a system that provides a customized travel experience that takes into account the user's emotional state and realizes service improvement through real-time assistance and feedback.

[0877] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0878] Step 1: Initial setup and obtaining user preferences

[0879] The user starts up the device and starts planning a trip. Input: Basic information such as travel destination (e.g., "I want to go to Okinawa"), schedule, and budget.

[0880] The server receives the input information and then generates questions to obtain more detailed conditions. Examples include questions like "What are your travel dates?" and "What is your budget?"

[0881] The server generates a question and sends it to the terminal.

[0882] The device displays the question to the user. Output: The options "What are your travel dates?"

[0883] The user enters detailed information (e.g., "last week of June" and "budget within 100,000 yen").

[0884] Step 2: Emotion recognition and itinerary generation

[0885] The server searches the database based on the conditions obtained from the user and generates the optimal travel plan. Input: Detailed information (travel destination, schedule, budget, etc.). Data processing: Search the database and generate the optimal travel plan. Output: Candidate travel plans.

[0886] The server starts the emotion engine and analyzes the user's facial expressions, voice, and input actions to determine the current emotional state. Input: facial expression images, voice data. Data calculation: analysis of emotional state. Output: analysis results (relief, anxiety, excitement, etc.).

[0887] The travel plan generated by the server is compared with the analysis results of the emotion engine to select the plan that best suits the user's emotional state. Input: Travel plan candidates and emotion analysis results. Data processing: Selection of the optimal plan. Output: Optimal travel plan.

[0888] The server sends the selected plan to the device.

[0889] The device will ask the user for confirmation: "Are you sure you want to proceed with this plan?" Output: Confirmation message.

[0890] The user reviews the plan and selects "Yes."

[0891] Step 3: Reservation Processing

[0892] The server processes the reservation request for accommodation and transportation based on the plan selected by the user. Input: Selected travel plan. Data processing: Sending the request to the reservation system.

[0893] Once each reservation is completed, details such as the associated reservation number, dates, and price are generated. Output: Reservation confirmation information.

[0894] The server sends the reservation confirmation information to the terminal.

[0895] The terminal displays the reservation completion details to the user. Output: Reservation confirmation message.

[0896] Step 4: Local support

[0897] The user launches the application again on the day of travel.

[0898] The server obtains the user's current location information and travel schedule and starts real-time support. Input: Current location information. Data processing: Preparation for real-time support. Output: Support information.

[0899] The terminal displays real-time route guidance, transfer information, tourist information, etc. Output: Real-time guidance message.

[0900] The server continues to run the emotion engine and monitors the user's current emotional state. Input: facial expression, voice, and movement data. Data calculation: real-time emotion analysis. Output: emotion analysis results.

[0901] If anxiety or stress is detected, the server will provide more friendly guidance or additional support. Input: Sentiment analysis results. Data processing: Generation of additional support. Output: Additional guidance message.

[0902] When a user visits a tourist spot or restaurant, the server provides additional information and recommended spots. Input: Data of visited places. Data processing: Generation of additional information. Output: Recommended information.

[0903] The device will make special suggestions to boost the user's mood based on the emotion engine's judgment. Output: Special suggestion message.

[0904] Step 5: Feedback and Service Improvement

[0905] After the trip ends, the device displays a survey such as, "Were you satisfied with your trip?"

[0906] The user enters and submits feedback. Input: Feedback data. Output: Feedback message.

[0907] The server collects feedback data and analyzes it to improve the service. Input: Feedback data. Data processing: Feedback analysis. Output: Analysis results.

[0908] The server improves the service based on the sentiment analysis results and reflects them in future travel plan generation. Input: Analysis results. Data processing: Algorithm improvement. Output: Improved travel plan generation algorithm.

[0909] Through the above steps, the present invention is a system that provides a customized travel experience based on the user's emotional state and realizes service improvement through real-time assistance and feedback.

[0910] (Application example 2)

[0911] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0912] Conventional travel support systems are limited to generating itineraries based on user-specified criteria and providing basic on-site support. However, they lack the ability to respond to users' emotional states and real-time needs, and do not provide sufficient personalized support, especially during the shopping experience in physical stores. Therefore, there is a need for systems that can reduce the inconvenience and stress users experience while traveling or shopping in physical stores and provide more satisfying support.

[0913] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving travel requests from a user, means for generating an optimal travel plan, means for booking accommodations and transportation based on the generated travel plan, means for providing local route guidance and tourist information on the day of the trip, means for analyzing the user's emotional state in real time during the trip and providing customized support based thereon, means for collecting user feedback after the trip and improving services, means for providing real-time guidance using the user's location information and emotional state, and means for recommending products and providing special support based on the emotional analysis when the user shops in physical stores during the trip. This makes it possible to provide customized support according to the user's emotional state and meet real-time needs.

[0914] The "means for receiving travel requests from users" refers to an interface through which users input information such as desired travel destination, schedule, budget, etc., and the system receives that information.

[0915] A "means for generating an optimal travel plan" is an algorithm or process for automatically designing an optimal travel plan for a user based on travel data collected from the user.

[0916] "Means for reserving accommodation and transportation based on the generated travel plan" is a function for automatically reserving accommodation and transportation based on the travel plan generated by the system.

[0917] "Means of providing local directions and tourist information on the day of travel" is a function that provides real-time directions to the destination and tourist information when travelers arrive at their travel destination.

[0918] "Means of analyzing the user's emotional state in real time while traveling and providing customized support based on that" refers to algorithms and sensor technology that analyzes the user's facial expressions and behavior to recognize their emotions and provide optimal support and suggestions based on that state.

[0919] "Means of collecting user feedback after the trip and improving services" refers to the process of collecting impressions and opinions from users after the trip and using that data to improve the quality of services.

[0920] "Means for providing real-time guidance using the user's location information and emotional state" refers to technology that tracks the user's current location and emotional state in real time and provides optimal information and guidance based on that.

[0921] "A means of providing product recommendations and special support based on emotional analysis when users shop in physical stores while traveling" is a function that analyzes the user's emotional state while shopping in a store and provides optimal product recommendations and additional support.

[0922] System configuration

[0923] This invention is a system that uses emotion analysis to provide product recommendations and special support when a user is shopping at a physical store while traveling. Specifically, it has the following configuration.

[0924] A method for receiving travel requests from users: Users input desired information such as travel destination, schedule, budget, etc. using a smartphone or computer. This information is received by the server and stored in a database.

[0925] Means for generating optimal travel plans: The server uses an algorithm to generate optimal travel plans based on the received desired information. The generated plans include information on accommodations, transportation, and tourist spots.

[0926] A means for reserving accommodation and transportation based on the generated travel plan: The server automatically reserves accommodation and transportation based on the generated travel plan. The reservation details are sent to the user's terminal.

[0927] A method for providing local route guidance and tourist information on the day of travel: On the day of travel, users launch the application on their smartphones. The server provides real-time route guidance and tourist information.

[0928] A means of analyzing the user's emotional state in real time while traveling and providing customized support based on that: The server performs emotional analysis through the user's camera and microphone, analyzing the user's facial expressions, voice, and behavioral data to determine the user's emotional state.

[0929] A means to collect user feedback after the trip and improve the service: After the trip is over, the application displays a questionnaire to the user and collects their feedback. The server analyzes this information and uses it to improve the service.

[0930] A method for providing real-time guidance using the user's location information and emotional state: The server provides real-time guidance information based on the user's location information and emotional state. Location information is obtained using technologies such as GPS.

[0931] A means of providing product recommendations and special support based on sentiment analysis when users shop in physical stores while traveling: When users shop in stores, the server recommends products and provides special support based on the results of sentiment analysis.

[0932] System Operation

[0933] 1. Initial Setup:

[0934] The server receives the desired information from the user and stores it in a database.

[0935] The server uses an algorithm to generate an optimal travel plan and makes reservations for accommodation and transportation.

[0936] 2. On the day of travel:

[0937] The server monitors the user's location and emotional state in real time and provides appropriate guidance and tourist information.

[0938] An emotion analysis engine collects data from the user's camera and microphone to determine their emotional state.

[0939] 3. In-store shopping support:

[0940] When a user shops in a store, the server recommends products based on the results of sentiment analysis.

[0941] Provide special assistance as needed (e.g., providing coupons, directing store associates).

[0942] 4. After the trip:

[0943] The server collects feedback from users and analyzes the content using a sentiment analysis engine.

[0944] The analysis results will be used to improve services.

[0945] Specific examples

[0946] If a user selects "Okinawa" as their travel destination, the server will generate a travel plan and make reservations for accommodation and flights. When the user goes shopping at a physical store during their trip, the server will analyze the user's emotions through cameras and microphones and recommend appropriate products. It will also provide special support if it detects stress or anxiety. After the trip, feedback will be collected through a survey to help improve the service.

[0947] Example prompt for a generative AI model:

[0948] "We are developing a smartphone app that uses an emotion engine to analyze users' emotions in real time when they enter a physical store and provides appropriate support and product information. When a user is in a happy mood, the system will recommend products that they might be interested in, and when they are anxious, it will provide friendly guidance. Please tell us the specific requirements for the use scenarios and functions of this app."

[0949] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0950] Step 1:

[0951] The user inputs their desired travel destination, itinerary, budget, etc. into their smartphone or PC. The device then sends this data to the server. The input is the user's desired information (destination, itinerary, budget), and the output is the desired information that is saved on the server.

[0952] Step 2:

[0953] The server generates an optimal travel plan based on the received information. It uses an algorithm to search a database of accommodations, transportation options, and tourist attractions to select the optimal combination. The input is the user's desired information, and the output is the generated travel plan.

[0954] Step 3:

[0955] The server makes reservations for accommodation and transportation based on the generated itinerary. It communicates with the reservation system via API and automatically makes the necessary reservations. The input is the generated itinerary, and the output is reservation confirmation information.

[0956] Step 4:

[0957] On the day of the trip, the user launches the app on their smartphone. The server obtains the user's location information and travel schedule in real time and provides route guidance and tourist information. The inputs are the user's location information and travel schedule, and the output is real-time guidance information.

[0958] Step 5:

[0959] The server analyzes the user's emotional state in real time through a camera and microphone. The emotion analysis engine recognizes facial expressions and analyzes voice to determine the user's emotional state. The input is the user's facial expression data and voice data, and the output is the analyzed emotional state.

[0960] Step 6:

[0961] The server provides customized support based on the analysis results. When users shop in physical stores, product recommendations and special support (e.g., coupons and sales assistant guidance) are provided. The inputs are the analyzed emotional state and a product database, and the output is recommended product information and special support.

[0962] Step 7:

[0963] After the trip, the app displays a feedback questionnaire for the user. The feedback entered by the user is sent to the server. Based on this data, the server analyzes the feedback using a sentiment analysis engine and uses it to improve the service. The input is the user's feedback information, and the output is the analysis results and improvement data.

[0964] Step 8:

[0965] The server integrates all feedback and sentiment analysis results and reflects them in future itinerary generation algorithms and in-store support customization. The input is the integrated feedback data, and the output is an improved service algorithm.

[0966] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0967] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0968] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0969] [Third embodiment]

[0970] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0971] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0972] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0973] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0974] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0975] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0976] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0977] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0978] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0979] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0980] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0981] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0982] System Overview

[0983] The invention is an AI-based system that supports the entire travel process, from trip planning and execution to collecting feedback and improving services. Users can access travel arrangements and on-site support through a smartphone app, website, or wearable device.

[0984] Initial settings and obtaining user preferences

[0985] A user launches an app, website, or wearable device and the system first asks the user for basic information, such as their travel destination, desired dates, and budget.

[0986] The user types, "I want to go to Okinawa."

[0987] The server receives this information and then generates questions to obtain detailed conditions (e.g., schedule, budget, interests, etc.) and sends them to the terminal.

[0988] The device prompts the user with specific questions.

[0989] The user answers, "The last week of June, my budget is under 100,000 yen."

[0990] Generate a travel plan

[0991] The server searches the database based on the conditions obtained from the user and generates the optimal travel plan.

[0992] The plan includes potential accommodation, transportation options and tourist destinations.

[0993] The server sends the generated plan to the terminal.

[0994] The device will prompt the user, "Are you sure you want to proceed with this plan?"

[0995] The user reviews the plan and selects "Yes."

[0996] Reservation Processing

[0997] The server processes the reservation request for the relevant accommodation and transportation based on the plan selected by the user.

[0998] Upon completion of each reservation, reservation details (e.g. reservation number, dates, price, etc.) are generated.

[0999] The server sends the reservation confirmation information to the terminal.

[1000] The device will display the details of the completed booking to the user.

[1001] Local support

[1002] On the day of travel, the user simply launches the application again and the system begins providing real-time support.

[1003] The server obtains the user's current location and travel schedule.

[1004] The device displays real-time directions, transfer information, and tourist information.

[1005] When users visit tourist spots, the system provides additional information and recommendations.

[1006] Feedback and Service Improvement

[1007] After the trip is completed, the system asks the user to provide feedback.

[1008] The device displays a survey such as "Were you satisfied with your trip?"

[1009] The user enters and submits feedback.

[1010] The server collects feedback data and analyzes it to improve the service.

[1011] The server uses the analysis results to improve the algorithm for generating travel plans for future trips.

[1012] Specific use cases

[1013] For example, if a user inputs their desire to "go to Okinawa," the system will interactively obtain detailed requirements and propose the optimal travel plan. On the day of the trip, real-time route guidance and tourist information will be provided via smartphone, and in the case of overseas travel, an interpretation function will also be available to overcome language barriers. After the trip, feedback will be collected through a questionnaire, and the quality of the service will be improved based on this.

[1014] In this way, the present invention is a system that comprehensively supports travel from planning to implementation and feedback, allowing users to have an easy and more enjoyable travel experience.

[1015] The processing flow will be explained below.

[1016] Program processing steps

[1017] 1. Travel plan consultation and proposal

[1018] Step 1:

[1019] The user opens a smartphone app, website, or wearable device and enters their travel wishes.

[1020] Example: "I want to go to Okinawa."

[1021] Step 2:

[1022] The server receives the user's input and stores it as initial data.

[1023] Step 3:

[1024] The device will prompt the user with detailed questions such as "When would you like to travel?"

[1025] Step 4:

[1026] The user answers detailed questions (e.g., travel dates, budget, special interests, etc.).

[1027] Step 5:

[1028] The server analyzes the user's responses and collects information on available hotels, transportation options, and tourist attractions.

[1029] Step 6:

[1030] The server uses this data to generate and present the optimal travel plan.

[1031] Step 7:

[1032] The device displays the generated itinerary to the user.

[1033] For example: "Are you sure you want to go ahead with this plan?"

[1034] Step 8:

[1035] The user reviews and selects the plan.

[1036] 2. Processing and Confirmation of Bookings

[1037] Step 9:

[1038] The user selects the best suggested travel plan and begins the booking process.

[1039] Step 10:

[1040] The server processes hotel and transportation reservations based on the plan selected by the user.

[1041] Step 11:

[1042] The server generates confirmation information (reservation number, detailed schedule, fee, etc.) after the reservation is completed and sends it to the terminal.

[1043] Step 12:

[1044] The device will notify the user of the reservation completion confirmation and display details.

[1045] 3. Support and guidance on the day

[1046] Step 13:

[1047] The user activates the service on the day of travel and requests support.

[1048] Step 14:

[1049] The server obtains the user's location and status, predicts their next move, and prepares for it.

[1050] Step 15:

[1051] The device displays and navigates transfer directions and routes from your current location.

[1052] Step 16:

[1053] The device will provide information about tourist destinations the user will visit and recommended spots.

[1054] Step 17:

[1055] The server will provide real-time restaurant recommendations and flexible support depending on the user's situation.

[1056] 4. Post-trip feedback and improvements

[1057] Step 18:

[1058] A screen will be available for users to provide feedback after completing their trip.

[1059] Step 19:

[1060] The device displays a survey to the user, such as "Were you satisfied with your trip?"

[1061] Step 20:

[1062] Users complete surveys and provide feedback.

[1063] Step 21:

[1064] Analyze the feedback collected by our servers to identify areas for improvement of our services.

[1065] Step 22:

[1066] The server reflects the feedback results in future travel plan generation algorithms and support functions.

[1067] This allows users to plan and execute trips simply and efficiently, and businesses to enhance customer service.

[1068] Example 1

[1069] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1070] Today's travelers are expected to efficiently and smoothly complete the entire process, from planning to execution and feedback on their trips. In particular, there is a lack of systems that provide comprehensive support, from selecting and booking a travel destination, to on-site support, and even post-trip feedback. Furthermore, while local guides using real-time location information and multilingual interpretation functions are important elements for travelers, current systems do not adequately provide these features. This creates problems for travelers, resulting in the time and effort they waste during the planning and execution processes.

[1071] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1072] In this invention, the server includes a means for receiving travel requests from users, a means for generating an optimal travel plan, a means for booking accommodations and transportation based on the generated travel plan, a means for providing local navigation and tourist information, and a means for collecting user feedback and improving services. This allows travelers to easily receive comprehensive travel support, providing a more comfortable and efficient travel experience. Furthermore, by including a means for providing real-time guidance using the user's location information and a multilingual interpretation function, inconveniences at the travel destination can be eliminated, resulting in a more fulfilling trip.

[1073] "User" refers to a person who uses the system to assist in travel planning and execution.

[1074] "Preferences" refers to information about a user's travel-related requests, such as destination, schedule, and budget.

[1075] "Travel Plan" refers to a travel schedule generated based on the user's preferences, including details of accommodation, transportation, tourist attractions, etc.

[1076] "Reservation" refers to the process of reserving accommodation and transportation in advance based on travel plans.

[1077] "Navigation" refers to providing users with directions and transportation information to reach their destinations on-site.

[1078] "Tourist destination information" refers to data that includes details such as the destination's attractions, recommended spots, and how to get there.

[1079] "Feedback" refers to opinions provided by users after a trip regarding their satisfaction with the trip and areas for improvement.

[1080] "Real-time" refers to the immediate processing and delivery of data or information in the current time.

[1081] "Guide" refers to providing information and support that users need during their travels.

[1082] "Multilingual" refers to the ability to provide information in different languages ​​to users who speak different languages.

[1083] "Interpretation function" refers to the function of translating conversations and text between different languages.

[1084] "System" refers to the integrated set of hardware and software that generates travel plans, provides bookings, provides on-site support, and collects feedback.

[1085] This invention is an AI-based system that supports all travel processes, from trip planning and execution to feedback collection and service improvement. Users can make trip arrangements and receive on-site support through a smartphone app, website, or wearable device. The system consists of the following hardware and software:

[1086] Hardware

[1087] Server: A central server that processes information from users and generates travel plans. It is equipped with a high-performance processor and large memory capacity.

[1088] Terminal: A smartphone, PC, or wearable device that serves as the user interface and has communication capabilities to communicate with the server.

[1089] software

[1090] Application: A smartphone app or website interface that a user installs, collects user input, and sends it to a server.

[1091] Database: Stores detailed data on accommodation, transportation and tourist destinations.

[1092] Navigation system: A module that provides local directions and transit information.

[1093] Generative AI model: An AI model for generating optimal travel plans based on user preferences.

[1094] Data processing and calculation

[1095] The server analyzes the travel preference data received from the user and uses a generative AI model to create an optimal travel plan, which queries a database to gather detailed information such as accommodation, transportation, and tourist attractions, and then generates a plan that meets the user's requirements.

[1096] For example, if a user inputs "I want to go to Okinawa," the server receives this information and then obtains detailed conditions (e.g., dates, budget, interests, etc.). Based on this, it generates an optimal travel plan and presents it to the user. Once the user confirms the plan and completes the reservation, the server provides navigation information as on-site support on the day of the trip.

[1097] Specific use cases

[1098] For example, if a user inputs their desire to "go to Okinawa," the system will interactively obtain detailed requirements and propose the optimal travel plan. On the day of the trip, real-time route guidance and tourist information will be provided via smartphone, and in the case of overseas travel, an interpretation function will also be available to overcome language barriers. After the trip, feedback will be collected through a questionnaire, and the quality of the service will be improved based on this.

[1099] Prompt Sentence Examples

[1100] By inputting prompt sentences like the one below into the generative AI model, it is possible to create the optimal travel plan based on the user's wishes.

[1101] "Please create the best travel plan for Okinawa. The date is the last week of June, and the budget is within 100,000 yen. Please propose a plan that includes information on accommodation, transportation, and tourist attractions."

[1102] To implement this invention, various hardware and software such as servers, terminals, applications, databases, navigation systems, and generative AI models must be appropriately combined to provide consistent travel support based on user preferences, allowing travelers to comfortably navigate the entire process from planning to execution.

[1103] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1104] Step 1:

[1105] The user launches a smartphone app, website, or wearable device. The user inputs a request, such as "I want to go to Okinawa." The request is sent from the device to the server.

[1106] Input: User's travel wishes (e.g., "I want to go to Okinawa")

[1107] Output: Travel preference data received by the server

[1108] Step 2:

[1109] The server receives the user's input and generates a question asking the user for additional detailed conditions, which is then sent to the terminal.

[1110] Input: Travel preference data received by the server

[1111] Output: A question asking for detailed conditions to be sent to the device (e.g., "When are your travel dates?", "What is your budget?")

[1112] Step 3:

[1113] The terminal displays the questions received from the server to the user, who then enters detailed conditions such as dates and budget and submits the request.

[1114] Input: Questions asking for detailed conditions from the server

[1115] Output: User's detailed condition response (e.g., "Last week of June", "Budget is within 100,000 yen")

[1116] Step 4:

[1117] The server searches the database to collect the necessary data based on the detailed conditions received from the user, and the generative AI model then generates the optimal travel plan based on the collected data.

[1118] Input: User's detailed condition data

[1119] Output: Optimal itinerary (e.g., list of accommodations, transportation options, and tourist attractions)

[1120] Step 5:

[1121] The server sends the generated travel plan to the terminal, which displays the proposed plan to the user and asks for confirmation.

[1122] Input: Optimal travel plan data

[1123] Output: A plan confirmation message to the user displayed on the device (e.g., "Are you sure you want to proceed with this plan?")

[1124] Step 6:

[1125] The user confirms the proposed travel plan and selects "Yes." The selected plan is sent from the device to the server.

[1126] Input: Confirmation of travel plan selected by user

[1127] Output: User selection data sent to the server

[1128] Step 7:

[1129] The server processes the reservation requests for accommodation and transportation based on the user's selected plan. After each reservation is completed, reservation details are generated.

[1130] Input: Travel plan information selected by the user

[1131] Output: Reservation confirmation information (e.g. reservation number, date, price)

[1132] Step 8:

[1133] The server sends the reservation confirmation information to the terminal, which displays the reservation details to the user.

[1134] Input: Reservation confirmation information

[1135] Output: Reservation details displayed on the device (e.g., accommodation name, check-in date, price)

[1136] Step 9:

[1137] On the day of the trip, the user launches the application again. The server uses the GPS to obtain the user's current location and checks the trip schedule.

[1138] Input: User application launch, current location information

[1139] Output: Real-time support data based on travel schedule and current location

[1140] Step 10:

[1141] The device displays directions and tourist information to the user based on real-time support data from the server.

[1142] Input: Real-time support data

[1143] Output: Directions information, tourist spot information (e.g., route from current location to tourist spot, recommended spots)

[1144] Step 11:

[1145] After the trip is over, the device displays a survey asking for feedback from the user, who then enters and submits the feedback.

[1146] Input: Feedback Survey

[1147] Output: User feedback data (e.g., satisfaction, areas for improvement)

[1148] Step 12:

[1149] The server collects feedback data from users and analyzes it to improve the service, and then refines the algorithm for generating future travel plans.

[1150] Input: User feedback data

[1151] Output: Analysis results and algorithm improvements based on them

[1152] (Application example 1)

[1153] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1154] There is a need to eliminate the complexity of travel planning and the inconvenience of being on-site, allowing users to plan and execute trips more easily and enjoyably. In particular, it is important to enable users to experience their destinations in advance through a virtual environment at home, allowing them to more concretely imagine and select their actual travel plans. In addition, a system is needed to collect feedback after the trip and improve the accuracy of future travel plans.

[1155] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1156] In this invention, the server includes means for receiving travel requests from a user, means for generating an optimal travel plan, and means for reserving accommodations and transportation based on the generated travel plan, thereby providing a simulated travel destination experience within a virtual environment and enabling users to reserve travel plans from the virtual environment.

[1157] "User" refers to a person who plans, makes reservations, and receives on-site support through this system.

[1158] "Preferences" refers to the travel requests, such as the travel destination, itinerary, and budget, proposed by the user.

[1159] "Travel plan" refers to a plan generated based on the user's preferences, including suggestions for accommodation, transportation, tourist attractions, etc.

[1160] "Accommodation" refers to hotels, inns, and other lodging facilities where users can stay at their travel destinations.

[1161] "Transportation" refers to the means of transportation, such as trains, buses, and airplanes, that users use to travel to their travel destinations.

[1162] "Route guidance" refers to a service that tells users the best route to their destination on the day of their trip.

[1163] "Tourist destination guide" refers to a service that provides information about tourist destinations and recommended spots that users visit.

[1164] "Feedback" refers to opinions and impressions collected from users after the trip has ended.

[1165] "Service improvement" refers to improving systems and proposal processes based on collected feedback.

[1166] A "virtual environment" refers to a computer-generated virtual space that simulates a real-life travel destination.

[1167] A "simulation experience" refers to an experience that allows users to test-visit real-world travel destinations within a virtual environment.

[1168] "Reservation" refers to the act of a user reserving accommodation and transportation based on a travel plan.

[1169] The present invention is an AI-based travel assistance system that supports everything from trip planning to execution, feedback collection, and service improvement. Specific embodiments of this system are described below.

[1170] System Overview

[1171] The system of this invention mainly consists of a server, a terminal, and a user. The server receives requests from the user and generates and provides the optimal travel plan. The terminal refers to a smartphone or a head-mounted display (HMD), through which the user interacts with the system.

[1172] Initial settings and obtaining user preferences

[1173] When a user starts up the device, the server generates questions to obtain basic information such as the travel destination, desired dates, and budget, and sends them to the device. The device displays these questions to the user, who then enters conditions such as "I want to go to Okinawa" and "The last week of June, budget within 100,000 yen." This allows the server to receive the user's basic preferences.

[1174] Generate a travel plan

[1175] The server generates an optimal travel plan from its internal database based on the received requests. This plan includes accommodation, transportation, and tourist attractions, and is presented to the user via the terminal. Once the user confirms and accepts the plan, the reservation process begins.

[1176] Reservation Processing

[1177] The server will make reservations for the relevant accommodations and transportation based on the plan selected by the user. Once the reservation is complete, a reservation number and detailed information will be generated and sent to the terminal. The terminal will display this to the user and help them prepare for the day of their trip.

[1178] Local support and virtual environments

[1179] On the day of the trip, the user restarts the device, and the server retrieves the user's current location and travel schedule. The device displays real-time route directions, transfer information, and tourist spot information. A simulation experience is also provided within the virtual environment, allowing users to virtually experience tourist spots and accommodations before actually visiting them.

[1180] Feedback and Service Improvement

[1181] After the trip is completed, the system asks the user for feedback. The user answers a questionnaire via their device, and the server collects and analyzes the feedback. Based on the results of this analysis, the system improves the algorithm for generating future travel plans and enhances the quality of the service.

[1182] Hardware and software used

[1183] Hardware: Smartphone, Head-Mounted Display (HMD)

[1184] Software: Flask (API server construction), JSON (data management), database (travel destination information management)

[1185] Examples and prompts

[1186] For example, if a user inputs their desire to "go to Tokyo," the system will provide a virtual tour experience of Tokyo's tourist attractions, accommodations, and transportation options. Using the HMD, users can visit tourist spots such as Sensoji Temple, Roppongi Hills, and Disneyland in advance.

[1187] Example prompt sentence:

[1188] The user has entered a desire to "go to Okinawa." The system processes the user's request through the following steps:

[1189] 1. Receive user input.

[1190] 2. Generate a travel plan based on the specified location.

[1191] 3. Present the generated plan to the user.

[1192] 4. The user checks the plan and makes a reservation.

[1193] 5. Send the reservation details to the user.

[1194] Please suggest the following travel destination: [Tokyo, Osaka, Kyoto]

[1195] In this way, the system of the present invention comprehensively supports everything from trip planning and execution to feedback collection and even advance experience of travel destinations through a virtual environment.

[1196] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1197] Step 1:

[1198] The user starts up the device and inputs their desired travel destination, schedule, budget, etc. The user's input is sent to the server by the device. Specifically, the user inputs "I want to go to Okinawa" and "The last week of June, budget is within 100,000 yen," and the data is transferred from the device to the server. The input data is sent to the server in JSON format, and the server receives the data.

[1199] Step 2:

[1200] The server analyzes the user's input data and generates a travel plan based on their preferences. At this time, the server searches its internal database to select the most suitable accommodations, transportation options, tourist attractions, etc. Specifically, the server executes the search query and generates a travel plan for "Okinawa." The output is JSON data for the travel plan, which includes a list of accommodations, transportation options, and tourist attractions.

[1201] Step 3:

[1202] The server sends the generated travel plan to the terminal, which then displays it to the user. The user selects the plan they prefer from the presented plans. Specifically, the travel plan is displayed in list format on the terminal screen, and the user selects "Hotel A," "Tourist Spot B," etc. by clicking on it. The input is the user's selection information, and the output is JSON data of the selected plan.

[1203] Step 4:

[1204] Based on the plan selected by the user, the server sends a reservation request for accommodation and transportation. The server processes each reservation according to the plan and generates a reservation number and detailed information. Specifically, the server calls the reservation API, confirms the reservation at "Hotel A," and generates a reservation number. The input is the user's selection information, and the output is JSON data of the reservation details (reservation number, dates, price, etc.).

[1205] Step 5:

[1206] The server sends reservation confirmation information to the terminal, and the terminal displays the reservation completion details to the user. Specifically, the reservation completion screen is displayed on the terminal, and detailed information (e.g. reservation number 123456, hotel A, price 80,000 yen) is presented. The input is the reservation confirmation data from the server, and the output is the detailed information displayed on the terminal screen.

[1207] Step 6:

[1208] On the day of travel, the user restarts the device, and the server obtains the user's current location and travel schedule. The device then displays route and transfer information in real time. Specifically, the device's GPS function is used to obtain the current location, and the server calls the map API to provide route guidance. The input is current location data, and the output is route guidance information.

[1209] Step 7:

[1210] After the trip, the server sends a questionnaire to the device requesting feedback, and the device displays the questionnaire to the user. The user enters and submits the feedback. Specifically, the device displays a questionnaire screen, and the feedback entered by the user is sent to the server. The input is the user's feedback data, and the output is analysis data stored on the server.

[1211] Step 8:

[1212] The server analyzes the collected feedback data and processes it to improve the service. This data is used to improve the travel plan generation algorithm for future trips. Specifically, the server aggregates the feedback data and builds new plan generation logic through an analytical algorithm. The input is the feedback data, and the output is an improved plan generation algorithm.

[1213] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1214] System Overview

[1215] This invention is an AI-based system that supports all travel-related processes, from trip planning and execution to collecting feedback and improving services. Its unique feature is that it combines an emotion engine that recognizes users' emotions to provide customized travel support based on their emotional state. Users can access travel arrangements and on-site support through a smartphone app, website, or wearable device.

[1216] Initial settings and obtaining user preferences

[1217] A user launches an app, website, or wearable device and the system first asks the user for basic information, such as their travel destination, desired dates, and budget.

[1218] The user types, "I want to go to Okinawa."

[1219] The server receives this information and then generates questions to obtain detailed conditions (e.g., schedule, budget, interests, etc.) and sends them to the terminal.

[1220] The device prompts the user with specific questions.

[1221] The user answers, "The last week of June, my budget is under 100,000 yen."

[1222] Emotion Recognition and Travel Plan Generation

[1223] The server searches the database based on the conditions obtained from the user and generates the optimal travel plan.

[1224] The emotion engine analyzes the user's facial expressions, voice, and input actions to determine their current emotional state.

[1225] The travel plan generated by the server is compared with the analysis results of the emotion engine to select the plan that best suits the user's emotional state.

[1226] The server sends the selected plan to the device.

[1227] The device will prompt the user, "Are you sure you want to proceed with this plan?"

[1228] The user reviews the plan and selects "Yes."

[1229] Reservation Processing

[1230] The server processes the reservation request for the relevant accommodation and transportation based on the plan selected by the user.

[1231] Upon completion of each reservation, reservation details (e.g. reservation number, dates, price, etc.) are generated.

[1232] The server sends the reservation confirmation information to the terminal.

[1233] The device will display the details of the completed booking to the user.

[1234] Local support

[1235] On the day of travel, the user simply launches the application again and the system begins providing real-time support.

[1236] The server obtains the user's current location and travel schedule.

[1237] The device displays real-time directions, transfer information, and tourist information.

[1238] The emotion engine continues to monitor the user's current emotional state and provides more friendly guidance or additional support if it determines they are feeling anxious or stressed.

[1239] When users visit tourist spots, the system provides additional information and recommendations.

[1240] Based on the emotion engine's judgment, the device may also make special suggestions to boost the user's mood.

[1241] Feedback and Service Improvement

[1242] After the trip is completed, the system asks the user to provide feedback.

[1243] The device displays a survey such as "Were you satisfied with your trip?"

[1244] The user enters and submits feedback.

[1245] The server collects feedback data and analyzes it to improve the service.

[1246] The emotion engine analyzes the user's emotional state at the time of feedback and evaluates the content of the feedback from an emotional perspective.

[1247] Based on the analysis results, the server improves the entire system, including the emotion engine, and reflects this in the travel plan generation algorithm for future trips.

[1248] Specific use cases

[1249] For example, if a user inputs their desire to "go to Okinawa," the system will obtain detailed conditions through a dialogue. On the day of the trip, real-time route guidance and tourist information will be provided via smartphone, and if the emotion engine detects anxiety or stress, special support will be offered. For overseas trips, an interpretation function is also available to overcome language barriers. After the trip, feedback will be collected through a questionnaire, and the quality of the service will be improved based on the analysis results of the emotion engine.

[1250] In this way, the present invention is a system that comprehensively supports travel from planning to implementation and feedback, and in particular provides customized services that take into account the user's emotional state, allowing users to have an easy and more enjoyable travel experience.

[1251] The processing flow will be explained below.

[1252] Specific processing steps of the program

[1253] 1. Travel plan consultation and proposal

[1254] Step 1:

[1255] The user opens a smartphone app, website, or wearable device and enters their travel wishes.

[1256] Example: "I want to go to Okinawa."

[1257] Step 2:

[1258] The server receives the user's input and stores it as initial data.

[1259] Step 3:

[1260] The terminal displays a question to the user asking for detailed conditions, such as "When would you like to travel?"

[1261] Step 4:

[1262] The user answers detailed criteria (e.g., travel dates, budget, special interests, etc.).

[1263] Step 5:

[1264] The server analyzes the user's responses and collects information on available accommodation, transportation options, and tourist destinations.

[1265] Step 6:

[1266] The server activates an emotion engine that analyzes the user's facial expressions and tone of voice while they are typing to determine their emotional state.

[1267] Step 7:

[1268] The server generates and presents optimal travel plans based on the collected data and emotional state.

[1269] Step 8:

[1270] The terminal displays the generated travel plan to the user.

[1271] For example: "Are you sure you want to go ahead with this plan?"

[1272] Step 9:

[1273] The user checks the plan and selects it.

[1274] 2. Processing and Confirmation of Bookings

[1275] Step 10:

[1276] The user selects the most suitable travel plan from the suggestions and begins the booking process.

[1277] Step 11:

[1278] The server processes reservations for accommodation and transportation based on the plan selected by the user.

[1279] Step 12:

[1280] The server generates confirmation information (reservation number, detailed schedule, fee, etc.) after the reservation is completed and sends it to the terminal.

[1281] Step 13:

[1282] The terminal notifies the user of the reservation completion confirmation and displays the details.

[1283] 3. Support and guidance on the day

[1284] Step 14:

[1285] The user activates the service on the day of travel and requests support.

[1286] Step 15:

[1287] The server obtains the user's location and status, predicts their next move, and prepares for it.

[1288] Step 16:

[1289] The device displays and navigates transfer directions and routes from your current location.

[1290] Step 17:

[1291] The device provides information about tourist destinations the user is visiting and recommended spots.

[1292] Step 18:

[1293] The server uses an emotion engine to monitor the user's real-time emotional state, and if the user feels anxious or stressed, it provides more friendly guidance or additional support.

[1294] Step 19:

[1295] The server will introduce restaurants and provide flexible support in real time depending on the user's situation.

[1296] 4. Post-trip feedback and improvements

[1297] Step 20:

[1298] A screen is provided for users to provide feedback after completing their trip.

[1299] Step 21:

[1300] The terminal displays a questionnaire to the user, such as "Were you satisfied with your trip?"

[1301] Step 22:

[1302] Users complete surveys and provide feedback.

[1303] Step 23:

[1304] Analyze the feedback collected by our servers to identify areas for improvement of our services.

[1305] Step 24:

[1306] The server uses an emotion engine to analyze the user's emotional state at the time of feedback and reflects it in the next travel plan.

[1307] Step 25:

[1308] Based on the analysis results, the server reflects the feedback results in the travel plan generation algorithm and support functions.

[1309] This allows users to plan and carry out trips simply and efficiently, and companies can improve the quality of their customer service. The introduction of the emotion engine provides customized support according to the user's emotional state, resulting in a more fulfilling travel experience.

[1310] Example 2

[1311] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1312] Conventional travel support systems provide basic functions such as generating travel plans based on user preferences, booking, and on-site support, but they lack customization based on the user's emotional state, which leads to a lack of user satisfaction. Furthermore, services are typically improved after collecting feedback, making it difficult to provide real-time support and support.

[1313] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for receiving travel requests from a user, a means for generating an optimal travel plan, a means for booking accommodations and transportation, a means for providing on-site directions and tourist information, a means for recognizing the user's emotional state and providing a customized travel plan, and a means for collecting feedback and improving services. This makes it possible to provide a customized travel plan and real-time support based on the user's emotional state.

[1314] "User" refers to an individual or group who uses the system to plan their trip or receive on-site support.

[1315] "Preferences" refers to travel requests and conditions such as destination, schedule, budget, and interests that users input into the system.

[1316] "Travel Plan" refers to the optimal travel proposal including tourist attractions, accommodation, transportation, schedule, etc.

[1317] "Emotional state" refers to the psychological state and mood that is analyzed from the user's facial expressions, voice, input actions, etc.

[1318] "Customization" refers to the adjustment and modification of travel plans and services provided to suit the user's individual wishes and emotional state.

[1319] "Feedback" refers to information such as ratings, opinions, and comments collected from users after their trip.

[1320] "Server" refers to the computer system that runs the entire system and performs core functions such as generating travel plans, processing reservations, and analyzing sentiment.

[1321] "Terminal" refers to devices such as smartphones, tablets, PCs, and wearable devices that users use to operate the system.

[1322] "Real-time guidance" refers to support such as route guidance, transfer information, and tourist information that is provided instantly based on the user's current location and situation.

[1323] "Multilingual interpretation function" refers to a function that translates between different languages ​​so that users can receive support in their local language while traveling abroad.

[1324] The present invention is an AI-based system that generates an optimal travel plan based on a user's preferences when planning a trip, provides real-time assistance during the trip, and collects feedback after the trip to improve services. Specific embodiments of this system are described below.

[1325] Hardware and software used

[1326] This system uses devices such as smartphones, tablets, PCs, and wearable devices to receive user operations. The server is used to operate the system and perform core functions such as generating travel plans, processing reservations, and analyzing emotions. The emotion engine is an AI model used to analyze the user's emotional state from their facial expressions, voice, and input actions. This emotion engine collects data using a facial recognition camera and microphone.

[1327] System Overview

[1328] The system includes the following means:

[1329] A method for receiving travel requests from users: Users input their travel destination, schedule, budget, and other requests into their terminal.

[1330] Means for generating an optimal travel plan based on preferences: A server receives input information and searches a database to generate an optimal travel plan.

[1331] A means for reserving accommodation and transportation: The server reserves accommodation and transportation based on the selected travel plan.

[1332] A means of providing local directions and tourist information: The device provides real-time guidance services based on the user's location information while traveling.

[1333] A means of recognizing emotional states and providing customized itineraries: The emotion engine monitors the user's emotional state and optimizes the itinerary and guidance content according to the emotions.

[1334] A means of collecting feedback and improving services: Feedback is collected after the trip is completed and used to improve the entire system.

[1335] Examples of specific examples and prompts

[1336] When a user wants to plan a trip, they might enter the following prompt into their terminal:

[1337] "I'd like to make travel plans. I'd like to go to Okinawa. Do you have any plans for the last week of June? My budget is within 100,000 yen. Also, please let me know about the local support functions."

[1338] A server receiving this prompt should process it as follows:

[1339] First, the system receives the user's desired information, then generates additional questions based on that information to ask for more detailed information. These questions are then sent to the terminal, where the user can enter their details.

[1340] Based on the details entered, the server uses an emotion engine to analyze the user's emotional state, for example by analyzing the user's facial expressions and tone of voice using a facial recognition camera and a voice recognition microphone.

[1341] Combining the results of the sentiment analysis with the user's requirements, the server generates an optimal travel plan from its database, including parameters such as accommodation, flight information, and tourist spot suggestions.

[1342] The travel plans generated in this way are then compared with the results of the emotion engine to select the most suitable one and send it to the device, which then displays a confirmation message asking, "Are you sure you want to proceed with this plan?"

[1343] Feedback is collected and real-time guidance and support is provided, including multilingual interpretation.

[1344] In this way, the present invention is a system that provides a customized travel experience that takes into account the user's emotional state and realizes service improvement through real-time assistance and feedback.

[1345] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1346] Step 1: Initial setup and obtaining user preferences

[1347] The user starts up the device and starts planning a trip. Input: Basic information such as travel destination (e.g., "I want to go to Okinawa"), schedule, and budget.

[1348] The server receives the input information and then generates questions to obtain more detailed conditions. Examples include questions like "What are your travel dates?" and "What is your budget?"

[1349] The server generates a question and sends it to the terminal.

[1350] The device displays the question to the user. Output: The options "What are your travel dates?"

[1351] The user enters detailed information (e.g., "last week of June" and "budget within 100,000 yen").

[1352] Step 2: Emotion recognition and itinerary generation

[1353] The server searches the database based on the conditions obtained from the user and generates the optimal travel plan. Input: Detailed information (travel destination, schedule, budget, etc.). Data processing: Search the database and generate the optimal travel plan. Output: Candidate travel plans.

[1354] The server starts the emotion engine and analyzes the user's facial expressions, voice, and input actions to determine the current emotional state. Input: facial expression images, voice data. Data calculation: analysis of emotional state. Output: analysis results (relief, anxiety, excitement, etc.).

[1355] The travel plan generated by the server is compared with the analysis results of the emotion engine to select the plan that best suits the user's emotional state. Input: Travel plan candidates and emotion analysis results. Data processing: Selection of the optimal plan. Output: Optimal travel plan.

[1356] The server sends the selected plan to the device.

[1357] The device will ask the user for confirmation: "Are you sure you want to proceed with this plan?" Output: Confirmation message.

[1358] The user reviews the plan and selects "Yes."

[1359] Step 3: Reservation Processing

[1360] The server processes the reservation request for accommodation and transportation based on the plan selected by the user. Input: Selected travel plan. Data processing: Sending the request to the reservation system.

[1361] Once each reservation is completed, details such as the associated reservation number, dates, and price are generated. Output: Reservation confirmation information.

[1362] The server sends the reservation confirmation information to the terminal.

[1363] The terminal displays the reservation completion details to the user. Output: Reservation confirmation message.

[1364] Step 4: Local support

[1365] The user launches the application again on the day of travel.

[1366] The server obtains the user's current location information and travel schedule and starts real-time support. Input: Current location information. Data processing: Preparation for real-time support. Output: Support information.

[1367] The terminal displays real-time route guidance, transfer information, tourist information, etc. Output: Real-time guidance message.

[1368] The server continues to run the emotion engine and monitors the user's current emotional state. Input: facial expression, voice, and movement data. Data calculation: real-time emotion analysis. Output: emotion analysis results.

[1369] If anxiety or stress is detected, the server will provide more friendly guidance or additional support. Input: Sentiment analysis results. Data processing: Generation of additional support. Output: Additional guidance message.

[1370] When a user visits a tourist spot or restaurant, the server provides additional information and recommended spots. Input: Data of visited places. Data processing: Generation of additional information. Output: Recommended information.

[1371] The device will make special suggestions to boost the user's mood based on the emotion engine's judgment. Output: Special suggestion message.

[1372] Step 5: Feedback and Service Improvement

[1373] After the trip ends, the device displays a survey such as, "Were you satisfied with your trip?"

[1374] The user enters and submits feedback. Input: Feedback data. Output: Feedback message.

[1375] The server collects feedback data and analyzes it to improve the service. Input: Feedback data. Data processing: Feedback analysis. Output: Analysis results.

[1376] The server improves the service based on the sentiment analysis results and reflects them in future travel plan generation. Input: Analysis results. Data processing: Algorithm improvement. Output: Improved travel plan generation algorithm.

[1377] Through the above steps, the present invention is a system that provides a customized travel experience based on the user's emotional state and realizes service improvement through real-time assistance and feedback.

[1378] (Application example 2)

[1379] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1380] Conventional travel support systems are limited to generating itineraries based on user-specified criteria and providing basic on-site support. However, they lack the ability to respond to users' emotional states and real-time needs, and do not provide sufficient personalized support, especially during the shopping experience in physical stores. Therefore, there is a need for systems that can reduce the inconvenience and stress users experience while traveling or shopping in physical stores and provide more satisfying support.

[1381] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving travel requests from a user, means for generating an optimal travel plan, means for booking accommodations and transportation based on the generated travel plan, means for providing local route guidance and tourist information on the day of the trip, means for analyzing the user's emotional state in real time during the trip and providing customized support based thereon, means for collecting user feedback after the trip and improving services, means for providing real-time guidance using the user's location information and emotional state, and means for recommending products and providing special support based on the emotional analysis when the user shops in physical stores during the trip. This makes it possible to provide customized support according to the user's emotional state and meet real-time needs.

[1382] The "means for receiving travel requests from users" refers to an interface through which users input information such as desired travel destination, schedule, budget, etc., and the system receives that information.

[1383] A "means for generating an optimal travel plan" is an algorithm or process for automatically designing an optimal travel plan for a user based on travel data collected from the user.

[1384] "Means for reserving accommodation and transportation based on the generated travel plan" is a function for automatically reserving accommodation and transportation based on the travel plan generated by the system.

[1385] "Means of providing local directions and tourist information on the day of travel" is a function that provides real-time directions to the destination and tourist information when travelers arrive at their travel destination.

[1386] "Means of analyzing the user's emotional state in real time while traveling and providing customized support based on that" refers to algorithms and sensor technology that analyzes the user's facial expressions and behavior to recognize their emotions and provide optimal support and suggestions based on that state.

[1387] "Means of collecting user feedback after the trip and improving services" refers to the process of collecting impressions and opinions from users after the trip and using that data to improve the quality of services.

[1388] "Means for providing real-time guidance using the user's location information and emotional state" refers to technology that tracks the user's current location and emotional state in real time and provides optimal information and guidance based on that.

[1389] "A means of providing product recommendations and special support based on emotional analysis when users shop in physical stores while traveling" is a function that analyzes the user's emotional state while shopping in a store and provides optimal product recommendations and additional support.

[1390] System configuration

[1391] This invention is a system that uses emotion analysis to provide product recommendations and special support when a user is shopping at a physical store while traveling. Specifically, it has the following configuration.

[1392] A method for receiving travel requests from users: Users input desired information such as travel destination, schedule, budget, etc. using a smartphone or computer. This information is received by the server and stored in a database.

[1393] Means for generating optimal travel plans: The server uses an algorithm to generate optimal travel plans based on the received desired information. The generated plans include information on accommodations, transportation, and tourist spots.

[1394] A means for reserving accommodation and transportation based on the generated travel plan: The server automatically reserves accommodation and transportation based on the generated travel plan. The reservation details are sent to the user's terminal.

[1395] A method for providing local route guidance and tourist information on the day of travel: On the day of travel, users launch the application on their smartphones. The server provides real-time route guidance and tourist information.

[1396] A means of analyzing the user's emotional state in real time while traveling and providing customized support based on that: The server performs emotional analysis through the user's camera and microphone, analyzing the user's facial expressions, voice, and behavioral data to determine the user's emotional state.

[1397] A means to collect user feedback after the trip and improve the service: After the trip is over, the application displays a questionnaire to the user and collects their feedback. The server analyzes this information and uses it to improve the service.

[1398] A method for providing real-time guidance using the user's location information and emotional state: The server provides real-time guidance information based on the user's location information and emotional state. Location information is obtained using technologies such as GPS.

[1399] A means of providing product recommendations and special support based on sentiment analysis when users shop in physical stores while traveling: When users shop in stores, the server recommends products and provides special support based on the results of sentiment analysis.

[1400] System Operation

[1401] 1. Initial Setup:

[1402] The server receives the desired information from the user and stores it in a database.

[1403] The server uses an algorithm to generate an optimal travel plan and makes reservations for accommodation and transportation.

[1404] 2. On the day of travel:

[1405] The server monitors the user's location and emotional state in real time and provides appropriate guidance and tourist information.

[1406] An emotion analysis engine collects data from the user's camera and microphone to determine their emotional state.

[1407] 3. In-store shopping support:

[1408] When a user shops in a store, the server recommends products based on the results of sentiment analysis.

[1409] Provide special assistance as needed (e.g., providing coupons, directing store associates).

[1410] 4. After the trip:

[1411] The server collects feedback from users and analyzes the content using a sentiment analysis engine.

[1412] The analysis results will be used to improve services.

[1413] Specific examples

[1414] If a user selects "Okinawa" as their travel destination, the server will generate a travel plan and make reservations for accommodation and flights. When the user goes shopping at a physical store during their trip, the server will analyze the user's emotions through cameras and microphones and recommend appropriate products. It will also provide special support if it detects stress or anxiety. After the trip, feedback will be collected through a survey to help improve the service.

[1415] Example prompt for a generative AI model:

[1416] "We are developing a smartphone app that uses an emotion engine to analyze users' emotions in real time when they enter a physical store and provides appropriate support and product information. When a user is in a happy mood, the system will recommend products that they might be interested in, and when they are anxious, it will provide friendly guidance. Please tell us the specific requirements for the use scenarios and functions of this app."

[1417] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1418] Step 1:

[1419] The user inputs their desired travel destination, itinerary, budget, etc. into their smartphone or PC. The device then sends this data to the server. The input is the user's desired information (destination, itinerary, budget), and the output is the desired information that is saved on the server.

[1420] Step 2:

[1421] The server generates an optimal travel plan based on the received information. It uses an algorithm to search a database of accommodations, transportation options, and tourist attractions to select the optimal combination. The input is the user's desired information, and the output is the generated travel plan.

[1422] Step 3:

[1423] The server makes reservations for accommodation and transportation based on the generated itinerary. It communicates with the reservation system via API and automatically makes the necessary reservations. The input is the generated itinerary, and the output is reservation confirmation information.

[1424] Step 4:

[1425] On the day of the trip, the user launches the app on their smartphone. The server obtains the user's location information and travel schedule in real time and provides route guidance and tourist information. The inputs are the user's location information and travel schedule, and the output is real-time guidance information.

[1426] Step 5:

[1427] The server analyzes the user's emotional state in real time through a camera and microphone. The emotion analysis engine recognizes facial expressions and analyzes voice to determine the user's emotional state. The input is the user's facial expression data and voice data, and the output is the analyzed emotional state.

[1428] Step 6:

[1429] The server provides customized support based on the analysis results. When users shop in physical stores, product recommendations and special support (e.g., coupons and sales assistant guidance) are provided. The inputs are the analyzed emotional state and a product database, and the output is recommended product information and special support.

[1430] Step 7:

[1431] After the trip, the app displays a feedback questionnaire for the user. The feedback entered by the user is sent to the server. Based on this data, the server analyzes the feedback using a sentiment analysis engine and uses it to improve the service. The input is the user's feedback information, and the output is the analysis results and improvement data.

[1432] Step 8:

[1433] The server integrates all feedback and sentiment analysis results and reflects them in future itinerary generation algorithms and in-store support customization. The input is the integrated feedback data, and the output is an improved service algorithm.

[1434] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1435] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1436] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1437] [Fourth embodiment]

[1438] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1439] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1440] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1441] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1442] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1443] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1444] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1445] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1446] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1447] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1448] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1449] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1450] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1451] System Overview

[1452] The invention is an AI-based system that supports the entire travel process, from trip planning and execution to collecting feedback and improving services. Users can access travel arrangements and on-site support through a smartphone app, website, or wearable device.

[1453] Initial settings and obtaining user preferences

[1454] A user launches an app, website, or wearable device and the system first asks the user for basic information, such as their travel destination, desired dates, and budget.

[1455] The user types, "I want to go to Okinawa."

[1456] The server receives this information and then generates questions to obtain detailed conditions (e.g., schedule, budget, interests, etc.) and sends them to the terminal.

[1457] The device prompts the user with specific questions.

[1458] The user answers, "The last week of June, my budget is under 100,000 yen."

[1459] Generate a travel plan

[1460] The server searches the database based on the conditions obtained from the user and generates the optimal travel plan.

[1461] The plan includes potential accommodation, transportation options and tourist destinations.

[1462] The server sends the generated plan to the terminal.

[1463] The device will prompt the user, "Are you sure you want to proceed with this plan?"

[1464] The user reviews the plan and selects "Yes."

[1465] Reservation Processing

[1466] The server processes the reservation request for the relevant accommodation and transportation based on the plan selected by the user.

[1467] Upon completion of each reservation, reservation details (e.g. reservation number, dates, price, etc.) are generated.

[1468] The server sends the reservation confirmation information to the terminal.

[1469] The device will display the details of the completed booking to the user.

[1470] Local support

[1471] On the day of travel, the user simply launches the application again and the system begins providing real-time support.

[1472] The server obtains the user's current location and travel schedule.

[1473] The device displays real-time directions, transfer information, and tourist information.

[1474] When users visit tourist spots, the system provides additional information and recommendations.

[1475] Feedback and Service Improvement

[1476] After the trip is completed, the system asks the user to provide feedback.

[1477] The device displays a survey such as "Were you satisfied with your trip?"

[1478] The user enters and submits feedback.

[1479] The server collects feedback data and analyzes it to improve the service.

[1480] The server uses the analysis results to improve the algorithm for generating travel plans for future trips.

[1481] Specific use cases

[1482] For example, if a user inputs their desire to "go to Okinawa," the system will interactively obtain detailed requirements and propose the optimal travel plan. On the day of the trip, real-time route guidance and tourist information will be provided via smartphone, and in the case of overseas travel, an interpretation function will also be available to overcome language barriers. After the trip, feedback will be collected through a questionnaire, and the quality of the service will be improved based on this.

[1483] In this way, the present invention is a system that comprehensively supports travel from planning to implementation and feedback, allowing users to have an easy and more enjoyable travel experience.

[1484] The processing flow will be explained below.

[1485] Program processing steps

[1486] 1. Travel plan consultation and proposal

[1487] Step 1:

[1488] The user opens a smartphone app, website, or wearable device and enters their travel wishes.

[1489] Example: "I want to go to Okinawa."

[1490] Step 2:

[1491] The server receives the user's input and stores it as initial data.

[1492] Step 3:

[1493] The device will prompt the user with detailed questions such as "When would you like to travel?"

[1494] Step 4:

[1495] The user answers detailed questions (e.g., travel dates, budget, special interests, etc.).

[1496] Step 5:

[1497] The server analyzes the user's responses and collects information on available hotels, transportation options, and tourist attractions.

[1498] Step 6:

[1499] The server uses this data to generate and present the optimal travel plan.

[1500] Step 7:

[1501] The device displays the generated itinerary to the user.

[1502] For example: "Are you sure you want to go ahead with this plan?"

[1503] Step 8:

[1504] The user reviews and selects the plan.

[1505] 2. Processing and Confirmation of Bookings

[1506] Step 9:

[1507] The user selects the best suggested travel plan and begins the booking process.

[1508] Step 10:

[1509] The server processes hotel and transportation reservations based on the plan selected by the user.

[1510] Step 11:

[1511] The server generates confirmation information (reservation number, detailed schedule, fee, etc.) after the reservation is completed and sends it to the terminal.

[1512] Step 12:

[1513] The device will notify the user of the reservation completion confirmation and display details.

[1514] 3. Support and guidance on the day

[1515] Step 13:

[1516] The user activates the service on the day of travel and requests support.

[1517] Step 14:

[1518] The server obtains the user's location and status, predicts their next move, and prepares for it.

[1519] Step 15:

[1520] The device displays and navigates transfer directions and routes from your current location.

[1521] Step 16:

[1522] The device will provide information about tourist destinations the user will visit and recommended spots.

[1523] Step 17:

[1524] The server will provide real-time restaurant recommendations and flexible support depending on the user's situation.

[1525] 4. Post-trip feedback and improvements

[1526] Step 18:

[1527] A screen will be available for users to provide feedback after completing their trip.

[1528] Step 19:

[1529] The device displays a survey to the user, such as "Were you satisfied with your trip?"

[1530] Step 20:

[1531] Users complete surveys and provide feedback.

[1532] Step 21:

[1533] Analyze the feedback collected by our servers to identify areas for improvement of our services.

[1534] Step 22:

[1535] The server reflects the feedback results in future travel plan generation algorithms and support functions.

[1536] This allows users to plan and execute trips simply and efficiently, and businesses to enhance customer service.

[1537] Example 1

[1538] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1539] Today's travelers are expected to efficiently and smoothly complete the entire process, from planning to execution and feedback on their trips. In particular, there is a lack of systems that provide comprehensive support, from selecting and booking a travel destination, to on-site support, and even post-trip feedback. Furthermore, while local guides using real-time location information and multilingual interpretation functions are important elements for travelers, current systems do not adequately provide these features. This creates problems for travelers, resulting in the time and effort they waste during the planning and execution processes.

[1540] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1541] In this invention, the server includes a means for receiving travel requests from users, a means for generating an optimal travel plan, a means for booking accommodations and transportation based on the generated travel plan, a means for providing local navigation and tourist information, and a means for collecting user feedback and improving services. This allows travelers to easily receive comprehensive travel support, providing a more comfortable and efficient travel experience. Furthermore, by including a means for providing real-time guidance using the user's location information and a multilingual interpretation function, inconveniences at the travel destination can be eliminated, resulting in a more fulfilling trip.

[1542] "User" refers to a person who uses the system to assist in travel planning and execution.

[1543] "Preferences" refers to information about a user's travel-related requests, such as destination, schedule, and budget.

[1544] "Travel Plan" refers to a travel schedule generated based on the user's preferences, including details of accommodation, transportation, tourist attractions, etc.

[1545] "Reservation" refers to the process of reserving accommodation and transportation in advance based on travel plans.

[1546] "Navigation" refers to providing users with directions and transportation information to reach their destinations on-site.

[1547] "Tourist destination information" refers to data that includes details such as the destination's attractions, recommended spots, and how to get there.

[1548] "Feedback" refers to opinions provided by users after a trip regarding their satisfaction with the trip and areas for improvement.

[1549] "Real-time" refers to the immediate processing and delivery of data or information in the current time.

[1550] "Guide" refers to providing information and support that users need during their travels.

[1551] "Multilingual" refers to the ability to provide information in different languages ​​to users who speak different languages.

[1552] "Interpretation function" refers to the function of translating conversations and text between different languages.

[1553] "System" refers to the integrated set of hardware and software that generates travel plans, provides bookings, provides on-site support, and collects feedback.

[1554] This invention is an AI-based system that supports all travel processes, from trip planning and execution to feedback collection and service improvement. Users can make trip arrangements and receive on-site support through a smartphone app, website, or wearable device. The system consists of the following hardware and software:

[1555] Hardware

[1556] Server: A central server that processes information from users and generates travel plans. It is equipped with a high-performance processor and large memory capacity.

[1557] Terminal: A smartphone, PC, or wearable device that serves as the user interface and has communication capabilities to communicate with the server.

[1558] software

[1559] Application: A smartphone app or website interface that a user installs, collects user input, and sends it to a server.

[1560] Database: Stores detailed data on accommodation, transportation and tourist destinations.

[1561] Navigation system: A module that provides local directions and transit information.

[1562] Generative AI model: An AI model for generating optimal travel plans based on user preferences.

[1563] Data processing and calculation

[1564] The server analyzes the travel preference data received from the user and uses a generative AI model to create an optimal travel plan, which queries a database to gather detailed information such as accommodation, transportation, and tourist attractions, and then generates a plan that meets the user's requirements.

[1565] For example, if a user inputs "I want to go to Okinawa," the server receives this information and then obtains detailed conditions (e.g., dates, budget, interests, etc.). Based on this, it generates an optimal travel plan and presents it to the user. Once the user confirms the plan and completes the reservation, the server provides navigation information as on-site support on the day of the trip.

[1566] Specific use cases

[1567] For example, if a user inputs their desire to "go to Okinawa," the system will interactively obtain detailed requirements and propose the optimal travel plan. On the day of the trip, real-time route guidance and tourist information will be provided via smartphone, and in the case of overseas travel, an interpretation function will also be available to overcome language barriers. After the trip, feedback will be collected through a questionnaire, and the quality of the service will be improved based on this.

[1568] Prompt Sentence Examples

[1569] By inputting prompt sentences like the one below into the generative AI model, it is possible to create the optimal travel plan based on the user's wishes.

[1570] "Please create the best travel plan for Okinawa. The date is the last week of June, and the budget is within 100,000 yen. Please propose a plan that includes information on accommodation, transportation, and tourist attractions."

[1571] To implement this invention, various hardware and software such as servers, terminals, applications, databases, navigation systems, and generative AI models must be appropriately combined to provide consistent travel support based on user preferences, allowing travelers to comfortably navigate the entire process from planning to execution.

[1572] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1573] Step 1:

[1574] The user launches a smartphone app, website, or wearable device. The user inputs a request, such as "I want to go to Okinawa." The request is sent from the device to the server.

[1575] Input: User's travel wishes (e.g., "I want to go to Okinawa")

[1576] Output: Travel preference data received by the server

[1577] Step 2:

[1578] The server receives the user's input and generates a question asking the user for additional detailed conditions, which is then sent to the terminal.

[1579] Input: Travel preference data received by the server

[1580] Output: A question asking for detailed conditions to be sent to the device (e.g., "When are your travel dates?", "What is your budget?")

[1581] Step 3:

[1582] The terminal displays the questions received from the server to the user, who then enters detailed conditions such as dates and budget and submits the request.

[1583] Input: Questions asking for detailed conditions from the server

[1584] Output: User's detailed condition response (e.g., "Last week of June", "Budget is within 100,000 yen")

[1585] Step 4:

[1586] The server searches the database to collect the necessary data based on the detailed conditions received from the user, and the generative AI model then generates the optimal travel plan based on the collected data.

[1587] Input: User's detailed condition data

[1588] Output: Optimal itinerary (e.g., list of accommodations, transportation options, and tourist attractions)

[1589] Step 5:

[1590] The server sends the generated travel plan to the terminal, which displays the proposed plan to the user and asks for confirmation.

[1591] Input: Optimal travel plan data

[1592] Output: A plan confirmation message to the user displayed on the device (e.g., "Are you sure you want to proceed with this plan?")

[1593] Step 6:

[1594] The user confirms the proposed travel plan and selects "Yes." The selected plan is sent from the device to the server.

[1595] Input: Confirmation of travel plan selected by user

[1596] Output: User selection data sent to the server

[1597] Step 7:

[1598] The server processes the reservation requests for accommodation and transportation based on the user's selected plan. After each reservation is completed, reservation details are generated.

[1599] Input: Travel plan information selected by the user

[1600] Output: Reservation confirmation information (e.g. reservation number, date, price)

[1601] Step 8:

[1602] The server sends the reservation confirmation information to the terminal, which displays the reservation details to the user.

[1603] Input: Reservation confirmation information

[1604] Output: Reservation details displayed on the device (e.g., accommodation name, check-in date, price)

[1605] Step 9:

[1606] On the day of the trip, the user launches the application again. The server uses the GPS to obtain the user's current location and checks the trip schedule.

[1607] Input: User application launch, current location information

[1608] Output: Real-time support data based on travel schedule and current location

[1609] Step 10:

[1610] The device displays directions and tourist information to the user based on real-time support data from the server.

[1611] Input: Real-time support data

[1612] Output: Directions information, tourist spot information (e.g., route from current location to tourist spot, recommended spots)

[1613] Step 11:

[1614] After the trip is over, the device displays a survey asking for feedback from the user, who then enters and submits the feedback.

[1615] Input: Feedback Survey

[1616] Output: User feedback data (e.g., satisfaction, areas for improvement)

[1617] Step 12:

[1618] The server collects feedback data from users and analyzes it to improve the service, and then refines the algorithm for generating future travel plans.

[1619] Input: User feedback data

[1620] Output: Analysis results and algorithm improvements based on them

[1621] (Application example 1)

[1622] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1623] There is a need to eliminate the complexity of travel planning and the inconvenience of being on-site, allowing users to plan and execute trips more easily and enjoyably. In particular, it is important to enable users to experience their destinations in advance through a virtual environment at home, allowing them to more concretely imagine and select their actual travel plans. In addition, a system is needed to collect feedback after the trip and improve the accuracy of future travel plans.

[1624] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1625] In this invention, the server includes means for receiving travel requests from a user, means for generating an optimal travel plan, and means for reserving accommodations and transportation based on the generated travel plan, thereby providing a simulated travel destination experience within a virtual environment and enabling users to reserve travel plans from the virtual environment.

[1626] "User" refers to a person who plans, makes reservations, and receives on-site support through this system.

[1627] "Preferences" refers to the travel requests, such as the travel destination, itinerary, and budget, proposed by the user.

[1628] "Travel plan" refers to a plan generated based on the user's preferences, including suggestions for accommodation, transportation, tourist attractions, etc.

[1629] "Accommodation" refers to hotels, inns, and other lodging facilities where users can stay at their travel destinations.

[1630] "Transportation" refers to the means of transportation, such as trains, buses, and airplanes, that users use to travel to their travel destinations.

[1631] "Route guidance" refers to a service that tells users the best route to their destination on the day of their trip.

[1632] "Tourist destination guide" refers to a service that provides information about tourist destinations and recommended spots that users visit.

[1633] "Feedback" refers to opinions and impressions collected from users after the trip has ended.

[1634] "Service improvement" refers to improving systems and proposal processes based on collected feedback.

[1635] A "virtual environment" refers to a computer-generated virtual space that simulates a real-life travel destination.

[1636] A "simulation experience" refers to an experience that allows users to test-visit real-world travel destinations within a virtual environment.

[1637] "Reservation" refers to the act of a user reserving accommodation and transportation based on a travel plan.

[1638] The present invention is an AI-based travel assistance system that supports everything from trip planning to execution, feedback collection, and service improvement. Specific embodiments of this system are described below.

[1639] System Overview

[1640] The system of this invention mainly consists of a server, a terminal, and a user. The server receives requests from the user and generates and provides the optimal travel plan. The terminal refers to a smartphone or a head-mounted display (HMD), through which the user interacts with the system.

[1641] Initial settings and obtaining user preferences

[1642] When a user starts up the device, the server generates questions to obtain basic information such as the travel destination, desired dates, and budget, and sends them to the device. The device displays these questions to the user, who then enters conditions such as "I want to go to Okinawa" and "The last week of June, budget within 100,000 yen." This allows the server to receive the user's basic preferences.

[1643] Generate a travel plan

[1644] The server generates an optimal travel plan from its internal database based on the received requests. This plan includes accommodation, transportation, and tourist attractions, and is presented to the user via the terminal. Once the user confirms and accepts the plan, the reservation process begins.

[1645] Reservation Processing

[1646] The server will make reservations for the relevant accommodations and transportation based on the plan selected by the user. Once the reservation is complete, a reservation number and detailed information will be generated and sent to the terminal. The terminal will display this to the user and help them prepare for the day of their trip.

[1647] Local support and virtual environments

[1648] On the day of the trip, the user restarts the device, and the server retrieves the user's current location and travel schedule. The device displays real-time route directions, transfer information, and tourist spot information. A simulation experience is also provided within the virtual environment, allowing users to virtually experience tourist spots and accommodations before actually visiting them.

[1649] Feedback and Service Improvement

[1650] After the trip is completed, the system asks the user for feedback. The user answers a questionnaire via their device, and the server collects and analyzes the feedback. Based on the results of this analysis, the system improves the algorithm for generating future travel plans and enhances the quality of the service.

[1651] Hardware and software used

[1652] Hardware: Smartphone, Head-Mounted Display (HMD)

[1653] Software: Flask (API server construction), JSON (data management), database (travel destination information management)

[1654] Examples and prompts

[1655] For example, if a user inputs their desire to "go to Tokyo," the system will provide a virtual tour experience of Tokyo's tourist attractions, accommodations, and transportation options. Using the HMD, users can visit tourist spots such as Sensoji Temple, Roppongi Hills, and Disneyland in advance.

[1656] Example prompt sentence:

[1657] The user has entered a desire to "go to Okinawa." The system processes the user's request through the following steps:

[1658] 1. Receive user input.

[1659] 2. Generate a travel plan based on the specified location.

[1660] 3. Present the generated plan to the user.

[1661] 4. The user checks the plan and makes a reservation.

[1662] 5. Send the reservation details to the user.

[1663] Please suggest the following travel destination: [Tokyo, Osaka, Kyoto]

[1664] In this way, the system of the present invention comprehensively supports everything from trip planning and execution to feedback collection and even advance experience of travel destinations through a virtual environment.

[1665] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1666] Step 1:

[1667] The user starts up the device and inputs their desired travel destination, schedule, budget, etc. The user's input is sent to the server by the device. Specifically, the user inputs "I want to go to Okinawa" and "The last week of June, budget is within 100,000 yen," and the data is transferred from the device to the server. The input data is sent to the server in JSON format, and the server receives the data.

[1668] Step 2:

[1669] The server analyzes the user's input data and generates a travel plan based on their preferences. At this time, the server searches its internal database to select the most suitable accommodations, transportation options, tourist attractions, etc. Specifically, the server executes the search query and generates a travel plan for "Okinawa." The output is JSON data for the travel plan, which includes a list of accommodations, transportation options, and tourist attractions.

[1670] Step 3:

[1671] The server sends the generated travel plan to the terminal, which then displays it to the user. The user selects the plan they prefer from the presented plans. Specifically, the travel plan is displayed in list format on the terminal screen, and the user selects "Hotel A," "Tourist Spot B," etc. by clicking on it. The input is the user's selection information, and the output is JSON data of the selected plan.

[1672] Step 4:

[1673] Based on the plan selected by the user, the server sends a reservation request for accommodation and transportation. The server processes each reservation according to the plan and generates a reservation number and detailed information. Specifically, the server calls the reservation API, confirms the reservation at "Hotel A," and generates a reservation number. The input is the user's selection information, and the output is JSON data of the reservation details (reservation number, dates, price, etc.).

[1674] Step 5:

[1675] The server sends reservation confirmation information to the terminal, and the terminal displays the reservation completion details to the user. Specifically, the reservation completion screen is displayed on the terminal, and detailed information (e.g. reservation number 123456, hotel A, price 80,000 yen) is presented. The input is the reservation confirmation data from the server, and the output is the detailed information displayed on the terminal screen.

[1676] Step 6:

[1677] On the day of travel, the user restarts the device, and the server obtains the user's current location and travel schedule. The device then displays route and transfer information in real time. Specifically, the device's GPS function is used to obtain the current location, and the server calls the map API to provide route guidance. The input is current location data, and the output is route guidance information.

[1678] Step 7:

[1679] After the trip, the server sends a questionnaire to the device requesting feedback, and the device displays the questionnaire to the user. The user enters and submits the feedback. Specifically, the device displays a questionnaire screen, and the feedback entered by the user is sent to the server. The input is the user's feedback data, and the output is analysis data stored on the server.

[1680] Step 8:

[1681] The server analyzes the collected feedback data and processes it to improve the service. This data is used to improve the travel plan generation algorithm for future trips. Specifically, the server aggregates the feedback data and builds new plan generation logic through an analytical algorithm. The input is the feedback data, and the output is an improved plan generation algorithm.

[1682] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1683] System Overview

[1684] This invention is an AI-based system that supports all travel-related processes, from trip planning and execution to collecting feedback and improving services. Its unique feature is that it combines an emotion engine that recognizes users' emotions to provide customized travel support based on their emotional state. Users can access travel arrangements and on-site support through a smartphone app, website, or wearable device.

[1685] Initial settings and obtaining user preferences

[1686] A user launches an app, website, or wearable device and the system first asks the user for basic information, such as their travel destination, desired dates, and budget.

[1687] The user types, "I want to go to Okinawa."

[1688] The server receives this information and then generates questions to obtain detailed conditions (e.g., schedule, budget, interests, etc.) and sends them to the terminal.

[1689] The device prompts the user with specific questions.

[1690] The user answers, "The last week of June, my budget is under 100,000 yen."

[1691] Emotion Recognition and Travel Plan Generation

[1692] The server searches the database based on the conditions obtained from the user and generates the optimal travel plan.

[1693] The emotion engine analyzes the user's facial expressions, voice, and input actions to determine their current emotional state.

[1694] The travel plan generated by the server is compared with the analysis results of the emotion engine to select the plan that best suits the user's emotional state.

[1695] The server sends the selected plan to the device.

[1696] The device will prompt the user, "Are you sure you want to proceed with this plan?"

[1697] The user reviews the plan and selects "Yes."

[1698] Reservation Processing

[1699] The server processes the reservation request for the relevant accommodation and transportation based on the plan selected by the user.

[1700] Upon completion of each reservation, reservation details (e.g. reservation number, dates, price, etc.) are generated.

[1701] The server sends the reservation confirmation information to the terminal.

[1702] The device will display the details of the completed booking to the user.

[1703] Local support

[1704] On the day of travel, the user simply launches the application again and the system begins providing real-time support.

[1705] The server obtains the user's current location and travel schedule.

[1706] The device displays real-time directions, transfer information, and tourist information.

[1707] The emotion engine continues to monitor the user's current emotional state and provides more friendly guidance or additional support if it determines they are feeling anxious or stressed.

[1708] When users visit tourist spots, the system provides additional information and recommendations.

[1709] Based on the emotion engine's judgment, the device may also make special suggestions to boost the user's mood.

[1710] Feedback and Service Improvement

[1711] After the trip is completed, the system asks the user to provide feedback.

[1712] The device displays a survey such as "Were you satisfied with your trip?"

[1713] The user enters and submits feedback.

[1714] The server collects feedback data and analyzes it to improve the service.

[1715] The emotion engine analyzes the user's emotional state at the time of feedback and evaluates the content of the feedback from an emotional perspective.

[1716] Based on the analysis results, the server improves the entire system, including the emotion engine, and reflects this in the travel plan generation algorithm for future trips.

[1717] Specific use cases

[1718] For example, if a user inputs their desire to "go to Okinawa," the system will obtain detailed conditions through a dialogue. On the day of the trip, real-time route guidance and tourist information will be provided via smartphone, and if the emotion engine detects anxiety or stress, special support will be offered. For overseas trips, an interpretation function is also available to overcome language barriers. After the trip, feedback will be collected through a questionnaire, and the quality of the service will be improved based on the analysis results of the emotion engine.

[1719] In this way, the present invention is a system that comprehensively supports travel from planning to implementation and feedback, and in particular provides customized services that take into account the user's emotional state, allowing users to have an easy and more enjoyable travel experience.

[1720] The processing flow will be explained below.

[1721] Specific processing steps of the program

[1722] 1. Travel plan consultation and proposal

[1723] Step 1:

[1724] The user opens a smartphone app, website, or wearable device and enters their travel wishes.

[1725] Example: "I want to go to Okinawa."

[1726] Step 2:

[1727] The server receives the user's input and stores it as initial data.

[1728] Step 3:

[1729] The terminal displays a question to the user asking for detailed conditions, such as "When would you like to travel?"

[1730] Step 4:

[1731] The user answers detailed criteria (e.g., travel dates, budget, special interests, etc.).

[1732] Step 5:

[1733] The server analyzes the user's responses and collects information on available accommodation, transportation options, and tourist destinations.

[1734] Step 6:

[1735] The server activates an emotion engine that analyzes the user's facial expressions and tone of voice while they are typing to determine their emotional state.

[1736] Step 7:

[1737] The server generates and presents optimal travel plans based on the collected data and emotional state.

[1738] Step 8:

[1739] The terminal displays the generated travel plan to the user.

[1740] For example: "Are you sure you want to go ahead with this plan?"

[1741] Step 9:

[1742] The user checks the plan and selects it.

[1743] 2. Processing and Confirmation of Bookings

[1744] Step 10:

[1745] The user selects the most suitable travel plan from the suggestions and begins the booking process.

[1746] Step 11:

[1747] The server processes reservations for accommodation and transportation based on the plan selected by the user.

[1748] Step 12:

[1749] The server generates confirmation information (reservation number, detailed schedule, fee, etc.) after the reservation is completed and sends it to the terminal.

[1750] Step 13:

[1751] The terminal notifies the user of the reservation completion confirmation and displays the details.

[1752] 3. Support and guidance on the day

[1753] Step 14:

[1754] The user activates the service on the day of travel and requests support.

[1755] Step 15:

[1756] The server obtains the user's location and status, predicts their next move, and prepares for it.

[1757] Step 16:

[1758] The device displays and navigates transfer directions and routes from your current location.

[1759] Step 17:

[1760] The device provides information about tourist destinations the user is visiting and recommended spots.

[1761] Step 18:

[1762] The server uses an emotion engine to monitor the user's real-time emotional state, and if the user feels anxious or stressed, it provides more friendly guidance or additional support.

[1763] Step 19:

[1764] The server will introduce restaurants and provide flexible support in real time depending on the user's situation.

[1765] 4. Post-trip feedback and improvements

[1766] Step 20:

[1767] A screen is provided for users to provide feedback after completing their trip.

[1768] Step 21:

[1769] The terminal displays a questionnaire to the user, such as "Were you satisfied with your trip?"

[1770] Step 22:

[1771] Users complete surveys and provide feedback.

[1772] Step 23:

[1773] Analyze the feedback collected by our servers to identify areas for improvement of our services.

[1774] Step 24:

[1775] The server uses an emotion engine to analyze the user's emotional state at the time of feedback and reflects it in the next travel plan.

[1776] Step 25:

[1777] Based on the analysis results, the server reflects the feedback results in the travel plan generation algorithm and support functions.

[1778] This allows users to plan and carry out trips simply and efficiently, and companies can improve the quality of their customer service. The introduction of the emotion engine provides customized support according to the user's emotional state, resulting in a more fulfilling travel experience.

[1779] Example 2

[1780] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1781] Conventional travel support systems provide basic functions such as generating travel plans based on user preferences, booking, and on-site support, but they lack customization based on the user's emotional state, which leads to a lack of user satisfaction. Furthermore, services are typically improved after collecting feedback, making it difficult to provide real-time support and support.

[1782] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for receiving travel requests from a user, a means for generating an optimal travel plan, a means for booking accommodations and transportation, a means for providing on-site directions and tourist information, a means for recognizing the user's emotional state and providing a customized travel plan, and a means for collecting feedback and improving services. This makes it possible to provide a customized travel plan and real-time support based on the user's emotional state.

[1783] "User" refers to an individual or group who uses the system to plan their trip or receive on-site support.

[1784] "Preferences" refers to travel requests and conditions such as destination, schedule, budget, and interests that users input into the system.

[1785] "Travel Plan" refers to the optimal travel proposal including tourist attractions, accommodation, transportation, schedule, etc.

[1786] "Emotional state" refers to the psychological state and mood that is analyzed from the user's facial expressions, voice, input actions, etc.

[1787] "Customization" refers to the adjustment and modification of travel plans and services provided to suit the user's individual wishes and emotional state.

[1788] "Feedback" refers to information such as ratings, opinions, and comments collected from users after their trip.

[1789] "Server" refers to the computer system that runs the entire system and performs core functions such as generating travel plans, processing reservations, and analyzing sentiment.

[1790] "Terminal" refers to devices such as smartphones, tablets, PCs, and wearable devices that users use to operate the system.

[1791] "Real-time guidance" refers to support such as route guidance, transfer information, and tourist information that is provided instantly based on the user's current location and situation.

[1792] "Multilingual interpretation function" refers to a function that translates between different languages ​​so that users can receive support in their local language while traveling abroad.

[1793] The present invention is an AI-based system that generates an optimal travel plan based on a user's preferences when planning a trip, provides real-time assistance during the trip, and collects feedback after the trip to improve services. Specific embodiments of this system are described below.

[1794] Hardware and software used

[1795] This system uses devices such as smartphones, tablets, PCs, and wearable devices to receive user operations. The server is used to operate the system and perform core functions such as generating travel plans, processing reservations, and analyzing emotions. The emotion engine is an AI model used to analyze the user's emotional state from their facial expressions, voice, and input actions. This emotion engine collects data using a facial recognition camera and microphone.

[1796] System Overview

[1797] The system includes the following means:

[1798] A method for receiving travel requests from users: Users input their travel destination, schedule, budget, and other requests into their terminal.

[1799] Means for generating an optimal travel plan based on preferences: A server receives input information and searches a database to generate an optimal travel plan.

[1800] A means for reserving accommodation and transportation: The server reserves accommodation and transportation based on the selected travel plan.

[1801] A means of providing local directions and tourist information: The device provides real-time guidance services based on the user's location information while traveling.

[1802] A means of recognizing emotional states and providing customized itineraries: The emotion engine monitors the user's emotional state and optimizes the itinerary and guidance content according to the emotions.

[1803] A means of collecting feedback and improving services: Feedback is collected after the trip is completed and used to improve the entire system.

[1804] Examples of specific examples and prompts

[1805] When a user wants to plan a trip, they might enter the following prompt into their terminal:

[1806] "I'd like to make travel plans. I'd like to go to Okinawa. Do you have any plans for the last week of June? My budget is within 100,000 yen. Also, please let me know about the local support functions."

[1807] A server receiving this prompt should process it as follows:

[1808] First, the system receives the user's desired information, then generates additional questions based on that information to ask for more detailed information. These questions are then sent to the terminal, where the user can enter their details.

[1809] Based on the details entered, the server uses an emotion engine to analyze the user's emotional state, for example by analyzing the user's facial expressions and tone of voice using a facial recognition camera and a voice recognition microphone.

[1810] Combining the results of the sentiment analysis with the user's requirements, the server generates an optimal travel plan from its database, including parameters such as accommodation, flight information, and tourist spot suggestions.

[1811] The travel plans generated in this way are then compared with the results of the emotion engine to select the most suitable one and send it to the device, which then displays a confirmation message asking, "Are you sure you want to proceed with this plan?"

[1812] Feedback is collected and real-time guidance and support is provided, including multilingual interpretation.

[1813] In this way, the present invention is a system that provides a customized travel experience that takes into account the user's emotional state and realizes service improvement through real-time assistance and feedback.

[1814] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1815] Step 1: Initial setup and obtaining user preferences

[1816] The user starts up the device and starts planning a trip. Input: Basic information such as travel destination (e.g., "I want to go to Okinawa"), schedule, and budget.

[1817] The server receives the input information and then generates questions to obtain more detailed conditions. Examples include questions like "What are your travel dates?" and "What is your budget?"

[1818] The server generates a question and sends it to the terminal.

[1819] The device displays the question to the user. Output: The options "What are your travel dates?"

[1820] The user enters detailed information (e.g., "last week of June" and "budget within 100,000 yen").

[1821] Step 2: Emotion recognition and itinerary generation

[1822] The server searches the database based on the conditions obtained from the user and generates the optimal travel plan. Input: Detailed information (travel destination, schedule, budget, etc.). Data processing: Search the database and generate the optimal travel plan. Output: Candidate travel plans.

[1823] The server starts the emotion engine and analyzes the user's facial expressions, voice, and input actions to determine the current emotional state. Input: facial expression images, voice data. Data calculation: analysis of emotional state. Output: analysis results (relief, anxiety, excitement, etc.).

[1824] The travel plan generated by the server is compared with the analysis results of the emotion engine to select the plan that best suits the user's emotional state. Input: Travel plan candidates and emotion analysis results. Data processing: Selection of the optimal plan. Output: Optimal travel plan.

[1825] The server sends the selected plan to the device.

[1826] The device will ask the user for confirmation: "Are you sure you want to proceed with this plan?" Output: Confirmation message.

[1827] The user reviews the plan and selects "Yes."

[1828] Step 3: Reservation Processing

[1829] The server processes the reservation request for accommodation and transportation based on the plan selected by the user. Input: Selected travel plan. Data processing: Sending the request to the reservation system.

[1830] Once each reservation is completed, details such as the associated reservation number, dates, and price are generated. Output: Reservation confirmation information.

[1831] The server sends the reservation confirmation information to the terminal.

[1832] The terminal displays the reservation completion details to the user. Output: Reservation confirmation message.

[1833] Step 4: Local support

[1834] The user launches the application again on the day of travel.

[1835] The server obtains the user's current location information and travel schedule and starts real-time support. Input: Current location information. Data processing: Preparation for real-time support. Output: Support information.

[1836] The terminal displays real-time route guidance, transfer information, tourist information, etc. Output: Real-time guidance message.

[1837] The server continues to run the emotion engine and monitors the user's current emotional state. Input: facial expression, voice, and movement data. Data calculation: real-time emotion analysis. Output: emotion analysis results.

[1838] If anxiety or stress is detected, the server will provide more friendly guidance or additional support. Input: Sentiment analysis results. Data processing: Generation of additional support. Output: Additional guidance message.

[1839] When a user visits a tourist spot or restaurant, the server provides additional information and recommended spots. Input: Data of visited places. Data processing: Generation of additional information. Output: Recommended information.

[1840] The device will make special suggestions to boost the user's mood based on the emotion engine's judgment. Output: Special suggestion message.

[1841] Step 5: Feedback and Service Improvement

[1842] After the trip ends, the device displays a survey such as, "Were you satisfied with your trip?"

[1843] The user enters and submits feedback. Input: Feedback data. Output: Feedback message.

[1844] The server collects feedback data and analyzes it to improve the service. Input: Feedback data. Data processing: Feedback analysis. Output: Analysis results.

[1845] The server improves the service based on the sentiment analysis results and reflects them in future travel plan generation. Input: Analysis results. Data processing: Algorithm improvement. Output: Improved travel plan generation algorithm.

[1846] Through the above steps, the present invention is a system that provides a customized travel experience based on the user's emotional state and realizes service improvement through real-time assistance and feedback.

[1847] (Application example 2)

[1848] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1849] Conventional travel support systems are limited to generating itineraries based on user-specified criteria and providing basic on-site support. However, they lack the ability to respond to users' emotional states and real-time needs, and do not provide sufficient personalized support, especially during the shopping experience in physical stores. Therefore, there is a need for systems that can reduce the inconvenience and stress users experience while traveling or shopping in physical stores and provide more satisfying support.

[1850] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving travel requests from a user, means for generating an optimal travel plan, means for booking accommodations and transportation based on the generated travel plan, means for providing local route guidance and tourist information on the day of the trip, means for analyzing the user's emotional state in real time during the trip and providing customized support based thereon, means for collecting user feedback after the trip and improving services, means for providing real-time guidance using the user's location information and emotional state, and means for recommending products and providing special support based on the emotional analysis when the user shops in physical stores during the trip. This makes it possible to provide customized support according to the user's emotional state and meet real-time needs.

[1851] The "means for receiving travel requests from users" refers to an interface through which users input information such as desired travel destination, schedule, budget, etc., and the system receives that information.

[1852] A "means for generating an optimal travel plan" is an algorithm or process for automatically designing an optimal travel plan for a user based on travel data collected from the user.

[1853] "Means for reserving accommodation and transportation based on the generated travel plan" is a function for automatically reserving accommodation and transportation based on the travel plan generated by the system.

[1854] "Means of providing local directions and tourist information on the day of travel" is a function that provides real-time directions to the destination and tourist information when travelers arrive at their travel destination.

[1855] "Means of analyzing the user's emotional state in real time while traveling and providing customized support based on that" refers to algorithms and sensor technology that analyzes the user's facial expressions and behavior to recognize their emotions and provide optimal support and suggestions based on that state.

[1856] "Means of collecting user feedback after the trip and improving services" refers to the process of collecting impressions and opinions from users after the trip and using that data to improve the quality of services.

[1857] "Means for providing real-time guidance using the user's location information and emotional state" refers to technology that tracks the user's current location and emotional state in real time and provides optimal information and guidance based on that.

[1858] "A means of providing product recommendations and special support based on emotional analysis when users shop in physical stores while traveling" is a function that analyzes the user's emotional state while shopping in a store and provides optimal product recommendations and additional support.

[1859] System configuration

[1860] This invention is a system that uses emotion analysis to provide product recommendations and special support when a user is shopping at a physical store while traveling. Specifically, it has the following configuration.

[1861] A method for receiving travel requests from users: Users input desired information such as travel destination, schedule, budget, etc. using a smartphone or computer. This information is received by the server and stored in a database.

[1862] Means for generating optimal travel plans: The server uses an algorithm to generate optimal travel plans based on the received desired information. The generated plans include information on accommodations, transportation, and tourist spots.

[1863] A means for reserving accommodation and transportation based on the generated travel plan: The server automatically reserves accommodation and transportation based on the generated travel plan. The reservation details are sent to the user's terminal.

[1864] A method for providing local route guidance and tourist information on the day of travel: On the day of travel, users launch the application on their smartphones. The server provides real-time route guidance and tourist information.

[1865] A means of analyzing the user's emotional state in real time while traveling and providing customized support based on that: The server performs emotional analysis through the user's camera and microphone, analyzing the user's facial expressions, voice, and behavioral data to determine the user's emotional state.

[1866] A means to collect user feedback after the trip and improve the service: After the trip is over, the application displays a questionnaire to the user and collects their feedback. The server analyzes this information and uses it to improve the service.

[1867] A method for providing real-time guidance using the user's location information and emotional state: The server provides real-time guidance information based on the user's location information and emotional state. Location information is obtained using technologies such as GPS.

[1868] A means of providing product recommendations and special support based on sentiment analysis when users shop in physical stores while traveling: When users shop in stores, the server recommends products and provides special support based on the results of sentiment analysis.

[1869] System Operation

[1870] 1. Initial Setup:

[1871] The server receives the desired information from the user and stores it in a database.

[1872] The server uses an algorithm to generate an optimal travel plan and makes reservations for accommodation and transportation.

[1873] 2. On the day of travel:

[1874] The server monitors the user's location and emotional state in real time and provides appropriate guidance and tourist information.

[1875] An emotion analysis engine collects data from the user's camera and microphone to determine their emotional state.

[1876] 3. In-store shopping support:

[1877] When a user shops in a store, the server recommends products based on the results of sentiment analysis.

[1878] Provide special assistance as needed (e.g., providing coupons, directing store associates).

[1879] 4. After the trip:

[1880] The server collects feedback from users and analyzes the content using a sentiment analysis engine.

[1881] The analysis results will be used to improve services.

[1882] Specific examples

[1883] If a user selects "Okinawa" as their travel destination, the server will generate a travel plan and make reservations for accommodation and flights. When the user goes shopping at a physical store during their trip, the server will analyze the user's emotions through cameras and microphones and recommend appropriate products. It will also provide special support if it detects stress or anxiety. After the trip, feedback will be collected through a survey to help improve the service.

[1884] Example prompt for a generative AI model:

[1885] "We are developing a smartphone app that uses an emotion engine to analyze users' emotions in real time when they enter a physical store and provides appropriate support and product information. When a user is in a happy mood, the system will recommend products that they might be interested in, and when they are anxious, it will provide friendly guidance. Please tell us the specific requirements for the use scenarios and functions of this app."

[1886] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1887] Step 1:

[1888] The user inputs their desired travel destination, itinerary, budget, etc. into their smartphone or PC. The device then sends this data to the server. The input is the user's desired information (destination, itinerary, budget), and the output is the desired information that is saved on the server.

[1889] Step 2:

[1890] The server generates an optimal travel plan based on the received information. It uses an algorithm to search a database of accommodations, transportation options, and tourist attractions to select the optimal combination. The input is the user's desired information, and the output is the generated travel plan.

[1891] Step 3:

[1892] The server makes reservations for accommodation and transportation based on the generated itinerary. It communicates with the reservation system via API and automatically makes the necessary reservations. The input is the generated itinerary, and the output is reservation confirmation information.

[1893] Step 4:

[1894] On the day of the trip, the user launches the app on their smartphone. The server obtains the user's location information and travel schedule in real time and provides route guidance and tourist information. The inputs are the user's location information and travel schedule, and the output is real-time guidance information.

[1895] Step 5:

[1896] The server analyzes the user's emotional state in real time through a camera and microphone. The emotion analysis engine recognizes facial expressions and analyzes voice to determine the user's emotional state. The input is the user's facial expression data and voice data, and the output is the analyzed emotional state.

[1897] Step 6:

[1898] The server provides customized support based on the analysis results. When users shop in physical stores, product recommendations and special support (e.g., coupons and sales assistant guidance) are provided. The inputs are the analyzed emotional state and a product database, and the output is recommended product information and special support.

[1899] Step 7:

[1900] After the trip, the app displays a feedback questionnaire for the user. The feedback entered by the user is sent to the server. Based on this data, the server analyzes the feedback using a sentiment analysis engine and uses it to improve the service. The input is the user's feedback information, and the output is the analysis results and improvement data.

[1901] Step 8:

[1902] The server integrates all feedback and sentiment analysis results and reflects them in future itinerary generation algorithms and in-store support customization. The input is the integrated feedback data, and the output is an improved service algorithm.

[1903] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1904] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1905] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1906] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1907] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1908] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1909] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1910] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1911] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1912] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1913] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1914] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1915] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1916] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1917] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1918] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1919] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1920] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1921] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1922] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1923] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1924] The following is further disclosed regarding the above embodiment.

[1925] (Claim 1)

[1926] a means for receiving travel preferences from users;

[1927] A means for generating an optimal travel plan based on the preferences;

[1928] A means for booking accommodation and transportation based on the generated travel plan;

[1929] A means of providing local directions and tourist information on the day of the trip,

[1930] A means of collecting user feedback after a trip and improving the service;

[1931] A system including:

[1932] (Claim 2)

[1933] 2. The system according to claim 1, further comprising means for providing real-time guidance using location information of the user.

[1934] (Claim 3)

[1935] 2. The system according to claim 1, further comprising means including a multilingual interpretation function, allowing users to receive support in local languages ​​while traveling abroad.

[1936] "Example 1"

[1937] (Claim 1)

[1938] a means for receiving travel preferences from users;

[1939] A means for generating an optimal travel plan based on the preferences;

[1940] a means for booking accommodation and transportation based on the generated travel plan;

[1941] A means of providing local navigation and tourist information on the day of travel,

[1942] A means of collecting user feedback after the trip and improving the service;

[1943] A system including:

[1944] (Claim 2)

[1945] 2. The system according to claim 1, further comprising means for providing real-time guidance using location information of the user.

[1946] (Claim 3)

[1947] 10. The system of claim 1, including a means for providing multilingual interpretation capabilities, allowing users to receive support in their local language while traveling abroad.

[1948] "Application Example 1"

[1949] (Claim 1)

[1950] a means for receiving travel preferences from users;

[1951] A means for generating an optimal travel plan based on the preferences;

[1952] A means for booking accommodation and transportation based on the generated travel plan;

[1953] A means of providing local directions and tourist information on the day of the trip,

[1954] A means of collecting user feedback after a trip and improving the service;

[1955] a means for providing a simulated travel destination experience within a virtual environment;

[1956] A means for users to book travel plans from a virtual environment;

[1957] A system including:

[1958] (Claim 2)

[1959] 2. The system according to claim 1, further comprising means for providing real-time guidance using location information of the user.

[1960] (Claim 3)

[1961] 10. The system according to claim 1, further comprising means including a multilingual interpretation function, allowing users to receive support in local languages ​​while traveling abroad.

[1962] "Example 2: Combining Emotion Engines"

[1963] (Claim 1)

[1964] a means for receiving travel preferences from users;

[1965] A means for generating an optimal travel plan based on the preferences;

[1966] A means for booking accommodation and transportation based on the generated travel plan;

[1967] A means of providing local directions and tourist information on the day of the trip,

[1968] a means for recognizing a user's emotional state and customizing a travel plan based on said emotional state;

[1969] A means of collecting user feedback after a trip and improving the service;

[1970] A system including:

[1971] (Claim 2)

[1972] 2. The system according to claim 1, further comprising means for providing real-time guidance using location information of the user.

[1973] (Claim 3)

[1974] 10. The system according to claim 1, further comprising means including a multilingual interpretation function, allowing users to receive support in local languages ​​while traveling abroad.

[1975] "Application example 2 when combining emotion engines"

[1976] (Claim 1)

[1977] a means for receiving travel preferences from users;

[1978] A means for generating an optimal travel plan based on the preferences;

[1979] A means for booking accommodation and transportation based on the generated travel plan;

[1980] A means of providing local directions and tourist information on the day of the trip,

[1981] A means for analyzing a user's emotional state in real time while traveling and providing customized support based on that analysis;

[1982] A means of collecting user feedback after a trip and improving the service;

[1983] A system including:

[1984] (Claim 2)

[1985] 10. The system of claim 1, further comprising means for providing real-time guidance using the user's location information and emotional state.

[1986] (Claim 3)

[1987] 2. The system according to claim 1, further comprising means for providing product recommendations and special support based on sentiment analysis when the user is shopping in a physical store while traveling. [Explanation of symbols]

[1988] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a means for receiving travel preferences from users; A means for generating an optimal travel plan based on the preferences; A means for booking accommodation and transportation based on the generated travel plan; A means of providing local directions and tourist information on the day of the trip, A means of collecting user feedback after a trip and improving the service; A system including:

2. 2. The system according to claim 1, further comprising means for providing real-time guidance using location information of the user.

3. 2. The system according to claim 1, further comprising means including a multilingual interpretation function, allowing a user to receive support in a local language while traveling abroad.

Images