System

Abstract

A system is provided.SOLUTION: A computer system for providing tourism information for a foreign tourist, comprising: means for storing foreign tourist tourism industry information; means for interacting with a foreign tourist to obtain preferences and needs; means for generating a tourism plan based on the preferences and needs; means for providing detailed information about the generated tourism plan to the foreign tourist; means for providing multilingual support; means for storing and reusing foreign tourist profile information; and means for providing tourism information based on affiliation with local registrants.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Many foreign tourists have difficulty understanding Japanese, making it difficult to obtain appropriate tourist information. Furthermore, there are limited services that can provide sightseeing plans tailored to individual preferences and needs, reducing opportunities for foreign tourists to get the best experience in Japan. Furthermore, the lack of multilingual support creates language barriers that hinder the smooth progress of sightseeing plans. This invention aims to solve these issues and enrich the sightseeing experience in Japan for foreign tourists. [Means for solving the problem]

[0005] The present invention provides a computer system for providing tourist information for foreign tourists. The system includes a means for storing registered information of foreign tourists. A means for acquiring preferences and needs through dialogue with foreign tourists is then provided. A means for generating a sightseeing plan based on the acquired preferences and needs is provided, and a means for providing detailed information about the generated sightseeing plan to foreign tourists is also provided. Furthermore, a means for providing multilingual support eliminates language barriers. A means for saving and reusing profile information of foreign tourists makes it possible to propose efficient sightseeing plans for subsequent uses. Furthermore, a means for providing up-to-date and accurate sightseeing information based on collaboration with local tourism businesses is provided, thereby improving the quality of the tourist experience.

[0006] A "foreign tourist" is a visitor who travels to a country other than their own and is unfamiliar with the language and culture of that country.

[0007] A "computer system" is a combination of hardware and software designed to process and manage data.

[0008] "Registration information" refers to personal information and authentication information provided by users to use the system.

[0009] "Dialogue" is an interactive means of communication between a user and a computer system to exchange information.

[0010] "Preferences" refer to the things and activities that a user is particularly interested in and likes.

[0011] "Needs" refer to the conditions and requirements that users require.

[0012] A "tourism plan" is a proposal for a schedule of visits to tourist spots and activities designed based on the user's wishes and requests.

[0013] "Multilingual support" refers to features and services that allow for support in multiple languages.

[0014] "Profile information" is a data set that includes a user's personal information, preferences, past behavioral history, etc.

[0015] "Reuse" refers to using data or information once used in a different context or for a different purpose.

[0016] "Local tourism operators" refer to businesses and facilities that provide services in tourist destinations and their surrounding areas.

[0017] A "partnership" refers to an agreement between different organizations or companies to work together to achieve a common goal. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0020] First, the terms used in the following description will be explained.

[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0026] [First embodiment]

[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0039] The present invention relates to a computer system for providing tourist information for foreign tourists, and in particular to a system that interacts with foreign tourists and proposes sightseeing plans in multiple languages ​​that meet their preferences and needs. Specific embodiments for carrying out the present invention are described below.

[0040] System Overview

[0041] The system includes the following main components:

[0042] 1. User terminal: Devices accessed by foreign tourists (PC, smartphone, tablet, etc.)

[0043] 2. Server: The central computer server of the system

[0044] 3. Database: A data store that stores user information, travel plans, partner information, etc.

[0045] 4. Generative AI Model: Conversational AI for generating sightseeing itineraries

[0046] System Embodiments

[0047] User Registration and Login

[0048] When a user first uses the device, they enter their registration information, such as their name, email address, and password. The device sends this information to the server, which stores it in a database. Once registration is complete, the user logs in using their registration information, and the server verifies the authentication information and starts the session.

[0049] Counseling begins and conversations begin

[0050] The user starts a counseling session and inputs their desired sightseeing information. For example, "I'd like to stay in Tokyo for a week. I like anime and manga." The device sends this information to the server in real time, and the server sends the user's input to the generative AI model. The generative AI model generates an interactive response based on the user's input, such as "I'll suggest sightseeing spots related to anime and manga. I can also help you with hotels and transportation." The device displays this response to the user.

[0051] Generate a sightseeing plan

[0052] The user then enters further details of their preferences, such as specific tourist spots, budget, and itinerary. The device sends this information to the server, which then uses a generation AI to generate a sightseeing plan. This sightseeing plan is customized based on the user's preferences and includes information on accommodation, transportation, and admission tickets to tourist attractions. The generated sightseeing plan is then sent to the device and displayed to the user.

[0053] Completing the reservation

[0054] The user checks the details of the proposed tour plan, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and tourist destinations. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a completion notification. The device displays this notification to the user.

[0055] Save and reuse profiles

[0056] Before logging out, users can choose whether to save their counseling history and preference information. The device sends this information to the server, which stores it in a database. The next time users use the service, they can reuse this information, enabling more efficient counseling and sightseeing plans.

[0057] Specific examples

[0058] For example, a first-time user might input their request, "I'd like to stay in Tokyo for a week. I like anime and manga." The server uses a generative AI to propose a plan including tourist spots, suitable accommodations, and transportation, and then selects a specific hotel from the proposed plan and requests a reservation. The server then confirms the reservation and notifies the user.

[0059] Repeat users can also request, "Next time, I'd like to experience traditional culture in Kyoto," based on their previously saved profile information. The server uses generative AI to create a new proposal based on past counseling history and provides it to the user. The user customizes the proposal, selects details, and requests a reservation. The server then confirms the reservation and notifies the user.

[0060] In this way, the present invention is a system that generates customized sightseeing plans for foreign tourists, removes language barriers, and provides special sightseeing experiences, thereby improving the satisfaction of foreign tourists.

[0061] The processing flow will be explained below.

[0062] Step 1:

[0063] When using the service for the first time, the user enters registration information (name, email address, password).

[0064] Step 2:

[0065] The terminal transmits the entered registration information to the server.

[0066] Step 3:

[0067] The server stores the received registration information in a database.

[0068] Step 4:

[0069] The server sends a notification of registration completion to the terminal.

[0070] Step 5:

[0071] The user receives a notification that registration is complete and logs in using the registration information.

[0072] Step 6:

[0073] The terminal sends login information (email address, password) to the server.

[0074] Step 7:

[0075] The server verifies the login information and, if authentication is successful, begins the session.

[0076] Step 8:

[0077] The user begins a counseling session and inputs their sightseeing preferences.

[0078] Step 9:

[0079] The terminal transmits the desired information input by the user to the server.

[0080] Step 10:

[0081] The server sends the user's desired information to the generation AI, which generates an interactive response.

[0082] Step 11:

[0083] The generative AI generates responses such as, "We'll suggest tourist spots related to anime and manga. We can also help you with hotels and transportation."

[0084] Step 12:

[0085] The server sends the generated response to the terminal.

[0086] Step 13:

[0087] The terminal displays the generated response to the user.

[0088] Step 14:

[0089] The user then enters more detailed requests (specific tourist spots, budget, dates, etc.).

[0090] Step 15:

[0091] The terminal transmits detailed desired information to the server.

[0092] Step 16:

[0093] The server uses AI to generate a sightseeing plan based on detailed desired information.

[0094] Step 17:

[0095] The generative AI generates a customized sightseeing plan based on the user's preferences, including information on accommodation, transportation, and admission tickets to tourist attractions.

[0096] Step 18:

[0097] The server transmits the generated sightseeing plan to the terminal.

[0098] Step 19:

[0099] The terminal displays the generated sightseeing plan to the user.

[0100] Step 20:

[0101] The user reviews the details of the proposed tour plan, selects a specific hotel, and requests a reservation.

[0102] Step 21:

[0103] The terminal transmits the user's reservation request to the server.

[0104] Step 22:

[0105] The server checks availability of the selected accommodations and tourist destinations.

[0106] Step 23:

[0107] The server confirms the reservation and sends the reservation information to the partner.

[0108] Step 24:

[0109] The server sends a reservation completion notification to the terminal.

[0110] Step 25:

[0111] The terminal displays a notification to the user that the reservation is complete.

[0112] Step 26:

[0113] Before logging out, the user has the option to save their counseling history and preferences.

[0114] Step 27:

[0115] The terminal transmits the profile information to be saved to the server.

[0116] Step 28:

[0117] The server stores the profile information and counseling history in a database.

[0118] Step 29:

[0119] The next time the user uses the service, the server will provide efficient counseling and suggest sightseeing plans based on the saved profile information.

[0120] Example 1

[0121] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0122] In recent years, with the increase in foreign tourists, the provision of information about tourist destinations and reservation procedures have become more complicated. In particular, providing multilingual support and proposing tour plans tailored to individual needs has become a major burden for many tourism operators. In addition, tourists themselves find it time-consuming to gather information and make reservations, making it difficult for them to enjoy sightseeing smoothly. To solve these problems, an efficient and effective information provision and reservation system that can meet the diverse needs of foreign tourists is required.

[0123] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0124] In this invention, the server includes: means for storing registration information of foreign tourists; means for interacting with foreign tourists to acquire their preferences and needs; means for using a generative AI model to generate a tour plan based on the preferences and needs; means for presenting detailed information about the generated tour plan to foreign tourists; means for providing support in multiple languages; means for managing reservation information for accommodations, transportation, and tourist attractions in tourist destinations; means for saving and reusing foreign tourists' profile information; means for transferring desired information to the server in real time and generating and providing interactive responses; and means for providing tour information in collaboration with local tourism operators. This allows foreign tourists to easily obtain tour plans that suit their preferences and needs and makes reservations smoothly. Furthermore, operators can efficiently provide information in multiple languages ​​and according to individual requests.

[0125] "Foreign tourists" are tourists whose nationality is different from that of the country of the tourist destination they are visiting.

[0126] "Registration information" refers to personal information such as name, email address, and password that foreign tourists provide prior to using the system.

[0127] "Means of dialogue" refers to the function of exchanging information with foreign tourists via text or voice.

[0128] "Preferences and needs" refers to the personal requests and preferences of foreign tourists, such as the tourist destinations and activities they wish to visit, their budget, and the length of their stay.

[0129] A "generative AI model" is an artificial intelligence algorithm that generates tourist plans based on input data.

[0130] A "tourism plan" is a plan that includes tourist attractions, activities, accommodation, transportation, etc. proposed based on the preferences and needs of foreign tourists.

[0131] "Means of providing support in multiple languages" refers to the function of providing information and dialogue responses to foreign tourists in multiple languages.

[0132] "Accommodation facilities" refer to facilities such as hotels, inns, and hostels where foreign tourists can stay at their destination.

[0133] "Transportation" refers to services such as public transportation and rental cars used to travel to and within tourist destinations.

[0134] "Tourist spots" are places and facilities that are particularly worth seeing within a tourist destination.

[0135] "Means for managing reservation information" refers to the function of recording and managing reservation status for accommodations, transportation, and tourist attractions.

[0136] "Profile information" refers to stored personal data such as a foreign tourist's past counseling history, preferences, and request information.

[0137] "Means for transferring desired information to the server in real time" refers to a function that instantly transmits desired information entered by foreign tourists to the server.

[0138] "Means for generating and providing interactive responses" refers to a function that uses a generative AI model to generate responses based on input information in real time and provide them to foreign tourists.

[0139] "Local tourism operators" are businesses that provide services such as accommodation, transportation, and activities to tourists in tourist destinations.

[0140] The present invention relates to a computer system for providing tourist information to foreign tourists, and in particular to a system that interacts with foreign tourists and proposes sightseeing plans in multiple languages ​​that meet their preferences and needs. Specific embodiments for implementing this system are described below.

[0141] User Registration and Login

[0142] When a user first uses the system, they enter their registration information, such as their name, email address, and password, into a dedicated form. The device sends the information to the server, which stores it in a database. Once registration is complete, the user logs in using their registration information, and the server verifies the authentication information and starts the session.

[0143] Counseling begins and conversations begin

[0144] The user inputs their desired sightseeing information. For example, "I would like to stay in Tokyo for a week. I like anime and manga." The device sends this information to the server in real time, and the server sends the user's input to the generative AI model. The generative AI model generates an interactive response based on the user's input, such as "I will suggest tourist spots related to anime and manga. I can also help you with hotels and transportation." The device displays this response to the user.

[0145] Generate a sightseeing plan

[0146] The user inputs detailed preferences, such as specific tourist attractions, budget, and itinerary. The device sends this information to the server, which then uses a generative AI model to generate a sightseeing plan. This plan includes information on accommodation, transportation, and tourist attraction admission tickets. The generated sightseeing plan is sent to the device and displayed to the user.

[0147] Completing the reservation

[0148] The user reviews the details of the proposed itinerary, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and attractions. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a completion notification, which is displayed to the user via the device.

[0149] Save and reuse profiles

[0150] Before logging out, users can choose whether to save their counseling history and preference information. The device sends this information to the server, which stores it in a database. The next time users use the service, they can reuse the saved profile information to receive faster and more efficient counseling and sightseeing plan suggestions.

[0151] Specific examples

[0152] For example, a first-time user might input their request, "I'd like to stay in Tokyo for a week. I like anime and manga." The server uses a generation AI to propose a plan including tourist spots, accommodations, and transportation, and then selects a specific hotel from the proposed plan and requests a reservation. The server then confirms the reservation and notifies the user.

[0153] Repeat users can also request, "Next time, I'd like to experience traditional culture in Kyoto," based on their previously saved profile information. The server uses generative AI to create a new proposal based on past counseling history and provides it to the user. The user customizes the proposal, selects details, and requests a reservation. The server then confirms the reservation and notifies the user.

[0154] Prompt Sentence Examples

[0155] 1. First-time prompt:

[0156] "I'd like to stay in Tokyo for a week. I love anime and manga. Can you recommend any tourist spots or accommodations?"

[0157] 2. Repeat prompt:

[0158] "When I went to Kyoto before, I experienced the tea ceremony and had a lot of fun. Next time I'd like to experience some traditional culture in Nara. What plan would you recommend?"

[0159] As described above, the present invention provides customized sightseeing plans for foreign tourists, eliminating language barriers, thereby providing a special sightseeing experience and improving the satisfaction of foreign tourists.

[0160] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0161] Processing Steps

[0162] Step 1: User Registration

[0163] Specific behavior:

[0164] 1. The user enters personal information such as name, email address, and password into an input form.

[0165] 2. The terminal sends the entered registration information to the server.

[0166] 3. The server stores the received registration information in a database.

[0167] 4. The server returns a registration completion message to the terminal.

[0168] 5. The terminal displays a registration completion message to the user.

[0169] Input: Name, email address, and password entered by the user

[0170] Output: Registration information saved in the database, registration completion message

[0171] Data processing and calculation:

[0172] Collecting data from input forms

[0173] Save to database

[0174] Generate a registration completion message

[0175] Step 2: User Login

[0176] Specific behavior:

[0177] 1. The user enters the registered email address and password in the login form.

[0178] 2. The terminal sends the login information to the server.

[0179] 3. The server retrieves the registration information from the database and compares it with the input information.

[0180] 4. If authentication is successful, the server generates a session ID and returns it to the terminal.

[0181] 5. The terminal displays a successful login message to the user.

[0182] Input: Email address and password entered by the user

[0183] Output: Session ID, login success message

[0184] Data processing and calculation:

[0185] Retrieving user information from the database

[0186] Verification with login information

[0187] Generate a session ID

[0188] Step 3: Enter and submit your preferences

[0189] Specific behavior:

[0190] 1. The user enters their desired sightseeing information. Example: "I want to stay in Tokyo for a week. I like anime and manga."

[0191] 2. The terminal transmits the entered desired information to the server in real time.

[0192] 3. The server sends the desired information to the generative AI model.

[0193] Input: User-entered preferences

[0194] Output: Sending desired information to the generative AI model

[0195] Data processing and calculation:

[0196] Collecting data from input forms

[0197] Real-time information transfer to the server

[0198] Transferring data to generative AI models

[0199] Step 4: Generate a response using an AI model

[0200] Specific behavior:

[0201] 1. The server sends the received desired information to the generative AI model.

[0202] 2. The generative AI model generates a response based on the input information. Example: "Suggest tourist spots related to anime and manga."

[0203] 3. The server returns the generated response to the terminal.

[0204] 4. The terminal displays the response to the user.

[0205] Input: Desired information received by the generative AI model

[0206] Output: The generated interactive response

[0207] Data processing and calculation:

[0208] Analysis of desired information

[0209] Generate a response using a response generation algorithm

[0210] Step 5: Enter your desired details and submit

[0211] Specific behavior:

[0212] 1. The user inputs detailed information about their desired sightseeing spots, budget, dates, etc.

[0213] 2. The device sends this information to the server.

[0214] Input: Detailed desired information entered by the user

[0215] Output: Send detailed request information to the server

[0216] Data processing and calculation:

[0217] Collecting data from input forms

[0218] Real-time information transfer to the server

[0219] Step 6: Generate a sightseeing plan

[0220] Specific behavior:

[0221] 1. The server sends the detailed desired information to the generating AI model.

[0222] 2. The generative AI model generates a sightseeing itinerary based on the detailed information, including accommodation, transportation, and attraction admission tickets.

[0223] 3. The server sends the generated sightseeing plan to the terminal.

[0224] 4. The terminal displays the sightseeing plan to the user.

[0225] Input: Detailed desired information received by the generative AI model

[0226] Output: Generated itinerary

[0227] Data processing and calculation:

[0228] Analysis of detailed desired information

[0229] Generation of plans using a sightseeing plan generation algorithm

[0230] Step 7: Confirm and request a booking

[0231] Specific behavior:

[0232] 1. The user reviews the proposed itinerary, selects specific accommodations and attractions, and requests a reservation.

[0233] 2. The terminal sends this request information to the server.

[0234] 3. The server checks the availability of the selected facility or spot.

[0235] 4. If the reservation is confirmed, the server sends the reservation information to the partner and generates a completion notification.

[0236] 5. The terminal displays a completion notification to the user.

[0237] Input: Accommodations and attractions selected by the user, reservation request information

[0238] Output: Reservation confirmation and completion notification

[0239] Data processing and calculation:

[0240] Check availability of facilities and spots

[0241] Generate reservation information

[0242] Generate and send a completion notification

[0243] Step 8: Save and reuse your profile information

[0244] Specific behavior:

[0245] 1. The user chooses whether to save their counseling history and preferences.

[0246] 2. If the device chooses to store it, it sends this information to the server.

[0247] 3. The server stores the received information in a database.

[0248] 4. The next time the user uses the service, they will receive new counseling based on the profile information they saved last time.

[0249] Input: User's counseling history, preferences

[0250] Output: Profile information stored in a database for reuse

[0251] Data processing and calculation:

[0252] Counseling information data collection

[0253] Saving to a database

[0254] Reading and providing stored data

[0255] (Application example 1)

[0256] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0257] Conventional tourist information systems were limited in their ability to provide tour plans tailored to the wishes and needs of foreign tourists, and their multilingual support was insufficient. Providing detailed information about tour plans and reservation procedures was also cumbersome. Furthermore, they lacked efficient support for factory workers, making it difficult to provide multilingual work support or reuse work history. This resulted in problems that reduced the satisfaction and efficiency of tourists and workers.

[0258] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0259] In this invention, the server includes means for saving registration information of foreign tourists, means for interacting with foreign tourists and acquiring their preferences and needs, means for generating sightseeing plans based on the preferences and needs, means for providing detailed information about the generated sightseeing plans to foreign tourists, means for providing support in multiple languages, means for saving and reusing profile information of foreign tourists, means for providing sightseeing information in collaboration with local tourism businesses, means for responding to instructions and questions from workers in the factory and proposing optimal work plans in multiple languages, and means for saving work history and reusing it for future work plans. This makes it possible to propose sightseeing plans to foreign tourists and provide efficient work support to workers.

[0260] "Means for storing registration information of foreign tourists" refers to a method for storing basic information such as the name, age, and contact details of foreign tourists in a database.

[0261] "Means for interacting with foreign tourists and obtaining their preferences and needs" refers to an interface that interactively collects the wishes and interests entered by foreign tourists.

[0262] "Means for generating tourist plans based on the preferences and needs" refers to a method for creating tourist plans that meet the preferences and needs of foreign tourists using AI models or other algorithms.

[0263] The "means for providing detailed information about the created sightseeing plan to foreign tourists" is a method for notifying foreign tourists of the details of the created sightseeing plan.

[0264] "Means of providing support in multiple languages" refers to technology that enables the provision of information and dialogue in the languages ​​used by foreign tourists.

[0265] "Means for storing and reusing profile information of foreign tourists" refers to a method for storing past counseling history and preference information in a database and using it for future suggestions and counseling.

[0266] "Means for providing tourism information in partnership with local tourism businesses" refers to a method for providing comprehensive tourism information by partnering with local tourism businesses and incorporating their information into the system.

[0267] "A means of responding to instructions and questions from workers inside the factory and proposing optimal work plans in multiple languages" is a method in which workers inside the factory give instructions and ask questions in multiple languages, and based on that information, an optimal work plan is created and provided.

[0268] "Means for saving work history and reusing it for future work plans" refers to a method for saving past work history in a database and using it to create future work plans.

[0269] The system of this invention provides tourist information to foreign tourists and supports factory workers. The system operates in cooperation with three elements: a server, a terminal, and a user.

[0270] System configuration and data processing

[0271] The server includes the following means:

[0272] 1. A means of storing registration information of foreign tourists

[0273] The server stores basic information such as the name, age, and contact details of foreign tourists in a database. This database can be created using MySQL or Firebase.

[0274] 2. A means of communicating with foreign tourists and learning about their preferences and needs

[0275] The server receives input from users in real time and analyzes the information to obtain their preferences and needs. Users input information by voice or text using their smartphones or tablets.

[0276] 3. A way to generate itineraries based on preferences and needs

[0277] The server automatically generates a sightseeing plan based on the acquired preferences and needs using a generative AI model such as OpenAI GPT-3.

[0278] 4. Means of providing detailed information about the generated travel plans to foreign tourists

[0279] The server sends the generated sightseeing plan to the user's terminal and provides detailed information, including information on accommodations, tourist spots, and transportation options.

[0280] 5. Multilingual support options

[0281] The server provides information corresponding to the language selected by the user, and is capable of providing dialogue and guidance in multiple languages.

[0282] 6. Means of storing and reusing foreign tourist profile information

[0283] The server stores past counseling history and preference information in a database and reuses it for the next proposal or counseling session.

[0284] 7. Means of providing tourism information in partnership with local tourism businesses

[0285] The server incorporates tourist information provided in partnership with local tourist businesses into the system and provides comprehensive tourist information to users.

[0286] 8. A means of responding to instructions and questions from workers inside the factory and proposing optimal work plans in multiple languages

[0287] The server allows factory workers to give instructions and ask questions in multiple languages, and based on that information, it uses a generative AI model to create and propose optimal work plans.

[0288] 9. A way to save work history and reuse it for future work planning

[0289] The server stores past work history in a database and uses it to create future work plans.

[0290] Specific examples

[0291] For example, if a foreign tourist inputs "I want to stay in Tokyo for a week. I like anime and manga," the server will use the generative AI model to suggest a sightseeing plan including tourist attractions, accommodations, and transportation. The user can select a plan and proceed with details and reservations.

[0292] In the factory, a worker can ask, "The next step will use part X, which will take about 30 minutes. What is the next step?" The server uses a generative AI model to suggest optimal work steps in multiple languages, and uses work history for future planning.

[0293] Prompt Sentence Examples

[0294] Current work:

[0295] 1. Attach part X

[0296] 2. Use a tightening tool

[0297] 3. Once completed, what are the next steps?

[0298] budget:

[0299] Within 1 hour

[0300] Hope:

[0301] Work efficiently and injury-free

[0302] In this way, the server can utilize the generative AI model to provide effective tourist information and work support in multiple languages.

[0303] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0304] Step 1:

[0305] The user enters the registration information and sends it to the server via the terminal.

[0306] Input: The user enters registration information such as name, age, and contact details.

[0307] Data processing: The terminal formats the information entered by the user and sends it to the server.

[0308] Output: The server saves the registration information in the database and generates a registration complete message.

[0309] Step 2:

[0310] The user initiates a dialogue and inputs their wishes and questions regarding sightseeing or work.

[0311] Input: The user interactively inputs desired content or questions using text or voice.

[0312] Data processing: The terminal converts the input into text format and sends it to the server.

[0313] Output: The server analyzes the input and extracts the user's preferences and needs.

[0314] Step 3:

[0315] The server generates a sightseeing plan or a work plan using the generative AI model.

[0316] Input: Data analyzed to identify user preferences and needs.

[0317] Data calculation: The server uses a generative AI model (e.g., OpenAI GPT-3) to generate a sightseeing or work plan based on the user's input, specifically suggesting relevant tourist spots and efficient work procedures.

[0318] Output: The generated sightseeing plan or work plan is output in text format.

[0319] Step 4:

[0320] The server provides the user with detailed information about the generated plan.

[0321] Input: Generated tourism plan or work plan.

[0322] Data processing: The server formats the detailed information and sends it to the user's device, such as tourist destination details, accommodation ratings, and transportation options.

[0323] Output: The terminal displays this information to the user.

[0324] Step 5:

[0325] The user checks the plan and makes the necessary reservations and procedures.

[0326] Input: The user selects a specific plan (reserving accommodation, purchasing tickets to a tourist attraction, etc.).

[0327] Data calculation: The server performs the reservation procedure based on the selected plan, checks availability, and confirms the reservation.

[0328] Output: Notify the user that the reservation or procedure is complete.

[0329] Step 6:

[0330] The server stores the user's counseling history and work history.

[0331] Input: User's counseling or work history.

[0332] Data processing: The server stores this information in a database and tags and categorizes it for reuse the next time.

[0333] Output: Confirm that the history information has been saved for future use.

[0334] Step 7:

[0335] The server reuses the saved history information the next time you use the server.

[0336] Input: Past counseling history and work history.

[0337] Data calculation: The server uses the historical information as a reference when creating new suggestions for the user.

[0338] Output: New suggestions for efficient counseling and work support are generated.

[0339] Through this series of processes, the server can utilize the generative AI model to provide users with tourist information and work support efficiently and in multiple languages.

[0340] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0341] The present invention relates to a computer system for providing tourist information for foreign tourists, and in particular to a system that interacts with foreign tourists and proposes sightseeing plans in multiple languages ​​that meet their preferences and needs. Furthermore, by combining the system with an emotion engine that recognizes the user's emotions, the user experience can be further improved. Specific embodiments for carrying out the present invention are described below.

[0342] System Overview

[0343] The system includes the following main components:

[0344] 1. User terminal: Devices accessed by foreign tourists (PC, smartphone, tablet, etc.)

[0345] 2. Server: The central computer server of the system

[0346] 3. Database: A data store that stores user information, travel plans, partner information, etc.

[0347] 4. Generative AI Model: Conversational AI for generating sightseeing itineraries

[0348] 5. Emotion Engine: Recognizes user emotions and tailors suggestions based on the conversation

[0349] System Embodiments

[0350] User Registration and Login

[0351] When a user first uses the device, they enter their registration information, such as their name, email address, and password. The device sends this information to the server, which stores it in a database. Once registration is complete, the user logs in using their registration information, and the server verifies the authentication information and starts the session.

[0352] Counseling begins and conversations begin

[0353] The user starts a counseling session and inputs their sightseeing preferences. For example, "I would like to experience traditional culture in Kyoto." The device sends this information to the server in real time, and the server sends the user's input to the generative AI model. The generative AI model generates a conversational response based on the user's input, such as "I recommend a tea ceremony experience and a tour of temples. I can also help with hotel accommodations and transportation." The device displays this response to the user.

[0354] Emotion recognition and suggestion adjustment by emotion engine

[0355] The emotion engine recognizes emotions from user input, voice, facial expressions, etc. For example, if a user inputs, "It's probably going to be crowded again," the emotion engine recognizes this as a negative emotion. This information is sent to the server, and the generation AI generates a different suggestion based on this emotion. For example, it might respond, "I'll introduce you to some hidden spots with fewer tourists." The device then displays this response to the user.

[0356] Generate a sightseeing plan

[0357] The user then enters more detailed information, specifying specific tourist attractions, budget, and itinerary. The device then sends this information to the server, which then uses a generation AI to generate a sightseeing plan. This plan is customized based on the user's preferences and feelings, and includes information on accommodation, transportation, and admission tickets to tourist attractions. The generated sightseeing plan is then sent to the device and displayed to the user.

[0358] Completing the reservation

[0359] The user reviews the details of the proposed itinerary, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and tourist destinations. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a completion notification. The device displays this notification to the user.

[0360] Save and reuse profiles

[0361] Before logging out, users can choose whether to save their counseling history and preference information. The device sends this information to the server, which stores it in a database. The next time users use the service, they can reuse this information, enabling more efficient counseling and sightseeing plans.

[0362] Specific examples

[0363] For example, a first-time user might input their desire to "experience traditional culture in Kyoto." The server then uses the generation AI to suggest a plan that includes tourist spots, suitable accommodations, and transportation. If the emotion engine recognizes that the user's input indicates excitement, the generation AI will suggest additional recommended spots.

[0364] Repeat users can also request, "Next, I'd like to enjoy the latest entertainment in Tokyo," based on their previously saved profile information. The server uses generative AI to create new suggestions based on past counseling history, and if the emotion engine recognizes "anxiety," it will suggest times to avoid crowds and hidden spots. This allows users to plan their trip with greater peace of mind.

[0365] In this way, the present invention is a system that generates customized sightseeing plans for foreign tourists, improves the user experience by adding an emotion engine, removes language barriers, and provides a special sightseeing experience, thereby significantly improving the satisfaction of foreign tourists.

[0366] The processing flow will be explained below.

[0367] Step 1:

[0368] When using the service for the first time, the user enters registration information (name, email address, password).

[0369] Step 2:

[0370] The terminal transmits the entered registration information to the server.

[0371] Step 3:

[0372] The server stores the received registration information in a database.

[0373] Step 4:

[0374] The server sends a notification of registration completion to the terminal.

[0375] Step 5:

[0376] The user receives a notification that registration is complete and logs in.

[0377] Step 6:

[0378] The terminal sends login information (email address, password) to the server.

[0379] Step 7:

[0380] The server verifies the login information and, if authentication is successful, begins the session.

[0381] Step 8:

[0382] The user starts a counseling session and inputs their desired sightseeing information, for example, "I would like to experience traditional culture in Kyoto."

[0383] Step 9:

[0384] The terminal transmits the desired information input by the user to the server.

[0385] Step 10:

[0386] The server sends the user's desired information to the generation AI, which generates an interactive response.

[0387] Step 11:

[0388] For example, the generative AI can generate a response such as, "We recommend a tea ceremony experience or a temple tour. We can also help you with hotel accommodations and transportation."

[0389] Step 12:

[0390] The server sends the generated response to the terminal.

[0391] Step 13:

[0392] The terminal displays the generated response to the user.

[0393] Step 14:

[0394] The emotion engine recognizes emotions from user input, facial expressions, etc. For example, if a user inputs "It's probably going to be crowded again," it will recognize a negative emotion.

[0395] Step 15:

[0396] The server sends the emotion information recognized by the emotion engine to the generation AI.

[0397] Step 16:

[0398] Based on emotional information, the generative AI generates a response such as, "I'll introduce you to some hidden spots with fewer tourists."

[0399] Step 17:

[0400] The server sends the generated response to the terminal.

[0401] Step 18:

[0402] The terminal displays the generated response to the user.

[0403] Step 19:

[0404] The user then enters more detailed requests (specific tourist spots, budget, dates, etc.).

[0405] Step 20:

[0406] The terminal transmits detailed desired information to the server.

[0407] Step 21:

[0408] The server uses AI to generate a sightseeing plan based on detailed desired information.

[0409] Step 22:

[0410] The generative AI generates a customized sightseeing plan based on the user's wishes and feelings, making suggestions including information on accommodation, transportation, and admission tickets to tourist attractions.

[0411] Step 23:

[0412] The server transmits the generated sightseeing plan to the terminal.

[0413] Step 24:

[0414] The terminal displays the generated sightseeing plan to the user.

[0415] Step 25:

[0416] The user reviews the details of the proposed tour plan, selects a specific hotel, and requests a reservation.

[0417] Step 26:

[0418] The terminal transmits the user's reservation request to the server.

[0419] Step 27:

[0420] The server checks availability of the selected accommodations and tourist destinations.

[0421] Step 28:

[0422] The server confirms the reservation and sends the reservation information to the partner.

[0423] Step 29:

[0424] The server sends a reservation completion notification to the terminal.

[0425] Step 30:

[0426] The terminal displays a notification to the user that the reservation is complete.

[0427] Step 31:

[0428] Before logging out, the user has the option to save their counseling history and preferences.

[0429] Step 32:

[0430] The terminal transmits the profile information to be saved to the server.

[0431] Step 33:

[0432] The server stores the profile information and counseling history in a database.

[0433] Step 34:

[0434] The next time the user uses the service, the server will provide efficient counseling and suggest sightseeing plans based on the saved profile information.

[0435] Example 2

[0436] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0437] Conventional tourist information systems for foreign tourists have difficulty proposing sightseeing plans that meet the individual preferences and needs of users, and do not adjust the proposals to take into account the user's emotional state. As a result, there are problems with user satisfaction and a poor user experience.

[0438] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0439] A means for storing registration information of foreign tourists;

[0440] A means of communicating with foreign tourists and obtaining information on their preferences and needs;

[0441] means for generating a sightseeing plan based on said preferences and needs;

[0442] A means for providing detailed information about the generated travel plans to foreign tourists;

[0443] Multilingual support options and

[0444] a means of storing and reusing foreign tourist profile information;

[0445] A means of providing tourism information in partnership with local tourism businesses;

[0446] A means of recognizing tourists' emotions and adjusting the content of the offers;

[0447] This allows for customized sightseeing plans based on the user's preferences and needs, as well as tailoring suggestions to suit the user's emotional state.

[0448] "Foreign tourists" are travelers visiting a country other than their own.

[0449] "Registration information" refers to information such as name, email address, and password that a user enters when using the service for the first time.

[0450] "Interaction" refers to the process by which a computer system and a user interact with each other.

[0451] "Preferences and needs" refers to the user's individual requests and needs, such as desired tourist destinations, experiences, and itineraries.

[0452] "Sightseeing Plan" means a travel plan including attractions, accommodations, transportation, and other necessary details generated based on the user's preferences and needs.

[0453] "Multilingual support" is a function that provides guidance and responses to users in multiple languages.

[0454] "Profile information" refers to information about a user's past usage history and preferences.

[0455] "Local tourism operators" are companies or individuals that provide tourism services in a particular tourist destination.

[0456] "Emotion recognition" is a technology that detects a user's emotional state from input, voice, facial expressions, etc.

[0457] "Recommendation adjustment" refers to the process of changing and adapting recommended sightseeing itineraries and travel suggestions based on the user's emotional state.

[0458] The present invention relates to a computer system for providing tourist information for foreign tourists, and in particular to a system that interacts with foreign tourists and proposes sightseeing plans in multiple languages ​​that meet their preferences and needs. Furthermore, by combining the system with an emotion engine that recognizes the user's emotions, the user experience can be further improved. Specific embodiments for carrying out the present invention are described below.

[0459] Key components of the system

[0460] 1. User terminal: Devices accessed by foreign tourists (PC, smartphone, tablet, etc.)

[0461] 2. Server: The central computer server of the system

[0462] 3. Database: A data store that stores user information, travel plans, partner information, etc.

[0463] 4. Generative AI Model: Conversational AI for generating sightseeing itineraries

[0464] 5. Emotion Engine: Recognizes user emotions and tailors suggestions based on the conversation

[0465] User Registration and Login

[0466] When a user first uses the device, they enter their registration information, such as their name, email address, and password. The device sends this information to the server, which stores it in a database. Once registration is complete, the user logs in, and the server verifies the authentication information and starts the session.

[0467] Counseling begins and conversations begin

[0468] The user starts a counseling session and inputs their sightseeing preferences. For example, they might say, "I'd like to experience traditional culture in Kyoto." The device sends this information to the server in real time, and the server sends the user's preferences in the form of prompts to the generative AI model. The generative AI model generates a conversational response based on the user's input, such as, "I recommend a tea ceremony experience and a tour of temples. I can also help you with hotel accommodations and transportation." The device then displays this response to the user.

[0469] Emotion recognition and suggestion adjustment by emotion engine

[0470] The emotion engine recognizes emotions from user input, voice, facial expressions, etc. For example, if a user inputs, "It's probably going to be crowded again," the emotion engine recognizes negative emotions. The device sends this emotional information to the server, which then has the generative AI model create new suggestions that take emotion into account. For example, the server might respond, "I'll introduce you to some hidden spots with fewer tourists." The device then displays this new suggestion to the user.

[0471] Generate a sightseeing plan

[0472] The user then enters more detailed information, including specific tourist attractions, budget, and itinerary. The device then sends this information to the server, which then uses the generative AI model to generate a detailed itinerary, including information on accommodation, transportation, and admission tickets to tourist attractions. The generated itinerary is then sent to the device and displayed to the user.

[0473] Completing the reservation

[0474] The user reviews the details of the proposed travel plan, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and tourist destinations. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a reservation completion notification. The device displays this notification to the user.

[0475] Save and reuse profiles

[0476] Before logging out, users can choose whether to save their counseling history and preference information. The device sends this information to the server, which then stores it in a database. The next time the user uses the service, they can reuse the saved information to receive more efficient counseling.

[0477] Specific examples

[0478] First-time use example

[0479] Example: A user inputs a request such as "I would like to experience traditional culture in Kyoto."

[0480] The terminal sends this information to the server.

[0481] The server sends the desired content to the generative AI model in the form of a prompt. An example of a prompt is: "The user wants to experience traditional culture in Kyoto. Please generate the optimal sightseeing plan for this."

[0482] The generative AI model generates a plan that includes tourist attractions, suitable accommodations, and transportation. An example of a generated response is, "We suggest a tea ceremony experience, a tour of temples, and a traditional craft workshop."

[0483] The terminal displays the generated plan to the user.

[0484] Examples of repeat use

[0485] Example: A repeat user requests, "Next time, I'd like to enjoy the latest entertainment in Tokyo."

[0486] The terminal sends this information to the server.

[0487] The server sends a request to the generative AI model that takes into account the user's past counseling history. An example of a prompt sentence is: "The user has previously enjoyed traditional culture in Kyoto. This time, the user wants to experience new entertainment in Tokyo."

[0488] The generative AI model generates new itineraries based on past history and new requests.

[0489] The terminal displays the generated plan to the user.

[0490] If any anxiety about the plan is detected (e.g., "Is it going to be crowded?"), the server resubmits the emotion recognition information to the generative AI model, which then suggests timings and hidden spots to avoid crowds. This is how the final recommendation is created.

[0491] The terminal displays the final proposal to the user.

[0492] As described above, the present invention is a system that generates customized sightseeing itineraries for foreign tourists and dramatically improves the user experience by including emotion recognition.

[0493] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0494] Step 1: User Registration

[0495] When a user uses the device for the first time, they enter registration information such as their name, email address, and password. The device then sends this information to the server, which then stores the received information in a database. This completes the user's registration.

[0496] Input: Name, Email Address, Password

[0497] Data processing: Convert input information into JSON format and send it to the server

[0498] Output: Registration information is saved in the database

[0499] Step 2: Log in

[0500] The user logs in using their registration information. The terminal sends the entered authentication information to the server. The server verifies the authentication information and, if valid, starts a session.

[0501] Input: Name, Password

[0502] Data calculation: authentication information verification, database matching

[0503] Output: Session started

[0504] Step 3: Counseling begins

[0505] The user starts a counseling session and inputs their desired tourist information. For example, they might input a preference such as "I would like to experience traditional culture in Kyoto." The device sends this information in real time to the server, which then sends the user's desired information in the form of prompts to the generative AI model.

[0506] Input: desired tourist information

[0507] Data processing: Convert into prompt sentence format and send to generative AI model

[0508] Output: Input data for the generative AI model is created

[0509] Step 4: Generative AI model generates interactive responses

[0510] The server sends a prompt to the generative AI model, which generates a conversational response based on the user's input. For example, it might respond, "We recommend a tea ceremony experience or a temple tour." The device then displays this response to the user.

[0511] Input: prompt statement

[0512] Data Computation: Response Generation with Generative AI Models

[0513] Output: Interactive response (e.g. "I recommend experiencing a tea ceremony and visiting temples.")

[0514] Step 5: Emotion Recognition

[0515] The emotion engine recognizes emotions from user input, voice, facial expressions, etc. For example, if a user inputs "It's probably going to be crowded again," it recognizes negative emotions. The device then sends this emotional information to the server.

[0516] Input: User emotion data (text, voice, facial expressions)

[0517] Data Computing: Applying Emotion Recognition Algorithms

[0518] Output: Emotional information (e.g., negative emotions)

[0519] Step 6: Adjust your proposal

[0520] The server provides the emotion information to the generative AI model, which then generates new suggestions that take emotion into account. For example, it might respond, "We'll introduce you to some hidden spots with fewer tourists." The device then displays the new suggestions to the user.

[0521] Input: Emotion information

[0522] Data Computation: Re-proposal Generation with Generative AI Models

[0523] Output: New proposal (e.g., "I'll introduce you to some hidden spots with few tourists")

[0524] Step 7: Setting up your itinerary

[0525] The user further inputs detailed preferences (tourist attractions, budget, schedule, etc.). The device sends this information to the server. The server uses a generative AI model to generate a detailed sightseeing plan. This plan includes information on accommodation, transportation, and admission tickets to tourist attractions. The generated sightseeing plan is sent to the device and displayed to the user.

[0526] Input: Detailed desired information

[0527] Data processing: Generating a sightseeing plan using a generative AI model

[0528] Output: Detailed itinerary

[0529] Step 8: Complete your booking

[0530] The user checks the details of the proposed travel plan, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and tourist destinations. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a reservation completion notification. The device displays this notification to the user.

[0531] Input: Reservation request information

[0532] Data calculation: Check availability, generate and send reservation information

[0533] Output: Reservation completion notification

[0534] Step 9: Saving and Reusing Profiles

[0535] Before logging out, the user can choose whether to save their counseling history and preference information. The device sends this information to the server, which then stores it in a database. The next time the user uses the service, they can reuse the saved information to receive more efficient counseling.

[0536] Input: Profile information to save

[0537] Data processing: Saving profile information

[0538] Output: Saved profile information

[0539] Through these processing steps, the system can not only provide customized sightseeing plans based on the user's preferences and needs, but also adjust suggestions based on emotion recognition, greatly improving the user experience.

[0540] (Application example 2)

[0541] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0542] Foreign tourists often feel anxious about their experiences in the countries they visit due to language barriers and cultural differences. Collecting tourist information quickly and efficiently and providing customized tour plans tailored to individual needs and preferences is also a challenge. Furthermore, there is a demand for a system that can automatically adjust suggestions in response to emotional changes during the tour. In particular, there is a desire for autonomous vehicles to provide tourist information at tourist destinations.

[0543] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0544] In this invention, the server includes means for saving registration information of foreign tourists, means for interacting with foreign tourists and acquiring their preferences and needs, means for generating sightseeing plans based on the preferences and needs, means for providing detailed information about the generated sightseeing plans to foreign tourists, means for providing support in multiple languages, means for saving and reusing profile information of foreign tourists, means for providing sightseeing information in collaboration with local tourism businesses, means for performing emotion recognition and adjusting suggestions according to the user's emotions, and means for providing sightseeing guides for autonomous vehicles. This allows foreign tourists to enjoy sightseeing with peace of mind, and makes it possible to easily provide sightseeing plans that meet their individual needs and preferences.

[0545] "Foreign tourists" refers to travelers visiting a country other than their home country.

[0546] "Tourist information" refers to information about tourist attractions, accommodation, transportation, restaurants, leisure activities, etc.

[0547] A "computer system" refers to an information processing system in which multiple components and devices function in cooperation with one another.

[0548] "Registration Information" refers to basic personal information such as a User's name, email address, and password.

[0549] "Preferences and needs" refers to the specific requests and desires of users regarding the experiences they desire and the services they expect.

[0550] A "tourist plan" refers to a specific travel plan that includes the order in which tourist spots are visited, accommodation, transportation, restaurants, etc.

[0551] "Emotion recognition" refers to the technology of identifying emotions from a user's voice, facial expressions, text input, etc.

[0552] "Multilingual support" refers to the ability to provide information and user interfaces in multiple languages.

[0553] "Profile information" refers to personal information such as a user's past behavioral history, preferences, needs, etc.

[0554] "Local tourism operators" refer to companies and organizations that provide services in tourist destinations.

[0555] An "autonomous vehicle" refers to a vehicle that operates autonomously without human operation.

[0556] "Tourist information" refers to providing information about tourist spots and giving tour instructions.

[0557] In this invention, we will explain how to specifically realize a tourist information system for self-driving vehicles provided to foreign tourists.

[0558] System Overview

[0559] The system includes the following main components:

[0560] 1. User terminal: Device accessed by foreign tourists (smart glasses)

[0561] 2. Server: The central computer server of the system

[0562] 3. Database: A data store that stores user information, travel plans, partner information, etc.

[0563] 4. Generative AI Model: Conversational AI for generating sightseeing itineraries

[0564] 5. Emotion Engine: Recognizes user emotions and tailors suggestions based on the conversation

[0565] 6. Autonomous Driving Navigation: A navigation system for autonomous vehicles to travel around tourist spots

[0566] System Embodiments

[0567] User Registration and Login

[0568] When a user first uses the device, they enter their registration information, such as their name, email address, and password. The device sends this information to the server, which stores it in a database. Once registration is complete, the user logs in using their registration information, and the server verifies the authentication information and starts the session.

[0569] Counseling begins and conversations begin

[0570] The user starts a counseling session and inputs their sightseeing preferences. For example, "I would like to experience traditional culture in Kyoto." The device sends this information to the server in real time, and the server sends the user's input to the generative AI model. The generative AI model generates a conversational response based on the user's input, such as "I recommend a tea ceremony experience and a tour of temples. I can also help with accommodation and transportation." The device displays this response to the user.

[0571] Emotion recognition and suggestion adjustment by emotion engine

[0572] The emotion engine recognizes emotions from user input, voice, facial expressions, etc. For example, if a user inputs, "It's probably going to be crowded again," the emotion engine recognizes this as a negative emotion. This information is sent to the server, and the generation AI generates a different suggestion based on this emotion. For example, it might respond, "I'll introduce you to some hidden spots with fewer tourists." The device then displays this response to the user.

[0573] Self-driving navigation settings

[0574] Once the user's sightseeing plan is finalized, the server sends route information to the autonomous driving navigation system to set the order in which the tourist spots are to be visited. The autonomous driving vehicle then travels around the tourist spots according to this route information.

[0575] Specific examples

[0576] For example, a first-time user might input their desire to "experience traditional culture in Kyoto." The server uses the generation AI to propose a plan that includes tourist spots, suitable accommodations, and transportation. If the emotion engine recognizes that the user's input indicates excitement, the generation AI will suggest additional recommended spots. The following prompt sentences are possible user inputs:

[0577] User input: "I want to experience traditional tea ceremony in Kyoto."

[0578] Server response: "We suggest a tea ceremony experience at a famous temple, followed by a leisurely tour of nearby temples and a visit to a traditional craft workshop."

[0579] The above is a specific embodiment for carrying out the present invention. By using this system, foreign tourists can enjoy sightseeing with peace of mind, and it is possible to easily provide sightseeing plans that meet individual needs and preferences.

[0580] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0581] Step 1:

[0582] When a user first uses a device, they enter their registration information, such as their name, email address, and password. This information is sent from the device to the server, which stores it in a database. The user then enters their login information for authentication, and the server verifies the authentication information and starts the session.

[0583] Input: Name, Email Address, Password

[0584] Output: User information stored in database, session started

[0585] Step 2:

[0586] The user starts a counseling session on the device and inputs their desired tourist information. This input information is sent from the device to the server in real time, and the server sends the user's desired information to the generative AI model. The generative AI model generates an interactive response based on the user's input and sends it to the device. This response is then displayed to the user.

[0587] Input: User's desired information (e.g., I want to experience traditional culture in Kyoto)

[0588] Output: A conversational response from the generative AI model (e.g., recommending tea ceremony experiences and temple tours. We can also help with accommodation and transportation)

[0589] Step 3:

[0590] The emotion engine recognizes emotions from the user's input, voice, facial expressions, etc. The recognition results are sent to the server, and the generation AI generates suggestions based on the emotion. For example, if the user expresses negative emotions, it generates a response such as "I'll introduce you to some hidden spots with fewer tourists." The device displays this response to the user.

[0591] Input: User's sentiment (e.g., "It's probably going to be crowded again").

[0592] Output: Suggestions from generative AI based on emotions (e.g., hidden spots with few tourists)

[0593] Step 4:

[0594] Once the user's sightseeing plan is finalized, the server sends route information to the autonomous driving navigation system to set the order in which the tourist spots are to be visited. The autonomous driving vehicle then travels around the tourist spots according to this route information.

[0595] Input: Confirmed sightseeing plan (sightseeing spot order)

[0596] Output: Route information for the autonomous driving navigation system

[0597] Step 5:

[0598] While sightseeing, the emotion engine continues to recognize the user's emotions in real time as the self-driving vehicle travels along the designated route. The recognition results are sent to the server, and the content of the sightseeing guide is adjusted accordingly. If the emotion is positive, the sightseeing guide continues, and if it is negative, new suggestions are made.

[0599] Input: Real-time user sentiment

[0600] Output: Adjustment of tourist information according to emotions, feedback to the user

[0601] Step 6:

[0602] After completing their visit, users can choose to save their counseling history and preferences on their device. The selected information is sent from the device to the server and stored in a database. This information can be reused the next time the user visits.

[0603] Input: Post-tour counseling history and preference save selection

[0604] Output: History information and preferences stored in a database

[0605] This allows users to enjoy an efficient and personalized tourism experience.

[0606] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0607] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0608] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0609] [Second embodiment]

[0610] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0611] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0612] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0613] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0614] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0615] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0616] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0617] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0618] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0619] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0620] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0621] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0622] The present invention relates to a computer system for providing tourist information for foreign tourists, and in particular to a system that interacts with foreign tourists and proposes sightseeing plans in multiple languages ​​that meet their preferences and needs. Specific embodiments for carrying out the present invention are described below.

[0623] System Overview

[0624] The system includes the following main components:

[0625] 1. User terminal: Devices accessed by foreign tourists (PC, smartphone, tablet, etc.)

[0626] 2. Server: The central computer server of the system

[0627] 3. Database: A data store that stores user information, travel plans, partner information, etc.

[0628] 4. Generative AI Model: Conversational AI for generating sightseeing itineraries

[0629] System Embodiments

[0630] User Registration and Login

[0631] When a user first uses the device, they enter their registration information, such as their name, email address, and password. The device sends this information to the server, which stores it in a database. Once registration is complete, the user logs in using their registration information, and the server verifies the authentication information and starts the session.

[0632] Counseling begins and conversations begin

[0633] The user starts a counseling session and inputs their desired sightseeing information. For example, "I'd like to stay in Tokyo for a week. I like anime and manga." The device sends this information to the server in real time, and the server sends the user's input to the generative AI model. The generative AI model generates an interactive response based on the user's input, such as "I'll suggest sightseeing spots related to anime and manga. I can also help you with hotels and transportation." The device displays this response to the user.

[0634] Generate a sightseeing plan

[0635] The user then enters further details of their preferences, such as specific tourist spots, budget, and itinerary. The device sends this information to the server, which then uses a generation AI to generate a sightseeing plan. This sightseeing plan is customized based on the user's preferences and includes information on accommodation, transportation, and admission tickets to tourist attractions. The generated sightseeing plan is then sent to the device and displayed to the user.

[0636] Completing the reservation

[0637] The user checks the details of the proposed tour plan, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and tourist destinations. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a completion notification. The device displays this notification to the user.

[0638] Save and reuse profiles

[0639] Before logging out, users can choose whether to save their counseling history and preference information. The device sends this information to the server, which stores it in a database. The next time users use the service, they can reuse this information, enabling more efficient counseling and sightseeing plans.

[0640] Specific examples

[0641] For example, a first-time user might input their request, "I'd like to stay in Tokyo for a week. I like anime and manga." The server uses a generative AI to propose a plan including tourist spots, suitable accommodations, and transportation, and then selects a specific hotel from the proposed plan and requests a reservation. The server then confirms the reservation and notifies the user.

[0642] Repeat users can also request, "Next time, I'd like to experience traditional culture in Kyoto," based on their previously saved profile information. The server uses generative AI to create a new proposal based on past counseling history and provides it to the user. The user customizes the proposal, selects details, and requests a reservation. The server then confirms the reservation and notifies the user.

[0643] In this way, the present invention is a system that generates customized sightseeing plans for foreign tourists, removes language barriers, and provides special sightseeing experiences, thereby improving the satisfaction of foreign tourists.

[0644] The processing flow will be explained below.

[0645] Step 1:

[0646] When using the service for the first time, the user enters registration information (name, email address, password).

[0647] Step 2:

[0648] The terminal transmits the entered registration information to the server.

[0649] Step 3:

[0650] The server stores the received registration information in a database.

[0651] Step 4:

[0652] The server sends a notification of registration completion to the terminal.

[0653] Step 5:

[0654] The user receives a notification that registration is complete and logs in using the registration information.

[0655] Step 6:

[0656] The terminal sends login information (email address, password) to the server.

[0657] Step 7:

[0658] The server verifies the login information and, if authentication is successful, begins the session.

[0659] Step 8:

[0660] The user begins a counseling session and inputs their sightseeing preferences.

[0661] Step 9:

[0662] The terminal transmits the desired information input by the user to the server.

[0663] Step 10:

[0664] The server sends the user's desired information to the generation AI, which generates an interactive response.

[0665] Step 11:

[0666] The generative AI generates responses such as, "We'll suggest tourist spots related to anime and manga. We can also help you with hotels and transportation."

[0667] Step 12:

[0668] The server sends the generated response to the terminal.

[0669] Step 13:

[0670] The terminal displays the generated response to the user.

[0671] Step 14:

[0672] The user then enters more detailed requests (specific tourist spots, budget, dates, etc.).

[0673] Step 15:

[0674] The terminal transmits detailed desired information to the server.

[0675] Step 16:

[0676] The server uses AI to generate a sightseeing plan based on detailed desired information.

[0677] Step 17:

[0678] The generative AI generates a customized sightseeing plan based on the user's preferences, including information on accommodation, transportation, and admission tickets to tourist attractions.

[0679] Step 18:

[0680] The server transmits the generated sightseeing plan to the terminal.

[0681] Step 19:

[0682] The terminal displays the generated sightseeing plan to the user.

[0683] Step 20:

[0684] The user reviews the details of the proposed tour plan, selects a specific hotel, and requests a reservation.

[0685] Step 21:

[0686] The terminal transmits the user's reservation request to the server.

[0687] Step 22:

[0688] The server checks availability of the selected accommodations and tourist destinations.

[0689] Step 23:

[0690] The server confirms the reservation and sends the reservation information to the partner.

[0691] Step 24:

[0692] The server sends a reservation completion notification to the terminal.

[0693] Step 25:

[0694] The terminal displays a notification to the user that the reservation is complete.

[0695] Step 26:

[0696] Before logging out, the user has the option to save their counseling history and preferences.

[0697] Step 27:

[0698] The terminal transmits the profile information to be saved to the server.

[0699] Step 28:

[0700] The server stores the profile information and counseling history in a database.

[0701] Step 29:

[0702] The next time the user uses the service, the server will provide efficient counseling and suggest sightseeing plans based on the saved profile information.

[0703] Example 1

[0704] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0705] In recent years, with the increase in foreign tourists, the provision of information about tourist destinations and reservation procedures have become more complicated. In particular, providing multilingual support and proposing tour plans tailored to individual needs has become a major burden for many tourism operators. In addition, tourists themselves find it time-consuming to gather information and make reservations, making it difficult for them to enjoy sightseeing smoothly. To solve these problems, an efficient and effective information provision and reservation system that can meet the diverse needs of foreign tourists is required.

[0706] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0707] In this invention, the server includes: means for storing registration information of foreign tourists; means for interacting with foreign tourists to acquire their preferences and needs; means for using a generative AI model to generate a tour plan based on the preferences and needs; means for presenting detailed information about the generated tour plan to foreign tourists; means for providing support in multiple languages; means for managing reservation information for accommodations, transportation, and tourist attractions in tourist destinations; means for saving and reusing foreign tourists' profile information; means for transferring desired information to the server in real time and generating and providing interactive responses; and means for providing tour information in collaboration with local tourism operators. This allows foreign tourists to easily obtain tour plans that suit their preferences and needs and makes reservations smoothly. Furthermore, operators can efficiently provide information in multiple languages ​​and according to individual requests.

[0708] "Foreign tourists" are tourists whose nationality is different from that of the country of the tourist destination they are visiting.

[0709] "Registration information" refers to personal information such as name, email address, and password that foreign tourists provide prior to using the system.

[0710] "Means of dialogue" refers to the function of exchanging information with foreign tourists via text or voice.

[0711] "Preferences and needs" refers to the personal requests and preferences of foreign tourists, such as the tourist destinations and activities they wish to visit, their budget, and the length of their stay.

[0712] A "generative AI model" is an artificial intelligence algorithm that generates tourist plans based on input data.

[0713] A "tourism plan" is a plan that includes tourist attractions, activities, accommodation, transportation, etc. proposed based on the preferences and needs of foreign tourists.

[0714] "Means of providing support in multiple languages" refers to the function of providing information and dialogue responses to foreign tourists in multiple languages.

[0715] "Accommodation facilities" refer to facilities such as hotels, inns, and hostels where foreign tourists can stay at their destination.

[0716] "Transportation" refers to services such as public transportation and rental cars used to travel to and within tourist destinations.

[0717] "Tourist spots" are places and facilities that are particularly worth seeing within a tourist destination.

[0718] "Means for managing reservation information" refers to the function of recording and managing reservation status for accommodations, transportation, and tourist attractions.

[0719] "Profile information" refers to stored personal data such as a foreign tourist's past counseling history, preferences, and request information.

[0720] "Means for transferring desired information to the server in real time" refers to a function that instantly transmits desired information entered by foreign tourists to the server.

[0721] "Means for generating and providing interactive responses" refers to a function that uses a generative AI model to generate responses based on input information in real time and provide them to foreign tourists.

[0722] "Local tourism operators" are businesses that provide services such as accommodation, transportation, and activities to tourists in tourist destinations.

[0723] The present invention relates to a computer system for providing tourist information to foreign tourists, and in particular to a system that interacts with foreign tourists and proposes sightseeing plans in multiple languages ​​that meet their preferences and needs. Specific embodiments for implementing this system are described below.

[0724] User Registration and Login

[0725] When a user first uses the system, they enter their registration information, such as their name, email address, and password, into a dedicated form. The device sends the information to the server, which stores it in a database. Once registration is complete, the user logs in using their registration information, and the server verifies the authentication information and starts the session.

[0726] Counseling begins and conversations begin

[0727] The user inputs their desired sightseeing information. For example, "I would like to stay in Tokyo for a week. I like anime and manga." The device sends this information to the server in real time, and the server sends the user's input to the generative AI model. The generative AI model generates an interactive response based on the user's input, such as "I will suggest tourist spots related to anime and manga. I can also help you with hotels and transportation." The device displays this response to the user.

[0728] Generate a sightseeing plan

[0729] The user inputs detailed preferences, such as specific tourist attractions, budget, and itinerary. The device sends this information to the server, which then uses a generative AI model to generate a sightseeing plan. This plan includes information on accommodation, transportation, and tourist attraction admission tickets. The generated sightseeing plan is sent to the device and displayed to the user.

[0730] Completing the reservation

[0731] The user reviews the details of the proposed itinerary, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and attractions. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a completion notification, which is displayed to the user via the device.

[0732] Save and reuse profiles

[0733] Before logging out, users can choose whether to save their counseling history and preference information. The device sends this information to the server, which stores it in a database. The next time users use the service, they can reuse the saved profile information to receive faster and more efficient counseling and sightseeing plan suggestions.

[0734] Specific examples

[0735] For example, a first-time user might input their request, "I'd like to stay in Tokyo for a week. I like anime and manga." The server uses a generation AI to propose a plan including tourist spots, accommodations, and transportation, and then selects a specific hotel from the proposed plan and requests a reservation. The server then confirms the reservation and notifies the user.

[0736] Repeat users can also request, "Next time, I'd like to experience traditional culture in Kyoto," based on their previously saved profile information. The server uses generative AI to create a new proposal based on past counseling history and provides it to the user. The user customizes the proposal, selects details, and requests a reservation. The server then confirms the reservation and notifies the user.

[0737] Prompt Sentence Examples

[0738] 1. First-time prompt:

[0739] "I'd like to stay in Tokyo for a week. I love anime and manga. Can you recommend any tourist spots or accommodations?"

[0740] 2. Repeat prompt:

[0741] "When I went to Kyoto before, I experienced the tea ceremony and had a lot of fun. Next time I'd like to experience some traditional culture in Nara. What plan would you recommend?"

[0742] As described above, the present invention provides customized sightseeing plans for foreign tourists, eliminating language barriers, thereby providing a special sightseeing experience and improving the satisfaction of foreign tourists.

[0743] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0744] Processing Steps

[0745] Step 1: User Registration

[0746] Specific behavior:

[0747] 1. The user enters personal information such as name, email address, and password into an input form.

[0748] 2. The terminal sends the entered registration information to the server.

[0749] 3. The server stores the received registration information in a database.

[0750] 4. The server returns a registration completion message to the terminal.

[0751] 5. The terminal displays a registration completion message to the user.

[0752] Input: Name, email address, and password entered by the user

[0753] Output: Registration information saved in the database, registration completion message

[0754] Data processing and calculation:

[0755] Collecting data from input forms

[0756] Save to database

[0757] Generate a registration completion message

[0758] Step 2: User Login

[0759] Specific behavior:

[0760] 1. The user enters the registered email address and password in the login form.

[0761] 2. The terminal sends the login information to the server.

[0762] 3. The server retrieves the registration information from the database and compares it with the input information.

[0763] 4. If authentication is successful, the server generates a session ID and returns it to the terminal.

[0764] 5. The terminal displays a successful login message to the user.

[0765] Input: Email address and password entered by the user

[0766] Output: Session ID, login success message

[0767] Data processing and calculation:

[0768] Retrieving user information from the database

[0769] Verification with login information

[0770] Generate a session ID

[0771] Step 3: Enter and submit your preferences

[0772] Specific behavior:

[0773] 1. The user enters their desired sightseeing information. Example: "I want to stay in Tokyo for a week. I like anime and manga."

[0774] 2. The terminal transmits the entered desired information to the server in real time.

[0775] 3. The server sends the desired information to the generative AI model.

[0776] Input: User-entered preferences

[0777] Output: Sending desired information to the generative AI model

[0778] Data processing and calculation:

[0779] Collecting data from input forms

[0780] Real-time information transfer to the server

[0781] Data transfer to generative AI models

[0782] Step 4: Generate a response using an AI model

[0783] Specific behavior:

[0784] 1. The server sends the received desired information to the generative AI model.

[0785] 2. The generative AI model generates a response based on the input information. Example: "Suggest tourist spots related to anime and manga."

[0786] 3. The server returns the generated response to the terminal.

[0787] 4. The terminal displays the response to the user.

[0788] Input: Desired information received by the generative AI model

[0789] Output: The generated interactive response

[0790] Data processing and calculation:

[0791] Analysis of desired information

[0792] Generate a response using a response generation algorithm

[0793] Step 5: Enter your desired details and submit

[0794] Specific behavior:

[0795] 1. The user inputs detailed information about their desired sightseeing spots, budget, dates, etc.

[0796] 2. The device sends this information to the server.

[0797] Input: Detailed desired information entered by the user

[0798] Output: Send detailed request information to the server

[0799] Data processing and calculation:

[0800] Collecting data from input forms

[0801] Real-time information transfer to the server

[0802] Step 6: Generate a sightseeing plan

[0803] Specific behavior:

[0804] 1. The server sends the detailed desired information to the generation AI model.

[0805] 2. The generative AI model generates a sightseeing itinerary based on the detailed information, including accommodation, transportation, and attraction admission tickets.

[0806] 3. The server sends the generated tour plan to the terminal.

[0807] 4. The terminal displays the sightseeing plan to the user.

[0808] Input: Detailed desired information received by the generative AI model

[0809] Output: Generated itinerary

[0810] Data processing and calculation:

[0811] Analysis of detailed desired information

[0812] Generation of plans using a sightseeing plan generation algorithm

[0813] Step 7: Confirm and request a booking

[0814] Specific behavior:

[0815] 1. The user reviews the proposed itinerary, selects specific accommodations and attractions, and requests a reservation.

[0816] 2. The terminal sends this request information to the server.

[0817] 3. The server checks the availability of the selected facility or spot.

[0818] 4. If the reservation is confirmed, the server sends the reservation information to the partner and generates a completion notification.

[0819] 5. The terminal displays a completion notification to the user.

[0820] Input: Accommodations and attractions selected by the user, reservation request information

[0821] Output: Reservation confirmation and completion notification

[0822] Data processing and calculation:

[0823] Check availability of facilities and spots

[0824] Generate reservation information

[0825] Generate and send a completion notification

[0826] Step 8: Save and reuse your profile information

[0827] Specific behavior:

[0828] 1. The user chooses whether to save their counseling history and preferences.

[0829] 2. If the device chooses to store it, it sends this information to the server.

[0830] 3. The server stores the received information in a database.

[0831] 4. The next time the user uses the service, they will receive new counseling based on the profile information they saved last time.

[0832] Input: User's counseling history, preferences

[0833] Output: Profile information stored in a database for reuse

[0834] Data processing and calculation:

[0835] Counseling information data collection

[0836] Saving to a database

[0837] Reading and providing stored data

[0838] (Application example 1)

[0839] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0840] Conventional tourist information systems were limited in their ability to provide tour plans tailored to the wishes and needs of foreign tourists, and their multilingual support was insufficient. Providing detailed information about tour plans and reservation procedures was also cumbersome. Furthermore, they lacked efficient support for factory workers, making it difficult to provide multilingual work support or reuse work history. This resulted in problems that reduced the satisfaction and efficiency of tourists and workers.

[0841] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0842] In this invention, the server includes means for saving registration information of foreign tourists, means for interacting with foreign tourists and acquiring their preferences and needs, means for generating sightseeing plans based on the preferences and needs, means for providing detailed information about the generated sightseeing plans to foreign tourists, means for providing support in multiple languages, means for saving and reusing profile information of foreign tourists, means for providing sightseeing information in collaboration with local tourism businesses, means for responding to instructions and questions from workers in the factory and proposing optimal work plans in multiple languages, and means for saving work history and reusing it for future work plans. This makes it possible to propose sightseeing plans to foreign tourists and provide efficient work support to workers.

[0843] "Means for storing registration information of foreign tourists" refers to a method for storing basic information such as the name, age, and contact details of foreign tourists in a database.

[0844] "Means for interacting with foreign tourists and obtaining their preferences and needs" refers to an interface that interactively collects the wishes and interests entered by foreign tourists.

[0845] "Means for generating tourist plans based on the preferences and needs" refers to a method for creating tourist plans that meet the preferences and needs of foreign tourists using AI models or other algorithms.

[0846] The "means for providing detailed information about the created sightseeing plan to foreign tourists" is a method for notifying foreign tourists of the details of the created sightseeing plan.

[0847] "Means of providing support in multiple languages" refers to technology that enables the provision of information and dialogue in the languages ​​used by foreign tourists.

[0848] "Means for storing and reusing profile information of foreign tourists" refers to a method for storing past counseling history and preference information in a database and using it for future suggestions and counseling.

[0849] "Means for providing tourism information in partnership with local tourism businesses" refers to a method for providing comprehensive tourism information by partnering with local tourism businesses and incorporating their information into the system.

[0850] "A means of responding to instructions and questions from workers inside the factory and proposing optimal work plans in multiple languages" is a method in which workers inside the factory give instructions and ask questions in multiple languages, and based on that information, an optimal work plan is created and provided.

[0851] "Means for saving work history and reusing it for future work plans" refers to a method for saving past work history in a database and using it to create future work plans.

[0852] The system of this invention provides tourist information to foreign tourists and supports factory workers. The system operates in cooperation with three elements: a server, a terminal, and a user.

[0853] System configuration and data processing

[0854] The server includes the following means:

[0855] 1. A means of storing registration information of foreign tourists

[0856] The server stores basic information such as the name, age, and contact details of foreign tourists in a database. This database can be created using MySQL or Firebase.

[0857] 2. A means of communicating with foreign tourists and learning about their preferences and needs

[0858] The server receives input from users in real time and analyzes the information to obtain their preferences and needs. Users input information by voice or text using their smartphones or tablets.

[0859] 3. A way to generate itineraries based on preferences and needs

[0860] The server automatically generates a sightseeing plan based on the acquired preferences and needs using a generative AI model such as OpenAI GPT-3.

[0861] 4. Means of providing detailed information about the generated travel plans to foreign tourists

[0862] The server sends the generated sightseeing plan to the user's terminal and provides detailed information, including information on accommodations, tourist spots, and transportation options.

[0863] 5. Multilingual support options

[0864] The server provides information corresponding to the language selected by the user, and is capable of providing dialogue and guidance in multiple languages.

[0865] 6. Means of storing and reusing foreign tourist profile information

[0866] The server stores past counseling history and preference information in a database and reuses it for the next proposal or counseling session.

[0867] 7. Means of providing tourism information in partnership with local tourism businesses

[0868] The server incorporates tourist information provided in partnership with local tourist businesses into the system and provides comprehensive tourist information to users.

[0869] 8. A means of responding to instructions and questions from workers inside the factory and proposing optimal work plans in multiple languages

[0870] The server allows factory workers to give instructions and ask questions in multiple languages, and based on that information, it uses a generative AI model to create and propose optimal work plans.

[0871] 9. A way to save work history and reuse it for future work planning

[0872] The server stores past work history in a database and uses it to create future work plans.

[0873] Specific examples

[0874] For example, if a foreign tourist inputs "I want to stay in Tokyo for a week. I like anime and manga," the server will use the generative AI model to suggest a sightseeing plan including tourist attractions, accommodations, and transportation. The user can select a plan and proceed with details and reservations.

[0875] In the factory, a worker can ask, "The next step will use part X, which will take about 30 minutes. What is the next step?" The server uses a generative AI model to suggest optimal work steps in multiple languages, and uses work history for future planning.

[0876] Prompt Sentence Examples

[0877] Current work:

[0878] 1. Attach part X

[0879] 2. Use a tightening tool

[0880] 3. Once completed, what are the next steps?

[0881] budget:

[0882] Within 1 hour

[0883] Hope:

[0884] Work efficiently and injury-free

[0885] In this way, the server can utilize the generative AI model to provide effective tourist information and work support in multiple languages.

[0886] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0887] Step 1:

[0888] The user enters the registration information and sends it to the server via the terminal.

[0889] Input: The user enters registration information such as name, age, and contact details.

[0890] Data processing: The terminal formats the information entered by the user and sends it to the server.

[0891] Output: The server saves the registration information in the database and generates a registration complete message.

[0892] Step 2:

[0893] The user initiates a dialogue and inputs their wishes and questions regarding sightseeing or work.

[0894] Input: The user interactively inputs desired content or questions using text or voice.

[0895] Data processing: The terminal converts the input into text format and sends it to the server.

[0896] Output: The server analyzes the input and extracts the user's preferences and needs.

[0897] Step 3:

[0898] The server generates a sightseeing plan or a work plan using the generative AI model.

[0899] Input: Data analyzed to identify user preferences and needs.

[0900] Data calculation: The server uses a generative AI model (e.g., OpenAI GPT-3) to generate a sightseeing or work plan based on the user's input, specifically suggesting relevant tourist spots and efficient work procedures.

[0901] Output: The generated sightseeing plan or work plan is output in text format.

[0902] Step 4:

[0903] The server provides the user with detailed information about the generated plan.

[0904] Input: Generated tourism plan or work plan.

[0905] Data processing: The server formats the detailed information and sends it to the user's device, such as tourist destination details, accommodation ratings, and transportation options.

[0906] Output: The terminal displays this information to the user.

[0907] Step 5:

[0908] The user checks the plan and makes the necessary reservations and procedures.

[0909] Input: The user selects a specific plan (reserving accommodation, purchasing tickets to a tourist attraction, etc.).

[0910] Data calculation: The server performs the reservation procedure based on the selected plan, checks availability, and confirms the reservation.

[0911] Output: Notify the user that the reservation or procedure is complete.

[0912] Step 6:

[0913] The server stores the user's counseling history and work history.

[0914] Input: User's counseling or work history.

[0915] Data processing: The server stores this information in a database and tags and categorizes it for reuse the next time.

[0916] Output: Confirm that the history information has been saved for future use.

[0917] Step 7:

[0918] The server reuses the saved history information the next time you use the server.

[0919] Input: Past counseling history and work history.

[0920] Data calculation: The server uses the historical information as a reference when creating new suggestions for the user.

[0921] Output: New suggestions for efficient counseling and work support are generated.

[0922] Through this series of processes, the server can utilize the generative AI model to provide users with tourist information and work support efficiently and in multiple languages.

[0923] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0924] The present invention relates to a computer system for providing tourist information for foreign tourists, and in particular to a system that interacts with foreign tourists and proposes sightseeing plans in multiple languages ​​that meet their preferences and needs. Furthermore, by combining the system with an emotion engine that recognizes the user's emotions, the user experience can be further improved. Specific embodiments for carrying out the present invention are described below.

[0925] System Overview

[0926] The system includes the following main components:

[0927] 1. User terminal: Devices accessed by foreign tourists (PC, smartphone, tablet, etc.)

[0928] 2. Server: The central computer server of the system

[0929] 3. Database: A data store that stores user information, travel plans, partner information, etc.

[0930] 4. Generative AI Model: Conversational AI for generating sightseeing itineraries

[0931] 5. Emotion Engine: Recognizes user emotions and tailors suggestions based on the conversation

[0932] System Embodiments

[0933] User Registration and Login

[0934] When a user first uses the device, they enter their registration information, such as their name, email address, and password. The device sends this information to the server, which stores it in a database. Once registration is complete, the user logs in using their registration information, and the server verifies the authentication information and starts the session.

[0935] Counseling begins and conversations begin

[0936] The user starts a counseling session and inputs their sightseeing preferences. For example, "I would like to experience traditional culture in Kyoto." The device sends this information to the server in real time, and the server sends the user's input to the generative AI model. The generative AI model generates a conversational response based on the user's input, such as "I recommend a tea ceremony experience and a tour of temples. I can also help with hotel accommodations and transportation." The device displays this response to the user.

[0937] Emotion recognition and suggestion adjustment by emotion engine

[0938] The emotion engine recognizes emotions from user input, voice, facial expressions, etc. For example, if a user inputs, "It's probably going to be crowded again," the emotion engine recognizes this as a negative emotion. This information is sent to the server, and the generation AI generates a different suggestion based on this emotion. For example, it might respond, "I'll introduce you to some hidden spots with fewer tourists." The device then displays this response to the user.

[0939] Generate a sightseeing plan

[0940] The user then enters more detailed information, specifying specific tourist attractions, budget, and itinerary. The device then sends this information to the server, which then uses a generation AI to generate a sightseeing plan. This plan is customized based on the user's preferences and feelings, and includes information on accommodation, transportation, and admission tickets to tourist attractions. The generated sightseeing plan is then sent to the device and displayed to the user.

[0941] Completing the reservation

[0942] The user reviews the details of the proposed itinerary, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and tourist destinations. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a completion notification. The device displays this notification to the user.

[0943] Save and reuse profiles

[0944] Before logging out, users can choose whether to save their counseling history and preference information. The device sends this information to the server, which stores it in a database. The next time users use the service, they can reuse this information, enabling more efficient counseling and sightseeing plans.

[0945] Specific examples

[0946] For example, a first-time user might input their desire to "experience traditional culture in Kyoto." The server then uses the generation AI to suggest a plan that includes tourist spots, suitable accommodations, and transportation. If the emotion engine recognizes that the user's input indicates excitement, the generation AI will suggest additional recommended spots.

[0947] Repeat users can also request, "Next, I'd like to enjoy the latest entertainment in Tokyo," based on their previously saved profile information. The server uses generative AI to create new suggestions based on past counseling history, and if the emotion engine recognizes "anxiety," it will suggest times to avoid crowds and hidden spots. This allows users to plan their trip with greater peace of mind.

[0948] In this way, the present invention is a system that generates customized sightseeing plans for foreign tourists, improves the user experience by adding an emotion engine, removes language barriers, and provides a special sightseeing experience, thereby significantly improving the satisfaction of foreign tourists.

[0949] The processing flow will be explained below.

[0950] Step 1:

[0951] When using the service for the first time, the user enters registration information (name, email address, password).

[0952] Step 2:

[0953] The terminal transmits the entered registration information to the server.

[0954] Step 3:

[0955] The server stores the received registration information in a database.

[0956] Step 4:

[0957] The server sends a notification of registration completion to the terminal.

[0958] Step 5:

[0959] The user receives a notification that registration is complete and logs in.

[0960] Step 6:

[0961] The terminal sends login information (email address, password) to the server.

[0962] Step 7:

[0963] The server verifies the login information and, if authentication is successful, begins the session.

[0964] Step 8:

[0965] The user starts a counseling session and inputs their desired sightseeing information, for example, "I would like to experience traditional culture in Kyoto."

[0966] Step 9:

[0967] The terminal transmits the desired information input by the user to the server.

[0968] Step 10:

[0969] The server sends the user's desired information to the generation AI, which generates an interactive response.

[0970] Step 11:

[0971] For example, the generative AI can generate a response such as, "We recommend a tea ceremony experience or a temple tour. We can also help you with hotel accommodations and transportation."

[0972] Step 12:

[0973] The server sends the generated response to the terminal.

[0974] Step 13:

[0975] The terminal displays the generated response to the user.

[0976] Step 14:

[0977] The emotion engine recognizes emotions from user input, facial expressions, etc. For example, if a user inputs "It's probably going to be crowded again," it will recognize a negative emotion.

[0978] Step 15:

[0979] The server sends the emotion information recognized by the emotion engine to the generation AI.

[0980] Step 16:

[0981] Based on emotional information, the generative AI generates a response such as, "I'll introduce you to some hidden spots with fewer tourists."

[0982] Step 17:

[0983] The server sends the generated response to the terminal.

[0984] Step 18:

[0985] The terminal displays the generated response to the user.

[0986] Step 19:

[0987] The user then enters more detailed requests (specific tourist spots, budget, dates, etc.).

[0988] Step 20:

[0989] The terminal transmits detailed desired information to the server.

[0990] Step 21:

[0991] The server uses AI to generate a sightseeing plan based on detailed desired information.

[0992] Step 22:

[0993] The generative AI generates a customized sightseeing plan based on the user's wishes and feelings, making suggestions including information on accommodation, transportation, and admission tickets to tourist attractions.

[0994] Step 23:

[0995] The server transmits the generated sightseeing plan to the terminal.

[0996] Step 24:

[0997] The terminal displays the generated sightseeing plan to the user.

[0998] Step 25:

[0999] The user reviews the details of the proposed tour plan, selects a specific hotel, and requests a reservation.

[1000] Step 26:

[1001] The terminal transmits the user's reservation request to the server.

[1002] Step 27:

[1003] The server checks availability of the selected accommodations and tourist destinations.

[1004] Step 28:

[1005] The server confirms the reservation and sends the reservation information to the partner.

[1006] Step 29:

[1007] The server sends a reservation completion notification to the terminal.

[1008] Step 30:

[1009] The terminal displays a notification to the user that the reservation is complete.

[1010] Step 31:

[1011] Before logging out, the user has the option to save their counseling history and preferences.

[1012] Step 32:

[1013] The terminal transmits the profile information to be saved to the server.

[1014] Step 33:

[1015] The server stores the profile information and counseling history in a database.

[1016] Step 34:

[1017] The next time the user uses the service, the server will provide efficient counseling and suggest sightseeing plans based on the saved profile information.

[1018] Example 2

[1019] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1020] Conventional tourist information systems for foreign tourists have difficulty proposing sightseeing plans that meet the individual preferences and needs of users, and do not adjust the proposals to take into account the user's emotional state. As a result, there are problems with user satisfaction and a poor user experience.

[1021] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1022] A means for storing registration information of foreign tourists;

[1023] A means of communicating with foreign tourists and obtaining information on their preferences and needs;

[1024] means for generating a sightseeing plan based on said preferences and needs;

[1025] A means for providing detailed information about the generated travel plans to foreign tourists;

[1026] Multilingual support options and

[1027] a means of storing and reusing foreign tourist profile information;

[1028] A means of providing tourism information in partnership with local tourism businesses;

[1029] A means of recognizing tourists' emotions and adjusting the content of the offers;

[1030] This allows for customized sightseeing plans based on the user's preferences and needs, as well as tailoring suggestions to suit the user's emotional state.

[1031] "Foreign tourists" are travelers visiting a country other than their own.

[1032] "Registration information" refers to information such as name, email address, and password that a user enters when using the service for the first time.

[1033] "Interaction" refers to the process by which a computer system and a user interact with each other.

[1034] "Preferences and needs" refers to the user's individual requests and needs, such as desired tourist destinations, experiences, and itineraries.

[1035] "Sightseeing Plan" means a travel plan including attractions, accommodations, transportation, and other necessary details generated based on the user's preferences and needs.

[1036] "Multilingual support" is a function that provides guidance and responses to users in multiple languages.

[1037] "Profile information" refers to information about a user's past usage history and preferences.

[1038] "Local tourism operators" are companies or individuals that provide tourism services in a particular tourist destination.

[1039] "Emotion recognition" is a technology that detects a user's emotional state from input, voice, facial expressions, etc.

[1040] "Recommendation adjustment" refers to the process of changing and adapting recommended sightseeing itineraries and travel suggestions based on the user's emotional state.

[1041] The present invention relates to a computer system for providing tourist information for foreign tourists, and in particular to a system that interacts with foreign tourists and proposes sightseeing plans in multiple languages ​​that meet their preferences and needs. Furthermore, by combining the system with an emotion engine that recognizes the user's emotions, the user experience can be further improved. Specific embodiments for carrying out the present invention are described below.

[1042] Key components of the system

[1043] 1. User terminal: Devices accessed by foreign tourists (PC, smartphone, tablet, etc.)

[1044] 2. Server: The central computer server of the system

[1045] 3. Database: A data store that stores user information, travel plans, partner information, etc.

[1046] 4. Generative AI Model: Conversational AI for generating sightseeing itineraries

[1047] 5. Emotion Engine: Recognizes user emotions and tailors suggestions based on the conversation

[1048] User Registration and Login

[1049] When a user first uses the device, they enter their registration information, such as their name, email address, and password. The device sends this information to the server, which stores it in a database. Once registration is complete, the user logs in, and the server verifies the authentication information and starts the session.

[1050] Counseling begins and conversations begin

[1051] The user starts a counseling session and inputs their sightseeing preferences. For example, they might say, "I'd like to experience traditional culture in Kyoto." The device sends this information to the server in real time, and the server sends the user's preferences in the form of prompts to the generative AI model. The generative AI model generates a conversational response based on the user's input, such as, "I recommend a tea ceremony experience and a tour of temples. I can also help you with hotel accommodations and transportation." The device then displays this response to the user.

[1052] Emotion recognition and suggestion adjustment by emotion engine

[1053] The emotion engine recognizes emotions from user input, voice, facial expressions, etc. For example, if a user inputs, "It's probably going to be crowded again," the emotion engine recognizes negative emotions. The device sends this emotional information to the server, which then has the generative AI model create new suggestions that take emotion into account. For example, the server might respond, "I'll introduce you to some hidden spots with fewer tourists." The device then displays this new suggestion to the user.

[1054] Generate a sightseeing plan

[1055] The user then enters more detailed information, including specific tourist attractions, budget, and itinerary. The device then sends this information to the server, which then uses the generative AI model to generate a detailed itinerary, including information on accommodation, transportation, and admission tickets to tourist attractions. The generated itinerary is then sent to the device and displayed to the user.

[1056] Completing the reservation

[1057] The user reviews the details of the proposed travel plan, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and tourist destinations. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a reservation completion notification. The device displays this notification to the user.

[1058] Save and reuse profiles

[1059] Before logging out, users can choose whether to save their counseling history and preference information. The device sends this information to the server, which then stores it in a database. The next time the user uses the service, they can reuse the saved information to receive more efficient counseling.

[1060] Specific examples

[1061] First-time use example

[1062] Example: A user inputs a request such as "I would like to experience traditional culture in Kyoto."

[1063] The terminal sends this information to the server.

[1064] The server sends the desired content to the generative AI model in the form of a prompt. An example of a prompt is: "The user wants to experience traditional culture in Kyoto. Please generate the optimal sightseeing plan for this."

[1065] The generative AI model generates a plan that includes tourist attractions, suitable accommodations, and transportation. An example of a generated response is, "We suggest a tea ceremony experience, a tour of temples, and a traditional craft workshop."

[1066] The terminal displays the generated plan to the user.

[1067] Examples of repeat use

[1068] Example: A repeat user requests, "Next time, I'd like to enjoy the latest entertainment in Tokyo."

[1069] The terminal sends this information to the server.

[1070] The server sends a request to the generative AI model that takes into account the user's past counseling history. An example of a prompt sentence is: "The user has previously enjoyed traditional culture in Kyoto. This time, the user wants to experience new entertainment in Tokyo."

[1071] The generative AI model generates new itineraries based on past history and new requests.

[1072] The terminal displays the generated plan to the user.

[1073] If any anxiety about the plan is detected (e.g., "Is it going to be crowded?"), the server resubmits the emotion recognition information to the generative AI model, which then suggests timings and hidden spots to avoid crowds. This is how the final recommendation is created.

[1074] The terminal displays the final proposal to the user.

[1075] As described above, the present invention is a system that generates customized sightseeing itineraries for foreign tourists and dramatically improves the user experience by including emotion recognition.

[1076] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1077] Step 1: User Registration

[1078] When a user uses the device for the first time, they enter registration information such as their name, email address, and password. The device then sends this information to the server, which then stores the received information in a database. This completes the user's registration.

[1079] Input: Name, Email Address, Password

[1080] Data processing: Convert input information into JSON format and send it to the server

[1081] Output: Registration information is saved in the database

[1082] Step 2: Log in

[1083] The user logs in using their registration information. The terminal sends the entered authentication information to the server. The server verifies the authentication information and, if valid, starts a session.

[1084] Input: Name, Password

[1085] Data calculation: authentication information verification, database matching

[1086] Output: Session started

[1087] Step 3: Counseling begins

[1088] The user starts a counseling session and inputs their desired tourist information. For example, they might input a preference such as "I would like to experience traditional culture in Kyoto." The device sends this information in real time to the server, which then sends the user's desired information in the form of prompts to the generative AI model.

[1089] Input: Desired tourist information

[1090] Data processing: Convert into prompt sentence format and send to generative AI model

[1091] Output: Input data for the generative AI model is created

[1092] Step 4: Generative AI model generates interactive responses

[1093] The server sends a prompt to the generative AI model, which generates a conversational response based on the user's input. For example, it might respond, "We recommend a tea ceremony experience or a temple tour." The device then displays this response to the user.

[1094] Input: prompt statement

[1095] Data Computation: Response Generation with Generative AI Models

[1096] Output: Interactive response (e.g. "I recommend experiencing a tea ceremony and visiting temples.")

[1097] Step 5: Emotion Recognition

[1098] The emotion engine recognizes emotions from user input, voice, facial expressions, etc. For example, if a user inputs "It's probably going to be crowded again," it recognizes negative emotions. The device then sends this emotional information to the server.

[1099] Input: User emotion data (text, voice, facial expressions)

[1100] Data Computing: Applying Emotion Recognition Algorithms

[1101] Output: Emotional information (e.g., negative emotions)

[1102] Step 6: Adjust your proposal

[1103] The server provides the emotion information to the generative AI model, which then generates new suggestions that take emotion into account. For example, it might respond, "We'll introduce you to some hidden spots with fewer tourists." The device then displays the new suggestions to the user.

[1104] Input: Emotion information

[1105] Data Computation: Re-proposal Generation with Generative AI Models

[1106] Output: New proposal (e.g., "I'll introduce you to some hidden spots with few tourists")

[1107] Step 7: Setting up your itinerary

[1108] The user further inputs detailed preferences (tourist attractions, budget, schedule, etc.). The device sends this information to the server. The server uses a generative AI model to generate a detailed sightseeing plan. This plan includes information on accommodation, transportation, and admission tickets to tourist attractions. The generated sightseeing plan is sent to the device and displayed to the user.

[1109] Input: Detailed desired information

[1110] Data processing: Generating a sightseeing plan using a generative AI model

[1111] Output: Detailed itinerary

[1112] Step 8: Complete your booking

[1113] The user checks the details of the proposed travel plan, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and tourist destinations. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a reservation completion notification. The device displays this notification to the user.

[1114] Input: Reservation request information

[1115] Data calculation: Check availability, generate and send reservation information

[1116] Output: Reservation completion notification

[1117] Step 9: Saving and Reusing Profiles

[1118] Before logging out, the user can choose whether to save their counseling history and preference information. The device sends this information to the server, which then stores it in a database. The next time the user uses the service, they can reuse the saved information to receive more efficient counseling.

[1119] Input: Profile information to save

[1120] Data processing: Saving profile information

[1121] Output: Saved profile information

[1122] Through these processing steps, the system can not only provide customized sightseeing plans based on the user's preferences and needs, but also adjust suggestions based on emotion recognition, greatly improving the user experience.

[1123] (Application example 2)

[1124] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1125] Foreign tourists often feel anxious about their experiences in the countries they visit due to language barriers and cultural differences. Collecting tourist information quickly and efficiently and providing customized tour plans tailored to individual needs and preferences is also a challenge. Furthermore, there is a demand for a system that can automatically adjust suggestions in response to emotional changes during the tour. In particular, there is a desire for autonomous vehicles to provide tourist information at tourist destinations.

[1126] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1127] In this invention, the server includes means for saving registration information of foreign tourists, means for interacting with foreign tourists and acquiring their preferences and needs, means for generating sightseeing plans based on the preferences and needs, means for providing detailed information about the generated sightseeing plans to foreign tourists, means for providing support in multiple languages, means for saving and reusing profile information of foreign tourists, means for providing sightseeing information in collaboration with local tourism businesses, means for performing emotion recognition and adjusting suggestions according to the user's emotions, and means for providing sightseeing guides for autonomous vehicles. This allows foreign tourists to enjoy sightseeing with peace of mind, and makes it possible to easily provide sightseeing plans that meet their individual needs and preferences.

[1128] "Foreign tourists" refers to travelers visiting a country other than their home country.

[1129] "Tourist information" refers to information about tourist attractions, accommodation, transportation, restaurants, leisure activities, etc.

[1130] A "computer system" refers to an information processing system in which multiple components and devices function in cooperation with one another.

[1131] "Registration Information" refers to basic personal information such as a User's name, email address, and password.

[1132] "Preferences and needs" refers to the specific requests and desires of users regarding the experiences they desire and the services they expect.

[1133] A "tourist plan" refers to a specific travel plan that includes the order in which tourist spots are visited, accommodation, transportation, restaurants, etc.

[1134] "Emotion recognition" refers to the technology of identifying emotions from a user's voice, facial expressions, text input, etc.

[1135] "Multilingual support" refers to the ability to provide information and user interfaces in multiple languages.

[1136] "Profile information" refers to personal information such as a user's past behavioral history, preferences, needs, etc.

[1137] "Local tourism operators" refer to companies and organizations that provide services in tourist destinations.

[1138] An "autonomous vehicle" refers to a vehicle that operates autonomously without human operation.

[1139] "Tourist information" refers to providing information about tourist spots and giving tour instructions.

[1140] In this invention, we will explain how to specifically realize a tourist information system for self-driving vehicles provided to foreign tourists.

[1141] System Overview

[1142] The system includes the following main components:

[1143] 1. User terminal: Device accessed by foreign tourists (smart glasses)

[1144] 2. Server: The central computer server of the system

[1145] 3. Database: A data store that stores user information, travel plans, partner information, etc.

[1146] 4. Generative AI Model: Conversational AI for generating sightseeing itineraries

[1147] 5. Emotion Engine: Recognizes user emotions and tailors suggestions based on the conversation

[1148] 6. Autonomous Driving Navigation: A navigation system for autonomous vehicles to travel around tourist spots

[1149] System Embodiments

[1150] User Registration and Login

[1151] When a user first uses the device, they enter their registration information, such as their name, email address, and password. The device sends this information to the server, which stores it in a database. Once registration is complete, the user logs in using their registration information, and the server verifies the authentication information and starts the session.

[1152] Counseling begins and conversations begin

[1153] The user starts a counseling session and inputs their sightseeing preferences. For example, "I would like to experience traditional culture in Kyoto." The device sends this information to the server in real time, and the server sends the user's input to the generative AI model. The generative AI model generates a conversational response based on the user's input, such as "I recommend a tea ceremony experience and a tour of temples. I can also help with accommodation and transportation." The device displays this response to the user.

[1154] Emotion recognition and suggestion adjustment by emotion engine

[1155] The emotion engine recognizes emotions from user input, voice, facial expressions, etc. For example, if a user inputs, "It's probably going to be crowded again," the emotion engine recognizes this as a negative emotion. This information is sent to the server, and the generation AI generates a different suggestion based on this emotion. For example, it might respond, "I'll introduce you to some hidden spots with fewer tourists." The device then displays this response to the user.

[1156] Self-driving navigation settings

[1157] Once the user's sightseeing plan is finalized, the server sends route information to the autonomous driving navigation system to set the order in which the tourist spots are to be visited. The autonomous driving vehicle then travels around the tourist spots according to this route information.

[1158] Specific examples

[1159] For example, a first-time user might input their desire to "experience traditional culture in Kyoto." The server uses the generation AI to propose a plan that includes tourist spots, suitable accommodations, and transportation. If the emotion engine recognizes that the user's input indicates excitement, the generation AI will suggest additional recommended spots. The following prompt sentences are possible user inputs:

[1160] User input: "I want to experience traditional tea ceremony in Kyoto."

[1161] Server response: "We suggest a tea ceremony experience at a famous temple, followed by a leisurely tour of nearby temples and a visit to a traditional craft workshop."

[1162] The above is a specific embodiment for carrying out the present invention. By using this system, foreign tourists can enjoy sightseeing with peace of mind, and it is possible to easily provide sightseeing plans that meet individual needs and preferences.

[1163] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1164] Step 1:

[1165] When a user first uses a device, they enter their registration information, such as their name, email address, and password. This information is sent from the device to the server, which stores it in a database. The user then enters their login information for authentication, and the server verifies the authentication information and starts the session.

[1166] Input: Name, Email Address, Password

[1167] Output: User information stored in database, session started

[1168] Step 2:

[1169] The user starts a counseling session on the device and inputs their desired tourist information. This input information is sent from the device to the server in real time, and the server sends the user's desired information to the generative AI model. The generative AI model generates an interactive response based on the user's input and sends it to the device. This response is then displayed to the user.

[1170] Input: User's desired information (e.g., I want to experience traditional culture in Kyoto)

[1171] Output: A conversational response from the generative AI model (e.g., recommending tea ceremony experiences and temple tours. We can also help with accommodation and transportation)

[1172] Step 3:

[1173] The emotion engine recognizes emotions from the user's input, voice, facial expressions, etc. The recognition results are sent to the server, and the generation AI generates suggestions based on the emotion. For example, if the user expresses negative emotions, it generates a response such as "I'll introduce you to some hidden spots with fewer tourists." The device displays this response to the user.

[1174] Input: User's sentiment (e.g., "It's probably going to be crowded again").

[1175] Output: Suggestions from generative AI based on emotions (e.g., hidden spots with few tourists)

[1176] Step 4:

[1177] Once the user's sightseeing plan is finalized, the server sends route information to the autonomous driving navigation system to set the order in which the tourist spots are to be visited. The autonomous driving vehicle then travels around the tourist spots according to this route information.

[1178] Input: Confirmed sightseeing plan (sightseeing spot order)

[1179] Output: Route information for the autonomous driving navigation system

[1180] Step 5:

[1181] While sightseeing, the emotion engine continues to recognize the user's emotions in real time as the self-driving vehicle travels along the designated route. The recognition results are sent to the server, and the content of the sightseeing guide is adjusted accordingly. If the emotion is positive, the sightseeing guide continues, and if it is negative, new suggestions are made.

[1182] Input: Real-time user sentiment

[1183] Output: Adjustment of tourist information according to emotions, feedback to the user

[1184] Step 6:

[1185] After completing their visit, users can choose to save their counseling history and preferences on their device. The selected information is sent from the device to the server and stored in a database. This information can be reused the next time the user visits.

[1186] Input: Post-tour counseling history and preference save selection

[1187] Output: History information and preferences stored in a database

[1188] This allows users to enjoy an efficient and personalized tourism experience.

[1189] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1190] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1191] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1192] [Third embodiment]

[1193] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1194] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1195] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1196] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1197] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1198] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1199] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1200] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1201] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1202] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1203] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1204] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1205] The present invention relates to a computer system for providing tourist information for foreign tourists, and in particular to a system that interacts with foreign tourists and proposes sightseeing plans in multiple languages ​​that meet their preferences and needs. Specific embodiments for carrying out the present invention are described below.

[1206] System Overview

[1207] The system includes the following main components:

[1208] 1. User terminal: Devices accessed by foreign tourists (PC, smartphone, tablet, etc.)

[1209] 2. Server: The central computer server of the system

[1210] 3. Database: A data store that stores user information, travel plans, partner information, etc.

[1211] 4. Generative AI Model: Conversational AI for generating sightseeing itineraries

[1212] System Embodiments

[1213] User Registration and Login

[1214] When a user first uses the device, they enter their registration information, such as their name, email address, and password. The device sends this information to the server, which stores it in a database. Once registration is complete, the user logs in using their registration information, and the server verifies the authentication information and starts the session.

[1215] Counseling begins and conversations begin

[1216] The user starts a counseling session and inputs their desired sightseeing information. For example, "I'd like to stay in Tokyo for a week. I like anime and manga." The device sends this information to the server in real time, and the server sends the user's input to the generative AI model. The generative AI model generates an interactive response based on the user's input, such as "I'll suggest sightseeing spots related to anime and manga. I can also help you with hotels and transportation." The device displays this response to the user.

[1217] Generate a sightseeing plan

[1218] The user then enters further details of their preferences, such as specific tourist spots, budget, and itinerary. The device sends this information to the server, which then uses a generation AI to generate a sightseeing plan. This sightseeing plan is customized based on the user's preferences and includes information on accommodation, transportation, and admission tickets to tourist attractions. The generated sightseeing plan is then sent to the device and displayed to the user.

[1219] Completing the reservation

[1220] The user checks the details of the proposed tour plan, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and tourist destinations. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a completion notification. The device displays this notification to the user.

[1221] Save and reuse profiles

[1222] Before logging out, users can choose whether to save their counseling history and preference information. The device sends this information to the server, which stores it in a database. The next time users use the service, they can reuse this information, enabling more efficient counseling and sightseeing plans.

[1223] Specific examples

[1224] For example, a first-time user might input their request, "I'd like to stay in Tokyo for a week. I like anime and manga." The server uses a generative AI to propose a plan including tourist spots, suitable accommodations, and transportation, and then selects a specific hotel from the proposed plan and requests a reservation. The server then confirms the reservation and notifies the user.

[1225] Repeat users can also request, "Next time, I'd like to experience traditional culture in Kyoto," based on their previously saved profile information. The server uses generative AI to create a new proposal based on past counseling history and provides it to the user. The user customizes the proposal, selects details, and requests a reservation. The server then confirms the reservation and notifies the user.

[1226] In this way, the present invention is a system that generates customized sightseeing plans for foreign tourists, removes language barriers, and provides special sightseeing experiences, thereby improving the satisfaction of foreign tourists.

[1227] The processing flow will be explained below.

[1228] Step 1:

[1229] When using the service for the first time, the user enters registration information (name, email address, password).

[1230] Step 2:

[1231] The terminal transmits the entered registration information to the server.

[1232] Step 3:

[1233] The server stores the received registration information in a database.

[1234] Step 4:

[1235] The server sends a notification of registration completion to the terminal.

[1236] Step 5:

[1237] The user receives a notification that registration is complete and logs in using the registration information.

[1238] Step 6:

[1239] The terminal sends login information (email address, password) to the server.

[1240] Step 7:

[1241] The server verifies the login information and, if authentication is successful, begins the session.

[1242] Step 8:

[1243] The user begins a counseling session and inputs their sightseeing preferences.

[1244] Step 9:

[1245] The terminal transmits the desired information input by the user to the server.

[1246] Step 10:

[1247] The server sends the user's desired information to the generation AI, which generates an interactive response.

[1248] Step 11:

[1249] The generative AI generates responses such as, "We'll suggest tourist spots related to anime and manga. We can also help you with hotels and transportation."

[1250] Step 12:

[1251] The server sends the generated response to the terminal.

[1252] Step 13:

[1253] The terminal displays the generated response to the user.

[1254] Step 14:

[1255] The user then enters more detailed requests (specific tourist spots, budget, dates, etc.).

[1256] Step 15:

[1257] The terminal transmits detailed desired information to the server.

[1258] Step 16:

[1259] The server uses AI to generate a sightseeing plan based on detailed desired information.

[1260] Step 17:

[1261] The generative AI generates a customized sightseeing plan based on the user's preferences, including information on accommodation, transportation, and admission tickets to tourist attractions.

[1262] Step 18:

[1263] The server transmits the generated sightseeing plan to the terminal.

[1264] Step 19:

[1265] The terminal displays the generated sightseeing plan to the user.

[1266] Step 20:

[1267] The user reviews the details of the proposed tour plan, selects a specific hotel, and requests a reservation.

[1268] Step 21:

[1269] The terminal transmits the user's reservation request to the server.

[1270] Step 22:

[1271] The server checks availability of the selected accommodations and tourist destinations.

[1272] Step 23:

[1273] The server confirms the reservation and sends the reservation information to the partner.

[1274] Step 24:

[1275] The server sends a reservation completion notification to the terminal.

[1276] Step 25:

[1277] The terminal displays a notification to the user that the reservation is complete.

[1278] Step 26:

[1279] Before logging out, the user has the option to save their counseling history and preferences.

[1280] Step 27:

[1281] The terminal transmits the profile information to be saved to the server.

[1282] Step 28:

[1283] The server stores the profile information and counseling history in a database.

[1284] Step 29:

[1285] The next time the user uses the service, the server will provide efficient counseling and suggest sightseeing plans based on the saved profile information.

[1286] Example 1

[1287] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1288] In recent years, with the increase in foreign tourists, the provision of information about tourist destinations and reservation procedures have become more complicated. In particular, providing multilingual support and proposing tour plans tailored to individual needs has become a major burden for many tourism operators. In addition, tourists themselves find it time-consuming to gather information and make reservations, making it difficult for them to enjoy sightseeing smoothly. To solve these problems, an efficient and effective information provision and reservation system that can meet the diverse needs of foreign tourists is required.

[1289] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1290] In this invention, the server includes: means for storing registration information of foreign tourists; means for interacting with foreign tourists to acquire their preferences and needs; means for using a generative AI model to generate a tour plan based on the preferences and needs; means for presenting detailed information about the generated tour plan to foreign tourists; means for providing support in multiple languages; means for managing reservation information for accommodations, transportation, and tourist attractions in tourist destinations; means for saving and reusing foreign tourists' profile information; means for transferring desired information to the server in real time and generating and providing interactive responses; and means for providing tour information in collaboration with local tourism operators. This allows foreign tourists to easily obtain tour plans that suit their preferences and needs and makes reservations smoothly. Furthermore, operators can efficiently provide information in multiple languages ​​and according to individual requests.

[1291] "Foreign tourists" are tourists whose nationality is different from that of the country of the tourist destination they are visiting.

[1292] "Registration information" refers to personal information such as name, email address, and password that foreign tourists provide prior to using the system.

[1293] "Means of dialogue" refers to the function of exchanging information with foreign tourists via text or voice.

[1294] "Preferences and needs" refers to the personal requests and preferences of foreign tourists, such as the tourist destinations and activities they wish to visit, their budget, and the length of their stay.

[1295] A "generative AI model" is an artificial intelligence algorithm that generates tourist plans based on input data.

[1296] A "tourism plan" is a plan that includes tourist attractions, activities, accommodation, transportation, etc. proposed based on the preferences and needs of foreign tourists.

[1297] "Means of providing support in multiple languages" refers to the function of providing information and dialogue responses to foreign tourists in multiple languages.

[1298] "Accommodation facilities" refer to facilities such as hotels, inns, and hostels where foreign tourists can stay at their destination.

[1299] "Transportation" refers to services such as public transportation and rental cars used to travel to and within tourist destinations.

[1300] "Tourist spots" are places and facilities that are particularly worth seeing within a tourist destination.

[1301] "Means for managing reservation information" refers to the function of recording and managing reservation status for accommodations, transportation, and tourist attractions.

[1302] "Profile information" refers to stored personal data such as a foreign tourist's past counseling history, preferences, and request information.

[1303] "Means for transferring desired information to the server in real time" refers to a function that instantly transmits desired information entered by foreign tourists to the server.

[1304] "Means for generating and providing interactive responses" refers to a function that uses a generative AI model to generate responses based on input information in real time and provide them to foreign tourists.

[1305] "Local tourism operators" are businesses that provide services such as accommodation, transportation, and activities to tourists in tourist destinations.

[1306] The present invention relates to a computer system for providing tourist information to foreign tourists, and in particular to a system that interacts with foreign tourists and proposes sightseeing plans in multiple languages ​​that meet their preferences and needs. Specific embodiments for implementing this system are described below.

[1307] User Registration and Login

[1308] When a user first uses the system, they enter their registration information, such as their name, email address, and password, into a dedicated form. The device sends the information to the server, which stores it in a database. Once registration is complete, the user logs in using their registration information, and the server verifies the authentication information and starts the session.

[1309] Counseling begins and conversations begin

[1310] The user inputs their desired sightseeing information. For example, "I would like to stay in Tokyo for a week. I like anime and manga." The device sends this information to the server in real time, and the server sends the user's input to the generative AI model. The generative AI model generates an interactive response based on the user's input, such as "I will suggest tourist spots related to anime and manga. I can also help you with hotels and transportation." The device displays this response to the user.

[1311] Generate a sightseeing plan

[1312] The user inputs detailed preferences, such as specific tourist attractions, budget, and itinerary. The device sends this information to the server, which then uses a generative AI model to generate a sightseeing plan. This plan includes information on accommodation, transportation, and tourist attraction admission tickets. The generated sightseeing plan is sent to the device and displayed to the user.

[1313] Completing the reservation

[1314] The user reviews the details of the proposed itinerary, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and attractions. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a completion notification, which is displayed to the user via the device.

[1315] Save and reuse profiles

[1316] Before logging out, users can choose whether to save their counseling history and preference information. The device sends this information to the server, which stores it in a database. The next time users use the service, they can reuse the saved profile information to receive faster and more efficient counseling and sightseeing plan suggestions.

[1317] Specific examples

[1318] For example, a first-time user might input their request, "I'd like to stay in Tokyo for a week. I like anime and manga." The server uses a generation AI to propose a plan including tourist spots, accommodations, and transportation, and then selects a specific hotel from the proposed plan and requests a reservation. The server then confirms the reservation and notifies the user.

[1319] Repeat users can also request, "Next time, I'd like to experience traditional culture in Kyoto," based on their previously saved profile information. The server uses generative AI to create a new proposal based on past counseling history and provides it to the user. The user customizes the proposal, selects details, and requests a reservation. The server then confirms the reservation and notifies the user.

[1320] Prompt Sentence Examples

[1321] 1. First-time prompt:

[1322] "I'd like to stay in Tokyo for a week. I love anime and manga. Can you recommend any tourist spots or accommodations?"

[1323] 2. Repeat prompt:

[1324] "When I went to Kyoto before, I experienced the tea ceremony and had a lot of fun. Next time I'd like to experience some traditional culture in Nara. What plan would you recommend?"

[1325] As described above, the present invention provides customized sightseeing plans for foreign tourists, eliminating language barriers, thereby providing a special sightseeing experience and improving the satisfaction of foreign tourists.

[1326] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1327] Processing Steps

[1328] Step 1: User Registration

[1329] Specific behavior:

[1330] 1. The user enters personal information such as name, email address, and password into an input form.

[1331] 2. The terminal sends the entered registration information to the server.

[1332] 3. The server stores the received registration information in a database.

[1333] 4. The server returns a registration completion message to the terminal.

[1334] 5. The terminal displays a registration completion message to the user.

[1335] Input: Name, email address, and password entered by the user

[1336] Output: Registration information saved in the database, registration completion message

[1337] Data processing and calculation:

[1338] Collecting data from input forms

[1339] Save to database

[1340] Generate a registration completion message

[1341] Step 2: User Login

[1342] Specific behavior:

[1343] 1. The user enters the registered email address and password in the login form.

[1344] 2. The terminal sends the login information to the server.

[1345] 3. The server retrieves the registration information from the database and compares it with the input information.

[1346] 4. If authentication is successful, the server generates a session ID and returns it to the terminal.

[1347] 5. The terminal displays a successful login message to the user.

[1348] Input: Email address and password entered by the user

[1349] Output: Session ID, login success message

[1350] Data processing and calculation:

[1351] Retrieving user information from the database

[1352] Verification with login information

[1353] Generate a session ID

[1354] Step 3: Enter and submit your preferences

[1355] Specific behavior:

[1356] 1. The user enters their desired sightseeing information. Example: "I want to stay in Tokyo for a week. I like anime and manga."

[1357] 2. The terminal transmits the entered desired information to the server in real time.

[1358] 3. The server sends the desired information to the generative AI model.

[1359] Input: User-entered preferences

[1360] Output: Sending desired information to the generative AI model

[1361] Data processing and calculation:

[1362] Collecting data from input forms

[1363] Real-time information transfer to the server

[1364] Data transfer to generative AI models

[1365] Step 4: Generate a response using an AI model

[1366] Specific behavior:

[1367] 1. The server sends the received desired information to the generative AI model.

[1368] 2. The generative AI model generates a response based on the input information. Example: "Suggest tourist spots related to anime and manga."

[1369] 3. The server returns the generated response to the terminal.

[1370] 4. The terminal displays the response to the user.

[1371] Input: Desired information received by the generative AI model

[1372] Output: The generated interactive response

[1373] Data processing and calculation:

[1374] Analysis of desired information

[1375] Generate a response using a response generation algorithm

[1376] Step 5: Enter your desired details and submit

[1377] Specific behavior:

[1378] 1. The user inputs detailed information about their desired sightseeing spots, budget, dates, etc.

[1379] 2. The device sends this information to the server.

[1380] Input: Detailed desired information entered by the user

[1381] Output: Send detailed request information to the server

[1382] Data processing and calculation:

[1383] Collecting data from input forms

[1384] Real-time information transfer to the server

[1385] Step 6: Generate a sightseeing plan

[1386] Specific behavior:

[1387] 1. The server sends the detailed desired information to the generating AI model.

[1388] 2. The generative AI model generates a sightseeing itinerary based on the detailed information, including accommodation, transportation, and attraction admission tickets.

[1389] 3. The server sends the generated sightseeing plan to the terminal.

[1390] 4. The terminal displays the sightseeing plan to the user.

[1391] Input: Detailed desired information received by the generative AI model

[1392] Output: Generated itinerary

[1393] Data processing and calculation:

[1394] Analysis of detailed desired information

[1395] Generation of plans using a sightseeing plan generation algorithm

[1396] Step 7: Confirm and request a booking

[1397] Specific behavior:

[1398] 1. The user reviews the proposed itinerary, selects specific accommodations and attractions, and requests a reservation.

[1399] 2. The terminal sends this request information to the server.

[1400] 3. The server checks the availability of the selected facility or spot.

[1401] 4. If the reservation is confirmed, the server sends the reservation information to the partner and generates a completion notification.

[1402] 5. The terminal displays a completion notification to the user.

[1403] Input: Accommodations and attractions selected by the user, reservation request information

[1404] Output: Reservation confirmation and completion notification

[1405] Data processing and calculation:

[1406] Check availability of facilities and spots

[1407] Generate reservation information

[1408] Generate and send a completion notification

[1409] Step 8: Save and reuse your profile information

[1410] Specific behavior:

[1411] 1. The user chooses whether to save their counseling history and preferences.

[1412] 2. If the device chooses to store it, it sends this information to the server.

[1413] 3. The server stores the received information in a database.

[1414] 4. The next time the user uses the service, they will receive new counseling based on the profile information they saved last time.

[1415] Input: User's counseling history, preferences

[1416] Output: Profile information stored in a database for reuse

[1417] Data processing and calculation:

[1418] Counseling information data collection

[1419] Saving to a database

[1420] Reading and providing stored data

[1421] (Application example 1)

[1422] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1423] Conventional tourist information systems were limited in their ability to provide tour plans tailored to the wishes and needs of foreign tourists, and their multilingual support was insufficient. Providing detailed information about tour plans and reservation procedures was also cumbersome. Furthermore, they lacked efficient support for factory workers, making it difficult to provide multilingual work support or reuse work history. This resulted in problems that reduced the satisfaction and efficiency of tourists and workers.

[1424] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1425] In this invention, the server includes means for saving registration information of foreign tourists, means for interacting with foreign tourists and acquiring their preferences and needs, means for generating sightseeing plans based on the preferences and needs, means for providing detailed information about the generated sightseeing plans to foreign tourists, means for providing support in multiple languages, means for saving and reusing profile information of foreign tourists, means for providing sightseeing information in collaboration with local tourism businesses, means for responding to instructions and questions from workers in the factory and proposing optimal work plans in multiple languages, and means for saving work history and reusing it for future work plans. This makes it possible to propose sightseeing plans to foreign tourists and provide efficient work support to workers.

[1426] "Means for storing registration information of foreign tourists" refers to a method for storing basic information such as the name, age, and contact details of foreign tourists in a database.

[1427] "Means for interacting with foreign tourists and obtaining their preferences and needs" refers to an interface that interactively collects the wishes and interests entered by foreign tourists.

[1428] "Means for generating tourist plans based on the preferences and needs" refers to a method for creating tourist plans that meet the preferences and needs of foreign tourists using AI models or other algorithms.

[1429] The "means for providing detailed information about the created sightseeing plan to foreign tourists" is a method for notifying foreign tourists of the details of the created sightseeing plan.

[1430] "Means of providing support in multiple languages" refers to technology that enables the provision of information and dialogue in the languages ​​used by foreign tourists.

[1431] "Means for storing and reusing profile information of foreign tourists" refers to a method for storing past counseling history and preference information in a database and using it for future suggestions and counseling.

[1432] "Means for providing tourism information in partnership with local tourism businesses" refers to a method for providing comprehensive tourism information by partnering with local tourism businesses and incorporating their information into the system.

[1433] "A means of responding to instructions and questions from workers inside the factory and proposing optimal work plans in multiple languages" refers to a method in which workers inside the factory give instructions and ask questions in multiple languages, and based on that information, an optimal work plan is created and provided.

[1434] "Means for saving work history and reusing it for future work plans" refers to a method for saving past work history in a database and using it to create future work plans.

[1435] The system of this invention provides tourist information to foreign tourists and supports factory workers. The system operates in cooperation with three elements: a server, a terminal, and a user.

[1436] System configuration and data processing

[1437] The server includes the following means:

[1438] 1. A means of storing registration information of foreign tourists

[1439] The server stores basic information such as the name, age, and contact details of foreign tourists in a database. This database can be created using MySQL or Firebase.

[1440] 2. A means of communicating with foreign tourists and learning about their preferences and needs

[1441] The server receives input from users in real time and analyzes the information to obtain their preferences and needs. Users input information by voice or text using their smartphones or tablets.

[1442] 3. A way to generate itineraries based on preferences and needs

[1443] The server automatically generates a sightseeing plan based on the acquired preferences and needs using a generative AI model such as OpenAI GPT-3.

[1444] 4. Means of providing detailed information about the generated travel plans to foreign tourists

[1445] The server sends the generated sightseeing plan to the user's terminal and provides detailed information, including information on accommodations, tourist spots, and transportation options.

[1446] 5. Multilingual support options

[1447] The server provides information corresponding to the language selected by the user, and is capable of providing dialogue and guidance in multiple languages.

[1448] 6. Means of storing and reusing foreign tourist profile information

[1449] The server stores past counseling history and preference information in a database and reuses it for the next proposal or counseling session.

[1450] 7. Means of providing tourism information in partnership with local tourism businesses

[1451] The server incorporates tourist information provided in partnership with local tourist businesses into the system and provides comprehensive tourist information to users.

[1452] 8. A means of responding to instructions and questions from workers inside the factory and proposing optimal work plans in multiple languages

[1453] The server allows factory workers to give instructions and ask questions in multiple languages, and based on that information, it uses a generative AI model to create and propose optimal work plans.

[1454] 9. A way to save work history and reuse it for future work planning

[1455] The server stores past work history in a database and uses it to create future work plans.

[1456] Specific examples

[1457] For example, if a foreign tourist inputs "I want to stay in Tokyo for a week. I like anime and manga," the server will use the generative AI model to suggest a sightseeing plan including tourist attractions, accommodations, and transportation. The user can select a plan and proceed with details and reservations.

[1458] In the factory, a worker can ask, "The next step will use part X, which will take about 30 minutes. What is the next step?" The server uses a generative AI model to suggest optimal work steps in multiple languages, and uses work history for future planning.

[1459] Prompt Sentence Examples

[1460] Current work:

[1461] 1. Attach part X

[1462] 2. Use a tightening tool

[1463] 3. Once completed, what are the next steps?

[1464] budget:

[1465] Within 1 hour

[1466] Hope:

[1467] Work efficiently and injury-free

[1468] In this way, the server can utilize the generative AI model to provide effective tourist information and work support in multiple languages.

[1469] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1470] Step 1:

[1471] The user enters the registration information and sends it to the server via the terminal.

[1472] Input: The user enters registration information such as name, age, and contact details.

[1473] Data processing: The terminal formats the information entered by the user and sends it to the server.

[1474] Output: The server saves the registration information in the database and generates a registration complete message.

[1475] Step 2:

[1476] The user initiates a dialogue and inputs their wishes and questions regarding sightseeing or work.

[1477] Input: The user interactively inputs desired content or questions using text or voice.

[1478] Data processing: The terminal converts the input into text format and sends it to the server.

[1479] Output: The server analyzes the input and extracts the user's preferences and needs.

[1480] Step 3:

[1481] The server generates a sightseeing plan or a work plan using the generative AI model.

[1482] Input: Data analyzed to identify user preferences and needs.

[1483] Data calculation: The server uses a generative AI model (e.g., OpenAI GPT-3) to generate a sightseeing or work plan based on the user's input, specifically suggesting relevant tourist spots and efficient work procedures.

[1484] Output: The generated sightseeing plan or work plan is output in text format.

[1485] Step 4:

[1486] The server provides the user with detailed information about the generated plan.

[1487] Input: Generated tourism plan or work plan.

[1488] Data processing: The server formats the detailed information and sends it to the user's device, such as tourist destination details, accommodation ratings, and transportation options.

[1489] Output: The terminal displays this information to the user.

[1490] Step 5:

[1491] The user checks the plan and makes the necessary reservations and procedures.

[1492] Input: The user selects a specific plan (reserving accommodation, purchasing tickets to a tourist attraction, etc.).

[1493] Data calculation: The server performs the reservation procedure based on the selected plan, checks availability, and confirms the reservation.

[1494] Output: Notify the user that the reservation or procedure is complete.

[1495] Step 6:

[1496] The server stores the user's counseling history and work history.

[1497] Input: User's counseling or work history.

[1498] Data processing: The server stores this information in a database and tags and categorizes it for reuse the next time.

[1499] Output: Confirm that the history information has been saved for future use.

[1500] Step 7:

[1501] The server reuses the saved history information the next time you use the server.

[1502] Input: Past counseling history and work history.

[1503] Data calculation: The server uses the historical information as a reference when creating new suggestions for the user.

[1504] Output: New suggestions for efficient counseling and work support are generated.

[1505] Through this series of processes, the server can utilize the generative AI model to provide users with tourist information and work support efficiently and in multiple languages.

[1506] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1507] The present invention relates to a computer system for providing tourist information for foreign tourists, and in particular to a system that interacts with foreign tourists and proposes sightseeing plans in multiple languages ​​that meet their preferences and needs. Furthermore, by combining the system with an emotion engine that recognizes the user's emotions, the user experience can be further improved. Specific embodiments for carrying out the present invention are described below.

[1508] System Overview

[1509] The system includes the following main components:

[1510] 1. User terminal: Devices accessed by foreign tourists (PC, smartphone, tablet, etc.)

[1511] 2. Server: The central computer server of the system

[1512] 3. Database: A data store that stores user information, travel plans, partner information, etc.

[1513] 4. Generative AI Model: Conversational AI for generating sightseeing itineraries

[1514] 5. Emotion Engine: Recognizes user emotions and tailors suggestions based on the conversation

[1515] System Embodiments

[1516] User Registration and Login

[1517] When a user first uses the device, they enter their registration information, such as their name, email address, and password. The device sends this information to the server, which stores it in a database. Once registration is complete, the user logs in using their registration information, and the server verifies the authentication information and starts the session.

[1518] Counseling begins and conversations begin

[1519] The user starts a counseling session and inputs their sightseeing preferences. For example, "I would like to experience traditional culture in Kyoto." The device sends this information to the server in real time, and the server sends the user's input to the generative AI model. The generative AI model generates a conversational response based on the user's input, such as "I recommend a tea ceremony experience and a tour of temples. I can also help with hotel accommodations and transportation." The device displays this response to the user.

[1520] Emotion recognition and suggestion adjustment by emotion engine

[1521] The emotion engine recognizes emotions from user input, voice, facial expressions, etc. For example, if a user inputs, "It's probably going to be crowded again," the emotion engine recognizes this as a negative emotion. This information is sent to the server, and the generation AI generates a different suggestion based on this emotion. For example, it might respond, "I'll introduce you to some hidden spots with fewer tourists." The device then displays this response to the user.

[1522] Generate a sightseeing plan

[1523] The user then enters more detailed information, specifying specific tourist attractions, budget, and itinerary. The device then sends this information to the server, which then uses a generation AI to generate a sightseeing plan. This plan is customized based on the user's preferences and feelings, and includes information on accommodation, transportation, and admission tickets to tourist attractions. The generated sightseeing plan is then sent to the device and displayed to the user.

[1524] Completing the reservation

[1525] The user reviews the details of the proposed itinerary, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and tourist destinations. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a completion notification. The device displays this notification to the user.

[1526] Save and reuse profiles

[1527] Before logging out, users can choose whether to save their counseling history and preference information. The device sends this information to the server, which stores it in a database. The next time users use the service, they can reuse this information, enabling more efficient counseling and sightseeing plans.

[1528] Specific examples

[1529] For example, a first-time user might input their desire to "experience traditional culture in Kyoto." The server then uses the generation AI to suggest a plan that includes tourist spots, suitable accommodations, and transportation. If the emotion engine recognizes that the user's input indicates excitement, the generation AI will suggest additional recommended spots.

[1530] Repeat users can also request, "Next, I'd like to enjoy the latest entertainment in Tokyo," based on their previously saved profile information. The server uses generative AI to create new suggestions based on past counseling history, and if the emotion engine recognizes "anxiety," it will suggest times to avoid crowds and hidden spots. This allows users to plan their trip with greater peace of mind.

[1531] In this way, the present invention is a system that generates customized sightseeing plans for foreign tourists, improves the user experience by adding an emotion engine, removes language barriers, and provides a special sightseeing experience, thereby significantly improving the satisfaction of foreign tourists.

[1532] The processing flow will be explained below.

[1533] Step 1:

[1534] When using the service for the first time, the user enters registration information (name, email address, password).

[1535] Step 2:

[1536] The terminal transmits the entered registration information to the server.

[1537] Step 3:

[1538] The server stores the received registration information in a database.

[1539] Step 4:

[1540] The server sends a notification of registration completion to the terminal.

[1541] Step 5:

[1542] The user receives a notification that registration is complete and logs in.

[1543] Step 6:

[1544] The terminal sends login information (email address, password) to the server.

[1545] Step 7:

[1546] The server verifies the login information and, if authentication is successful, begins the session.

[1547] Step 8:

[1548] The user starts a counseling session and inputs their desired sightseeing information, for example, "I would like to experience traditional culture in Kyoto."

[1549] Step 9:

[1550] The terminal transmits the desired information input by the user to the server.

[1551] Step 10:

[1552] The server sends the user's desired information to the generation AI, which generates an interactive response.

[1553] Step 11:

[1554] For example, the generative AI can generate a response such as, "We recommend a tea ceremony experience or a temple tour. We can also help you with hotel accommodations and transportation."

[1555] Step 12:

[1556] The server sends the generated response to the terminal.

[1557] Step 13:

[1558] The terminal displays the generated response to the user.

[1559] Step 14:

[1560] The emotion engine recognizes emotions from user input, facial expressions, etc. For example, if a user inputs "It's probably going to be crowded again," it will recognize a negative emotion.

[1561] Step 15:

[1562] The server sends the emotion information recognized by the emotion engine to the generation AI.

[1563] Step 16:

[1564] Based on emotional information, the generative AI generates a response such as, "I'll introduce you to some hidden spots with fewer tourists."

[1565] Step 17:

[1566] The server sends the generated response to the terminal.

[1567] Step 18:

[1568] The terminal displays the generated response to the user.

[1569] Step 19:

[1570] The user then enters more detailed requests (specific tourist spots, budget, dates, etc.).

[1571] Step 20:

[1572] The terminal transmits detailed desired information to the server.

[1573] Step 21:

[1574] The server uses AI to generate a sightseeing plan based on detailed desired information.

[1575] Step 22:

[1576] The generative AI generates a customized sightseeing plan based on the user's wishes and feelings, making suggestions including information on accommodation, transportation, and admission tickets to tourist attractions.

[1577] Step 23:

[1578] The server transmits the generated sightseeing plan to the terminal.

[1579] Step 24:

[1580] The terminal displays the generated sightseeing plan to the user.

[1581] Step 25:

[1582] The user reviews the details of the proposed tour plan, selects a specific hotel, and requests a reservation.

[1583] Step 26:

[1584] The terminal transmits the user's reservation request to the server.

[1585] Step 27:

[1586] The server checks availability of the selected accommodations and tourist destinations.

[1587] Step 28:

[1588] The server confirms the reservation and sends the reservation information to the partner.

[1589] Step 29:

[1590] The server sends a reservation completion notification to the terminal.

[1591] Step 30:

[1592] The terminal displays a notification to the user that the reservation is complete.

[1593] Step 31:

[1594] Before logging out, the user has the option to save their counseling history and preferences.

[1595] Step 32:

[1596] The terminal transmits the profile information to be saved to the server.

[1597] Step 33:

[1598] The server stores the profile information and counseling history in a database.

[1599] Step 34:

[1600] The next time the user uses the service, the server will provide efficient counseling and suggest sightseeing plans based on the saved profile information.

[1601] Example 2

[1602] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1603] Conventional tourist information systems for foreign tourists have difficulty proposing sightseeing plans that meet the individual preferences and needs of users, and do not adjust the proposals to take into account the user's emotional state. As a result, there are problems with user satisfaction and a poor user experience.

[1604] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1605] A means for storing registration information of foreign tourists;

[1606] A means of communicating with foreign tourists and obtaining information on their preferences and needs;

[1607] means for generating a sightseeing plan based on said preferences and needs;

[1608] A means for providing detailed information about the generated travel plans to foreign tourists;

[1609] Multilingual support options and

[1610] a means of storing and reusing foreign tourist profile information;

[1611] A means of providing tourism information in partnership with local tourism businesses;

[1612] A means of recognizing tourists' emotions and adjusting the content of the offers;

[1613] This allows for customized sightseeing plans based on the user's preferences and needs, as well as tailoring suggestions to suit the user's emotional state.

[1614] "Foreign tourists" are travelers visiting a country other than their own.

[1615] "Registration information" refers to information such as name, email address, and password that a user enters when using the service for the first time.

[1616] "Interaction" refers to the process by which a computer system and a user interact with each other.

[1617] "Preferences and needs" refers to the user's individual requests and needs, such as desired tourist destinations, experiences, and itineraries.

[1618] "Sightseeing Plan" means a travel plan including attractions, accommodations, transportation, and other necessary details generated based on the user's preferences and needs.

[1619] "Multilingual support" is a function that provides guidance and responses to users in multiple languages.

[1620] "Profile information" refers to information about a user's past usage history and preferences.

[1621] "Local tourism operators" are companies or individuals that provide tourism services in a particular tourist destination.

[1622] "Emotion recognition" is a technology that detects a user's emotional state from input, voice, facial expressions, etc.

[1623] "Recommendation adjustment" refers to the process of changing and adapting recommended sightseeing itineraries and travel suggestions based on the user's emotional state.

[1624] The present invention relates to a computer system for providing tourist information for foreign tourists, and in particular to a system that interacts with foreign tourists and proposes sightseeing plans in multiple languages ​​that meet their preferences and needs. Furthermore, by combining the system with an emotion engine that recognizes the user's emotions, the user experience can be further improved. Specific embodiments for carrying out the present invention are described below.

[1625] Key components of the system

[1626] 1. User terminal: Devices accessed by foreign tourists (PC, smartphone, tablet, etc.)

[1627] 2. Server: The central computer server of the system

[1628] 3. Database: A data store that stores user information, travel plans, partner information, etc.

[1629] 4. Generative AI Model: Conversational AI for generating sightseeing itineraries

[1630] 5. Emotion Engine: Recognizes user emotions and tailors suggestions based on the conversation

[1631] User Registration and Login

[1632] When a user first uses the device, they enter their registration information, such as their name, email address, and password. The device sends this information to the server, which stores it in a database. Once registration is complete, the user logs in, and the server verifies the authentication information and starts the session.

[1633] Counseling begins and conversations begin

[1634] The user starts a counseling session and inputs their sightseeing preferences. For example, they might say, "I'd like to experience traditional culture in Kyoto." The device sends this information to the server in real time, and the server sends the user's preferences in the form of prompts to the generative AI model. The generative AI model generates a conversational response based on the user's input, such as, "I recommend a tea ceremony experience and a tour of temples. I can also help you with hotel accommodations and transportation." The device then displays this response to the user.

[1635] Emotion recognition and suggestion adjustment by emotion engine

[1636] The emotion engine recognizes emotions from user input, voice, facial expressions, etc. For example, if a user inputs, "It's probably going to be crowded again," the emotion engine recognizes negative emotions. The device sends this emotional information to the server, which then has the generative AI model create new suggestions that take emotion into account. For example, the server might respond, "I'll introduce you to some hidden spots with fewer tourists." The device then displays this new suggestion to the user.

[1637] Generate a sightseeing plan

[1638] The user then enters more detailed information, including specific tourist attractions, budget, and itinerary. The device then sends this information to the server, which then uses the generative AI model to generate a detailed itinerary, including information on accommodation, transportation, and admission tickets to tourist attractions. The generated itinerary is then sent to the device and displayed to the user.

[1639] Completing the reservation

[1640] The user reviews the details of the proposed travel plan, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and tourist destinations. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a reservation completion notification. The device displays this notification to the user.

[1641] Save and reuse profiles

[1642] Before logging out, users can choose whether to save their counseling history and preference information. The device sends this information to the server, which then stores it in a database. The next time the user uses the service, they can reuse the saved information to receive more efficient counseling.

[1643] Specific examples

[1644] First-time use example

[1645] Example: A user inputs a request such as "I would like to experience traditional culture in Kyoto."

[1646] The terminal sends this information to the server.

[1647] The server sends the desired content to the generative AI model in the form of a prompt. An example of a prompt is: "The user wants to experience traditional culture in Kyoto. Please generate the optimal sightseeing plan for this."

[1648] The generative AI model generates a plan that includes tourist attractions, suitable accommodations, and transportation. An example of a generated response is, "We suggest a tea ceremony experience, a tour of temples, and a traditional craft workshop."

[1649] The terminal displays the generated plan to the user.

[1650] Examples of repeat use

[1651] Example: A repeat user requests, "Next time, I'd like to enjoy the latest entertainment in Tokyo."

[1652] The terminal sends this information to the server.

[1653] The server sends a request to the generative AI model that takes into account the user's past counseling history. An example of a prompt sentence is: "The user has previously enjoyed traditional culture in Kyoto. This time, the user wants to experience new entertainment in Tokyo."

[1654] The generative AI model generates new itineraries based on past history and new requests.

[1655] The terminal displays the generated plan to the user.

[1656] If any anxiety about the plan is detected (e.g., "Is it going to be crowded?"), the server resubmits the emotion recognition information to the generative AI model, which then suggests timings and hidden spots to avoid crowds. This is how the final recommendation is created.

[1657] The terminal displays the final proposal to the user.

[1658] As described above, the present invention is a system that generates customized sightseeing itineraries for foreign tourists and dramatically improves the user experience by including emotion recognition.

[1659] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1660] Step 1: User Registration

[1661] When a user uses the device for the first time, they enter registration information such as their name, email address, and password. The device then sends this information to the server, which then stores the received information in a database. This completes the user's registration.

[1662] Input: Name, Email Address, Password

[1663] Data processing: Convert input information into JSON format and send it to the server

[1664] Output: Registration information is saved in the database

[1665] Step 2: Log in

[1666] The user logs in using their registration information. The terminal sends the entered authentication information to the server. The server verifies the authentication information and, if valid, starts a session.

[1667] Input: Name, Password

[1668] Data calculation: authentication information verification, database matching

[1669] Output: Session started

[1670] Step 3: Counseling begins

[1671] The user starts a counseling session and inputs their desired tourist information. For example, they might input a preference such as "I would like to experience traditional culture in Kyoto." The device sends this information in real time to the server, which then sends the user's desired information in the form of prompts to the generative AI model.

[1672] Input: Desired tourist information

[1673] Data processing: Convert into prompt sentence format and send to generative AI model

[1674] Output: Input data for the generative AI model is created

[1675] Step 4: Generative AI model generates interactive responses

[1676] The server sends a prompt to the generative AI model, which generates a conversational response based on the user's input. For example, it might respond, "We recommend a tea ceremony experience or a temple tour." The device then displays this response to the user.

[1677] Input: prompt statement

[1678] Data Computation: Response Generation with Generative AI Models

[1679] Output: Interactive response (e.g. "I recommend experiencing a tea ceremony and visiting temples.")

[1680] Step 5: Emotion Recognition

[1681] The emotion engine recognizes emotions from user input, voice, facial expressions, etc. For example, if a user inputs "It's probably going to be crowded again," it recognizes negative emotions. The device then sends this emotional information to the server.

[1682] Input: User emotion data (text, voice, facial expressions)

[1683] Data Computing: Applying Emotion Recognition Algorithms

[1684] Output: Emotional information (e.g., negative emotions)

[1685] Step 6: Adjust your proposal

[1686] The server provides the emotion information to the generative AI model, which then generates new suggestions that take emotion into account. For example, it might respond, "We'll introduce you to some hidden spots with fewer tourists." The device then displays the new suggestions to the user.

[1687] Input: Emotion information

[1688] Data Computation: Re-proposal Generation with Generative AI Models

[1689] Output: New proposal (e.g., "I'll introduce you to some hidden spots with few tourists")

[1690] Step 7: Setting up your itinerary

[1691] The user further inputs detailed preferences (tourist attractions, budget, schedule, etc.). The device sends this information to the server. The server uses a generative AI model to generate a detailed sightseeing plan. This plan includes information on accommodation, transportation, and admission tickets to tourist attractions. The generated sightseeing plan is sent to the device and displayed to the user.

[1692] Input: Detailed desired information

[1693] Data processing: Generating a sightseeing plan using a generative AI model

[1694] Output: Detailed itinerary

[1695] Step 8: Complete your booking

[1696] The user checks the details of the proposed travel plan, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and tourist destinations. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a reservation completion notification. The device displays this notification to the user.

[1697] Input: Reservation request information

[1698] Data calculation: Check availability, generate and send reservation information

[1699] Output: Reservation completion notification

[1700] Step 9: Saving and Reusing Profiles

[1701] Before logging out, the user can choose whether to save their counseling history and preference information. The device sends this information to the server, which then stores it in a database. The next time the user uses the service, they can reuse the saved information to receive more efficient counseling.

[1702] Input: Profile information to save

[1703] Data processing: Saving profile information

[1704] Output: Saved profile information

[1705] Through these processing steps, the system can not only provide customized sightseeing plans based on the user's preferences and needs, but also adjust suggestions based on emotion recognition, greatly improving the user experience.

[1706] (Application example 2)

[1707] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1708] Foreign tourists often feel anxious about their experiences in the countries they visit due to language barriers and cultural differences. Collecting tourist information quickly and efficiently and providing customized tour plans tailored to individual needs and preferences is also a challenge. Furthermore, there is a demand for a system that can automatically adjust suggestions in response to emotional changes during the tour. In particular, there is a desire for autonomous vehicles to provide tourist information at tourist destinations.

[1709] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1710] In this invention, the server includes means for saving registration information of foreign tourists, means for interacting with foreign tourists and acquiring their preferences and needs, means for generating sightseeing plans based on the preferences and needs, means for providing detailed information about the generated sightseeing plans to foreign tourists, means for providing support in multiple languages, means for saving and reusing profile information of foreign tourists, means for providing sightseeing information in collaboration with local tourism businesses, means for performing emotion recognition and adjusting suggestions according to the user's emotions, and means for providing sightseeing guides for autonomous vehicles. This allows foreign tourists to enjoy sightseeing with peace of mind, and makes it possible to easily provide sightseeing plans that meet their individual needs and preferences.

[1711] "Foreign tourists" refers to travelers visiting a country other than their home country.

[1712] "Tourist information" refers to information about tourist attractions, accommodation, transportation, restaurants, leisure activities, etc.

[1713] A "computer system" refers to an information processing system in which multiple components and devices function in cooperation with one another.

[1714] "Registration Information" refers to basic personal information such as a User's name, email address, and password.

[1715] "Preferences and needs" refers to the specific requests and desires of users regarding the experiences they desire and the services they expect.

[1716] A "tourist plan" refers to a specific travel plan that includes the order in which tourist spots are visited, accommodation, transportation, restaurants, etc.

[1717] "Emotion recognition" refers to the technology of identifying emotions from a user's voice, facial expressions, text input, etc.

[1718] "Multilingual support" refers to the ability to provide information and user interfaces in multiple languages.

[1719] "Profile information" refers to personal information such as a user's past behavioral history, preferences, needs, etc.

[1720] "Local tourism operators" refer to companies and organizations that provide services in tourist destinations.

[1721] An "autonomous vehicle" refers to a vehicle that operates autonomously without human operation.

[1722] "Tourist information" refers to providing information about tourist spots and giving tour instructions.

[1723] In this invention, we will explain how to specifically realize a tourist information system for self-driving vehicles provided to foreign tourists.

[1724] System Overview

[1725] The system includes the following main components:

[1726] 1. User terminal: Device accessed by foreign tourists (smart glasses)

[1727] 2. Server: The central computer server of the system

[1728] 3. Database: A data store that stores user information, travel plans, partner information, etc.

[1729] 4. Generative AI Model: Conversational AI for generating sightseeing itineraries

[1730] 5. Emotion Engine: Recognizes user emotions and tailors suggestions based on the conversation

[1731] 6. Autonomous Driving Navigation: A navigation system for autonomous vehicles to travel around tourist spots

[1732] System Embodiments

[1733] User Registration and Login

[1734] When a user first uses the device, they enter their registration information, such as their name, email address, and password. The device sends this information to the server, which stores it in a database. Once registration is complete, the user logs in using their registration information, and the server verifies the authentication information and starts the session.

[1735] Counseling begins and conversations begin

[1736] The user starts a counseling session and inputs their sightseeing preferences. For example, "I would like to experience traditional culture in Kyoto." The device sends this information to the server in real time, and the server sends the user's input to the generative AI model. The generative AI model generates a conversational response based on the user's input, such as "I recommend a tea ceremony experience and a tour of temples. I can also help with accommodation and transportation." The device displays this response to the user.

[1737] Emotion recognition and suggestion adjustment by emotion engine

[1738] The emotion engine recognizes emotions from user input, voice, facial expressions, etc. For example, if a user inputs, "It's probably going to be crowded again," the emotion engine recognizes this as a negative emotion. This information is sent to the server, and the generation AI generates a different suggestion based on this emotion. For example, it might respond, "I'll introduce you to some hidden spots with fewer tourists." The device then displays this response to the user.

[1739] Self-driving navigation settings

[1740] Once the user's sightseeing plan is finalized, the server sends route information to the autonomous driving navigation system to set the order in which the tourist spots are to be visited. The autonomous driving vehicle then travels around the tourist spots according to this route information.

[1741] Specific examples

[1742] For example, a first-time user might input their desire to "experience traditional culture in Kyoto." The server uses the generation AI to propose a plan that includes tourist spots, suitable accommodations, and transportation. If the emotion engine recognizes that the user's input indicates excitement, the generation AI will suggest additional recommended spots. The following prompt sentences are possible user inputs:

[1743] User input: "I want to experience traditional tea ceremony in Kyoto."

[1744] Server response: "We suggest a tea ceremony experience at a famous temple, followed by a leisurely tour of nearby temples and a visit to a traditional craft workshop."

[1745] The above is a specific embodiment for carrying out the present invention. By using this system, foreign tourists can enjoy sightseeing with peace of mind, and it is possible to easily provide sightseeing plans that meet individual needs and preferences.

[1746] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1747] Step 1:

[1748] When a user first uses a device, they enter their registration information, such as their name, email address, and password. This information is sent from the device to the server, which stores it in a database. The user then enters their login information for authentication, and the server verifies the authentication information and starts the session.

[1749] Input: Name, Email Address, Password

[1750] Output: User information stored in database, session started

[1751] Step 2:

[1752] The user starts a counseling session on the device and inputs their desired tourist information. This input information is sent from the device to the server in real time, and the server sends the user's desired information to the generative AI model. The generative AI model generates an interactive response based on the user's input and sends it to the device. This response is then displayed to the user.

[1753] Input: User's desired information (e.g., I want to experience traditional culture in Kyoto)

[1754] Output: A conversational response from the generative AI model (e.g., recommending tea ceremony experiences and temple tours. We can also help with accommodation and transportation)

[1755] Step 3:

[1756] The emotion engine recognizes emotions from the user's input, voice, facial expressions, etc. The recognition results are sent to the server, and the generation AI generates suggestions based on the emotion. For example, if the user expresses negative emotions, it generates a response such as "I'll introduce you to some hidden spots with fewer tourists." The device displays this response to the user.

[1757] Input: User's sentiment (e.g., "It's probably going to be crowded again").

[1758] Output: Suggestions from generative AI based on emotions (e.g., hidden spots with few tourists)

[1759] Step 4:

[1760] Once the user's sightseeing plan is finalized, the server sends route information to the autonomous driving navigation system to set the order in which the tourist spots are to be visited. The autonomous driving vehicle then travels around the tourist spots according to this route information.

[1761] Input: Confirmed sightseeing plan (sightseeing spot order)

[1762] Output: Route information for the autonomous driving navigation system

[1763] Step 5:

[1764] While sightseeing, the emotion engine continues to recognize the user's emotions in real time as the self-driving vehicle travels along the designated route. The recognition results are sent to the server, and the content of the sightseeing guide is adjusted accordingly. If the emotion is positive, the sightseeing guide continues, and if it is negative, new suggestions are made.

[1765] Input: Real-time user sentiment

[1766] Output: Adjustment of tourist information according to emotions, feedback to the user

[1767] Step 6:

[1768] After completing their visit, users can choose to save their counseling history and preferences on their device. The selected information is sent from the device to the server and stored in a database. This information can be reused the next time the user visits.

[1769] Input: Post-tour counseling history and preference save selection

[1770] Output: History information and preferences stored in a database

[1771] This allows users to enjoy an efficient and personalized tourism experience.

[1772] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1773] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1774] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1775] [Fourth embodiment]

[1776] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1777] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1778] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1779] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1780] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1781] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1782] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1783] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1784] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1785] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1786] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1787] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1788] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1789] The present invention relates to a computer system for providing tourist information for foreign tourists, and in particular to a system that interacts with foreign tourists and proposes sightseeing plans in multiple languages ​​that meet their preferences and needs. Specific embodiments for carrying out the present invention are described below.

[1790] System Overview

[1791] The system includes the following main components:

[1792] 1. User terminal: Devices accessed by foreign tourists (PC, smartphone, tablet, etc.)

[1793] 2. Server: The central computer server of the system

[1794] 3. Database: A data store that stores user information, travel plans, partner information, etc.

[1795] 4. Generative AI Model: Conversational AI for generating sightseeing itineraries

[1796] System Embodiments

[1797] User Registration and Login

[1798] When a user first uses the device, they enter their registration information, such as their name, email address, and password. The device sends this information to the server, which stores it in a database. Once registration is complete, the user logs in using their registration information, and the server verifies the authentication information and starts the session.

[1799] Counseling begins and conversations begin

[1800] The user starts a counseling session and inputs their desired sightseeing information. For example, "I'd like to stay in Tokyo for a week. I like anime and manga." The device sends this information to the server in real time, and the server sends the user's input to the generative AI model. The generative AI model generates an interactive response based on the user's input, such as "I'll suggest sightseeing spots related to anime and manga. I can also help you with hotels and transportation." The device displays this response to the user.

[1801] Generate a sightseeing plan

[1802] The user then enters further details of their preferences, such as specific tourist spots, budget, and itinerary. The device sends this information to the server, which then uses a generation AI to generate a sightseeing plan. This sightseeing plan is customized based on the user's preferences and includes information on accommodation, transportation, and admission tickets to tourist attractions. The generated sightseeing plan is then sent to the device and displayed to the user.

[1803] Completing the reservation

[1804] The user checks the details of the proposed tour plan, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and tourist destinations. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a completion notification. The device displays this notification to the user.

[1805] Save and reuse profiles

[1806] Before logging out, users can choose whether to save their counseling history and preference information. The device sends this information to the server, which stores it in a database. The next time users use the service, they can reuse this information, enabling more efficient counseling and sightseeing plans.

[1807] Specific examples

[1808] For example, a first-time user might input their request, "I'd like to stay in Tokyo for a week. I like anime and manga." The server uses a generative AI to propose a plan including tourist spots, suitable accommodations, and transportation, and then selects a specific hotel from the proposed plan and requests a reservation. The server then confirms the reservation and notifies the user.

[1809] Repeat users can also request, "Next time, I'd like to experience traditional culture in Kyoto," based on their previously saved profile information. The server uses generative AI to create a new proposal based on past counseling history and provides it to the user. The user customizes the proposal, selects details, and requests a reservation. The server then confirms the reservation and notifies the user.

[1810] In this way, the present invention is a system that generates customized sightseeing plans for foreign tourists, removes language barriers, and provides special sightseeing experiences, thereby improving the satisfaction of foreign tourists.

[1811] The processing flow will be explained below.

[1812] Step 1:

[1813] When using the service for the first time, the user enters registration information (name, email address, password).

[1814] Step 2:

[1815] The terminal transmits the entered registration information to the server.

[1816] Step 3:

[1817] The server stores the received registration information in a database.

[1818] Step 4:

[1819] The server sends a notification of registration completion to the terminal.

[1820] Step 5:

[1821] The user receives a notification that registration is complete and logs in using the registration information.

[1822] Step 6:

[1823] The terminal sends login information (email address, password) to the server.

[1824] Step 7:

[1825] The server verifies the login information and, if authentication is successful, begins the session.

[1826] Step 8:

[1827] The user begins a counseling session and inputs their sightseeing preferences.

[1828] Step 9:

[1829] The terminal transmits the desired information input by the user to the server.

[1830] Step 10:

[1831] The server sends the user's desired information to the generation AI, which generates an interactive response.

[1832] Step 11:

[1833] The generative AI generates responses such as, "We'll suggest tourist spots related to anime and manga. We can also help you with hotels and transportation."

[1834] Step 12:

[1835] The server sends the generated response to the terminal.

[1836] Step 13:

[1837] The terminal displays the generated response to the user.

[1838] Step 14:

[1839] The user then enters more detailed requests (specific tourist spots, budget, dates, etc.).

[1840] Step 15:

[1841] The terminal transmits detailed desired information to the server.

[1842] Step 16:

[1843] The server uses AI to generate a sightseeing plan based on detailed desired information.

[1844] Step 17:

[1845] The generative AI generates a customized sightseeing plan based on the user's preferences, including information on accommodation, transportation, and admission tickets to tourist attractions.

[1846] Step 18:

[1847] The server transmits the generated sightseeing plan to the terminal.

[1848] Step 19:

[1849] The terminal displays the generated sightseeing plan to the user.

[1850] Step 20:

[1851] The user reviews the details of the proposed tour plan, selects a specific hotel, and requests a reservation.

[1852] Step 21:

[1853] The terminal transmits the user's reservation request to the server.

[1854] Step 22:

[1855] The server checks availability of the selected accommodations and tourist destinations.

[1856] Step 23:

[1857] The server confirms the reservation and sends the reservation information to the partner.

[1858] Step 24:

[1859] The server sends a reservation completion notification to the terminal.

[1860] Step 25:

[1861] The terminal displays a notification to the user that the reservation is complete.

[1862] Step 26:

[1863] Before logging out, the user has the option to save their counseling history and preferences.

[1864] Step 27:

[1865] The terminal transmits the profile information to be saved to the server.

[1866] Step 28:

[1867] The server stores the profile information and counseling history in a database.

[1868] Step 29:

[1869] The next time the user uses the service, the server will provide efficient counseling and suggest sightseeing plans based on the saved profile information.

[1870] Example 1

[1871] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1872] In recent years, with the increase in foreign tourists, the provision of information about tourist destinations and reservation procedures have become more complicated. In particular, providing multilingual support and proposing tour plans tailored to individual needs has become a major burden for many tourism operators. In addition, tourists themselves find it time-consuming to gather information and make reservations, making it difficult for them to enjoy sightseeing smoothly. To solve these problems, an efficient and effective information provision and reservation system that can meet the diverse needs of foreign tourists is required.

[1873] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1874] In this invention, the server includes: means for storing registration information of foreign tourists; means for interacting with foreign tourists to acquire their preferences and needs; means for using a generative AI model to generate a tour plan based on the preferences and needs; means for presenting detailed information about the generated tour plan to foreign tourists; means for providing support in multiple languages; means for managing reservation information for accommodations, transportation, and tourist attractions in tourist destinations; means for saving and reusing foreign tourists' profile information; means for transferring desired information to the server in real time and generating and providing interactive responses; and means for providing tour information in collaboration with local tourism operators. This allows foreign tourists to easily obtain tour plans that suit their preferences and needs and makes reservations smoothly. Furthermore, operators can efficiently provide information in multiple languages ​​and according to individual requests.

[1875] "Foreign tourists" are tourists whose nationality is different from that of the country of the tourist destination they are visiting.

[1876] "Registration information" refers to personal information such as name, email address, and password that foreign tourists provide prior to using the system.

[1877] "Means of dialogue" refers to the function of exchanging information with foreign tourists via text or voice.

[1878] "Preferences and needs" refers to the personal requests and preferences of foreign tourists, such as the tourist destinations and activities they wish to visit, their budget, and the length of their stay.

[1879] A "generative AI model" is an artificial intelligence algorithm that generates tourist plans based on input data.

[1880] A "tourism plan" is a plan that includes tourist attractions, activities, accommodation, transportation, etc. proposed based on the preferences and needs of foreign tourists.

[1881] "Means of providing support in multiple languages" refers to the function of providing information and dialogue responses to foreign tourists in multiple languages.

[1882] "Accommodation facilities" refer to facilities such as hotels, inns, and hostels where foreign tourists can stay at their destination.

[1883] "Transportation" refers to services such as public transportation and rental cars used to travel to and within tourist destinations.

[1884] "Tourist spots" are places and facilities that are particularly worth seeing within a tourist destination.

[1885] "Means for managing reservation information" refers to the function of recording and managing reservation status for accommodations, transportation, and tourist attractions.

[1886] "Profile information" refers to stored personal data such as a foreign tourist's past counseling history, preferences, and request information.

[1887] "Means for transferring desired information to the server in real time" refers to a function that instantly transmits desired information entered by foreign tourists to the server.

[1888] "Means for generating and providing interactive responses" refers to a function that uses a generative AI model to generate responses based on input information in real time and provide them to foreign tourists.

[1889] "Local tourism operators" are businesses that provide services such as accommodation, transportation, and activities to tourists in tourist destinations.

[1890] The present invention relates to a computer system for providing tourist information to foreign tourists, and in particular to a system that interacts with foreign tourists and proposes sightseeing plans in multiple languages ​​that meet their preferences and needs. Specific embodiments for implementing this system are described below.

[1891] User Registration and Login

[1892] When a user first uses the system, they enter their registration information, such as their name, email address, and password, into a dedicated form. The device sends the information to the server, which stores it in a database. Once registration is complete, the user logs in using their registration information, and the server verifies the authentication information and starts the session.

[1893] Counseling begins and conversations begin

[1894] The user inputs their desired sightseeing information. For example, "I would like to stay in Tokyo for a week. I like anime and manga." The device sends this information to the server in real time, and the server sends the user's input to the generative AI model. The generative AI model generates an interactive response based on the user's input, such as "I will suggest tourist spots related to anime and manga. I can also help you with hotels and transportation." The device displays this response to the user.

[1895] Generate a sightseeing plan

[1896] The user inputs detailed preferences, such as specific tourist attractions, budget, and itinerary. The device sends this information to the server, which then uses a generative AI model to generate a sightseeing plan. This plan includes information on accommodation, transportation, and tourist attraction admission tickets. The generated sightseeing plan is sent to the device and displayed to the user.

[1897] Completing the reservation

[1898] The user reviews the details of the proposed itinerary, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and attractions. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a completion notification, which is displayed to the user via the device.

[1899] Save and reuse profiles

[1900] Before logging out, users can choose whether to save their counseling history and preference information. The device sends this information to the server, which stores it in a database. The next time users use the service, they can reuse the saved profile information to receive faster and more efficient counseling and sightseeing plan suggestions.

[1901] Specific examples

[1902] For example, a first-time user might input their request, "I'd like to stay in Tokyo for a week. I like anime and manga." The server uses a generation AI to propose a plan including tourist spots, accommodations, and transportation, and then selects a specific hotel from the proposed plan and requests a reservation. The server then confirms the reservation and notifies the user.

[1903] Repeat users can also request, "Next time, I'd like to experience traditional culture in Kyoto," based on their previously saved profile information. The server uses generative AI to create a new proposal based on past counseling history and provides it to the user. The user customizes the proposal, selects details, and requests a reservation. The server then confirms the reservation and notifies the user.

[1904] Prompt Sentence Examples

[1905] 1. First-time prompt:

[1906] "I'd like to stay in Tokyo for a week. I love anime and manga. Can you recommend any tourist spots or accommodations?"

[1907] 2. Repeat prompt:

[1908] "When I went to Kyoto before, I experienced the tea ceremony and had a lot of fun. Next time I'd like to experience some traditional culture in Nara. What plan would you recommend?"

[1909] As described above, the present invention provides customized sightseeing plans for foreign tourists, eliminating language barriers, thereby providing a special sightseeing experience and improving the satisfaction of foreign tourists.

[1910] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1911] Processing Steps

[1912] Step 1: User Registration

[1913] Specific behavior:

[1914] 1. The user enters personal information such as name, email address, and password into an input form.

[1915] 2. The terminal sends the entered registration information to the server.

[1916] 3. The server stores the received registration information in a database.

[1917] 4. The server returns a registration completion message to the terminal.

[1918] 5. The terminal displays a registration completion message to the user.

[1919] Input: Name, email address, and password entered by the user

[1920] Output: Registration information saved in the database, registration completion message

[1921] Data processing and calculation:

[1922] Collecting data from input forms

[1923] Save to database

[1924] Generate a registration completion message

[1925] Step 2: User Login

[1926] Specific behavior:

[1927] 1. The user enters the registered email address and password in the login form.

[1928] 2. The terminal sends the login information to the server.

[1929] 3. The server retrieves the registration information from the database and compares it with the input information.

[1930] 4. If authentication is successful, the server generates a session ID and returns it to the terminal.

[1931] 5. The terminal displays a successful login message to the user.

[1932] Input: Email address and password entered by the user

[1933] Output: Session ID, login success message

[1934] Data processing and calculation:

[1935] Retrieving user information from the database

[1936] Verification with login information

[1937] Generate a session ID

[1938] Step 3: Enter and submit your preferences

[1939] Specific behavior:

[1940] 1. The user enters their desired sightseeing information. Example: "I want to stay in Tokyo for a week. I like anime and manga."

[1941] 2. The terminal transmits the entered desired information to the server in real time.

[1942] 3. The server sends the desired information to the generative AI model.

[1943] Input: User-entered preferences

[1944] Output: Sending desired information to the generative AI model

[1945] Data processing and calculation:

[1946] Collecting data from input forms

[1947] Real-time information transfer to the server

[1948] Transferring data to generative AI models

[1949] Step 4: Generate a response using an AI model

[1950] Specific behavior:

[1951] 1. The server sends the received desired information to the generative AI model.

[1952] 2. The generative AI model generates a response based on the input information. Example: "Suggest tourist spots related to anime and manga."

[1953] 3. The server returns the generated response to the terminal.

[1954] 4. The terminal displays the response to the user.

[1955] Input: Desired information received by the generative AI model

[1956] Output: The generated interactive response

[1957] Data processing and calculation:

[1958] Analysis of desired information

[1959] Generate a response using a response generation algorithm

[1960] Step 5: Enter your desired details and submit

[1961] Specific behavior:

[1962] 1. The user inputs detailed information about their desired sightseeing spots, budget, dates, etc.

[1963] 2. The device sends this information to the server.

[1964] Input: Detailed desired information entered by the user

[1965] Output: Send detailed request information to the server

[1966] Data processing and calculation:

[1967] Collecting data from input forms

[1968] Real-time information transfer to the server

[1969] Step 6: Generate a sightseeing plan

[1970] Specific behavior:

[1971] 1. The server sends the detailed desired information to the generating AI model.

[1972] 2. The generative AI model generates a sightseeing itinerary based on the detailed information, including accommodation, transportation, and attraction admission tickets.

[1973] 3. The server sends the generated sightseeing plan to the terminal.

[1974] 4. The terminal displays the sightseeing plan to the user.

[1975] Input: Detailed desired information received by the generative AI model

[1976] Output: Generated itinerary

[1977] Data processing and calculation:

[1978] Analysis of detailed desired information

[1979] Generation of plans using a sightseeing plan generation algorithm

[1980] Step 7: Confirm and request a booking

[1981] Specific behavior:

[1982] 1. The user reviews the proposed itinerary, selects specific accommodations and attractions, and requests a reservation.

[1983] 2. The terminal sends this request information to the server.

[1984] 3. The server checks the availability of the selected facility or spot.

[1985] 4. If the reservation is confirmed, the server sends the reservation information to the partner and generates a completion notification.

[1986] 5. The terminal displays a completion notification to the user.

[1987] Input: Accommodations and attractions selected by the user, reservation request information

[1988] Output: Reservation confirmation and completion notification

[1989] Data processing and calculation:

[1990] Check availability of facilities and spots

[1991] Generate reservation information

[1992] Generate and send a completion notification

[1993] Step 8: Save and reuse your profile information

[1994] Specific behavior:

[1995] 1. The user chooses whether to save their counseling history and preferences.

[1996] 2. If the device chooses to store it, it sends this information to the server.

[1997] 3. The server stores the received information in a database.

[1998] 4. The next time the user uses the service, they will receive new counseling based on the profile information they saved last time.

[1999] Input: User's counseling history, preferences

[2000] Output: Profile information stored in a database for reuse

[2001] Data processing and calculation:

[2002] Counseling information data collection

[2003] Saving to a database

[2004] Reading and providing stored data

[2005] (Application example 1)

[2006] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2007] Conventional tourist information systems were limited in their ability to provide tour plans tailored to the wishes and needs of foreign tourists, and their multilingual support was insufficient. Providing detailed information about tour plans and reservation procedures was also cumbersome. Furthermore, they lacked efficient support for factory workers, making it difficult to provide multilingual work support or reuse work history. This resulted in problems that reduced the satisfaction and efficiency of tourists and workers.

[2008] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2009] In this invention, the server includes means for saving registration information of foreign tourists, means for interacting with foreign tourists and acquiring their preferences and needs, means for generating sightseeing plans based on the preferences and needs, means for providing detailed information about the generated sightseeing plans to foreign tourists, means for providing support in multiple languages, means for saving and reusing profile information of foreign tourists, means for providing sightseeing information in collaboration with local tourism businesses, means for responding to instructions and questions from workers in the factory and proposing optimal work plans in multiple languages, and means for saving work history and reusing it for future work plans. This makes it possible to propose sightseeing plans to foreign tourists and provide efficient work support to workers.

[2010] "Means for storing registration information of foreign tourists" refers to a method for storing basic information such as the name, age, and contact details of foreign tourists in a database.

[2011] "Means for interacting with foreign tourists and obtaining their preferences and needs" refers to an interface that interactively collects the wishes and interests entered by foreign tourists.

[2012] "Means for generating tourist plans based on the preferences and needs" refers to a method for creating tourist plans that meet the preferences and needs of foreign tourists using AI models or other algorithms.

[2013] The "means for providing detailed information about the created sightseeing plan to foreign tourists" is a method for notifying foreign tourists of the details of the created sightseeing plan.

[2014] "Means of providing support in multiple languages" refers to technology that enables the provision of information and dialogue in the languages ​​used by foreign tourists.

[2015] "Means for storing and reusing profile information of foreign tourists" refers to a method for storing past counseling history and preference information in a database and using it for future suggestions and counseling.

[2016] "Means for providing tourism information in partnership with local tourism businesses" refers to a method for providing comprehensive tourism information by partnering with local tourism businesses and incorporating their information into the system.

[2017] "A means of responding to instructions and questions from workers inside the factory and proposing optimal work plans in multiple languages" refers to a method in which workers inside the factory give instructions and ask questions in multiple languages, and based on that information, an optimal work plan is created and provided.

[2018] "Means for saving work history and reusing it for future work plans" refers to a method for saving past work history in a database and using it to create future work plans.

[2019] The system of this invention provides tourist information to foreign tourists and supports factory workers. The system operates in cooperation with three elements: a server, a terminal, and a user.

[2020] System configuration and data processing

[2021] The server includes the following means:

[2022] 1. A means of storing registration information of foreign tourists

[2023] The server stores basic information such as the name, age, and contact details of foreign tourists in a database. This database can be created using MySQL or Firebase.

[2024] 2. A means of communicating with foreign tourists and learning about their preferences and needs

[2025] The server receives input from users in real time and analyzes the information to obtain their preferences and needs. Users input information by voice or text using their smartphones or tablets.

[2026] 3. A way to generate itineraries based on preferences and needs

[2027] The server automatically generates a sightseeing plan based on the acquired preferences and needs using a generative AI model such as OpenAI GPT-3.

[2028] 4. Means of providing detailed information about the generated travel plans to foreign tourists

[2029] The server sends the generated sightseeing plan to the user's terminal and provides detailed information, including information on accommodations, tourist spots, and transportation options.

[2030] 5. Multilingual support options

[2031] The server provides information corresponding to the language selected by the user, and is capable of providing dialogue and guidance in multiple languages.

[2032] 6. Means of storing and reusing foreign tourist profile information

[2033] The server stores past counseling history and preference information in a database and reuses it for the next proposal or counseling session.

[2034] 7. Means of providing tourism information in partnership with local tourism businesses

[2035] The server incorporates tourist information provided in partnership with local tourist businesses into the system and provides comprehensive tourist information to users.

[2036] 8. A means of responding to instructions and questions from workers inside the factory and proposing optimal work plans in multiple languages

[2037] The server allows factory workers to give instructions and ask questions in multiple languages, and based on that information, it uses a generative AI model to create and propose optimal work plans.

[2038] 9. A way to save work history and reuse it for future work planning

[2039] The server stores past work history in a database and uses it to create future work plans.

[2040] Specific examples

[2041] For example, if a foreign tourist inputs "I want to stay in Tokyo for a week. I like anime and manga," the server will use the generative AI model to suggest a sightseeing plan including tourist attractions, accommodations, and transportation. The user can select a plan and proceed with details and reservations.

[2042] In the factory, a worker can ask, "The next step will use part X, which will take about 30 minutes. What is the next step?" The server uses a generative AI model to suggest optimal work steps in multiple languages, and uses work history for future planning.

[2043] Prompt Sentence Examples

[2044] Current work:

[2045] 1. Attach part X

[2046] 2. Use a tightening tool

[2047] 3. Once completed, what are the next steps?

[2048] budget:

[2049] Within 1 hour

[2050] Hope:

[2051] Work efficiently and injury-free

[2052] In this way, the server can utilize the generative AI model to provide effective tourist information and work support in multiple languages.

[2053] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2054] Step 1:

[2055] The user enters the registration information and sends it to the server via the terminal.

[2056] Input: The user enters registration information such as name, age, and contact details.

[2057] Data processing: The terminal formats the information entered by the user and sends it to the server.

[2058] Output: The server saves the registration information in the database and generates a registration complete message.

[2059] Step 2:

[2060] The user initiates a dialogue and inputs their wishes and questions regarding sightseeing or work.

[2061] Input: The user interactively inputs desired content or questions using text or voice.

[2062] Data processing: The terminal converts the input into text format and sends it to the server.

[2063] Output: The server analyzes the input and extracts the user's preferences and needs.

[2064] Step 3:

[2065] The server generates a sightseeing plan or a work plan using the generative AI model.

[2066] Input: Data analyzed to identify user preferences and needs.

[2067] Data calculation: The server uses a generative AI model (e.g., OpenAI GPT-3) to generate a sightseeing or work plan based on the user's input, specifically suggesting relevant tourist spots and efficient work procedures.

[2068] Output: The generated sightseeing plan or work plan is output in text format.

[2069] Step 4:

[2070] The server provides the user with detailed information about the generated plan.

[2071] Input: Generated tourism plan or work plan.

[2072] Data processing: The server formats the detailed information and sends it to the user's device, such as tourist destination details, accommodation ratings, and transportation options.

[2073] Output: The terminal displays this information to the user.

[2074] Step 5:

[2075] The user checks the plan and makes the necessary reservations and procedures.

[2076] Input: The user selects a specific plan (reserving accommodation, purchasing tickets to a tourist attraction, etc.).

[2077] Data calculation: The server performs the reservation procedure based on the selected plan, checks availability, and confirms the reservation.

[2078] Output: Notify the user that the reservation or procedure is complete.

[2079] Step 6:

[2080] The server stores the user's counseling history and work history.

[2081] Input: User's counseling or work history.

[2082] Data processing: The server stores this information in a database and tags and categorizes it for reuse the next time.

[2083] Output: Confirm that the history information has been saved for future use.

[2084] Step 7:

[2085] The server reuses the saved history information the next time you use the server.

[2086] Input: Past counseling history and work history.

[2087] Data calculation: The server uses the historical information as a reference when creating new suggestions for the user.

[2088] Output: New suggestions for efficient counseling and work support are generated.

[2089] Through this series of processes, the server can utilize the generative AI model to provide users with tourist information and work support efficiently and in multiple languages.

[2090] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2091] The present invention relates to a computer system for providing tourist information for foreign tourists, and in particular to a system that interacts with foreign tourists and proposes sightseeing plans in multiple languages ​​that meet their preferences and needs. Furthermore, by combining the system with an emotion engine that recognizes the user's emotions, the user experience can be further improved. Specific embodiments for carrying out the present invention are described below.

[2092] System Overview

[2093] The system includes the following main components:

[2094] 1. User terminal: Devices accessed by foreign tourists (PC, smartphone, tablet, etc.)

[2095] 2. Server: The central computer server of the system

[2096] 3. Database: A data store that stores user information, travel plans, partner information, etc.

[2097] 4. Generative AI Model: Conversational AI for generating sightseeing itineraries

[2098] 5. Emotion Engine: Recognizes user emotions and tailors suggestions based on the conversation

[2099] System Embodiments

[2100] User Registration and Login

[2101] When a user first uses the device, they enter their registration information, such as their name, email address, and password. The device sends this information to the server, which stores it in a database. Once registration is complete, the user logs in using their registration information, and the server verifies the authentication information and starts the session.

[2102] Counseling begins and conversations begin

[2103] The user starts a counseling session and inputs their sightseeing preferences. For example, "I would like to experience traditional culture in Kyoto." The device sends this information to the server in real time, and the server sends the user's input to the generative AI model. The generative AI model generates a conversational response based on the user's input, such as "I recommend a tea ceremony experience and a tour of temples. I can also help with hotel accommodations and transportation." The device displays this response to the user.

[2104] Emotion recognition and suggestion adjustment by emotion engine

[2105] The emotion engine recognizes emotions from user input, voice, facial expressions, etc. For example, if a user inputs, "It's probably going to be crowded again," the emotion engine recognizes this as a negative emotion. This information is sent to the server, and the generation AI generates a different suggestion based on this emotion. For example, it might respond, "I'll introduce you to some hidden spots with fewer tourists." The device then displays this response to the user.

[2106] Generate a sightseeing plan

[2107] The user then enters more detailed information, specifying specific tourist attractions, budget, and itinerary. The device then sends this information to the server, which then uses a generation AI to generate a sightseeing plan. This plan is customized based on the user's preferences and feelings, and includes information on accommodation, transportation, and admission tickets to tourist attractions. The generated sightseeing plan is then sent to the device and displayed to the user.

[2108] Completing the reservation

[2109] The user reviews the details of the proposed itinerary, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and tourist destinations. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a completion notification. The device displays this notification to the user.

[2110] Save and reuse profiles

[2111] Before logging out, users can choose whether to save their counseling history and preference information. The device sends this information to the server, which stores it in a database. The next time users use the service, they can reuse this information, enabling more efficient counseling and sightseeing plans.

[2112] Specific examples

[2113] For example, a first-time user might input their desire to "experience traditional culture in Kyoto." The server then uses the generation AI to suggest a plan that includes tourist spots, suitable accommodations, and transportation. If the emotion engine recognizes that the user's input indicates excitement, the generation AI will suggest additional recommended spots.

[2114] Repeat users can also request, "Next, I'd like to enjoy the latest entertainment in Tokyo," based on their previously saved profile information. The server uses generative AI to create new suggestions based on past counseling history, and if the emotion engine recognizes "anxiety," it will suggest times to avoid crowds and hidden spots. This allows users to plan their trip with greater peace of mind.

[2115] In this way, the present invention is a system that generates customized sightseeing plans for foreign tourists, improves the user experience by adding an emotion engine, removes language barriers, and provides a special sightseeing experience, thereby significantly improving the satisfaction of foreign tourists.

[2116] The processing flow will be explained below.

[2117] Step 1:

[2118] When using the service for the first time, the user enters registration information (name, email address, password).

[2119] Step 2:

[2120] The terminal transmits the entered registration information to the server.

[2121] Step 3:

[2122] The server stores the received registration information in a database.

[2123] Step 4:

[2124] The server sends a notification of registration completion to the terminal.

[2125] Step 5:

[2126] The user receives a notification that registration is complete and logs in.

[2127] Step 6:

[2128] The terminal sends login information (email address, password) to the server.

[2129] Step 7:

[2130] The server verifies the login information and, if authentication is successful, begins the session.

[2131] Step 8:

[2132] The user starts a counseling session and inputs their desired sightseeing information, for example, "I would like to experience traditional culture in Kyoto."

[2133] Step 9:

[2134] The terminal transmits the desired information input by the user to the server.

[2135] Step 10:

[2136] The server sends the user's desired information to the generation AI, which generates an interactive response.

[2137] Step 11:

[2138] For example, the generative AI can generate a response such as, "We recommend a tea ceremony experience or a temple tour. We can also help you with hotel accommodations and transportation."

[2139] Step 12:

[2140] The server sends the generated response to the terminal.

[2141] Step 13:

[2142] The terminal displays the generated response to the user.

[2143] Step 14:

[2144] The emotion engine recognizes emotions from user input, facial expressions, etc. For example, if a user inputs "It's probably going to be crowded again," it will recognize a negative emotion.

[2145] Step 15:

[2146] The server sends the emotion information recognized by the emotion engine to the generation AI.

[2147] Step 16:

[2148] Based on emotional information, the generative AI generates a response such as, "I'll introduce you to some hidden spots with fewer tourists."

[2149] Step 17:

[2150] The server sends the generated response to the terminal.

[2151] Step 18:

[2152] The terminal displays the generated response to the user.

[2153] Step 19:

[2154] The user then enters more detailed requests (specific tourist spots, budget, dates, etc.).

[2155] Step 20:

[2156] The terminal transmits detailed desired information to the server.

[2157] Step 21:

[2158] The server uses AI to generate a sightseeing plan based on detailed desired information.

[2159] Step 22:

[2160] The generative AI generates a customized sightseeing plan based on the user's wishes and feelings, making suggestions including information on accommodation, transportation, and admission tickets to tourist attractions.

[2161] Step 23:

[2162] The server transmits the generated sightseeing plan to the terminal.

[2163] Step 24:

[2164] The terminal displays the generated sightseeing plan to the user.

[2165] Step 25:

[2166] The user reviews the details of the proposed tour plan, selects a specific hotel, and requests a reservation.

[2167] Step 26:

[2168] The terminal transmits the user's reservation request to the server.

[2169] Step 27:

[2170] The server checks availability of the selected accommodations and tourist destinations.

[2171] Step 28:

[2172] The server confirms the reservation and sends the reservation information to the partner.

[2173] Step 29:

[2174] The server sends a reservation completion notification to the terminal.

[2175] Step 30:

[2176] The terminal displays a notification to the user that the reservation is complete.

[2177] Step 31:

[2178] Before logging out, the user has the option to save their counseling history and preferences.

[2179] Step 32:

[2180] The terminal transmits the profile information to be saved to the server.

[2181] Step 33:

[2182] The server stores the profile information and counseling history in a database.

[2183] Step 34:

[2184] The next time the user uses the service, the server will provide efficient counseling and suggest sightseeing plans based on the saved profile information.

[2185] Example 2

[2186] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2187] Conventional tourist information systems for foreign tourists have difficulty proposing sightseeing plans that meet the individual preferences and needs of users, and do not adjust the proposals to take into account the user's emotional state. As a result, there are problems with user satisfaction and a poor user experience.

[2188] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2189] A means for storing registration information of foreign tourists;

[2190] A means of communicating with foreign tourists and obtaining information on their preferences and needs;

[2191] means for generating a sightseeing plan based on said preferences and needs;

[2192] A means for providing detailed information about the generated travel plans to foreign tourists;

[2193] Multilingual support options and

[2194] a means of storing and reusing foreign tourist profile information;

[2195] A means of providing tourism information in partnership with local tourism businesses;

[2196] A means of recognizing tourists' emotions and adjusting the content of the offers;

[2197] This allows for customized sightseeing plans based on the user's preferences and needs, as well as tailoring suggestions to suit the user's emotional state.

[2198] "Foreign tourists" are travelers visiting a country other than their own.

[2199] "Registration information" refers to information such as name, email address, and password that a user enters when using the service for the first time.

[2200] "Interaction" refers to the process by which a computer system and a user interact with each other.

[2201] "Preferences and needs" refers to the user's individual requests and needs, such as desired tourist destinations, experiences, and itineraries.

[2202] "Sightseeing Plan" means a travel plan including attractions, accommodations, transportation, and other necessary details generated based on the user's preferences and needs.

[2203] "Multilingual support" is a function that provides guidance and responses to users in multiple languages.

[2204] "Profile information" refers to information about a user's past usage history and preferences.

[2205] "Local tourism operators" are companies or individuals that provide tourism services in a particular tourist destination.

[2206] "Emotion recognition" is a technology that detects a user's emotional state from input, voice, facial expressions, etc.

[2207] "Recommendation adjustment" refers to the process of changing and adapting recommended sightseeing itineraries and travel suggestions based on the user's emotional state.

[2208] The present invention relates to a computer system for providing tourist information for foreign tourists, and in particular to a system that interacts with foreign tourists and proposes sightseeing plans in multiple languages ​​that meet their preferences and needs. Furthermore, by combining the system with an emotion engine that recognizes the user's emotions, the user experience can be further improved. Specific embodiments for carrying out the present invention are described below.

[2209] Key components of the system

[2210] 1. User terminal: Devices accessed by foreign tourists (PC, smartphone, tablet, etc.)

[2211] 2. Server: The central computer server of the system

[2212] 3. Database: A data store that stores user information, travel plans, partner information, etc.

[2213] 4. Generative AI Model: Conversational AI for generating sightseeing itineraries

[2214] 5. Emotion Engine: Recognizes user emotions and tailors suggestions based on the conversation

[2215] User Registration and Login

[2216] When a user first uses the device, they enter their registration information, such as their name, email address, and password. The device sends this information to the server, which stores it in a database. Once registration is complete, the user logs in, and the server verifies the authentication information and starts the session.

[2217] Counseling begins and conversations begin

[2218] The user starts a counseling session and inputs their sightseeing preferences. For example, they might say, "I'd like to experience traditional culture in Kyoto." The device sends this information to the server in real time, and the server sends the user's preferences in the form of prompts to the generative AI model. The generative AI model generates a conversational response based on the user's input, such as, "I recommend a tea ceremony experience and a tour of temples. I can also help you with hotel accommodations and transportation." The device then displays this response to the user.

[2219] Emotion recognition and suggestion adjustment by emotion engine

[2220] The emotion engine recognizes emotions from user input, voice, facial expressions, etc. For example, if a user inputs, "It's probably going to be crowded again," the emotion engine recognizes negative emotions. The device sends this emotional information to the server, which then has the generative AI model create new suggestions that take emotion into account. For example, the server might respond, "I'll introduce you to some hidden spots with fewer tourists." The device then displays this new suggestion to the user.

[2221] Generate a sightseeing plan

[2222] The user then enters more detailed information, including specific tourist attractions, budget, and itinerary. The device then sends this information to the server, which then uses the generative AI model to generate a detailed itinerary, including information on accommodation, transportation, and admission tickets to tourist attractions. The generated itinerary is then sent to the device and displayed to the user.

[2223] Completing the reservation

[2224] The user reviews the details of the proposed travel plan, selects a specific hotel, and requests a reservation. The device sends this request to the server, which checks the availability of the selected accommodations and tourist destinations. Once the reservation is confirmed, the server sends the reservation information to the partner and provides the user with a reservation completion notification. The device displays this notification to the user.

[2225] Save and reuse profiles

[2226] Before logging out, users can choose whether to save their counseling history and preference information. The device sends this information to the server, which then stores it in a database. The next time the user uses the service, they can reuse the saved information to receive more efficient counseling.

[2227] Specific examples

[2228] First-time use example

[2229] Example: A user inputs a request such as "I would like to experience traditional culture in Kyoto."

[2230] The terminal sends this information to the server.

[2231] The server sends the desired content to the generative AI model in the form of a prompt. An example of a prompt is: "The user wants to experience traditional culture in Kyoto. Please generate the optimal sightseeing plan for this."

[2232] The generative AI model generates a plan that includes tourist attractions, suitable accommodations, and transportation. An example of a generated response is, "We suggest a tea ceremony experience, a tour of temples, and a traditional craft workshop."

[2233] The terminal displays the generated plan to the user.

[2234] Examples of repeat use

[2235] Example: A repeat user requests, "Next time, I'd like to enjoy the latest entertainment in Tokyo."

[2236] The terminal sends this information to the server.

[2237] The server sends a request to the generative AI model that takes into account the user's past counseling history. An example of a prompt sentence is: "The user has previously enjoyed traditional culture in Kyoto. This time, the user wants to experience new entertainment in Tokyo."

[2238] The generative AI model generates new itineraries based on past history and new requests.

[2239] The terminal displays the generated plan to the user.

[2240] If any anxiety about the plan is detected (e.g., "Is it going to be crowded?"), the server resubmits the emotion recognition information to the generative AI model, which then suggests timings and hidden spots to avoid crowds. This is how the final recommendation is created.

[2241] The terminal displays the final proposal to the user.

[2242] As described above, the present invention is a system that generates customized sightseeing itineraries for foreign tourists and dramatically improves the user experience by including emotion recognition.

[2243] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2244] Step 1: User Registration

[2245] When a user uses the device for the first time, they enter registration information such as their name, email address, and password. The device then sends this information to the server, which then stores the received information in a database. This completes the user's registration.

[2246] Input: Name, Email Address, Password

[2247] Da...

Claims

1. A computer system for providing tourist information for foreign tourists, A means for storing registration information of foreign tourists; A means of communicating with foreign tourists and obtaining information on their preferences and needs; means for generating a sightseeing plan based on said preferences and needs; A means for providing detailed information about the generated travel plans to foreign tourists; Multilingual support options and a means of storing and reusing foreign tourist profile information; A means of providing tourism information in partnership with local tourism businesses; A system including:

2. 2. The system according to claim 1, further comprising means for reserving accommodations, purchasing admission tickets to tourist attractions, and providing transportation based on the desired information of foreign tourists.

3. 10. The system of claim 1, further comprising means for reusing information for future counseling and tourism plan generation based on the foreign tourist's past counseling history and preferences.

Images