System

Abstract

A system is provided.SOLUTION: A system comprising: means for storing user information in a database; means for inputting a search condition for a local experience based on a user's interest or schedule; means for proposing an experience that matches the search condition using artificial intelligence; means for accepting a reservation for the selected experience and processing payment; and means for inputting an evaluation and feedback after the end of the experience and storing them in the database.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] The present invention relates to sharing local experiences in areas visited by tourists, and aims to revitalize the local economy and promote cultural understanding among tourists by utilizing the skills, specialties, and culture of local residents. The problems that the present invention aims to solve are as follows:

[0005] 1. Improving the quality of tourism experiences: Traditional tourism guides often feature standardized tours and guides, making it difficult to provide the unique local experiences that tourists truly desire.

[0006] 2. Revitalizing the local economy: Local residents can increase their sources of income by sharing their skills, talents, and culture, but there is a lack of a system to efficiently match this.

[0007] 3. Ensuring diversity in tourism experiences: To meet the diverse needs of tourists, there is a need to provide more personalized experiences, but there is no effective system in place to achieve this.

[0008] 4. Quality management through ratings and feedback: In order to maintain and improve the quality of the experience, it is necessary to effectively utilize user ratings and feedback, but there is a lack of a system to accumulate this information and use it to propose the next experience. [Means for solving the problem]

[0009] In order to solve these problems, the present invention provides the following means.

[0010] 1. Means of storing user information in a database: Provide users with the ability to register their basic information, specialties and skills, and details of the experiences they wish to provide in a database.

[0011] 2. A means to input search criteria for local experiences based on the user's interests and schedule: Providing tourists with the ability to search for appropriate local experiences based on their interests and visiting plans.

[0012] 3. Using artificial intelligence to suggest experiences that match the search criteria: Using AI, we provide a function that compares the data entered by tourists with registered experience information and suggests the most suitable experiences.

[0013] 4. A means to accept reservations and process payments for selected experiences: We provide tourists with the ability to book selected experiences and make payments all at once on the platform.

[0014] 5. Means for inputting ratings and feedback after the experience and saving it in the database: A function is provided that allows tourists to input ratings (star ratings) and feedback after the experience and save that information in the database.

[0015] In addition, the following additional measures will be used to make the entire system more efficient and accurate:

[0016] 1. A means for users to access the database and register information about their skills, specialties, and culture: Provide an interface that allows local residents to easily register the experiences they offer.

[0017] 2. A means of listing experiences that users can offer based on the above information: Based on the registered information, a function is provided that automatically lists the experiences that can be offered and presents them to tourists.

[0018] 3. A means for artificial intelligence to improve the accuracy of experience suggestions based on the user's ratings and feedback: AI analyzes the accumulated ratings and feedback and reflects them in the next suggestions, providing a function for more accurate matching.

[0019] 4. Means of excluding experience providers with low ratings and feedback from the system: Provide a function to automatically exclude experience providers with ratings below a certain standard from the system, ensuring the quality of the experience.

[0020] These measures allow tourists to enjoy highly personalized experiences and enable local residents to use their skills and talents to generate new income.

[0021] A "database" is a system for centrally storing and managing data such as user information, experience information, and evaluations.

[0022] "User" means any individual or entity that uses the Platform to provide, search for, or participate in Experiences.

[0023] "Artificial intelligence (AI)" refers to algorithms and systems that analyze user input data and suggest optimal experiences.

[0024] "Experience" means a specific activity, event, or service that a User can provide or participate in, such as a tour guide, workshop, or cultural experience.

[0025] "Reservation" refers to the process by which a tourist (user) confirms in advance the experience offered and applies to participate.

[0026] "Payment" refers to the process of paying for an Experience through the Platform.

[0027] "Evaluation" refers to feedback and opinions such as star ratings provided by tourists (users) after completing an experience.

[0028] "Feedback" refers to detailed comments, opinions, and suggestions about the experience, and is important information for improving the quality of the experience.

[0029] An "experience provider" refers to a user who provides experiences based on their own skills, specialties, and culture.

[0030] "Tourist" means a user who uses the Platform to search for and book experiences offered with the intent of participating in them. [Brief explanation of the drawings]

[0031] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0032] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0033] First, the terms used in the following description will be explained.

[0034] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0035] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0036] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0037] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0038] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0039] [First embodiment]

[0040] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0041] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0042] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0043] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0044] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0045] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0046] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0047] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0048] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0049] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0050] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0051] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0052] The present invention relates to a local experience sharing platform that connects tourists and local residents, and specific embodiments thereof are described below.

[0053] User Registration

[0054] 1. User Registration:

[0055] A user registers by entering their name, email address, and password.

[0056] The terminal sends this information to the server, which stores it in a database.

[0057] The server returns registration confirmation information to the terminal and displays a registration completion message on the user's screen.

[0058] Register your experience

[0059] 1. Enter your experience provider information:

[0060] The experience provider (user or corporation) enters details of the experience they wish to offer (e.g., tea ceremony class, Japanese cooking class, etc.).

[0061] The terminal sends this information to the server, which stores it in a database.

[0062] The server returns registration confirmation information to the terminal and displays a trial registration completion message on the screen.

[0063] Experience search and suggestions

[0064] 1. Tourist search:

[0065] Tourists (users) input the desired experience genre and dates.

[0066] The terminal transmits the search conditions to the server.

[0067] The server uses AI algorithms to extract experiences from a database that match the search criteria.

[0068] The server returns the extracted results to the terminal and displays a list of experiences suitable for the tourist.

[0069] Reservation and payment

[0070] 1. Select and book your experience:

[0071] Tourists select the experience they want from a list and enter their booking information.

[0072] The terminal transmits the reservation information to the server, which stores it in a database.

[0073] The server returns a reservation confirmation message to the terminal and displays a reservation completion message on the screen.

[0074] 2. Payment Processing:

[0075] Tourists enter their payment information.

[0076] The terminal transmits this information to the server, which then processes the payment via the payment system.

[0077] The server returns confirmation of payment completion to the terminal and displays a payment completion message on the screen.

[0078] Ratings and Feedback

[0079] 1. Post-experience evaluation:

[0080] Tourists can enter their ratings and feedback after completing the experience.

[0081] The terminal sends this information to the server, which stores it in a database.

[0082] The server returns the evaluation and feedback confirmation information to the terminal and displays an evaluation completion message on the screen.

[0083] Specific examples

[0084] 1. Example of user registration:

[0085] The user accesses the platform and enters information as "Taro" on the registration page.

[0086] The terminal sends this information to the server, which stores the information in a database.

[0087] The server sends a message to the terminal indicating that registration is complete, and displays it on "Taro's" screen.

[0088] 2. Example of experience registration:

[0089] Experience providers enter details of the "Japanese cooking class."

[0090] The terminal sends this information to the server, which stores it in a database.

[0091] The server sends a message to the terminal indicating that registration is complete, and displays it on the screen.

[0092] 3. Examples of experience search and suggestions:

[0093] Tourists search by entering "handmade experience" and "April 10th."

[0094] The device sends these search criteria to the server, which then uses AI to extract the optimal experience.

[0095] The server sends the list of experiences to the terminal and displays it to the tourist.

[0096] 4. Examples of booking and payment:

[0097] Tourists select "Japanese cooking class" from the list of experiences and enter their reservation information.

[0098] The terminal transmits the reservation information to the server, which stores it in a database.

[0099] The tourist enters payment information and the terminal transmits this information to the server.

[0100] The server processes the payment and returns a completion message to the terminal.

[0101] 5. Examples of evaluation and feedback:

[0102] After completing the experience, tourists can rate it five stars and comment that it was fun.

[0103] The terminal sends this information to the server, which stores it in a database.

[0104] The server returns a message indicating that the evaluation is complete to the terminal and displays it on the screen.

[0105] This allows tourists to seamlessly discover, book, and participate in experiences that are perfect for them, allows experience providers to earn income by leveraging their skills and expertise, and improves the overall quality of the experience through ratings and feedback.

[0106] The processing flow will be explained below.

[0107] User Registration

[0108] Step 1:

[0109] The user accesses the platform's registration page and enters the required information (name, email address, password).

[0110] Step 2:

[0111] The terminal sends the entered information to the server as an HTTP POST request.

[0112] Step 3:

[0113] The server stores the received information in a database.

[0114] Step 4:

[0115] The server confirms that the save was successful.

[0116] Step 5:

[0117] The server generates a registration completion confirmation message and sends it to the terminal.

[0118] Step 6:

[0119] The terminal will display a confirmation message to inform the user that registration is complete.

[0120] Register your experience

[0121] Step 1:

[0122] The experience provider (user or corporation) accesses the experience registration page and enters detailed information (title, description, date and time, price).

[0123] Step 2:

[0124] The terminal sends the entered information to the server as an HTTP POST request.

[0125] Step 3:

[0126] The server stores the received information in a database.

[0127] Step 4:

[0128] The server confirms that the save was successful.

[0129] Step 5:

[0130] The server generates a registration completion confirmation message and sends it to the terminal.

[0131] Step 6:

[0132] The device will display a confirmation message to inform the experience provider that registration is complete.

[0133] Experience search and suggestions

[0134] Step 1:

[0135] Tourists (users) access the platform's search page and enter the type of experience they are interested in and the dates they wish to visit.

[0136] Step 2:

[0137] The terminal sends the entered search criteria to the server as an HTTP GET request.

[0138] Step 3:

[0139] The server uses an AI algorithm to match the experience information in the database based on the received search criteria.

[0140] Step 4:

[0141] The server generates a list of experiences that match the search criteria.

[0142] Step 5:

[0143] The server transmits the experience list to the terminal.

[0144] Step 6:

[0145] The terminal displays to the tourist a list of experiences generated as search results.

[0146] Reservation and payment

[0147] Step 1:

[0148] Tourists (users) select the experience they want from the list of experiences and enter the number of participants and any special notes.

[0149] Step 2:

[0150] The terminal sends the entered reservation information to the server as an HTTP POST request.

[0151] Step 3:

[0152] The server stores the received reservation information in a database.

[0153] Step 4:

[0154] The server confirms that the save was successful.

[0155] Step 5:

[0156] The server generates a reservation confirmation message and sends it to the terminal.

[0157] Step 6:

[0158] The terminal displays a booking confirmation message to the tourist.

[0159] Step 7:

[0160] Tourists enter their payment information (such as credit card information).

[0161] Step 8:

[0162] The terminal sends the payment information to the server as an HTTP POST request.

[0163] Step 9:

[0164] The server transmits the received payment information to the payment system and requests payment processing.

[0165] Step 10:

[0166] The server receives the payment transaction results and stores them in a database.

[0167] Step 11:

[0168] The server generates a confirmation message for the payment completion and sends it to the terminal.

[0169] Step 12:

[0170] The terminal will display a payment completion message to the tourist.

[0171] Ratings and Feedback

[0172] Step 1:

[0173] After completing the experience, tourists (users) access the platform's rating page and enter their rating (star rating) and feedback (comments) about the experience.

[0174] Step 2:

[0175] The device sends the entered rating and feedback to the server as an HTTP POST request.

[0176] Step 3:

[0177] The server stores the received ratings and feedback in a database.

[0178] Step 4:

[0179] The server confirms that the save was successful.

[0180] Step 5:

[0181] The server generates a confirmation message of the completion of the evaluation and sends it to the terminal.

[0182] Step 6:

[0183] The terminal displays an evaluation completion message to the tourist.

[0184] The above is a specific processing flow of the system of the present invention, which realizes a platform that is beneficial to both tourists and experience providers.

[0185] Example 1

[0186] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0187] Conventional tourism platforms make it difficult for users to easily search, book, and pay for local experiences that match their interests. They also lack effective means to maintain the quality of experience providers and reflect user feedback. An effective system to solve these issues is needed.

[0188] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0189] In this invention, the server includes means for saving user information in a database, means for a user to register by entering their name, email address, and password, means for transmitting the entered information to the server and the server storing it in the database, means for inputting search criteria for local experiences based on the user's interests and schedule, means for the server to extract experiences that match the search criteria from the database using an AI algorithm, means for inputting reservation information for the selected experience, transmitting it to the server and storing it in the database, means for tourists to input payment information and for the server to process the payment via a payment system, and means for tourists to input ratings and feedback after the experience has ended and the server storing it in the database. This allows users to efficiently search for, book, and pay for local experiences, and also enables them to evaluate the quality of experience providers and improve the overall quality of the experience.

[0190] "User Information" refers to identifying information such as a user's name, email address, and password.

[0191] "Database" refers to a system for systematically storing and managing user information, experience information, reservation information, evaluation information, etc.

[0192] "Server" refers to a central processing unit that stores information sent by users in a database and provides users with the information they require.

[0193] "Terminal" refers to a device (e.g., PC, smartphone, etc.) through which a user inputs information and communicates with a server.

[0194] "New Registration" refers to the process when a User accesses the Platform for the first time and enters their information to create an account.

[0195] "Local experiences" refer to the provision of local culture and activities that are unique to the region, and in which tourists can participate directly through experience providers.

[0196] "AI algorithm" refers to a program that uses machine learning models and filtering algorithms to extract the optimal experience based on a user's search criteria.

[0197] "Reservation Information" refers to the information a User enters to reserve a particular Experience (e.g., experience date, number of participants, etc.).

[0198] "Payment System" refers to a system for processing online payments (e.g., Stripe, PayPal, etc.).

[0199] "Ratings and feedback" refers to information that a user enters after completing an experience, such as their thoughts and ratings about the experience.

[0200] "Experience Provider" refers to an individual or entity that provides a local experience.

[0201] "Tourist" refers to a traveler or individual user looking for a local experience.

[0202] The present invention relates to a local experience sharing platform that connects tourists and experience providers, and a specific embodiment thereof will be described. The platform is a system that stores user information in a database and allows users to search, book, pay for, and rate local experiences. This system consists of three main components: a server, a terminal, and a user.

[0203] 1. User Registration Implementation

[0204] User Registration:

[0205] The user accesses the platform's registration page using a device (e.g., a PC or smartphone) and enters their name, email address, and password.

[0206] The terminal transmits this information to the server.

[0207] The server uses a database management system such as MySQL or PostgreSQL to store the received information in a database.

[0208] The server generates a registration completion confirmation message and sends it to the terminal.

[0209] Examples:

[0210] The user accesses the platform and enters their name, email address, and password as "Taro" on the registration page.

[0211] The terminal sends this information to the server, which stores it in a database.

[0212] The server sends a message to the terminal indicating that registration is complete, and the terminal displays the message on "Taro's" screen.

[0213] 2. How to register your experience

[0214] Register your experience:

[0215] The experience provider (user or corporation) uses a terminal to input details of the experience they are offering.

[0216] The terminal sends this information to the server.

[0217] The server stores the received experience information in a database.

[0218] The server generates a confirmation message confirming the completion of the trial registration and sends it to the terminal.

[0219] Examples:

[0220] Experience providers enter details of the "Japanese cooking class."

[0221] The terminal sends this information to the server, which stores it in a database.

[0222] The server sends a registration completion message to the terminal, which displays it on the screen.

[0223] 3. Experience Search and Suggestion Implementation

[0224] Experience search and suggestions:

[0225] Tourists (users) use their terminals to input the desired experience genre and dates and perform a search.

[0226] The terminal transmits the input search conditions to the server.

[0227] The server uses a generative AI model to extract experiences that match the search criteria from a database, using Python machine learning models and collaborative filtering algorithms.

[0228] The server returns the extracted results in list form to the terminal, which displays them to the tourist.

[0229] Examples:

[0230] Tourists search by entering "handmade experience" and "April 10th."

[0231] The device sends these search criteria to a server, which uses AI to extract the optimal experience.

[0232] The server sends the list of experiences to the terminal, which displays it to the tourist.

[0233] 4. Booking and payment methods

[0234] Reservation and payment:

[0235] Tourists select the experience they want from a list and enter their booking information.

[0236] The terminal transmits the entered reservation information to the server.

[0237] The server stores the reservation information in a database.

[0238] The server generates a reservation confirmation message and sends it to the terminal.

[0239] The tourist enters payment information and the terminal transmits this information to the server.

[0240] The server processes the payment through a payment system (e.g., Stripe, PayPal, etc.).

[0241] The server generates a confirmation message for the payment completion and sends it to the terminal.

[0242] Examples:

[0243] Tourists select "Japanese cooking class" from the list of experiences and enter their reservation information.

[0244] The terminal transmits the reservation information to the server, which stores it in a database.

[0245] The tourist enters payment information and the terminal transmits this information to the server.

[0246] The server processes the payment and returns a completion message to the terminal.

[0247] 5. Evaluation and feedback methods

[0248] Rating and Feedback:

[0249] Tourists can enter their ratings and feedback after completing the experience.

[0250] The terminal transmits the input rating and feedback information to the server.

[0251] The server stores the received information in a database.

[0252] The server generates a confirmation message of the completion of the evaluation and sends it to the terminal.

[0253] Examples:

[0254] After completing the experience, tourists can rate it five stars and comment that it was fun.

[0255] The terminal sends this information to the server, which stores it in a database.

[0256] The server sends a message indicating that the evaluation is complete to the terminal, which displays the message on the screen.

[0257] These specific embodiments allow users to seamlessly find, book, pay for, and rate local experiences, while also enabling experience providers to earn income by leveraging their skills and expertise, improving the overall quality of the experience.

[0258] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0259] Step 1: The user enters their name, email address, and password.

[0260] The user visits the registration page and enters their name, email address, and password.

[0261] Input: Name, email address, and password entered by the user.

[0262] Output: User information temporarily stored on the device.

[0263] Step 2: The device sends the user information to the server

[0264] The terminal transmits the input user information to the server.

[0265] Input: Name, email address, and password entered by the user.

[0266] Output: User information arriving at the server.

[0267] Step 3: The server saves the user information to a database

[0268] The server stores the received user information in a database.

[0269] Input: User information received by the server.

[0270] Data processing: Validate user information and save it to the database if successful.

[0271] Output: User information stored in the database.

[0272] Step 4: The server generates a confirmation message for the registration and sends it to the device.

[0273] The server generates a registration completion confirmation message and sends it to the terminal.

[0274] Input: The registration process has been completed successfully.

[0275] Output: Registration completion message received on the device.

[0276] Step 5: Your device will display a registration complete message

[0277] The terminal displays the received confirmation message to inform the user that registration is complete.

[0278] Input: Registration completion message sent by the server.

[0279] Output: A confirmation message that will be displayed on the user's screen.

[0280] Step 6: Enter details about the experience the experience provider is offering

[0281] The experience provider uses the terminal to input details of the experience they are offering (e.g., experience name, details, dates, etc.).

[0282] Input: Experience information such as experience name, details, and dates.

[0283] Output: Experience information temporarily stored on the device.

[0284] Step 7: The device sends the experience information to the server

[0285] The terminal transmits the input experience information to the server.

[0286] Input: Experience information such as experience name, details, and dates.

[0287] Output: Experience information that arrives at the server.

[0288] Step 8: The server stores the experience information in a database

[0289] The server stores the received experience information in a database.

[0290] Input: Experience information received by the server.

[0291] Data processing: Validate the experience information and save it to the database if successful.

[0292] Output: Experience information stored in a database.

[0293] Step 9: The server generates a confirmation message for the completion of the trial registration and sends it to the device.

[0294] The server generates a confirmation message confirming the completion of the trial registration and sends it to the terminal.

[0295] Input: The trial registration process has been completed successfully.

[0296] Output: A message will be sent to your device confirming your registration.

[0297] Step 10: Your device will display a message that your trial registration is complete.

[0298] The device will display the received confirmation message and notify the experience provider that registration has been completed.

[0299] Input: Trial registration completion message sent from the server.

[0300] Output: A confirmation message that will be displayed to the experience provider.

[0301] Step 11: Enter the type of experience and dates that tourists want to use and search

[0302] Tourists use their devices to search by entering the type of experience and dates they want.

[0303] Input: Search criteria such as experience genre and date.

[0304] Output: Search criteria temporarily saved on your device.

[0305] Step 12: The device sends the search criteria to the server

[0306] The terminal transmits the input search conditions to the server.

[0307] Input: Search criteria such as experience genre and date.

[0308] Output: The search criteria that arrives at the server.

[0309] Step 13: The server uses an AI algorithm to extract experiences from the database that match the search criteria.

[0310] The server uses a generative AI model to extract experiences from a database that match the search criteria.

[0311] Input: The search criteria received by the server.

[0312] Data calculations: Using AI algorithms to extract experience information that matches search criteria (e.g., collaborative filtering).

[0313] Output: A list of extracted experience information.

[0314] Step 14: The server returns the extracted results to the terminal in list format.

[0315] The server returns the extraction results in list form to the terminal and displays them.

[0316] Input: A list of extracted experience information.

[0317] Output: A list of experience information delivered to the device.

[0318] Step 15: The device displays the search results to the tourist.

[0319] The terminal displays the received search results to the tourist.

[0320] Input: Experience information list sent from the server.

[0321] Output: A list of experience information displayed on the tourist's screen.

[0322] Step 16: Tourists select the experience they want and enter their booking information

[0323] Tourists select the experience they want from a list and enter their reservation information.

[0324] Input: Experience selection and booking information (e.g. number of participants, booking date).

[0325] Output: Reservation information temporarily stored on the device.

[0326] Step 17: The device sends the reservation information to the server

[0327] The terminal transmits the entered reservation information to the server.

[0328] Input: Booking information (e.g. number of participants, booking date).

[0329] Output: Reservation information received by the server.

[0330] Step 18: The server saves the reservation information to the database

[0331] The server stores the received reservation information in a database.

[0332] Input: Reservation information received by the server.

[0333] Data processing: Validate reservation information and save it to the database if successful.

[0334] Output: Reservation information stored in a database.

[0335] Step 19: The server generates a reservation confirmation message and sends it to the terminal.

[0336] The server generates a reservation confirmation message and sends it to the terminal.

[0337] Input: The reservation process has been completed successfully.

[0338] Output: Reservation confirmation message received on your device.

[0339] Step 20: The terminal displays a reservation completion message to the tourist

[0340] The terminal will display the received confirmation message and inform the tourist that their reservation has been completed.

[0341] Input: The reservation confirmation message sent by the server.

[0342] Output: A confirmation message that will be displayed on the tourist's screen.

[0343] Step 21: Tourist enters payment information

[0344] Once a tourist has booked an experience, they enter their payment information.

[0345] Input: Payment information (e.g. credit card information, payment amount).

[0346] Output: Payment information temporarily stored on the device.

[0347] Step 22: The terminal sends the payment information to the server

[0348] The terminal transmits the entered payment information to the server.

[0349] Input: Payment information.

[0350] Output: Payment information arriving at the server.

[0351] Step 23: The server processes the payment through the payment system

[0352] The server processes the payment through a payment system (e.g., Stripe, PayPal).

[0353] Input: Payment information received by the server.

[0354] Data processing: Processing payments via payment systems and APIs and receiving results.

[0355] Output: Confirmation of successful payment.

[0356] Step 24: The server sends a confirmation message to the terminal that the payment has been completed.

[0357] The server generates a confirmation message for the payment completion and sends it to the terminal.

[0358] Input: The payment process has been completed successfully.

[0359] Output: Payment completed message received on the terminal.

[0360] Step 25: The terminal displays a payment completion message to the tourist

[0361] The terminal will display the received confirmation message and inform the tourist that the payment has been completed.

[0362] Input: Payment completion message sent from the server.

[0363] Output: A confirmation message that will be displayed on the tourist's screen.

[0364] Step 26: Tourists complete the experience and enter their rating and feedback

[0365] Tourists can enter their ratings and feedback after completing the experience.

[0366] Input: Rating information (e.g., star rating, comments).

[0367] Output: Rating information temporarily stored on the device.

[0368] Step 27: The device sends the rating and feedback information to the server.

[0369] The terminal transmits the input rating and feedback information to the server.

[0370] Input: Rating information.

[0371] Output: Rating information arriving at the server.

[0372] Step 28: The server stores the rating and feedback information in a database

[0373] The server stores the received ratings and feedback information in a database.

[0374] Input: Rating information received by the server.

[0375] Data processing: Validate the evaluation information and save it in the database if successful.

[0376] Output: Evaluation information stored in a database.

[0377] Step 29: The server generates a confirmation message confirming the completion of the evaluation and sends it to the terminal.

[0378] The server generates a confirmation message of the completion of the evaluation and sends it to the terminal.

[0379] Input: The evaluation process completed successfully.

[0380] Output: Evaluation completion message arriving on your terminal.

[0381] Step 30: The terminal displays a message to the tourist that the evaluation is complete.

[0382] The terminal will display the received confirmation message to inform the tourist that the evaluation is complete.

[0383] Input: Evaluation completion message sent by the server.

[0384] Output: A confirmation message that will be displayed on the tourist's screen.

[0385] (Application example 1)

[0386] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0387] With conventional tourism experience reservation systems, it is difficult for tourists to check the experience content and provider ratings until they arrive at the destination, and the reservation and payment procedures are cumbersome. As a result, tourists are unable to enjoy high-quality experiences, and local experience providers have difficulty attracting appropriate customers. In addition, the inability to share experiences in real time or make instant payments reduces the quality and satisfaction of the experience.

[0388] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0389] In this invention, the server includes means for storing user information in a database, means for inputting search criteria for local experiences based on the user's interests and schedule, means for using artificial intelligence to suggest experiences that match the search criteria, means for accepting reservations for the selected experience and processing payments, means for inputting ratings and feedback after the experience and storing them in the database, and means for sharing local experiences in real time and making reservations and payments using smart devices in physical stores. This allows tourists to share experiences in real time on-site and make instant reservations and payments, improving the quality of the experience and satisfaction.

[0390] A "database" is an information system that organizes and stores various data, such as user information and experience information, and can efficiently search, manage, and update it.

[0391] "User" refers to individuals and corporations such as tourists and experience providers who use this system.

[0392] "Local Experiences" are activities and events that are rooted in local culture and specialties and offer tourists a unique experience.

[0393] "Artificial intelligence" is a technology that allows systems to automatically analyze data and make predictions, and makes optimal suggestions based on user input conditions.

[0394] "Search criteria" refers to information such as the type of experience and dates desired that a user enters into the system.

[0395] "Reservation" refers to the process by which a tourist confirms their chosen experience in advance.

[0396] "Payment" refers to the process of paying for a booked experience.

[0397] A "smart device" is an electronic device that can use the Internet and applications, such as a smartphone, smart glasses, or a head-mounted display.

[0398] "Real-time" means that users receive experience information immediately and reservations and payments are completed instantly on the spot.

[0399] "Evaluation" refers to the act of tourists expressing their thoughts and satisfaction about the quality of the experience after it has ended.

[0400] "Feedback" refers to specific comments or opinions about the experience or service provided by a user.

[0401] The system that realizes this invention not only has a conventional tourism experience reservation system but also a real-time experience sharing function using smart devices in a physical store. This system consists of the following main components.

[0402] System Program Overview

[0403] 1. User registration procedure:

[0404] Users access the system and register by entering their name, email address, and password.

[0405] The terminal sends this information to the server, which stores it in a database.

[0406] A registration completion message is returned to the terminal and displayed on the screen.

[0407] 2. Experience registration procedure:

[0408] The experience provider inputs details of the experience to be offered, and the terminal transmits these to the server.

[0409] The server stores the information in a database and returns a registration completion message to the terminal.

[0410] 3. Experience search and proposal procedure:

[0411] Tourists (users) input the desired experience genre and dates, and the terminal sends these search conditions to the server.

[0412] The server uses the generative AI model to suggest the optimal experience and sends the results back to the device.

[0413] 4. Booking and payment procedures:

[0414] Tourists select the experience they want and enter their booking and payment information.

[0415] The terminal sends this information to the server, the reservation information is stored in a database, and payments are processed using the Stripe API.

[0416] A message confirming reservation and payment is sent back to the terminal.

[0417] 5. Evaluation and Feedback Procedures:

[0418] After completing the experience, tourists enter their ratings and feedback into the terminal, and the server stores them in a database.

[0419] A completion message is sent back to the terminal and displayed on the screen.

[0420] 6. Real-time experience sharing procedure:

[0421] Tourists use smart devices (smartphones, smart glasses, head-mounted displays, etc.) in physical stores to search, book, and pay for experience details in real time.

[0422] The terminal sends this request to the server, which processes it in real time.

[0423] Hardware and Software Used

[0424] Hardware: Smart devices such as smartphones, smart glasses, and head-mounted displays (HMDs).

[0425] Software: Python, Flask, SQLite, Stripe API, Generative AI Model

[0426] Specific example explanation

[0427] Example of user registration:

[0428] The user accesses the platform and registers by entering the name "Taro", email address, and password.

[0429] The terminal sends this information to the server, which stores it in a database and returns a registration completion message.

[0430] Examples of experience registration:

[0431] The experience provider enters details of the "Japanese sweets making experience," and the terminal sends these to the server.

[0432] The server stores the information in a database and a registration complete message is sent back to the terminal.

[0433] Examples of experience search and suggestions:

[0434] Tourists search by entering "handmade experience" and "April 10th."

[0435] The device sends these search criteria to the server, which extracts information and sends results back to the device to suggest the optimal experience using a generative AI model.

[0436] Examples of booking and payment:

[0437] Tourists select "Japanese sweets making experience," enter their reservation and payment information, and the terminal sends this to the server.

[0438] The server saves the reservation information in a database, the payment is processed using the Stripe API, and a completion message is sent back to the terminal.

[0439] Examples of evaluation and feedback:

[0440] After completing the experience, tourists enter their ratings and comments, which are then sent to the server by the device.

[0441] The server stores it in a database and a completion message is sent back to the terminal.

[0442] Example prompt sentence:

[0443] "I'd like to book an experience. I'm looking for a crafting experience on April 10th."

[0444] "We found three handmade experiences taking place on April 10th. We have a Japanese sweets making experience, a Japanese cooking class, and a crafts making experience. Which one would you like to book?"

[0445] As described above, this system allows tourists to search, book, and pay for experiences in real time, improving the quality and satisfaction of the experiences. It also allows experience providers to efficiently offer their skills and specialties.

[0446] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0447] Step 1: User Registration

[0448] A user accesses the platform and enters their name, email address, and password. This information is sent from the device to the server. The server stores this information in a database and returns a registration completion message to the device. This saves the user information in the database and confirms the registration.

[0449] Step 2: Register your experience

[0450] The experience provider (user or corporation) enters details of the experience they wish to offer (e.g., Japanese sweets making experience). The device sends this information to the server, which stores the information in a database. Registration confirmation information is returned to the device, and a message indicating experience registration completion is displayed on the screen. The experience information is then stored in the database.

[0451] Step 3: Find and suggest experiences

[0452] Tourists (users) input the desired experience genre and dates, and the device sends these search criteria to the server. The server uses a generative AI model to extract the best experiences that match the search criteria from the database. The extracted results are sent back to the device, and a list of experiences that match the tourist is displayed. This allows tourists to easily find the experience they want.

[0453] Step 4: Reservation

[0454] The tourist selects the desired experience from the list and enters the reservation information. The terminal sends the reservation information to the server, which stores it in a database. A reservation confirmation message is sent back to the terminal, and a reservation completion message is displayed on the screen. This saves the reservation information in the database and confirms the reservation to the tourist.

[0455] Step 5: Payment

[0456] The tourist enters payment information. The terminal sends this information to the server, which processes the payment using the Stripe API. A confirmation of the payment is sent back to the terminal, and a payment completion message is displayed on the screen. This completes the payment, and the tourist can confirm it.

[0457] Step 6: Rating and feedback

[0458] After completing the experience, tourists enter their rating and feedback. The device sends this information to the server, which stores it in a database. Confirmation of the rating and feedback is sent back to the device, and a rating completion message is displayed on the screen. This saves the rating and feedback in the database, affecting the existing data.

[0459] Step 7: Real-time experience sharing

[0460] Tourists use smart devices in physical stores to search, book, and pay for experience details in real time. The device sends this request to the server, which processes it in real time. The response is immediately sent back to the device and displayed to the tourist, allowing for immediate on-site response.

[0461] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0462] This invention relates to a local experience sharing platform that effectively matches tourists and local residents and provides more personalized experiences. In particular, it aims to improve user satisfaction by combining it with an emotion engine that recognizes user emotions.

[0463] User Registration

[0464] 1. User Registration:

[0465] A user registers by entering basic information such as name, email address, and password.

[0466] The terminal sends this information to a server, which stores the information in a database.

[0467] The server sends a confirmation message to the terminal confirming the completion of registration, which is displayed on the user's screen.

[0468] Register your experience

[0469] 1. Experience provider registration:

[0470] Experience providers enter detailed information about the experience they are offering (e.g., tea ceremony class, Japanese cooking class, etc.).

[0471] The device sends this information to the server, which stores it in a database.

[0472] The server sends a confirmation message to the terminal to confirm the completion of registration, which is displayed on the screen.

[0473] Experience search and suggestions

[0474] 1. Tourist search:

[0475] Tourists input the type of experience they are interested in and the dates they wish to visit.

[0476] The terminal transmits the search conditions to the server.

[0477] Based on the received search criteria, the server uses an AI algorithm to compare the experience information in the database and generate an optimal experience list.

[0478] The server sends the list of experiences to the terminal and displays it to the tourist.

[0479] Reservation and payment

[0480] 1. Booking an experience:

[0481] Tourists select the experience they want from a list and enter their reservation information.

[0482] The terminal transmits the reservation information to the server, which stores it in a database.

[0483] The server sends a reservation confirmation message to the terminal and displays it to the tourist.

[0484] 2. Payment Processing:

[0485] Tourists enter their payment information.

[0486] The terminal transmits payment information to the server, which processes the payment via a payment system.

[0487] After the server confirms the payment, it sends a final confirmation message to the terminal and displays it to the tourist.

[0488] Ratings and Feedback

[0489] 1. Post-experience evaluation:

[0490] After completing the experience, tourists enter a rating (star rating) and feedback (comments).

[0491] The terminal transmits the evaluation information to the server, which stores it in a database.

[0492] The server sends a confirmation message of the completion of the evaluation to the terminal and displays it to the tourist.

[0493] Use of emotion engine

[0494] 1. User Emotion Recognition:

[0495] The terminal analyzes the user's input information and feedback and recognizes the user's emotions through an emotion engine.

[0496] The server stores the emotion recognition results in a database.

[0497] 2. Customized Experience Proposals:

[0498] Based on the emotion recognition results, the server uses an AI algorithm to further customize and suggest the optimal experience for the user.

[0499] The server sends the customized experience list to the terminal and displays it to the user.

[0500] 3. Feedback sentiment rating:

[0501] The server analyzes the feedback received from tourists using an emotion engine and rates them based on positive or negative emotions.

[0502] The server stores the emotion evaluation results in a database and reflects them in the evaluation of the experience provider.

[0503] 4. Experience Provider Management:

[0504] The server excludes experience providers with low emotional ratings from the system.

[0505] The server periodically checks the evaluation database and manages inappropriate experience providers.

[0506] Specific examples

[0507] 1. Example of user registration:

[0508] A user accesses the platform and enters information as "Yamada Taro."

[0509] The device sends this information to the server, which stores it in a database.

[0510] The server sends a registration completion message to the terminal and displays it on Yamada Taro's screen.

[0511] 2. Example of experience registration:

[0512] The experience provider enters details of the "Tea Ceremony Class."

[0513] The device sends this information to the server, which stores it in a database.

[0514] The server sends a registration completion message to the terminal and displays it on the screen.

[0515] 3. Examples of experience search and suggestions:

[0516] A tourist enters "handmade experience" and "May 25th" as search criteria.

[0517] The device sends these search criteria to the server, which then uses AI to extract the most suitable experiences and generate a list.

[0518] The server sends the list of experiences to the terminal and displays it to the tourist.

[0519] 4. Examples of booking and payment:

[0520] Tourists select "Tea Ceremony Class" from the list of experiences and enter their reservation information.

[0521] The terminal transmits the reservation information to the server, which stores it in a database.

[0522] The tourist enters payment information and the terminal transmits this information to the server.

[0523] The server processes the payment and sends a completion message to the terminal.

[0524] 5. Examples of evaluation and feedback:

[0525] After the experience, tourists rate it five stars and comment, "Very satisfied."

[0526] The device sends this information to the server, which stores it in a database.

[0527] The server sends an evaluation completion message to the terminal and displays it to the tourist.

[0528] 6. Examples of Emotion Engines:

[0529] When tourists book an experience, they express their "expectations" and the device recognizes this emotion and transmits it to the server.

[0530] The server takes emotions into account to suggest a more positive experience.

[0531] After the experience, tourists enter feedback such as "It was fun," and the emotion engine analyzes it as a positive evaluation and stores it in the database.

[0532] This allows tourists to enjoy a more personalized experience, and experience providers can receive appropriate feedback and improve the quality of their services. In addition, by managing the system based on negative reviews, the quality of the overall experience can be maintained.

[0533] The processing flow will be explained below.

[0534] User Registration

[0535] Step 1:

[0536] Users visit the platform's registration page and enter their name, email address, and password.

[0537] Step 2:

[0538] The terminal sends the entered information to the server as an HTTP POST request.

[0539] Step 3:

[0540] The server stores the received information in a database.

[0541] Step 4:

[0542] The server confirms that the save was successful.

[0543] Step 5:

[0544] The server generates a registration completion confirmation message and sends it to the terminal.

[0545] Step 6:

[0546] The terminal will display a confirmation message to inform the user that registration is complete.

[0547] Register your experience

[0548] Step 1:

[0549] The experience provider (user or corporation) accesses the registration page for the experience and enters detailed information (e.g., tea ceremony class, Japanese cooking class, etc.).

[0550] Step 2:

[0551] The terminal sends the entered information to the server as an HTTP POST request.

[0552] Step 3:

[0553] The server stores the received information in a database.

[0554] Step 4:

[0555] The server confirms that the save was successful.

[0556] Step 5:

[0557] The server generates a registration completion confirmation message and sends it to the terminal.

[0558] Step 6:

[0559] The device will display a confirmation message to inform the experience provider that registration is complete.

[0560] Experience search and suggestions

[0561] Step 1:

[0562] Tourists (users) access the platform's search page and enter the type of experience they are interested in and the dates they wish to visit.

[0563] Step 2:

[0564] The terminal sends the entered search criteria to the server as an HTTP GET request.

[0565] Step 3:

[0566] The server uses an AI algorithm to match the experience information in the database based on the received search criteria.

[0567] Step 4:

[0568] The server generates a list of experiences that match the search criteria.

[0569] Step 5:

[0570] The server transmits the experience list to the terminal.

[0571] Step 6:

[0572] The terminal displays to the tourist a list of experiences generated as search results.

[0573] Reservation and payment

[0574] Step 1:

[0575] Tourists (users) select the experience they want from the list of experiences and enter the number of participants and any special notes.

[0576] Step 2:

[0577] The terminal sends the entered reservation information to the server as an HTTP POST request.

[0578] Step 3:

[0579] The server stores the received reservation information in a database.

[0580] Step 4:

[0581] The server confirms that the save was successful.

[0582] Step 5:

[0583] The server generates a reservation confirmation message and sends it to the terminal.

[0584] Step 6:

[0585] The terminal displays a booking confirmation message to the tourist.

[0586] Step 7:

[0587] Tourists enter their payment information (such as credit card information).

[0588] Step 8:

[0589] The terminal sends the payment information to the server as an HTTP POST request.

[0590] Step 9:

[0591] The server transmits the received payment information to the payment system and requests payment processing.

[0592] Step 10:

[0593] The server receives the payment transaction results and stores them in a database.

[0594] Step 11:

[0595] The server generates a confirmation message for the payment completion and sends it to the terminal.

[0596] Step 12:

[0597] The terminal will display a payment completion message to the tourist.

[0598] Ratings and Feedback

[0599] Step 1:

[0600] After completing the experience, tourists (users) access the platform's rating page and enter their rating (star rating) and feedback (comments) about the experience.

[0601] Step 2:

[0602] The device sends the entered rating and feedback to the server as an HTTP POST request.

[0603] Step 3:

[0604] The server stores the received ratings and feedback in a database.

[0605] Step 4:

[0606] The server confirms that the save was successful.

[0607] Step 5:

[0608] The server generates a confirmation message of the completion of the evaluation and sends it to the terminal.

[0609] Step 6:

[0610] The terminal displays an evaluation completion message to the tourist.

[0611] Use of emotion engine

[0612] Step 1:

[0613] When tourists (users) search for or book experiences, they input their current emotions (e.g., anticipation, excitement, anxiety, etc.) using an emotion recognition interface.

[0614] Step 2:

[0615] The device sends the input emotion information to the server as an HTTP POST request.

[0616] Step 3:

[0617] The server analyzes the received emotion information using an emotion engine and generates emotion data.

[0618] Step 4:

[0619] The server stores the emotion data in a database and associates it with user information.

[0620] Step 5:

[0621] Based on the emotional data, the server uses an AI algorithm to further customize the list of experiences it suggests.

[0622] Step 6:

[0623] The server sends the customized experience list to the terminal.

[0624] Step 7:

[0625] The terminal displays a customized list of experiences for tourists.

[0626] Step 8:

[0627] After the experience, tourists enter their ratings and feedback, which are analyzed by the emotion engine to generate emotion evaluation data.

[0628] Step 9:

[0629] The server stores the received emotion evaluation data in a database.

[0630] Step 10:

[0631] The server publishes positive or negative feedback to the experience provider based on the emotional evaluation.

[0632] Step 11:

[0633] The server will remove from the system any experience provider whose negative ratings exceed a certain threshold.

[0634] Step 12:

[0635] The server periodically checks the evaluation database and manages inappropriate experience providers.

[0636] The above is a specific processing flow that combines the emotion engine of the present invention. This realizes a system that provides tourists with a more personalized experience and also contributes to improving the services of experience providers.

[0637] Example 2

[0638] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0639] In the modern tourism industry, tourists have difficulty finding local experiences that fit their interests and schedules. Experience providers also lack effective ways to promote their skills and expertise and stimulate demand. Furthermore, there is a lack of systems to ensure the quality of experiences and improve user satisfaction. To solve this problem and provide tourists with personalized experiences, a system that recognizes user emotions and makes experience suggestions based on those emotions is needed.

[0640] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for storing user information in a database, a means for inputting search criteria for local experiences based on the user's interests and schedule, and a means for proposing experiences that match the search criteria using a generative AI model. This allows tourists to easily find the best experience based on their interests. The server also includes a means for accepting reservations for the selected experience and processing payments, a means for inputting ratings and feedback after the experience and storing them in the database, a means for recognizing the user's emotions via an emotion engine, a means for customizing experience suggestions based on the emotion recognition results, a means for analyzing the ratings and feedback using the emotion engine and storing the rating results in the database, and a means for excluding experience providers with low emotion ratings from the system. This allows tourists to enjoy more personalized, high-quality experiences, and allows experience providers to improve their services by receiving appropriate feedback. It also maintains the overall quality of the experience and improves user satisfaction.

[0641] A "database" is a system for efficiently managing, storing, searching, and updating large amounts of data.

[0642] "User information" refers to a collection of basic data such as a user's name, email address, and password, as well as data related to valid operations and records.

[0643] "Local experiences" are activities and services that allow tourists to experience the culture, skills, and specialties unique to a region.

[0644] "Search criteria" refers to information that serves as the basis for a search, which is performed by specifying the experience the user is interested in, the desired date and time, and so on.

[0645] A "generative AI model" is an artificial intelligence algorithm used to make predictions and suggestions based on user input data.

[0646] A "suggestion" is when a generative AI model finds the best experience based on the user's search criteria and recommends it to the user.

[0647] A "reservation" is a process by which a user reserves a selected experience for a specific date and time.

[0648] "Payment Processing" means the process of managing the fees for a selected Experience through a payment system.

[0649] "Evaluation" refers to the act of a user providing feedback on the content and quality of an experience after it has ended, such as in the form of a star rating.

[0650] "Feedback" refers to comments, opinions, and evaluation information provided by users after completing an experience.

[0651] An "emotion engine" is a technology that analyzes user input information and feedback to recognize the user's emotional state.

[0652] "Emotion recognition" is the process of using an emotion engine to identify emotions from user input and feedback.

[0653] "Customization" refers to the act of individually adjusting experience suggestions based on the user's emotion recognition results to make them more appropriate.

[0654] "Emotion evaluation" is an evaluation by the emotion engine to determine positive or negative emotions based on user feedback.

[0655] "Experience provider" refers to an individual or organization that offers local experiences to tourists.

[0656] "Exclusion" refers to the act of excluding experience providers with low emotional ratings from the platform.

[0657] The present invention relates to a local experience sharing platform for effectively matching tourists and local residents to provide more personalized experiences. Embodiments of the present invention are described below.

[0658] User Registration

[0659] 1. A user enters basic information such as name, email address, and password on the registration screen of a web application. The information is temporarily stored on the device. The device then sends the information to the server as an HTTP POST request.

[0660] 2. The server receives this information and performs validation. If validation is successful, the server stores the user information in a database (e.g. MySQL, PostgreSQL).

[0661] 3. The server generates a registration completion message and sends it to the terminal as an HTTP response, and the terminal displays this message on its screen.

[0662] Register your experience

[0663] 1. The experience provider enters detailed information about the experience (e.g., the date, time, location, and participation fee of the tea ceremony class) on the experience registration screen. The entered information is temporarily saved on the device.

[0664] 2. When the provider presses the registration button, the terminal sends the entered information to the server as an HTTP POST request.

[0665] 3. The server receives this information and performs content validation. If validation is successful, the server stores the experience information in a database.

[0666] 4. The server generates a registration completion message and sends it to the terminal as an HTTP response, and the terminal displays this message on its screen.

[0667] Experience search and suggestions

[0668] 1. Tourists enter the type of experience they are interested in and the dates they wish to visit on the experience search screen. The information entered is temporarily saved on the device.

[0669] 2. When the terminal presses the search button, it sends the entered search criteria to the server as an HTTP GET request.

[0670] 3. The server receives the request, accesses the database, and uses a generative AI model to extract the best list of experiences.

[0671] 4. The server generates a list of the extracted results and sends it to the terminal as an HTTP response. The terminal displays this list on its screen.

[0672] Reservation and payment

[0673] 1. Tourists select the experience they want from the list of experiences and enter reservation information (e.g., number of people, date and time). The entered information is temporarily saved on the device.

[0674] 2. When the reservation button is pressed on the terminal, the entered reservation information is sent to the server as an HTTP POST request.

[0675] 3. The server receives the request, validates the reservation information, and if successful, saves the reservation information in the database.

[0676] 4. The tourist proceeds to the payment screen and enters their payment information (e.g., credit card information), which is temporarily stored on the device.

[0677] 5. When the payment button is pressed, the terminal sends the entered payment information as an HTTP POST request to the server, and the server processes the payment via a payment system (e.g., Stripe, PayPal).

[0678] 6. After confirming the payment, the server generates a reservation completion message and sends it to the terminal as an HTTP response. The terminal displays this message on its screen.

[0679] Ratings and Feedback

[0680] 1. After the experience is over, tourists enter their rating (star rating) and feedback (comments). The entered information is temporarily saved on the device.

[0681] 2. When the device presses the send button, the rating and feedback information is sent to the server as an HTTP POST request.

[0682] 3. The server receives the request and stores the information in a database.

[0683] 4. The server generates an evaluation completion message and sends it to the terminal as an HTTP response. The terminal displays this message on its screen.

[0684] Use of emotion engine

[0685] 1. The device analyzes the user's input information and feedback and recognizes the user's emotions through an emotion engine (e.g., NLP model). The recognized emotion data is sent from the device to the server.

[0686] 2. The server stores the emotion recognition results in a database.

[0687] 3. The server uses a generative AI model based on the emotion recognition results to further customize and propose the most suitable experience for the user. The customized experience list is sent from the server to the device, which then displays it on the screen.

[0688] 4. The server analyzes the feedback received from tourists using an emotion engine and rates them based on positive or negative emotions. The results are stored in a database and reflected in the experience provider's ratings.

[0689] 5. The server removes experience providers with low emotional ratings from the system and periodically checks the rating database to manage inappropriate experience providers.

[0690] Specific examples

[0691] 1. Example of user registration:

[0692] A user accesses the platform and enters "Yamada Taro" as their name, email address, and password.

[0693] The device sends this information to the server, which stores it in a database.

[0694] The server sends a registration completion message to the terminal, which is displayed on Yamada Taro's screen.

[0695] 2. Example of experience registration:

[0696] The experience provider enters details of the "Tea Ceremony Class."

[0697] The device sends this information to the server, which stores it in a database.

[0698] The server sends a registration completion message to the terminal and displays it on the screen.

[0699] 3. Examples of experience search and suggestions:

[0700] A tourist enters "handmade experience" and "May 25th" as search criteria.

[0701] The device sends these search criteria to the server, which then uses a generative AI model to extract the most suitable experiences and generate a list.

[0702] The server sends the experience list to the terminal and displays it to the tourist.

[0703] 4. Examples of booking and payment:

[0704] Tourists select "Tea Ceremony Class" from the list of experiences and enter their reservation information.

[0705] The terminal sends the reservation information to the server, which stores it in a database.

[0706] The tourist enters payment information and the terminal transmits this information to the server.

[0707] After the server completes the payment process, it sends a completion message to the terminal.

[0708] 5. Examples of evaluation and feedback:

[0709] After the experience, tourists rate it five stars and comment, "Very satisfied."

[0710] The device sends this information to the server, which stores it in a database.

[0711] The server sends an evaluation completion message to the terminal and displays it to the tourist.

[0712] 6. Examples of Emotion Engines:

[0713] When tourists book an experience, they express their "expectations" and the device recognizes this emotion and transmits it to the server.

[0714] The server takes emotions into account to suggest a more positive experience.

[0715] After the experience, tourists enter feedback such as "It was fun," and the emotion engine analyzes it as a positive evaluation and stores it in the database.

[0716] This allows tourists to enjoy a more personalized experience, and experience providers can receive appropriate feedback and improve the quality of their services. In addition, by managing the system based on negative reviews, the quality of the overall experience can be maintained.

[0717] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0718] Step 1: Enter your user information

[0719] The user enters basic information such as name, email address, and password on the registration screen of the web application.

[0720] Input: Name, Email Address, Password

[0721] The terminal temporarily stores the entered information.

[0722] Output: Temporarily saved user information

[0723] Step 2: Submit your information

[0724] When the user presses the registration button, the terminal sends the entered information to the server as an HTTP POST request.

[0725] Input: Temporarily saved user information

[0726] Output: HTTP POST request

[0727] Step 3: Storing and validating information

[0728] The server receives the request and performs validations such as name, email format, and password strength.

[0729] Input: HTTP POST request

[0730] Data processing: Validation (format check, strength check)

[0731] If validation is successful, the server saves the user information in the database.

[0732] Output: User information stored in the database

[0733] Step 4: Notification of registration completion

[0734] The server generates a registration completion message and sends it to the terminal as an HTTP response.

[0735] Input: User information stored in the database

[0736] Output: Registration complete message

[0737] The terminal displays the received registration completion message on the screen to notify the user that registration has been completed.

[0738] Output: Registration complete message displayed

[0739] Step 5: Enter your experience details

[0740] The experience provider enters detailed information about the experience (e.g., the date, time, location, and participation fee of the tea ceremony class) on the experience content registration screen.

[0741] Input: Experience details

[0742] The device temporarily stores the information you enter.

[0743] Output: Temporarily saved experience information

[0744] Step 6: Submit your experience

[0745] When the provider presses the registration button, the terminal sends the entered information to the server as an HTTP POST request.

[0746] Input: Temporarily saved experience information

[0747] Output: HTTP POST request

[0748] Step 7: Storing and validating experience information

[0749] The server receives the request and validates the experience information (e.g., checking for duplicate dates and times, validity of participation fees).

[0750] Input: HTTP POST request

[0751] Data processing: Validation (duplicate check, validity check)

[0752] If the validation is successful, the server stores the experience information in a database.

[0753] Output: Experience information stored in a database

[0754] Step 8: Notification of completion of experience registration

[0755] The server generates a registration completion message and sends it to the terminal as an HTTP response.

[0756] Input: Experience information stored in the database

[0757] Output: Registration complete message

[0758] The terminal displays the received registration completion message on the screen and notifies the experience provider that registration is complete.

[0759] Output: Registration complete message displayed

[0760] Step 9: Enter search criteria

[0761] Tourists enter the type of experience they are interested in and the dates they wish to visit on the experience search screen.

[0762] Input: Experience genre, desired date

[0763] The device temporarily stores the information you enter.

[0764] Output: Saved search criteria

[0765] Step 10: Submitting search criteria

[0766] When the terminal presses the search button, the entered search criteria is sent to the server as an HTTP GET request.

[0767] Input: Saved search criteria

[0768] Output: HTTP GET request

[0769] Step 11: Search and suggest

[0770] The server receives the request, accesses a database, and uses a generative AI model to generate a list of optimal experiences.

[0771] Input: HTTP GET request

[0772] Data computation: Generative AI models extract a list of experiences based on search criteria

[0773] The server generates the experience list in list form.

[0774] Output: Experience list

[0775] Step 12: Submit your proposal list

[0776] The server sends the experience list to the terminal as an HTTP response.

[0777] Input: Experience list

[0778] Output: HTTP response

[0779] The device displays the received list on the screen and makes suggestions to tourists.

[0780] Output: Display the list of suggestions

[0781] Step 13: Enter reservation information

[0782] Tourists select the experience they want from the list of experiences and enter reservation information (e.g., number of people, date and time).

[0783] Input: Reservation information

[0784] The device temporarily stores the information you enter.

[0785] Output: Temporarily saved reservation information

[0786] Step 14: Submit reservation information

[0787] When the reservation button is pressed, the terminal sends the entered reservation information to the server as an HTTP POST request.

[0788] Input: Temporarily saved reservation information

[0789] Output: HTTP POST request

[0790] Step 15: Storing and validating reservation information

[0791] The server receives the request and performs validation of the reservation information (e.g. checks for overbooking).

[0792] Input: HTTP POST request

[0793] Data processing: Validation (capacity check)

[0794] If the validation is successful, the server saves the reservation information in the database.

[0795] Output: Reservation information stored in the database

[0796] Step 16: Enter your payment information

[0797] Tourists enter their payment information (e.g., credit card information) on the payment screen.

[0798] Input: Payment Information

[0799] The device temporarily stores the information you enter.

[0800] Output: Temporarily saved payment information

[0801] Step 17: Submit payment information

[0802] When the payment button is pressed, the terminal sends the entered payment information to the server as an HTTP POST request.

[0803] Enter: Saved payment information

[0804] Output: HTTP POST request

[0805] Step 18: Payment Processing

[0806] The server receives the request and processes the payment via a payment system (e.g., Stripe, PayPal).

[0807] Input: HTTP POST request

[0808] Data processing: processing payments through payment systems

[0809] After confirming the payment, the server generates a reservation completion message.

[0810] Output: Payment confirmation and reservation completion message

[0811] Step 19: Reservation completion notification

[0812] The server sends a completion message to the terminal as an HTTP response.

[0813] Input: Payment confirmation and reservation completion message

[0814] Output: HTTP response

[0815] The terminal displays the received completion message on the screen to inform the tourist that the reservation has been completed.

[0816] Output: Display a reservation completion message

[0817] Step 20: Post-Experience Rating and Feedback

[0818] After the experience is over, tourists enter a rating (star rating) and feedback (comments).

[0819] Input: Ratings and Feedback

[0820] The device temporarily stores the information you enter.

[0821] Output: Temporarily saved ratings and feedback

[0822] Step 21: Rate and provide feedback

[0823] When the device presses the send button, it sends the rating and feedback information to the server as an HTTP POST request.

[0824] Input: Saved ratings and feedback

[0825] Output: HTTP POST request

[0826] Step 22: Save your ratings and feedback

[0827] The server receives the request and stores the ratings and feedback information in a database.

[0828] Input: HTTP POST request

[0829] Output: Ratings and feedback stored in a database

[0830] Step 23: Notification of evaluation completion

[0831] The server generates an evaluation completion message and sends it to the terminal as an HTTP response.

[0832] Input: Ratings and feedback stored in the database

[0833] Output: HTTP response

[0834] The terminal displays the received completion message on the screen to inform the tourist that the evaluation is complete.

[0835] Output: Evaluation complete message displayed

[0836] Step 24: Emotion Recognition with the Emotion Engine

[0837] The device analyzes the user's input information and feedback and recognizes the user's emotions through an emotion engine (e.g., NLP model).

[0838] Input: Ratings and Feedback

[0839] Data Computation: Emotion Recognition with Emotion Engine

[0840] The emotion recognition results are sent to the server.

[0841] Output: Emotion recognition result

[0842] Step 25: Storing Emotion Data

[0843] The server stores the emotion recognition results in a database.

[0844] Input: Emotion recognition results

[0845] Output: Emotion recognition results stored in a database

[0846] Step 26: Customize experience recommendations based on emotions

[0847] Based on the emotion recognition results, the server uses a generative AI model to customize and propose the optimal experience for the user.

[0848] Input: Emotion recognition results

[0849] Data Computation: Emotion-Based Customization of Experience Proposals

[0850] The server generates a customized list of experiences.

[0851] Output: A customized list of experiences

[0852] Step 27: Submit your customized list

[0853] The server sends the customized experience list to the device as an HTTP response.

[0854] Input: Customized Experience List

[0855] Output: HTTP response

[0856] The terminal displays the received list on the screen and provides it to the user.

[0857] Output: Display of customized experience list

[0858] Step 28: Sentiment Analysis of Feedback

[0859] The server analyzes the feedback received from tourists using an emotion engine and rates them based on positive or negative emotions.

[0860] Input: Feedback

[0861] Data Computation: Emotion Analysis with Emotion Engine

[0862] The evaluation results are stored in a database.

[0863] Output: Emotion evaluation results stored in a database

[0864] Step 29: Control and exclude experience providers

[0865] The server excludes experience providers with low emotional ratings from the system.

[0866] Input: Emotion evaluation result

[0867] Data processing: Experience provider evaluation check

[0868] The server periodically checks the evaluation database and manages inappropriate experience providers.

[0869] Output: Updated donor list

[0870] (Application example 2)

[0871] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0872] There is a demand for local experience sharing platforms to provide tourists with more personalized experiences, but current systems do not take user emotions into consideration, resulting in a uniform quality of experience and variations in satisfaction. Furthermore, it is difficult to provide experiences that are close to reality even in virtual spaces, which can lead to a decrease in user satisfaction. To solve these issues, it is necessary to recognize user emotions in real time and utilize this information to propose and customize experiences.

[0873] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0874] In this invention, the server includes means for storing user information in a database, means for inputting search criteria for local experiences based on the user's interests and schedule, means for using artificial intelligence to suggest experiences that match the search criteria, means for accepting reservations for the selected experiences and processing payments, means for guiding the provision of experiences and products in the virtual space, means for recognizing the user's emotions using a camera and microphone and customizing the suggestions, and means for inputting evaluations and feedback after the experience and storing them in the database. This allows tourists to enjoy a more personalized experience, and experience providers can receive appropriate feedback and improve the quality of their services.

[0875] A "database" is a system for storing information in an organized manner and for easily retrieving and managing it.

[0876] "User Information" refers to data related to individual users, such as basic information, personal preferences, and history.

[0877] "Search criteria" are the criteria or requirements that users set to efficiently find the experiences or products they desire.

[0878] "Artificial intelligence" is a technology that mimics human intelligence and automates tasks such as data analysis, predictions, and suggestions.

[0879] An "experience" is a service or activity offered to a user that may include cultural, educational, or recreational content.

[0880] A "reservation" is the process of reserving an experience or service in advance for use at a specific time.

[0881] "Payment" refers to the act of a user paying for an experience or service provided.

[0882] "Virtual space" is a virtual environment or world created using computer technology.

[0883] A "guide" is a person or system whose role is to provide information and instructions to users.

[0884] A "camera" is a device that takes still images and videos and is used to recognize the user's facial expressions and movements.

[0885] A "microphone" is a device for picking up sound and is used to recognize the user's tone of voice and words.

[0886] "Emotion" is a subjective state of feeling or sensation experienced by a user.

[0887] "Customization" means tailoring content to the needs and preferences of individual users.

[0888] A "rating" is the act of expressing opinions or impressions about the quality of an experience or service provided.

[0889] "Feedback" refers to the communication of users' opinions and thoughts about the experience or service provided.

[0890] A "generative AI model" is a form of artificial intelligence that uses algorithms that have been trained with large amounts of data in advance and designed to perform specific tasks.

[0891] In this invention, the following hardware and software are used to realize a virtual experience guide system that provides tourists with a more personalized experience.

[0892] Hardware used

[0893] Smartphone: Uses camera, microphone, and GPS functions.

[0894] Head-mounted displays (HMDs) or smart glasses: Used to provide experiences within virtual spaces.

[0895] Software used

[0896] Cloud-based servers (e.g., AWS) for storing and processing data.

[0897] Emotion recognition engine (e.g., Microsoft Azure Emotion API): Recognizes and analyzes user emotions in real time.

[0898] AI algorithms (machine learning models) to suggest and customize experiences.

[0899] Database (MySQL, etc.): Stores user information, experience information, and feedback.

[0900] What the program does

[0901] 1. User Registration

[0902] The server stores the user's basic information (name, email address, password) received from the smartphone in a database. It then sends a confirmation message to the user and displays it on the smartphone.

[0903] 2. Register your experience

[0904] The experience provider enters details of the experience they are offering using their smartphone and sends them to the server, which stores the information in a database and sends a confirmation message to the experience provider's smartphone.

[0905] 3. Start the virtual tour

[0906] Tourists launch the app and begin their virtual guided tour. The app uses the smartphone's camera and microphone to analyze facial expressions and tone of voice in real time, and an emotion recognition engine is used to identify emotions.

[0907] 4. Emotion-based recommendations

[0908] The server proposes optimal virtual experiences and products based on emotion recognition results and past data. The proposals are sent to the smartphone or HMD and displayed to the user. The emotion recognition data and proposal history are stored in a database.

[0909] 5. Post-experience feedback

[0910] After the experience, tourists enter star ratings and comments. This information is sent to the server via smartphone and stored in a database. The emotion engine analyzes the emotional state of the feedback and generates feedback data to improve the quality of services.

[0911] 6. Reputation Management

[0912] The server periodically checks the rating database and manages low-rated experience providers, excluding inappropriate experience providers from the system.

[0913] Specific examples

[0914] As an example of a tourist, Taro Yamada books a "Virtual Tea Ceremony Experience" and uses a facial recognition camera to indicate his "expectations." The app then suggests a "Japanese Cooking Class" in addition to the "Tea Ceremony Experience." After the experience, Yamada leaves a comment saying he's "very satisfied," which the emotion engine interprets as a positive evaluation.

[0915] Example of input prompt for generative AI model

[0916] User Taro Yamada has booked a "Virtual Tea Ceremony Experience." Judging from his facial expression, he seems "expected." Suggest the best additional experiences and customize your next suggestions based on his post-experience feedback.

[0917] Examples of registered experiences: Tea ceremony class, Japanese cooking class, Origami class

[0918] Using this system, tourists can enjoy rich local experiences in a more enjoyable and satisfying way, even in a virtual space, and experience providers can receive appropriate feedback and improve the quality of their services.

[0919] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0920] Step 1:

[0921] User registration step: The user uses their smartphone to enter basic information such as their name, email address, and password. The device sends this information to the server, which then stores it in a database. The input is the user's basic information, and the output is the result of saving it to the database and a message that registration is complete.

[0922] Step 2:

[0923] Experience content registration step: The experience provider enters detailed information about the experience they are offering from their smartphone. The device sends this information to the server, which then stores it in a database. The input is the experience content information, and the output is the result of saving it to the database and a message indicating registration is complete.

[0924] Step 3:

[0925] User emotion recognition and virtual guide start step The user starts the virtual guide using a smartphone or head-mounted display (HMD). The camera and microphone capture the user's facial expressions and tone of voice in real time and send this to the emotion recognition engine. The input is real-time facial expression and tone of voice data, and the output is the emotion recognition results.

[0926] Step 4:

[0927] Emotion-based experience suggestion step: Based on the emotion recognition results, the server uses an AI algorithm to suggest the most suitable experiences and products to the user. The server saves the suggestions in a database, sends them to the device, and displays them to the user. The input is the emotion recognition results and past data, and the output is a list of optimal experience suggestions.

[0928] Step 5:

[0929] Experience booking and payment step The user selects the desired experience from the list of suggested experiences and makes a reservation. The terminal sends the reservation information to the server, which stores it in a database. The user then enters payment information, which the terminal sends to the server for payment processing. The input is reservation information and payment information, and the output is reservation confirmation and payment confirmation messages.

[0930] Step 6:

[0931] Post-experience evaluation and feedback step After completing the experience, the user inputs an evaluation (star rating) and feedback (comments). The terminal sends this information to the server, which stores it in a database. The input is the evaluation and feedback information, and the output is the result of saving to the database and a message that the evaluation is complete.

[0932] Step 7:

[0933] Sentiment analysis and management of rating data: The server analyzes the rating data and feedback data using an emotion recognition engine and customizes the next proposal based on positive or negative emotions. It also removes experience providers with low ratings from the database. The input is the rating and feedback data, and the output is the analysis results and system management results.

[0934] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0935] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0936] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0937] [Second embodiment]

[0938] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0939] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0940] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0941] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0942] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0943] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0944] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0945] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0946] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0947] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0948] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0949] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0950] The present invention relates to a local experience sharing platform that connects tourists and local residents, and specific embodiments thereof are described below.

[0951] User Registration

[0952] 1. User Registration:

[0953] A user registers by entering their name, email address, and password.

[0954] The terminal sends this information to the server, which stores it in a database.

[0955] The server returns registration confirmation information to the terminal and displays a registration completion message on the user's screen.

[0956] Register your experience

[0957] 1. Enter your experience provider information:

[0958] The experience provider (user or corporation) enters details of the experience they wish to offer (e.g., tea ceremony class, Japanese cooking class, etc.).

[0959] The terminal sends this information to the server, which stores it in a database.

[0960] The server returns registration confirmation information to the terminal and displays a trial registration completion message on the screen.

[0961] Experience search and suggestions

[0962] 1. Tourist search:

[0963] Tourists (users) input the desired experience genre and dates.

[0964] The terminal transmits the search conditions to the server.

[0965] The server uses AI algorithms to extract experiences from a database that match the search criteria.

[0966] The server returns the extracted results to the terminal and displays a list of experiences suitable for the tourist.

[0967] Reservation and payment

[0968] 1. Select and book your experience:

[0969] Tourists select the experience they want from a list and enter their booking information.

[0970] The terminal transmits the reservation information to the server, which stores it in a database.

[0971] The server returns a reservation confirmation message to the terminal and displays a reservation completion message on the screen.

[0972] 2. Payment Processing:

[0973] Tourists enter their payment information.

[0974] The terminal transmits this information to the server, which then processes the payment via the payment system.

[0975] The server returns confirmation of payment completion to the terminal and displays a payment completion message on the screen.

[0976] Ratings and Feedback

[0977] 1. Post-experience evaluation:

[0978] Tourists can enter their ratings and feedback after completing the experience.

[0979] The terminal sends this information to the server, which stores it in a database.

[0980] The server returns the evaluation and feedback confirmation information to the terminal and displays an evaluation completion message on the screen.

[0981] Specific examples

[0982] 1. Example of user registration:

[0983] The user accesses the platform and enters information as "Taro" on the registration page.

[0984] The terminal sends this information to the server, which stores the information in a database.

[0985] The server sends a message to the terminal indicating that registration is complete, and displays it on "Taro's" screen.

[0986] 2. Example of experience registration:

[0987] Experience providers enter details of the "Japanese cooking class."

[0988] The terminal sends this information to the server, which stores it in a database.

[0989] The server sends a message to the terminal indicating that registration is complete, and displays it on the screen.

[0990] 3. Examples of experience search and suggestions:

[0991] Tourists search by entering "handmade experience" and "April 10th."

[0992] The device sends these search criteria to the server, which then uses AI to extract the optimal experience.

[0993] The server sends the list of experiences to the terminal and displays it to the tourist.

[0994] 4. Examples of booking and payment:

[0995] Tourists select "Japanese cooking class" from the list of experiences and enter their reservation information.

[0996] The terminal transmits the reservation information to the server, which stores it in a database.

[0997] The tourist enters payment information and the terminal transmits this information to the server.

[0998] The server processes the payment and returns a completion message to the terminal.

[0999] 5. Examples of evaluation and feedback:

[1000] After completing the experience, tourists can rate it five stars and comment that it was fun.

[1001] The terminal sends this information to the server, which stores it in a database.

[1002] The server returns a message indicating that the evaluation is complete to the terminal and displays it on the screen.

[1003] This allows tourists to seamlessly discover, book, and participate in experiences that are perfect for them, allows experience providers to earn income by leveraging their skills and expertise, and improves the overall quality of the experience through ratings and feedback.

[1004] The processing flow will be explained below.

[1005] User Registration

[1006] Step 1:

[1007] The user accesses the platform's registration page and enters the required information (name, email address, password).

[1008] Step 2:

[1009] The terminal sends the entered information to the server as an HTTP POST request.

[1010] Step 3:

[1011] The server stores the received information in a database.

[1012] Step 4:

[1013] The server confirms that the save was successful.

[1014] Step 5:

[1015] The server generates a registration completion confirmation message and sends it to the terminal.

[1016] Step 6:

[1017] The terminal will display a confirmation message to inform the user that registration is complete.

[1018] Register your experience

[1019] Step 1:

[1020] The experience provider (user or corporation) accesses the experience registration page and enters detailed information (title, description, date and time, price).

[1021] Step 2:

[1022] The terminal sends the entered information to the server as an HTTP POST request.

[1023] Step 3:

[1024] The server stores the received information in a database.

[1025] Step 4:

[1026] The server confirms that the save was successful.

[1027] Step 5:

[1028] The server generates a registration completion confirmation message and sends it to the terminal.

[1029] Step 6:

[1030] The device will display a confirmation message to inform the experience provider that registration is complete.

[1031] Experience search and suggestions

[1032] Step 1:

[1033] Tourists (users) access the platform's search page and enter the type of experience they are interested in and the dates they wish to visit.

[1034] Step 2:

[1035] The terminal sends the entered search criteria to the server as an HTTP GET request.

[1036] Step 3:

[1037] The server uses an AI algorithm to match the experience information in the database based on the received search criteria.

[1038] Step 4:

[1039] The server generates a list of experiences that match the search criteria.

[1040] Step 5:

[1041] The server transmits the experience list to the terminal.

[1042] Step 6:

[1043] The terminal displays to the tourist a list of experiences generated as search results.

[1044] Reservation and payment

[1045] Step 1:

[1046] Tourists (users) select the experience they want from the list of experiences and enter the number of participants and any special notes.

[1047] Step 2:

[1048] The terminal sends the entered reservation information to the server as an HTTP POST request.

[1049] Step 3:

[1050] The server stores the received reservation information in a database.

[1051] Step 4:

[1052] The server confirms that the save was successful.

[1053] Step 5:

[1054] The server generates a reservation confirmation message and sends it to the terminal.

[1055] Step 6:

[1056] The terminal displays a booking confirmation message to the tourist.

[1057] Step 7:

[1058] Tourists enter their payment information (such as credit card information).

[1059] Step 8:

[1060] The terminal sends the payment information to the server as an HTTP POST request.

[1061] Step 9:

[1062] The server transmits the received payment information to the payment system and requests payment processing.

[1063] Step 10:

[1064] The server receives the payment transaction results and stores them in a database.

[1065] Step 11:

[1066] The server generates a confirmation message for the payment completion and sends it to the terminal.

[1067] Step 12:

[1068] The terminal will display a payment completion message to the tourist.

[1069] Ratings and Feedback

[1070] Step 1:

[1071] After completing the experience, tourists (users) access the platform's rating page and enter their rating (star rating) and feedback (comments) about the experience.

[1072] Step 2:

[1073] The device sends the entered rating and feedback to the server as an HTTP POST request.

[1074] Step 3:

[1075] The server stores the received ratings and feedback in a database.

[1076] Step 4:

[1077] The server confirms that the save was successful.

[1078] Step 5:

[1079] The server generates a confirmation message of the completion of the evaluation and sends it to the terminal.

[1080] Step 6:

[1081] The terminal displays an evaluation completion message to the tourist.

[1082] The above is a specific processing flow of the system of the present invention, which realizes a platform that is beneficial to both tourists and experience providers.

[1083] Example 1

[1084] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1085] Conventional tourism platforms make it difficult for users to easily search, book, and pay for local experiences that match their interests. They also lack effective means to maintain the quality of experience providers and reflect user feedback. An effective system to solve these issues is needed.

[1086] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1087] In this invention, the server includes means for saving user information in a database, means for a user to register by entering their name, email address, and password, means for transmitting the entered information to the server and the server storing it in the database, means for inputting search criteria for local experiences based on the user's interests and schedule, means for the server to extract experiences that match the search criteria from the database using an AI algorithm, means for inputting reservation information for the selected experience, transmitting it to the server and storing it in the database, means for tourists to input payment information and for the server to process the payment via a payment system, and means for tourists to input ratings and feedback after the experience has ended and the server storing it in the database. This allows users to efficiently search for, book, and pay for local experiences, and also enables them to evaluate the quality of experience providers and improve the overall quality of the experience.

[1088] "User Information" refers to identifying information such as a user's name, email address, and password.

[1089] "Database" refers to a system for systematically storing and managing user information, experience information, reservation information, evaluation information, etc.

[1090] "Server" refers to a central processing unit that stores information sent by users in a database and provides users with the information they require.

[1091] "Terminal" refers to a device (e.g., PC, smartphone, etc.) through which a user inputs information and communicates with a server.

[1092] "New Registration" refers to the process when a User accesses the Platform for the first time and enters their information to create an account.

[1093] "Local experiences" refer to the provision of local culture and activities that are unique to the region, and in which tourists can participate directly through experience providers.

[1094] "AI algorithm" refers to a program that uses machine learning models and filtering algorithms to extract the optimal experience based on a user's search criteria.

[1095] "Reservation Information" refers to the information a User enters to reserve a particular Experience (e.g., experience date, number of participants, etc.).

[1096] "Payment System" refers to a system for processing online payments (e.g., Stripe, PayPal, etc.).

[1097] "Ratings and feedback" refers to information that a user enters after completing an experience, such as their thoughts and ratings about the experience.

[1098] "Experience Provider" refers to an individual or entity that provides a local experience.

[1099] "Tourist" refers to a traveler or individual user looking for a local experience.

[1100] The present invention relates to a local experience sharing platform that connects tourists and experience providers, and a specific embodiment thereof will be described. The platform is a system that stores user information in a database and allows users to search, book, pay for, and rate local experiences. This system consists of three main components: a server, a terminal, and a user.

[1101] 1. User Registration Implementation

[1102] User Registration:

[1103] The user accesses the platform's registration page using a device (e.g., a PC or smartphone) and enters their name, email address, and password.

[1104] The terminal transmits this information to the server.

[1105] The server uses a database management system such as MySQL or PostgreSQL to store the received information in a database.

[1106] The server generates a registration completion confirmation message and sends it to the terminal.

[1107] Examples:

[1108] The user accesses the platform and enters their name, email address, and password as "Taro" on the registration page.

[1109] The terminal sends this information to the server, which stores it in a database.

[1110] The server sends a message to the terminal indicating that registration is complete, and the terminal displays the message on "Taro's" screen.

[1111] 2. How to register your experience

[1112] Register your experience:

[1113] The experience provider (user or corporation) uses a terminal to input details of the experience they are offering.

[1114] The terminal sends this information to the server.

[1115] The server stores the received experience information in a database.

[1116] The server generates a confirmation message confirming the completion of the trial registration and sends it to the terminal.

[1117] Examples:

[1118] Experience providers enter details of the "Japanese cooking class."

[1119] The terminal sends this information to the server, which stores it in a database.

[1120] The server sends a registration completion message to the terminal, which displays it on the screen.

[1121] 3. Experience Search and Suggestion Implementation

[1122] Experience search and suggestions:

[1123] Tourists (users) use their terminals to input the desired experience genre and dates and perform a search.

[1124] The terminal transmits the input search conditions to the server.

[1125] The server uses a generative AI model to extract experiences that match the search criteria from a database, using Python machine learning models and collaborative filtering algorithms.

[1126] The server returns the extracted results in list form to the terminal, which displays them to the tourist.

[1127] Examples:

[1128] Tourists search by entering "handmade experience" and "April 10th."

[1129] The device sends these search criteria to a server, which uses AI to extract the optimal experience.

[1130] The server sends the list of experiences to the terminal, which displays it to the tourist.

[1131] 4. Booking and payment methods

[1132] Reservation and payment:

[1133] Tourists select the experience they want from a list and enter their booking information.

[1134] The terminal transmits the entered reservation information to the server.

[1135] The server stores the reservation information in a database.

[1136] The server generates a reservation confirmation message and sends it to the terminal.

[1137] The tourist enters payment information and the terminal transmits this information to the server.

[1138] The server processes the payment through a payment system (e.g., Stripe, PayPal, etc.).

[1139] The server generates a confirmation message for the payment completion and sends it to the terminal.

[1140] Examples:

[1141] Tourists select "Japanese cooking class" from the list of experiences and enter their reservation information.

[1142] The terminal transmits the reservation information to the server, which stores it in a database.

[1143] The tourist enters payment information and the terminal transmits this information to the server.

[1144] The server processes the payment and returns a completion message to the terminal.

[1145] 5. Evaluation and feedback methods

[1146] Rating and Feedback:

[1147] Tourists can enter their ratings and feedback after completing the experience.

[1148] The terminal transmits the input rating and feedback information to the server.

[1149] The server stores the received information in a database.

[1150] The server generates a confirmation message of the completion of the evaluation and sends it to the terminal.

[1151] Examples:

[1152] After completing the experience, tourists can rate it five stars and comment that it was fun.

[1153] The terminal sends this information to the server, which stores it in a database.

[1154] The server sends a message indicating that the evaluation is complete to the terminal, which displays the message on the screen.

[1155] These specific embodiments allow users to seamlessly find, book, pay for, and rate local experiences, while also enabling experience providers to earn income by leveraging their skills and expertise, improving the overall quality of the experience.

[1156] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1157] Step 1: The user enters their name, email address, and password.

[1158] The user visits the registration page and enters their name, email address, and password.

[1159] Input: Name, email address, and password entered by the user.

[1160] Output: User information temporarily stored on the device.

[1161] Step 2: The device sends the user information to the server

[1162] The terminal transmits the input user information to the server.

[1163] Input: Name, email address, and password entered by the user.

[1164] Output: User information arriving at the server.

[1165] Step 3: The server saves the user information to a database

[1166] The server stores the received user information in a database.

[1167] Input: User information received by the server.

[1168] Data processing: Validate user information and save it to the database if successful.

[1169] Output: User information stored in the database.

[1170] Step 4: The server generates a confirmation message for the registration and sends it to the device.

[1171] The server generates a registration completion confirmation message and sends it to the terminal.

[1172] Input: The registration process has been completed successfully.

[1173] Output: Registration completion message received on the device.

[1174] Step 5: Your device will display a registration complete message

[1175] The terminal displays the received confirmation message to inform the user that registration is complete.

[1176] Input: Registration completion message sent by the server.

[1177] Output: A confirmation message that will be displayed on the user's screen.

[1178] Step 6: Enter details about the experience the experience provider is offering

[1179] The experience provider uses the terminal to input details of the experience they are offering (e.g., experience name, details, dates, etc.).

[1180] Input: Experience information such as experience name, details, and dates.

[1181] Output: Experience information temporarily stored on the device.

[1182] Step 7: The device sends the experience information to the server

[1183] The terminal transmits the input experience information to the server.

[1184] Input: Experience information such as experience name, details, and dates.

[1185] Output: Experience information that arrives at the server.

[1186] Step 8: The server stores the experience information in a database

[1187] The server stores the received experience information in a database.

[1188] Input: Experience information received by the server.

[1189] Data processing: Validate the experience information and save it to the database if successful.

[1190] Output: Experience information stored in a database.

[1191] Step 9: The server generates a confirmation message for the completion of the trial registration and sends it to the device.

[1192] The server generates a confirmation message confirming the completion of the trial registration and sends it to the terminal.

[1193] Input: The trial registration process has been completed successfully.

[1194] Output: A message will be sent to your device confirming your registration.

[1195] Step 10: Your device will display a message that your trial registration is complete.

[1196] The device will display the received confirmation message and notify the experience provider that registration has been completed.

[1197] Input: Trial registration completion message sent from the server.

[1198] Output: A confirmation message that will be displayed to the experience provider.

[1199] Step 11: Enter the type of experience and dates that tourists want to use and search

[1200] Tourists use their devices to search by entering the type of experience and dates they want.

[1201] Input: Search criteria such as experience genre and date.

[1202] Output: Search criteria temporarily saved on your device.

[1203] Step 12: The device sends the search criteria to the server

[1204] The terminal transmits the input search conditions to the server.

[1205] Input: Search criteria such as experience genre and date.

[1206] Output: The search criteria that arrives at the server.

[1207] Step 13: The server uses an AI algorithm to extract experiences from the database that match the search criteria.

[1208] The server uses a generative AI model to extract experiences from a database that match the search criteria.

[1209] Input: The search criteria received by the server.

[1210] Data calculations: Using AI algorithms to extract experience information that matches search criteria (e.g., collaborative filtering).

[1211] Output: A list of extracted experience information.

[1212] Step 14: The server returns the extracted results to the terminal in list format.

[1213] The server returns the extraction results in list form to the terminal and displays them.

[1214] Input: A list of extracted experience information.

[1215] Output: A list of experience information delivered to the device.

[1216] Step 15: The device displays the search results to the tourist.

[1217] The terminal displays the received search results to the tourist.

[1218] Input: Experience information list sent from the server.

[1219] Output: A list of experience information displayed on the tourist's screen.

[1220] Step 16: Tourists select the experience they want and enter their booking information

[1221] Tourists select the experience they want from a list and enter their reservation information.

[1222] Input: Experience selection and booking information (e.g. number of participants, booking date).

[1223] Output: Reservation information temporarily stored on the device.

[1224] Step 17: The device sends the reservation information to the server

[1225] The terminal transmits the entered reservation information to the server.

[1226] Input: Booking information (e.g. number of participants, booking date).

[1227] Output: Reservation information received by the server.

[1228] Step 18: The server saves the reservation information to the database

[1229] The server stores the received reservation information in a database.

[1230] Input: Reservation information received by the server.

[1231] Data processing: Validate reservation information and save it to the database if successful.

[1232] Output: Reservation information stored in a database.

[1233] Step 19: The server generates a reservation confirmation message and sends it to the terminal.

[1234] The server generates a reservation confirmation message and sends it to the terminal.

[1235] Input: The reservation process has been completed successfully.

[1236] Output: Reservation confirmation message received on your device.

[1237] Step 20: The terminal displays a reservation completion message to the tourist

[1238] The terminal will display the received confirmation message and inform the tourist that their reservation has been completed.

[1239] Input: The reservation confirmation message sent by the server.

[1240] Output: A confirmation message that will be displayed on the tourist's screen.

[1241] Step 21: Tourist enters payment information

[1242] Once a tourist has booked an experience, they enter their payment information.

[1243] Input: Payment information (e.g. credit card information, payment amount).

[1244] Output: Payment information temporarily stored on the device.

[1245] Step 22: The terminal sends the payment information to the server

[1246] The terminal transmits the entered payment information to the server.

[1247] Input: Payment information.

[1248] Output: Payment information arriving at the server.

[1249] Step 23: The server processes the payment through the payment system

[1250] The server processes the payment through a payment system (e.g., Stripe, PayPal).

[1251] Input: Payment information received by the server.

[1252] Data processing: Processing payments via payment systems and APIs and receiving results.

[1253] Output: Confirmation of successful payment.

[1254] Step 24: The server sends a confirmation message to the terminal that the payment has been completed.

[1255] The server generates a confirmation message for the payment completion and sends it to the terminal.

[1256] Input: The payment process has been completed successfully.

[1257] Output: Payment completed message received on the terminal.

[1258] Step 25: The terminal displays a payment completion message to the tourist

[1259] The terminal will display the received confirmation message and inform the tourist that the payment has been completed.

[1260] Input: Payment completion message sent from the server.

[1261] Output: A confirmation message that will be displayed on the tourist's screen.

[1262] Step 26: Tourists complete the experience and enter their rating and feedback

[1263] Tourists can enter their ratings and feedback after completing the experience.

[1264] Input: Rating information (e.g., star rating, comments).

[1265] Output: Rating information temporarily stored on the device.

[1266] Step 27: The device sends the rating and feedback information to the server.

[1267] The terminal transmits the input rating and feedback information to the server.

[1268] Input: Rating information.

[1269] Output: Rating information arriving at the server.

[1270] Step 28: The server stores the rating and feedback information in a database

[1271] The server stores the received ratings and feedback information in a database.

[1272] Input: Rating information received by the server.

[1273] Data processing: Validate the evaluation information and save it in the database if successful.

[1274] Output: Evaluation information stored in a database.

[1275] Step 29: The server generates a confirmation message confirming the completion of the evaluation and sends it to the terminal.

[1276] The server generates a confirmation message of the completion of the evaluation and sends it to the terminal.

[1277] Input: The evaluation process completed successfully.

[1278] Output: Evaluation completion message arriving on your terminal.

[1279] Step 30: The terminal displays a message to the tourist that the evaluation is complete.

[1280] The terminal will display the received confirmation message to inform the tourist that the evaluation is complete.

[1281] Input: Evaluation completion message sent by the server.

[1282] Output: A confirmation message that will be displayed on the tourist's screen.

[1283] (Application example 1)

[1284] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1285] With conventional tourism experience reservation systems, it is difficult for tourists to check the experience content and provider ratings until they arrive at the destination, and the reservation and payment procedures are cumbersome. As a result, tourists are unable to enjoy high-quality experiences, and local experience providers have difficulty attracting appropriate customers. In addition, the inability to share experiences in real time or make instant payments reduces the quality and satisfaction of the experience.

[1286] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1287] In this invention, the server includes means for storing user information in a database, means for inputting search criteria for local experiences based on the user's interests and schedule, means for using artificial intelligence to suggest experiences that match the search criteria, means for accepting reservations for the selected experience and processing payments, means for inputting ratings and feedback after the experience and storing them in the database, and means for sharing local experiences in real time and making reservations and payments using smart devices in physical stores. This allows tourists to share experiences in real time on-site and make instant reservations and payments, improving the quality of the experience and satisfaction.

[1288] A "database" is an information system that organizes and stores various data, such as user information and experience information, and can efficiently search, manage, and update it.

[1289] "User" refers to individuals and corporations such as tourists and experience providers who use this system.

[1290] "Local Experiences" are activities and events that are rooted in local culture and specialties and offer tourists a unique experience.

[1291] "Artificial intelligence" is a technology that allows systems to automatically analyze data and make predictions, and makes optimal suggestions based on user input conditions.

[1292] "Search criteria" refers to information such as the type of experience and dates desired that a user enters into the system.

[1293] "Reservation" refers to the process by which a tourist confirms their chosen experience in advance.

[1294] "Payment" refers to the process of paying for a booked experience.

[1295] A "smart device" is an electronic device that can use the Internet and applications, such as a smartphone, smart glasses, or a head-mounted display.

[1296] "Real-time" means that users receive experience information immediately and reservations and payments are completed instantly on the spot.

[1297] "Evaluation" refers to the act of tourists expressing their thoughts and satisfaction about the quality of the experience after it has ended.

[1298] "Feedback" refers to specific comments or opinions about the experience or service provided by a user.

[1299] The system that realizes this invention not only has a conventional tourism experience reservation system but also a real-time experience sharing function using smart devices in a physical store. This system consists of the following main components.

[1300] System Program Overview

[1301] 1. User registration procedure:

[1302] Users access the system and register by entering their name, email address, and password.

[1303] The terminal sends this information to the server, which stores it in a database.

[1304] A registration completion message is returned to the terminal and displayed on the screen.

[1305] 2. Experience registration procedure:

[1306] The experience provider inputs details of the experience to be offered, and the terminal transmits these to the server.

[1307] The server stores the information in a database and returns a registration completion message to the terminal.

[1308] 3. Experience search and proposal procedure:

[1309] Tourists (users) input the desired experience genre and dates, and the terminal sends these search conditions to the server.

[1310] The server uses the generative AI model to suggest the optimal experience and sends the results back to the device.

[1311] 4. Booking and payment procedures:

[1312] Tourists select the experience they want and enter their booking and payment information.

[1313] The terminal sends this information to the server, the reservation information is stored in a database, and payments are processed using the Stripe API.

[1314] A message confirming reservation and payment is sent back to the terminal.

[1315] 5. Evaluation and Feedback Procedures:

[1316] After completing the experience, tourists enter their ratings and feedback into the terminal, and the server stores them in a database.

[1317] A completion message is sent back to the terminal and displayed on the screen.

[1318] 6. Real-time experience sharing procedure:

[1319] Tourists use smart devices (smartphones, smart glasses, head-mounted displays, etc.) in physical stores to search, book, and pay for experience details in real time.

[1320] The terminal sends this request to the server, which processes it in real time.

[1321] Hardware and Software Used

[1322] Hardware: Smart devices such as smartphones, smart glasses, and head-mounted displays (HMDs).

[1323] Software: Python, Flask, SQLite, Stripe API, Generative AI Model

[1324] Specific example explanation

[1325] Example of user registration:

[1326] The user accesses the platform and registers by entering the name "Taro", email address, and password.

[1327] The terminal sends this information to the server, which stores it in a database and returns a registration completion message.

[1328] Examples of experience registration:

[1329] The experience provider enters details of the "Japanese sweets making experience," and the terminal sends these to the server.

[1330] The server stores the information in a database and a registration complete message is sent back to the terminal.

[1331] Examples of experience search and suggestions:

[1332] Tourists search by entering "handmade experience" and "April 10th."

[1333] The device sends these search criteria to the server, which extracts information and sends results back to the device to suggest the optimal experience using a generative AI model.

[1334] Examples of booking and payment:

[1335] Tourists select "Japanese sweets making experience," enter their reservation and payment information, and the terminal sends this to the server.

[1336] The server saves the reservation information in a database, the payment is processed using the Stripe API, and a completion message is sent back to the terminal.

[1337] Examples of evaluation and feedback:

[1338] After completing the experience, tourists enter their ratings and comments, which are then sent to the server by the device.

[1339] The server stores it in a database and a completion message is sent back to the terminal.

[1340] Example prompt sentence:

[1341] "I'd like to book an experience. I'm looking for a crafting experience on April 10th."

[1342] "We found three handmade experiences taking place on April 10th. We have a Japanese sweets making experience, a Japanese cooking class, and a crafts making experience. Which one would you like to book?"

[1343] As described above, this system allows tourists to search, book, and pay for experiences in real time, improving the quality and satisfaction of the experiences. It also allows experience providers to efficiently offer their skills and specialties.

[1344] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1345] Step 1: User Registration

[1346] A user accesses the platform and enters their name, email address, and password. This information is sent from the device to the server. The server stores this information in a database and returns a registration completion message to the device. This saves the user information in the database and confirms the registration.

[1347] Step 2: Register your experience

[1348] The experience provider (user or corporation) enters details of the experience they wish to offer (e.g., Japanese sweets making experience). The device sends this information to the server, which stores the information in a database. Registration confirmation information is returned to the device, and a message indicating experience registration completion is displayed on the screen. The experience information is then stored in the database.

[1349] Step 3: Find and suggest experiences

[1350] Tourists (users) input the desired experience genre and dates, and the device sends these search criteria to the server. The server uses a generative AI model to extract the best experiences that match the search criteria from the database. The extracted results are sent back to the device, and a list of experiences that match the tourist is displayed. This allows tourists to easily find the experience they want.

[1351] Step 4: Reservation

[1352] The tourist selects the desired experience from the list and enters the reservation information. The terminal sends the reservation information to the server, which stores it in a database. A reservation confirmation message is sent back to the terminal, and a reservation completion message is displayed on the screen. This saves the reservation information in the database and confirms the reservation to the tourist.

[1353] Step 5: Payment

[1354] The tourist enters payment information. The terminal sends this information to the server, which processes the payment using the Stripe API. A confirmation of the payment is sent back to the terminal, and a payment completion message is displayed on the screen. This completes the payment, and the tourist can confirm it.

[1355] Step 6: Rating and feedback

[1356] After completing the experience, tourists enter their rating and feedback. The device sends this information to the server, which stores it in a database. Confirmation of the rating and feedback is sent back to the device, and a rating completion message is displayed on the screen. This saves the rating and feedback in the database, affecting the existing data.

[1357] Step 7: Real-time experience sharing

[1358] Tourists use smart devices in physical stores to search, book, and pay for experience details in real time. The device sends this request to the server, which processes it in real time. The response is immediately sent back to the device and displayed to the tourist, allowing for immediate on-site response.

[1359] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1360] This invention relates to a local experience sharing platform that effectively matches tourists and local residents and provides more personalized experiences. In particular, it aims to improve user satisfaction by combining it with an emotion engine that recognizes user emotions.

[1361] User Registration

[1362] 1. User Registration:

[1363] A user registers by entering basic information such as name, email address, and password.

[1364] The terminal sends this information to a server, which stores the information in a database.

[1365] The server sends a confirmation message to the terminal confirming the completion of registration, which is displayed on the user's screen.

[1366] Register your experience

[1367] 1. Experience provider registration:

[1368] Experience providers enter detailed information about the experience they are offering (e.g., tea ceremony class, Japanese cooking class, etc.).

[1369] The device sends this information to the server, which stores it in a database.

[1370] The server sends a confirmation message to the terminal to confirm the completion of registration, which is displayed on the screen.

[1371] Experience search and suggestions

[1372] 1. Tourist search:

[1373] Tourists input the type of experience they are interested in and the dates they wish to visit.

[1374] The terminal transmits the search conditions to the server.

[1375] Based on the received search criteria, the server uses an AI algorithm to compare the experience information in the database and generate an optimal experience list.

[1376] The server sends the list of experiences to the terminal and displays it to the tourist.

[1377] Reservation and payment

[1378] 1. Booking an experience:

[1379] Tourists select the experience they want from a list and enter their reservation information.

[1380] The terminal transmits the reservation information to the server, which stores it in a database.

[1381] The server sends a reservation confirmation message to the terminal and displays it to the tourist.

[1382] 2. Payment Processing:

[1383] Tourists enter their payment information.

[1384] The terminal transmits payment information to the server, which processes the payment via a payment system.

[1385] After the server confirms the payment, it sends a final confirmation message to the terminal and displays it to the tourist.

[1386] Ratings and Feedback

[1387] 1. Post-experience evaluation:

[1388] After completing the experience, tourists enter a rating (star rating) and feedback (comments).

[1389] The terminal transmits the evaluation information to the server, which stores it in a database.

[1390] The server sends a confirmation message of the completion of the evaluation to the terminal and displays it to the tourist.

[1391] Use of emotion engine

[1392] 1. User Emotion Recognition:

[1393] The terminal analyzes the user's input information and feedback and recognizes the user's emotions through an emotion engine.

[1394] The server stores the emotion recognition results in a database.

[1395] 2. Customized Experience Proposals:

[1396] Based on the emotion recognition results, the server uses an AI algorithm to further customize and suggest the optimal experience for the user.

[1397] The server sends the customized experience list to the terminal and displays it to the user.

[1398] 3. Feedback sentiment rating:

[1399] The server analyzes the feedback received from tourists using an emotion engine and rates them based on positive or negative emotions.

[1400] The server stores the emotion evaluation results in a database and reflects them in the evaluation of the experience provider.

[1401] 4. Experience Provider Management:

[1402] The server excludes experience providers with low emotional ratings from the system.

[1403] The server periodically checks the evaluation database and manages inappropriate experience providers.

[1404] Specific examples

[1405] 1. Example of user registration:

[1406] A user accesses the platform and enters information as "Yamada Taro."

[1407] The device sends this information to the server, which stores it in a database.

[1408] The server sends a registration completion message to the terminal and displays it on Yamada Taro's screen.

[1409] 2. Example of experience registration:

[1410] The experience provider enters details of the "Tea Ceremony Class."

[1411] The device sends this information to the server, which stores it in a database.

[1412] The server sends a registration completion message to the terminal and displays it on the screen.

[1413] 3. Examples of experience search and suggestions:

[1414] A tourist enters "handmade experience" and "May 25th" as search criteria.

[1415] The device sends these search criteria to the server, which then uses AI to extract the most suitable experiences and generate a list.

[1416] The server sends the list of experiences to the terminal and displays it to the tourist.

[1417] 4. Examples of booking and payment:

[1418] Tourists select "Tea Ceremony Class" from the list of experiences and enter their reservation information.

[1419] The terminal transmits the reservation information to the server, which stores it in a database.

[1420] The tourist enters payment information and the terminal transmits this information to the server.

[1421] The server processes the payment and sends a completion message to the terminal.

[1422] 5. Examples of evaluation and feedback:

[1423] After the experience, tourists rate it five stars and comment, "Very satisfied."

[1424] The device sends this information to the server, which stores it in a database.

[1425] The server sends an evaluation completion message to the terminal and displays it to the tourist.

[1426] 6. Examples of Emotion Engines:

[1427] When tourists book an experience, they express their "expectations" and the device recognizes this emotion and transmits it to the server.

[1428] The server takes emotions into account to suggest a more positive experience.

[1429] After the experience, tourists enter feedback such as "It was fun," and the emotion engine analyzes it as a positive evaluation and stores it in the database.

[1430] This allows tourists to enjoy a more personalized experience, and experience providers can receive appropriate feedback and improve the quality of their services. In addition, by managing the system based on negative reviews, the quality of the overall experience can be maintained.

[1431] The processing flow will be explained below.

[1432] User Registration

[1433] Step 1:

[1434] Users visit the platform's registration page and enter their name, email address, and password.

[1435] Step 2:

[1436] The terminal sends the entered information to the server as an HTTP POST request.

[1437] Step 3:

[1438] The server stores the received information in a database.

[1439] Step 4:

[1440] The server confirms that the save was successful.

[1441] Step 5:

[1442] The server generates a registration completion confirmation message and sends it to the terminal.

[1443] Step 6:

[1444] The terminal will display a confirmation message to inform the user that registration is complete.

[1445] Register your experience

[1446] Step 1:

[1447] The experience provider (user or corporation) accesses the registration page for the experience and enters detailed information (e.g., tea ceremony class, Japanese cooking class, etc.).

[1448] Step 2:

[1449] The terminal sends the entered information to the server as an HTTP POST request.

[1450] Step 3:

[1451] The server stores the received information in a database.

[1452] Step 4:

[1453] The server confirms that the save was successful.

[1454] Step 5:

[1455] The server generates a registration completion confirmation message and sends it to the terminal.

[1456] Step 6:

[1457] The device will display a confirmation message to inform the experience provider that registration is complete.

[1458] Experience search and suggestions

[1459] Step 1:

[1460] Tourists (users) access the platform's search page and enter the type of experience they are interested in and the dates they wish to visit.

[1461] Step 2:

[1462] The terminal sends the entered search criteria to the server as an HTTP GET request.

[1463] Step 3:

[1464] The server uses an AI algorithm to match the experience information in the database based on the received search criteria.

[1465] Step 4:

[1466] The server generates a list of experiences that match the search criteria.

[1467] Step 5:

[1468] The server transmits the experience list to the terminal.

[1469] Step 6:

[1470] The terminal displays to the tourist a list of experiences generated as search results.

[1471] Reservation and payment

[1472] Step 1:

[1473] Tourists (users) select the experience they want from the list of experiences and enter the number of participants and any special notes.

[1474] Step 2:

[1475] The terminal sends the entered reservation information to the server as an HTTP POST request.

[1476] Step 3:

[1477] The server stores the received reservation information in a database.

[1478] Step 4:

[1479] The server confirms that the save was successful.

[1480] Step 5:

[1481] The server generates a reservation confirmation message and sends it to the terminal.

[1482] Step 6:

[1483] The terminal displays a booking confirmation message to the tourist.

[1484] Step 7:

[1485] Tourists enter their payment information (such as credit card information).

[1486] Step 8:

[1487] The terminal sends the payment information to the server as an HTTP POST request.

[1488] Step 9:

[1489] The server transmits the received payment information to the payment system and requests payment processing.

[1490] Step 10:

[1491] The server receives the payment transaction results and stores them in a database.

[1492] Step 11:

[1493] The server generates a confirmation message for the payment completion and sends it to the terminal.

[1494] Step 12:

[1495] The terminal will display a payment completion message to the tourist.

[1496] Ratings and Feedback

[1497] Step 1:

[1498] After completing the experience, tourists (users) access the platform's rating page and enter their rating (star rating) and feedback (comments) about the experience.

[1499] Step 2:

[1500] The device sends the entered rating and feedback to the server as an HTTP POST request.

[1501] Step 3:

[1502] The server stores the received ratings and feedback in a database.

[1503] Step 4:

[1504] The server confirms that the save was successful.

[1505] Step 5:

[1506] The server generates a confirmation message of the completion of the evaluation and sends it to the terminal.

[1507] Step 6:

[1508] The terminal displays an evaluation completion message to the tourist.

[1509] Use of emotion engine

[1510] Step 1:

[1511] When tourists (users) search for or book experiences, they input their current emotions (e.g., anticipation, excitement, anxiety, etc.) using an emotion recognition interface.

[1512] Step 2:

[1513] The device sends the input emotion information to the server as an HTTP POST request.

[1514] Step 3:

[1515] The server analyzes the received emotion information using an emotion engine and generates emotion data.

[1516] Step 4:

[1517] The server stores the emotion data in a database and associates it with user information.

[1518] Step 5:

[1519] Based on the emotional data, the server uses an AI algorithm to further customize the list of experiences it suggests.

[1520] Step 6:

[1521] The server sends the customized experience list to the terminal.

[1522] Step 7:

[1523] The terminal displays a customized list of experiences for tourists.

[1524] Step 8:

[1525] After the experience, tourists enter their ratings and feedback, which are analyzed by the emotion engine to generate emotion evaluation data.

[1526] Step 9:

[1527] The server stores the received emotion evaluation data in a database.

[1528] Step 10:

[1529] The server publishes positive or negative feedback to the experience provider based on the emotional evaluation.

[1530] Step 11:

[1531] The server will remove from the system any experience provider whose negative ratings exceed a certain threshold.

[1532] Step 12:

[1533] The server periodically checks the evaluation database and manages inappropriate experience providers.

[1534] The above is a specific processing flow that combines the emotion engine of the present invention. This realizes a system that provides tourists with a more personalized experience and also contributes to improving the services of experience providers.

[1535] Example 2

[1536] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1537] In the modern tourism industry, tourists have difficulty finding local experiences that fit their interests and schedules. Experience providers also lack effective ways to promote their skills and expertise and stimulate demand. Furthermore, there is a lack of systems to ensure the quality of experiences and improve user satisfaction. To solve this problem and provide tourists with personalized experiences, a system that recognizes user emotions and makes experience suggestions based on those emotions is needed.

[1538] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for storing user information in a database, a means for inputting search criteria for local experiences based on the user's interests and schedule, and a means for proposing experiences that match the search criteria using a generative AI model. This allows tourists to easily find the best experience based on their interests. The server also includes a means for accepting reservations for the selected experience and processing payments, a means for inputting ratings and feedback after the experience and storing them in the database, a means for recognizing the user's emotions via an emotion engine, a means for customizing experience suggestions based on the emotion recognition results, a means for analyzing the ratings and feedback using the emotion engine and storing the rating results in the database, and a means for excluding experience providers with low emotion ratings from the system. This allows tourists to enjoy more personalized, high-quality experiences, and allows experience providers to improve their services by receiving appropriate feedback. It also maintains the overall quality of the experience and improves user satisfaction.

[1539] A "database" is a system for efficiently managing, storing, searching, and updating large amounts of data.

[1540] "User information" refers to a collection of basic data such as a user's name, email address, and password, as well as data related to valid operations and records.

[1541] "Local experiences" are activities and services that allow tourists to experience the culture, skills, and specialties unique to a region.

[1542] "Search criteria" refers to information that serves as the basis for a search, which is performed by specifying the experience the user is interested in, the desired date and time, and so on.

[1543] A "generative AI model" is an artificial intelligence algorithm used to make predictions and suggestions based on user input data.

[1544] A "suggestion" is when a generative AI model finds the best experience based on the user's search criteria and recommends it to the user.

[1545] A "reservation" is a process by which a user reserves a selected experience for a specific date and time.

[1546] "Payment Processing" means the process of managing the fees for a selected Experience through a payment system.

[1547] "Evaluation" refers to the act of a user providing feedback on the content and quality of an experience after it has ended, such as in the form of a star rating.

[1548] "Feedback" refers to comments, opinions, and evaluation information provided by users after completing an experience.

[1549] An "emotion engine" is a technology that analyzes user input information and feedback to recognize the user's emotional state.

[1550] "Emotion recognition" is the process of using an emotion engine to identify emotions from user input and feedback.

[1551] "Customization" refers to the act of individually adjusting experience suggestions based on the user's emotion recognition results to make them more appropriate.

[1552] "Emotion evaluation" is an evaluation by the emotion engine to determine positive or negative emotions based on user feedback.

[1553] "Experience provider" refers to an individual or organization that offers local experiences to tourists.

[1554] "Exclusion" refers to the act of excluding experience providers with low emotional ratings from the platform.

[1555] The present invention relates to a local experience sharing platform for effectively matching tourists and local residents to provide more personalized experiences. Embodiments of the present invention are described below.

[1556] User Registration

[1557] 1. A user enters basic information such as name, email address, and password on the registration screen of a web application. The information is temporarily stored on the device. The device then sends the information to the server as an HTTP POST request.

[1558] 2. The server receives this information and performs validation. If validation is successful, the server stores the user information in a database (e.g. MySQL, PostgreSQL).

[1559] 3. The server generates a registration completion message and sends it to the terminal as an HTTP response, and the terminal displays this message on its screen.

[1560] Register your experience

[1561] 1. The experience provider enters detailed information about the experience (e.g., the date, time, location, and participation fee of the tea ceremony class) on the experience registration screen. The entered information is temporarily saved on the device.

[1562] 2. When the provider presses the registration button, the terminal sends the entered information to the server as an HTTP POST request.

[1563] 3. The server receives this information and performs content validation. If validation is successful, the server stores the experience information in a database.

[1564] 4. The server generates a registration completion message and sends it to the terminal as an HTTP response, and the terminal displays this message on its screen.

[1565] Experience search and suggestions

[1566] 1. Tourists enter the type of experience they are interested in and the dates they wish to visit on the experience search screen. The information entered is temporarily saved on the device.

[1567] 2. When the terminal presses the search button, it sends the entered search criteria to the server as an HTTP GET request.

[1568] 3. The server receives the request, accesses the database, and uses a generative AI model to extract the best list of experiences.

[1569] 4. The server generates a list of the extracted results and sends it to the terminal as an HTTP response. The terminal displays this list on its screen.

[1570] Reservation and payment

[1571] 1. Tourists select the experience they want from the list of experiences and enter reservation information (e.g., number of people, date and time). The entered information is temporarily saved on the device.

[1572] 2. When the reservation button is pressed on the terminal, the entered reservation information is sent to the server as an HTTP POST request.

[1573] 3. The server receives the request, validates the reservation information, and if successful, saves the reservation information in the database.

[1574] 4. The tourist proceeds to the payment screen and enters their payment information (e.g., credit card information), which is temporarily stored on the device.

[1575] 5. When the payment button is pressed, the terminal sends the entered payment information as an HTTP POST request to the server, and the server processes the payment via a payment system (e.g., Stripe, PayPal).

[1576] 6. After confirming the payment, the server generates a reservation completion message and sends it to the terminal as an HTTP response. The terminal displays this message on its screen.

[1577] Ratings and Feedback

[1578] 1. After the experience is over, tourists enter their rating (star rating) and feedback (comments). The entered information is temporarily saved on the device.

[1579] 2. When the device presses the send button, the rating and feedback information is sent to the server as an HTTP POST request.

[1580] 3. The server receives the request and stores the information in a database.

[1581] 4. The server generates an evaluation completion message and sends it to the terminal as an HTTP response. The terminal displays this message on its screen.

[1582] Use of emotion engine

[1583] 1. The device analyzes the user's input information and feedback and recognizes the user's emotions through an emotion engine (e.g., NLP model). The recognized emotion data is sent from the device to the server.

[1584] 2. The server stores the emotion recognition results in a database.

[1585] 3. The server uses a generative AI model based on the emotion recognition results to further customize and propose the most suitable experience for the user. The customized experience list is sent from the server to the device, which then displays it on the screen.

[1586] 4. The server analyzes the feedback received from tourists using an emotion engine and rates them based on positive or negative emotions. The results are stored in a database and reflected in the experience provider's ratings.

[1587] 5. The server removes experience providers with low emotional ratings from the system and periodically checks the rating database to manage inappropriate experience providers.

[1588] Specific examples

[1589] 1. Example of user registration:

[1590] A user accesses the platform and enters "Yamada Taro" as their name, email address, and password.

[1591] The device sends this information to the server, which stores it in a database.

[1592] The server sends a registration completion message to the terminal, which is displayed on Yamada Taro's screen.

[1593] 2. Example of experience registration:

[1594] The experience provider enters details of the "Tea Ceremony Class."

[1595] The device sends this information to the server, which stores it in a database.

[1596] The server sends a registration completion message to the terminal and displays it on the screen.

[1597] 3. Examples of experience search and suggestions:

[1598] A tourist enters "handmade experience" and "May 25th" as search criteria.

[1599] The device sends these search criteria to the server, which then uses a generative AI model to extract the most suitable experiences and generate a list.

[1600] The server sends the experience list to the terminal and displays it to the tourist.

[1601] 4. Examples of booking and payment:

[1602] Tourists select "Tea Ceremony Class" from the list of experiences and enter their reservation information.

[1603] The terminal sends the reservation information to the server, which stores it in a database.

[1604] The tourist enters payment information and the terminal transmits this information to the server.

[1605] After the server completes the payment process, it sends a completion message to the terminal.

[1606] 5. Examples of evaluation and feedback:

[1607] After the experience, tourists rate it five stars and comment, "Very satisfied."

[1608] The device sends this information to the server, which stores it in a database.

[1609] The server sends an evaluation completion message to the terminal and displays it to the tourist.

[1610] 6. Examples of Emotion Engines:

[1611] When tourists book an experience, they express their "expectations" and the device recognizes this emotion and transmits it to the server.

[1612] The server takes emotions into account to suggest a more positive experience.

[1613] After the experience, tourists enter feedback such as "It was fun," and the emotion engine analyzes it as a positive evaluation and stores it in the database.

[1614] This allows tourists to enjoy a more personalized experience, and experience providers can receive appropriate feedback and improve the quality of their services. In addition, by managing the system based on negative reviews, the quality of the overall experience can be maintained.

[1615] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1616] Step 1: Enter your user information

[1617] The user enters basic information such as name, email address, and password on the registration screen of the web application.

[1618] Input: Name, Email Address, Password

[1619] The terminal temporarily stores the entered information.

[1620] Output: Temporarily saved user information

[1621] Step 2: Submit your information

[1622] When the user presses the registration button, the terminal sends the entered information to the server as an HTTP POST request.

[1623] Input: Temporarily saved user information

[1624] Output: HTTP POST request

[1625] Step 3: Storing and validating information

[1626] The server receives the request and performs validations such as name, email format, and password strength.

[1627] Input: HTTP POST request

[1628] Data processing: Validation (format check, strength check)

[1629] If validation is successful, the server saves the user information in the database.

[1630] Output: User information stored in the database

[1631] Step 4: Notification of registration completion

[1632] The server generates a registration completion message and sends it to the terminal as an HTTP response.

[1633] Input: User information stored in the database

[1634] Output: Registration complete message

[1635] The terminal displays the received registration completion message on the screen to notify the user that registration has been completed.

[1636] Output: Registration complete message displayed

[1637] Step 5: Enter your experience details

[1638] The experience provider enters detailed information about the experience (e.g., the date, time, location, and participation fee of the tea ceremony class) on the experience content registration screen.

[1639] Input: Experience details

[1640] The device temporarily stores the information you enter.

[1641] Output: Temporarily saved experience information

[1642] Step 6: Submit your experience

[1643] When the provider presses the registration button, the terminal sends the entered information to the server as an HTTP POST request.

[1644] Input: Temporarily saved experience information

[1645] Output: HTTP POST request

[1646] Step 7: Storing and validating experience information

[1647] The server receives the request and validates the experience information (e.g., checking for duplicate dates and times, validity of participation fees).

[1648] Input: HTTP POST request

[1649] Data processing: Validation (duplicate check, validity check)

[1650] If the validation is successful, the server stores the experience information in a database.

[1651] Output: Experience information stored in a database

[1652] Step 8: Notification of completion of experience registration

[1653] The server generates a registration completion message and sends it to the terminal as an HTTP response.

[1654] Input: Experience information stored in the database

[1655] Output: Registration complete message

[1656] The terminal displays the received registration completion message on the screen and notifies the experience provider that registration is complete.

[1657] Output: Registration complete message displayed

[1658] Step 9: Enter search criteria

[1659] Tourists enter the type of experience they are interested in and the dates they wish to visit on the experience search screen.

[1660] Input: Experience genre, desired date

[1661] The device temporarily stores the information you enter.

[1662] Output: Saved search criteria

[1663] Step 10: Submitting search criteria

[1664] When the terminal presses the search button, the entered search criteria is sent to the server as an HTTP GET request.

[1665] Input: Saved search criteria

[1666] Output: HTTP GET request

[1667] Step 11: Search and suggest

[1668] The server receives the request, accesses a database, and uses a generative AI model to generate a list of optimal experiences.

[1669] Input: HTTP GET request

[1670] Data computation: Generative AI models extract a list of experiences based on search criteria

[1671] The server generates the experience list in list form.

[1672] Output: Experience list

[1673] Step 12: Submit your proposal list

[1674] The server sends the experience list to the terminal as an HTTP response.

[1675] Input: Experience list

[1676] Output: HTTP response

[1677] The device displays the received list on the screen and makes suggestions to tourists.

[1678] Output: Display the list of suggestions

[1679] Step 13: Enter reservation information

[1680] Tourists select the experience they want from the list of experiences and enter reservation information (e.g., number of people, date and time).

[1681] Input: Reservation information

[1682] The device temporarily stores the information you enter.

[1683] Output: Temporarily saved reservation information

[1684] Step 14: Submit reservation information

[1685] When the reservation button is pressed, the terminal sends the entered reservation information to the server as an HTTP POST request.

[1686] Input: Temporarily saved reservation information

[1687] Output: HTTP POST request

[1688] Step 15: Storing and validating reservation information

[1689] The server receives the request and performs validation of the reservation information (e.g. checks for overbooking).

[1690] Input: HTTP POST request

[1691] Data processing: Validation (capacity check)

[1692] If the validation is successful, the server saves the reservation information in the database.

[1693] Output: Reservation information stored in the database

[1694] Step 16: Enter your payment information

[1695] Tourists enter their payment information (e.g., credit card information) on the payment screen.

[1696] Input: Payment Information

[1697] The device temporarily stores the information you enter.

[1698] Output: Temporarily saved payment information

[1699] Step 17: Submit payment information

[1700] When the payment button is pressed, the terminal sends the entered payment information to the server as an HTTP POST request.

[1701] Enter: Saved payment information

[1702] Output: HTTP POST request

[1703] Step 18: Payment Processing

[1704] The server receives the request and processes the payment via a payment system (e.g., Stripe, PayPal).

[1705] Input: HTTP POST request

[1706] Data processing: processing payments through payment systems

[1707] After confirming the payment, the server generates a reservation completion message.

[1708] Output: Payment confirmation and reservation completion message

[1709] Step 19: Reservation completion notification

[1710] The server sends a completion message to the terminal as an HTTP response.

[1711] Input: Payment confirmation and reservation completion message

[1712] Output: HTTP response

[1713] The terminal displays the received completion message on the screen to inform the tourist that the reservation has been completed.

[1714] Output: Display a reservation completion message

[1715] Step 20: Post-Experience Rating and Feedback

[1716] After the experience is over, tourists enter a rating (star rating) and feedback (comments).

[1717] Input: Ratings and Feedback

[1718] The device temporarily stores the information you enter.

[1719] Output: Temporarily saved ratings and feedback

[1720] Step 21: Rate and provide feedback

[1721] When the device presses the send button, it sends the rating and feedback information to the server as an HTTP POST request.

[1722] Input: Saved ratings and feedback

[1723] Output: HTTP POST request

[1724] Step 22: Save your ratings and feedback

[1725] The server receives the request and stores the ratings and feedback information in a database.

[1726] Input: HTTP POST request

[1727] Output: Ratings and feedback stored in a database

[1728] Step 23: Notification of evaluation completion

[1729] The server generates an evaluation completion message and sends it to the terminal as an HTTP response.

[1730] Input: Ratings and feedback stored in the database

[1731] Output: HTTP response

[1732] The terminal displays the received completion message on the screen to inform the tourist that the evaluation is complete.

[1733] Output: Evaluation complete message displayed

[1734] Step 24: Emotion Recognition with the Emotion Engine

[1735] The device analyzes the user's input information and feedback and recognizes the user's emotions through an emotion engine (e.g., NLP model).

[1736] Input: Ratings and Feedback

[1737] Data Computation: Emotion Recognition with Emotion Engine

[1738] The emotion recognition results are sent to the server.

[1739] Output: Emotion recognition result

[1740] Step 25: Storing Emotion Data

[1741] The server stores the emotion recognition results in a database.

[1742] Input: Emotion recognition results

[1743] Output: Emotion recognition results stored in a database

[1744] Step 26: Customize experience recommendations based on emotions

[1745] Based on the emotion recognition results, the server uses a generative AI model to customize and propose the optimal experience for the user.

[1746] Input: Emotion recognition results

[1747] Data Computation: Emotion-Based Customization of Experience Proposals

[1748] The server generates a customized list of experiences.

[1749] Output: A customized list of experiences

[1750] Step 27: Submit your customized list

[1751] The server sends the customized experience list to the device as an HTTP response.

[1752] Input: Customized Experience List

[1753] Output: HTTP response

[1754] The terminal displays the received list on the screen and provides it to the user.

[1755] Output: Display of customized experience list

[1756] Step 28: Sentiment Analysis of Feedback

[1757] The server analyzes the feedback received from tourists using an emotion engine and rates them based on positive or negative emotions.

[1758] Input: Feedback

[1759] Data Computation: Emotion Analysis with Emotion Engine

[1760] The evaluation results are stored in a database.

[1761] Output: Emotion evaluation results stored in a database

[1762] Step 29: Control and exclude experience providers

[1763] The server excludes experience providers with low emotional ratings from the system.

[1764] Input: Emotion evaluation result

[1765] Data processing: Experience provider evaluation check

[1766] The server periodically checks the evaluation database and manages inappropriate experience providers.

[1767] Output: Updated donor list

[1768] (Application example 2)

[1769] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1770] There is a demand for local experience sharing platforms to provide tourists with more personalized experiences, but current systems do not take user emotions into consideration, resulting in a uniform quality of experience and variations in satisfaction. Furthermore, it is difficult to provide experiences that are close to reality even in virtual spaces, which can lead to a decrease in user satisfaction. To solve these issues, it is necessary to recognize user emotions in real time and utilize this information to propose and customize experiences.

[1771] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1772] In this invention, the server includes means for storing user information in a database, means for inputting search criteria for local experiences based on the user's interests and schedule, means for using artificial intelligence to suggest experiences that match the search criteria, means for accepting reservations for the selected experiences and processing payments, means for guiding the provision of experiences and products in the virtual space, means for recognizing the user's emotions using a camera and microphone and customizing the suggestions, and means for inputting evaluations and feedback after the experience and storing them in the database. This allows tourists to enjoy a more personalized experience, and experience providers can receive appropriate feedback and improve the quality of their services.

[1773] A "database" is a system for storing information in an organized manner and for easily retrieving and managing it.

[1774] "User Information" refers to data related to individual users, such as basic information, personal preferences, and history.

[1775] "Search criteria" are the criteria or requirements that users set to efficiently find the experiences or products they desire.

[1776] "Artificial intelligence" is a technology that mimics human intelligence and automates tasks such as data analysis, predictions, and suggestions.

[1777] An "experience" is a service or activity offered to a user that may include cultural, educational, or recreational content.

[1778] A "reservation" is the process of reserving an experience or service in advance for use at a specific time.

[1779] "Payment" refers to the act of a user paying for an experience or service provided.

[1780] "Virtual space" is a virtual environment or world created using computer technology.

[1781] A "guide" is a person or system whose role is to provide information and instructions to users.

[1782] A "camera" is a device that takes still images and videos and is used to recognize the user's facial expressions and movements.

[1783] A "microphone" is a device for picking up sound and is used to recognize the user's tone of voice and words.

[1784] "Emotion" is a subjective state of feeling or sensation experienced by a user.

[1785] "Customization" means tailoring content to the needs and preferences of individual users.

[1786] A "rating" is the act of expressing opinions or impressions about the quality of an experience or service provided.

[1787] "Feedback" refers to the communication of users' opinions and thoughts about the experience or service provided.

[1788] A "generative AI model" is a form of artificial intelligence that uses algorithms that have been trained with large amounts of data in advance and designed to perform specific tasks.

[1789] In this invention, the following hardware and software are used to realize a virtual experience guide system that provides tourists with a more personalized experience.

[1790] Hardware used

[1791] Smartphone: Uses camera, microphone, and GPS functions.

[1792] Head-mounted displays (HMDs) or smart glasses: Used to provide experiences within virtual spaces.

[1793] Software used

[1794] Cloud-based servers (e.g., AWS) for storing and processing data.

[1795] Emotion recognition engine (e.g., Microsoft Azure Emotion API): Recognizes and analyzes user emotions in real time.

[1796] AI algorithms (machine learning models) to suggest and customize experiences.

[1797] Database (MySQL, etc.): Stores user information, experience information, and feedback.

[1798] What the program does

[1799] 1. User Registration

[1800] The server stores the user's basic information (name, email address, password) received from the smartphone in a database. It then sends a confirmation message to the user and displays it on the smartphone.

[1801] 2. Register your experience

[1802] The experience provider enters details of the experience they are offering using their smartphone and sends them to the server, which stores the information in a database and sends a confirmation message to the experience provider's smartphone.

[1803] 3. Start the virtual tour

[1804] Tourists launch the app and begin their virtual guided tour. The app uses the smartphone's camera and microphone to analyze facial expressions and tone of voice in real time, and an emotion recognition engine is used to identify emotions.

[1805] 4. Emotion-based recommendations

[1806] The server proposes optimal virtual experiences and products based on emotion recognition results and past data. The proposals are sent to the smartphone or HMD and displayed to the user. The emotion recognition data and proposal history are stored in a database.

[1807] 5. Post-experience feedback

[1808] After the experience, tourists enter star ratings and comments. This information is sent to the server via smartphone and stored in a database. The emotion engine analyzes the emotional state of the feedback and generates feedback data to improve the quality of services.

[1809] 6. Reputation Management

[1810] The server periodically checks the rating database and manages low-rated experience providers, excluding inappropriate experience providers from the system.

[1811] Specific examples

[1812] As an example of a tourist, Taro Yamada books a "Virtual Tea Ceremony Experience" and uses a facial recognition camera to indicate his "expectations." The app then suggests a "Japanese Cooking Class" in addition to the "Tea Ceremony Experience." After the experience, Yamada leaves a comment saying he's "very satisfied," which the emotion engine interprets as a positive evaluation.

[1813] Example of input prompt for generative AI model

[1814] User Taro Yamada has booked a "Virtual Tea Ceremony Experience." Judging from his facial expression, he seems "expected." Suggest the best additional experiences and customize your next suggestions based on his post-experience feedback.

[1815] Examples of registered experiences: Tea ceremony class, Japanese cooking class, Origami class

[1816] Using this system, tourists can enjoy rich local experiences in a more enjoyable and satisfying way, even in a virtual space, and experience providers can receive appropriate feedback and improve the quality of their services.

[1817] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1818] Step 1:

[1819] User registration step: The user uses their smartphone to enter basic information such as their name, email address, and password. The device sends this information to the server, which then stores it in a database. The input is the user's basic information, and the output is the result of saving it to the database and a message that registration is complete.

[1820] Step 2:

[1821] Experience content registration step: The experience provider enters detailed information about the experience they are offering from their smartphone. The device sends this information to the server, which then stores it in a database. The input is the experience content information, and the output is the result of saving it to the database and a message indicating registration is complete.

[1822] Step 3:

[1823] User emotion recognition and virtual guide start step The user starts the virtual guide using a smartphone or head-mounted display (HMD). The camera and microphone capture the user's facial expressions and tone of voice in real time and send this to the emotion recognition engine. The input is real-time facial expression and tone of voice data, and the output is the emotion recognition results.

[1824] Step 4:

[1825] Emotion-based experience suggestion step: Based on the emotion recognition results, the server uses an AI algorithm to suggest the most suitable experiences and products to the user. The server saves the suggestions in a database, sends them to the device, and displays them to the user. The input is the emotion recognition results and past data, and the output is a list of optimal experience suggestions.

[1826] Step 5:

[1827] Experience booking and payment step The user selects the desired experience from the list of suggested experiences and makes a reservation. The terminal sends the reservation information to the server, which stores it in a database. The user then enters payment information, which the terminal sends to the server for payment processing. The input is reservation information and payment information, and the output is reservation confirmation and payment confirmation messages.

[1828] Step 6:

[1829] Post-experience evaluation and feedback step After completing the experience, the user inputs an evaluation (star rating) and feedback (comments). The terminal sends this information to the server, which stores it in a database. The input is the evaluation and feedback information, and the output is the result of saving to the database and a message that the evaluation is complete.

[1830] Step 7:

[1831] Sentiment analysis and management of rating data: The server analyzes the rating data and feedback data using an emotion recognition engine and customizes the next proposal based on positive or negative emotions. It also removes experience providers with low ratings from the database. The input is the rating and feedback data, and the output is the analysis results and system management results.

[1832] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1833] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1834] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1835] [Third embodiment]

[1836] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1837] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1838] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1839] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1840] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1841] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1842] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1843] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1844] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1845] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1846] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1847] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1848] The present invention relates to a local experience sharing platform that connects tourists and local residents, and specific embodiments thereof are described below.

[1849] User Registration

[1850] 1. User Registration:

[1851] A user registers by entering their name, email address, and password.

[1852] The terminal sends this information to the server, which stores it in a database.

[1853] The server returns registration confirmation information to the terminal and displays a registration completion message on the user's screen.

[1854] Register your experience

[1855] 1. Enter your experience provider information:

[1856] The experience provider (user or corporation) enters details of the experience they wish to offer (e.g., tea ceremony class, Japanese cooking class, etc.).

[1857] The terminal sends this information to the server, which stores it in a database.

[1858] The server returns registration confirmation information to the terminal and displays a trial registration completion message on the screen.

[1859] Experience search and suggestions

[1860] 1. Tourist search:

[1861] Tourists (users) input the desired experience genre and dates.

[1862] The terminal transmits the search conditions to the server.

[1863] The server uses AI algorithms to extract experiences from a database that match the search criteria.

[1864] The server returns the extracted results to the terminal and displays a list of experiences suitable for the tourist.

[1865] Reservation and payment

[1866] 1. Select and book your experience:

[1867] Tourists select the experience they want from a list and enter their booking information.

[1868] The terminal transmits the reservation information to the server, which stores it in a database.

[1869] The server returns a reservation confirmation message to the terminal and displays a reservation completion message on the screen.

[1870] 2. Payment Processing:

[1871] Tourists enter their payment information.

[1872] The terminal transmits this information to the server, which then processes the payment via the payment system.

[1873] The server returns confirmation of payment completion to the terminal and displays a payment completion message on the screen.

[1874] Ratings and Feedback

[1875] 1. Post-experience evaluation:

[1876] Tourists can enter their ratings and feedback after completing the experience.

[1877] The terminal sends this information to the server, which stores it in a database.

[1878] The server returns the evaluation and feedback confirmation information to the terminal and displays an evaluation completion message on the screen.

[1879] Specific examples

[1880] 1. Example of user registration:

[1881] The user accesses the platform and enters information as "Taro" on the registration page.

[1882] The terminal sends this information to the server, which stores the information in a database.

[1883] The server sends a message to the terminal indicating that registration is complete, and displays it on "Taro's" screen.

[1884] 2. Example of experience registration:

[1885] Experience providers enter details of the "Japanese cooking class."

[1886] The terminal sends this information to the server, which stores it in a database.

[1887] The server sends a message to the terminal indicating that registration is complete, and displays it on the screen.

[1888] 3. Examples of experience search and suggestions:

[1889] Tourists search by entering "handmade experience" and "April 10th."

[1890] The device sends these search criteria to the server, which then uses AI to extract the optimal experience.

[1891] The server sends the list of experiences to the terminal and displays it to the tourist.

[1892] 4. Examples of booking and payment:

[1893] Tourists select "Japanese cooking class" from the list of experiences and enter their reservation information.

[1894] The terminal transmits the reservation information to the server, which stores it in a database.

[1895] The tourist enters payment information and the terminal transmits this information to the server.

[1896] The server processes the payment and returns a completion message to the terminal.

[1897] 5. Examples of evaluation and feedback:

[1898] After completing the experience, tourists can rate it five stars and comment that it was fun.

[1899] The terminal sends this information to the server, which stores it in a database.

[1900] The server returns a message indicating that the evaluation is complete to the terminal and displays it on the screen.

[1901] This allows tourists to seamlessly discover, book, and participate in experiences that are perfect for them, allows experience providers to earn income by leveraging their skills and expertise, and improves the overall quality of the experience through ratings and feedback.

[1902] The processing flow will be explained below.

[1903] User Registration

[1904] Step 1:

[1905] The user accesses the platform's registration page and enters the required information (name, email address, password).

[1906] Step 2:

[1907] The terminal sends the entered information to the server as an HTTP POST request.

[1908] Step 3:

[1909] The server stores the received information in a database.

[1910] Step 4:

[1911] The server confirms that the save was successful.

[1912] Step 5:

[1913] The server generates a registration completion confirmation message and sends it to the terminal.

[1914] Step 6:

[1915] The terminal will display a confirmation message to inform the user that registration is complete.

[1916] Register your experience

[1917] Step 1:

[1918] The experience provider (user or corporation) accesses the experience registration page and enters detailed information (title, description, date and time, price).

[1919] Step 2:

[1920] The terminal sends the entered information to the server as an HTTP POST request.

[1921] Step 3:

[1922] The server stores the received information in a database.

[1923] Step 4:

[1924] The server confirms that the save was successful.

[1925] Step 5:

[1926] The server generates a registration completion confirmation message and sends it to the terminal.

[1927] Step 6:

[1928] The device will display a confirmation message to inform the experience provider that registration is complete.

[1929] Experience search and suggestions

[1930] Step 1:

[1931] Tourists (users) access the platform's search page and enter the type of experience they are interested in and the dates they wish to visit.

[1932] Step 2:

[1933] The terminal sends the entered search criteria to the server as an HTTP GET request.

[1934] Step 3:

[1935] The server uses an AI algorithm to match the experience information in the database based on the received search criteria.

[1936] Step 4:

[1937] The server generates a list of experiences that match the search criteria.

[1938] Step 5:

[1939] The server transmits the experience list to the terminal.

[1940] Step 6:

[1941] The terminal displays to the tourist a list of experiences generated as search results.

[1942] Reservation and payment

[1943] Step 1:

[1944] Tourists (users) select the experience they want from the list of experiences and enter the number of participants and any special notes.

[1945] Step 2:

[1946] The terminal sends the entered reservation information to the server as an HTTP POST request.

[1947] Step 3:

[1948] The server stores the received reservation information in a database.

[1949] Step 4:

[1950] The server confirms that the save was successful.

[1951] Step 5:

[1952] The server generates a reservation confirmation message and sends it to the terminal.

[1953] Step 6:

[1954] The terminal displays a booking confirmation message to the tourist.

[1955] Step 7:

[1956] Tourists enter their payment information (such as credit card information).

[1957] Step 8:

[1958] The terminal sends the payment information to the server as an HTTP POST request.

[1959] Step 9:

[1960] The server transmits the received payment information to the payment system and requests payment processing.

[1961] Step 10:

[1962] The server receives the payment transaction results and stores them in a database.

[1963] Step 11:

[1964] The server generates a confirmation message for the payment completion and sends it to the terminal.

[1965] Step 12:

[1966] The terminal will display a payment completion message to the tourist.

[1967] Ratings and Feedback

[1968] Step 1:

[1969] After completing the experience, tourists (users) access the platform's rating page and enter their rating (star rating) and feedback (comments) about the experience.

[1970] Step 2:

[1971] The device sends the entered rating and feedback to the server as an HTTP POST request.

[1972] Step 3:

[1973] The server stores the received ratings and feedback in a database.

[1974] Step 4:

[1975] The server confirms that the save was successful.

[1976] Step 5:

[1977] The server generates a confirmation message of the completion of the evaluation and sends it to the terminal.

[1978] Step 6:

[1979] The terminal displays an evaluation completion message to the tourist.

[1980] The above is a specific processing flow of the system of the present invention, which realizes a platform that is beneficial to both tourists and experience providers.

[1981] Example 1

[1982] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1983] Conventional tourism platforms make it difficult for users to easily search, book, and pay for local experiences that match their interests. They also lack effective means to maintain the quality of experience providers and reflect user feedback. An effective system to solve these issues is needed.

[1984] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1985] In this invention, the server includes means for saving user information in a database, means for a user to register by entering their name, email address, and password, means for transmitting the entered information to the server and the server storing it in the database, means for inputting search criteria for local experiences based on the user's interests and schedule, means for the server to extract experiences that match the search criteria from the database using an AI algorithm, means for inputting reservation information for the selected experience, transmitting it to the server and storing it in the database, means for tourists to input payment information and for the server to process the payment via a payment system, and means for tourists to input ratings and feedback after the experience has ended and the server storing it in the database. This allows users to efficiently search for, book, and pay for local experiences, and also enables them to evaluate the quality of experience providers and improve the overall quality of the experience.

[1986] "User Information" refers to identifying information such as a user's name, email address, and password.

[1987] "Database" refers to a system for systematically storing and managing user information, experience information, reservation information, evaluation information, etc.

[1988] "Server" refers to a central processing unit that stores information sent by users in a database and provides users with the information they require.

[1989] "Terminal" refers to a device (e.g., PC, smartphone, etc.) through which a user inputs information and communicates with a server.

[1990] "New Registration" refers to the process when a User accesses the Platform for the first time and enters their information to create an account.

[1991] "Local experiences" refer to the provision of local culture and activities that are unique to the region, and in which tourists can participate directly through experience providers.

[1992] "AI algorithm" refers to a program that uses machine learning models and filtering algorithms to extract the optimal experience based on a user's search criteria.

[1993] "Reservation Information" refers to the information a User enters to reserve a particular Experience (e.g., experience date, number of participants, etc.).

[1994] "Payment System" refers to a system for processing online payments (e.g., Stripe, PayPal, etc.).

[1995] "Ratings and feedback" refers to information that a user enters after completing an experience, such as their thoughts and ratings about the experience.

[1996] "Experience Provider" refers to an individual or entity that provides a local experience.

[1997] "Tourist" refers to a traveler or individual user looking for a local experience.

[1998] The present invention relates to a local experience sharing platform that connects tourists and experience providers, and a specific embodiment thereof will be described. The platform is a system that stores user information in a database and allows users to search, book, pay for, and rate local experiences. This system consists of three main components: a server, a terminal, and a user.

[1999] 1. User Registration Implementation

[2000] User Registration:

[2001] The user accesses the platform's registration page using a device (e.g., a PC or smartphone) and enters their name, email address, and password.

[2002] The terminal transmits this information to the server.

[2003] The server uses a database management system such as MySQL or PostgreSQL to store the received information in a database.

[2004] The server generates a registration completion confirmation message and sends it to the terminal.

[2005] Examples:

[2006] The user accesses the platform and enters their name, email address, and password as "Taro" on the registration page.

[2007] The terminal sends this information to the server, which stores it in a database.

[2008] The server sends a message to the terminal indicating that registration is complete, and the terminal displays the message on "Taro's" screen.

[2009] 2. How to register your experience

[2010] Register your experience:

[2011] The experience provider (user or corporation) uses a terminal to input details of the experience they are offering.

[2012] The terminal sends this information to the server.

[2013] The server stores the received experience information in a database.

[2014] The server generates a confirmation message confirming the completion of the trial registration and sends it to the terminal.

[2015] Examples:

[2016] Experience providers enter details of the "Japanese cooking class."

[2017] The terminal sends this information to the server, which stores it in a database.

[2018] The server sends a registration completion message to the terminal, which displays it on the screen.

[2019] 3. Experience Search and Suggestion Implementation

[2020] Experience search and suggestions:

[2021] Tourists (users) use their terminals to input the desired experience genre and dates and perform a search.

[2022] The terminal transmits the input search conditions to the server.

[2023] The server uses a generative AI model to extract experiences that match the search criteria from a database, using Python machine learning models and collaborative filtering algorithms.

[2024] The server returns the extracted results in list form to the terminal, which displays them to the tourist.

[2025] Examples:

[2026] Tourists search by entering "handmade experience" and "April 10th."

[2027] The device sends these search criteria to a server, which uses AI to extract the optimal experience.

[2028] The server sends the list of experiences to the terminal, which displays it to the tourist.

[2029] 4. Booking and payment methods

[2030] Reservation and payment:

[2031] Tourists select the experience they want from a list and enter their booking information.

[2032] The terminal transmits the entered reservation information to the server.

[2033] The server stores the reservation information in a database.

[2034] The server generates a reservation confirmation message and sends it to the terminal.

[2035] The tourist enters payment information and the terminal transmits this information to the server.

[2036] The server processes the payment through a payment system (e.g., Stripe, PayPal, etc.).

[2037] The server generates a confirmation message for the payment completion and sends it to the terminal.

[2038] Examples:

[2039] Tourists select "Japanese cooking class" from the list of experiences and enter their reservation information.

[2040] The terminal transmits the reservation information to the server, which stores it in a database.

[2041] The tourist enters payment information and the terminal transmits this information to the server.

[2042] The server processes the payment and returns a completion message to the terminal.

[2043] 5. Evaluation and feedback methods

[2044] Rating and Feedback:

[2045] Tourists can enter their ratings and feedback after completing the experience.

[2046] The terminal transmits the input rating and feedback information to the server.

[2047] The server stores the received information in a database.

[2048] The server generates a confirmation message of the completion of the evaluation and sends it to the terminal.

[2049] Examples:

[2050] After completing the experience, tourists can rate it five stars and comment that it was fun.

[2051] The terminal sends this information to the server, which stores it in a database.

[2052] The server sends a message indicating that the evaluation is complete to the terminal, which displays the message on the screen.

[2053] These specific embodiments allow users to seamlessly find, book, pay for, and rate local experiences, while also enabling experience providers to earn income by leveraging their skills and expertise, improving the overall quality of the experience.

[2054] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2055] Step 1: The user enters their name, email address, and password.

[2056] The user visits the registration page and enters their name, email address, and password.

[2057] Input: Name, email address, and password entered by the user.

[2058] Output: User information temporarily stored on the device.

[2059] Step 2: The device sends the user information to the server

[2060] The terminal transmits the input user information to the server.

[2061] Input: Name, email address, and password entered by the user.

[2062] Output: User information arriving at the server.

[2063] Step 3: The server saves the user information to a database

[2064] The server stores the received user information in a database.

[2065] Input: User information received by the server.

[2066] Data processing: Validate user information and save it to the database if successful.

[2067] Output: User information stored in the database.

[2068] Step 4: The server generates a confirmation message for the registration and sends it to the device.

[2069] The server generates a registration completion confirmation message and sends it to the terminal.

[2070] Input: The registration process has been completed successfully.

[2071] Output: Registration completion message received on the device.

[2072] Step 5: Your device will display a registration complete message

[2073] The terminal displays the received confirmation message to inform the user that registration is complete.

[2074] Input: Registration completion message sent by the server.

[2075] Output: A confirmation message that will be displayed on the user's screen.

[2076] Step 6: Enter details about the experience the experience provider is offering

[2077] The experience provider uses the terminal to input details of the experience they are offering (e.g., experience name, details, dates, etc.).

[2078] Input: Experience information such as experience name, details, and dates.

[2079] Output: Experience information temporarily stored on the device.

[2080] Step 7: The device sends the experience information to the server

[2081] The terminal transmits the input experience information to the server.

[2082] Input: Experience information such as experience name, details, and dates.

[2083] Output: Experience information that arrives at the server.

[2084] Step 8: The server stores the experience information in a database

[2085] The server stores the received experience information in a database.

[2086] Input: Experience information received by the server.

[2087] Data processing: Validate the experience information and save it to the database if successful.

[2088] Output: Experience information stored in a database.

[2089] Step 9: The server generates a confirmation message for the completion of the trial registration and sends it to the device.

[2090] The server generates a confirmation message confirming the completion of the trial registration and sends it to the terminal.

[2091] Input: The trial registration process has been completed successfully.

[2092] Output: A message will be sent to your device confirming your registration.

[2093] Step 10: Your device will display a message that your trial registration is complete.

[2094] The device will display the received confirmation message and notify the experience provider that registration has been completed.

[2095] Input: Trial registration completion message sent from the server.

[2096] Output: A confirmation message that will be displayed to the experience provider.

[2097] Step 11: Enter the type of experience and dates that tourists want to use and search

[2098] Tourists use their devices to search by entering the type of experience and dates they want.

[2099] Input: Search criteria such as experience genre and date.

[2100] Output: Search criteria temporarily saved on your device.

[2101] Step 12: The device sends the search criteria to the server

[2102] The terminal transmits the input search conditions to the server.

[2103] Input: Search criteria such as experience genre and date.

[2104] Output: The search criteria that arrives at the server.

[2105] Step 13: The server uses an AI algorithm to extract experiences from the database that match the search criteria.

[2106] The server uses a generative AI model to extract experiences from a database that match the search criteria.

[2107] Input: The search criteria received by the server.

[2108] Data calculations: Using AI algorithms to extract experience information that matches search criteria (e.g., collaborative filtering).

[2109] Output: A list of extracted experience information.

[2110] Step 14: The server returns the extracted results to the terminal in list format.

[2111] The server returns the extraction results in list form to the terminal and displays them.

[2112] Input: A list of extracted experience information.

[2113] Output: A list of experience information delivered to the device.

[2114] Step 15: The device displays the search results to the tourist.

[2115] The terminal displays the received search results to the tourist.

[2116] Input: Experience information list sent from the server.

[2117] Output: A list of experience information displayed on the tourist's screen.

[2118] Step 16: Tourists select the experience they want and enter their booking information

[2119] Tourists select the experience they want from a list and enter their reservation information.

[2120] Input: Experience selection and booking information (e.g. number of participants, booking date).

[2121] Output: Reservation information temporarily stored on the device.

[2122] Step 17: The device sends the reservation information to the server

[2123] The terminal transmits the entered reservation information to the server.

[2124] Input: Booking information (e.g. number of participants, booking date).

[2125] Output: Reservation information received by the server.

[2126] Step 18: The server saves the reservation information to the database

[2127] The server stores the received reservation information in a database.

[2128] Input: Reservation information received by the server.

[2129] Data processing: Validate reservation information and save it to the database if successful.

[2130] Output: Reservation information stored in a database.

[2131] Step 19: The server generates a reservation confirmation message and sends it to the terminal.

[2132] The server generates a reservation confirmation message and sends it to the terminal.

[2133] Input: The reservation process has been completed successfully.

[2134] Output: Reservation confirmation message received on your device.

[2135] Step 20: The terminal displays a reservation completion message to the tourist

[2136] The terminal will display the received confirmation message and inform the tourist that their reservation has been completed.

[2137] Input: The reservation confirmation message sent by the server.

[2138] Output: A confirmation message that will be displayed on the tourist's screen.

[2139] Step 21: Tourist enters payment information

[2140] Once a tourist has booked an experience, they enter their payment information.

[2141] Input: Payment information (e.g. credit card information, payment amount).

[2142] Output: Payment information temporarily stored on the device.

[2143] Step 22: The terminal sends the payment information to the server

[2144] The terminal transmits the entered payment information to the server.

[2145] Input: Payment information.

[2146] Output: Payment information arriving at the server.

[2147] Step 23: The server processes the payment through the payment system

[2148] The server processes the payment through a payment system (e.g., Stripe, PayPal).

[2149] Input: Payment information received by the server.

[2150] Data processing: Processing payments via payment systems and APIs and receiving results.

[2151] Output: Confirmation of successful payment.

[2152] Step 24: The server sends a confirmation message to the terminal that the payment has been completed.

[2153] The server generates a confirmation message for the payment completion and sends it to the terminal.

[2154] Input: The payment process has been completed successfully.

[2155] Output: Payment completed message received on the terminal.

[2156] Step 25: The terminal displays a payment completion message to the tourist

[2157] The terminal will display the received confirmation message and inform the tourist that the payment has been completed.

[2158] Input: Payment completion message sent from the server.

[2159] Output: A confirmation message that will be displayed on the tourist's screen.

[2160] Step 26: Tourists complete the experience and enter their rating and feedback

[2161] Tourists can enter their ratings and feedback after completing the experience.

[2162] Input: Rating information (e.g., star rating, comments).

[2163] Output: Rating information temporarily stored on the device.

[2164] Step 27: The device sends the rating and feedback information to the server.

[2165] The terminal transmits the input rating and feedback information to the server.

[2166] Input: Rating information.

[2167] Output: Rating information arriving at the server.

[2168] Step 28: The server stores the rating and feedback information in a database

[2169] The server stores the received ratings and feedback information in a database.

[2170] Input: Rating information received by the server.

[2171] Data processing: Validate the evaluation information and save it in the database if successful.

[2172] Output: Evaluation information stored in a database.

[2173] Step 29: The server generates a confirmation message confirming the completion of the evaluation and sends it to the terminal.

[2174] The server generates a confirmation message of the completion of the evaluation and sends it to the terminal.

[2175] Input: The evaluation process completed successfully.

[2176] Output: Evaluation completion message arriving on your terminal.

[2177] Step 30: The terminal displays a message to the tourist that the evaluation is complete.

[2178] The terminal will display the received confirmation message to inform the tourist that the evaluation is complete.

[2179] Input: Evaluation completion message sent by the server.

[2180] Output: A confirmation message that will be displayed on the tourist's screen.

[2181] (Application example 1)

[2182] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2183] With conventional tourism experience reservation systems, it is difficult for tourists to check the experience content and provider ratings until they arrive at the destination, and the reservation and payment procedures are cumbersome. As a result, tourists are unable to enjoy high-quality experiences, and local experience providers have difficulty attracting appropriate customers. In addition, the inability to share experiences in real time or make instant payments reduces the quality and satisfaction of the experience.

[2184] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2185] In this invention, the server includes means for storing user information in a database, means for inputting search criteria for local experiences based on the user's interests and schedule, means for using artificial intelligence to suggest experiences that match the search criteria, means for accepting reservations for the selected experience and processing payments, means for inputting ratings and feedback after the experience and storing them in the database, and means for sharing local experiences in real time and making reservations and payments using smart devices in physical stores. This allows tourists to share experiences in real time on-site and make instant reservations and payments, improving the quality of the experience and satisfaction.

[2186] A "database" is an information system that organizes and stores various data, such as user information and experience information, and can efficiently search, manage, and update it.

[2187] "User" refers to individuals and corporations such as tourists and experience providers who use this system.

[2188] "Local Experiences" are activities and events that are rooted in local culture and specialties and offer tourists a unique experience.

[2189] "Artificial intelligence" is a technology that allows systems to automatically analyze data and make predictions, and makes optimal suggestions based on user input conditions.

[2190] "Search criteria" refers to information such as the type of experience and dates desired that a user enters into the system.

[2191] "Reservation" refers to the process by which a tourist confirms their chosen experience in advance.

[2192] "Payment" refers to the process of paying for a booked experience.

[2193] A "smart device" is an electronic device that can use the Internet and applications, such as a smartphone, smart glasses, or a head-mounted display.

[2194] "Real-time" means that users receive experience information immediately and reservations and payments are completed instantly on the spot.

[2195] "Evaluation" refers to the act of tourists expressing their thoughts and satisfaction about the quality of the experience after it has ended.

[2196] "Feedback" refers to specific comments or opinions about the experience or service provided by a user.

[2197] The system that realizes this invention not only has a conventional tourism experience reservation system but also a real-time experience sharing function using smart devices in a physical store. This system consists of the following main components.

[2198] System Program Overview

[2199] 1. User registration procedure:

[2200] Users access the system and register by entering their name, email address, and password.

[2201] The terminal sends this information to the server, which stores it in a database.

[2202] A registration completion message is returned to the terminal and displayed on the screen.

[2203] 2. Experience registration procedure:

[2204] The experience provider inputs details of the experience to be offered, and the terminal transmits these to the server.

[2205] The server stores the information in a database and returns a registration completion message to the terminal.

[2206] 3. Experience search and proposal procedure:

[2207] Tourists (users) input the desired experience genre and dates, and the terminal sends these search conditions to the server.

[2208] The server uses the generative AI model to suggest the optimal experience and sends the results back to the device.

[2209] 4. Booking and payment procedures:

[2210] Tourists select the experience they want and enter their booking and payment information.

[2211] The terminal sends this information to the server, the reservation information is stored in a database, and payments are processed using the Stripe API.

[2212] A message confirming reservation and payment is sent back to the terminal.

[2213] 5. Evaluation and Feedback Procedures:

[2214] After completing the experience, tourists enter their ratings and feedback into the terminal, and the server stores them in a database.

[2215] A completion message is sent back to the terminal and displayed on the screen.

[2216] 6. Real-time experience sharing procedure:

[2217] Tourists use smart devices (smartphones, smart glasses, head-mounted displays, etc.) in physical stores to search, book, and pay for experience details in real time.

[2218] The terminal sends this request to the server, which processes it in real time.

[2219] Hardware and Software Used

[2220] Hardware: Smart devices such as smartphones, smart glasses, and head-mounted displays (HMDs).

[2221] Software: Python, Flask, SQLite, Stripe API, Generative AI Model

[2222] Specific example explanation

[2223] Example of user registration:

[2224] The user accesses the platform and registers by entering the name "Taro", email address, and password.

[2225] The terminal sends this information to the server, which stores it in a database and returns a registration completion message.

[2226] Examples of experience registration:

[2227] The experience provider enters details of the "Japanese sweets making experience," and the terminal sends these to the server.

[2228] The server stores the information in a database and a registration complete message is sent back to the terminal.

[2229] Examples of experience search and suggestions:

[2230] Tourists search by entering "handmade experience" and "April 10th."

[2231] The device sends these search criteria to the server, which extracts information and sends results back to the device to suggest the optimal experience using a generative AI model.

[2232] Examples of booking and payment:

[2233] Tourists select "Japanese sweets making experience," enter their reservation and payment information, and the terminal sends this to the server.

[2234] The server saves the reservation information in a database, the payment is processed using the Stripe API, and a completion message is sent back to the terminal.

[2235] Examples of evaluation and feedback:

[2236] After completing the experience, tourists enter their ratings and comments, which are then sent to the server by the device.

[2237] The server stores it in a database and a completion message is sent back to the terminal.

[2238] Example prompt sentence:

[2239] "I'd like to book an experience. I'm looking for a crafting experience on April 10th."

[2240] "We found three handmade experiences taking place on April 10th. We have a Japanese sweets making experience, a Japanese cooking class, and a crafts making experience. Which one would you like to book?"

[2241] As described above, this system allows tourists to search, book, and pay for experiences in real time, improving the quality and satisfaction of the experiences. It also allows experience providers to efficiently offer their skills and specialties.

[2242] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2243] Step 1: User Registration

[2244] A user accesses the platform and enters their name, email address, and password. This information is sent from the device to the server. The server stores this information in a database and returns a registration completion message to the device. This saves the user information in the database and confirms the registration.

[2245] Step 2: Register your experience

[2246] The experience provider (user or corporation) enters details of the experience they wish to offer (e.g., Japanese sweets making experience). The device sends this information to the server, which stores the information in a database. Registration confirmation information is returned to the device, and a message indicating experience registration completion is displayed on the screen. The experience information is then stored in the database.

[2247] Step 3: Find and suggest experiences

[2248] Tourists (users) input the desired experience genre and dates, and the device sends these search criteria to the server. The server uses a generative AI model to extract the best experiences that match the search criteria from the database. The extracted results are sent back to the device, and a list of experiences that match the tourist is displayed. This allows tourists to easily find the experience they want.

[2249] Step 4: Reservation

[2250] The tourist selects the desired experience from the list and enters the reservation information. The terminal sends the reservation information to the server, which stores it in a database. A reservation confirmation message is sent back to the terminal, and a reservation completion message is displayed on the screen. This saves the reservation information in the database and confirms the reservation to the tourist.

[2251] Step 5: Payment

[2252] The tourist enters payment information. The terminal sends this information to the server, which processes the payment using the Stripe API. A confirmation of the payment is sent back to the terminal, and a payment completion message is displayed on the screen. This completes the payment, and the tourist can confirm it.

[2253] Step 6: Rating and feedback

[2254] After completing the experience, tourists enter their rating and feedback. The device sends this information to the server, which stores it in a database. Confirmation of the rating and feedback is sent back to the device, and a rating completion message is displayed on the screen. This saves the rating and feedback in the database, affecting the existing data.

[2255] Step 7: Real-time experience sharing

[2256] Tourists use smart devices in physical stores to search, book, and pay for experience details in real time. The device sends this request to the server, which processes it in real time. The response is immediately sent back to the device and displayed to the tourist, allowing for immediate on-site response.

[2257] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2258] This invention relates to a local experience sharing platform that effectively matches tourists and local residents and provides more personalized experiences. In particular, it aims to improve user satisfaction by combining it with an emotion engine that recognizes user emotions.

[2259] User Registration

[2260] 1. User Registration:

[2261] A user registers by entering basic information such as name, email address, and password.

[2262] The terminal sends this information to a server, which stores the information in a database.

[2263] The server sends a confirmation message to the terminal confirming the completion of registration, which is displayed on the user's screen.

[2264] Register your experience

[2265] 1. Experience provider registration:

[2266] Experience providers enter detailed information about the experience they are offering (e.g., tea ceremony class, Japanese cooking class, etc.).

[2267] The device sends this information to the server, which stores it in a database.

[2268] The server sends a confirmation message to the terminal to confirm the completion of registration, which is displayed on the screen.

[2269] Experience search and suggestions

[2270] 1. Tourist search:

[2271] Tourists input the type of experience they are interested in and the dates they wish to visit.

[2272] The terminal transmits the search conditions to the server.

[2273] Based on the received search criteria, the server uses an AI algorithm to compare the experience information in the database and generate an optimal experience list.

[2274] The server sends the list of experiences to the terminal and displays it to the tourist.

[2275] Reservation and payment

[2276] 1. Booking an experience:

[2277] Tourists select the experience they want from a list and enter their reservation information.

[2278] The terminal transmits the reservation information to the server, which stores it in a database.

[2279] The server sends a reservation confirmation message to the terminal and displays it to the tourist.

[2280] 2. Payment Processing:

[2281] Tourists enter their payment information.

[2282] The terminal transmits payment information to the server, which processes the payment via a payment system.

[2283] After the server confirms the payment, it sends a final confirmation message to the terminal and displays it to the tourist.

[2284] Ratings and Feedback

[2285] 1. Post-experience evaluation:

[2286] After completing the experience, tourists enter a rating (star rating) and feedback (comments).

[2287] The terminal transmits the evaluation information to the server, which stores it in a database.

[2288] The server sends a confirmation message of the completion of the evaluation to the terminal and displays it to the tourist.

[2289] Use of emotion engine

[2290] 1. User Emotion Recognition:

[2291] The terminal analyzes the user's input information and feedback and recognizes the user's emotions through an emotion engine.

[2292] The server stores the emotion recognition results in a database.

[2293] 2. Customized Experience Proposals:

[2294] Based on the emotion recognition results, the server uses an AI algorithm to further customize and suggest the optimal experience for the user.

[2295] The server sends the customized experience list to the terminal and displays it to the user.

[2296] 3. Feedback sentiment rating:

[2297] The server analyzes the feedback received from tourists using an emotion engine and rates them based on positive or negative emotions.

[2298] The server stores the emotion evaluation results in a database and reflects them in the evaluation of the experience provider.

[2299] 4. Experience Provider Management:

[2300] The server excludes experience providers with low emotional ratings from the system.

[2301] The server periodically checks the evaluation database and manages inappropriate experience providers.

[2302] Specific examples

[2303] 1. Example of user registration:

[2304] A user accesses the platform and enters information as "Yamada Taro."

[2305] The device sends this information to the server, which stores it in a database.

[2306] The server sends a registration completion message to the terminal and displays it on Yamada Taro's screen.

[2307] 2. Example of experience registration:

[2308] The experience provider enters details of the "Tea Ceremony Class."

[2309] The device sends this information to the server, which stores it in a database.

[2310] The server sends a registration completion message to the terminal and displays it on the screen.

[2311] 3. Examples of experience search and suggestions:

[2312] A tourist enters "handmade experience" and "May 25th" as search criteria.

[2313] The device sends these search criteria to the server, which then uses AI to extract the most suitable experiences and generate a list.

[2314] The server sends the list of experiences to the terminal and displays it to the tourist.

[2315] 4. Examples of booking and payment:

[2316] Tourists select "Tea Ceremony Class" from the list of experiences and enter their reservation information.

[2317] The terminal transmits the reservation information to the server, which stores it in a database.

[2318] The tourist enters payment information and the terminal transmits this information to the server.

[2319] The server processes the payment and sends a completion message to the terminal.

[2320] 5. Examples of evaluation and feedback:

[2321] After the experience, tourists rate it five stars and comment, "Very satisfied."

[2322] The device sends this information to the server, which stores it in a database.

[2323] The server sends an evaluation completion message to the terminal and displays it to the tourist.

[2324] 6. Examples of Emotion Engines:

[2325] When tourists book an experience, they express their "expectations" and the device recognizes this emotion and transmits it to the server.

[2326] The server takes emotions into account to suggest a more positive experience.

[2327] After the experience, tourists enter feedback such as "It was fun," and the emotion engine analyzes it as a positive evaluation and stores it in the database.

[2328] This allows tourists to enjoy a more personalized experience, and experience providers can receive appropriate feedback and improve the quality of their services. In addition, by managing the system based on negative reviews, the quality of the overall experience can be maintained.

[2329] The processing flow will be explained below.

[2330] User Registration

[2331] Step 1:

[2332] Users visit the platform's registration page and enter their name, email address, and password.

[2333] Step 2:

[2334] The terminal sends the entered information to the server as an HTTP POST request.

[2335] Step 3:

[2336] The server stores the received information in a database.

[2337] Step 4:

[2338] The server confirms that the save was successful.

[2339] Step 5:

[2340] The server generates a registration completion confirmation message and sends it to the terminal.

[2341] Step 6:

[2342] The terminal will display a confirmation message to inform the user that registration is complete.

[2343] Register your experience

[2344] Step 1:

[2345] The experience provider (user or corporation) accesses the registration page for the experience and enters detailed information (e.g., tea ceremony class, Japanese cooking class, etc.).

[2346] Step 2:

[2347] The terminal sends the entered information to the server as an HTTP POST request.

[2348] Step 3:

[2349] The server stores the received information in a database.

[2350] Step 4:

[2351] The server confirms that the save was successful.

[2352] Step 5:

[2353] The server generates a registration completion confirmation message and sends it to the terminal.

[2354] Step 6:

[2355] The device will display a confirmation message to inform the experience provider that registration is complete.

[2356] Experience search and suggestions

[2357] Step 1:

[2358] Tourists (users) access the platform's search page and enter the type of experience they are interested in and the dates they wish to visit.

[2359] Step 2:

[2360] The terminal sends the entered search criteria to the server as an HTTP GET request.

[2361] Step 3:

[2362] The server uses an AI algorithm to match the experience information in the database based on the received search criteria.

[2363] Step 4:

[2364] The server generates a list of experiences that match the search criteria.

[2365] Step 5:

[2366] The server transmits the experience list to the terminal.

[2367] Step 6:

[2368] The terminal displays to the tourist a list of experiences generated as search results.

[2369] Reservation and payment

[2370] Step 1:

[2371] Tourists (users) select the experience they want from the list of experiences and enter the number of participants and any special notes.

[2372] Step 2:

[2373] The terminal sends the entered reservation information to the server as an HTTP POST request.

[2374] Step 3:

[2375] The server stores the received reservation information in a database.

[2376] Step 4:

[2377] The server confirms that the save was successful.

[2378] Step 5:

[2379] The server generates a reservation confirmation message and sends it to the terminal.

[2380] Step 6:

[2381] The terminal displays a booking confirmation message to the tourist.

[2382] Step 7:

[2383] Tourists enter their payment information (such as credit card information).

[2384] Step 8:

[2385] The terminal sends the payment information to the server as an HTTP POST request.

[2386] Step 9:

[2387] The server transmits the received payment information to the payment system and requests payment processing.

[2388] Step 10:

[2389] The server receives the payment transaction results and stores them in a database.

[2390] Step 11:

[2391] The server generates a confirmation message for the payment completion and sends it to the terminal.

[2392] Step 12:

[2393] The terminal will display a payment completion message to the tourist.

[2394] Ratings and Feedback

[2395] Step 1:

[2396] After completing the experience, tourists (users) access the platform's rating page and enter their rating (star rating) and feedback (comments) about the experience.

[2397] Step 2:

[2398] The device sends the entered rating and feedback to the server as an HTTP POST request.

[2399] Step 3:

[2400] The server stores the received ratings and feedback in a database.

[2401] Step 4:

[2402] The server confirms that the save was successful.

[2403] Step 5:

[2404] The server generates a confirmation message of the completion of the evaluation and sends it to the terminal.

[2405] Step 6:

[2406] The terminal displays an evaluation completion message to the tourist.

[2407] Use of emotion engine

[2408] Step 1:

[2409] When tourists (users) search for or book experiences, they input their current emotions (e.g., anticipation, excitement, anxiety, etc.) using an emotion recognition interface.

[2410] Step 2:

[2411] The device sends the input emotion information to the server as an HTTP POST request.

[2412] Step 3:

[2413] The server analyzes the received emotion information using an emotion engine and generates emotion data.

[2414] Step 4:

[2415] The server stores the emotion data in a database and associates it with user information.

[2416] Step 5:

[2417] Based on the emotional data, the server uses an AI algorithm to further customize the list of experiences it suggests.

[2418] Step 6:

[2419] The server sends the customized experience list to the terminal.

[2420] Step 7:

[2421] The terminal displays a customized list of experiences for tourists.

[2422] Step 8:

[2423] After the experience, tourists enter their ratings and feedback, which are analyzed by the emotion engine to generate emotion evaluation data.

[2424] Step 9:

[2425] The server stores the received emotion evaluation data in a database.

[2426] Step 10:

[2427] The server publishes positive or negative feedback to the experience provider based on the emotional evaluation.

[2428] Step 11:

[2429] The server will remove from the system any experience provider whose negative ratings exceed a certain threshold.

[2430] Step 12:

[2431] The server periodically checks the evaluation database and manages inappropriate experience providers.

[2432] The above is a specific processing flow that combines the emotion engine of the present invention. This realizes a system that provides tourists with a more personalized experience and also contributes to improving the services of experience providers.

[2433] Example 2

[2434] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2435] In the modern tourism industry, tourists have difficulty finding local experiences that fit their interests and schedules. Experience providers also lack effective ways to promote their skills and expertise and stimulate demand. Furthermore, there is a lack of systems to ensure the quality of experiences and improve user satisfaction. To solve this problem and provide tourists with personalized experiences, a system that recognizes user emotions and makes experience suggestions based on those emotions is needed.

[2436] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for storing user information in a database, a means for inputting search criteria for local experiences based on the user's interests and schedule, and a means for proposing experiences that match the search criteria using a generative AI model. This allows tourists to easily find the best experience based on their interests. The server also includes a means for accepting reservations for the selected experience and processing payments, a means for inputting ratings and feedback after the experience and storing them in the database, a means for recognizing the user's emotions via an emotion engine, a means for customizing experience suggestions based on the emotion recognition results, a means for analyzing the ratings and feedback using the emotion engine and storing the rating results in the database, and a means for excluding experience providers with low emotion ratings from the system. This allows tourists to enjoy more personalized, high-quality experiences, and allows experience providers to improve their services by receiving appropriate feedback. It also maintains the overall quality of the experience and improves user satisfaction.

[2437] A "database" is a system for efficiently managing, storing, searching, and updating large amounts of data.

[2438] "User information" refers to a collection of basic data such as a user's name, email address, and password, as well as data related to valid operations and records.

[2439] "Local experiences" are activities and services that allow tourists to experience the culture, skills, and specialties unique to a region.

[2440] "Search criteria" refers to information that serves as the basis for a search, which is performed by specifying the experience the user is interested in, the desired date and time, and so on.

[2441] A "generative AI model" is an artificial intelligence algorithm used to make predictions and suggestions based on user input data.

[2442] A "suggestion" is when a generative AI model finds the best experience based on the user's search criteria and recommends it to the user.

[2443] A "reservation" is a process by which a user reserves a selected experience for a specific date and time.

[2444] "Payment Processing" means the process of managing the fees for a selected Experience through a payment system.

[2445] "Evaluation" refers to the act of a user providing feedback on the content and quality of an experience after it has ended, such as in the form of a star rating.

[2446] "Feedback" refers to comments, opinions, and evaluation information provided by users after completing an experience.

[2447] An "emotion engine" is a technology that analyzes user input information and feedback to recognize the user's emotional state.

[2448] "Emotion recognition" is the process of using an emotion engine to identify emotions from user input and feedback.

[2449] "Customization" refers to the act of individually adjusting experience suggestions based on the user's emotion recognition results to make them more appropriate.

[2450] "Emotion evaluation" is an evaluation by the emotion engine to determine positive or negative emotions based on user feedback.

[2451] "Experience provider" refers to an individual or organization that offers local experiences to tourists.

[2452] "Exclusion" refers to the act of excluding experience providers with low emotional ratings from the platform.

[2453] The present invention relates to a local experience sharing platform for effectively matching tourists and local residents to provide more personalized experiences. Embodiments of the present invention are described below.

[2454] User Registration

[2455] 1. A user enters basic information such as name, email address, and password on the registration screen of a web application. The information is temporarily stored on the device. The device then sends the information to the server as an HTTP POST request.

[2456] 2. The server receives this information and performs validation. If validation is successful, the server stores the user information in a database (e.g. MySQL, PostgreSQL).

[2457] 3. The server generates a registration completion message and sends it to the terminal as an HTTP response, and the terminal displays this message on its screen.

[2458] Register your experience

[2459] 1. The experience provider enters detailed information about the experience (e.g., the date, time, location, and participation fee of the tea ceremony class) on the experience registration screen. The entered information is temporarily saved on the device.

[2460] 2. When the provider presses the registration button, the terminal sends the entered information to the server as an HTTP POST request.

[2461] 3. The server receives this information and performs content validation. If validation is successful, the server stores the experience information in a database.

[2462] 4. The server generates a registration completion message and sends it to the terminal as an HTTP response, and the terminal displays this message on its screen.

[2463] Experience search and suggestions

[2464] 1. Tourists enter the type of experience they are interested in and the dates they wish to visit on the experience search screen. The information entered is temporarily saved on the device.

[2465] 2. When the terminal presses the search button, it sends the entered search criteria to the server as an HTTP GET request.

[2466] 3. The server receives the request, accesses the database, and uses a generative AI model to extract the best list of experiences.

[2467] 4. The server generates a list of the extracted results and sends it to the terminal as an HTTP response. The terminal displays this list on its screen.

[2468] Reservation and payment

[2469] 1. Tourists select the experience they want from the list of experiences and enter reservation information (e.g., number of people, date and time). The entered information is temporarily saved on the device.

[2470] 2. When the reservation button is pressed on the terminal, the entered reservation information is sent to the server as an HTTP POST request.

[2471] 3. The server receives the request, validates the reservation information, and if successful, saves the reservation information in the database.

[2472] 4. The tourist proceeds to the payment screen and enters their payment information (e.g., credit card information), which is temporarily stored on the device.

[2473] 5. When the payment button is pressed, the terminal sends the entered payment information as an HTTP POST request to the server, and the server processes the payment via a payment system (e.g., Stripe, PayPal).

[2474] 6. After confirming the payment, the server generates a reservation completion message and sends it to the terminal as an HTTP response. The terminal displays this message on its screen.

[2475] Ratings and Feedback

[2476] 1. After the experience is over, tourists enter their rating (star rating) and feedback (comments). The entered information is temporarily saved on the device.

[2477] 2. When the device presses the send button, the rating and feedback information is sent to the server as an HTTP POST request.

[2478] 3. The server receives the request and stores the information in a database.

[2479] 4. The server generates an evaluation completion message and sends it to the terminal as an HTTP response. The terminal displays this message on its screen.

[2480] Use of emotion engine

[2481] 1. The device analyzes the user's input information and feedback and recognizes the user's emotions through an emotion engine (e.g., NLP model). The recognized emotion data is sent from the device to the server.

[2482] 2. The server stores the emotion recognition results in a database.

[2483] 3. The server uses a generative AI model based on the emotion recognition results to further customize and propose the most suitable experience for the user. The customized experience list is sent from the server to the device, which then displays it on the screen.

[2484] 4. The server analyzes the feedback received from tourists using an emotion engine and rates them based on positive or negative emotions. The results are stored in a database and reflected in the experience provider's ratings.

[2485] 5. The server removes experience providers with low emotional ratings from the system and periodically checks the rating database to manage inappropriate experience providers.

[2486] Specific examples

[2487] 1. Example of user registration:

[2488] A user accesses the platform and enters "Yamada Taro" as their name, email address, and password.

[2489] The device sends this information to the server, which stores it in a database.

[2490] The server sends a registration completion message to the terminal, which is displayed on Yamada Taro's screen.

[2491] 2. Example of experience registration:

[2492] The experience provider enters details of the "Tea Ceremony Class."

[2493] The device sends this information to the server, which stores it in a database.

[2494] The server sends a registration completion message to the terminal and displays it on the screen.

[2495] 3. Examples of experience search and suggestions:

[2496] A tourist enters "handmade experience" and "May 25th" as search criteria.

[2497] The device sends these search criteria to the server, which then uses a generative AI model to extract the most suitable experiences and generate a list.

[2498] The server sends the experience list to the terminal and displays it to the tourist.

[2499] 4. Examples of booking and payment:

[2500] Tourists select "Tea Ceremony Class" from the list of experiences and enter their reservation information.

[2501] The terminal sends the reservation information to the server, which stores it in a database.

[2502] The tourist enters payment information and the terminal transmits this information to the server.

[2503] After the server completes the payment process, it sends a completion message to the terminal.

[2504] 5. Examples of evaluation and feedback:

[2505] After the experience, tourists rate it five stars and comment, "Very satisfied."

[2506] The device sends this information to the server, which stores it in a database.

[2507] The server sends an evaluation completion message to the terminal and displays it to the tourist.

[2508] 6. Examples of Emotion Engines:

[2509] When tourists book an experience, they express their "expectations" and the device recognizes this emotion and transmits it to the server.

[2510] The server takes emotions into account to suggest a more positive experience.

[2511] After the experience, tourists enter feedback such as "It was fun," and the emotion engine analyzes it as a positive evaluation and stores it in the database.

[2512] This allows tourists to enjoy a more personalized experience, and experience providers can receive appropriate feedback and improve the quality of their services. In addition, by managing the system based on negative reviews, the quality of the overall experience can be maintained.

[2513] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2514] Step 1: Enter your user information

[2515] The user enters basic information such as name, email address, and password on the registration screen of the web application.

[2516] Input: Name, Email Address, Password

[2517] The terminal temporarily stores the entered information.

[2518] Output: Temporarily saved user information

[2519] Step 2: Submit your information

[2520] When the user presses the registration button, the terminal sends the entered information to the server as an HTTP POST request.

[2521] Input: Temporarily saved user information

[2522] Output: HTTP POST request

[2523] Step 3: Storing and validating information

[2524] The server receives the request and performs validations such as name, email format, and password strength.

[2525] Input: HTTP POST request

[2526] Data processing: Validation (format check, strength check)

[2527] If validation is successful, the server saves the user information in the database.

[2528] Output: User information stored in the database

[2529] Step 4: Notification of registration completion

[2530] The server generates a registration completion message and sends it to the terminal as an HTTP response.

[2531] Input: User information stored in the database

[2532] Output: Registration complete message

[2533] The terminal displays the received registration completion message on the screen to notify the user that registration has been completed.

[2534] Output: Registration complete message displayed

[2535] Step 5: Enter your experience details

[2536] The experience provider enters detailed information about the experience (e.g., the date, time, location, and participation fee of the tea ceremony class) on the experience content registration screen.

[2537] Input: Experience details

[2538] The device temporarily stores the information you enter.

[2539] Output: Temporarily saved experience information

[2540] Step 6: Submit your experience

[2541] When the provider presses the registration button, the terminal sends the entered information to the server as an HTTP POST request.

[2542] Input: Temporarily saved experience information

[2543] Output: HTTP POST request

[2544] Step 7: Storing and validating experience information

[2545] The server receives the request and validates the experience information (e.g., checking for duplicate dates and times, validity of participation fees).

[2546] Input: HTTP POST request

[2547] Data processing: Validation (duplicate check, validity check)

[2548] If the validation is successful, the server stores the experience information in a database.

[2549] Output: Experience information stored in a database

[2550] Step 8: Notification of completion of experience registration

[2551] The server generates a registration completion message and sends it to the terminal as an HTTP response.

[2552] Input: Experience information stored in the database

[2553] Output: Registration complete message

[2554] The terminal displays the received registration completion message on the screen and notifies the experience provider that registration is complete.

[2555] Output: Registration complete message displayed

[2556] Step 9: Enter search criteria

[2557] Tourists enter the type of experience they are interested in and the dates they wish to visit on the experience search screen.

[2558] Input: Experience genre, desired date

[2559] The device temporarily stores the information you enter.

[2560] Output: Saved search criteria

[2561] Step 10: Submitting search criteria

[2562] When the terminal presses the search button, the entered search criteria is sent to the server as an HTTP GET request.

[2563] Input: Saved search criteria

[2564] Output: HTTP GET request

[2565] Step 11: Search and suggest

[2566] The server receives the request, accesses a database, and uses a generative AI model to generate a list of optimal experiences.

[2567] Input: HTTP GET request

[2568] Data computation: Generative AI models extract a list of experiences based on search criteria

[2569] The server generates the experience list in list form.

[2570] Output: Experience list

[2571] Step 12: Submit your proposal list

[2572] The server sends the experience list to the terminal as an HTTP response.

[2573] Input: Experience list

[2574] Output: HTTP response

[2575] The device displays the received list on the screen and makes suggestions to tourists.

[2576] Output: Display the list of suggestions

[2577] Step 13: Enter reservation information

[2578] Tourists select the experience they want from the list of experiences and enter reservation information (e.g., number of people, date and time).

[2579] Input: Reservation information

[2580] The device temporarily stores the information you enter.

[2581] Output: Temporarily saved reservation information

[2582] Step 14: Submit reservation information

[2583] When the reservation button is pressed, the terminal sends the entered reservation information to the server as an HTTP POST request.

[2584] Input: Temporarily saved reservation information

[2585] Output: HTTP POST request

[2586] Step 15: Storing and validating reservation information

[2587] The server receives the request and performs validation of the reservation information (e.g. checks for overbooking).

[2588] Input: HTTP POST request

[2589] Data processing: Validation (capacity check)

[2590] If the validation is successful, the server saves the reservation information in the database.

[2591] Output: Reservation information stored in the database

[2592] Step 16: Enter your payment information

[2593] Tourists enter their payment information (e.g., credit card information) on the payment screen.

[2594] Input: Payment Information

[2595] The device temporarily stores the information you enter.

[2596] Output: Temporarily saved payment information

[2597] Step 17: Submit payment information

[2598] When the payment button is pressed, the terminal sends the entered payment information to the server as an HTTP POST request.

[2599] Enter: Saved payment information

[2600] Output: HTTP POST request

[2601] Step 18: Payment Processing

[2602] The server receives the request and processes the payment via a payment system (e.g., Stripe, PayPal).

[2603] Input: HTTP POST request

[2604] Data processing: processing payments through payment systems

[2605] After confirming the payment, the server generates a reservation completion message.

[2606] Output: Payment confirmation and reservation completion message

[2607] Step 19: Reservation completion notification

[2608] The server sends a completion message to the terminal as an HTTP response.

[2609] Input: Payment confirmation and reservation completion message

[2610] Output: HTTP response

[2611] The terminal displays the received completion message on the screen to inform the tourist that the reservation has been completed.

[2612] Output: Display a reservation completion message

[2613] Step 20: Post-Experience Rating and Feedback

[2614] After the experience is over, tourists enter a rating (star rating) and feedback (comments).

[2615] Input: Ratings and Feedback

[2616] The device temporarily stores the information you enter.

[2617] Output: Temporarily saved ratings and feedback

[2618] Step 21: Rate and provide feedback

[2619] When the device presses the send button, it sends the rating and feedback information to the server as an HTTP POST request.

[2620] Input: Saved ratings and feedback

[2621] Output: HTTP POST request

[2622] Step 22: Save your ratings and feedback

[2623] The server receives the request and stores the ratings and feedback information in a database.

[2624] Input: HTTP POST request

[2625] Output: Ratings and feedback stored in a database

[2626] Step 23: Notification of evaluation completion

[2627] The server generates an evaluation completion message and sends it to the terminal as an HTTP response.

[2628] Input: Ratings and feedback stored in the database

[2629] Output: HTTP response

[2630] The terminal displays the received completion message on the screen to inform the tourist that the evaluation is complete.

[2631] Output: Evaluation complete message displayed

[2632] Step 24: Emotion Recognition with the Emotion Engine

[2633] The device analyzes the user's input information and feedback and recognizes the user's emotions through an emotion engine (e.g., NLP model).

[2634] Input: Ratings and Feedback

[2635] Data Computation: Emotion Recognition with Emotion Engine

[2636] The emotion recognition results are sent to the server.

[2637] Output: Emotion recognition result

[2638] Step 25: Storing Emotion Data

[2639] The server stores the emotion recognition results in a database.

[2640] Input: Emotion recognition results

[2641] Output: Emotion recognition results stored in a database

[2642] Step 26: Customize experience recommendations based on emotions

[2643] Based on the emotion recognition results, the server uses a generative AI model to customize and propose the optimal experience for the user.

[2644] Input: Emotion recognition results

[2645] Data Computation: Emotion-Based Customization of Experience Proposals

[2646] The server generates a customized list of experiences.

[2647] Output: A customized list of experiences

[2648] Step 27: Submit your customized list

[2649] The server sends the customized experience list to the device as an HTTP response.

[2650] Input: Customized Experience List

[2651] Output: HTTP response

[2652] The terminal displays the received list on the screen and provides it to the user.

[2653] Output: Display of customized experience list

[2654] Step 28: Sentiment Analysis of Feedback

[2655] The server analyzes the feedback received from tourists using an emotion engine and rates them based on positive or negative emotions.

[2656] Input: Feedback

[2657] Data Computation: Emotion Analysis with Emotion Engine

[2658] The evaluation results are stored in a database.

[2659] Output: Emotion evaluation results stored in a database

[2660] Step 29: Control and exclude experience providers

[2661] The server excludes experience providers with low emotional ratings from the system.

[2662] Input: Emotion evaluation result

[2663] Data processing: Experience provider evaluation check

[2664] The server periodically checks the evaluation database and manages inappropriate experience providers.

[2665] Output: Updated donor list

[2666] (Application example 2)

[2667] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2668] There is a demand for local experience sharing platforms to provide tourists with more personalized experiences, but current systems do not take user emotions into consideration, resulting in a uniform quality of experience and variations in satisfaction. Furthermore, it is difficult to provide experiences that are close to reality even in virtual spaces, which can lead to a decrease in user satisfaction. To solve these issues, it is necessary to recognize user emotions in real time and utilize this information to propose and customize experiences.

[2669] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2670] In this invention, the server includes means for storing user information in a database, means for inputting search criteria for local experiences based on the user's interests and schedule, means for using artificial intelligence to suggest experiences that match the search criteria, means for accepting reservations for the selected experiences and processing payments, means for guiding the provision of experiences and products in the virtual space, means for recognizing the user's emotions using a camera and microphone and customizing the suggestions, and means for inputting evaluations and feedback after the experience and storing them in the database. This allows tourists to enjoy a more personalized experience, and experience providers can receive appropriate feedback and improve the quality of their services.

[2671] A "database" is a system for storing information in an organized manner and for easily retrieving and managing it.

[2672] "User Information" refers to data related to individual users, such as basic information, personal preferences, and history.

[2673] "Search criteria" are the criteria or requirements that users set to efficiently find the experiences or products they desire.

[2674] "Artificial intelligence" is a technology that mimics human intelligence and automates tasks such as data analysis, predictions, and suggestions.

[2675] An "experience" is a service or activity offered to a user that may include cultural, educational, or recreational content.

[2676] A "reservation" is the process of reserving an experience or service in advance for use at a specific time.

[2677] "Payment" refers to the act of a user paying for an experience or service provided.

[2678] "Virtual space" is a virtual environment or world created using computer technology.

[2679] A "guide" is a person or system whose role is to provide information and instructions to users.

[2680] A "camera" is a device that takes still images and videos and is used to recognize the user's facial expressions and movements.

[2681] A "microphone" is a device for picking up sound and is used to recognize the user's tone of voice and words.

[2682] "Emotion" is a subjective state of feeling or sensation experienced by a user.

[2683] "Customization" means tailoring content to the needs and preferences of individual users.

[2684] A "rating" is the act of expressing opinions or impressions about the quality of an experience or service provided.

[2685] "Feedback" refers to the communication of users' opinions and thoughts about the experience or service provided.

[2686] A "generative AI model" is a form of artificial intelligence that uses algorithms that have been trained with large amounts of data in advance and designed to perform specific tasks.

[2687] In this invention, the following hardware and software are used to realize a virtual experience guide system that provides tourists with a more personalized experience.

[2688] Hardware used

[2689] Smartphone: Uses camera, microphone, and GPS functions.

[2690] Head-mounted displays (HMDs) or smart glasses: Used to provide experiences within virtual spaces.

[2691] Software used

[2692] Cloud-based servers (e.g., AWS) for storing and processing data.

[2693] Emotion recognition engine (e.g., Microsoft Azure Emotion API): Recognizes and analyzes user emotions in real time.

[2694] AI algorithms (machine learning models) to suggest and customize experiences.

[2695] Database (MySQL, etc.): Stores user information, experience information, and feedback.

[2696] What the program does

[2697] 1. User Registration

[2698] The server stores the user's basic information (name, email address, password) received from the smartphone in a database. It then sends a confirmation message to the user and displays it on the smartphone.

[2699] 2. Register your experience

[2700] The experience provider enters details of the experience they are offering using their smartphone and sends them to the server, which stores the information in a database and sends a confirmation message to the experience provider's smartphone.

[2701] 3. Start the virtual tour

[2702] Tourists launch the app and begin their virtual guided tour. The app uses the smartphone's camera and microphone to analyze facial expressions and tone of voice in real time, and an emotion recognition engine is used to identify emotions.

[2703] 4. Emotion-based recommendations

[2704] The server proposes optimal virtual experiences and products based on emotion recognition results and past data. The proposals are sent to the smartphone or HMD and displayed to the user. The emotion recognition data and proposal history are stored in a database.

[2705] 5. Post-experience feedback

[2706] After the experience, tourists enter star ratings and comments. This information is sent to the server via smartphone and stored in a database. The emotion engine analyzes the emotional state of the feedback and generates feedback data to improve the quality of services.

[2707] 6. Reputation Management

[2708] The server periodically checks the rating database and manages low-rated experience providers, excluding inappropriate experience providers from the system.

[2709] Specific examples

[2710] As an example of a tourist, Taro Yamada books a "Virtual Tea Ceremony Experience" and uses a facial recognition camera to indicate his "expectations." The app then suggests a "Japanese Cooking Class" in addition to the "Tea Ceremony Experience." After the experience, Yamada leaves a comment saying he's "very satisfied," which the emotion engine interprets as a positive evaluation.

[2711] Example of input prompt for generative AI model

[2712] User Taro Yamada has booked a "Virtual Tea Ceremony Experience." Judging from his facial expression, he seems "expected." Suggest the best additional experiences and customize your next suggestions based on his post-experience feedback.

[2713] Examples of registered experiences: Tea ceremony class, Japanese cooking class, Origami class

[2714] Using this system, tourists can enjoy rich local experiences in a more enjoyable and satisfying way, even in a virtual space, and experience providers can receive appropriate feedback and improve the quality of their services.

[2715] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2716] Step 1:

[2717] User registration step: The user uses their smartphone to enter basic information such as their name, email address, and password. The device sends this information to the server, which then stores it in a database. The input is the user's basic information, and the output is the result of saving it to the database and a message that registration is complete.

[2718] Step 2:

[2719] Experience content registration step: The experience provider enters detailed information about the experience they are offering from their smartphone. The device sends this information to the server, which then stores it in a database. The input is the experience content information, and the output is the result of saving it to the database and a message indicating registration is complete.

[2720] Step 3:

[2721] User emotion recognition and virtual guide start step The user starts the virtual guide using a smartphone or head-mounted display (HMD). The camera and microphone capture the user's facial expressions and tone of voice in real time and send this to the emotion recognition engine. The input is real-time facial expression and tone of voice data, and the output is the emotion recognition results.

[2722] Step 4:

[2723] Emotion-based experience suggestion step: Based on the emotion recognition results, the server uses an AI algorithm to suggest the most suitable experiences and products to the user. The server saves the suggestions in a database, sends them to the device, and displays them to the user. The input is the emotion recognition results and past data, and the output is a list of optimal experience suggestions.

[2724] Step 5:

[2725] Experience booking and payment step The user selects the desired experience from the list of suggested experiences and makes a reservation. The terminal sends the reservation information to the server, which stores it in a database. The user then enters payment information, which the terminal sends to the server for payment processing. The input is reservation information and payment information, and the output is reservation confirmation and payment confirmation messages.

[2726] Step 6:

[2727] Post-experience evaluation and feedback step After completing the experience, the user inputs an evaluation (star rating) and feedback (comments). The terminal sends this information to the server, which stores it in a database. The input is the evaluation and feedback information, and the output is the result of saving to the database and a message that the evaluation is complete.

[2728] Step 7:

[2729] Sentiment analysis and management of rating data: The server analyzes the rating data and feedback data using an emotion recognition engine and customizes the next proposal based on positive or negative emotions. It also removes experience providers with low ratings from the database. The input is the rating and feedback data, and the output is the analysis results and system management results.

[2730] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2731] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2732] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present...

Claims

1. a means for storing user information in a database; a means for inputting search criteria for local experiences based on the user's interests and schedule; means for suggesting experiences that match the search criteria using artificial intelligence; a means to accept reservations and process payments for selected experiences; A means for inputting an evaluation and feedback after the experience is completed and storing the evaluation and feedback in the database; A system including:

2. A means for users to access the database and register information about their skills, specialties, and culture; A means for listing experiences provided by the user based on the information; a means for tourists to select and book experiences from said list; The system of claim 1 further comprising:

3. A means for the artificial intelligence to improve the accuracy of the experience suggestions based on the user's evaluations and feedback; A means for excluding experience providers with low ratings and feedback from the system; The system of claim 1 further comprising:

Images