System

Abstract

A system is provided.SOLUTION: A system comprising: means for a user to download and install an online payment application on a mobile terminal; means for the user to input information about interests and past experiences; means for sending the user's input information to a server; means at the server including an algorithm for suggesting tourist attractions and restaurants based on the user's input information; means for sending the suggestion information to the user's mobile terminal; means for displaying the suggestion information on the mobile terminal; and means for reserving special experiences and making online payments based on the suggestion information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] The present invention aims to provide foreign tourists visiting Japan with a more comfortable and convenient tourist experience by solving problems such as communication difficulties, inconvenient payment methods, and a lack of Wi-Fi. Specifically, the objective is to provide a system that allows foreign tourists visiting Japan to easily select tourist spots and restaurants within Japan and smoothly use cashless payment. [Means for solving the problem]

[0005] In order to solve the above problems, the present invention provides the following means.

[0006] The system includes: a means for a user to download and install an online payment application to a mobile device; a means for the user to input information about their interests and past experiences; a means for transmitting the user's input information to a server; a means in the server that includes an algorithm for suggesting tourist attractions and restaurants based on the user's input information; a means for transmitting the suggested information to the user's mobile device; a means for displaying the suggested information on the mobile device; and a means for booking a special experience and making an online payment based on the suggested information. Furthermore, the system promotes use of the system by providing a notification means at specific locations that prompts users to download the online payment application, and by providing a means for users to check whether tourist attractions and restaurants support online payments, the system allows users to use cashless payments with peace of mind.

[0007] "User" means any person or entity using the Online Payment Application.

[0008] "Online payment application" refers to software that allows payment procedures to be carried out over the Internet.

[0009] "Mobile device" refers to a portable electronic device such as a smartphone or tablet.

[0010] "Downloading" refers to the act of importing data or software into a mobile device via the Internet.

[0011] "Installation" refers to the act of placing software on a mobile terminal and setting it up so that it can be executed.

[0012] "Interests" refers to the themes or categories in which a user is particularly interested or concerned.

[0013] "Past experiences" refers to information about trips, events, and other experiences that users have had in the past.

[0014] "Information input form" refers to the screen or field where users can enter the required information.

[0015] "Server" refers to a computer system that stores, processes, and transmits data.

[0016] An "algorithm" refers to a procedure or computational method for solving a specific problem.

[0017] "Tourist destination" refers to a place or area intended for visitation by tourists.

[0018] "Restaurant" refers to a facility that provides food and beverage services to customers.

[0019] "Special experiences" refer to special events or activities that are different from the norm.

[0020] "Online payment" refers to the electronic payment of money made over the Internet.

[0021] "Notification means" refers to a method or device for notifying a user of specific information. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6]FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0023] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0024] First, the terms used in the following description will be explained.

[0025] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0026] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0027] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0028] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0029] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0030] [First embodiment]

[0031] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0032] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0033] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0034] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0035] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0036] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0037] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0038] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0039] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0040] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0041] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0042] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0043] The system of the present invention is designed to enable foreign tourists visiting Japan to enjoy tourist spots and restaurants in Japan with peace of mind and to use cashless payment. A specific embodiment of this system will be described below.

[0044] System Overview

[0045] The system consists of the following main components:

[0046] Mobile devices (such as users' smartphones or tablets)

[0047] Server (a computer system that stores, processes, and transmits data)

[0048] Online payment application

[0049] User operation steps

[0050] 1. Download and install the app

[0051] When users arrive at Narita Airport or other major arrival points, a pop-up notification will appear after connecting to Wi-Fi.

[0052] The user taps the pop-up notification, downloads the online payment application from the app store, and installs it on the mobile device.

[0053] 2. First launch and setup

[0054] The user launches the app and selects English from the language settings screen.

[0055] The app displays an initial setup screen, prompting the user to enter information about their interests and past experiences.

[0056] 3. Enter information

[0057] The user enters their interests (e.g., hot springs), past travel experiences (e.g., first visit to Japan), etc.

[0058] The terminal transmits the input information to the server.

[0059] Processing on the server

[0060] 4. Receiving and analyzing information

[0061] The server receives input information from the terminal.

[0062] The server uses AI algorithms to select recommended tourist spots and restaurants based on input interests and past experiences.

[0063] 5. Generating and sending recommendations

[0064] The server generates a list of recommended tourist spots and restaurants for the user. For example, "Hakone Onsen" or "Ramen Museum" are selected.

[0065] The server transmits the generated recommendation information to the terminal.

[0066] Displaying results and offering special experiences

[0067] 6. Display of recommended information

[0068] The device displays the recommended information received from the server.

[0069] Detailed information about each recommended spot (location, opening hours, whether cashless payment is accepted, etc.) is displayed.

[0070] 7. Special Experience Reservations and Payment

[0071] The server generates a special experience (e.g., a guided tour exclusive to the Ramen Museum) and displays it in the app.

[0072] A user books a special experience and pays for it using an online payment application.

[0073] Specific examples

[0074] The user arrives at Narita Airport and taps the pop-up notification that appears after connecting to Wi-Fi.

[0075] A user downloads an online payment application from an app store and installs it on a mobile device.

[0076] A user launches the app, selects English, and enters "hot springs" as their interest and "first visit to Japan" as their past experience.

[0077] The device sends the information to the server, which then returns "Hakone Onsen" and "Ramen Museum" as recommendations.

[0078] The device displays the recommended information, and the user checks for more information.

[0079] The server generates a "Ramen Museum Exclusive Guided Tour," which the user reserves and pays for using an online payment application.

[0080] Through this process, foreign tourists visiting Japan can smoothly find tourist spots and restaurants, book special experiences, and use cashless payment. This system provides users with a comfortable and convenient tourist experience.

[0081] The processing flow will be explained below.

[0082] Step 1:

[0083] When the user arrives at Narita Airport and connects to Wi-Fi, a pop-up notification appears. The device displays a pop-up notification prompting the user to download an online payment application.

[0084] Step 2:

[0085] The user taps the pop-up notification and downloads the online payment application from the app store. The device installs the application and displays a notification that the installation is complete.

[0086] Step 3:

[0087] After installation, a user launches the app and selects English on the language settings screen. The device displays an initial setup screen, prompting the user to enter information about their interests and past experiences.

[0088] Step 4:

[0089] The user enters information such as "Interests: Hot Springs, Food: Ramen, Experience: First visit to Japan" into the information input form and presses the send button. The device then sends the entered information to the server.

[0090] Step 5:

[0091] The server receives the input information sent from the device, analyzes it, and uses an AI algorithm to select recommended tourist spots and restaurants based on the user's interests and past experiences.

[0092] Step 6:

[0093] The server generates a list of selected recommended tourist spots and restaurants, and adds related information (location, business hours, cashless payment availability, etc.). The server then returns the generated recommendation information to the terminal.

[0094] Step 7:

[0095] The device displays the recommended information received from the server to the user, including detailed information such as the addresses, access information, and opening hours of "Hakone Onsen" and "Ramen Museum."

[0096] Step 8:

[0097] The user checks the displayed details and plans a visit. The server generates a special experience based on the user's interests (e.g., an exclusive guided tour of the Ramen Museum) and sends it to the device.

[0098] Step 9:

[0099] The device displays detailed information about the special experience to the user, including an overview of the special experience, how to book, and the price.

[0100] Step 10:

[0101] A user books a special experience and pays using an online payment application. The terminal sends the payment information to a server, which processes the booking to confirm the booking.

[0102] This series of steps allows foreign tourists to easily find tourist spots and restaurants in Japan, book special experiences, and use cashless payment, providing a comfortable and convenient tourist experience for travelers.

[0103] Example 1

[0104] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0105] There is a lack of support systems to ensure that foreign tourists visiting Japan can enjoy sightseeing and dining in the country with peace of mind. Furthermore, there is no centralized system in place to provide information on tourist spots and restaurants, reservations for special experiences, and cashless payments. Furthermore, there is a lack of means to provide travelers with the information they need at the right time at specific locations. This makes it difficult for travelers to spend their stay comfortably and efficiently.

[0106] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0107] In this invention, the server includes a means for a user to download and install an online payment application to a mobile terminal, a means for the user to input information about their interests and past experiences, a means for using an AI algorithm to suggest tourist spots and restaurants based on the user's input information, a notification means for prompting the user to download the online payment application at a specific location, and a means for checking whether the suggested tourist spots and restaurants accept cashless payment. This allows foreign tourists visiting Japan to enjoy sightseeing and dining efficiently and comfortably at their destinations.

[0108] An "online payment application" is software that allows users to pay for goods and services over the Internet using their mobile devices.

[0109] "Mobile terminal" refers to a portable computing device such as a smartphone or tablet.

[0110] "AI algorithm" refers to the computational procedures used by artificial intelligence (AI) to analyze and make predictions based on data.

[0111] "Tourist destination" means a place visited by tourists or visitors for tourism purposes.

[0112] "Restaurant" refers to a place that serves food and drinks and where customers eat and drink.

[0113] "Special experiences" refer to unique services and activities that differ from regular sightseeing and dining, and are special experiences that are offered under specific conditions.

[0114] "Notification means" refers to a system or method for conveying information to users when certain conditions are met.

[0115] "Cashless payment" refers to a payment method that does not use cash but instead uses credit cards, digital wallets, etc.

[0116] This invention is a system that allows foreign tourists visiting Japan to use cashless payment smoothly and safely when enjoying sightseeing, dining, and drinking within the country. The system consists of a mobile device such as a user's smartphone or tablet, a server computer system for storing, processing, and transmitting data, and an online payment application.

[0117] First, when a user arrives at a major arrival point such as Narita Airport and connects their smartphone to Wi-Fi, the mobile device automatically displays a pop-up notification. The pop-up notification includes a message saying, "Download an app to make your trip more convenient." When the user taps on this notification, they are directed to an app store where they can download and install an online payment application. Specific software names used include, for example, "PayPay" and "Alipay."

[0118] After installation is complete, the user launches the app for the first time. The mobile device displays a language setting screen and prompts the user to select a language. For example, English is selected. The device then displays the initial setting screen, where the user inputs their interests (e.g., hot springs) and past travel experiences (e.g., first visit to Japan). The input information is sent from the device to the server.

[0119] The server analyzes the received information using an AI algorithm (e.g., TensorFlow model) built into it. Based on the analysis results, it selects the most suitable tourist spots and restaurants for the user. For example, places such as Hakone Onsen and the Ramen Museum may be selected. The server generates this information as a list and sends it to the device.

[0120] The server displays recommended information on the user's device. This information also includes detailed information about each recommended spot (such as its location, opening hours, and whether cashless payment is accepted). If a special experience is suggested, the server generates a special experience, such as a guided tour exclusive to the Ramen Museum, and sends that information to the user's device. The user can then reserve this special experience and pay for it using an online payment application.

[0121] Through the above series of processes, foreign tourists visiting Japan can efficiently find tourist attractions and restaurants, book special experiences, and make cashless payments safely and smoothly.

[0122] Specific examples and examples of prompts for generative AI models

[0123] A concrete example is when a user arrives at Narita Airport and checks the pop-up notification that appears after connecting to Wi-Fi. The device displays the notification, and when the user taps it, the app store page is immediately opened. While the user downloads and installs an online payment application, the device displays the installation progress to the user. The user then launches the app, selects English, and enters "hot springs" as an interest and "first visit to Japan" as a past experience. The device sends the information to the server, and the server returns "Hakone Hot Springs" and "Ramen Museum" as recommendations. The device displays detailed information, and the user books the special experience and pays using the online payment application.

[0124] An example of a prompt for a generative AI model is as follows:

[0125] Please explain the process that a foreign tourist visiting Japan goes through after arriving at Narita Airport: connecting to Wi-Fi, tapping the pop-up notification, and installing a cashless payment app for Japan from the app store. Please then provide a detailed explanation of the steps involved, from launching the app for the first time, to being presented with recommended tourist spots and restaurants, and making reservations and payments for special experiences.

[0126] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0127] Step 1:

[0128] Download and install the app

[0129] The user arrives at Narita Airport and connects their smartphone to Wi-Fi.

[0130] The device will detect a Wi-Fi connection and display a pop-up notification with the message "Download apps to make your travel easier."

[0131] When users tap on the notification, they are directed to the app store.

[0132] A user downloads an online payment application from an app store and installs it on their device, during which the device displays the installation progress.

[0133] Input: User's Wi-Fi connection

[0134] Output: Show popup notification

[0135] Example of operation

[0136] The device runs a program that monitors Wi-Fi connections in the background and triggers a popup when a connection is made.

[0137] The user taps the notification, which opens the specified page in the app store.

[0138] The user downloads the app and is presented with an installation screen once complete.

[0139] Step 2:

[0140] First time launch and setup

[0141] The first time a user launches an installed app.

[0142] The device displays the language setting screen and prompts the user to select a language. The user selects English.

[0143] Once the language selection is complete, the device displays an initial setup screen, where the user enters their interests (e.g., hot springs) and past travel experiences (e.g., first visit to Japan).

[0144] Input: First launch of the app, user language selection, interests and travel experience

[0145] Output: Display of initial setting screen, accumulation of input data

[0146] Example of operation

[0147] The device will automatically display the language selection screen when first started.

[0148] Once the user selects a language, the language preference is saved within the app.

[0149] Users enter their interests and travel experiences and store that data in a local database.

[0150] Step 3:

[0151] Enter information

[0152] The user confirms their interests and past travel experiences on the settings screen and completes the input.

[0153] The terminal transmits the input information to the server.

[0154] Input: User interests and past travel experience data

[0155] Output: Send data to the server

[0156] Example of operation

[0157] The device sends the user input data in JSON format to the server.

[0158] When transmitting data, we use encryption technology (e.g., SSL / TLS) to ensure security.

[0159] The server receives the data and sends a confirmation response back to the terminal.

[0160] Step 4:

[0161] Receiving and analyzing information

[0162] The server receives information about the user's interests and past travel experiences sent from the terminal.

[0163] The server uses an AI algorithm (e.g., TensorFlow) to analyze the input information and select the best tourist spots and restaurants for the user based on the analysis results.

[0164] Input: User interests and past travel experience data

[0165] Output: A list of recommended tourist spots and restaurants as analysis results

[0166] Example of operation

[0167] The server stores the received data in a database and inputs it into the AI ​​model.

[0168] The AI ​​model predicts and generates a list of tourist attractions and restaurants that best fit your interests.

[0169] The generated list is converted to JSON format and sent to the terminal.

[0170] Step 5:

[0171] Generating and sending recommendations

[0172] The server generates a list of recommended tourist spots and restaurants based on the analysis results. For example, "Hakone Onsen" and "Ramen Museum" might be selected.

[0173] The server generates recommendation information and sends it to the terminal.

[0174] Input: Analysis result data

[0175] Output: A list of recommendations

[0176] Example of operation

[0177] The server creates a list based on the analysis results and stores it in a database.

[0178] The server encodes the list data in JSON format and sends it to the terminal.

[0179] Step 6:

[0180] Displaying recommendations

[0181] The device displays the recommended information received from the server.

[0182] The device will display detailed information about each recommended spot (location, opening hours, whether cashless payment is accepted, etc.).

[0183] Input: Recommendations from the server

[0184] Output: Detailed information displayed on the device display

[0185] Example of operation

[0186] The device receives and decodes the JSON response from the server.

[0187] The decoded data is displayed in a user interface.

[0188] Detailed information about each spot is displayed in text and image format.

[0189] Step 7:

[0190] Special experience booking and payment

[0191] The server generates a special experience for the user (e.g., a guided tour exclusive to the Ramen Museum) and transmits that information to the terminal.

[0192] A user books a special experience and pays for it using an online payment application.

[0193] Input: Special experience information, user reservation and payment information

[0194] Output: Special experience reservation confirmation and payment completion notification

[0195] Example of operation

[0196] The server generates special experience information and sends it to the device.

[0197] The device displays details about the special experience and provides a booking form.

[0198] Once the user makes a reservation and enters their payment information, the terminal initiates the online payment process.

[0199] Once payment is complete, a confirmation notice is sent to the terminal via the server.

[0200] (Application example 1)

[0201] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0202] The goal is to provide a system that allows foreign tourists visiting Japan to smoothly use cashless payment while enjoying sightseeing and dining in Japan, without having to face language barriers or the inconvenience of cash payments. There is also a need for a system that allows tourists to easily find nearby restaurants and order food on the spot.

[0203] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0204] In this invention, the server includes a means for receiving user input information, a means including an algorithm for suggesting tourist spots and restaurants based on the input information, and a means including a generative AI model for generating recommended dishes and restaurants based on the user's current location and interests. This allows foreign tourists visiting Japan to smoothly use cashless payment while enjoying tourist spots and restaurants in Japan, and further enables them to easily find and order recommended dishes and restaurants on the spot.

[0205] "Users" are foreign tourists visiting Japan who use the system to enjoy sightseeing, dining and drinking within Japan.

[0206] An "online payment application" is software that users install on their mobile devices, such as smartphones or tablets, to purchase goods or reserve services cashlessly.

[0207] A "mobile terminal" is a portable device such as a smartphone or tablet.

[0208] "Interests" refers to information about sightseeing and activities that users would like to experience in Japan.

[0209] "Past experience" refers to information about the user's past travel experiences, hobbies, and preferences.

[0210] A "server" is a computer system that receives information entered by users and processes and analyzes that information.

[0211] The "algorithm for suggesting tourist spots and restaurants" is a calculation procedure for selecting and suggesting appropriate tourist spots and restaurants based on the user's interests and past experiences.

[0212] "Suggestion information" is a list of tourist spots and restaurants recommended for the user, sent from the server.

[0213] A "special experience" is a special sightseeing or dining experience that is different from the usual and is booked based on the suggested information.

[0214] A "generative AI model" is an artificial intelligence model that generates recommended dishes and restaurants based on a user's current location and interests.

[0215] "Notification means" refers to a method for prompting a user to download an online payment application when the user reaches a specific location.

[0216] "Cashless payment" is a method of paying for goods and services without using cash.

[0217] The system of the present invention is designed to enable users to smoothly make cashless payments while enjoying sightseeing spots and restaurants in Japan. The main components of this system are a mobile terminal (such as a smartphone or tablet), a server, and an online payment application.

[0218] System Operation Overview

[0219] 1. Download and install the app

[0220] When a user arrives at a specific location (e.g., an airport or major tourist destination), a pop-up notification appears on the mobile device after connecting to Wi-Fi, allowing the user to download and install an online payment application from an app store.

[0221] 2. First launch and setup

[0222] A user launches the app and selects their native language (e.g., English) from the language settings screen. The app then prompts the user to enter information about their interests and past travel experiences.

[0223] 3. Entering information and sending it to the server

[0224] The user inputs their interests (e.g., Japanese cuisine (hot springs, etc.)) and past travel experiences (e.g., first visit to Japan) and sends this information to the server.

[0225] Processing on the server

[0226] 4. Receiving and analyzing information

[0227] The server receives the information sent by the user and analyzes it using an AI algorithm. This algorithm selects recommended tourist spots and restaurants based on the user's interests and past experiences. The server also uses a generative AI model to generate recommended dishes and restaurants based on the user's current location and interests.

[0228] 5. Generating and sending recommendations

[0229] The server generates recommended information (e.g., tourist spot "Hakone Hot Springs," restaurant "Sushi Restaurant") and sends it to the mobile terminal.

[0230] Displaying results and settlement

[0231] 6. Display of recommended information

[0232] The mobile device displays the recommended information received from the server, along with detailed information about each recommended spot (e.g., location, business hours, whether cashless payment is accepted, etc.).

[0233] 7. Special Experience Reservations and Payment

[0234] Users can book special experiences based on the displayed information and pay cashlessly through the app, such as special guided tours or limited menus.

[0235] Hardware and software used

[0236] Mobile devices: smartphones, tablets, etc.

[0237] Server: A computer system that performs on-demand data processing.

[0238] Online payment applications: Cashless payment services such as PayPal and Stripe.

[0239] Generative AI models: Artificial intelligence models such as GPT-3, BERT, etc.

[0240] Specific examples and examples of prompts for generative AI models

[0241] As a concrete example, a user arrives at Narita Airport and taps on a pop-up notification after connecting to Wi-Fi. The user downloads an online payment application from the app store and installs it on their mobile device. Next, the user launches the application, selects English, and enters "hot springs" as their interest and "first visit to Japan" as their past experience. The server receives the information, returns "Hakone Hot Springs" and "Sushi Restaurant" as recommendations, and the device displays the information. The user then books a special experience and makes a payment using the online payment application.

[0242] An example of a prompt for a generative AI model is:

[0243] "We are designing a food delivery application for foreign tourists. Please provide recommendations for Japanese restaurants and dishes based on the following information:

[0244] Interests: Hot spring trips

[0245] Past experience: First visit to Japan

[0246] Current location: Tokyo Station

[0247] Create results that include specific restaurant names, their features, and special offers.

[0248] As described above, this system provides foreign tourists visiting Japan with a comfortable and convenient sightseeing and dining experience.

[0249] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0250] Step 1:

[0251] When a user arrives at a specific location (e.g., an airport or major tourist destination) and connects to Wi-Fi, a pop-up notification appears on the device, prompting the user to download and install an online payment application from the app store by tapping the notification.

[0252] Input: User's current location and Wi-Fi connection

[0253] Output: Show popup notification

[0254] Specific operation: The device generates and displays a pop-up notification based on GPS data and Wi-Fi connection information.

[0255] Step 2:

[0256] The user starts the application and selects their native language (e.g., English) on the language setting screen.

[0257] Input: User launches application for the first time

[0258] Output: Display of language setting screen

[0259] What it does: When the app first launches, it loads the default settings and prompts the user to select a language.

[0260] Step 3:

[0261] The user enters information about their interests (e.g., hot springs) and past travel experiences (e.g., first visit to Japan) and presses the submit button.

[0262] Input: User input of interests and past experiences

[0263] Output: Sending input information to the server

[0264] Specific operation: The information entered by the user is sent by the terminal to the server as an HTTP request.

[0265] Step 4:

[0266] The server analyzes the information received from the user and uses an AI algorithm to select recommended tourist spots and restaurants based on the user's interests and past experiences.

[0267] Input: User interests and past experiences

[0268] Output: A list of recommended tourist spots and restaurants

[0269] How it works: The server uses a generative AI model (such as GPT-3) to generate prompts and then creates a list of tourist attractions and restaurants based on those prompts. The following prompts are used:

[0270] "We are designing a food delivery application for foreign tourists. Please provide recommendations for Japanese restaurants and dishes based on the following information:

[0271] Interests: Hot spring trips

[0272] Past experience: First visit to Japan

[0273] Current location: Tokyo Station

[0274] Create results that include specific restaurant names, their features, and special offers.

[0275] Step 5:

[0276] The server generates a list of recommended tourist spots and restaurants and sends it to the terminal.

[0277] Input: Recommended tourist spots and restaurant list

[0278] Output: Send the list to the mobile device

[0279] Specific operation: The server returns the generated list to the terminal as an HTTP response.

[0280] Step 6:

[0281] The device displays the recommended information received from the server.

[0282] Input: A list of recommendations from the server

[0283] Output: Display information on the terminal

[0284] Specific operation: The device analyzes the data received and displays it in a format that is easy for the user to view.

[0285] Step 7:

[0286] The user can book a special experience (e.g., a guided tour or a limited menu) based on the displayed information and make a cashless payment through an online payment application.

[0287] Input: User reservation information and payment information

[0288] Output: Reservation and payment completion notification

[0289] Specific operation: The terminal sends the reservation details to the server, and processes the transaction using an online payment API (e.g., PayPal or Stripe) as the payment process. As a result, a notification of the completion of the reservation and payment is displayed to the user.

[0290] By following these steps, foreign visitors to Japan can comfortably enjoy tourist spots and restaurants around the country and smoothly use cashless payment methods.

[0291] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0292] The system of the present invention is designed to enable foreign tourists visiting Japan to enjoy tourist spots and restaurants in Japan with peace of mind and to use cashless payment. Furthermore, it provides a more personalized tourist experience by recognizing the user's emotions and making customized suggestions based on those emotions. A specific embodiment of this system is described below.

[0293] System Overview

[0294] The system consists of the following main components:

[0295] Mobile devices (such as users' smartphones or tablets)

[0296] Server (a computer system that stores, processes, and transmits data)

[0297] Online payment application

[0298] Emotion engine (software for recognizing user emotions)

[0299] User operation steps

[0300] 1. Download and install the app

[0301] When users arrive at Narita Airport or other major arrival points, a pop-up notification will appear after connecting to Wi-Fi.

[0302] The user taps the pop-up notification, downloads the online payment application from the app store, and installs it on the mobile device.

[0303] 2. First launch and setup

[0304] The user launches the app and selects English from the language settings screen.

[0305] The app displays an initial setup screen, prompting the user to enter information about their interests and past experiences.

[0306] 3. Enter information

[0307] Users input their interests (e.g., hot springs) and past travel experiences (e.g., first visit to Japan), and the emotion engine analyzes the user's facial expressions and voice to recognize their emotions.

[0308] The device sends the input information and emotion data to the server.

[0309] Processing on the server

[0310] 4. Receiving and analyzing information

[0311] The server receives the input information and emotion data sent from the terminal.

[0312] The server uses AI algorithms and an emotion engine to select recommended tourist spots and restaurants based on input interests, past experiences, and recognized emotions.

[0313] 5. Generating and sending recommendations

[0314] The server generates a list of recommended tourist spots and restaurants for the user. For example, "Hakone Onsen" or "Ramen Museum" are selected.

[0315] The server returns the generated recommendations to the device.

[0316] Displaying results and offering special experiences

[0317] 6. Display of recommended information

[0318] The device displays the recommended information received from the server.

[0319] Detailed information about each recommended spot (location, opening hours, whether cashless payment is accepted, etc.) is displayed.

[0320] 7. Special Experience Reservations and Payment

[0321] The server generates a special experience (e.g., a guided tour exclusive to the Ramen Museum) and displays it in the app.

[0322] A user books a special experience and pays for it using an online payment application.

[0323] Specific examples

[0324] The user arrives at Narita Airport and taps the pop-up notification that appears after connecting to Wi-Fi.

[0325] A user downloads an online payment application from an app store and installs it on a mobile device.

[0326] The user starts the app, selects English, and enters "hot springs" as their interest and "first visit to Japan" as their past experience. The emotion engine recognizes the user's emotions from their facial expressions and voice.

[0327] The device sends information and emotional data to the server, which then returns recommendations for "Hakone Onsen" and "Ramen Museum."

[0328] The device displays the recommended information, and the user checks for more information.

[0329] The server generates a "Ramen Museum Exclusive Guided Tour," which the user reserves and pays for using an online payment application.

[0330] This series of processes allows foreign tourists visiting Japan to easily find tourist attractions and restaurants within Japan, and by receiving emotion-based suggestions, they can enjoy a more personalized sightseeing experience. This system provides users with a comfortable and convenient sightseeing experience.

[0331] The processing flow will be explained below.

[0332] Step 1:

[0333] When the user arrives at Narita Airport and connects to Wi-Fi, a pop-up notification appears. The device displays a pop-up notification prompting the user to download an online payment application.

[0334] Step 2:

[0335] The user taps the pop-up notification and downloads the online payment application from the app store. The device installs the application and displays a notification that the installation is complete.

[0336] Step 3:

[0337] After installation, a user launches the app and selects English on the language settings screen. The device displays an initial setup screen, prompting the user to enter information about their interests and past experiences.

[0338] Step 4:

[0339] The user enters information such as "Interests: Hot Springs, Food: Ramen, Experience: First visit to Japan" into the information input form, and the emotion engine analyzes the user's facial expressions and voice to recognize their emotions. The device then sends the input information and emotion data to the server.

[0340] Step 5:

[0341] The server receives input information and emotion data sent from the device, analyzes the received information, and uses AI algorithms and emotion engines to select recommended tourist spots and restaurants based on the user's interests, past experiences, and recognized emotions.

[0342] Step 6:

[0343] The server generates a list of selected recommended tourist spots and restaurants, and adds related information (location, business hours, cashless payment availability, etc.). The server then returns the generated recommendation information to the terminal.

[0344] Step 7:

[0345] The device displays the recommended information received from the server to the user, including detailed information such as the addresses, access information, and opening hours of "Hakone Onsen" and "Ramen Museum."

[0346] Step 8:

[0347] The user checks the displayed details and plans a visit. The server generates a special experience (e.g., an exclusive guided tour of the Ramen Museum) based on the user's interests and emotions and sends it to the device.

[0348] Step 9:

[0349] The device displays detailed information about the special experience to the user, including an overview of the special experience, how to book, and the price.

[0350] Step 10:

[0351] A user books a special experience and pays using an online payment application. The terminal sends the payment information to a server, which processes the booking to confirm the booking.

[0352] This series of steps makes it easier for foreign tourists visiting Japan to find tourist attractions and restaurants within the country, and by receiving customized suggestions based on their own emotions, they can enjoy a more personalized sightseeing experience. This system provides users with a comfortable and convenient sightseeing experience.

[0353] Example 2

[0354] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0355] In order for foreign tourists visiting Japan to enjoy tourist spots and restaurants in Japan with peace of mind, appropriate guidance and the widespread adoption of cashless payment are essential. However, there are few systems that can overcome language barriers, provide personalized information tailored to the interests of individual travelers, and improve the convenience of online payments. This invention solves these issues by providing a system that makes customized suggestions based on travelers' interests and emotions and facilitates cashless payment.

[0356] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for transmitting user input information and emotion data to the server, a means including an algorithm for the server to suggest tourist spots and restaurants based on the user input information and emotion data, and a means for transmitting the suggestion information to the user's mobile terminal. This enables foreign tourists visiting Japan to overcome language barriers, obtain personalized tourist information based on their individual emotions, and easily make cashless payments.

[0357] An "online payment application" is software that allows users to pay for goods and services over the Internet without using cash.

[0358] A "mobile terminal" is an electronic device that a user can carry around and has a communication function, and includes smartphones, tablets, and the like.

[0359] "Interests" refers to information about topics, activities, tourist destinations, etc. that are of particular interest to users.

[0360] "Past experience" refers to the history of trips and activities that a user has previously undertaken.

[0361] "Emotion data" is data that reflects the user's current emotions, and is information obtained through facial expression and voice analysis, etc.

[0362] A "server" is a computer system that receives, stores, processes, and transmits data.

[0363] An "AI algorithm" is a computational procedure that uses artificial intelligence techniques to analyze data and produce a specific result.

[0364] "Suggested information" is information about recommended tourist spots, restaurants, etc. that is generated by the server based on the user's input information and emotional data.

[0365] A "special experience" is a plan that offers additional benefits and exclusive services in addition to regular sightseeing and dining.

[0366] A "notification means" is a system that displays messages or alerts to encourage users to take specific actions.

[0367] "Cashless payment" refers to transactions that are conducted using electronic payment methods without using cash.

[0368] The present invention is a system that allows foreign tourists visiting Japan to enjoy tourist spots and restaurants in Japan with peace of mind and use cashless payment. Furthermore, the system provides a personalized tourism experience by recognizing the user's emotions and making customized suggestions based on those emotions. A specific embodiment of this system is described below.

[0369] System configuration

[0370] The system consists of the following main components:

[0371] 1. Mobile terminal: An electronic device with communication capabilities, such as a user's smartphone or tablet.

[0372] 2. Server: A computer system that stores, processes, and transmits data.

[0373] 3. Online payment application: Software that allows users to pay for goods and services over the Internet without using cash.

[0374] 4. Emotion engine: Software that analyzes the user's facial expressions and voice to recognize emotions.

[0375] Operational Overview

[0376] Download and install the app

[0377] When users arrive at Narita Airport or other major arrival points, a pop-up notification will appear after connecting to Wi-Fi. By tapping on this notification, users can download an online payment application from the app store and install it on their mobile device.

[0378] First time launch and setup

[0379] When users first launch the app, they are prompted to select English as their language setting. They are then prompted to enter information about their interests and past experiences. For example, they can enter "hot springs" as their interest and "first visit to Japan" as their past travel experience.

[0380] Information input and emotion recognition

[0381] The emotion engine analyzes the user's facial expressions and voice to recognize their current emotion, and the acquired emotion data and input information are sent from the device to the server.

[0382] Data processing on the server

[0383] The server uses an AI algorithm to analyze the inputted interests, past experiences, and recognized emotions. As a result of the analysis, information on recommended tourist spots and restaurants is generated. For example, "Hakone Onsen" and "Ramen Museum" are selected.

[0384] Displaying recommendations

[0385] The server sends the generated recommendation information to the device, which then displays it to the user. Detailed information about each recommended spot is also displayed at the same time. The user decides on a destination based on the displayed information.

[0386] Special experience booking and payment

[0387] The server generates special experiences (e.g., "Exclusive Guided Tour of Ramen Museum") and displays them in the app. Users can book them and pay for them using an online payment application.

[0388] Specific examples

[0389] The user arrives at Narita Airport, connects to Wi-Fi, and then taps the popup notification.

[0390] A user downloads an online payment application from an app store and installs it on a mobile device.

[0391] A user launches the app, selects English, and enters their interest in "hot springs" and their past experience as "first visit to Japan."

[0392] The emotion engine recognizes the user's emotions from facial expressions and voice.

[0393] The device sends information and emotional data to the server, which then returns recommendations for "Hakone Onsen" and "Ramen Museum."

[0394] The device displays the recommended information, and the user checks for more information.

[0395] The server generates a "Ramen Museum Exclusive Guided Tour," which the user reserves and pays for using an online payment application.

[0396] In this way, foreign tourists visiting Japan can enjoy tourist attractions and restaurants in Japan with peace of mind, and receive emotion-based suggestions for a more personalized sightseeing experience. The system is designed to provide users with a comfortable and convenient sightseeing experience.

[0397] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0398] Step 1: Download and install the app

[0399] Once users arrive and connect to Wi-Fi, they will receive a pop-up notification containing a link to download a dedicated app for visitors to Japan.

[0400] The user taps on the popup notification and is redirected to the app store.

[0401] The user downloads the app and installs it on their device.

[0402] Input: Wi-Fi connection, popup notification

[0403] Output: App download link display, app installation

[0404] Step 2: First launch and language setting

[0405] The user launches the app for the first time.

[0406] The terminal displays a language setting screen, and the user selects English.

[0407] Input: Launch the app, display the language setting screen

[0408] Output: Language selection (English)

[0409] Step 3: Enter your interests and past experiences

[0410] The device will display an initial setup screen, prompting you to enter your interests and past travel experiences.

[0411] The user enters information such as "hot springs" and "first visit to Japan."

[0412] The emotion engine analyzes facial expressions and voice to recognize the current emotion.

[0413] Input: Initial setup screen display, interests, past travel experiences, user facial expressions and voice

[0414] Output: Input information and emotion data

[0415] Step 4: Sending data to the server

[0416] The terminal transmits the input information and emotion data to the server.

[0417] Input: Input information and emotion data

[0418] Output: Sending data to the server, confirming data reception

[0419] Step 5: Data analysis on the server

[0420] The server receives the input information and emotion data.

[0421] The server uses AI algorithms to analyze the input interests, past experiences, and recognized emotions.

[0422] The server selects recommended tourist spots and restaurants based on the analysis results.

[0423] Input: Input information and emotion data

[0424] Output: Analysis results, list of selected tourist spots and restaurants

[0425] Step 6: Generate and send recommendations

[0426] The server generates recommendations based on the analysis results, such as "Hakone Hot Springs" or "Ramen Museum."

[0427] The server generates recommendation information and sends it to the terminal.

[0428] Input: Analysis results

[0429] Output: Recommendations, data sent to device

[0430] Step 7: View recommendations

[0431] The device displays the recommended information received from the server.

[0432] Detailed information about each recommended spot (location, opening hours, whether cashless payment is accepted, etc.) is displayed.

[0433] Input: Recommendations

[0434] Output: Show detailed information

[0435] Step 8: Book and pay for your special experience

[0436] The server generates a special experience (e.g., a guided tour exclusive to the Ramen Museum) and displays it in the app.

[0437] A user books a special experience and pays for it using an online payment application.

[0438] Input: Special experience information, booking request

[0439] Output: Reservation completion notification, payment completion notification

[0440] This series of processing steps allows foreign tourists to enjoy sightseeing spots and restaurants in Japan with peace of mind. Utilizing emotion data also makes it possible to provide personalized sightseeing suggestions.

[0441] (Application example 2)

[0442] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0443] When foreign tourists visit Japan, they often face difficulties in finding suitable dining facilities due to language barriers and cultural differences, and it is also cumbersome to check whether online payment is available. Therefore, personalized suggestions based on emotions are needed so that visitors can enjoy their meals with peace of mind.

[0444] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0445] means including an algorithm for suggesting dining establishments based on user input information and data from an emotion recognition engine;

[0446] means for transmitting the proposal information to a user's mobile terminal;

[0447] means for ordering meals and making online payments based on the suggested information;

[0448] This allows for suggestions of dining options and menus based on the user's current mood and preferences, and allows for seamless food ordering and online payment.

[0449] An "online payment application" is software that allows users to make payments safely and quickly via the Internet using mobile devices such as smartphones and tablets.

[0450] A "mobile terminal" is an electronic device that a user can carry with them, such as a smartphone, tablet, or laptop.

[0451] "Interests" are information about specific things or activities that a user is particularly interested in and enjoys.

[0452] "Past experiences" are information about events or activities that the user has previously experienced.

[0453] An "emotion recognition engine" is software that analyzes facial expressions and voice data to identify a user's current emotional state.

[0454] "Food and beverage establishments" are places that serve food and drinks, such as restaurants, cafes, and bars.

[0455] "Input information" is data about interests and past experiences that a user provides to an application.

[0456] "Suggested information" is information about optimal dining facilities and menus generated by the server based on the user's input information and emotional state.

[0457] "Ordering a meal" refers to the act of purchasing a food and drink menu item selected by the user based on the suggested information.

[0458] A "special experience" is a special service or activity that differs from normal usage and provides added value to the user.

[0459] This invention is a system that provides personalized suggestions based on emotions to foreign tourists visiting Japan when they visit restaurants and other establishments in Japan, reducing language barriers and cultural differences. The system consists of a user's mobile device, a server, an online payment application, and an emotion recognition engine.

[0460] System Overview

[0461] The system includes the following major components:

[0462] Mobile device: An electronic device that can be carried by a user, such as a smartphone or tablet.

[0463] Server: A computer system that stores, processes, and transmits data.

[0464] Online payment application: Software that allows you to make payments securely and quickly over the internet (e.g., PayPal, Stripe).

[0465] Emotion recognition engine: Software that analyzes facial and voice data to identify a user's emotional state (e.g., Microsoft Azure Cognitive Services).

[0466] User operation steps

[0467] 1. Download and install the app

[0468] A user downloads an online payment application from an app store and installs it on a mobile device.

[0469] 2. First launch and setup

[0470] The user starts the app, selects an appropriate language (e.g., English) from the language setting screen, and enters their interests (e.g., Japanese food, Chinese food) and past experiences (e.g., vegetarian, likes spicy food).

[0471] 3. Emotion recognition

[0472] The mobile device captures the user's facial expressions and voice data and analyzes them in real time using an emotion recognition engine.

[0473] 4. Information Transmission

[0474] The mobile terminal transmits the input information and the recognized emotion data to the server.

[0475] Processing on the server

[0476] The server does the following:

[0477] 1. Analysis of information

[0478] The server receives the input information and emotional data sent by the user and uses an AI algorithm and emotion recognition engine to select the most suitable dining establishments and menus for the user.

[0479] 2. Proposal information generation

[0480] The server generates a list of optimal dining options and menus based on the user's current mood and preferences.

[0481] 3. Sending Proposal Information

[0482] The server transmits the generated proposal information to the user's mobile terminal.

[0483] Viewing and manipulating results

[0484] 1. Display of suggested information

[0485] The mobile terminal receives the proposal information and the user confirms it.

[0486] 2. Ordering and Payment

[0487] The user selects from suggested dining options and menus and pays through an online payment application.

[0488] Specific examples

[0489] Specifically, an example of how this system works is shown below.

[0490] scenario:

[0491] A user launches an emotion-aware food delivery app on their smartphone and feels a bit down today.

[0492] The app can recognize the emotion of "sadness" from the user's facial expression and suggest hot soup or comforting meals.

[0493] Example prompt sentence:

[0494] User Information:

[0495] Favorite cuisine type: Japanese

[0496] Preferred spiciness level: Medium

[0497] Specific allergies: None

[0498] Inferred emotion: Sadness

[0499] AI algorithm recommendation results:

[0500] Maiki Pumpkin Soup (Warm and comforting)

[0501] Porridge set meal (healthy and very comforting)

[0502] This system will enable personalized, emotion-based recommendations for dining options and menus, as well as easy online payment.

[0503] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0504] Step 1:

[0505] Download and install the app

[0506] A user downloads an online payment application from an app store and installs it on a mobile device.

[0507] Enter: App Store

[0508] Output: Applications installed on the mobile device

[0509] Step 2:

[0510] First time launch and setup

[0511] A user starts the app, selects English from the language setting screen, and enters their interests (e.g., Japanese food, Chinese food) and past experiences (e.g., vegetarian, likes spicy food).

[0512] Input: User interests and past experiences

[0513] Output: The user's input information is saved in the mobile device.

[0514] Step 3:

[0515] emotion recognition

[0516] The mobile device captures the user's facial expressions and voice data and analyzes them in real time using an emotion recognition engine.

[0517] Input: User's facial expressions and voice data

[0518] Output: User emotion data

[0519] Step 4:

[0520] Information transmission

[0521] The mobile terminal transmits the input information and the recognized emotion data to the server.

[0522] Input: User input information and emotion data

[0523] Output: Data sent to the server

[0524] Step 5:

[0525] Analysis of information

[0526] The server receives the input information and emotional data sent by the user and uses an AI algorithm and emotion recognition engine to select the most suitable dining establishments and menus for the user.

[0527] Input: User input information and emotion data

[0528] Output: Restaurant and menu suggestions

[0529] Step 6:

[0530] Generate suggestions

[0531] The server generates a list of optimal dining options and menus based on the user's current mood and preferences.

[0532] Input: Analysis results of information

[0533] Output: Generated proposal information

[0534] Step 7:

[0535] Sending Proposal Information

[0536] The server transmits the generated proposal information to the user's mobile terminal.

[0537] Input: Generated proposal information

[0538] Output: Proposal information sent to the mobile terminal

[0539] Step 8:

[0540] Displaying Proposal Information

[0541] The mobile terminal receives the proposal information and the user confirms it.

[0542] Input: Proposal information sent from the server

[0543] Output: Proposal information displayed on the mobile device

[0544] Step 9:

[0545] Ordering and Payment

[0546] The user selects from suggested dining options and menus and pays through an online payment application.

[0547] Input: User's choice

[0548] Output: Completed order and payment information

[0549] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0550] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0551] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0552] [Second embodiment]

[0553] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0554] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0555] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0556] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0557] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0558] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0559] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0560] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0561] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0562] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0563] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0564] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0565] The system of the present invention is designed to enable foreign tourists visiting Japan to enjoy tourist spots and restaurants in Japan with peace of mind and to use cashless payment. A specific embodiment of this system will be described below.

[0566] System Overview

[0567] The system consists of the following main components:

[0568] Mobile devices (such as users' smartphones or tablets)

[0569] Server (a computer system that stores, processes, and transmits data)

[0570] Online payment application

[0571] User operation steps

[0572] 1. Download and install the app

[0573] When users arrive at Narita Airport or other major arrival points, a pop-up notification will appear after connecting to Wi-Fi.

[0574] The user taps the pop-up notification, downloads the online payment application from the app store, and installs it on the mobile device.

[0575] 2. First launch and setup

[0576] The user launches the app and selects English from the language settings screen.

[0577] The app displays an initial setup screen, prompting the user to enter information about their interests and past experiences.

[0578] 3. Enter information

[0579] The user enters their interests (e.g., hot springs), past travel experiences (e.g., first visit to Japan), etc.

[0580] The terminal transmits the input information to the server.

[0581] Processing on the server

[0582] 4. Receiving and analyzing information

[0583] The server receives input information from the terminal.

[0584] The server uses AI algorithms to select recommended tourist spots and restaurants based on input interests and past experiences.

[0585] 5. Generating and sending recommendations

[0586] The server generates a list of recommended tourist spots and restaurants for the user. For example, "Hakone Onsen" or "Ramen Museum" are selected.

[0587] The server transmits the generated recommendation information to the terminal.

[0588] Displaying results and offering special experiences

[0589] 6. Display of recommended information

[0590] The device displays the recommended information received from the server.

[0591] Detailed information about each recommended spot (location, opening hours, whether cashless payment is accepted, etc.) is displayed.

[0592] 7. Special Experience Reservations and Payment

[0593] The server generates a special experience (e.g., a guided tour exclusive to the Ramen Museum) and displays it in the app.

[0594] A user books a special experience and pays for it using an online payment application.

[0595] Specific examples

[0596] The user arrives at Narita Airport and taps the pop-up notification that appears after connecting to Wi-Fi.

[0597] A user downloads an online payment application from an app store and installs it on a mobile device.

[0598] A user launches the app, selects English, and enters "hot springs" as their interest and "first visit to Japan" as their past experience.

[0599] The device sends the information to the server, which then returns "Hakone Onsen" and "Ramen Museum" as recommendations.

[0600] The device displays the recommended information, and the user checks for more information.

[0601] The server generates a "Ramen Museum Exclusive Guided Tour," which the user reserves and pays for using an online payment application.

[0602] Through this process, foreign tourists visiting Japan can smoothly find tourist spots and restaurants, book special experiences, and use cashless payment. This system provides users with a comfortable and convenient tourist experience.

[0603] The processing flow will be explained below.

[0604] Step 1:

[0605] When the user arrives at Narita Airport and connects to Wi-Fi, a pop-up notification appears. The device displays a pop-up notification prompting the user to download an online payment application.

[0606] Step 2:

[0607] The user taps the pop-up notification and downloads the online payment application from the app store. The device installs the application and displays a notification that the installation is complete.

[0608] Step 3:

[0609] After installation, a user launches the app and selects English on the language settings screen. The device displays an initial setup screen, prompting the user to enter information about their interests and past experiences.

[0610] Step 4:

[0611] The user enters information such as "Interests: Hot Springs, Food: Ramen, Experience: First visit to Japan" into the information input form and presses the send button. The device then sends the entered information to the server.

[0612] Step 5:

[0613] The server receives the input information sent from the device, analyzes it, and uses an AI algorithm to select recommended tourist spots and restaurants based on the user's interests and past experiences.

[0614] Step 6:

[0615] The server generates a list of selected recommended tourist spots and restaurants, and adds related information (location, business hours, cashless payment availability, etc.). The server then returns the generated recommendation information to the terminal.

[0616] Step 7:

[0617] The device displays the recommended information received from the server to the user, including detailed information such as the addresses, access information, and opening hours of "Hakone Onsen" and "Ramen Museum."

[0618] Step 8:

[0619] The user checks the displayed details and plans a visit. The server generates a special experience based on the user's interests (e.g., an exclusive guided tour of the Ramen Museum) and sends it to the device.

[0620] Step 9:

[0621] The device displays detailed information about the special experience to the user, including an overview of the special experience, how to book, and the price.

[0622] Step 10:

[0623] A user books a special experience and pays using an online payment application. The terminal sends the payment information to a server, which processes the booking to confirm the booking.

[0624] This series of steps allows foreign tourists to easily find tourist spots and restaurants in Japan, book special experiences, and use cashless payment, providing a comfortable and convenient tourist experience for travelers.

[0625] Example 1

[0626] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0627] There is a lack of support systems to ensure that foreign tourists visiting Japan can enjoy sightseeing and dining in the country with peace of mind. Furthermore, there is no centralized system in place to provide information on tourist spots and restaurants, reservations for special experiences, and cashless payments. Furthermore, there is a lack of means to provide travelers with the information they need at the right time at specific locations. This makes it difficult for travelers to spend their stay comfortably and efficiently.

[0628] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0629] In this invention, the server includes a means for a user to download and install an online payment application to a mobile terminal, a means for the user to input information about their interests and past experiences, a means for using an AI algorithm to suggest tourist spots and restaurants based on the user's input information, a notification means for prompting the user to download the online payment application at a specific location, and a means for checking whether the suggested tourist spots and restaurants accept cashless payment. This allows foreign tourists visiting Japan to enjoy sightseeing and dining efficiently and comfortably at their destinations.

[0630] An "online payment application" is software that allows users to pay for goods and services over the Internet using their mobile devices.

[0631] "Mobile terminal" refers to a portable computing device such as a smartphone or tablet.

[0632] "AI algorithm" refers to the computational procedures used by artificial intelligence (AI) to analyze and make predictions based on data.

[0633] "Tourist destination" means a place visited by tourists or visitors for tourism purposes.

[0634] "Restaurant" refers to a place that serves food and drinks and where customers eat and drink.

[0635] "Special experiences" refer to unique services and activities that differ from regular sightseeing and dining, and are special experiences that are offered under specific conditions.

[0636] "Notification means" refers to a system or method for conveying information to users when certain conditions are met.

[0637] "Cashless payment" refers to a payment method that does not use cash but instead uses credit cards, digital wallets, etc.

[0638] This invention is a system that allows foreign tourists visiting Japan to use cashless payment smoothly and safely when enjoying sightseeing, dining, and drinking within the country. The system consists of a mobile device such as a user's smartphone or tablet, a server computer system for storing, processing, and transmitting data, and an online payment application.

[0639] First, when a user arrives at a major arrival point such as Narita Airport and connects their smartphone to Wi-Fi, the mobile device automatically displays a pop-up notification. The pop-up notification includes a message saying, "Download an app to make your trip more convenient." When the user taps on this notification, they are directed to an app store where they can download and install an online payment application. Specific software names used include, for example, "PayPay" and "Alipay."

[0640] After installation is complete, the user launches the app for the first time. The mobile device displays a language setting screen and prompts the user to select a language. For example, English is selected. The device then displays the initial setting screen, where the user inputs their interests (e.g., hot springs) and past travel experiences (e.g., first visit to Japan). The input information is sent from the device to the server.

[0641] The server analyzes the received information using an AI algorithm (e.g., TensorFlow model) built into it. Based on the analysis results, it selects the most suitable tourist spots and restaurants for the user. For example, places such as Hakone Onsen and the Ramen Museum may be selected. The server generates this information as a list and sends it to the device.

[0642] The server displays recommended information on the user's device. This information also includes detailed information about each recommended spot (such as its location, opening hours, and whether cashless payment is accepted). If a special experience is suggested, the server generates a special experience, such as a guided tour exclusive to the Ramen Museum, and sends that information to the user's device. The user can then reserve this special experience and pay for it using an online payment application.

[0643] Through the above series of processes, foreign tourists visiting Japan can efficiently find tourist attractions and restaurants, book special experiences, and make cashless payments safely and smoothly.

[0644] Specific examples and examples of prompts for generative AI models

[0645] A concrete example is when a user arrives at Narita Airport and checks the pop-up notification that appears after connecting to Wi-Fi. The device displays the notification, and when the user taps it, the app store page is immediately opened. While the user downloads and installs an online payment application, the device displays the installation progress to the user. The user then launches the app, selects English, and enters "hot springs" as an interest and "first visit to Japan" as a past experience. The device sends the information to the server, and the server returns "Hakone Hot Springs" and "Ramen Museum" as recommendations. The device displays detailed information, and the user books the special experience and pays using the online payment application.

[0646] An example of a prompt for a generative AI model is as follows:

[0647] Please explain the process that a foreign tourist visiting Japan goes through after arriving at Narita Airport: connecting to Wi-Fi, tapping the pop-up notification, and installing a cashless payment app for Japan from the app store. Please then provide a detailed explanation of the steps involved, from launching the app for the first time, to being presented with recommended tourist spots and restaurants, and making reservations and payments for special experiences.

[0648] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0649] Step 1:

[0650] Download and install the app

[0651] The user arrives at Narita Airport and connects their smartphone to Wi-Fi.

[0652] The device will detect a Wi-Fi connection and display a pop-up notification with the message "Download apps to make your travel easier."

[0653] When users tap on the notification, they are directed to the app store.

[0654] A user downloads an online payment application from an app store and installs it on their device, during which the device displays the installation progress.

[0655] Input: User's Wi-Fi connection

[0656] Output: Show popup notification

[0657] Example of operation

[0658] The device runs a program that monitors Wi-Fi connections in the background and triggers a popup when a connection is made.

[0659] The user taps the notification, which opens the specified page in the app store.

[0660] The user downloads the app and is presented with an installation screen once complete.

[0661] Step 2:

[0662] First time launch and setup

[0663] The first time a user launches an installed app.

[0664] The device displays the language setting screen and prompts the user to select a language. The user selects English.

[0665] Once the language selection is complete, the device displays an initial setup screen, where the user enters their interests (e.g., hot springs) and past travel experiences (e.g., first visit to Japan).

[0666] Input: First launch of the app, user language selection, interests and travel experience

[0667] Output: Display of initial setting screen, accumulation of input data

[0668] Example of operation

[0669] The device will automatically display the language selection screen when first started.

[0670] Once the user selects a language, the language preference is saved within the app.

[0671] Users enter their interests and travel experiences and store that data in a local database.

[0672] Step 3:

[0673] Enter information

[0674] The user confirms their interests and past travel experiences on the settings screen and completes the input.

[0675] The terminal transmits the input information to the server.

[0676] Input: User interests and past travel experience data

[0677] Output: Send data to the server

[0678] Example of operation

[0679] The device sends the user input data in JSON format to the server.

[0680] When transmitting data, we use encryption technology (e.g., SSL / TLS) to ensure security.

[0681] The server receives the data and sends a confirmation response back to the terminal.

[0682] Step 4:

[0683] Receiving and analyzing information

[0684] The server receives information about the user's interests and past travel experiences sent from the terminal.

[0685] The server uses an AI algorithm (e.g., TensorFlow) to analyze the input information and select the best tourist spots and restaurants for the user based on the analysis results.

[0686] Input: User interests and past travel experience data

[0687] Output: A list of recommended tourist spots and restaurants as analysis results

[0688] Example of operation

[0689] The server stores the received data in a database and inputs it into the AI ​​model.

[0690] The AI ​​model predicts and generates a list of tourist attractions and restaurants that best fit your interests.

[0691] The generated list is converted to JSON format and sent to the terminal.

[0692] Step 5:

[0693] Generating and sending recommendations

[0694] The server generates a list of recommended tourist spots and restaurants based on the analysis results. For example, "Hakone Onsen" and "Ramen Museum" might be selected.

[0695] The server generates recommendation information and sends it to the terminal.

[0696] Input: Analysis result data

[0697] Output: A list of recommendations

[0698] Example of operation

[0699] The server creates a list based on the analysis results and stores it in a database.

[0700] The server encodes the list data in JSON format and sends it to the terminal.

[0701] Step 6:

[0702] Displaying recommendations

[0703] The device displays the recommended information received from the server.

[0704] The device will display detailed information about each recommended spot (location, opening hours, whether cashless payment is accepted, etc.).

[0705] Input: Recommendations from the server

[0706] Output: Detailed information displayed on the device display

[0707] Example of operation

[0708] The device receives and decodes the JSON response from the server.

[0709] The decoded data is displayed in a user interface.

[0710] Detailed information about each spot is displayed in text and image format.

[0711] Step 7:

[0712] Special experience booking and payment

[0713] The server generates a special experience for the user (e.g., a guided tour exclusive to the Ramen Museum) and transmits that information to the terminal.

[0714] A user books a special experience and pays for it using an online payment application.

[0715] Input: Special experience information, user reservation and payment information

[0716] Output: Special experience reservation confirmation and payment completion notification

[0717] Example of operation

[0718] The server generates special experience information and sends it to the device.

[0719] The device displays details about the special experience and provides a booking form.

[0720] Once the user makes a reservation and enters their payment information, the terminal initiates the online payment process.

[0721] Once payment is complete, a confirmation notice is sent to the terminal via the server.

[0722] (Application example 1)

[0723] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0724] The goal is to provide a system that allows foreign tourists visiting Japan to smoothly use cashless payment while enjoying sightseeing and dining in Japan, without having to face language barriers or the inconvenience of cash payments. There is also a need for a system that allows tourists to easily find nearby restaurants and order food on the spot.

[0725] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0726] In this invention, the server includes a means for receiving user input information, a means including an algorithm for suggesting tourist spots and restaurants based on the input information, and a means including a generative AI model for generating recommended dishes and restaurants based on the user's current location and interests. This allows foreign tourists visiting Japan to smoothly use cashless payment while enjoying tourist spots and restaurants in Japan, and further enables them to easily find and order recommended dishes and restaurants on the spot.

[0727] "Users" are foreign tourists visiting Japan who use the system to enjoy sightseeing, dining and drinking within Japan.

[0728] An "online payment application" is software that users install on their mobile devices, such as smartphones or tablets, to purchase goods or reserve services cashlessly.

[0729] A "mobile terminal" is a portable device such as a smartphone or tablet.

[0730] "Interests" refers to information about sightseeing and activities that users would like to experience in Japan.

[0731] "Past experience" refers to information about the user's past travel experiences, hobbies, and preferences.

[0732] A "server" is a computer system that receives information entered by users and processes and analyzes that information.

[0733] The "algorithm for suggesting tourist spots and restaurants" is a calculation procedure for selecting and suggesting appropriate tourist spots and restaurants based on the user's interests and past experiences.

[0734] "Suggestion information" is a list of tourist spots and restaurants recommended for the user, sent from the server.

[0735] A "special experience" is a special sightseeing or dining experience that is different from the usual and is booked based on the suggested information.

[0736] A "generative AI model" is an artificial intelligence model that generates recommended dishes and restaurants based on a user's current location and interests.

[0737] "Notification means" refers to a method for prompting a user to download an online payment application when the user reaches a specific location.

[0738] "Cashless payment" is a method of paying for goods and services without using cash.

[0739] The system of the present invention is designed to enable users to smoothly make cashless payments while enjoying sightseeing spots and restaurants in Japan. The main components of this system are a mobile terminal (such as a smartphone or tablet), a server, and an online payment application.

[0740] System Operation Overview

[0741] 1. Download and install the app

[0742] When a user arrives at a specific location (e.g., an airport or major tourist destination), a pop-up notification appears on the mobile device after connecting to Wi-Fi, allowing the user to download and install an online payment application from an app store.

[0743] 2. First launch and setup

[0744] A user launches the app and selects their native language (e.g., English) from the language settings screen. The app then prompts the user to enter information about their interests and past travel experiences.

[0745] 3. Entering information and sending it to the server

[0746] The user inputs their interests (e.g., Japanese cuisine (hot springs, etc.)) and past travel experiences (e.g., first visit to Japan) and sends this information to the server.

[0747] Processing on the server

[0748] 4. Receiving and analyzing information

[0749] The server receives the information sent by the user and analyzes it using an AI algorithm. This algorithm selects recommended tourist spots and restaurants based on the user's interests and past experiences. The server also uses a generative AI model to generate recommended dishes and restaurants based on the user's current location and interests.

[0750] 5. Generating and sending recommendations

[0751] The server generates recommended information (e.g., tourist spot "Hakone Hot Springs," restaurant "Sushi Restaurant") and sends it to the mobile terminal.

[0752] Displaying results and settlement

[0753] 6. Display of recommended information

[0754] The mobile device displays the recommended information received from the server, along with detailed information about each recommended spot (e.g., location, business hours, whether cashless payment is accepted, etc.).

[0755] 7. Special Experience Reservations and Payment

[0756] Users can book special experiences based on the displayed information and pay cashlessly through the app, such as special guided tours or limited menus.

[0757] Hardware and software used

[0758] Mobile devices: smartphones, tablets, etc.

[0759] Server: A computer system that performs on-demand data processing.

[0760] Online payment applications: Cashless payment services such as PayPal and Stripe.

[0761] Generative AI models: Artificial intelligence models such as GPT-3, BERT, etc.

[0762] Specific examples and examples of prompts for generative AI models

[0763] As a concrete example, a user arrives at Narita Airport and taps on a pop-up notification after connecting to Wi-Fi. The user downloads an online payment application from the app store and installs it on their mobile device. Next, the user launches the application, selects English, and enters "hot springs" as their interest and "first visit to Japan" as their past experience. The server receives the information, returns "Hakone Hot Springs" and "Sushi Restaurant" as recommendations, and the device displays the information. The user then books a special experience and makes a payment using the online payment application.

[0764] An example of a prompt for a generative AI model is:

[0765] "We are designing a food delivery application for foreign tourists. Please provide recommendations for Japanese restaurants and dishes based on the following information:

[0766] Interests: Hot spring trips

[0767] Past experience: First visit to Japan

[0768] Current location: Tokyo Station

[0769] Create results that include specific restaurant names, their features, and special offers.

[0770] As described above, this system provides foreign tourists visiting Japan with a comfortable and convenient sightseeing and dining experience.

[0771] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0772] Step 1:

[0773] When a user arrives at a specific location (e.g., an airport or major tourist destination) and connects to Wi-Fi, a pop-up notification appears on the device, prompting the user to download and install an online payment application from the app store by tapping the notification.

[0774] Input: User's current location and Wi-Fi connection

[0775] Output: Show popup notification

[0776] Specific operation: The device generates and displays a pop-up notification based on GPS data and Wi-Fi connection information.

[0777] Step 2:

[0778] The user starts the application and selects their native language (e.g., English) on the language setting screen.

[0779] Input: User launches application for the first time

[0780] Output: Display of language setting screen

[0781] What it does: When the app first launches, it loads the default settings and prompts the user to select a language.

[0782] Step 3:

[0783] The user enters information about their interests (e.g., hot springs) and past travel experiences (e.g., first visit to Japan) and presses the submit button.

[0784] Input: User input of interests and past experiences

[0785] Output: Sending input information to the server

[0786] Specific operation: The information entered by the user is sent by the terminal to the server as an HTTP request.

[0787] Step 4:

[0788] The server analyzes the information received from the user and uses an AI algorithm to select recommended tourist spots and restaurants based on the user's interests and past experiences.

[0789] Input: User interests and past experiences

[0790] Output: A list of recommended tourist spots and restaurants

[0791] How it works: The server uses a generative AI model (such as GPT-3) to generate prompts and then creates a list of tourist attractions and restaurants based on those prompts. The following prompts are used:

[0792] "We are designing a food delivery application for foreign tourists. Please provide recommendations for Japanese restaurants and dishes based on the following information:

[0793] Interests: Hot spring trips

[0794] Past experience: First visit to Japan

[0795] Current location: Tokyo Station

[0796] Create results that include specific restaurant names, their features, and special offers.

[0797] Step 5:

[0798] The server generates a list of recommended tourist spots and restaurants and sends it to the terminal.

[0799] Input: Recommended tourist spots and restaurant list

[0800] Output: Send the list to the mobile device

[0801] Specific operation: The server returns the generated list to the terminal as an HTTP response.

[0802] Step 6:

[0803] The device displays the recommended information received from the server.

[0804] Input: A list of recommendations from the server

[0805] Output: Display information on the terminal

[0806] Specific operation: The device analyzes the data received and displays it in a format that is easy for the user to view.

[0807] Step 7:

[0808] The user can book a special experience (e.g., a guided tour or a limited menu) based on the displayed information and make a cashless payment through an online payment application.

[0809] Input: User reservation information and payment information

[0810] Output: Reservation and payment completion notification

[0811] Specific operation: The terminal sends the reservation details to the server, and processes the transaction using an online payment API (e.g., PayPal or Stripe) as the payment process. As a result, a notification of the completion of the reservation and payment is displayed to the user.

[0812] By following these steps, foreign visitors to Japan can comfortably enjoy tourist spots and restaurants around the country and smoothly use cashless payment methods.

[0813] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0814] The system of the present invention is designed to enable foreign tourists visiting Japan to enjoy tourist spots and restaurants in Japan with peace of mind and to use cashless payment. Furthermore, it provides a more personalized tourist experience by recognizing the user's emotions and making customized suggestions based on those emotions. A specific embodiment of this system is described below.

[0815] System Overview

[0816] The system consists of the following main components:

[0817] Mobile devices (such as users' smartphones or tablets)

[0818] Server (a computer system that stores, processes, and transmits data)

[0819] Online payment application

[0820] Emotion engine (software for recognizing user emotions)

[0821] User operation steps

[0822] 1. Download and install the app

[0823] When users arrive at Narita Airport or other major arrival points, a pop-up notification will appear after connecting to Wi-Fi.

[0824] The user taps the pop-up notification, downloads the online payment application from the app store, and installs it on the mobile device.

[0825] 2. First launch and setup

[0826] The user launches the app and selects English from the language settings screen.

[0827] The app displays an initial setup screen, prompting the user to enter information about their interests and past experiences.

[0828] 3. Enter information

[0829] Users input their interests (e.g., hot springs) and past travel experiences (e.g., first visit to Japan), and the emotion engine analyzes the user's facial expressions and voice to recognize their emotions.

[0830] The device sends the input information and emotion data to the server.

[0831] Processing on the server

[0832] 4. Receiving and analyzing information

[0833] The server receives the input information and emotion data sent from the terminal.

[0834] The server uses AI algorithms and an emotion engine to select recommended tourist spots and restaurants based on input interests, past experiences, and recognized emotions.

[0835] 5. Generating and sending recommendations

[0836] The server generates a list of recommended tourist spots and restaurants for the user. For example, "Hakone Onsen" or "Ramen Museum" are selected.

[0837] The server returns the generated recommendations to the device.

[0838] Displaying results and offering special experiences

[0839] 6. Display of recommended information

[0840] The device displays the recommended information received from the server.

[0841] Detailed information about each recommended spot (location, opening hours, whether cashless payment is accepted, etc.) is displayed.

[0842] 7. Special Experience Reservations and Payment

[0843] The server generates a special experience (e.g., a guided tour exclusive to the Ramen Museum) and displays it in the app.

[0844] A user books a special experience and pays for it using an online payment application.

[0845] Specific examples

[0846] The user arrives at Narita Airport and taps the pop-up notification that appears after connecting to Wi-Fi.

[0847] A user downloads an online payment application from an app store and installs it on a mobile device.

[0848] The user starts the app, selects English, and enters "hot springs" as their interest and "first visit to Japan" as their past experience. The emotion engine recognizes the user's emotions from their facial expressions and voice.

[0849] The device sends information and emotional data to the server, which then returns recommendations for "Hakone Onsen" and "Ramen Museum."

[0850] The device displays the recommended information, and the user checks for more information.

[0851] The server generates a "Ramen Museum Exclusive Guided Tour," which the user reserves and pays for using an online payment application.

[0852] This series of processes allows foreign tourists visiting Japan to easily find tourist attractions and restaurants within Japan, and by receiving emotion-based suggestions, they can enjoy a more personalized sightseeing experience. This system provides users with a comfortable and convenient sightseeing experience.

[0853] The processing flow will be explained below.

[0854] Step 1:

[0855] When the user arrives at Narita Airport and connects to Wi-Fi, a pop-up notification appears. The device displays a pop-up notification prompting the user to download an online payment application.

[0856] Step 2:

[0857] The user taps the pop-up notification and downloads the online payment application from the app store. The device installs the application and displays a notification that the installation is complete.

[0858] Step 3:

[0859] After installation, a user launches the app and selects English on the language settings screen. The device displays an initial setup screen, prompting the user to enter information about their interests and past experiences.

[0860] Step 4:

[0861] The user enters information such as "Interests: Hot Springs, Food: Ramen, Experience: First visit to Japan" into the information input form, and the emotion engine analyzes the user's facial expressions and voice to recognize their emotions. The device then sends the input information and emotion data to the server.

[0862] Step 5:

[0863] The server receives input information and emotion data sent from the device, analyzes the received information, and uses AI algorithms and emotion engines to select recommended tourist spots and restaurants based on the user's interests, past experiences, and recognized emotions.

[0864] Step 6:

[0865] The server generates a list of selected recommended tourist spots and restaurants, and adds related information (location, business hours, cashless payment availability, etc.). The server then returns the generated recommendation information to the terminal.

[0866] Step 7:

[0867] The device displays the recommended information received from the server to the user, including detailed information such as the addresses, access information, and opening hours of "Hakone Onsen" and "Ramen Museum."

[0868] Step 8:

[0869] The user checks the displayed details and plans a visit. The server generates a special experience (e.g., an exclusive guided tour of the Ramen Museum) based on the user's interests and emotions and sends it to the device.

[0870] Step 9:

[0871] The device displays detailed information about the special experience to the user, including an overview of the special experience, how to book, and the price.

[0872] Step 10:

[0873] A user books a special experience and pays using an online payment application. The terminal sends the payment information to a server, which processes the booking to confirm the booking.

[0874] This series of steps makes it easier for foreign tourists visiting Japan to find tourist attractions and restaurants within the country, and by receiving customized suggestions based on their own emotions, they can enjoy a more personalized sightseeing experience. This system provides users with a comfortable and convenient sightseeing experience.

[0875] Example 2

[0876] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0877] In order for foreign tourists visiting Japan to enjoy tourist spots and restaurants in Japan with peace of mind, appropriate guidance and the widespread adoption of cashless payment are essential. However, there are few systems that can overcome language barriers, provide personalized information tailored to the interests of individual travelers, and improve the convenience of online payments. This invention solves these issues by providing a system that makes customized suggestions based on travelers' interests and emotions and facilitates cashless payment.

[0878] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for transmitting user input information and emotion data to the server, a means including an algorithm for the server to suggest tourist spots and restaurants based on the user input information and emotion data, and a means for transmitting the suggestion information to the user's mobile terminal. This enables foreign tourists visiting Japan to overcome language barriers, obtain personalized tourist information based on their individual emotions, and easily make cashless payments.

[0879] An "online payment application" is software that allows users to pay for goods and services over the Internet without using cash.

[0880] A "mobile terminal" is an electronic device that a user can carry around and has a communication function, and includes smartphones, tablets, and the like.

[0881] "Interests" refers to information about topics, activities, tourist destinations, etc. that are of particular interest to users.

[0882] "Past experience" refers to the history of trips and activities that a user has previously undertaken.

[0883] "Emotion data" is data that reflects the user's current emotions, and is information obtained through facial expression and voice analysis, etc.

[0884] A "server" is a computer system that receives, stores, processes, and transmits data.

[0885] An "AI algorithm" is a computational procedure that uses artificial intelligence techniques to analyze data and produce a specific result.

[0886] "Suggested information" is information about recommended tourist spots, restaurants, etc. that is generated by the server based on the user's input information and emotional data.

[0887] A "special experience" is a plan that offers additional benefits and exclusive services in addition to regular sightseeing and dining.

[0888] A "notification means" is a system that displays messages or alerts to encourage users to take specific actions.

[0889] "Cashless payment" refers to transactions that are conducted using electronic payment methods without using cash.

[0890] The present invention is a system that allows foreign tourists visiting Japan to enjoy tourist spots and restaurants in Japan with peace of mind and use cashless payment. Furthermore, the system provides a personalized tourism experience by recognizing the user's emotions and making customized suggestions based on those emotions. A specific embodiment of this system is described below.

[0891] System configuration

[0892] The system consists of the following main components:

[0893] 1. Mobile terminal: An electronic device with communication capabilities, such as a user's smartphone or tablet.

[0894] 2. Server: A computer system that stores, processes, and transmits data.

[0895] 3. Online payment application: Software that allows users to pay for goods and services over the Internet without using cash.

[0896] 4. Emotion engine: Software that analyzes the user's facial expressions and voice to recognize emotions.

[0897] Operational Overview

[0898] Download and install the app

[0899] When users arrive at Narita Airport or other major arrival points, a pop-up notification will appear after connecting to Wi-Fi. By tapping on this notification, users can download an online payment application from the app store and install it on their mobile device.

[0900] First time launch and setup

[0901] When users first launch the app, they are prompted to select English as their language setting. They are then prompted to enter information about their interests and past experiences. For example, they can enter "hot springs" as their interest and "first visit to Japan" as their past travel experience.

[0902] Information input and emotion recognition

[0903] The emotion engine analyzes the user's facial expressions and voice to recognize their current emotion, and the acquired emotion data and input information are sent from the device to the server.

[0904] Data processing on the server

[0905] The server uses an AI algorithm to analyze the inputted interests, past experiences, and recognized emotions. As a result of the analysis, information on recommended tourist spots and restaurants is generated. For example, "Hakone Onsen" and "Ramen Museum" are selected.

[0906] Displaying recommendations

[0907] The server sends the generated recommendation information to the device, which then displays it to the user. Detailed information about each recommended spot is also displayed at the same time. The user decides on a destination based on the displayed information.

[0908] Special experience booking and payment

[0909] The server generates special experiences (e.g., "Exclusive Guided Tour of Ramen Museum") and displays them in the app. Users can book them and pay for them using an online payment application.

[0910] Specific examples

[0911] The user arrives at Narita Airport, connects to Wi-Fi, and then taps the popup notification.

[0912] A user downloads an online payment application from an app store and installs it on a mobile device.

[0913] A user launches the app, selects English, and enters their interest in "hot springs" and their past experience as "first visit to Japan."

[0914] The emotion engine recognizes the user's emotions from facial expressions and voice.

[0915] The device sends information and emotional data to the server, which then returns recommendations for "Hakone Onsen" and "Ramen Museum."

[0916] The device displays the recommended information, and the user checks for more information.

[0917] The server generates a "Ramen Museum Exclusive Guided Tour," which the user reserves and pays for using an online payment application.

[0918] In this way, foreign tourists visiting Japan can enjoy tourist attractions and restaurants in Japan with peace of mind, and receive emotion-based suggestions for a more personalized sightseeing experience. The system is designed to provide users with a comfortable and convenient sightseeing experience.

[0919] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0920] Step 1: Download and install the app

[0921] Once users arrive and connect to Wi-Fi, they will receive a pop-up notification containing a link to download a dedicated app for visitors to Japan.

[0922] The user taps on the popup notification and is redirected to the app store.

[0923] The user downloads the app and installs it on their device.

[0924] Input: Wi-Fi connection, popup notification

[0925] Output: App download link display, app installation

[0926] Step 2: First launch and language setting

[0927] The user launches the app for the first time.

[0928] The terminal displays a language setting screen, and the user selects English.

[0929] Input: Launch the app, display the language setting screen

[0930] Output: Language selection (English)

[0931] Step 3: Enter your interests and past experiences

[0932] The device will display an initial setup screen, prompting you to enter your interests and past travel experiences.

[0933] The user enters information such as "hot springs" and "first visit to Japan."

[0934] The emotion engine analyzes facial expressions and voice to recognize the current emotion.

[0935] Input: Initial setup screen display, interests, past travel experiences, user facial expressions and voice

[0936] Output: Input information and emotion data

[0937] Step 4: Sending data to the server

[0938] The terminal transmits the input information and emotion data to the server.

[0939] Input: Input information and emotion data

[0940] Output: Sending data to the server, confirming data reception

[0941] Step 5: Data analysis on the server

[0942] The server receives the input information and emotion data.

[0943] The server uses AI algorithms to analyze the input interests, past experiences, and recognized emotions.

[0944] The server selects recommended tourist spots and restaurants based on the analysis results.

[0945] Input: Input information and emotion data

[0946] Output: Analysis results, list of selected tourist spots and restaurants

[0947] Step 6: Generate and send recommendations

[0948] The server generates recommendations based on the analysis results, such as "Hakone Hot Springs" or "Ramen Museum."

[0949] The server generates recommendation information and sends it to the terminal.

[0950] Input: Analysis results

[0951] Output: Recommendations, data sent to device

[0952] Step 7: View recommendations

[0953] The device displays the recommended information received from the server.

[0954] Detailed information about each recommended spot (location, opening hours, whether cashless payment is accepted, etc.) is displayed.

[0955] Input: Recommendations

[0956] Output: Show detailed information

[0957] Step 8: Book and pay for your special experience

[0958] The server generates a special experience (e.g., a guided tour exclusive to the Ramen Museum) and displays it in the app.

[0959] A user books a special experience and pays for it using an online payment application.

[0960] Input: Special experience information, booking request

[0961] Output: Reservation completion notification, payment completion notification

[0962] This series of processing steps allows foreign tourists to enjoy sightseeing spots and restaurants in Japan with peace of mind. Utilizing emotion data also makes it possible to provide personalized sightseeing suggestions.

[0963] (Application example 2)

[0964] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0965] When foreign tourists visit Japan, they often face difficulties in finding suitable dining facilities due to language barriers and cultural differences, and it is also cumbersome to check whether online payment is available. Therefore, personalized suggestions based on emotions are needed so that visitors can enjoy their meals with peace of mind.

[0966] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0967] means including an algorithm for suggesting dining establishments based on user input information and data from an emotion recognition engine;

[0968] means for transmitting the proposal information to a user's mobile terminal;

[0969] means for ordering meals and making online payments based on the suggested information;

[0970] This allows for suggestions of dining options and menus based on the user's current mood and preferences, and allows for seamless food ordering and online payment.

[0971] An "online payment application" is software that allows users to make payments safely and quickly via the Internet using mobile devices such as smartphones and tablets.

[0972] A "mobile terminal" is an electronic device that a user can carry with them, such as a smartphone, tablet, or laptop.

[0973] "Interests" are information about specific things or activities that a user is particularly interested in and enjoys.

[0974] "Past experiences" are information about events or activities that the user has previously experienced.

[0975] An "emotion recognition engine" is software that analyzes facial expressions and voice data to identify a user's current emotional state.

[0976] "Food and beverage establishments" are places that serve food and drinks, such as restaurants, cafes, and bars.

[0977] "Input information" is data about interests and past experiences that a user provides to an application.

[0978] "Suggested information" is information about optimal dining facilities and menus generated by the server based on the user's input information and emotional state.

[0979] "Ordering a meal" refers to the act of purchasing a food and drink menu item selected by the user based on the suggested information.

[0980] A "special experience" is a special service or activity that differs from normal usage and provides added value to the user.

[0981] This invention is a system that provides personalized suggestions based on emotions to foreign tourists visiting Japan when they visit restaurants and other establishments in Japan, reducing language barriers and cultural differences. The system consists of a user's mobile device, a server, an online payment application, and an emotion recognition engine.

[0982] System Overview

[0983] The system includes the following major components:

[0984] Mobile device: An electronic device that can be carried by a user, such as a smartphone or tablet.

[0985] Server: A computer system that stores, processes, and transmits data.

[0986] Online payment application: Software that allows you to make payments securely and quickly over the internet (e.g., PayPal, Stripe).

[0987] Emotion recognition engine: Software that analyzes facial and voice data to identify a user's emotional state (e.g., Microsoft Azure Cognitive Services).

[0988] User operation steps

[0989] 1. Download and install the app

[0990] A user downloads an online payment application from an app store and installs it on a mobile device.

[0991] 2. First launch and setup

[0992] The user starts the app, selects an appropriate language (e.g., English) from the language setting screen, and enters their interests (e.g., Japanese food, Chinese food) and past experiences (e.g., vegetarian, likes spicy food).

[0993] 3. Emotion recognition

[0994] The mobile device captures the user's facial expressions and voice data and analyzes them in real time using an emotion recognition engine.

[0995] 4. Information Transmission

[0996] The mobile terminal transmits the input information and the recognized emotion data to the server.

[0997] Processing on the server

[0998] The server does the following:

[0999] 1. Analysis of information

[1000] The server receives the input information and emotional data sent by the user and uses an AI algorithm and emotion recognition engine to select the most suitable dining establishments and menus for the user.

[1001] 2. Proposal information generation

[1002] The server generates a list of optimal dining options and menus based on the user's current mood and preferences.

[1003] 3. Sending Proposal Information

[1004] The server transmits the generated proposal information to the user's mobile terminal.

[1005] Viewing and manipulating results

[1006] 1. Display of suggested information

[1007] The mobile terminal receives the proposal information and the user confirms it.

[1008] 2. Ordering and Payment

[1009] The user selects from suggested dining options and menus and pays through an online payment application.

[1010] Specific examples

[1011] Specifically, an example of how this system works is shown below.

[1012] scenario:

[1013] A user launches an emotion-aware food delivery app on their smartphone and feels a bit down today.

[1014] The app can recognize the emotion of "sadness" from the user's facial expression and suggest hot soup or comforting meals.

[1015] Example prompt sentence:

[1016] User Information:

[1017] Favorite cuisine type: Japanese

[1018] Preferred spiciness level: Medium

[1019] Specific allergies: None

[1020] Inferred emotion: Sadness

[1021] AI algorithm recommendation results:

[1022] Maiki Pumpkin Soup (Warm and comforting)

[1023] Porridge set meal (healthy and very comforting)

[1024] This system will enable personalized, emotion-based recommendations for dining options and menus, as well as easy online payment.

[1025] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1026] Step 1:

[1027] Download and install the app

[1028] A user downloads an online payment application from an app store and installs it on a mobile device.

[1029] Enter: App Store

[1030] Output: Applications installed on the mobile device

[1031] Step 2:

[1032] First time launch and setup

[1033] A user starts the app, selects English from the language setting screen, and enters their interests (e.g., Japanese food, Chinese food) and past experiences (e.g., vegetarian, likes spicy food).

[1034] Input: User interests and past experiences

[1035] Output: The user's input information is saved in the mobile device.

[1036] Step 3:

[1037] emotion recognition

[1038] The mobile device captures the user's facial expressions and voice data and analyzes them in real time using an emotion recognition engine.

[1039] Input: User's facial expressions and voice data

[1040] Output: User emotion data

[1041] Step 4:

[1042] Information transmission

[1043] The mobile terminal transmits the input information and the recognized emotion data to the server.

[1044] Input: User input information and emotion data

[1045] Output: Data sent to the server

[1046] Step 5:

[1047] Analysis of information

[1048] The server receives the input information and emotional data sent by the user and uses an AI algorithm and emotion recognition engine to select the most suitable dining establishments and menus for the user.

[1049] Input: User input information and emotion data

[1050] Output: Restaurant and menu suggestions

[1051] Step 6:

[1052] Generate suggestions

[1053] The server generates a list of optimal dining options and menus based on the user's current mood and preferences.

[1054] Input: Analysis results of information

[1055] Output: Generated proposal information

[1056] Step 7:

[1057] Sending Proposal Information

[1058] The server transmits the generated proposal information to the user's mobile terminal.

[1059] Input: Generated proposal information

[1060] Output: Proposal information sent to the mobile terminal

[1061] Step 8:

[1062] Displaying Proposal Information

[1063] The mobile terminal receives the proposal information and the user confirms it.

[1064] Input: Proposal information sent from the server

[1065] Output: Proposal information displayed on the mobile device

[1066] Step 9:

[1067] Ordering and Payment

[1068] The user selects from suggested dining options and menus and pays through an online payment application.

[1069] Input: User's choice

[1070] Output: Completed order and payment information

[1071] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1072] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1073] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1074] [Third embodiment]

[1075] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1076] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1077] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1078] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1079] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1080] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1081] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1082] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1083] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1084] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1085] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1086] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1087] The system of the present invention is designed to enable foreign tourists visiting Japan to enjoy tourist spots and restaurants in Japan with peace of mind and to use cashless payment. A specific embodiment of this system will be described below.

[1088] System Overview

[1089] The system consists of the following main components:

[1090] Mobile devices (such as users' smartphones or tablets)

[1091] Server (a computer system that stores, processes, and transmits data)

[1092] Online payment application

[1093] User operation steps

[1094] 1. Download and install the app

[1095] When users arrive at Narita Airport or other major arrival points, a pop-up notification will appear after connecting to Wi-Fi.

[1096] The user taps the pop-up notification, downloads the online payment application from the app store, and installs it on the mobile device.

[1097] 2. First launch and setup

[1098] The user launches the app and selects English from the language settings screen.

[1099] The app displays an initial setup screen, prompting the user to enter information about their interests and past experiences.

[1100] 3. Enter information

[1101] The user enters their interests (e.g., hot springs), past travel experiences (e.g., first visit to Japan), etc.

[1102] The terminal transmits the input information to the server.

[1103] Processing on the server

[1104] 4. Receiving and analyzing information

[1105] The server receives input information from the terminal.

[1106] The server uses AI algorithms to select recommended tourist spots and restaurants based on input interests and past experiences.

[1107] 5. Generating and sending recommendations

[1108] The server generates a list of recommended tourist spots and restaurants for the user. For example, "Hakone Onsen" or "Ramen Museum" are selected.

[1109] The server transmits the generated recommendation information to the terminal.

[1110] Displaying results and offering special experiences

[1111] 6. Display of recommended information

[1112] The device displays the recommended information received from the server.

[1113] Detailed information about each recommended spot (location, opening hours, whether cashless payment is accepted, etc.) is displayed.

[1114] 7. Special Experience Reservations and Payment

[1115] The server generates a special experience (e.g., a guided tour exclusive to the Ramen Museum) and displays it in the app.

[1116] A user books a special experience and pays for it using an online payment application.

[1117] Specific examples

[1118] The user arrives at Narita Airport and taps the pop-up notification that appears after connecting to Wi-Fi.

[1119] A user downloads an online payment application from an app store and installs it on a mobile device.

[1120] A user launches the app, selects English, and enters "hot springs" as their interest and "first visit to Japan" as their past experience.

[1121] The device sends the information to the server, which then returns "Hakone Onsen" and "Ramen Museum" as recommendations.

[1122] The device displays the recommended information, and the user checks for more information.

[1123] The server generates a "Ramen Museum Exclusive Guided Tour," which the user reserves and pays for using an online payment application.

[1124] Through this process, foreign tourists visiting Japan can smoothly find tourist spots and restaurants, book special experiences, and use cashless payment. This system provides users with a comfortable and convenient tourist experience.

[1125] The processing flow will be explained below.

[1126] Step 1:

[1127] When the user arrives at Narita Airport and connects to Wi-Fi, a pop-up notification appears. The device displays a pop-up notification prompting the user to download an online payment application.

[1128] Step 2:

[1129] The user taps the pop-up notification and downloads the online payment application from the app store. The device installs the application and displays a notification that the installation is complete.

[1130] Step 3:

[1131] After installation, a user launches the app and selects English on the language settings screen. The device displays an initial setup screen, prompting the user to enter information about their interests and past experiences.

[1132] Step 4:

[1133] The user enters information such as "Interests: Hot Springs, Food: Ramen, Experience: First visit to Japan" into the information input form and presses the send button. The device then sends the entered information to the server.

[1134] Step 5:

[1135] The server receives the input information sent from the device, analyzes it, and uses an AI algorithm to select recommended tourist spots and restaurants based on the user's interests and past experiences.

[1136] Step 6:

[1137] The server generates a list of selected recommended tourist spots and restaurants, and adds related information (location, business hours, cashless payment availability, etc.). The server then returns the generated recommendation information to the terminal.

[1138] Step 7:

[1139] The device displays the recommended information received from the server to the user, including detailed information such as the addresses, access information, and opening hours of "Hakone Onsen" and "Ramen Museum."

[1140] Step 8:

[1141] The user checks the displayed details and plans a visit. The server generates a special experience based on the user's interests (e.g., an exclusive guided tour of the Ramen Museum) and sends it to the device.

[1142] Step 9:

[1143] The device displays detailed information about the special experience to the user, including an overview of the special experience, how to book, and the price.

[1144] Step 10:

[1145] A user books a special experience and pays using an online payment application. The terminal sends the payment information to a server, which processes the booking to confirm the booking.

[1146] This series of steps allows foreign tourists to easily find tourist spots and restaurants in Japan, book special experiences, and use cashless payment, providing a comfortable and convenient tourist experience for travelers.

[1147] Example 1

[1148] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1149] There is a lack of support systems to ensure that foreign tourists visiting Japan can enjoy sightseeing and dining in the country with peace of mind. Furthermore, there is no centralized system in place to provide information on tourist spots and restaurants, reservations for special experiences, and cashless payments. Furthermore, there is a lack of means to provide travelers with the information they need at the right time at specific locations. This makes it difficult for travelers to spend their stay comfortably and efficiently.

[1150] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1151] In this invention, the server includes a means for a user to download and install an online payment application to a mobile terminal, a means for the user to input information about their interests and past experiences, a means for using an AI algorithm to suggest tourist spots and restaurants based on the user's input information, a notification means for prompting the user to download the online payment application at a specific location, and a means for checking whether the suggested tourist spots and restaurants accept cashless payment. This allows foreign tourists visiting Japan to enjoy sightseeing and dining efficiently and comfortably at their destinations.

[1152] An "online payment application" is software that allows users to pay for goods and services over the Internet using their mobile devices.

[1153] "Mobile terminal" refers to a portable computing device such as a smartphone or tablet.

[1154] "AI algorithm" refers to the computational procedures used by artificial intelligence (AI) to analyze and make predictions based on data.

[1155] "Tourist destination" means a place visited by tourists or visitors for tourism purposes.

[1156] "Restaurant" refers to a place that serves food and drinks and where customers eat and drink.

[1157] "Special experiences" refer to unique services and activities that differ from regular sightseeing and dining, and are special experiences that are offered under specific conditions.

[1158] "Notification means" refers to a system or method for conveying information to users when certain conditions are met.

[1159] "Cashless payment" refers to a payment method that does not use cash but instead uses credit cards, digital wallets, etc.

[1160] This invention is a system that allows foreign tourists visiting Japan to use cashless payment smoothly and safely when enjoying sightseeing, dining, and drinking within the country. The system consists of a mobile device such as a user's smartphone or tablet, a server computer system for storing, processing, and transmitting data, and an online payment application.

[1161] First, when a user arrives at a major arrival point such as Narita Airport and connects their smartphone to Wi-Fi, the mobile device automatically displays a pop-up notification. The pop-up notification includes a message saying, "Download an app to make your trip more convenient." When the user taps on this notification, they are directed to an app store where they can download and install an online payment application. Specific software names used include, for example, "PayPay" and "Alipay."

[1162] After installation is complete, the user launches the app for the first time. The mobile device displays a language setting screen and prompts the user to select a language. For example, English is selected. The device then displays the initial setting screen, where the user inputs their interests (e.g., hot springs) and past travel experiences (e.g., first visit to Japan). The input information is sent from the device to the server.

[1163] The server analyzes the received information using an AI algorithm (e.g., TensorFlow model) built into it. Based on the analysis results, it selects the most suitable tourist spots and restaurants for the user. For example, places such as Hakone Onsen and the Ramen Museum may be selected. The server generates this information as a list and sends it to the device.

[1164] The server displays recommended information on the user's device. This information also includes detailed information about each recommended spot (such as its location, opening hours, and whether cashless payment is accepted). If a special experience is suggested, the server generates a special experience, such as a guided tour exclusive to the Ramen Museum, and sends that information to the user's device. The user can then reserve this special experience and pay for it using an online payment application.

[1165] Through the above series of processes, foreign tourists visiting Japan can efficiently find tourist attractions and restaurants, book special experiences, and make cashless payments safely and smoothly.

[1166] Specific examples and examples of prompts for generative AI models

[1167] A concrete example is when a user arrives at Narita Airport and checks the pop-up notification that appears after connecting to Wi-Fi. The device displays the notification, and when the user taps it, the app store page is immediately opened. While the user downloads and installs an online payment application, the device displays the installation progress to the user. The user then launches the app, selects English, and enters "hot springs" as an interest and "first visit to Japan" as a past experience. The device sends the information to the server, and the server returns "Hakone Hot Springs" and "Ramen Museum" as recommendations. The device displays detailed information, and the user books the special experience and pays using the online payment application.

[1168] An example of a prompt for a generative AI model is as follows:

[1169] Please explain the process that a foreign tourist visiting Japan goes through after arriving at Narita Airport: connecting to Wi-Fi, tapping the pop-up notification, and installing a cashless payment app for Japan from the app store. Please then provide a detailed explanation of the steps involved, from launching the app for the first time, to being presented with recommended tourist spots and restaurants, and making reservations and payments for special experiences.

[1170] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1171] Step 1:

[1172] Download and install the app

[1173] The user arrives at Narita Airport and connects their smartphone to Wi-Fi.

[1174] The device will detect a Wi-Fi connection and display a pop-up notification with the message "Download apps to make your travel easier."

[1175] When users tap on the notification, they are directed to the app store.

[1176] A user downloads an online payment application from an app store and installs it on their device, during which the device displays the installation progress.

[1177] Input: User's Wi-Fi connection

[1178] Output: Show popup notification

[1179] Example of operation

[1180] The device runs a program that monitors Wi-Fi connections in the background and triggers a popup when a connection is made.

[1181] The user taps the notification, which opens the specified page in the app store.

[1182] The user downloads the app and is presented with an installation screen once complete.

[1183] Step 2:

[1184] First time launch and setup

[1185] The first time a user launches an installed app.

[1186] The device displays the language setting screen and prompts the user to select a language. The user selects English.

[1187] Once the language selection is complete, the device displays an initial setup screen, where the user enters their interests (e.g., hot springs) and past travel experiences (e.g., first visit to Japan).

[1188] Input: First launch of the app, user language selection, interests and travel experience

[1189] Output: Display of initial setting screen, accumulation of input data

[1190] Example of operation

[1191] The device will automatically display the language selection screen when first started.

[1192] Once the user selects a language, the language preference is saved within the app.

[1193] Users enter their interests and travel experiences and store that data in a local database.

[1194] Step 3:

[1195] Enter information

[1196] The user confirms their interests and past travel experiences on the settings screen and completes the input.

[1197] The terminal transmits the input information to the server.

[1198] Input: User interests and past travel experience data

[1199] Output: Send data to the server

[1200] Example of operation

[1201] The device sends the user input data in JSON format to the server.

[1202] When transmitting data, we use encryption technology (e.g., SSL / TLS) to ensure security.

[1203] The server receives the data and sends a confirmation response back to the terminal.

[1204] Step 4:

[1205] Receiving and analyzing information

[1206] The server receives information about the user's interests and past travel experiences sent from the terminal.

[1207] The server uses an AI algorithm (e.g., TensorFlow) to analyze the input information and select the best tourist spots and restaurants for the user based on the analysis results.

[1208] Input: User interests and past travel experience data

[1209] Output: A list of recommended tourist spots and restaurants as analysis results

[1210] Example of operation

[1211] The server stores the received data in a database and inputs it into the AI ​​model.

[1212] The AI ​​model predicts and generates a list of tourist attractions and restaurants that best fit your interests.

[1213] The generated list is converted to JSON format and sent to the terminal.

[1214] Step 5:

[1215] Generating and sending recommendations

[1216] The server generates a list of recommended tourist spots and restaurants based on the analysis results. For example, "Hakone Onsen" and "Ramen Museum" might be selected.

[1217] The server generates recommendation information and sends it to the terminal.

[1218] Input: Analysis result data

[1219] Output: A list of recommendations

[1220] Example of operation

[1221] The server creates a list based on the analysis results and stores it in a database.

[1222] The server encodes the list data in JSON format and sends it to the terminal.

[1223] Step 6:

[1224] Displaying recommendations

[1225] The device displays the recommended information received from the server.

[1226] The device will display detailed information about each recommended spot (location, opening hours, whether cashless payment is accepted, etc.).

[1227] Input: Recommendations from the server

[1228] Output: Detailed information displayed on the device display

[1229] Example of operation

[1230] The device receives and decodes the JSON response from the server.

[1231] The decoded data is displayed in a user interface.

[1232] Detailed information about each spot is displayed in text and image format.

[1233] Step 7:

[1234] Special experience booking and payment

[1235] The server generates a special experience for the user (e.g., a guided tour exclusive to the Ramen Museum) and transmits that information to the terminal.

[1236] A user books a special experience and pays for it using an online payment application.

[1237] Input: Special experience information, user reservation and payment information

[1238] Output: Special experience reservation confirmation and payment completion notification

[1239] Example of operation

[1240] The server generates special experience information and sends it to the device.

[1241] The device displays details about the special experience and provides a booking form.

[1242] Once the user makes a reservation and enters their payment information, the terminal initiates the online payment process.

[1243] Once payment is complete, a confirmation notice is sent to the terminal via the server.

[1244] (Application example 1)

[1245] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1246] The goal is to provide a system that allows foreign tourists visiting Japan to smoothly use cashless payment while enjoying sightseeing and dining in Japan, without having to face language barriers or the inconvenience of cash payments. There is also a need for a system that allows tourists to easily find nearby restaurants and order food on the spot.

[1247] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1248] In this invention, the server includes a means for receiving user input information, a means including an algorithm for suggesting tourist spots and restaurants based on the input information, and a means including a generative AI model for generating recommended dishes and restaurants based on the user's current location and interests. This allows foreign tourists visiting Japan to smoothly use cashless payment while enjoying tourist spots and restaurants in Japan, and further enables them to easily find and order recommended dishes and restaurants on the spot.

[1249] "Users" are foreign tourists visiting Japan who use the system to enjoy sightseeing, dining and drinking within Japan.

[1250] An "online payment application" is software that users install on their mobile devices, such as smartphones or tablets, to purchase goods or reserve services cashlessly.

[1251] A "mobile terminal" is a portable device such as a smartphone or tablet.

[1252] "Interests" refers to information about sightseeing and activities that users would like to experience in Japan.

[1253] "Past experience" refers to information about the user's past travel experiences, hobbies, and preferences.

[1254] A "server" is a computer system that receives information entered by users and processes and analyzes that information.

[1255] The "algorithm for suggesting tourist spots and restaurants" is a calculation procedure for selecting and suggesting appropriate tourist spots and restaurants based on the user's interests and past experiences.

[1256] "Suggestion information" is a list of tourist spots and restaurants recommended for the user, sent from the server.

[1257] A "special experience" is a special sightseeing or dining experience that is different from the usual and is booked based on the suggested information.

[1258] A "generative AI model" is an artificial intelligence model that generates recommended dishes and restaurants based on a user's current location and interests.

[1259] "Notification means" refers to a method for prompting a user to download an online payment application when the user reaches a specific location.

[1260] "Cashless payment" is a method of paying for goods and services without using cash.

[1261] The system of the present invention is designed to enable users to smoothly make cashless payments while enjoying sightseeing spots and restaurants in Japan. The main components of this system are a mobile terminal (such as a smartphone or tablet), a server, and an online payment application.

[1262] System Operation Overview

[1263] 1. Download and install the app

[1264] When a user arrives at a specific location (e.g., an airport or major tourist destination), a pop-up notification appears on the mobile device after connecting to Wi-Fi, allowing the user to download and install an online payment application from an app store.

[1265] 2. First launch and setup

[1266] A user launches the app and selects their native language (e.g., English) from the language settings screen. The app then prompts the user to enter information about their interests and past travel experiences.

[1267] 3. Entering information and sending it to the server

[1268] The user inputs their interests (e.g., Japanese cuisine (hot springs, etc.)) and past travel experiences (e.g., first visit to Japan) and sends this information to the server.

[1269] Processing on the server

[1270] 4. Receiving and analyzing information

[1271] The server receives the information sent by the user and analyzes it using an AI algorithm. This algorithm selects recommended tourist spots and restaurants based on the user's interests and past experiences. The server also uses a generative AI model to generate recommended dishes and restaurants based on the user's current location and interests.

[1272] 5. Generating and sending recommendations

[1273] The server generates recommended information (e.g., tourist spot "Hakone Hot Springs," restaurant "Sushi Restaurant") and sends it to the mobile terminal.

[1274] Displaying results and settlement

[1275] 6. Display of recommended information

[1276] The mobile device displays the recommended information received from the server, along with detailed information about each recommended spot (e.g., location, business hours, whether cashless payment is accepted, etc.).

[1277] 7. Special Experience Reservations and Payment

[1278] Users can book special experiences based on the displayed information and pay cashlessly through the app, such as special guided tours or limited menus.

[1279] Hardware and software used

[1280] Mobile devices: smartphones, tablets, etc.

[1281] Server: A computer system that performs on-demand data processing.

[1282] Online payment applications: Cashless payment services such as PayPal and Stripe.

[1283] Generative AI models: Artificial intelligence models such as GPT-3, BERT, etc.

[1284] Specific examples and examples of prompts for generative AI models

[1285] As a concrete example, a user arrives at Narita Airport and taps on a pop-up notification after connecting to Wi-Fi. The user downloads an online payment application from the app store and installs it on their mobile device. Next, the user launches the application, selects English, and enters "hot springs" as their interest and "first visit to Japan" as their past experience. The server receives the information, returns "Hakone Hot Springs" and "Sushi Restaurant" as recommendations, and the device displays the information. The user then books a special experience and makes a payment using the online payment application.

[1286] An example of a prompt for a generative AI model is:

[1287] "We are designing a food delivery application for foreign tourists. Please provide recommendations for Japanese restaurants and dishes based on the following information:

[1288] Interests: Hot spring trips

[1289] Past experience: First visit to Japan

[1290] Current location: Tokyo Station

[1291] Create results that include specific restaurant names, their features, and special offers.

[1292] As described above, this system provides foreign tourists visiting Japan with a comfortable and convenient sightseeing and dining experience.

[1293] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1294] Step 1:

[1295] When a user arrives at a specific location (e.g., an airport or major tourist destination) and connects to Wi-Fi, a pop-up notification appears on the device, prompting the user to download and install an online payment application from the app store by tapping the notification.

[1296] Input: User's current location and Wi-Fi connection

[1297] Output: Show popup notification

[1298] Specific operation: The device generates and displays a pop-up notification based on GPS data and Wi-Fi connection information.

[1299] Step 2:

[1300] The user starts the application and selects their native language (e.g., English) on the language setting screen.

[1301] Input: User launches application for the first time

[1302] Output: Display of language setting screen

[1303] What it does: When the app first launches, it loads the default settings and prompts the user to select a language.

[1304] Step 3:

[1305] The user enters information about their interests (e.g., hot springs) and past travel experiences (e.g., first visit to Japan) and presses the submit button.

[1306] Input: User input of interests and past experiences

[1307] Output: Sending input information to the server

[1308] Specific operation: The information entered by the user is sent by the terminal to the server as an HTTP request.

[1309] Step 4:

[1310] The server analyzes the information received from the user and uses an AI algorithm to select recommended tourist spots and restaurants based on the user's interests and past experiences.

[1311] Input: User interests and past experiences

[1312] Output: A list of recommended tourist spots and restaurants

[1313] How it works: The server uses a generative AI model (such as GPT-3) to generate prompts and then creates a list of tourist attractions and restaurants based on those prompts. The following prompts are used:

[1314] "We are designing a food delivery application for foreign tourists. Please provide recommendations for Japanese restaurants and dishes based on the following information:

[1315] Interests: Hot spring trips

[1316] Past experience: First visit to Japan

[1317] Current location: Tokyo Station

[1318] Create results that include specific restaurant names, their features, and special offers.

[1319] Step 5:

[1320] The server generates a list of recommended tourist spots and restaurants and sends it to the terminal.

[1321] Input: Recommended tourist spots and restaurant list

[1322] Output: Send the list to the mobile device

[1323] Specific operation: The server returns the generated list to the terminal as an HTTP response.

[1324] Step 6:

[1325] The device displays the recommended information received from the server.

[1326] Input: A list of recommendations from the server

[1327] Output: Display information on the terminal

[1328] Specific operation: The device analyzes the data received and displays it in a format that is easy for the user to view.

[1329] Step 7:

[1330] The user can book a special experience (e.g., a guided tour or a limited menu) based on the displayed information and make a cashless payment through an online payment application.

[1331] Input: User reservation information and payment information

[1332] Output: Reservation and payment completion notification

[1333] Specific operation: The terminal sends the reservation details to the server, and processes the transaction using an online payment API (e.g., PayPal or Stripe) as the payment process. As a result, a notification of the completion of the reservation and payment is displayed to the user.

[1334] By following these steps, foreign visitors to Japan can comfortably enjoy tourist spots and restaurants around the country and smoothly use cashless payment methods.

[1335] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1336] The system of the present invention is designed to enable foreign tourists visiting Japan to enjoy tourist spots and restaurants in Japan with peace of mind and to use cashless payment. Furthermore, it provides a more personalized tourist experience by recognizing the user's emotions and making customized suggestions based on those emotions. A specific embodiment of this system is described below.

[1337] System Overview

[1338] The system consists of the following main components:

[1339] Mobile devices (such as users' smartphones or tablets)

[1340] Server (a computer system that stores, processes, and transmits data)

[1341] Online payment application

[1342] Emotion engine (software for recognizing user emotions)

[1343] User operation steps

[1344] 1. Download and install the app

[1345] When users arrive at Narita Airport or other major arrival points, a pop-up notification will appear after connecting to Wi-Fi.

[1346] The user taps the pop-up notification, downloads the online payment application from the app store, and installs it on the mobile device.

[1347] 2. First launch and setup

[1348] The user launches the app and selects English from the language settings screen.

[1349] The app displays an initial setup screen, prompting the user to enter information about their interests and past experiences.

[1350] 3. Enter information

[1351] Users input their interests (e.g., hot springs) and past travel experiences (e.g., first visit to Japan), and the emotion engine analyzes the user's facial expressions and voice to recognize their emotions.

[1352] The device sends the input information and emotion data to the server.

[1353] Processing on the server

[1354] 4. Receiving and analyzing information

[1355] The server receives the input information and emotion data sent from the terminal.

[1356] The server uses AI algorithms and an emotion engine to select recommended tourist spots and restaurants based on input interests, past experiences, and recognized emotions.

[1357] 5. Generating and sending recommendations

[1358] The server generates a list of recommended tourist spots and restaurants for the user. For example, "Hakone Onsen" or "Ramen Museum" are selected.

[1359] The server returns the generated recommendations to the device.

[1360] Displaying results and offering special experiences

[1361] 6. Display of recommended information

[1362] The device displays the recommended information received from the server.

[1363] Detailed information about each recommended spot (location, opening hours, whether cashless payment is accepted, etc.) is displayed.

[1364] 7. Special Experience Reservations and Payment

[1365] The server generates a special experience (e.g., a guided tour exclusive to the Ramen Museum) and displays it in the app.

[1366] A user books a special experience and pays for it using an online payment application.

[1367] Specific examples

[1368] The user arrives at Narita Airport and taps the pop-up notification that appears after connecting to Wi-Fi.

[1369] A user downloads an online payment application from an app store and installs it on a mobile device.

[1370] The user starts the app, selects English, and enters "hot springs" as their interest and "first visit to Japan" as their past experience. The emotion engine recognizes the user's emotions from their facial expressions and voice.

[1371] The device sends information and emotional data to the server, which then returns recommendations for "Hakone Onsen" and "Ramen Museum."

[1372] The device displays the recommended information, and the user checks for more information.

[1373] The server generates a "Ramen Museum Exclusive Guided Tour," which the user reserves and pays for using an online payment application.

[1374] This series of processes allows foreign tourists visiting Japan to easily find tourist attractions and restaurants within Japan, and by receiving emotion-based suggestions, they can enjoy a more personalized sightseeing experience. This system provides users with a comfortable and convenient sightseeing experience.

[1375] The processing flow will be explained below.

[1376] Step 1:

[1377] When the user arrives at Narita Airport and connects to Wi-Fi, a pop-up notification appears. The device displays a pop-up notification prompting the user to download an online payment application.

[1378] Step 2:

[1379] The user taps the pop-up notification and downloads the online payment application from the app store. The device installs the application and displays a notification that the installation is complete.

[1380] Step 3:

[1381] After installation, a user launches the app and selects English on the language settings screen. The device displays an initial setup screen, prompting the user to enter information about their interests and past experiences.

[1382] Step 4:

[1383] The user enters information such as "Interests: Hot Springs, Food: Ramen, Experience: First visit to Japan" into the information input form, and the emotion engine analyzes the user's facial expressions and voice to recognize their emotions. The device then sends the input information and emotion data to the server.

[1384] Step 5:

[1385] The server receives input information and emotion data sent from the device, analyzes the received information, and uses AI algorithms and emotion engines to select recommended tourist spots and restaurants based on the user's interests, past experiences, and recognized emotions.

[1386] Step 6:

[1387] The server generates a list of selected recommended tourist spots and restaurants, and adds related information (location, business hours, cashless payment availability, etc.). The server then returns the generated recommendation information to the terminal.

[1388] Step 7:

[1389] The device displays the recommended information received from the server to the user, including detailed information such as the addresses, access information, and opening hours of "Hakone Onsen" and "Ramen Museum."

[1390] Step 8:

[1391] The user checks the displayed details and plans a visit. The server generates a special experience (e.g., an exclusive guided tour of the Ramen Museum) based on the user's interests and emotions and sends it to the device.

[1392] Step 9:

[1393] The device displays detailed information about the special experience to the user, including an overview of the special experience, how to book, and the price.

[1394] Step 10:

[1395] A user books a special experience and pays using an online payment application. The terminal sends the payment information to a server, which processes the booking to confirm the booking.

[1396] This series of steps makes it easier for foreign tourists visiting Japan to find tourist attractions and restaurants within the country, and by receiving customized suggestions based on their own emotions, they can enjoy a more personalized sightseeing experience. This system provides users with a comfortable and convenient sightseeing experience.

[1397] Example 2

[1398] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1399] In order for foreign tourists visiting Japan to enjoy tourist spots and restaurants in Japan with peace of mind, appropriate guidance and the widespread adoption of cashless payment are essential. However, there are few systems that can overcome language barriers, provide personalized information tailored to the interests of individual travelers, and improve the convenience of online payments. This invention solves these issues by providing a system that makes customized suggestions based on travelers' interests and emotions and facilitates cashless payment.

[1400] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for transmitting user input information and emotion data to the server, a means including an algorithm for the server to suggest tourist spots and restaurants based on the user input information and emotion data, and a means for transmitting the suggestion information to the user's mobile terminal. This enables foreign tourists visiting Japan to overcome language barriers, obtain personalized tourist information based on their individual emotions, and easily make cashless payments.

[1401] An "online payment application" is software that allows users to pay for goods and services over the Internet without using cash.

[1402] A "mobile terminal" is an electronic device that a user can carry around and has a communication function, and includes smartphones, tablets, and the like.

[1403] "Interests" refers to information about topics, activities, tourist destinations, etc. that are of particular interest to users.

[1404] "Past experience" refers to the history of trips and activities that a user has previously undertaken.

[1405] "Emotion data" is data that reflects the user's current emotions, and is information obtained through facial expression and voice analysis, etc.

[1406] A "server" is a computer system that receives, stores, processes, and transmits data.

[1407] An "AI algorithm" is a computational procedure that uses artificial intelligence techniques to analyze data and produce a specific result.

[1408] "Suggested information" is information about recommended tourist spots, restaurants, etc. that is generated by the server based on the user's input information and emotional data.

[1409] A "special experience" is a plan that offers additional benefits and exclusive services in addition to regular sightseeing and dining.

[1410] A "notification means" is a system that displays messages or alerts to encourage users to take specific actions.

[1411] "Cashless payment" refers to transactions that are conducted using electronic payment methods without using cash.

[1412] The present invention is a system that allows foreign tourists visiting Japan to enjoy tourist spots and restaurants in Japan with peace of mind and use cashless payment. Furthermore, the system provides a personalized tourism experience by recognizing the user's emotions and making customized suggestions based on those emotions. A specific embodiment of this system is described below.

[1413] System configuration

[1414] The system consists of the following main components:

[1415] 1. Mobile terminal: An electronic device with communication capabilities, such as a user's smartphone or tablet.

[1416] 2. Server: A computer system that stores, processes, and transmits data.

[1417] 3. Online payment application: Software that allows users to pay for goods and services over the Internet without using cash.

[1418] 4. Emotion engine: Software that analyzes the user's facial expressions and voice to recognize emotions.

[1419] Operational Overview

[1420] Download and install the app

[1421] When users arrive at Narita Airport or other major arrival points, a pop-up notification will appear after connecting to Wi-Fi. By tapping on this notification, users can download an online payment application from the app store and install it on their mobile device.

[1422] First time launch and setup

[1423] When users first launch the app, they are prompted to select English as their language setting. They are then prompted to enter information about their interests and past experiences. For example, they can enter "hot springs" as their interest and "first visit to Japan" as their past travel experience.

[1424] Information input and emotion recognition

[1425] The emotion engine analyzes the user's facial expressions and voice to recognize their current emotion, and the acquired emotion data and input information are sent from the device to the server.

[1426] Data processing on the server

[1427] The server uses an AI algorithm to analyze the inputted interests, past experiences, and recognized emotions. As a result of the analysis, information on recommended tourist spots and restaurants is generated. For example, "Hakone Onsen" and "Ramen Museum" are selected.

[1428] Displaying recommendations

[1429] The server sends the generated recommendation information to the device, which then displays it to the user. Detailed information about each recommended spot is also displayed at the same time. The user decides on a destination based on the displayed information.

[1430] Special experience booking and payment

[1431] The server generates special experiences (e.g., "Exclusive Guided Tour of Ramen Museum") and displays them in the app. Users can book them and pay for them using an online payment application.

[1432] Specific examples

[1433] The user arrives at Narita Airport, connects to Wi-Fi, and then taps the popup notification.

[1434] A user downloads an online payment application from an app store and installs it on a mobile device.

[1435] A user launches the app, selects English, and enters their interest in "hot springs" and their past experience as "first visit to Japan."

[1436] The emotion engine recognizes the user's emotions from facial expressions and voice.

[1437] The device sends information and emotional data to the server, which then returns recommendations for "Hakone Onsen" and "Ramen Museum."

[1438] The device displays the recommended information, and the user checks for more information.

[1439] The server generates a "Ramen Museum Exclusive Guided Tour," which the user reserves and pays for using an online payment application.

[1440] In this way, foreign tourists visiting Japan can enjoy tourist attractions and restaurants in Japan with peace of mind, and receive emotion-based suggestions for a more personalized sightseeing experience. The system is designed to provide users with a comfortable and convenient sightseeing experience.

[1441] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1442] Step 1: Download and install the app

[1443] Once users arrive and connect to Wi-Fi, they will receive a pop-up notification containing a link to download a dedicated app for visitors to Japan.

[1444] The user taps on the popup notification and is redirected to the app store.

[1445] The user downloads the app and installs it on their device.

[1446] Input: Wi-Fi connection, popup notification

[1447] Output: App download link display, app installation

[1448] Step 2: First launch and language setting

[1449] The user launches the app for the first time.

[1450] The terminal displays a language setting screen, and the user selects English.

[1451] Input: Launch the app, display the language setting screen

[1452] Output: Language selection (English)

[1453] Step 3: Enter your interests and past experiences

[1454] The device will display an initial setup screen, prompting you to enter your interests and past travel experiences.

[1455] The user enters information such as "hot springs" and "first visit to Japan."

[1456] The emotion engine analyzes facial expressions and voice to recognize the current emotion.

[1457] Input: Initial setup screen display, interests, past travel experiences, user facial expressions and voice

[1458] Output: Input information and emotion data

[1459] Step 4: Sending data to the server

[1460] The terminal transmits the input information and emotion data to the server.

[1461] Input: Input information and emotion data

[1462] Output: Sending data to the server, confirming data reception

[1463] Step 5: Data analysis on the server

[1464] The server receives the input information and emotion data.

[1465] The server uses AI algorithms to analyze the input interests, past experiences, and recognized emotions.

[1466] The server selects recommended tourist spots and restaurants based on the analysis results.

[1467] Input: Input information and emotion data

[1468] Output: Analysis results, list of selected tourist spots and restaurants

[1469] Step 6: Generate and send recommendations

[1470] The server generates recommendations based on the analysis results, such as "Hakone Hot Springs" or "Ramen Museum."

[1471] The server generates recommendation information and sends it to the terminal.

[1472] Input: Analysis results

[1473] Output: Recommendations, data sent to device

[1474] Step 7: View recommendations

[1475] The device displays the recommended information received from the server.

[1476] Detailed information about each recommended spot (location, opening hours, whether cashless payment is accepted, etc.) is displayed.

[1477] Input: Recommendations

[1478] Output: Show detailed information

[1479] Step 8: Book and pay for your special experience

[1480] The server generates a special experience (e.g., a guided tour exclusive to the Ramen Museum) and displays it in the app.

[1481] A user books a special experience and pays for it using an online payment application.

[1482] Input: Special experience information, booking request

[1483] Output: Reservation completion notification, payment completion notification

[1484] This series of processing steps allows foreign tourists to enjoy sightseeing spots and restaurants in Japan with peace of mind. Utilizing emotion data also makes it possible to provide personalized sightseeing suggestions.

[1485] (Application example 2)

[1486] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1487] When foreign tourists visit Japan, they often face difficulties in finding suitable dining facilities due to language barriers and cultural differences, and it is also cumbersome to check whether online payment is available. Therefore, personalized suggestions based on emotions are needed so that visitors can enjoy their meals with peace of mind.

[1488] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1489] means including an algorithm for suggesting dining establishments based on user input information and data from an emotion recognition engine;

[1490] means for transmitting the proposal information to a user's mobile terminal;

[1491] means for ordering meals and making online payments based on the suggested information;

[1492] This allows for suggestions of dining options and menus based on the user's current mood and preferences, and allows for seamless food ordering and online payment.

[1493] An "online payment application" is software that allows users to make payments safely and quickly via the Internet using mobile devices such as smartphones and tablets.

[1494] A "mobile terminal" is an electronic device that a user can carry with them, such as a smartphone, tablet, or laptop.

[1495] "Interests" are information about specific things or activities that a user is particularly interested in and enjoys.

[1496] "Past experiences" are information about events or activities that the user has previously experienced.

[1497] An "emotion recognition engine" is software that analyzes facial expressions and voice data to identify a user's current emotional state.

[1498] "Food and beverage establishments" are places that serve food and drinks, such as restaurants, cafes, and bars.

[1499] "Input information" is data about interests and past experiences that a user provides to an application.

[1500] "Suggested information" is information about optimal dining facilities and menus generated by the server based on the user's input information and emotional state.

[1501] "Ordering a meal" refers to the act of purchasing a food and drink menu item selected by the user based on the suggested information.

[1502] A "special experience" is a special service or activity that differs from normal usage and provides added value to the user.

[1503] This invention is a system that provides personalized suggestions based on emotions to foreign tourists visiting Japan when they visit restaurants and other establishments in Japan, reducing language barriers and cultural differences. The system consists of a user's mobile device, a server, an online payment application, and an emotion recognition engine.

[1504] System Overview

[1505] The system includes the following major components:

[1506] Mobile device: An electronic device that can be carried by a user, such as a smartphone or tablet.

[1507] Server: A computer system that stores, processes, and transmits data.

[1508] Online payment application: Software that allows you to make payments securely and quickly over the internet (e.g., PayPal, Stripe).

[1509] Emotion recognition engine: Software that analyzes facial and voice data to identify a user's emotional state (e.g., Microsoft Azure Cognitive Services).

[1510] User operation steps

[1511] 1. Download and install the app

[1512] A user downloads an online payment application from an app store and installs it on a mobile device.

[1513] 2. First launch and setup

[1514] The user starts the app, selects an appropriate language (e.g., English) from the language setting screen, and enters their interests (e.g., Japanese food, Chinese food) and past experiences (e.g., vegetarian, likes spicy food).

[1515] 3. Emotion recognition

[1516] The mobile device captures the user's facial expressions and voice data and analyzes them in real time using an emotion recognition engine.

[1517] 4. Information Transmission

[1518] The mobile terminal transmits the input information and the recognized emotion data to the server.

[1519] Processing on the server

[1520] The server does the following:

[1521] 1. Analysis of information

[1522] The server receives the input information and emotional data sent by the user and uses an AI algorithm and emotion recognition engine to select the most suitable dining establishments and menus for the user.

[1523] 2. Proposal information generation

[1524] The server generates a list of optimal dining options and menus based on the user's current mood and preferences.

[1525] 3. Sending Proposal Information

[1526] The server transmits the generated proposal information to the user's mobile terminal.

[1527] Viewing and manipulating results

[1528] 1. Display of suggested information

[1529] The mobile terminal receives the proposal information and the user confirms it.

[1530] 2. Ordering and Payment

[1531] The user selects from suggested dining options and menus and pays through an online payment application.

[1532] Specific examples

[1533] Specifically, an example of how this system works is shown below.

[1534] scenario:

[1535] A user launches an emotion-aware food delivery app on their smartphone and feels a bit down today.

[1536] The app can recognize the emotion of "sadness" from the user's facial expression and suggest hot soup or comforting meals.

[1537] Example prompt sentence:

[1538] User Information:

[1539] Favorite cuisine type: Japanese

[1540] Preferred spiciness level: Medium

[1541] Specific allergies: None

[1542] Inferred emotion: Sadness

[1543] AI algorithm recommendation results:

[1544] Maiki Pumpkin Soup (Warm and comforting)

[1545] Porridge set meal (healthy and very comforting)

[1546] This system will enable personalized, emotion-based recommendations for dining options and menus, as well as easy online payment.

[1547] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1548] Step 1:

[1549] Download and install the app

[1550] A user downloads an online payment application from an app store and installs it on a mobile device.

[1551] Enter: App Store

[1552] Output: Applications installed on the mobile device

[1553] Step 2:

[1554] First time launch and setup

[1555] A user starts the app, selects English from the language setting screen, and enters their interests (e.g., Japanese food, Chinese food) and past experiences (e.g., vegetarian, likes spicy food).

[1556] Input: User interests and past experiences

[1557] Output: The user's input information is saved in the mobile device.

[1558] Step 3:

[1559] emotion recognition

[1560] The mobile device captures the user's facial expressions and voice data and analyzes them in real time using an emotion recognition engine.

[1561] Input: User's facial expressions and voice data

[1562] Output: User emotion data

[1563] Step 4:

[1564] Information transmission

[1565] The mobile terminal transmits the input information and the recognized emotion data to the server.

[1566] Input: User input information and emotion data

[1567] Output: Data sent to the server

[1568] Step 5:

[1569] Analysis of information

[1570] The server receives the input information and emotional data sent by the user and uses an AI algorithm and emotion recognition engine to select the most suitable dining establishments and menus for the user.

[1571] Input: User input information and emotion data

[1572] Output: Restaurant and menu suggestions

[1573] Step 6:

[1574] Generate suggestions

[1575] The server generates a list of optimal dining options and menus based on the user's current mood and preferences.

[1576] Input: Analysis results of information

[1577] Output: Generated proposal information

[1578] Step 7:

[1579] Sending Proposal Information

[1580] The server transmits the generated proposal information to the user's mobile terminal.

[1581] Input: Generated proposal information

[1582] Output: Proposal information sent to the mobile terminal

[1583] Step 8:

[1584] Displaying Proposal Information

[1585] The mobile terminal receives the proposal information and the user confirms it.

[1586] Input: Proposal information sent from the server

[1587] Output: Proposal information displayed on the mobile device

[1588] Step 9:

[1589] Ordering and Payment

[1590] The user selects from suggested dining options and menus and pays through an online payment application.

[1591] Input: User's choice

[1592] Output: Completed order and payment information

[1593] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1594] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1595] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1596] [Fourth embodiment]

[1597] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1598] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1599] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1600] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1601] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1602] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1603] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1604] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1605] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1606] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1607] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1608] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1609] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1610] The system of the present invention is designed to enable foreign tourists visiting Japan to enjoy tourist spots and restaurants in Japan with peace of mind and to use cashless payment. A specific embodiment of this system will be described below.

[1611] System Overview

[1612] The system consists of the following main components:

[1613] Mobile devices (such as users' smartphones or tablets)

[1614] Server (a computer system that stores, processes, and transmits data)

[1615] Online payment application

[1616] User operation steps

[1617] 1. Download and install the app

[1618] When users arrive at Narita Airport or other major arrival points, a pop-up notification will appear after connecting to Wi-Fi.

[1619] The user taps the pop-up notification, downloads the online payment application from the app store, and installs it on the mobile device.

[1620] 2. First launch and setup

[1621] The user launches the app and selects English from the language settings screen.

[1622] The app displays an initial setup screen, prompting the user to enter information about their interests and past experiences.

[1623] 3. Enter information

[1624] The user enters their interests (e.g., hot springs), past travel experiences (e.g., first visit to Japan), etc.

[1625] The terminal transmits the input information to the server.

[1626] Processing on the server

[1627] 4. Receiving and analyzing information

[1628] The server receives input information from the terminal.

[1629] The server uses AI algorithms to select recommended tourist spots and restaurants based on input interests and past experiences.

[1630] 5. Generating and sending recommendations

[1631] The server generates a list of recommended tourist spots and restaurants for the user. For example, "Hakone Onsen" or "Ramen Museum" are selected.

[1632] The server transmits the generated recommendation information to the terminal.

[1633] Displaying results and offering special experiences

[1634] 6. Display of recommended information

[1635] The device displays the recommended information received from the server.

[1636] Detailed information about each recommended spot (location, opening hours, whether cashless payment is accepted, etc.) is displayed.

[1637] 7. Special Experience Reservations and Payment

[1638] The server generates a special experience (e.g., a guided tour exclusive to the Ramen Museum) and displays it in the app.

[1639] A user books a special experience and pays for it using an online payment application.

[1640] Specific examples

[1641] The user arrives at Narita Airport and taps the pop-up notification that appears after connecting to Wi-Fi.

[1642] A user downloads an online payment application from an app store and installs it on a mobile device.

[1643] A user launches the app, selects English, and enters "hot springs" as their interest and "first visit to Japan" as their past experience.

[1644] The device sends the information to the server, which then returns "Hakone Onsen" and "Ramen Museum" as recommendations.

[1645] The device displays the recommended information, and the user checks for more information.

[1646] The server generates a "Ramen Museum Exclusive Guided Tour," which the user reserves and pays for using an online payment application.

[1647] Through this process, foreign tourists visiting Japan can smoothly find tourist spots and restaurants, book special experiences, and use cashless payment. This system provides users with a comfortable and convenient tourist experience.

[1648] The processing flow will be explained below.

[1649] Step 1:

[1650] When the user arrives at Narita Airport and connects to Wi-Fi, a pop-up notification appears. The device displays a pop-up notification prompting the user to download an online payment application.

[1651] Step 2:

[1652] The user taps the pop-up notification and downloads the online payment application from the app store. The device installs the application and displays a notification that the installation is complete.

[1653] Step 3:

[1654] After installation, a user launches the app and selects English on the language settings screen. The device displays an initial setup screen, prompting the user to enter information about their interests and past experiences.

[1655] Step 4:

[1656] The user enters information such as "Interests: Hot Springs, Food: Ramen, Experience: First visit to Japan" into the information input form and presses the send button. The device then sends the entered information to the server.

[1657] Step 5:

[1658] The server receives the input information sent from the device, analyzes it, and uses an AI algorithm to select recommended tourist spots and restaurants based on the user's interests and past experiences.

[1659] Step 6:

[1660] The server generates a list of selected recommended tourist spots and restaurants, and adds related information (location, business hours, cashless payment availability, etc.). The server then returns the generated recommendation information to the terminal.

[1661] Step 7:

[1662] The device displays the recommended information received from the server to the user, including detailed information such as the addresses, access information, and opening hours of "Hakone Onsen" and "Ramen Museum."

[1663] Step 8:

[1664] The user checks the displayed details and plans a visit. The server generates a special experience based on the user's interests (e.g., an exclusive guided tour of the Ramen Museum) and sends it to the device.

[1665] Step 9:

[1666] The device displays detailed information about the special experience to the user, including an overview of the special experience, how to book, and the price.

[1667] Step 10:

[1668] A user books a special experience and pays using an online payment application. The terminal sends the payment information to a server, which processes the booking to confirm the booking.

[1669] This series of steps allows foreign tourists to easily find tourist spots and restaurants in Japan, book special experiences, and use cashless payment, providing a comfortable and convenient tourist experience for travelers.

[1670] Example 1

[1671] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1672] There is a lack of support systems to ensure that foreign tourists visiting Japan can enjoy sightseeing and dining in the country with peace of mind. Furthermore, there is no centralized system in place to provide information on tourist spots and restaurants, reservations for special experiences, and cashless payments. Furthermore, there is a lack of means to provide travelers with the information they need at the right time at specific locations. This makes it difficult for travelers to spend their stay comfortably and efficiently.

[1673] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1674] In this invention, the server includes a means for a user to download and install an online payment application to a mobile terminal, a means for the user to input information about their interests and past experiences, a means for using an AI algorithm to suggest tourist spots and restaurants based on the user's input information, a notification means for prompting the user to download the online payment application at a specific location, and a means for checking whether the suggested tourist spots and restaurants accept cashless payment. This allows foreign tourists visiting Japan to enjoy sightseeing and dining efficiently and comfortably at their destinations.

[1675] An "online payment application" is software that allows users to pay for goods and services over the Internet using their mobile devices.

[1676] "Mobile terminal" refers to a portable computing device such as a smartphone or tablet.

[1677] "AI algorithm" refers to the computational procedures used by artificial intelligence (AI) to analyze and make predictions based on data.

[1678] "Tourist destination" means a place visited by tourists or visitors for tourism purposes.

[1679] "Restaurant" refers to a place that serves food and drinks and where customers eat and drink.

[1680] "Special experiences" refer to unique services and activities that differ from regular sightseeing and dining, and are special experiences that are offered under specific conditions.

[1681] "Notification means" refers to a system or method for conveying information to users when certain conditions are met.

[1682] "Cashless payment" refers to a payment method that does not use cash but instead uses credit cards, digital wallets, etc.

[1683] This invention is a system that allows foreign tourists visiting Japan to use cashless payment smoothly and safely when enjoying sightseeing, dining, and drinking within the country. The system consists of a mobile device such as a user's smartphone or tablet, a server computer system for storing, processing, and transmitting data, and an online payment application.

[1684] First, when a user arrives at a major arrival point such as Narita Airport and connects their smartphone to Wi-Fi, the mobile device automatically displays a pop-up notification. The pop-up notification includes a message saying, "Download an app to make your trip more convenient." When the user taps on this notification, they are directed to an app store where they can download and install an online payment application. Specific software names used include, for example, "PayPay" and "Alipay."

[1685] After installation is complete, the user launches the app for the first time. The mobile device displays a language setting screen and prompts the user to select a language. For example, English is selected. The device then displays the initial setting screen, where the user inputs their interests (e.g., hot springs) and past travel experiences (e.g., first visit to Japan). The input information is sent from the device to the server.

[1686] The server analyzes the received information using an AI algorithm (e.g., TensorFlow model) built into it. Based on the analysis results, it selects the most suitable tourist spots and restaurants for the user. For example, places such as Hakone Onsen and the Ramen Museum may be selected. The server generates this information as a list and sends it to the device.

[1687] The server displays recommended information on the user's device. This information also includes detailed information about each recommended spot (such as its location, opening hours, and whether cashless payment is accepted). If a special experience is suggested, the server generates a special experience, such as a guided tour exclusive to the Ramen Museum, and sends that information to the user's device. The user can then reserve this special experience and pay for it using an online payment application.

[1688] Through the above series of processes, foreign tourists visiting Japan can efficiently find tourist attractions and restaurants, book special experiences, and make cashless payments safely and smoothly.

[1689] Specific examples and examples of prompts for generative AI models

[1690] A concrete example is when a user arrives at Narita Airport and checks the pop-up notification that appears after connecting to Wi-Fi. The device displays the notification, and when the user taps it, the app store page is immediately opened. While the user downloads and installs an online payment application, the device displays the installation progress to the user. The user then launches the app, selects English, and enters "hot springs" as an interest and "first visit to Japan" as a past experience. The device sends the information to the server, and the server returns "Hakone Hot Springs" and "Ramen Museum" as recommendations. The device displays detailed information, and the user books the special experience and pays using the online payment application.

[1691] An example of a prompt for a generative AI model is as follows:

[1692] Please explain the process that a foreign tourist visiting Japan goes through after arriving at Narita Airport: connecting to Wi-Fi, tapping the pop-up notification, and installing a cashless payment app for Japan from the app store. Please then provide a detailed explanation of the steps involved, from launching the app for the first time, to being presented with recommended tourist spots and restaurants, and making reservations and payments for special experiences.

[1693] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1694] Step 1:

[1695] Download and install the app

[1696] The user arrives at Narita Airport and connects their smartphone to Wi-Fi.

[1697] The device will detect a Wi-Fi connection and display a pop-up notification with the message "Download apps to make your travel easier."

[1698] When users tap on the notification, they are directed to the app store.

[1699] A user downloads an online payment application from an app store and installs it on their device, during which the device displays the installation progress.

[1700] Input: User's Wi-Fi connection

[1701] Output: Show popup notification

[1702] Example of operation

[1703] The device runs a program that monitors Wi-Fi connections in the background and triggers a popup when a connection is made.

[1704] The user taps the notification, which opens the specified page in the app store.

[1705] The user downloads the app and is presented with an installation screen once complete.

[1706] Step 2:

[1707] First time launch and setup

[1708] The first time a user launches an installed app.

[1709] The device displays the language setting screen and prompts the user to select a language. The user selects English.

[1710] Once the language selection is complete, the device displays an initial setup screen, where the user enters their interests (e.g., hot springs) and past travel experiences (e.g., first visit to Japan).

[1711] Input: First launch of the app, user language selection, interests and travel experience

[1712] Output: Display of initial setting screen, accumulation of input data

[1713] Example of operation

[1714] The device will automatically display the language selection screen when first started.

[1715] Once the user selects a language, the language preference is saved within the app.

[1716] Users enter their interests and travel experiences and store that data in a local database.

[1717] Step 3:

[1718] Enter information

[1719] The user confirms their interests and past travel experiences on the settings screen and completes the input.

[1720] The terminal transmits the input information to the server.

[1721] Input: User interests and past travel experience data

[1722] Output: Send data to the server

[1723] Example of operation

[1724] The device sends the user input data in JSON format to the server.

[1725] When transmitting data, we use encryption technology (e.g., SSL / TLS) to ensure security.

[1726] The server receives the data and sends a confirmation response back to the terminal.

[1727] Step 4:

[1728] Receiving and analyzing information

[1729] The server receives information about the user's interests and past travel experiences sent from the terminal.

[1730] The server uses an AI algorithm (e.g., TensorFlow) to analyze the input information and select the best tourist spots and restaurants for the user based on the analysis results.

[1731] Input: User interests and past travel experience data

[1732] Output: A list of recommended tourist spots and restaurants as analysis results

[1733] Example of operation

[1734] The server stores the received data in a database and inputs it into the AI ​​model.

[1735] The AI ​​model predicts and generates a list of tourist attractions and restaurants that best fit your interests.

[1736] The generated list is converted to JSON format and sent to the terminal.

[1737] Step 5:

[1738] Generating and sending recommendations

[1739] The server generates a list of recommended tourist spots and restaurants based on the analysis results. For example, "Hakone Onsen" and "Ramen Museum" might be selected.

[1740] The server generates recommendation information and sends it to the terminal.

[1741] Input: Analysis result data

[1742] Output: A list of recommendations

[1743] Example of operation

[1744] The server creates a list based on the analysis results and stores it in a database.

[1745] The server encodes the list data in JSON format and sends it to the terminal.

[1746] Step 6:

[1747] Displaying recommendations

[1748] The device displays the recommended information received from the server.

[1749] The device will display detailed information about each recommended spot (location, opening hours, whether cashless payment is accepted, etc.).

[1750] Input: Recommendations from the server

[1751] Output: Detailed information displayed on the device display

[1752] Example of operation

[1753] The device receives and decodes the JSON response from the server.

[1754] The decoded data is displayed in a user interface.

[1755] Detailed information about each spot is displayed in text and image format.

[1756] Step 7:

[1757] Special experience booking and payment

[1758] The server generates a special experience for the user (e.g., a guided tour exclusive to the Ramen Museum) and transmits that information to the terminal.

[1759] A user books a special experience and pays for it using an online payment application.

[1760] Input: Special experience information, user reservation and payment information

[1761] Output: Special experience reservation confirmation and payment completion notification

[1762] Example of operation

[1763] The server generates special experience information and sends it to the device.

[1764] The device displays details about the special experience and provides a booking form.

[1765] Once the user makes a reservation and enters their payment information, the terminal initiates the online payment process.

[1766] Once payment is complete, a confirmation notice is sent to the terminal via the server.

[1767] (Application example 1)

[1768] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1769] The goal is to provide a system that allows foreign tourists visiting Japan to smoothly use cashless payment while enjoying sightseeing and dining in Japan, without having to face language barriers or the inconvenience of cash payments. There is also a need for a system that allows tourists to easily find nearby restaurants and order food on the spot.

[1770] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1771] In this invention, the server includes a means for receiving user input information, a means including an algorithm for suggesting tourist spots and restaurants based on the input information, and a means including a generative AI model for generating recommended dishes and restaurants based on the user's current location and interests. This allows foreign tourists visiting Japan to smoothly use cashless payment while enjoying tourist spots and restaurants in Japan, and further enables them to easily find and order recommended dishes and restaurants on the spot.

[1772] "Users" are foreign tourists visiting Japan who use the system to enjoy sightseeing, dining and drinking within Japan.

[1773] An "online payment application" is software that users install on their mobile devices, such as smartphones or tablets, to purchase goods or reserve services cashlessly.

[1774] A "mobile terminal" is a portable device such as a smartphone or tablet.

[1775] "Interests" refers to information about sightseeing and activities that users would like to experience in Japan.

[1776] "Past experience" refers to information about the user's past travel experiences, hobbies, and preferences.

[1777] A "server" is a computer system that receives information entered by users and processes and analyzes that information.

[1778] The "algorithm for suggesting tourist spots and restaurants" is a calculation procedure for selecting and suggesting appropriate tourist spots and restaurants based on the user's interests and past experiences.

[1779] "Suggestion information" is a list of tourist spots and restaurants recommended for the user, sent from the server.

[1780] A "special experience" is a special sightseeing or dining experience that is different from the usual and is booked based on the suggested information.

[1781] A "generative AI model" is an artificial intelligence model that generates recommended dishes and restaurants based on a user's current location and interests.

[1782] "Notification means" refers to a method for prompting a user to download an online payment application when the user reaches a specific location.

[1783] "Cashless payment" is a method of paying for goods and services without using cash.

[1784] The system of the present invention is designed to enable users to smoothly make cashless payments while enjoying sightseeing spots and restaurants in Japan. The main components of this system are a mobile terminal (such as a smartphone or tablet), a server, and an online payment application.

[1785] System Operation Overview

[1786] 1. Download and install the app

[1787] When a user arrives at a specific location (e.g., an airport or major tourist destination), a pop-up notification appears on the mobile device after connecting to Wi-Fi, allowing the user to download and install an online payment application from an app store.

[1788] 2. First launch and setup

[1789] A user launches the app and selects their native language (e.g., English) from the language settings screen. The app then prompts the user to enter information about their interests and past travel experiences.

[1790] 3. Entering information and sending it to the server

[1791] The user inputs their interests (e.g., Japanese cuisine (hot springs, etc.)) and past travel experiences (e.g., first visit to Japan) and sends this information to the server.

[1792] Processing on the server

[1793] 4. Receiving and analyzing information

[1794] The server receives the information sent by the user and analyzes it using an AI algorithm. This algorithm selects recommended tourist spots and restaurants based on the user's interests and past experiences. The server also uses a generative AI model to generate recommended dishes and restaurants based on the user's current location and interests.

[1795] 5. Generating and sending recommendations

[1796] The server generates recommended information (e.g., tourist spot "Hakone Hot Springs," restaurant "Sushi Restaurant") and sends it to the mobile terminal.

[1797] Displaying results and settlement

[1798] 6. Display of recommended information

[1799] The mobile device displays the recommended information received from the server, along with detailed information about each recommended spot (e.g., location, business hours, whether cashless payment is accepted, etc.).

[1800] 7. Special Experience Reservations and Payment

[1801] Users can book special experiences based on the displayed information and pay cashlessly through the app, such as special guided tours or limited menus.

[1802] Hardware and software used

[1803] Mobile devices: smartphones, tablets, etc.

[1804] Server: A computer system that performs on-demand data processing.

[1805] Online payment applications: Cashless payment services such as PayPal and Stripe.

[1806] Generative AI models: Artificial intelligence models such as GPT-3, BERT, etc.

[1807] Specific examples and examples of prompts for generative AI models

[1808] As a concrete example, a user arrives at Narita Airport and taps on a pop-up notification after connecting to Wi-Fi. The user downloads an online payment application from the app store and installs it on their mobile device. Next, the user launches the application, selects English, and enters "hot springs" as their interest and "first visit to Japan" as their past experience. The server receives the information, returns "Hakone Hot Springs" and "Sushi Restaurant" as recommendations, and the device displays the information. The user then books a special experience and makes a payment using the online payment application.

[1809] An example of a prompt for a generative AI model is:

[1810] "We are designing a food delivery application for foreign tourists. Please provide recommendations for Japanese restaurants and dishes based on the following information:

[1811] Interests: Hot spring trips

[1812] Past experience: First visit to Japan

[1813] Current location: Tokyo Station

[1814] Create results that include specific restaurant names, their features, and special offers.

[1815] As described above, this system provides foreign tourists visiting Japan with a comfortable and convenient sightseeing and dining experience.

[1816] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1817] Step 1:

[1818] When a user arrives at a specific location (e.g., an airport or major tourist destination) and connects to Wi-Fi, a pop-up notification appears on the device, prompting the user to download and install an online payment application from the app store by tapping the notification.

[1819] Input: User's current location and Wi-Fi connection

[1820] Output: Show popup notification

[1821] Specific operation: The device generates and displays a pop-up notification based on GPS data and Wi-Fi connection information.

[1822] Step 2:

[1823] The user starts the application and selects their native language (e.g., English) on the language setting screen.

[1824] Input: User launches application for the first time

[1825] Output: Display of language setting screen

[1826] What it does: When the app first launches, it loads the default settings and prompts the user to select a language.

[1827] Step 3:

[1828] The user enters information about their interests (e.g., hot springs) and past travel experiences (e.g., first visit to Japan) and presses the submit button.

[1829] Input: User input of interests and past experiences

[1830] Output: Sending input information to the server

[1831] Specific operation: The information entered by the user is sent by the terminal to the server as an HTTP request.

[1832] Step 4:

[1833] The server analyzes the information received from the user and uses an AI algorithm to select recommended tourist spots and restaurants based on the user's interests and past experiences.

[1834] Input: User interests and past experiences

[1835] Output: A list of recommended tourist spots and restaurants

[1836] How it works: The server uses a generative AI model (such as GPT-3) to generate prompts and then creates a list of tourist attractions and restaurants based on those prompts. The following prompts are used:

[1837] "We are designing a food delivery application for foreign tourists. Please provide recommendations for Japanese restaurants and dishes based on the following information:

[1838] Interests: Hot spring trips

[1839] Past experience: First visit to Japan

[1840] Current location: Tokyo Station

[1841] Create results that include specific restaurant names, their features, and special offers.

[1842] Step 5:

[1843] The server generates a list of recommended tourist spots and restaurants and sends it to the terminal.

[1844] Input: Recommended tourist spots and restaurant list

[1845] Output: Send the list to the mobile device

[1846] Specific operation: The server returns the generated list to the terminal as an HTTP response.

[1847] Step 6:

[1848] The device displays the recommended information received from the server.

[1849] Input: A list of recommendations from the server

[1850] Output: Display information on the terminal

[1851] Specific operation: The device analyzes the data received and displays it in a format that is easy for the user to view.

[1852] Step 7:

[1853] The user can book a special experience (e.g., a guided tour or a limited menu) based on the displayed information and make a cashless payment through an online payment application.

[1854] Input: User reservation information and payment information

[1855] Output: Reservation and payment completion notification

[1856] Specific operation: The terminal sends the reservation details to the server, and processes the transaction using an online payment API (e.g., PayPal or Stripe) as the payment process. As a result, a notification of the completion of the reservation and payment is displayed to the user.

[1857] By following these steps, foreign visitors to Japan can comfortably enjoy tourist spots and restaurants around the country and smoothly use cashless payment methods.

[1858] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1859] The system of the present invention is designed to enable foreign tourists visiting Japan to enjoy tourist spots and restaurants in Japan with peace of mind and to use cashless payment. Furthermore, it provides a more personalized tourist experience by recognizing the user's emotions and making customized suggestions based on those emotions. A specific embodiment of this system is described below.

[1860] System Overview

[1861] The system consists of the following main components:

[1862] Mobile devices (such as users' smartphones or tablets)

[1863] Server (a computer system that stores, processes, and transmits data)

[1864] Online payment application

[1865] Emotion engine (software for recognizing user emotions)

[1866] User operation steps

[1867] 1. Download and install the app

[1868] When users arrive at Narita Airport or other major arrival points, a pop-up notification will appear after connecting to Wi-Fi.

[1869] The user taps the pop-up notification, downloads the online payment application from the app store, and installs it on the mobile device.

[1870] 2. First launch and setup

[1871] The user launches the app and selects English from the language settings screen.

[1872] The app displays an initial setup screen, prompting the user to enter information about their interests and past experiences.

[1873] 3. Enter information

[1874] Users input their interests (e.g., hot springs) and past travel experiences (e.g., first visit to Japan), and the emotion engine analyzes the user's facial expressions and voice to recognize their emotions.

[1875] The device sends the input information and emotion data to the server.

[1876] Processing on the server

[1877] 4. Receiving and analyzing information

[1878] The server receives the input information and emotion data sent from the terminal.

[1879] The server uses AI algorithms and an emotion engine to select recommended tourist spots and restaurants based on input interests, past experiences, and recognized emotions.

[1880] 5. Generating and sending recommendations

[1881] The server generates a list of recommended tourist spots and restaurants for the user. For example, "Hakone Onsen" or "Ramen Museum" are selected.

[1882] The server returns the generated recommendations to the device.

[1883] Displaying results and offering special experiences

[1884] 6. Display of recommended information

[1885] The device displays the recommended information received from the server.

[1886] Detailed information about each recommended spot (location, opening hours, whether cashless payment is accepted, etc.) is displayed.

[1887] 7. Special Experience Reservations and Payment

[1888] The server generates a special experience (e.g., a guided tour exclusive to the Ramen Museum) and displays it in the app.

[1889] A user books a special experience and pays for it using an online payment application.

[1890] Specific examples

[1891] The user arrives at Narita Airport and taps the pop-up notification that appears after connecting to Wi-Fi.

[1892] A user downloads an online payment application from an app store and installs it on a mobile device.

[1893] The user starts the app, selects English, and enters "hot springs" as their interest and "first visit to Japan" as their past experience. The emotion engine recognizes the user's emotions from their facial expressions and voice.

[1894] The device sends information and emotional data to the server, which then returns recommendations for "Hakone Onsen" and "Ramen Museum."

[1895] The device displays the recommended information, and the user checks for more information.

[1896] The server generates a "Ramen Museum Exclusive Guided Tour," which the user reserves and pays for using an online payment application.

[1897] This series of processes allows foreign tourists visiting Japan to easily find tourist attractions and restaurants within Japan, and by receiving emotion-based suggestions, they can enjoy a more personalized sightseeing experience. This system provides users with a comfortable and convenient sightseeing experience.

[1898] The processing flow will be explained below.

[1899] Step 1:

[1900] When the user arrives at Narita Airport and connects to Wi-Fi, a pop-up notification appears. The device displays a pop-up notification prompting the user to download an online payment application.

[1901] Step 2:

[1902] The user taps the pop-up notification and downloads the online payment application from the app store. The device installs the application and displays a notification that the installation is complete.

[1903] Step 3:

[1904] After installation, a user launches the app and selects English on the language settings screen. The device displays an initial setup screen, prompting the user to enter information about their interests and past experiences.

[1905] Step 4:

[1906] The user enters information such as "Interests: Hot Springs, Food: Ramen, Experience: First visit to Japan" into the information input form, and the emotion engine analyzes the user's facial expressions and voice to recognize their emotions. The device then sends the input information and emotion data to the server.

[1907] Step 5:

[1908] The server receives input information and emotion data sent from the device, analyzes the received information, and uses AI algorithms and emotion engines to select recommended tourist spots and restaurants based on the user's interests, past experiences, and recognized emotions.

[1909] Step 6:

[1910] The server generates a list of selected recommended tourist spots and restaurants, and adds related information (location, business hours, cashless payment availability, etc.). The server then returns the generated recommendation information to the terminal.

[1911] Step 7:

[1912] The device displays the recommended information received from the server to the user, including detailed information such as the addresses, access information, and opening hours of "Hakone Onsen" and "Ramen Museum."

[1913] Step 8:

[1914] The user checks the displayed details and plans a visit. The server generates a special experience (e.g., an exclusive guided tour of the Ramen Museum) based on the user's interests and emotions and sends it to the device.

[1915] Step 9:

[1916] The device displays detailed information about the special experience to the user, including an overview of the special experience, how to book, and the price.

[1917] Step 10:

[1918] A user books a special experience and pays using an online payment application. The terminal sends the payment information to a server, which processes the booking to confirm the booking.

[1919] This series of steps makes it easier for foreign tourists visiting Japan to find tourist attractions and restaurants within the country, and by receiving customized suggestions based on their own emotions, they can enjoy a more personalized sightseeing experience. This system provides users with a comfortable and convenient sightseeing experience.

[1920] Example 2

[1921] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1922] In order for foreign tourists visiting Japan to enjoy tourist spots and restaurants in Japan with peace of mind, appropriate guidance and the widespread adoption of cashless payment are essential. However, there are few systems that can overcome language barriers, provide personalized information tailored to the interests of individual travelers, and improve the convenience of online payments. This invention solves these issues by providing a system that makes customized suggestions based on travelers' interests and emotions and facilitates cashless payment.

[1923] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for transmitting user input information and emotion data to the server, a means including an algorithm for the server to suggest tourist spots and restaurants based on the user input information and emotion data, and a means for transmitting the suggestion information to the user's mobile terminal. This enables foreign tourists visiting Japan to overcome language barriers, obtain personalized tourist information based on their individual emotions, and easily make cashless payments.

[1924] An "online payment application" is software that allows users to pay for goods and services over the Internet without using cash.

[1925] A "mobile terminal" is an electronic device that a user can carry around and has a communication function, and includes smartphones, tablets, and the like.

[1926] "Interests" refers to information about topics, activities, tourist destinations, etc. that are of particular interest to users.

[1927] "Past experience" refers to the history of trips and activities that a user has previously undertaken.

[1928] "Emotion data" is data that reflects the user's current emotions, and is information obtained through facial expression and voice analysis, etc.

[1929] A "server" is a computer system that receives, stores, processes, and transmits data.

[1930] An "AI algorithm" is a computational procedure that uses artificial intelligence techniques to analyze data and produce a specific result.

[1931] "Suggested information" is information about recommended tourist spots, restaurants, etc. that is generated by the server based on the user's input information and emotional data.

[1932] A "special experience" is a plan that offers additional benefits and exclusive services in addition to regular sightseeing and dining.

[1933] A "notification means" is a system that displays messages or alerts to encourage users to take specific actions.

[1934] "Cashless payment" refers to transactions that are conducted using electronic payment methods without using cash.

[1935] The present invention is a system that allows foreign tourists visiting Japan to enjoy tourist spots and restaurants in Japan with peace of mind and use cashless payment. Furthermore, the system provides a personalized tourism experience by recognizing the user's emotions and making customized suggestions based on those emotions. A specific embodiment of this system is described below.

[1936] System configuration

[1937] The system consists of the following main components:

[1938] 1. Mobile terminal: An electronic device with communication capabilities, such as a user's smartphone or tablet.

[1939] 2. Server: A computer system that stores, processes, and transmits data.

[1940] 3. Online payment application: Software that allows users to pay for goods and services over the Internet without using cash.

[1941] 4. Emotion engine: Software that analyzes the user's facial expressions and voice to recognize emotions.

[1942] Operational Overview

[1943] Download and install the app

[1944] When users arrive at Narita Airport or other major arrival points, a pop-up notification will appear after connecting to Wi-Fi. By tapping on this notification, users can download an online payment application from the app store and install it on their mobile device.

[1945] First time launch and setup

[1946] When users first launch the app, they are prompted to select English as their language setting. They are then prompted to enter information about their interests and past experiences. For example, they can enter "hot springs" as their interest and "first visit to Japan" as their past travel experience.

[1947] Information input and emotion recognition

[1948] The emotion engine analyzes the user's facial expressions and voice to recognize their current emotion, and the acquired emotion data and input information are sent from the device to the server.

[1949] Data processing on the server

[1950] The server uses an AI algorithm to analyze the inputted interests, past experiences, and recognized emotions. As a result of the analysis, information on recommended tourist spots and restaurants is generated. For example, "Hakone Onsen" and "Ramen Museum" are selected.

[1951] Displaying recommendations

[1952] The server sends the generated recommendation information to the device, which then displays it to the user. Detailed information about each recommended spot is also displayed at the same time. The user decides on a destination based on the displayed information.

[1953] Special experience booking and payment

[1954] The server generates special experiences (e.g., "Exclusive Guided Tour of Ramen Museum") and displays them in the app. Users can book them and pay for them using an online payment application.

[1955] Specific examples

[1956] The user arrives at Narita Airport, connects to Wi-Fi, and then taps the popup notification.

[1957] A user downloads an online payment application from an app store and installs it on a mobile device.

[1958] A user launches the app, selects English, and enters their interest in "hot springs" and their past experience as "first visit to Japan."

[1959] The emotion engine recognizes the user's emotions from facial expressions and voice.

[1960] The device sends information and emotional data to the server, which then returns recommendations for "Hakone Onsen" and "Ramen Museum."

[1961] The device displays the recommended information, and the user checks for more information.

[1962] The server generates a "Ramen Museum Exclusive Guided Tour," which the user reserves and pays for using an online payment application.

[1963] In this way, foreign tourists visiting Japan can enjoy tourist attractions and restaurants in Japan with peace of mind, and receive emotion-based suggestions for a more personalized sightseeing experience. The system is designed to provide users with a comfortable and convenient sightseeing experience.

[1964] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1965] Step 1: Download and install the app

[1966] Once users arrive and connect to Wi-Fi, they will receive a pop-up notification containing a link to download a dedicated app for visitors to Japan.

[1967] The user taps on the popup notification and is redirected to the app store.

[1968] The user downloads the app and installs it on their device.

[1969] Input: Wi-Fi connection, popup notification

[1970] Output: App download link display, app installation

[1971] Step 2: First launch and language setting

[1972] The user launches the app for the first time.

[1973] The terminal displays a language setting screen, and the user selects English.

[1974] Input: Launch the app, display the language setting screen

[1975] Output: Language selection (English)

[1976] Step 3: Enter your interests and past experiences

[1977] The device will display an initial setup screen, prompting you to enter your interests and past travel experiences.

[1978] The user enters information such as "hot springs" and "first visit to Japan."

[1979] The emotion engine analyzes facial expressions and voice to recognize the current emotion.

[1980] Input: Initial setup screen display, interests, past travel experiences, user facial expressions and voice

[1981] Output: Input information and emotion data

[1982] Step 4: Sending data to the server

[1983] The terminal transmits the input information and emotion data to the server.

[1984] Input: Input information and emotion data

[1985] Output: Sending data to the server, confirming data reception

[1986] Step 5: Data analysis on the server

[1987] The server receives the input information and emotion data.

[1988] The server uses AI algorithms to analyze the input interests, past experiences, and recognized emotions.

[1989] The server selects recommended tourist spots and restaurants based on the analysis results.

[1990] Input: Input information and emotion data

[1991] Output: Analysis results, list of selected tourist spots and restaurants

[1992] Step 6: Generate and send recommendations

[1993] The server generates recommendations based on the analysis results, such as "Hakone Hot Springs" or "Ramen Museum."

[1994] The server generates recommendation information and sends it to the terminal.

[1995] Input: Analysis results

[1996] Output: Recommendations, data sent to device

[1997] Step 7: View recommendations

[1998] The device displays the recommended information received from the server.

[1999] Detailed information about each recommended spot (location, opening hours, whether cashless payment is accepted, etc.) is displayed.

[2000] Input: Recommendations

[2001] Output: Show detailed information

[2002] Step 8: Book and pay for your special experience

[2003] The server generates a special experience (e.g., a guided tour exclusive to the Ramen Museum) and displays it in the app.

[2004] A user books a special experience and pays for it using an online payment application.

[2005] Input: Special experience information, booking request

[2006] Output: Reservation completion notification, payment completion notification

[2007] This series of processing steps allows foreign tourists to enjoy sightseeing spots and restaurants in Japan with peace of mind. Utilizing emotion data also makes it possible to provide personalized sightseeing suggestions.

[2008] (Application example 2)

[2009] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2010] When foreign tourists visit Japan, they often face difficulties in finding suitable dining facilities due to language barriers and cultural differences, and it is also cumbersome to check whether online payment is available. Therefore, personalized suggestions based on emotions are needed so that visitors can enjoy their meals with peace of mind.

[2011] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2012] means including an algorithm for suggesting dining establishments based on user input information and data from an emotion recognition engine;

[2013] means for transmitting the proposal information to a user's mobile terminal;

[2014] means for ordering meals and making online payments based on the suggested information;

[2015] This allows for suggestions of dining options and menus based on the user's current mood and preferences, and allows for seamless food ordering and online payment.

[2016] An "online payment application" is software that allows users to make payments safely and quickly via the Internet using mobile devices such as smartphones and tablets.

[2017] A "mobile terminal" is an electronic device that a user can carry with them, such as a smartphone, tablet, or laptop.

[2018] "Interests" are information about specific things or activities that a user is particularly interested in and enjoys.

[2019] "Past experiences" are information about events or activities that the user has previously experienced.

[2020] An "emotion recognition engine" is software that analyzes facial expressions and voice data to identify a user's current emotional state.

[2021] "Food and beverage establishments" are places that serve food and drinks, such as restaurants, cafes, and bars.

[2022] "Input information" is data about interests and past experiences that a user provides to an application.

[2023] "Suggested information" is information about optimal dining facilities and menus generated by the server based on the user's input information and emotional state.

[2024] "Ordering a meal" refers to the act of purchasing a food and drink menu item selected by the user based on the suggested information.

[2025] A "special experience" is a special service or activity that differs from normal usage and provides added value to the user.

[2026] This invention is a system that provides personalized suggestions based on emotions to foreign tourists visiting Japan when they visit restaurants and other establishments in Japan, reducing language barriers and cultural differences. The system consists of a user's mobile device, a server, an online payment application, and an emotion recognition engine.

[2027] System Overview

[2028] The system includes the following major components:

[2029] Mobile device: An electronic device that can be carried by a user, such as a smartphone or tablet.

[2030] Server: A computer system that stores, processes, and transmits data.

[2031] Online payment application: Software that allows you to make payments securely and quickly over the internet (e.g., PayPal, Stripe).

[2032] Emotion recognition engine: Software that analyzes facial and voice data to identify a user's emotional state (e.g., Microsoft Azure Cognitive Services).

[2033] User operation steps

[2034] 1. Download and install the app

[2035] A user downloads an online payment application from an app store and installs it on a mobile device.

[2036] 2. First launch and setup

[2037] The user starts the app, selects an appropriate language (e.g., English) from the language setting screen, and enters their interests (e.g., Japanese food, Chinese food) and past experiences (e.g., vegetarian, likes spicy food).

[2038] 3. Emotion recognition

[2039] The mobile device captures the user's facial expressions and voice data and analyzes them in real time using an emotion recognition engine.

[2040] 4. Information Transmission

[2041] The mobile terminal transmits the input information and the recognized emotion data to the server.

[2042] Processing on the server

[2043] The server does the following:

[2044] 1. Analysis of information

[2045] The server receives the input information and emotional data sent by the user and uses an AI algorithm and emotion recognition engine to select the most suitable dining establishments and menus for the user.

[2046] 2. Proposal information generation

[2047] The server generates a list of optimal dining options and menus based on the user's current mood and preferences.

[2048] 3. Sending Proposal Information

[2049] The server transmits the generated proposal information to the user's mobile terminal.

[2050] Viewing and manipulating results

[2051] 1. Display of suggested information

[2052] The mobile terminal receives the proposal information and the user confirms it.

[2053] 2. Ordering and Payment

[2054] The user selects from suggested dining options and menus and pays through an online payment application.

[2055] Specific examples

[2056] Specifically, an example of how this system works is shown below.

[2057] scenario:

[2058] A user launches an emotion-aware food delivery app on their smartphone and feels a bit down today.

[2059] The app can recognize the emotion of "sadness" from the user's facial expression and suggest hot soup or comforting meals.

[2060] Example prompt sentence:

[2061] User Information:

[2062] Favorite cuisine type: Japanese

[2063] Preferred spiciness level: Medium

[2064] Specific allergies: None

[2065] Inferred emotion: Sadness

[2066] AI algorithm recommendation results:

[2067] Maiki Pumpkin Soup (Warm and comforting)

[2068] Porridge set meal (healthy and very comforting)

[2069] This system will enable personalized, emotion-based recommendations for dining options and menus, as well as easy online payment.

[2070] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2071] Step 1:

[2072] Download and install the app

[2073] A user downloads an online payment application from an app store and installs it on a mobile device.

[2074] Enter: App Store

[2075] Output: Applications installed on the mobile device

[2076] Step 2:

[2077] First time launch and setup

[2078] A user starts the app, selects English from the language setting screen, and enters their interests (e.g., Japanese food, Chinese food) and past experiences (e.g., vegetarian, likes spicy food).

[2079] Input: User interests and past experiences

[2080] Output: The user's input information is saved in the mobile device.

[2081] Step 3:

[2082] emotion recognition

[2083] The mobile device captures the user's facial expressions and voice data and analyzes them in real time using an emotion recognition engine.

[2084] Input: User's facial expressions and voice data

[2085] Output: User emotion data

[2086] Step 4:

[2087] Information transmission

[2088] The mobile terminal transmits the input information and the recognized emotion data to the server.

[2089] Input: User input information and emotion data

[2090] Output: Data sent to the server

[2091] Step 5:

[2092] Analysis of information

[2093] The server receives the input information and emotional data sent by the user and uses an AI algorithm and emotion recognition engine to select the most suitable dining establishments and menus for the user.

[2094] Input: User input information and emotion data

[2095] Output: Restaurant and menu suggestions

[2096] Step 6:

[2097] Generate suggestions

[2098] The server generates a list of optimal dining options and menus based on the user's current mood and preferences.

[2099] Input: Analysis results of information

[2100] Output: Generated proposal information

[2101] Step 7:

[2102] Sending Proposal Information

[2103] The server transmits the generated proposal information to the user's mobile terminal.

[2104] Input: Generated proposal information

[2105] Output: Proposal information sent to the mobile terminal

[2106] Step 8:

[2107] Displaying Proposal Information

[2108] The mobile terminal receives the proposal information and the user confirms it.

[2109] Input: Proposal information sent from the server

[2110] Output: Proposal information displayed on the mobile device

[2111] Step 9:

[2112] Ordering and Payment

[2113] The user selects from suggested dining options and menus and pays through an online payment application.

[2114] Input: User's choice

[2115] Output: Completed order and payment information

[2116] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2117] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2118] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2119] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2120] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2121] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2122] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2123] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2124] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2125] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2126] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2127] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2128] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2129] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2130] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2131] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2132] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2133] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2134] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2135] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2136] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2137] The following is further disclosed regarding the above embodiment.

[2138] (Claim 1)

[2139] means for a user to download and install an online payment application onto a mobile terminal;

[2140] a means for users to input information about their interests and past experiences;

[2141] means for transmitting the user's input information to a server;

[2142] The server includes an algorithm for suggesting tourist spots and restaurants based on user input information;

[2143] means for transmitting the proposal information to a user's mobile terminal;

[2144] means for displaying suggested information on the mobile terminal;

[2145] means for booking a special experience based on the suggested information and making an online payment;

[2146] A system including:

[2147] (Claim 2)

[2148] 10. The system of claim 1, further comprising a notification means for prompting a user to download an online payment application at a specific point.

[2149] (Claim 3)

[2150] The system according to claim 1, wherein the server further comprises means for checking whether the suggested tourist spots and restaurants accept online payments.

[2151] "Example 1"

[2152] (Claim 1)

[2153] means for a user to download and install an online payment application onto a mobile terminal;

[2154] a means for users to input information about their interests and past experiences;

[2155] means for transmitting the user's input information to a server;

[2156] A means for suggesting tourist spots and restaurants based on user input information using an AI algorithm in the server;

[2157] means for transmitting the proposal information to a user's mobile terminal;

[2158] means for displaying suggested information on the mobile terminal;

[2159] means for booking a special experience based on the suggested information and making an online payment;

[2160] A system including:

[2161] (Claim 2)

[2162] 10. The system of claim 1, further comprising a notification means for prompting a user to download an online payment application at a specific point.

[2163] (Claim 3)

[2164] The system according to claim 1, wherein the server further comprises means for checking whether the suggested tourist spots and restaurants accept cashless payment.

[2165] "Application Example 1"

[2166] New Claims

[2167] (Claim 1)

[2168] means for a user to download and install an online payment application onto a mobile terminal;

[2169] a means for users to input information about their interests and past experiences;

[2170] means for transmitting the user's input information to a server;

[2171] The server includes an algorithm for suggesting tourist spots and restaurants based on user input information;

[2172] means for transmitting the proposal information to a user's mobile terminal;

[2173] means for displaying suggested information on the mobile terminal;

[2174] means for booking a special experience based on the suggested information and making an online payment;

[2175] means including a generative AI model for generating food and restaurant recommendations based on a user's location and interests;

[2176] A system including:

[2177] (Claim 2)

[2178] 10. The system of claim 1, further comprising a notification means for prompting a user to download an online payment application at a specific point.

[2179] (Claim 3)

[2180] The system according to claim 1, further comprising means for checking whether the tourist spots and restaurants recommended by the server accept online payments.

[2181] "Example 2: Combining Emotion Engines"

[2182] (Claim 1)

[2183] means for a user to download and install an online payment application onto a mobile terminal;

[2184] a means for users to input information about their interests and past experiences;

[2185] means for transmitting user input information and emotion data to a server;

[2186] A server includes an algorithm for suggesting tourist spots and restaurants based on the user's input information and emotion data;

[2187] means for transmitting the proposal information to the user's mobile terminal;

[2188] means for displaying the proposed information and the detailed information on the mobile terminal;

[2189] a means for booking a special experience based on the suggested information and making an online payment;

[2190] A system including:

[2191] (Claim 2)

[2192] 10. The system of claim 1, further comprising a notification means for prompting a user to download an online payment application at a specific point.

[2193] (Claim 3)

[2194] 2. The system according to claim 1, wherein the server further comprises means for checking whether the suggested tourist spots and restaurants accept online payments.

[2195] "Application example 2 when combining emotion engines"

[2196] (Claim 1)

[2197] means for a user to download and install an online payment application onto a mobile terminal;

[2198] a means for users to input information about their interests and past experiences;

[2199] means for transmitting the input information, facial expression and voice data of the user to a server;

[2200] means, at said server, for including an algorithm for suggesting dining establishments based on user input information and data from an emotion recognition engine;

[2201] means for transmitting the proposal information to a user's mobile terminal;

[2202] means for displaying suggested information on the mobile terminal;

[2203] means for ordering meals and making online payments based on the suggested information;

[2204] A system including:

[2205] (Claim 2)

[2206] 10. The system of claim 1, further comprising a notification means for prompting a user to download an online payment application at a specific point.

[2207] (Claim 3)

[2208] 10. The system of claim 1, wherein the server further comprises means for verifying whether the proposed dining establishment accepts online payments. [Explanation of symbols]

[2209] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. means for a user to download and install an online payment application onto a mobile terminal; a means for users to input information about their interests and past experiences; means for transmitting the user's input information to a server; The server includes an algorithm for suggesting tourist spots and restaurants based on user input information; means for transmitting the proposal information to a user's mobile terminal; means for displaying suggested information on the mobile terminal; means for booking a special experience based on the suggested information and making an online payment; A system including:

2. 10. The system of claim 1, further comprising a notification means for prompting a user to download an online payment application at a specific point.

3. The system according to claim 1 , wherein the server further comprises means for checking whether the suggested tourist spots and restaurants accept online payments.

Images