System

Abstract

A system is provided.SOLUTION: The system includes a means for receiving the hobby / taste and position information of a user, a means for retrieving and proposing sightseeing spots and stores on the basis of the received hobby / taste and position information, and a means for providing detailed information of the proposed sightseeing spots and stores in the user's native language.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional guide systems for inbound tourists often only provide general information, making it difficult to provide personalized services that match each individual's hobbies and behavioral patterns. Furthermore, information about tourist spots, restaurants, and other information is not provided in tourists' native languages, making them difficult to use. Furthermore, it is often difficult to secure a communication environment locally, making the systems inconvenient. In addition, tourist spots and stores themselves lacked the means to reach tourists. [Means for solving the problem]

[0005] This invention provides a system that receives a user's hobbies, preferences, and location information, and searches for and suggests tourist spots and stores based on this information. Specifically, it creates a profile based on the user's hobbies and preferences, and tracks the user's current location in real time using GPS information. Upon arrival at a tourist spot or store, detailed information about the spot is displayed in the user's native language. Furthermore, by incorporating a means for measuring advertisement display and click counts and generating revenue, the system can also generate advertising revenue from tourist spots and stores. This provides a personalized and convenient tourist experience for users, while also providing an effective means for tourist spots and stores to attract customers.

[0006] "Users" refer to foreign tourists who use the application.

[0007] "Hobbies and preferences" refers to the things that a user likes and has interests in, and is an element that allows the information provided to be customized based on those interests.

[0008] "Location Information" means a user's current geographic location, as determined using GPS or other means.

[0009] "Tourist attractions" refer to tourist spots and famous places that users are encouraged to visit.

[0010] "Store" refers to a commercial facility that a user may visit, such as a restaurant or shopping facility.

[0011] "Search" refers to the process of identifying relevant tourist spots and stores from a database based on the user's interests and location information.

[0012] "Suggestion" refers to the act of providing users with information about tourist spots and stores identified through a search.

[0013] "Mother tongue" refers to the language that a user understands best, and providing information in this language increases user convenience.

[0014] "Detailed information" refers to specific information about tourist spots and stores, such as their history, highlights, and service content.

[0015] "Advertisement" refers to content that displays promotional information provided by tourist spots and stores to users.

[0016] "Clicks" refers to a number that measures the number of times a user clicks on an advertisement.

[0017] "Revenue" refers to the economic benefits generated based on the number of impressions and clicks on an advertisement.

[0018] "System" refers collectively to a set of functions and processes built to provide tourist information based on users' hobbies, preferences and location information and generate advertising revenue. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8]FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0020] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0021] First, the terms used in the following description will be explained.

[0022] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0023] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0024] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0025] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0026] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0027] [First embodiment]

[0028] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0029] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0030] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0031] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0032] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0033] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0034] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0035] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0036] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0037] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0038] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0039] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0040] This invention is a system that generates advertising revenue by suggesting tourist information based on the user's hobbies, preferences, and location information. The program processing of this system will be specifically explained below.

[0041] User registration and initial settings

[0042] User registration and initial setup:

[0043] First, the user downloads and installs the application. Then, they enter the required information, such as their name, email address, and password, on the account creation screen and press the register button. The device then sends this information to the server, which then stores the received user information in a database.

[0044] Profile Settings:

[0045] The user enters detailed information such as hobbies and interests, places to visit, places they want to visit in Japan, their purpose, and their native language. The device sends this information to the server, which then creates a user profile based on the received information and stores it in a database.

[0046] Spot suggestions upon arrival

[0047] Get GPS location:

[0048] When the user arrives at their travel destination and launches the app, the GPS function on the device is activated, and the current coordinates are acquired and sent to the server.

[0049] Search and suggest recommended places:

[0050] The server compares the received location information with the user profile and searches for tourist spots and store information around the current location based on the user's hobbies and preferences. The server generates a list of search results, adds detailed information in the user's native language, and sends it to the device. The device then displays the received information to the user.

[0051] As a concrete example, when a user arrives in Asakusa, Tokyo, the device sends GPS information to the server, which then uses that information to create a list of Sensoji Temple and recommended restaurants nearby, displaying it in the user's native language.

[0052] Detailed information provided upon arrival at the spot

[0053] Spot arrival detection:

[0054] When the user arrives at one of the suggested tourist spots, the device uses GPS to locate the user and notifies the server.

[0055] View more information:

[0056] The server searches for detailed information about tourist spots based on the location of the user's arrival and sends information about highlights, history, etc. to the user's device in their native language. The device then displays the received information to the user.

[0057] For example, when a user arrives at Sensoji Temple, the device notifies the user of the location, and the server displays the detailed history and highlights of the temple in the user's native language.

[0058] Dining and shopping support

[0059] Search for restaurants and shopping spots:

[0060] When a user wants to eat or shop, they use the search function within the app to search for nearby restaurants or shopping spots. The device sends the search criteria to the server, which then provides relevant store information in the user's native language based on the criteria.

[0061] Specifically, if a user wants to enjoy Japanese food around Asakusa, the app will display nearby Japanese restaurants and provide information on recommended sushi restaurants.

[0062] Menu ordering support:

[0063] When the user arrives at the restaurant of their choice, the device will confirm its location and activate the ordering support function. The server will provide the restaurant's menu information in the user's native language, which the device will then display to the user. It will also provide clear instructions on how to order.

[0064] Prepaid router set provided

[0065] Purchase and Setup:

[0066] Users purchase the app and prepaid router online before traveling and set it up after arriving in Japan, allowing them to use the app while always connected to the internet and obtain real-time tourist information.

[0067] Advertising revenue initiatives

[0068] Display ads:

[0069] The server selects advertisements related to the proposed tourist spots and store information and sends them to the terminal, which then displays the advertisements along with the tourist spot and store information to the user.

[0070] Ad click measurement and revenue generation:

[0071] When a user clicks on an advertisement, the device sends the click information to the server, which then counts the number of clicks and generates revenue. This revenue model makes the system sustainable.

[0072] As described above, this system provides users with a personalized tourism experience and realizes a sustainable business model through advertising revenue.

[0073] The processing flow will be explained below.

[0074] User registration and initial settings

[0075] Step 1:

[0076] User: Downloads and installs the application. After installation is complete, launches the app.

[0077] Step 2:

[0078] User: The account creation screen will appear. Enter your name, email address, and password, then click the Register button.

[0079] Step 3:

[0080] Terminal: Sends the entered information to the server.

[0081] Step 4:

[0082] Server: Stores the received user information in a database and sends a registration completion message to the terminal.

[0083] Step 5:

[0084] User: Enter detailed information such as hobbies and interests, places to visit, places you want to visit in Japan and your purpose, and your native language.

[0085] Step 6:

[0086] Terminal: Sends the entered details to the server.

[0087] Step 7:

[0088] Server: Creates a user profile based on the received details and stores it in a database.

[0089] Spot suggestions upon arrival

[0090] Step 8:

[0091] User: Arrives at travel destination and launches the app.

[0092] Step 9:

[0093] Device: Activate the GPS function and obtain the coordinates of your current location.

[0094] Step 10:

[0095] Device: Sends current location information to the server.

[0096] Step 11:

[0097] Server: Matches the received location information with the user profile.

[0098] Step 12:

[0099] Server: Searches for tourist spots and store information around the current location based on the user's hobbies and preferences.

[0100] Step 13:

[0101] Server: Generates a list of search results, adds detailed information in the user's native language, and sends it to the device.

[0102] Step 14:

[0103] Terminal: Displays the received information to the user.

[0104] Detailed information provided upon arrival at the spot

[0105] Step 15:

[0106] User: Travel to one of the suggested attractions.

[0107] Step 16:

[0108] Device: Monitors the user's location using GPS and detects when they arrive at a tourist spot.

[0109] Step 17:

[0110] Terminal: Notifies the server of the location of the spot where the user has arrived.

[0111] Step 18:

[0112] Server: Search for detailed information about tourist attractions based on arrival location.

[0113] Step 19:

[0114] Server: Sends detailed information about attractions, history, etc. to the device in the user's native language.

[0115] Step 20:

[0116] Terminal: Displays the received information to the user.

[0117] Dining and shopping support

[0118] Step 21:

[0119] User: If they want to eat or shop, they use the in-app search function to find restaurants and shopping spots near their current location.

[0120] Step 22:

[0121] Terminal: Sends search criteria to the server.

[0122] Step 23:

[0123] Server: Generates a list of nearby stores based on the search criteria, adds detailed information in the user's native language, and sends it to the device.

[0124] Step 24:

[0125] Terminal: Displays the received information to the user.

[0126] Step 25:

[0127] User: Arrive at the restaurant of their choice.

[0128] Step 26:

[0129] Terminal: Locate the store and launch ordering support features.

[0130] Step 27:

[0131] Server: Sends menu information for the restaurant in question to the device in the user's native language.

[0132] Step 28:

[0133] Terminal: Displays the received menu information to the user and guides them through ordering.

[0134] Prepaid router set provided

[0135] Step 29:

[0136] Users: Purchase the app and prepaid router online before traveling.

[0137] Step 30:

[0138] User: After arriving in Japan, set up a prepaid router and connect to the Internet.

[0139] Step 31:

[0140] User: Use the app while always connected to the Internet using a prepaid router.

[0141] Advertising revenue initiatives

[0142] Step 32:

[0143] Server: Selects advertisements related to the suggested tourist spots and store information and sends them to the device.

[0144] Step 33:

[0145] Device: Displays advertisements along with tourist attractions and store information.

[0146] Step 34:

[0147] User: Clicks on an ad that interests them.

[0148] Step 35:

[0149] Device: Sends ad click information to the server.

[0150] Step 36:

[0151] Server: Counts ad clicks and generates revenue.

[0152] By following the steps above, it is possible to implement a system that provides tourist information tailored to the user's preferences and realizes a sustainable business model through advertising revenue.

[0153] Example 1

[0154] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0155] Conventional tourist information systems lacked the ability to provide personalized information based on users' hobbies, preferences, and location information, making it difficult to maximize the travel experience. Furthermore, they lacked support for users to obtain detailed information on-site, which sometimes resulted in ineffective guidance. Furthermore, these systems lacked a mechanism for effectively generating advertising revenue, making sustainable operation difficult.

[0156] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0157] In this invention, the server includes: means for receiving user's hobbies, tastes, and location information; means for searching for and suggesting facilities and stores based on the received hobbies, tastes, and location information; means for providing detailed information on the suggested facilities and stores in the user's native language; means for displaying advertisements related to the detailed information; and means for measuring the number of advertisement views and clicks and generating revenue. This makes it possible to provide users with personalized tourist information and detailed local guidance, while also realizing sustainable operation of the system through advertising revenue.

[0158] "User" means an individual or organization that uses the system.

[0159] "Hobbies and tastes" refers to the user's personal interests and preferences, and is information related to travel destinations, purposes, etc.

[0160] "Location information" refers to the user's current geographic coordinate information obtained using the Global Positioning System or the like.

[0161] The Global Positioning System is a system that uses satellites such as GPS to determine locations on Earth.

[0162] "Facilities" refers to tourist destinations such as tourist attractions, historical buildings, and parks.

[0163] "Store" refers to commercial facilities such as restaurants and shopping malls.

[0164] A "search tool" is an algorithm or program that uses a database or API to find specific information.

[0165] "Suggestion means" refers to functions and algorithms for presenting search results to users.

[0166] "Detailed information" is additional information or explanation about a facility or store, including, for example, history, attractions, menus, etc.

[0167] "Providing means" refers to the algorithms and programs used to display information on the user's terminal.

[0168] "Advertisement" means information displayed to promote a product or service.

[0169] "Measurement means" refers to a program or system for recording the number of clicks and views of displayed advertisements.

[0170] A "revenue generation means" is a mechanism for generating advertising revenue based on measured data.

[0171] A "profile" is a data set that integrates a user's hobbies, preferences, location information, and personal information.

[0172] The "order support function" is a support function that helps users to smoothly place orders at restaurants.

[0173] This invention is a system that generates advertising revenue by suggesting tourist information based on the user's hobbies, preferences, and location information. The program processing of this system will be specifically explained below.

[0174] User registration and initial settings

[0175] User registration and initial settings

[0176] First, the user downloads and installs the application. Next, they open the account creation screen, enter their name, email address, and password, and press the Register button. The device sends this information to the server using an HTTP POST request. The server verifies the received information and, if there are no problems, stores it in a MySQL® database.

[0177] Profile Settings

[0178] Users enter detailed information such as their hobbies and interests, places they want to visit in Japan, their purpose, and their native language. The device sends this information in JSON format to the server, which then creates a profile based on the received information and stores it in a database.

[0179] Spot suggestions upon arrival

[0180] Acquiring GPS location information

[0181] When a user arrives at their travel destination and launches the app, the GPS function on the device automatically activates, obtaining the current latitude and longitude data and sending that information to the server.

[0182] Search and suggest recommended spots

[0183] The server compares the received GPS data with the user's profile information. It uses ElasticSearch (registered trademark) to quickly search the data. It creates a list of tourist attractions and shops near the current location, adding detailed information in the user's native language. It then sends this information to the user's device, which then displays it to the user.

[0184] As a concrete example, when a user arrives in Asakusa, Tokyo, the device sends GPS information to the server, which then uses that information to create a list of Sensoji Temple and recommended restaurants nearby, displaying it in the user's native language.

[0185] Detailed information provided upon arrival at the spot

[0186] Spot arrival detection

[0187] When the user arrives at the suggested spot, the device will again check its location using GPS and notify the server of this location information.

[0188] Viewing detailed information

[0189] The server searches for detailed information about tourist attractions at that location based on the received location information. The server obtains the detailed information using a specific API (for example, Wikipedia API). The server translates the obtained information into the user's native language and sends it to the device. The device then displays the information to the user.

[0190] For example, when a user arrives at Sensoji Temple, the device notifies the user of the location, and the server displays the detailed history and highlights of the temple in the user's native language.

[0191] Dining and shopping support

[0192] Search for restaurants and shopping spots

[0193] The user enters search criteria for desired dining or shopping within the app, and the device sends the entered criteria (type of cuisine, price range, distance, etc.) to the server.

[0194] Providing search results

[0195] The server searches for suitable restaurants and shopping spots based on the received conditions. The search uses a specific database or API (for example, Google (registered trademark) Places API). The search results are added with detailed information in the user's native language and sent to the device. The device then displays the received information to the user.

[0196] Menu ordering support

[0197] When the user arrives at the restaurant of their choice, the device locates them and activates the ordering support function. The server provides the restaurant's menu information in the user's native language, which the device displays. If necessary, the device also provides instructions on how to order (e.g., how to scan a QR code).

[0198] Prepaid router set provided

[0199] Purchase and Setup

[0200] Users purchase the app and prepaid router online before traveling. The purchase process is completed through a web portal. Upon arrival in Japan, users receive the prepaid router and follow a simple setup procedure. The app includes a setup guide, which makes setup easy.

[0201] Advertising revenue initiatives

[0202] Displaying ads

[0203] The server selects advertisements related to tourist spots and store information recommended to the user. Advertisements are selected using Google AdSense or the RTB (Real-Time Bidding) platform. Advertisement data is sent to the device, which then displays the advertisements along with tourist spot information.

[0204] Ad click measurement and revenue generation

[0205] When a user clicks on an ad, the device sends the click information to the server, which aggregates the click data and generates revenue, which is monitored in real time by a server-side analytics tool (e.g., Google Analytics).

[0206] Prompt Sentence Examples

[0207] Example prompts to be input to the generative AI model:

[0208] The user arrives at their travel destination and launches the app. GPS information is acquired and their current coordinates are sent to the server. Based on the user's profile information and current location, create a list of recommended tourist spots. The list should also include detailed information about each spot and be provided in the user's native language.

[0209] The above is an embodiment of the present invention. The system provides users with personalized tourist information and detailed local guidance, and is sustainable through advertising revenue.

[0210] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0211] Step 1: User registration and initial setup

[0212] Input: The user enters their name, email address, and password.

[0213] How it works: A user first downloads and installs the application, then enters their name, email address, and password on the account creation screen and clicks the Register button.

[0214] Data processing: The device sends this information to the server using an HTTP POST request, which validates the information and stores it in a MySQL database if there are no errors.

[0215] Output: The user's account information is saved on the server and registration is complete.

[0216] Step 2: Profile Settings

[0217] Input: The user enters detailed information such as hobbies and interests, places they would like to visit in Japan, their purpose, and their native language.

[0218] How it works: The user enters these details in the app and hits submit.

[0219] Data processing: The device sends this information in JSON format to the server, which then creates a profile based on the received information and stores it in a database.

[0220] Output: The user's profile information is saved on the server and the profile is complete.

[0221] Step 3: Get GPS location

[0222] Input: The user arrives at their travel destination and launches the app.

[0223] How it works: The GPS function on your device will automatically start up and obtain your current latitude and longitude data.

[0224] Data processing: The device sends its current location information to the server.

[0225] Output: The current location is sent to the server.

[0226] Step 4: Search and suggest recommended spots

[0227] Input: GPS data received by the server and user profile information.

[0228] How it works: The server collates this information and lists tourist attractions and stores near the current location.

[0229] Data processing: The server uses Elasticsearch to quickly search the data and generate a list with additional details in the user's native language.

[0230] Output: A list of tourist attractions and stores is sent to the user's device.

[0231] Step 5: View Spot Suggestions

[0232] Input: A list of attractions and stores sent by the server.

[0233] Action: The terminal displays the received information to the user.

[0234] Output: The user is shown a list of attractions and shops, and can check their details.

[0235] Step 6: Detect spot arrivals

[0236] Input: User arrives at a suggested spot.

[0237] What it does: The device uses GPS to reconfirm the user's location.

[0238] Data processing: The device notifies the server of the newly acquired location information.

[0239] Output: The user's location is sent to the server and their arrival is confirmed.

[0240] Step 7: Provide more information

[0241] Input: User arrival information received by the server.

[0242] How it works: The server retrieves detailed information about tourist attractions at that location and translates it into your native language.

[0243] Data processing: The server uses a specific API to get detailed information and perform translation.

[0244] Output: The translated details are sent to the user's device.

[0245] Step 8: Viewing detailed information

[0246] Input: The details sent by the server.

[0247] Action: The terminal displays the received details to the user.

[0248] Output: The user is presented with detailed information about the attraction.

[0249] Step 9: Find restaurants and shopping spots

[0250] Input: The user enters search criteria for dining or shopping.

[0251] How it works: A user enters search criteria within the app and presses the search button.

[0252] Data processing: The device sends the search criteria to the server, which uses a specific database or API to search for information based on the criteria and adds detailed information in the user's native language.

[0253] Output: Information about related restaurants and shopping spots is sent to the user's device.

[0254] Step 10: Displaying search results

[0255] Input: Information about restaurants and shopping spots sent from the server.

[0256] Action: The terminal displays the received information to the user.

[0257] Output: Information about restaurants and shopping spots is displayed to the user.

[0258] Step 11: Menu ordering support

[0259] Input: The location of the restaurant selected by the user.

[0260] How it works: When a user arrives at a restaurant, the device verifies the user's location and activates the ordering support function.

[0261] Data processing: The server provides the menu information for the relevant store in the user's native language, which is then displayed on the device.

[0262] Output: The user is presented with ordering support information and instructions on how to place an order.

[0263] Step 12: Ad selection and display

[0264] Input: Tourist attractions and store information suggested by the server.

[0265] Operation: The server selects advertisements relevant to the user and sends the data to the device.

[0266] Data processing: The server selects ads using Google AdSense or RTB platforms.

[0267] Output: The ad is displayed to the user along with the tourist attraction information.

[0268] Step 13: Measure ad clicks and generate revenue

[0269] Input: User clicks on an ad.

[0270] How it works: The device sends ad click information to the server.

[0271] Data processing: The server aggregates click data and generates revenue using analytics tools such as Google Analytics.

[0272] Output: Ad revenue based on click data is generated on the server.

[0273] (Application example 1)

[0274] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0275] Conventional tourist information systems have been limited in the provision of personalized information based on users' hobbies, preferences, and location information, and have not been able to fully meet user needs. Furthermore, the range of information provided on tourist spots and stores is narrow, making it difficult to provide detailed information in real time. Furthermore, advertising revenue models have not adequately implemented personalized advertising display and monetization based on user behavior. The purpose of this invention is to solve these problems and realize an effective advertising revenue model while providing users with more abundant and personalized tourist information.

[0276] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0277] In this invention, the server includes a means for receiving a user's hobbies, preferences, and location information, a means for searching for and suggesting tourist spots and stores based on the received hobbies, preferences, and location information, a means for providing detailed information on the suggested tourist spots and stores in the user's native language, and a means for displaying the user's movement and tourist information within the virtual space. This allows the user to receive personalized tourist information in real time. The server also includes a means for generating personalized advertisements based on the user's behavior and interests, improving the effectiveness of advertisements for users and enabling effective monetization.

[0278] "User" refers to an individual who uses the system.

[0279] "Hobbies and tastes" refers to information related to a user's interests and preferences.

[0280] "Location information" refers to geographic data such as the latitude and longitude of a user's current location.

[0281] "Virtual space" refers to a virtual space generated on a computer system.

[0282] "Tourist spots" refer to places and attractions that tourists visit.

[0283] "Store" refers to a place for offering goods or services.

[0284] "Real-time tracking" means knowing a user's location almost instantly and monitoring their movements at every moment.

[0285] "Network Equipment" refers to equipment for connecting to the Internet or other communications networks.

[0286] "Advertising" refers to a message promoting a product or service.

[0287] "Personalized advertising" refers to advertising that is individually optimized based on a user's hobbies, preferences, and behavioral history.

[0288] "Revenue" refers to the profits earned from advertising clicks or views.

[0289] "Detailed information" refers to detailed information about tourist attractions and stores.

[0290] This invention is a system that provides users with personalized tourist information in real time when they visit tourist spots and earns revenue through advertising. This system is characterized by suggesting tourist spots and stores based on the user's hobbies, preferences, and location information.

[0291] System Program

[0292] The server starts when the user downloads the application and registers their profile information. The user enters details such as their name, email address, hobbies and interests, places they would like to visit in Japan, their purpose, and their native language. This information is sent to the server and stored in a database.

[0293] When a user arrives at a location and launches the application, the device uses its GPS to obtain the current latitude and longitude coordinates and sends that location information to the server. The server then matches the received location information with the user's profile to search for nearby tourist attractions and stores. The server then generates a list of search results and provides detailed information in the user's native language. Additionally, advertisements related to the suggested tourist attractions and stores are also displayed.

[0294] Specific examples

[0295] For example, if a user arrives at Asakusa in Tokyo, their device sends GPS information to the server, which then uses that information to create a list of Sensoji Temple and recommended restaurants nearby. This information is provided in the user's native language, enhancing their understanding of the tourist destination and improving convenience. Furthermore, personalized ads are generated based on the user's behavior and interests, allowing them to see highly relevant ads.

[0296] Hardware and software used

[0297] Device: Smartphone or tablet with GPS functionality

[0298] Server: Database and API server

[0299] software:

[0300] Software for obtaining GPS information (e.g. geopy)

[0301] Libraries for network communication (e.g., requests)

[0302] Database management system (e.g. MySQL)

[0303] Machine learning models for generating personalized ads (e.g., generative AI models)

[0304] Example prompts for generative AI models

[0305] "Write a prompt for an application that provides recommended tourist spots and restaurants for history-loving tourists traveling in Tokyo, Japan. The application will combine detailed historical information about the area to be visited with store information provided in the user's native language, and will also include a revenue model based on ad clicks."

[0306] This system allows users to receive personalized tourist information in real time, deepening their understanding of tourist destinations and further enriching their trips. In addition, monetization through effective advertising makes the system sustainable to maintain and operate.

[0307] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0308] Step 1:

[0309] The user downloads and installs the application. Next, the user launches the application, enters the required information such as name, email address, and password on the account creation screen, and presses the register button. This information is sent from the device to the server, and the server stores the received user information in a database.

[0310] Step 2:

[0311] On the profile setting screen, users enter detailed information such as their hobbies and interests, places they would like to visit in Japan, their purpose, and their native language. This information is also sent from the device to the server, which then creates a user profile based on the received information and stores it in a database.

[0312] Step 3:

[0313] The user arrives at their travel destination and launches the application. The device activates its GPS function to obtain current location information (latitude and longitude). The obtained location information is sent from the device to the server. The server receives this location information and stores it in a database.

[0314] Step 4:

[0315] The server compares the received location information with the user profile and searches for tourist spots and stores near the current location based on the user's hobbies and preferences. This search result list is generated with detailed information added in the user's native language. The generated list is sent from the server to the device, which then displays the received information to the user.

[0316] Step 5:

[0317] If the user becomes interested in a suggested tourist spot or store and actually visits it, the device again uses its GPS function to confirm its location and notify the server. The server then searches for more detailed tourist spot and store information based on the user's location and sends it to the device in the user's native language. The device then displays the received information to the user.

[0318] Step 6:

[0319] When a user wants to eat, drink, or shop, they use the search function within the application to search for nearby restaurants and shopping spots. The device sends the search criteria to the server, which then searches for relevant store information based on the criteria. The results are provided in the user's native language and displayed on the device.

[0320] Step 7:

[0321] When the user arrives at the restaurant of their choice, the device checks their GPS location and notifies the server of their location. The server then provides the restaurant's menu information in the user's native language, which the device receives and displays to the user. The device also provides clear instructions on how to order.

[0322] Step 8:

[0323] When a user displays information about a particular tourist spot or store, the server selects relevant advertisements and sends them to the device. The device then displays the advertisements along with the tourist spot or store information to the user. When a user clicks on an advertisement, the device sends click information to the server, which then counts the number of clicks and generates revenue.

[0324] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0325] This invention is a system that generates advertising revenue by suggesting tourist information based on the user's hobbies, preferences, location information, and emotions. The program processing of this system will be specifically explained below.

[0326] User registration and initial settings

[0327] User registration and initial setup:

[0328] First, the user downloads and installs the application. Then, they enter the required information, such as their name, email address, and password, on the account creation screen and press the register button. The device then sends this information to the server, which then stores the received user information in a database.

[0329] Profile Settings:

[0330] The user enters detailed information such as hobbies and interests, places to visit, places they want to visit in Japan, their purpose, and their native language. The device sends this information to the server, which then creates a user profile based on the received information and stores it in a database.

[0331] Spot suggestions upon arrival

[0332] Get GPS location:

[0333] When the user arrives at their travel destination and launches the app, the GPS function on the device is activated, and the current coordinates are acquired and sent to the server.

[0334] Search and suggest recommended places:

[0335] The server compares the received location information with the user profile and searches for tourist attractions and store information based on the user's hobbies and preferences and real-time location information. The server generates a list of search results, adds detailed information in the user's native language, and sends it to the device. The device then displays the received information to the user.

[0336] As a concrete example, when a user arrives in Asakusa, Tokyo, the device sends GPS information to the server, which then uses that information to create a list of Sensoji Temple and recommended restaurants nearby, displaying it in the user's native language.

[0337] Detailed information provided upon arrival at the spot

[0338] Spot arrival detection:

[0339] The user travels to one of the suggested tourist spots. The device uses GPS to locate the user and notifies the server.

[0340] View more information:

[0341] The server searches for detailed information about tourist spots based on the location of the user's arrival and sends information about highlights, history, etc. to the user's device in their native language. The device then displays the received information to the user.

[0342] For example, when a user arrives at Sensoji Temple, the device notifies the user of the location, and the server displays the detailed history and highlights of the temple in the user's native language.

[0343] Dining and shopping support

[0344] Search for restaurants and shopping spots:

[0345] When a user wants to eat or shop, they use the search function within the app to search for nearby restaurants or shopping spots. The device sends the search criteria to the server, which then provides relevant store information in the user's native language based on the criteria.

[0346] Specifically, if a user wants to enjoy Japanese food around Asakusa, the app will display nearby Japanese restaurants and provide information on recommended sushi restaurants.

[0347] Menu ordering support:

[0348] When the user arrives at the restaurant of their choice, the device will confirm its location and activate the ordering support function. The server will provide the restaurant's menu information in the user's native language, which the device will then display to the user. It will also provide clear instructions on how to order.

[0349] Utilizing the Emotion Engine

[0350] Emotion Recognition:

[0351] The device inputs the user's facial expressions and voice into an emotion engine, which analyzes their emotions in real time. The server receives the analysis results and determines the user's current emotional state.

[0352] Suggestion adjustments:

[0353] The server then adjusts the recommendations for tourist spots and shops based on the user's emotions analyzed by the emotion engine. For example, if the user is tired, it will suggest places to relax and restaurants.

[0354] For example, if the emotion engine determines that a user is tired while touring a tourist spot, the server will list cafes and rest spots and provide information in the user's native language.

[0355] Ad customization:

[0356] The server customizes the advertisement display based on the user's emotional state: if the user is relaxed, it displays advertisements for travel services, and if the user is excited, it displays advertisements for activities.

[0357] Prepaid router set provided

[0358] Purchase and Setup:

[0359] Users purchase the app and prepaid router online before traveling and set it up after arriving in Japan, allowing them to use the app while always connected to the internet and obtain real-time tourist information.

[0360] Advertising revenue initiatives

[0361] Display ads:

[0362] The server selects advertisements related to the proposed tourist spots and store information and sends them to the terminal, which then displays the advertisements along with the tourist spot and store information to the user.

[0363] Ad click measurement and revenue generation:

[0364] When a user clicks on an advertisement, the device sends the click information to the server, which then counts the number of clicks and generates revenue. This revenue model makes the system sustainable.

[0365] As described above, this system provides tourist information tailored to the user's tastes and emotions, and can realize a sustainable business model through advertising revenue.

[0366] The processing flow will be explained below.

[0367] User registration and initial settings

[0368] Step 1:

[0369] User: Downloads and installs the application. After installation is complete, launches the app.

[0370] Step 2:

[0371] User: The account creation screen will appear. Enter your name, email address, and password, then click the Register button.

[0372] Step 3:

[0373] Terminal: Sends the entered information to the server.

[0374] Step 4:

[0375] Server: Stores the received user information in a database and sends a registration completion message to the terminal.

[0376] Step 5:

[0377] User: Enter detailed information such as hobbies and interests, places to visit, places you want to visit in Japan and your purpose, and your native language.

[0378] Step 6:

[0379] Terminal: Sends the entered details to the server.

[0380] Step 7:

[0381] Server: Creates a user profile based on the received details and stores it in a database.

[0382] Spot suggestions upon arrival

[0383] Step 8:

[0384] User: Arrives at travel destination and launches the app.

[0385] Step 9:

[0386] Device: Activate the GPS function and obtain the coordinates of your current location.

[0387] Step 10:

[0388] Device: Sends current location information to the server.

[0389] Step 11:

[0390] Server: Matches the received location information with the user profile.

[0391] Step 12:

[0392] Server: Searches for tourist spots and store information around the current location based on the user's hobbies and preferences. It also makes suggestions that take the user's emotions into account using an emotion engine.

[0393] Step 13:

[0394] Server: Generates a list of search results, adds detailed information in the user's native language, and sends it to the device.

[0395] Step 14:

[0396] Terminal: Displays the received information to the user.

[0397] Detailed information provided upon arrival at the spot

[0398] Step 15:

[0399] User: Travel to one of the suggested attractions.

[0400] Step 16:

[0401] Device: Monitors the user's location using GPS and detects when they arrive at a tourist spot.

[0402] Step 17:

[0403] Terminal: Notifies the server of the location of the spot where the user has arrived.

[0404] Step 18:

[0405] Server: Search for detailed information about tourist attractions based on arrival location.

[0406] Step 19:

[0407] Server: Sends detailed information about attractions, history, etc. to the device in the user's native language.

[0408] Step 20:

[0409] Terminal: Displays the received information to the user.

[0410] Dining and shopping support

[0411] Step 21:

[0412] User: If they want to eat or shop, they use the in-app search function to find restaurants and shopping spots near their current location.

[0413] Step 22:

[0414] Terminal: Sends search criteria to the server.

[0415] Step 23:

[0416] Server: Generates a list of nearby stores based on search criteria. It also uses an emotion engine to make suggestions that take user emotions into account.

[0417] Step 24:

[0418] Server: Adds detailed information in the user's native language and sends it to the device.

[0419] Step 25:

[0420] Terminal: Displays the received information to the user.

[0421] Step 26:

[0422] User: Arrive at the restaurant of their choice.

[0423] Step 27:

[0424] Terminal: Locate the store and launch ordering support features.

[0425] Step 28:

[0426] Server: Sends menu information for the restaurant in question to the device in the user's native language.

[0427] Step 29:

[0428] Terminal: Displays the received menu information to the user and guides them through ordering.

[0429] Utilizing the Emotion Engine

[0430] Step 30:

[0431] Device: The user's facial expressions and voice are input into an emotion engine, which analyzes emotions in real time.

[0432] Step 31:

[0433] Server: Receives the emotion data analyzed by the emotion engine and understands the user's current emotional state.

[0434] Step 32:

[0435] Server: Adjusts recommendations for tourist spots and shops based on emotion data. For example, if the user is tired, it suggests places to relax.

[0436] Step 33:

[0437] Server: Customize emotional advertising and select ads that match the user's interests and mood.

[0438] Prepaid router set provided

[0439] Step 34:

[0440] Users: Purchase the app and prepaid router online before traveling.

[0441] Step 35:

[0442] User: After arriving in Japan, set up a prepaid router and connect to the Internet.

[0443] Step 36:

[0444] User: Use the app while always connected to the Internet using a prepaid router.

[0445] Advertising revenue initiatives

[0446] Step 37:

[0447] Server: Selects advertisements related to the suggested tourist spots and store information and sends them to the device.

[0448] Step 38:

[0449] Device: Displays advertisements along with tourist attractions and store information.

[0450] Step 39:

[0451] User: Clicks on an ad that interests them.

[0452] Step 40:

[0453] Device: Sends ad click information to the server.

[0454] Step 41:

[0455] Server: Counts ad clicks and generates revenue.

[0456] By following the steps above, it is possible to implement a system that provides tourist information tailored to the user's tastes and emotions, and realizes a sustainable business model through advertising revenue.

[0457] Example 2

[0458] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0459] Conventional tourist information systems provide suggestions based on a user's hobbies, preferences, and location information, but do not take into account the user's emotional state. As a result, they are unable to recommend tourist spots or stores that best suit the user's situation and emotions, resulting in a decrease in user satisfaction. Furthermore, since advertising does not take into account the user's real-time emotions, it is difficult to display effective advertisements.

[0460] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0461] In this invention, the server includes means for receiving user's hobbies, preferences and location information, means for searching for and suggesting tourist spots and shops based on the received hobbies, preferences and location information, means for providing detailed information on the suggested tourist spots and shops in the user's native language, emotion analysis means using an engine for analyzing the user's emotions, and means for adjusting the suggested tourist spots and shops based on the emotions analyzed by the emotion analysis means, thereby making it possible to suggest optimal tourist spots and shops according to the user's emotional state.

[0462] "User" refers to an individual who uses the system to obtain tourist information.

[0463] "Hobbies and Preferences" is information about a user's preferred activities and areas of interest.

[0464] "Location information" refers to the user's current geographic coordinate information obtained using technology such as GPS.

[0465] "Search" is the operation of locating related tourist spots and stores from a database based on the user's hobbies, preferences and location information.

[0466] "Suggestion" is the act of informing the user of information about the tourist spots or stores that were searched for.

[0467] "Detailed information" refers to specific explanations and data about tourist spots and stores, and is supplementary information to help users understand the site.

[0468] A "native language" is a language that a user uses on a daily basis and that is easiest for the user to understand.

[0469] "Emotion analysis means" refers to technology that analyzes emotions in real time from a user's facial expressions, voice, etc.

[0470] The Global Positioning System is a system that uses artificial satellites to measure the position of any point on Earth with high precision.

[0471] "Real time" refers to a state in which information processing and communication are carried out the instant an event occurs, without any time lag.

[0472] An "advertisement" is a message that provides users with information about a specific product or service and encourages them to purchase it.

[0473] "Revenue" refers to the monetary profits earned from advertising displays, clicks, etc.

[0474] The "system" refers to the entire hardware and software required to realize the above-mentioned functions.

[0475] This invention is a system that generates advertising revenue by suggesting tourist information based on the user's hobbies, preferences, location information, and emotions. The system's main components are a server, terminals, and users, and information is exchanged between them.

[0476] User registration and initial settings

[0477] First, a user downloads and installs the application from the smartphone's app store. After installation, the user enters their name, email address, and password on the account creation screen and presses the register button. The device sends this information to the server, which then stores the received user information in a database.

[0478] Next, the user sets up a profile, entering detailed information such as hobbies, preferences, places to visit, places they want to visit in Japan, their purpose, and their native language. The device sends this information to the server, which then creates a user profile based on the received information and stores it in a database.

[0479] Spot suggestions upon arrival

[0480] When a user arrives at their travel destination and launches the app, the device's GPS function acquires their current coordinates and sends them to the server. The server compares the received location information with the user's profile and searches for tourist spots and store information based on the user's hobbies, preferences, and real-time location information. The server then adds detailed information in the user's native language and sends it to the device, where it is displayed to the user.

[0481] Detailed information provided upon arrival at the spot

[0482] When the user arrives at one of the suggested tourist spots, the device uses GPS to confirm the location and notifies the server. The server then searches for detailed information about the tourist spot based on the user's location and sends it to the device in the user's native language, including information about its highlights and history. The device then displays this information to the user.

[0483] Dining and shopping support

[0484] When a user wants to eat or shop, they use the app's search function to find nearby restaurants or shopping spots. The device sends the search criteria to the server, which then provides relevant store information in the user's native language based on the criteria.

[0485] Utilizing the Emotion Engine

[0486] The device inputs the user's facial expressions and voice into an emotion engine, which analyzes their emotions in real time. The server receives the analysis results and determines the user's current emotional state. The server then adjusts its recommendations for tourist spots and shops based on the emotion analysis results, providing the user with the most appropriate information. For example, if the user is tired, it can suggest places to relax or restaurants.

[0487] Advertising revenue initiatives

[0488] The server selects advertisements related to the recommendations and sends them to the device. The device displays them to the user. The server then measures the number of advertisements displayed and clicked, generating revenue. This revenue model makes the system sustainable.

[0489] Prepaid router set provided

[0490] Users can purchase the app and prepaid router online before traveling and set it up after arriving in Japan, allowing them to stay connected to the internet at all times, accessing real-time tourist information and getting detailed information about suggested locations.

[0491] Examples of concrete examples and prompts

[0492] For example, when a user arrives at Asakusa in Tokyo, the device sends GPS information to the server, which then lists Sensoji Temple and recommended restaurants nearby, displaying them in the user's native language.Also, when the user arrives at Sensoji Temple, the device notifies the user of its location, and the server displays the detailed history and highlights of Sensoji Temple in the user's native language.

[0493] Example prompt sentence:

[0494] How do I set up the initial user registration?

[0495] What are some recommended tourist spots in Asakusa?

[0496] I'd like to know more about the dining and shopping support features.

[0497] Show me tourist spot suggestions based on your current emotional state.

[0498] The above is a specific embodiment for carrying out the present invention.

[0499] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0500] Step 1: User registration and initial setup

[0501] 1. The user downloads and installs the application from the smartphone's app store.

[0502] Input: Internet connection, app store access

[0503] Output: Application installed

[0504] Specific operations: The user opens the Apple App Store or GOOGLE PLAY® Store, searches for the app, and presses the download button.

[0505] 2. The user enters their name, email address, and password on the account creation screen and presses the registration button.

[0506] Input: Name, Email Address, Password

[0507] Data processing: Converting the input information into a format for sending to the server

[0508] Output: Submit registration information

[0509] What happens: The user fills in the form with the required information and clicks the registration button.

[0510] 3. The terminal sends the user's input information to the server.

[0511] Input: Registration information

[0512] Data processing: Encryption of information and transmission to server

[0513] Output: Transfer of information to the server

[0514] What happens: The device performs an encryption process to securely transmit the entered information to the server.

[0515] 4. The server stores the received user information in a database.

[0516] Input: User information

[0517] Data processing: Converting data into a format for saving to a database

[0518] Output: Save successful message

[0519] What happens: The server opens a database connection, runs a query to save the user information, and returns a success message.

[0520] Step 2: Profile Settings

[0521] 1. The user enters detailed information such as hobbies and preferences, places to visit, places they would like to visit in Japan and their purpose, and their native language.

[0522] Input: Hobbies, preferences, places visited, native language, etc.

[0523] Data processing: Format conversion of input information

[0524] Output: Sending input information

[0525] Specific behavior: The user fills in a form with details such as hobbies, preferences, and destination.

[0526] 2. The terminal sends the entered information to the server.

[0527] Input: User details

[0528] Data processing: Encryption of information and transmission to server

[0529] Output: Transfer of information to the server

[0530] Specific operation: The device encrypts the entered information and sends it securely to the server.

[0531] 3. The server creates a user profile based on the received information and stores it in a database.

[0532] Input: User details

[0533] Data processing: Data structure conversion for profile creation

[0534] Output: Profile saved successfully message

[0535] What happens: The server opens a database connection and runs a query to create and save a user profile.

[0536] Step 3: Suggesting spots when you arrive

[0537] 1. The user arrives at their travel destination and launches the app.

[0538] Input: GPS location request

[0539] Output: App launched

[0540] Specific operation: After the user arrives at their travel destination, they tap the app to launch it.

[0541] 2. The device will activate its built-in GPS function and obtain its current coordinates.

[0542] Input: Current location request

[0543] Data Calculation: Acquisition and analysis of GPS data

[0544] Output: current position

[0545] Specific operations: The device turns on the GPS function and obtains the coordinate data of the current location.

[0546] 3. The device sends the acquired location information to the server.

[0547] Input: Obtained location information

[0548] Data processing: Encryption and transmission of location information

[0549] Output: Location information sent to the server

[0550] Specific operation: The device encrypts the location information and sends it to the server.

[0551] 4. The server compares the received location information with the user profile and searches for tourist spots and store information based on the user's hobbies and preferences.

[0552] Input: Current location, user profile

[0553] Data operations: performing database queries and retrieving results

[0554] Output: Search results

[0555] Specific operation: The server searches the database based on the user's location information and profile to extract the most suitable tourist spots and stores.

[0556] 5. The server generates a list of search results, adds detailed information in the user's native language, and sends it to the terminal.

[0557] Input: Search results

[0558] Data processing: translation into native language and list generation

[0559] Output: List sent to terminal

[0560] Specific operation: The server converts the search results into the user's native language, generates a suggestion list, and sends it to the device.

[0561] 6. The terminal displays the received information to the user.

[0562] Input: Suggestion list

[0563] Output: The displayed information

[0564] Specific operation: The device displays the received list on the app's user interface. For example, if the user arrives in Asakusa, Tokyo, the device will display a list of Sensoji Temple and recommended restaurants.

[0565] Step 4: Provide details when you arrive at the spot

[0566] 1. The user travels to one of the suggested tourist spots.

[0567] Input: Start moving

[0568] Output: Arrival at destination

[0569] Specific behavior: Move to the tourist spot selected by the user.

[0570] 2. The device uses GPS to confirm its location and notify the server.

[0571] Input: Current location request

[0572] Data calculation: Acquisition and transmission of GPS data

[0573] Output: Location notification to the server

[0574] Specific operation: The device checks the user's current location and sends the location data to the server.

[0575] 3. The server searches for detailed information about tourist spots based on the arrival location and sends information about highlights, history, and other information to the terminal in the user's native language.

[0576] Input: Destination location information

[0577] Data operations: performing database queries and translating information

[0578] Output: Send detailed information

[0579] Specific operation: The server searches for detailed information about the spot you have arrived at, translates it into your native language, and sends it to your device.

[0580] 4. The terminal displays the received information to the user.

[0581] Input: More information

[0582] Output: The displayed information

[0583] Specific operation: The device displays the received details on the app's user interface. For example, when the user arrives at Sensoji Temple, the device displays the history and attractions of the temple.

[0584] Step 5: Food and shopping assistance

[0585] 1. Users use the app's search function to find nearby restaurants and shopping spots.

[0586] Input: Enter search criteria

[0587] Output: Search request

[0588] What happens: A user enters a search term into the in-app search bar.

[0589] 2. The terminal sends the search criteria to the server.

[0590] Input: Search criteria

[0591] Data calculation: Encryption and transmission of search conditions

[0592] Output: Search request sent to the server

[0593] Specific operation: The device encrypts the entered search criteria before sending them to the server.

[0594] 3. The server provides relevant store information in the user's native language based on the search criteria.

[0595] Input: Search criteria

[0596] Data operations: performing database queries, translating into native language

[0597] Output: Send search results

[0598] Specific operation: The server searches the database, translates store information that matches the search criteria into the user's native language, and sends it to the terminal.

[0599] 4. The terminal displays the received information to the user.

[0600] Input: Search results

[0601] Output: The displayed information

[0602] Specific operation: The device displays the received information, for example, information about nearby Japanese restaurants or sushi restaurants.

[0603] 5. When the user arrives at the restaurant of their choice, the device will confirm the location and activate the ordering support function.

[0604] Input: Start moving

[0605] Output: Order Support Start

[0606] Specific operation: The user arrives at the store and the device confirms their location.

[0607] 6. The server provides menu information for the restaurant in the user's native language, and the terminal displays it to the user.

[0608] Input: Current location

[0609] Data Calculation: Retrieving and translating menu information

[0610] Output: Sending menu information

[0611] Specific operation: The server translates the listed menu information into the user's native language and sends it to the terminal.

[0612] Step 6: Leverage your emotional engine

[0613] 1. The device inputs the user's facial expressions and voice into an emotion engine and analyzes emotions in real time.

[0614] Input: facial expression data, voice data

[0615] Data Computing: Sentiment Analysis

[0616] Output: Emotion analysis results

[0617] How it works: The device uses a camera and microphone to capture the user's facial expressions and voice, and inputs them into a generative AI model.

[0618] 2. The server receives the analysis results and determines the user's current emotional state.

[0619] Input: Sentiment analysis results

[0620] Data Computing: Emotional State Recognition

[0621] Output: Emotional state data

[0622] Specific operation: The server analyzes the data received from the emotion engine and understands the user's emotional state.

[0623] 3. The server adjusts the suggestions for tourist spots and stores based on the results of the sentiment analysis, providing the user with the most appropriate information.

[0624] Input: Emotional state data

[0625] Data calculations: adjusting proposals

[0626] Output: A refined list of suggestions

[0627] Specific operation: The server optimizes tourist spot and store information according to the user's emotional state and sends it to the device. For example, if the user is tired, it suggests places to relax and restaurants.

[0628] Step 7: Ad revenue initiatives

[0629] 1. The server selects advertisements related to the proposal and sends them to the terminal.

[0630] Input: Suggestion list

[0631] Data calculation: Ad selection

[0632] Output: Sending advertising data

[0633] Specific operation: The server selects advertisements related to the suggested tourist spots and stores and sends them to the terminal.

[0634] 2. The device displays the advertisement to the user.

[0635] Input: Ad data

[0636] Output: Served ad

[0637] Specific operation: The device receives the advertising data and displays it within the app.

[0638] 3. When a user clicks on an ad, the device sends the click information to the server.

[0639] Input: Click event

[0640] Output: Send click information

[0641] What happens: When a user clicks on an ad, that information is sent to a server.

[0642] 4. The server counts clicks and generates revenue.

[0643] Input: Click information

[0644] Data Computing: Click Counting and Revenue Generation

[0645] Output: Revenue data

[0646] How it works: The server counts the number of clicks and calculates revenue based on that. This revenue model makes the system sustainable.

[0647] The above are the specific processing steps of this system. At each step, the necessary data processing and calculations are performed based on the input information, and the optimal output is obtained, providing the user with convenient and effective tourist information.

[0648] (Application example 2)

[0649] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0650] Conventional tourist information suggestion systems suggest tourist spots and shops based on the user's hobbies, preferences, and location information. However, they lacked a mechanism to consider the user's emotional state, and suggested spots suited to the user's physical condition and emotions were not suggested, which did not improve satisfaction. In addition, advertisements for suggested tourist spots and shops were not adjusted based on the user's emotions, reducing the effectiveness of the advertisements.

[0651] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving the user's hobbies, preferences, and location information, means for searching for and suggesting tourist spots and stores based on the received hobbies, preferences, and location information, means for providing detailed information on the suggested tourist spots and stores in the user's native language, means for analyzing the user's emotions, and means for adjusting the suggested tourist spots and stores based on the emotions. This makes it possible to suggest tourist spots and stores that suit the user's emotions.

[0652] "User" refers to an individual who uses the system.

[0653] "Hobbies and Preferences" refers to the activities and preferences that interest a user.

[0654] "Location information" refers to geographic data that indicates a user's current location.

[0655] "Tourist destination" refers to a place that tourists visit.

[0656] "Store" refers to a facility that sells goods or provides services.

[0657] "Detailed information" refers to specific information about tourist attractions and stores.

[0658] "Native language" refers to the language with which the user is most familiar.

[0659] "Emotion" refers to a temporary psychological state of a user.

[0660] "Analysis" refers to the detailed analysis of data.

[0661] "Suggestion" refers to recommending a particular action or choice to the user.

[0662] "Advertising" refers to information that promotes a product or service.

[0663] "Customization" refers to adjusting something to meet specific conditions.

[0664] "GPS" refers to Global Positioning System.

[0665] "Real-time" refers to information being processed immediately, without delay.

[0666] "Revenue" refers to profits earned from advertising clicks and impressions.

[0667] A "server" refers to a computer system that stores and processes data on a network.

[0668] This invention is a system that generates advertising revenue by individually suggesting tourist spots and stores based on the user's hobbies, preferences, location information, and emotions. We will explain the program and processing required to realize this system.

[0669] User registration and initial settings

[0670] The user downloads and installs the application on their device. They enter the required information, such as their name, email address, and password, on the account creation screen and press the register button. The device sends this information to the server, which then stores the received user information in a database.

[0671] Profile Settings

[0672] The user enters detailed information such as hobbies, preferences, places to visit, places they want to visit, their purpose, and their native language. The device sends this information to the server, which then creates a user profile based on the received information and stores it in a database.

[0673] Spot suggestions upon arrival

[0674] The user arrives at their travel destination and launches the app. The GPS function on the device is activated, obtaining their current coordinates and sending them to the server. The server compares the received location information with the user profile and searches for tourist spots and store information based on the user's hobbies, preferences, and real-time location information. The server generates a list of search results, adds detailed information in the user's native language, and sends it to the device. The device then displays the received information to the user. As a concrete example, if the user arrives in Asakusa, Tokyo, the device sends GPS information to the server, and the server uses that information to create a list of tourist spots and restaurants around Asakusa, displaying it in the user's native language.

[0675] Detailed information provided upon arrival at the spot

[0676] The user travels to one of the suggested tourist spots. The device uses GPS to confirm the location and notifies the server. The server searches for detailed information about the tourist spot based on the arrival location and sends information about its highlights and history to the device in the user's native language. The device then displays the received information to the user. For example, when the user arrives at Sensoji Temple, the device notifies the user of the location, and the server displays detailed information about the temple's history and highlights in the user's native language.

[0677] Dining and shopping support

[0678] When a user wants to eat or shop, they use the search function within the app to find nearby restaurants and shopping spots. The device sends the search criteria to the server, which then provides relevant store information in the user's native language based on the criteria. For example, if a user wants to enjoy Japanese food around Asakusa, the app will display nearby Japanese restaurants and provide information on recommended sushi restaurants.

[0679] Utilizing the Emotion Engine

[0680] The device inputs the user's facial expressions and voice into an emotion engine, which analyzes their emotions in real time. The server receives the analysis results and understands the user's current emotional state. The server then adjusts the recommendations of tourist spots and stores based on the user's emotions analyzed by the emotion engine. For example, if the user is tired, it will suggest places to relax and restaurants. If the emotion engine determines that the user is tired while touring tourist spots, the server will create a list of cafes and rest spots and provide guidance in the user's native language.

[0681] Ad customization

[0682] The server customizes the advertisement display based on the user's emotional state. If the user is relaxed, it displays advertisements for travel services, and if the user is excited, it displays advertisements for activities. Specifically, it uses the following prompt sentence:

[0683] Example prompt sentence:

[0684] "If the emotion engine detects that the user has arrived at Sensoji Temple and is very excited, the server will display an advertisement for a sightseeing boat as a nearby activity."

[0685] Hardware and software used

[0686] Hardware: Smartphone (ANDROID (registered trademark) and iOS)

[0687] software:

[0688] GPS tracking: geopy

[0689] Sentiment analysis: Google Cloud Natural Language API

[0690] Backend server: Python Flask

[0691] Database: Firebase Firestore

[0692] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0693] Step 1: Register and set up your profile

[0694] Input: The user enters information required by the app (such as name, email address, password, hobbies and preferences, native language, etc.).

[0695] Operation: The terminal sends the user's input information to the server.

[0696] Data calculation: The server stores the received information in a database (Firebase Firestore) and creates a user profile.

[0697] Output: A user account is created and the profile information is saved in the database.

[0698] Step 2: Obtaining location information

[0699] Input: A user arrives at a specific location and launches the app.

[0700] How it works: The device uses its GPS (geopy) to get its current coordinates and sends them to the server.

[0701] Data calculation: The server processes the received location information in real time.

[0702] Output: The user's current location data is saved on the server.

[0703] Step 3: Proposing tourist spots and stores

[0704] Input: User location, hobbies and preferences profile data.

[0705] How it works: The server matches the location information with the profile data to search for information on tourist attractions and stores.

[0706] Data calculation: The server lists the search results and translates the details into the user's native language.

[0707] Output: The list of tourist attractions and shops and their details are sent to the terminal and displayed to the user.

[0708] Step 4: Provide details when you arrive at the spot

[0709] Input: The user arrives at the suggested location (detected by the device's GPS).

[0710] Operation: The terminal sends arrival information to the server.

[0711] Data calculation: The server searches and translates detailed information (sights, history, etc.) based on the destination.

[0712] Output: Detailed information is sent to the terminal and displayed to the user.

[0713] Step 5: Food and shopping assistance

[0714] Input: A user wants to eat or shop and enters search criteria into the app.

[0715] Operation: The device sends search criteria to the server.

[0716] Data calculation: The server searches for store information based on the conditions and provides it in the user's native language.

[0717] Output: The store information is sent to the terminal and displayed to the user.

[0718] Step 6: Leverage your emotional engine

[0719] Input: User's facial and voice data.

[0720] How it works: The device inputs data into an emotion engine (Google Cloud Natural Language API) and analyzes emotions.

[0721] Data calculation: The server receives the analysis results (emotional state) and stores them in a database.

[0722] Output: The sentiment analysis results are saved on the server.

[0723] Step 7: Adjust your suggestions based on emotion

[0724] Input: Sentiment analysis results, a list of suggested tourist spots and stores.

[0725] How it works: The server adjusts the suggestion list based on the results of sentiment analysis. For example, if the user is tired, it will prioritize suggestions for places to relax.

[0726] Data operations: Arrangement of proposal lists.

[0727] Output: The adjusted suggestion list is sent to the device and displayed to the user.

[0728] Step 8: Customize your ads

[0729] Input: Sentiment analysis results, a list of suggested tourist spots and stores.

[0730] How it works: The server customizes relevant ads based on emotions.

[0731] Data processing: Selection and customization of advertising content.

[0732] Output: The customized advertisement is sent to the device and displayed to the user.

[0733] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0734] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0735] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0736] [Second embodiment]

[0737] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0738] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0739] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0740] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0741] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0742] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0743] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0744] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0745] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0746] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0747] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0748] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0749] This invention is a system that generates advertising revenue by suggesting tourist information based on the user's hobbies, preferences, and location information. The program processing of this system will be specifically explained below.

[0750] User registration and initial settings

[0751] User registration and initial setup:

[0752] First, the user downloads and installs the application. Then, they enter the required information, such as their name, email address, and password, on the account creation screen and press the register button. The device then sends this information to the server, which then stores the received user information in a database.

[0753] Profile Settings:

[0754] The user enters detailed information such as hobbies and interests, places to visit, places they want to visit in Japan, their purpose, and their native language. The device sends this information to the server, which then creates a user profile based on the received information and stores it in a database.

[0755] Spot suggestions upon arrival

[0756] Get GPS location:

[0757] When the user arrives at their travel destination and launches the app, the GPS function on the device is activated, and the current coordinates are acquired and sent to the server.

[0758] Search and suggest recommended places:

[0759] The server compares the received location information with the user profile and searches for tourist spots and store information around the current location based on the user's hobbies and preferences. The server generates a list of search results, adds detailed information in the user's native language, and sends it to the device. The device then displays the received information to the user.

[0760] As a concrete example, when a user arrives in Asakusa, Tokyo, the device sends GPS information to the server, which then uses that information to create a list of Sensoji Temple and recommended restaurants nearby, displaying it in the user's native language.

[0761] Detailed information provided upon arrival at the spot

[0762] Spot arrival detection:

[0763] When the user arrives at one of the suggested tourist spots, the device uses GPS to locate the user and notifies the server.

[0764] View more information:

[0765] The server searches for detailed information about tourist spots based on the location of the user's arrival and sends information about highlights, history, etc. to the user's device in their native language. The device then displays the received information to the user.

[0766] For example, when a user arrives at Sensoji Temple, the device notifies the user of the location, and the server displays the detailed history and highlights of the temple in the user's native language.

[0767] Dining and shopping support

[0768] Search for restaurants and shopping spots:

[0769] When a user wants to eat or shop, they use the search function within the app to search for nearby restaurants or shopping spots. The device sends the search criteria to the server, which then provides relevant store information in the user's native language based on the criteria.

[0770] Specifically, if a user wants to enjoy Japanese food around Asakusa, the app will display nearby Japanese restaurants and provide information on recommended sushi restaurants.

[0771] Menu ordering support:

[0772] When the user arrives at the restaurant of their choice, the device will confirm its location and activate the ordering support function. The server will provide the restaurant's menu information in the user's native language, which the device will then display to the user. It will also provide clear instructions on how to order.

[0773] Prepaid router set provided

[0774] Purchase and Setup:

[0775] Users purchase the app and prepaid router online before traveling and set it up after arriving in Japan, allowing them to use the app while always connected to the internet and obtain real-time tourist information.

[0776] Advertising revenue initiatives

[0777] Display ads:

[0778] The server selects advertisements related to the proposed tourist spots and store information and sends them to the terminal, which then displays the advertisements along with the tourist spot and store information to the user.

[0779] Ad click measurement and revenue generation:

[0780] When a user clicks on an advertisement, the device sends the click information to the server, which then counts the number of clicks and generates revenue. This revenue model makes the system sustainable.

[0781] As described above, this system provides users with a personalized tourism experience and realizes a sustainable business model through advertising revenue.

[0782] The processing flow will be explained below.

[0783] User registration and initial settings

[0784] Step 1:

[0785] User: Downloads and installs the application. After installation is complete, launches the app.

[0786] Step 2:

[0787] User: The account creation screen will appear. Enter your name, email address, and password, then click the Register button.

[0788] Step 3:

[0789] Terminal: Sends the entered information to the server.

[0790] Step 4:

[0791] Server: Stores the received user information in a database and sends a registration completion message to the terminal.

[0792] Step 5:

[0793] User: Enter detailed information such as hobbies and interests, places to visit, places you want to visit in Japan and your purpose, and your native language.

[0794] Step 6:

[0795] Terminal: Sends the entered details to the server.

[0796] Step 7:

[0797] Server: Creates a user profile based on the received details and stores it in a database.

[0798] Spot suggestions upon arrival

[0799] Step 8:

[0800] User: Arrives at travel destination and launches the app.

[0801] Step 9:

[0802] Device: Activate the GPS function and obtain the coordinates of your current location.

[0803] Step 10:

[0804] Device: Sends current location information to the server.

[0805] Step 11:

[0806] Server: Matches the received location information with the user profile.

[0807] Step 12:

[0808] Server: Searches for tourist spots and store information around the current location based on the user's hobbies and preferences.

[0809] Step 13:

[0810] Server: Generates a list of search results, adds detailed information in the user's native language, and sends it to the device.

[0811] Step 14:

[0812] Terminal: Displays the received information to the user.

[0813] Detailed information provided upon arrival at the spot

[0814] Step 15:

[0815] User: Travel to one of the suggested attractions.

[0816] Step 16:

[0817] Device: Monitors the user's location using GPS and detects when they arrive at a tourist spot.

[0818] Step 17:

[0819] Terminal: Notifies the server of the location of the spot where the user has arrived.

[0820] Step 18:

[0821] Server: Search for detailed information about tourist attractions based on arrival location.

[0822] Step 19:

[0823] Server: Sends detailed information about attractions, history, etc. to the device in the user's native language.

[0824] Step 20:

[0825] Terminal: Displays the received information to the user.

[0826] Dining and shopping support

[0827] Step 21:

[0828] User: If they want to eat or shop, they use the in-app search function to find restaurants and shopping spots near their current location.

[0829] Step 22:

[0830] Terminal: Sends search criteria to the server.

[0831] Step 23:

[0832] Server: Generates a list of nearby stores based on the search criteria, adds detailed information in the user's native language, and sends it to the device.

[0833] Step 24:

[0834] Terminal: Displays the received information to the user.

[0835] Step 25:

[0836] User: Arrive at the restaurant of their choice.

[0837] Step 26:

[0838] Terminal: Locate the store and launch ordering support features.

[0839] Step 27:

[0840] Server: Sends menu information for the restaurant in question to the device in the user's native language.

[0841] Step 28:

[0842] Terminal: Displays the received menu information to the user and guides them through ordering.

[0843] Prepaid router set provided

[0844] Step 29:

[0845] Users: Purchase the app and prepaid router online before traveling.

[0846] Step 30:

[0847] User: After arriving in Japan, set up a prepaid router and connect to the Internet.

[0848] Step 31:

[0849] User: Use the app while always connected to the Internet using a prepaid router.

[0850] Advertising revenue initiatives

[0851] Step 32:

[0852] Server: Selects advertisements related to the suggested tourist spots and store information and sends them to the device.

[0853] Step 33:

[0854] Device: Displays advertisements along with tourist attractions and store information.

[0855] Step 34:

[0856] User: Clicks on an ad that interests them.

[0857] Step 35:

[0858] Device: Sends ad click information to the server.

[0859] Step 36:

[0860] Server: Counts ad clicks and generates revenue.

[0861] By following the steps above, it is possible to implement a system that provides tourist information tailored to the user's preferences and realizes a sustainable business model through advertising revenue.

[0862] Example 1

[0863] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0864] Conventional tourist information systems lacked the ability to provide personalized information based on users' hobbies, preferences, and location information, making it difficult to maximize the travel experience. Furthermore, they lacked support for users to obtain detailed information on-site, which sometimes resulted in ineffective guidance. Furthermore, these systems lacked a mechanism for effectively generating advertising revenue, making sustainable operation difficult.

[0865] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0866] In this invention, the server includes: means for receiving user's hobbies, tastes, and location information; means for searching for and suggesting facilities and stores based on the received hobbies, tastes, and location information; means for providing detailed information on the suggested facilities and stores in the user's native language; means for displaying advertisements related to the detailed information; and means for measuring the number of advertisement views and clicks and generating revenue. This makes it possible to provide users with personalized tourist information and detailed local guidance, while also realizing sustainable operation of the system through advertising revenue.

[0867] "User" means an individual or organization that uses the system.

[0868] "Hobbies and tastes" refers to the user's personal interests and preferences, and is information related to travel destinations, purposes, etc.

[0869] "Location information" refers to the user's current geographic coordinate information obtained using the Global Positioning System or the like.

[0870] The Global Positioning System is a system that uses satellites such as GPS to determine locations on Earth.

[0871] "Facilities" refers to tourist destinations such as tourist attractions, historical buildings, and parks.

[0872] "Store" refers to commercial facilities such as restaurants and shopping malls.

[0873] A "search tool" is an algorithm or program that uses a database or API to find specific information.

[0874] "Suggestion means" refers to functions and algorithms for presenting search results to users.

[0875] "Detailed information" is additional information or explanation about a facility or store, including, for example, history, attractions, menus, etc.

[0876] "Providing means" refers to the algorithms and programs used to display information on the user's terminal.

[0877] "Advertisement" means information displayed to promote a product or service.

[0878] "Measurement means" refers to a program or system for recording the number of clicks and views of displayed advertisements.

[0879] A "revenue generation means" is a mechanism for generating advertising revenue based on measured data.

[0880] A "profile" is a data set that integrates a user's hobbies, preferences, location information, and personal information.

[0881] The "order support function" is a support function that helps users to smoothly place orders at restaurants.

[0882] This invention is a system that generates advertising revenue by suggesting tourist information based on the user's hobbies, preferences, and location information. The program processing of this system will be specifically explained below.

[0883] User registration and initial settings

[0884] User registration and initial settings

[0885] A user first downloads and installs the application. Next, they open the account creation screen, enter their name, email address, and password, and press the Register button. The device then sends this information to the server using an HTTP POST request. The server verifies the received information and, if there are no errors, stores it in a MySQL database.

[0886] Profile Settings

[0887] Users enter detailed information such as their hobbies and interests, places they want to visit in Japan, their purpose, and their native language. The device sends this information in JSON format to the server, which then creates a profile based on the received information and stores it in a database.

[0888] Spot suggestions upon arrival

[0889] Acquiring GPS location information

[0890] When a user arrives at their travel destination and launches the app, the GPS function on the device automatically activates, obtaining the current latitude and longitude data and sending that information to the server.

[0891] Search and suggest recommended spots

[0892] The server compares the received GPS data with the user's profile information. It uses Elasticsearch to quickly search the data. It generates a list of tourist attractions and shops near the current location, adding detailed information in the user's native language. It then sends this information to the user's device, which then displays it.

[0893] As a concrete example, when a user arrives in Asakusa, Tokyo, the device sends GPS information to the server, which then uses that information to create a list of Sensoji Temple and recommended restaurants nearby, displaying it in the user's native language.

[0894] Detailed information provided upon arrival at the spot

[0895] Spot arrival detection

[0896] When the user arrives at the suggested spot, the device will again check its location using GPS and notify the server of this location information.

[0897] Viewing detailed information

[0898] The server searches for detailed information about tourist attractions at that location based on the received location information. The server obtains the detailed information using a specific API (for example, Wikipedia API). The server translates the obtained information into the user's native language and sends it to the device. The device then displays the information to the user.

[0899] For example, when a user arrives at Sensoji Temple, the device notifies the user of the location, and the server displays the detailed history and highlights of the temple in the user's native language.

[0900] Dining and shopping support

[0901] Search for restaurants and shopping spots

[0902] The user enters search criteria for desired dining or shopping within the app, and the device sends the entered criteria (type of cuisine, price range, distance, etc.) to the server.

[0903] Providing search results

[0904] The server searches for suitable restaurants and shopping spots based on the received criteria. The search uses a specific database or API (for example, Google Places API). The search results are added with detailed information in the user's native language and sent to the device. The device then displays the received information to the user.

[0905] Menu ordering support

[0906] When the user arrives at the restaurant of their choice, the device locates them and activates the ordering support function. The server provides the restaurant's menu information in the user's native language, which the device displays. If necessary, the device also provides instructions on how to order in a specific way (e.g., by scanning a QR code).

[0907] Prepaid router set provided

[0908] Purchase and Setup

[0909] Users purchase the app and prepaid router online before traveling. The purchase process is completed through a web portal. Upon arrival in Japan, users receive the prepaid router and follow a simple setup procedure. The app includes a setup guide, which makes setup easy.

[0910] Advertising revenue initiatives

[0911] Displaying ads

[0912] The server selects advertisements related to tourist spots and store information recommended to the user. Advertisements are selected using Google AdSense or the RTB (Real-Time Bidding) platform. Advertisement data is sent to the device, which then displays the advertisements along with tourist spot information.

[0913] Ad click measurement and revenue generation

[0914] When a user clicks on an ad, the device sends the click information to the server, which aggregates the click data and generates revenue, which is monitored in real time by a server-side analytics tool (e.g., Google Analytics).

[0915] Prompt Sentence Examples

[0916] Example prompts to be input to the generative AI model:

[0917] The user arrives at their travel destination and launches the app. GPS information is acquired and their current coordinates are sent to the server. Based on the user's profile information and current location, create a list of recommended tourist spots. The list should also include detailed information about each spot and be provided in the user's native language.

[0918] The above is an embodiment of the present invention. The system provides users with personalized tourist information and detailed local guidance, and is sustainable through advertising revenue.

[0919] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0920] Step 1: User registration and initial setup

[0921] Input: The user enters their name, email address, and password.

[0922] How it works: A user first downloads and installs the application, then enters their name, email address, and password on the account creation screen and clicks the Register button.

[0923] Data processing: The device sends this information to the server using an HTTP POST request, which validates the information and stores it in a MySQL database if there are no errors.

[0924] Output: The user's account information is saved on the server and registration is complete.

[0925] Step 2: Profile Settings

[0926] Input: The user enters detailed information such as hobbies and interests, places they would like to visit in Japan, their purpose, and their native language.

[0927] How it works: The user enters these details in the app and hits submit.

[0928] Data processing: The device sends this information in JSON format to the server, which then creates a profile based on the received information and stores it in a database.

[0929] Output: The user's profile information is saved on the server and the profile is complete.

[0930] Step 3: Get GPS location

[0931] Input: The user arrives at their travel destination and launches the app.

[0932] How it works: The GPS function on your device will automatically start up and obtain your current latitude and longitude data.

[0933] Data processing: The device sends its current location information to the server.

[0934] Output: The current location is sent to the server.

[0935] Step 4: Search and suggest recommended spots

[0936] Input: GPS data received by the server and user profile information.

[0937] How it works: The server collates this information and lists tourist attractions and stores near the current location.

[0938] Data processing: The server uses Elasticsearch to quickly search the data and generate a list with additional details in the user's native language.

[0939] Output: A list of tourist attractions and stores is sent to the user's device.

[0940] Step 5: View Spot Suggestions

[0941] Input: A list of attractions and stores sent by the server.

[0942] Action: The terminal displays the received information to the user.

[0943] Output: The user is shown a list of attractions and shops, and can check their details.

[0944] Step 6: Detect spot arrivals

[0945] Input: User arrives at a suggested spot.

[0946] What it does: The device uses GPS to reconfirm the user's location.

[0947] Data processing: The device notifies the server of the newly acquired location information.

[0948] Output: The user's location is sent to the server and their arrival is confirmed.

[0949] Step 7: Provide more information

[0950] Input: User arrival information received by the server.

[0951] How it works: The server retrieves detailed information about tourist attractions at that location and translates it into your native language.

[0952] Data processing: The server uses a specific API to get detailed information and perform translation.

[0953] Output: The translated details are sent to the user's device.

[0954] Step 8: Viewing detailed information

[0955] Input: The details sent by the server.

[0956] Action: The terminal displays the received details to the user.

[0957] Output: The user is presented with detailed information about the attraction.

[0958] Step 9: Find restaurants and shopping spots

[0959] Input: The user enters search criteria for dining or shopping.

[0960] How it works: A user enters search criteria within the app and presses the search button.

[0961] Data processing: The device sends the search criteria to the server, which uses a specific database or API to search for information based on the criteria and adds detailed information in the user's native language.

[0962] Output: Information about related restaurants and shopping spots is sent to the user's device.

[0963] Step 10: Displaying search results

[0964] Input: Information about restaurants and shopping spots sent from the server.

[0965] Action: The terminal displays the received information to the user.

[0966] Output: Information about restaurants and shopping spots is displayed to the user.

[0967] Step 11: Menu ordering support

[0968] Input: The location of the restaurant selected by the user.

[0969] How it works: When a user arrives at a restaurant, the device verifies the user's location and activates the ordering support function.

[0970] Data processing: The server provides the menu information for the relevant store in the user's native language, which is then displayed on the device.

[0971] Output: The user is presented with ordering support information and instructions on how to place an order.

[0972] Step 12: Ad selection and display

[0973] Input: Tourist attractions and store information suggested by the server.

[0974] Operation: The server selects advertisements relevant to the user and sends the data to the device.

[0975] Data processing: The server selects ads using Google AdSense or RTB platforms.

[0976] Output: The ad is displayed to the user along with the tourist attraction information.

[0977] Step 13: Measure ad clicks and generate revenue

[0978] Input: User clicks on an ad.

[0979] How it works: The device sends ad click information to the server.

[0980] Data processing: The server aggregates click data and generates revenue using analytics tools such as Google Analytics.

[0981] Output: Ad revenue based on click data is generated on the server.

[0982] (Application example 1)

[0983] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0984] Conventional tourist information systems have been limited in the provision of personalized information based on users' hobbies, preferences, and location information, and have not been able to fully meet user needs. Furthermore, the range of information provided on tourist spots and stores is narrow, making it difficult to provide detailed information in real time. Furthermore, advertising revenue models have not adequately implemented personalized advertising display and monetization based on user behavior. The purpose of this invention is to solve these problems and realize an effective advertising revenue model while providing users with more abundant and personalized tourist information.

[0985] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0986] In this invention, the server includes a means for receiving a user's hobbies, preferences, and location information, a means for searching for and suggesting tourist spots and stores based on the received hobbies, preferences, and location information, a means for providing detailed information on the suggested tourist spots and stores in the user's native language, and a means for displaying the user's movement and tourist information within the virtual space. This allows the user to receive personalized tourist information in real time. The server also includes a means for generating personalized advertisements based on the user's behavior and interests, improving the effectiveness of advertisements for users and enabling effective monetization.

[0987] "User" refers to an individual who uses the system.

[0988] "Hobbies and tastes" refers to information related to a user's interests and preferences.

[0989] "Location information" refers to geographic data such as the latitude and longitude of a user's current location.

[0990] "Virtual space" refers to a virtual space generated on a computer system.

[0991] "Tourist spots" refer to places and attractions that tourists visit.

[0992] "Store" refers to a place for offering goods or services.

[0993] "Real-time tracking" means knowing a user's location almost instantly and monitoring their movements at every moment.

[0994] "Network Equipment" refers to equipment for connecting to the Internet or other communications networks.

[0995] "Advertising" refers to a message promoting a product or service.

[0996] "Personalized advertising" refers to advertising that is individually optimized based on a user's hobbies, preferences, and behavioral history.

[0997] "Revenue" refers to the profits earned from advertising clicks or views.

[0998] "Detailed information" refers to detailed information about tourist attractions and stores.

[0999] This invention is a system that provides users with personalized tourist information in real time when they visit tourist spots and earns revenue through advertising. This system is characterized by suggesting tourist spots and stores based on the user's hobbies, preferences, and location information.

[1000] System Program

[1001] The server starts when the user downloads the application and registers their profile information. The user enters details such as their name, email address, hobbies and interests, places they would like to visit in Japan, their purpose, and their native language. This information is sent to the server and stored in a database.

[1002] When a user arrives at a location and launches the application, the device uses its GPS to obtain the current latitude and longitude coordinates and sends that location information to the server. The server then matches the received location information with the user's profile to search for nearby tourist attractions and stores. The server then generates a list of search results and provides detailed information in the user's native language. Additionally, advertisements related to the suggested tourist attractions and stores are also displayed.

[1003] Specific examples

[1004] For example, if a user arrives at Asakusa in Tokyo, their device sends GPS information to the server, which then uses that information to create a list of Sensoji Temple and recommended restaurants nearby. This information is provided in the user's native language, enhancing their understanding of the tourist destination and improving convenience. Furthermore, personalized ads are generated based on the user's behavior and interests, allowing them to see highly relevant ads.

[1005] Hardware and software used

[1006] Device: Smartphone or tablet with GPS functionality

[1007] Server: Database and API server

[1008] software:

[1009] Software for obtaining GPS information (e.g. geopy)

[1010] Libraries for network communication (e.g., requests)

[1011] Database management system (e.g. MySQL)

[1012] Machine learning models for generating personalized ads (e.g., generative AI models)

[1013] Example prompts for generative AI models

[1014] "Write a prompt for an application that provides recommended tourist spots and restaurants for history-loving tourists traveling in Tokyo, Japan. The application will combine detailed historical information about the area to be visited with store information provided in the user's native language, and will also include a revenue model based on ad clicks."

[1015] This system allows users to receive personalized tourist information in real time, deepening their understanding of tourist destinations and further enriching their trips. In addition, monetization through effective advertising makes the system sustainable to maintain and operate.

[1016] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1017] Step 1:

[1018] The user downloads and installs the application. Next, the user launches the application, enters the required information such as name, email address, and password on the account creation screen, and presses the register button. This information is sent from the device to the server, and the server stores the received user information in a database.

[1019] Step 2:

[1020] On the profile setting screen, users enter detailed information such as their hobbies and interests, places they would like to visit in Japan, their purpose, and their native language. This information is also sent from the device to the server, which then creates a user profile based on the received information and stores it in a database.

[1021] Step 3:

[1022] The user arrives at their travel destination and launches the application. The device activates its GPS function to obtain current location information (latitude and longitude). The obtained location information is sent from the device to the server. The server receives this location information and stores it in a database.

[1023] Step 4:

[1024] The server compares the received location information with the user profile and searches for tourist spots and stores near the current location based on the user's hobbies and preferences. This search result list is generated with detailed information added in the user's native language. The generated list is sent from the server to the device, which then displays the received information to the user.

[1025] Step 5:

[1026] If the user becomes interested in a suggested tourist spot or store and actually visits it, the device again uses its GPS function to confirm its location and notify the server. The server then searches for more detailed tourist spot and store information based on the user's location and sends it to the device in the user's native language. The device then displays the received information to the user.

[1027] Step 6:

[1028] When a user wants to eat, drink, or shop, they use the search function within the application to search for nearby restaurants and shopping spots. The device sends the search criteria to the server, which then searches for relevant store information based on the criteria. The results are provided in the user's native language and displayed on the device.

[1029] Step 7:

[1030] When the user arrives at the restaurant of their choice, the device checks their GPS location and notifies the server of their location. The server then provides the restaurant's menu information in the user's native language, which the device receives and displays to the user. The device also provides clear instructions on how to order.

[1031] Step 8:

[1032] When a user displays information about a particular tourist spot or store, the server selects relevant advertisements and sends them to the device. The device then displays the advertisements along with the tourist spot or store information to the user. When a user clicks on an advertisement, the device sends click information to the server, which then counts the number of clicks and generates revenue.

[1033] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1034] This invention is a system that generates advertising revenue by suggesting tourist information based on the user's hobbies, preferences, location information, and emotions. The program processing of this system will be specifically explained below.

[1035] User registration and initial settings

[1036] User registration and initial setup:

[1037] First, the user downloads and installs the application. Then, they enter the required information, such as their name, email address, and password, on the account creation screen and press the register button. The device then sends this information to the server, which then stores the received user information in a database.

[1038] Profile Settings:

[1039] The user enters detailed information such as hobbies and interests, places to visit, places they want to visit in Japan, their purpose, and their native language. The device sends this information to the server, which then creates a user profile based on the received information and stores it in a database.

[1040] Spot suggestions upon arrival

[1041] Get GPS location:

[1042] When the user arrives at their travel destination and launches the app, the GPS function on the device is activated, and the current coordinates are acquired and sent to the server.

[1043] Search and suggest recommended places:

[1044] The server compares the received location information with the user profile and searches for tourist attractions and store information based on the user's hobbies and preferences and real-time location information. The server generates a list of search results, adds detailed information in the user's native language, and sends it to the device. The device then displays the received information to the user.

[1045] As a concrete example, when a user arrives in Asakusa, Tokyo, the device sends GPS information to the server, which then uses that information to create a list of Sensoji Temple and recommended restaurants nearby, displaying it in the user's native language.

[1046] Detailed information provided upon arrival at the spot

[1047] Spot arrival detection:

[1048] The user travels to one of the suggested tourist spots. The device uses GPS to locate the user and notifies the server.

[1049] View more information:

[1050] The server searches for detailed information about tourist spots based on the location of the user's arrival and sends information about highlights, history, etc. to the user's device in their native language. The device then displays the received information to the user.

[1051] For example, when a user arrives at Sensoji Temple, the device notifies the user of the location, and the server displays the detailed history and highlights of the temple in the user's native language.

[1052] Dining and shopping support

[1053] Search for restaurants and shopping spots:

[1054] When a user wants to eat or shop, they use the search function within the app to search for nearby restaurants or shopping spots. The device sends the search criteria to the server, which then provides relevant store information in the user's native language based on the criteria.

[1055] Specifically, if a user wants to enjoy Japanese food around Asakusa, the app will display nearby Japanese restaurants and provide information on recommended sushi restaurants.

[1056] Menu ordering support:

[1057] When the user arrives at the restaurant of their choice, the device will confirm its location and activate the ordering support function. The server will provide the restaurant's menu information in the user's native language, which the device will then display to the user. It will also provide clear instructions on how to order.

[1058] Utilizing the Emotion Engine

[1059] Emotion Recognition:

[1060] The device inputs the user's facial expressions and voice into an emotion engine, which analyzes their emotions in real time. The server receives the analysis results and determines the user's current emotional state.

[1061] Suggestion adjustments:

[1062] The server then adjusts the recommendations for tourist spots and shops based on the user's emotions analyzed by the emotion engine. For example, if the user is tired, it will suggest places to relax and restaurants.

[1063] For example, if the emotion engine determines that a user is tired while touring a tourist spot, the server will list cafes and rest spots and provide information in the user's native language.

[1064] Ad customization:

[1065] The server customizes the advertisement display based on the user's emotional state: if the user is relaxed, it displays advertisements for travel services, and if the user is excited, it displays advertisements for activities.

[1066] Prepaid router set provided

[1067] Purchase and Setup:

[1068] Users purchase the app and prepaid router online before traveling and set it up after arriving in Japan, allowing them to use the app while always connected to the internet and obtain real-time tourist information.

[1069] Advertising revenue initiatives

[1070] Display ads:

[1071] The server selects advertisements related to the proposed tourist spots and store information and sends them to the terminal, which then displays the advertisements along with the tourist spot and store information to the user.

[1072] Ad click measurement and revenue generation:

[1073] When a user clicks on an advertisement, the device sends the click information to the server, which then counts the number of clicks and generates revenue. This revenue model makes the system sustainable.

[1074] As described above, this system provides tourist information tailored to the user's tastes and emotions, and can realize a sustainable business model through advertising revenue.

[1075] The processing flow will be explained below.

[1076] User registration and initial settings

[1077] Step 1:

[1078] User: Downloads and installs the application. After installation is complete, launches the app.

[1079] Step 2:

[1080] User: The account creation screen will appear. Enter your name, email address, and password, then click the Register button.

[1081] Step 3:

[1082] Terminal: Sends the entered information to the server.

[1083] Step 4:

[1084] Server: Stores the received user information in a database and sends a registration completion message to the terminal.

[1085] Step 5:

[1086] User: Enter detailed information such as hobbies and interests, places to visit, places you want to visit in Japan and your purpose, and your native language.

[1087] Step 6:

[1088] Terminal: Sends the entered details to the server.

[1089] Step 7:

[1090] Server: Creates a user profile based on the received details and stores it in a database.

[1091] Spot suggestions upon arrival

[1092] Step 8:

[1093] User: Arrives at travel destination and launches the app.

[1094] Step 9:

[1095] Device: Activate the GPS function and obtain the coordinates of your current location.

[1096] Step 10:

[1097] Device: Sends current location information to the server.

[1098] Step 11:

[1099] Server: Matches the received location information with the user profile.

[1100] Step 12:

[1101] Server: Searches for tourist spots and store information around the current location based on the user's hobbies and preferences. It also makes suggestions that take the user's emotions into account using an emotion engine.

[1102] Step 13:

[1103] Server: Generates a list of search results, adds detailed information in the user's native language, and sends it to the device.

[1104] Step 14:

[1105] Terminal: Displays the received information to the user.

[1106] Detailed information provided upon arrival at the spot

[1107] Step 15:

[1108] User: Travel to one of the suggested attractions.

[1109] Step 16:

[1110] Device: Monitors the user's location using GPS and detects when they arrive at a tourist spot.

[1111] Step 17:

[1112] Terminal: Notifies the server of the location of the spot where the user has arrived.

[1113] Step 18:

[1114] Server: Search for detailed information about tourist attractions based on arrival location.

[1115] Step 19:

[1116] Server: Sends detailed information about attractions, history, etc. to the device in the user's native language.

[1117] Step 20:

[1118] Terminal: Displays the received information to the user.

[1119] Dining and shopping support

[1120] Step 21:

[1121] User: If they want to eat or shop, they use the in-app search function to find restaurants and shopping spots near their current location.

[1122] Step 22:

[1123] Terminal: Sends search criteria to the server.

[1124] Step 23:

[1125] Server: Generates a list of nearby stores based on search criteria. It also uses an emotion engine to make suggestions that take user emotions into account.

[1126] Step 24:

[1127] Server: Adds detailed information in the user's native language and sends it to the device.

[1128] Step 25:

[1129] Terminal: Displays the received information to the user.

[1130] Step 26:

[1131] User: Arrive at the restaurant of their choice.

[1132] Step 27:

[1133] Terminal: Locate the store and launch ordering support features.

[1134] Step 28:

[1135] Server: Sends menu information for the restaurant in question to the device in the user's native language.

[1136] Step 29:

[1137] Terminal: Displays the received menu information to the user and guides them through ordering.

[1138] Utilizing the Emotion Engine

[1139] Step 30:

[1140] Device: The user's facial expressions and voice are input into an emotion engine, which analyzes emotions in real time.

[1141] Step 31:

[1142] Server: Receives the emotion data analyzed by the emotion engine and understands the user's current emotional state.

[1143] Step 32:

[1144] Server: Adjusts recommendations for tourist spots and shops based on emotion data. For example, if the user is tired, it suggests places to relax.

[1145] Step 33:

[1146] Server: Customize emotional advertising and select ads that match the user's interests and mood.

[1147] Prepaid router set provided

[1148] Step 34:

[1149] Users: Purchase the app and prepaid router online before traveling.

[1150] Step 35:

[1151] User: After arriving in Japan, set up a prepaid router and connect to the Internet.

[1152] Step 36:

[1153] User: Use the app while always connected to the Internet using a prepaid router.

[1154] Advertising revenue initiatives

[1155] Step 37:

[1156] Server: Selects advertisements related to the suggested tourist spots and store information and sends them to the device.

[1157] Step 38:

[1158] Device: Displays advertisements along with tourist attractions and store information.

[1159] Step 39:

[1160] User: Clicks on an ad that interests them.

[1161] Step 40:

[1162] Device: Sends ad click information to the server.

[1163] Step 41:

[1164] Server: Counts ad clicks and generates revenue.

[1165] By following the steps above, it is possible to implement a system that provides tourist information tailored to the user's tastes and emotions, and realizes a sustainable business model through advertising revenue.

[1166] Example 2

[1167] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1168] Conventional tourist information systems provide suggestions based on a user's hobbies, preferences, and location information, but do not take into account the user's emotional state. As a result, they are unable to recommend tourist spots or stores that best suit the user's situation and emotions, resulting in a decrease in user satisfaction. Furthermore, since advertising does not take into account the user's real-time emotions, it is difficult to display effective advertisements.

[1169] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1170] In this invention, the server includes means for receiving user's hobbies, preferences and location information, means for searching for and suggesting tourist spots and shops based on the received hobbies, preferences and location information, means for providing detailed information on the suggested tourist spots and shops in the user's native language, emotion analysis means using an engine for analyzing the user's emotions, and means for adjusting the suggested tourist spots and shops based on the emotions analyzed by the emotion analysis means, thereby making it possible to suggest optimal tourist spots and shops according to the user's emotional state.

[1171] "User" refers to an individual who uses the system to obtain tourist information.

[1172] "Hobbies and Preferences" is information about a user's preferred activities and areas of interest.

[1173] "Location information" refers to the user's current geographic coordinate information obtained using technology such as GPS.

[1174] "Search" is the operation of locating related tourist spots and stores from a database based on the user's hobbies, preferences and location information.

[1175] "Suggestion" is the act of informing the user of information about the tourist spots or stores that were searched for.

[1176] "Detailed information" refers to specific explanations and data about tourist spots and stores, and is supplementary information to help users understand the site.

[1177] A "native language" is a language that a user uses on a daily basis and that is easiest for the user to understand.

[1178] "Emotion analysis means" refers to technology that analyzes emotions in real time from a user's facial expressions, voice, etc.

[1179] The Global Positioning System is a system that uses artificial satellites to measure the position of any point on Earth with high precision.

[1180] "Real time" refers to a state in which information processing and communication are carried out the instant an event occurs, without any time lag.

[1181] An "advertisement" is a message that provides users with information about a specific product or service and encourages them to purchase it.

[1182] "Revenue" refers to the monetary profits earned from advertising displays, clicks, etc.

[1183] The "system" refers to the entire hardware and software required to realize the above-mentioned functions.

[1184] This invention is a system that generates advertising revenue by suggesting tourist information based on the user's hobbies, preferences, location information, and emotions. The system's main components are a server, terminals, and users, and information is exchanged between them.

[1185] User registration and initial settings

[1186] First, a user downloads and installs the application from the smartphone's app store. After installation, the user enters their name, email address, and password on the account creation screen and presses the register button. The device sends this information to the server, which then stores the received user information in a database.

[1187] Next, the user sets up a profile, entering detailed information such as hobbies, preferences, places to visit, places they want to visit in Japan, their purpose, and their native language. The device sends this information to the server, which then creates a user profile based on the received information and stores it in a database.

[1188] Spot suggestions upon arrival

[1189] When a user arrives at their travel destination and launches the app, the device's GPS function acquires their current coordinates and sends them to the server. The server compares the received location information with the user's profile and searches for tourist spots and store information based on the user's hobbies, preferences, and real-time location information. The server then adds detailed information in the user's native language and sends it to the device, where it is displayed to the user.

[1190] Detailed information provided upon arrival at the spot

[1191] When the user arrives at one of the suggested tourist spots, the device uses GPS to confirm the location and notifies the server. The server then searches for detailed information about the tourist spot based on the user's location and sends it to the device in the user's native language, including information about its highlights and history. The device then displays this information to the user.

[1192] Dining and shopping support

[1193] When a user wants to eat or shop, they use the app's search function to find nearby restaurants or shopping spots. The device sends the search criteria to the server, which then provides relevant store information in the user's native language based on the criteria.

[1194] Utilizing the Emotion Engine

[1195] The device inputs the user's facial expressions and voice into an emotion engine, which analyzes their emotions in real time. The server receives the analysis results and determines the user's current emotional state. The server then adjusts its recommendations for tourist spots and shops based on the emotion analysis results, providing the user with the most appropriate information. For example, if the user is tired, it can suggest places to relax or restaurants.

[1196] Advertising revenue initiatives

[1197] The server selects advertisements related to the recommendations and sends them to the device. The device displays them to the user. The server then measures the number of advertisements displayed and clicked, generating revenue. This revenue model makes the system sustainable.

[1198] Prepaid router set provided

[1199] Users can purchase the app and prepaid router online before traveling and set it up after arriving in Japan, allowing them to stay connected to the internet at all times, accessing real-time tourist information and getting detailed information about suggested locations.

[1200] Examples of concrete examples and prompts

[1201] For example, when a user arrives at Asakusa in Tokyo, the device sends GPS information to the server, which then lists Sensoji Temple and recommended restaurants nearby, displaying them in the user's native language.Also, when the user arrives at Sensoji Temple, the device notifies the user of its location, and the server displays the detailed history and highlights of Sensoji Temple in the user's native language.

[1202] Example prompt sentence:

[1203] How do I set up the initial user registration?

[1204] What are some recommended tourist spots in Asakusa?

[1205] I'd like to know more about the dining and shopping support features.

[1206] Show me tourist spot suggestions based on your current emotional state.

[1207] The above is a specific embodiment for carrying out the present invention.

[1208] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1209] Step 1: User registration and initial setup

[1210] 1. The user downloads and installs the application from the smartphone's app store.

[1211] Input: Internet connection, app store access

[1212] Output: Application installed

[1213] What happens: A user opens the Apple App Store or Google Play Store, searches for an app, and presses the download button.

[1214] 2. The user enters their name, email address, and password on the account creation screen and presses the registration button.

[1215] Input: Name, Email Address, Password

[1216] Data processing: Converting the input information into a format for sending to the server

[1217] Output: Submit registration information

[1218] What happens: The user fills in the form with the required information and clicks the registration button.

[1219] 3. The terminal sends the user's input information to the server.

[1220] Input: Registration information

[1221] Data processing: Encryption of information and transmission to server

[1222] Output: Transfer of information to the server

[1223] What happens: The device performs an encryption process to securely transmit the entered information to the server.

[1224] 4. The server stores the received user information in a database.

[1225] Input: User information

[1226] Data processing: Converting data into a format for saving to a database

[1227] Output: Save successful message

[1228] What happens: The server opens a database connection, runs a query to save the user information, and returns a success message.

[1229] Step 2: Profile Settings

[1230] 1. The user enters detailed information such as hobbies and preferences, places to visit, places they would like to visit in Japan and their purpose, and their native language.

[1231] Input: Hobbies, preferences, places visited, native language, etc.

[1232] Data processing: Format conversion of input information

[1233] Output: Sending input information

[1234] Specific behavior: The user fills in a form with details such as hobbies, preferences, and destination.

[1235] 2. The terminal sends the entered information to the server.

[1236] Input: User details

[1237] Data processing: Encryption of information and transmission to server

[1238] Output: Transfer of information to the server

[1239] Specific operation: The device encrypts the entered information and sends it securely to the server.

[1240] 3. The server creates a user profile based on the received information and stores it in a database.

[1241] Input: User details

[1242] Data processing: Data structure conversion for profile creation

[1243] Output: Profile saved successfully message

[1244] What happens: The server opens a database connection and runs a query to create and save a user profile.

[1245] Step 3: Suggesting spots when you arrive

[1246] 1. The user arrives at their travel destination and launches the app.

[1247] Input: GPS location request

[1248] Output: App launched

[1249] Specific operation: After the user arrives at their travel destination, they tap the app to launch it.

[1250] 2. The device will activate its built-in GPS function and obtain its current coordinates.

[1251] Input: Current location request

[1252] Data Calculation: Acquisition and analysis of GPS data

[1253] Output: current position

[1254] Specific operations: The device turns on the GPS function and obtains the coordinate data of the current location.

[1255] 3. The device sends the acquired location information to the server.

[1256] Input: Obtained location information

[1257] Data processing: Encryption and transmission of location information

[1258] Output: Location information sent to the server

[1259] Specific operation: The device encrypts the location information and sends it to the server.

[1260] 4. The server compares the received location information with the user profile and searches for tourist spots and store information based on the user's hobbies and preferences.

[1261] Input: Current location, user profile

[1262] Data operations: performing database queries and retrieving results

[1263] Output: Search results

[1264] Specific operation: The server searches the database based on the user's location information and profile to extract the most suitable tourist spots and stores.

[1265] 5. The server generates a list of search results, adds detailed information in the user's native language, and sends it to the terminal.

[1266] Input: Search results

[1267] Data processing: translation into native language and list generation

[1268] Output: List sent to terminal

[1269] Specific operation: The server converts the search results into the user's native language, generates a suggestion list, and sends it to the device.

[1270] 6. The terminal displays the received information to the user.

[1271] Input: Suggestion list

[1272] Output: The displayed information

[1273] Specific operation: The device displays the received list on the app's user interface. For example, if the user arrives in Asakusa, Tokyo, the device will display a list of Sensoji Temple and recommended restaurants.

[1274] Step 4: Provide details when you arrive at the spot

[1275] 1. The user travels to one of the suggested tourist spots.

[1276] Input: Start moving

[1277] Output: Arrival at destination

[1278] Specific behavior: Move to the tourist spot selected by the user.

[1279] 2. The device uses GPS to confirm its location and notify the server.

[1280] Input: Current location request

[1281] Data calculation: Acquisition and transmission of GPS data

[1282] Output: Location notification to the server

[1283] Specific operation: The device checks the user's current location and sends the location data to the server.

[1284] 3. The server searches for detailed information about tourist spots based on the arrival location and sends information about highlights, history, and other information to the terminal in the user's native language.

[1285] Input: Destination location information

[1286] Data operations: performing database queries and translating information

[1287] Output: Send detailed information

[1288] Specific operation: The server searches for detailed information about the spot you have arrived at, translates it into your native language, and sends it to your device.

[1289] 4. The terminal displays the received information to the user.

[1290] Input: More information

[1291] Output: The displayed information

[1292] Specific operation: The device displays the received details on the app's user interface. For example, when the user arrives at Sensoji Temple, the device displays the history and attractions of the temple.

[1293] Step 5: Food and shopping assistance

[1294] 1. Users use the app's search function to find nearby restaurants and shopping spots.

[1295] Input: Enter search criteria

[1296] Output: Search request

[1297] What happens: A user enters a search term into the in-app search bar.

[1298] 2. The terminal sends the search criteria to the server.

[1299] Input: Search criteria

[1300] Data calculation: Encryption and transmission of search conditions

[1301] Output: Search request sent to the server

[1302] Specific operation: The device encrypts the entered search criteria before sending them to the server.

[1303] 3. The server provides relevant store information in the user's native language based on the search criteria.

[1304] Input: Search criteria

[1305] Data operations: performing database queries, translating into native language

[1306] Output: Send search results

[1307] Specific operation: The server searches the database, translates store information that matches the search criteria into the user's native language, and sends it to the terminal.

[1308] 4. The terminal displays the received information to the user.

[1309] Input: Search results

[1310] Output: The displayed information

[1311] Specific operation: The device displays the received information, for example, information about nearby Japanese restaurants or sushi restaurants.

[1312] 5. When the user arrives at the restaurant of their choice, the device will confirm the location and activate the ordering support function.

[1313] Input: Start moving

[1314] Output: Order Support Start

[1315] Specific operation: The user arrives at the store and the device confirms their location.

[1316] 6. The server provides menu information for the restaurant in the user's native language, and the terminal displays it to the user.

[1317] Input: Current location

[1318] Data Calculation: Retrieving and translating menu information

[1319] Output: Sending menu information

[1320] Specific operation: The server translates the listed menu information into the user's native language and sends it to the terminal.

[1321] Step 6: Leverage your emotional engine

[1322] 1. The device inputs the user's facial expressions and voice into an emotion engine and analyzes emotions in real time.

[1323] Input: facial expression data, voice data

[1324] Data Computing: Sentiment Analysis

[1325] Output: Emotion analysis results

[1326] How it works: The device uses a camera and microphone to capture the user's facial expressions and voice, and inputs them into a generative AI model.

[1327] 2. The server receives the analysis results and determines the user's current emotional state.

[1328] Input: Sentiment analysis results

[1329] Data Computing: Emotional State Recognition

[1330] Output: Emotional state data

[1331] Specific operation: The server analyzes the data received from the emotion engine and understands the user's emotional state.

[1332] 3. The server adjusts the suggestions for tourist spots and stores based on the results of the sentiment analysis, providing the user with the most appropriate information.

[1333] Input: Emotional state data

[1334] Data calculations: adjusting proposals

[1335] Output: A refined list of suggestions

[1336] Specific operation: The server optimizes tourist spot and store information according to the user's emotional state and sends it to the device. For example, if the user is tired, it suggests places to relax and restaurants.

[1337] Step 7: Ad revenue initiatives

[1338] 1. The server selects advertisements related to the proposal and sends them to the terminal.

[1339] Input: Suggestion list

[1340] Data calculation: Ad selection

[1341] Output: Sending advertising data

[1342] Specific operation: The server selects advertisements related to the suggested tourist spots and stores and sends them to the terminal.

[1343] 2. The device displays the advertisement to the user.

[1344] Input: Ad data

[1345] Output: Served ad

[1346] Specific operation: The device receives the advertising data and displays it within the app.

[1347] 3. When a user clicks on an ad, the device sends the click information to the server.

[1348] Input: Click event

[1349] Output: Send click information

[1350] What happens: When a user clicks on an ad, that information is sent to a server.

[1351] 4. The server counts clicks and generates revenue.

[1352] Input: Click information

[1353] Data Computing: Click Counting and Revenue Generation

[1354] Output: Revenue data

[1355] How it works: The server counts the number of clicks and calculates revenue based on that. This revenue model makes the system sustainable.

[1356] The above are the specific processing steps of this system. At each step, the necessary data processing and calculations are performed based on the input information, and the optimal output is obtained, providing the user with convenient and effective tourist information.

[1357] (Application example 2)

[1358] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1359] Conventional tourist information suggestion systems suggest tourist spots and shops based on the user's hobbies, preferences, and location information. However, they lacked a mechanism to consider the user's emotional state, and suggested spots suited to the user's physical condition and emotions were not suggested, which did not improve satisfaction. In addition, advertisements for suggested tourist spots and shops were not adjusted based on the user's emotions, reducing the effectiveness of the advertisements.

[1360] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving the user's hobbies, preferences, and location information, means for searching for and suggesting tourist spots and stores based on the received hobbies, preferences, and location information, means for providing detailed information on the suggested tourist spots and stores in the user's native language, means for analyzing the user's emotions, and means for adjusting the suggested tourist spots and stores based on the emotions. This makes it possible to suggest tourist spots and stores that suit the user's emotions.

[1361] "User" refers to an individual who uses the system.

[1362] "Hobbies and Preferences" refers to the activities and preferences that interest a user.

[1363] "Location information" refers to geographic data that indicates a user's current location.

[1364] "Tourist destination" refers to a place that tourists visit.

[1365] "Store" refers to a facility that sells goods or provides services.

[1366] "Detailed information" refers to specific information about tourist attractions and stores.

[1367] "Native language" refers to the language with which the user is most familiar.

[1368] "Emotion" refers to a temporary psychological state of a user.

[1369] "Analysis" refers to the detailed analysis of data.

[1370] "Suggestion" refers to recommending a particular action or choice to the user.

[1371] "Advertising" refers to information that promotes a product or service.

[1372] "Customization" refers to adjusting something to meet specific conditions.

[1373] "GPS" refers to Global Positioning System.

[1374] "Real-time" refers to information being processed immediately, without delay.

[1375] "Revenue" refers to profits earned from advertising clicks and impressions.

[1376] A "server" refers to a computer system that stores and processes data on a network.

[1377] This invention is a system that generates advertising revenue by individually suggesting tourist spots and stores based on the user's hobbies, preferences, location information, and emotions. We will explain the program and processing required to realize this system.

[1378] User registration and initial settings

[1379] The user downloads and installs the application on their device. They enter the required information, such as their name, email address, and password, on the account creation screen and press the register button. The device sends this information to the server, which then stores the received user information in a database.

[1380] Profile Settings

[1381] The user enters detailed information such as hobbies, preferences, places to visit, places they want to visit, their purpose, and their native language. The device sends this information to the server, which then creates a user profile based on the received information and stores it in a database.

[1382] Spot suggestions upon arrival

[1383] The user arrives at their travel destination and launches the app. The GPS function on the device is activated, obtaining their current coordinates and sending them to the server. The server compares the received location information with the user profile and searches for tourist spots and store information based on the user's hobbies, preferences, and real-time location information. The server generates a list of search results, adds detailed information in the user's native language, and sends it to the device. The device then displays the received information to the user. As a concrete example, if the user arrives in Asakusa, Tokyo, the device sends GPS information to the server, and the server uses that information to create a list of tourist spots and restaurants around Asakusa, displaying it in the user's native language.

[1384] Detailed information provided upon arrival at the spot

[1385] The user travels to one of the suggested tourist spots. The device uses GPS to confirm the location and notifies the server. The server searches for detailed information about the tourist spot based on the arrival location and sends information about its highlights and history to the device in the user's native language. The device then displays the received information to the user. For example, when the user arrives at Sensoji Temple, the device notifies the user of the location, and the server displays detailed information about the temple's history and highlights in the user's native language.

[1386] Dining and shopping support

[1387] When a user wants to eat or shop, they use the search function within the app to find nearby restaurants and shopping spots. The device sends the search criteria to the server, which then provides relevant store information in the user's native language based on the criteria. For example, if a user wants to enjoy Japanese food around Asakusa, the app will display nearby Japanese restaurants and provide information on recommended sushi restaurants.

[1388] Utilizing the Emotion Engine

[1389] The device inputs the user's facial expressions and voice into an emotion engine, which analyzes their emotions in real time. The server receives the analysis results and understands the user's current emotional state. The server then adjusts the recommendations of tourist spots and stores based on the user's emotions analyzed by the emotion engine. For example, if the user is tired, it will suggest places to relax and restaurants. If the emotion engine determines that the user is tired while touring tourist spots, the server will create a list of cafes and rest spots and provide guidance in the user's native language.

[1390] Ad customization

[1391] The server customizes the advertisement display based on the user's emotional state. If the user is relaxed, it displays advertisements for travel services, and if the user is excited, it displays advertisements for activities. Specifically, it uses the following prompt sentence:

[1392] Example prompt sentence:

[1393] "If the emotion engine detects that the user has arrived at Sensoji Temple and is very excited, the server will display an advertisement for a sightseeing boat as a nearby activity."

[1394] Hardware and software used

[1395] Hardware: Smartphones (Android and iOS)

[1396] software:

[1397] GPS tracking: geopy

[1398] Sentiment analysis: Google Cloud Natural Language API

[1399] Backend server: Python Flask

[1400] Database: Firebase Firestore

[1401] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1402] Step 1: Register and set up your profile

[1403] Input: The user enters information required by the app (such as name, email address, password, hobbies and preferences, native language, etc.).

[1404] Operation: The terminal sends the user's input information to the server.

[1405] Data calculation: The server stores the received information in a database (Firebase Firestore) and creates a user profile.

[1406] Output: A user account is created and the profile information is saved in the database.

[1407] Step 2: Obtaining location information

[1408] Input: A user arrives at a specific location and launches the app.

[1409] How it works: The device uses its GPS (geopy) to get its current coordinates and sends them to the server.

[1410] Data calculation: The server processes the received location information in real time.

[1411] Output: The user's current location data is saved on the server.

[1412] Step 3: Proposing tourist spots and stores

[1413] Input: User location, hobbies and preferences profile data.

[1414] How it works: The server matches the location information with the profile data to search for information on tourist attractions and stores.

[1415] Data calculation: The server lists the search results and translates the details into the user's native language.

[1416] Output: The list of tourist attractions and shops and their details are sent to the terminal and displayed to the user.

[1417] Step 4: Provide details when you arrive at the spot

[1418] Input: The user arrives at the suggested location (detected by the device's GPS).

[1419] Operation: The terminal sends arrival information to the server.

[1420] Data calculation: The server searches and translates detailed information (sights, history, etc.) based on the destination.

[1421] Output: Detailed information is sent to the terminal and displayed to the user.

[1422] Step 5: Food and shopping assistance

[1423] Input: A user wants to eat or shop and enters search criteria into the app.

[1424] Operation: The device sends search criteria to the server.

[1425] Data calculation: The server searches for store information based on the conditions and provides it in the user's native language.

[1426] Output: The store information is sent to the terminal and displayed to the user.

[1427] Step 6: Leverage your emotional engine

[1428] Input: User's facial and voice data.

[1429] How it works: The device inputs data into an emotion engine (Google Cloud Natural Language API) and analyzes emotions.

[1430] Data calculation: The server receives the analysis results (emotional state) and stores them in a database.

[1431] Output: The sentiment analysis results are saved on the server.

[1432] Step 7: Adjust your suggestions based on emotion

[1433] Input: Sentiment analysis results, a list of suggested tourist spots and stores.

[1434] How it works: The server adjusts the suggestion list based on the results of sentiment analysis. For example, if the user is tired, it will prioritize suggestions for places to relax.

[1435] Data operations: Arrangement of proposal lists.

[1436] Output: The adjusted suggestion list is sent to the device and displayed to the user.

[1437] Step 8: Customize your ads

[1438] Input: Sentiment analysis results, a list of suggested tourist spots and stores.

[1439] How it works: The server customizes relevant ads based on emotions.

[1440] Data processing: Selection and customization of advertising content.

[1441] Output: The customized advertisement is sent to the device and displayed to the user.

[1442] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1443] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1444] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1445] [Third embodiment]

[1446] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1447] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1448] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1449] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1450] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1451] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1452] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1453] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1454] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1455] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1456] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1457] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1458] This invention is a system that generates advertising revenue by suggesting tourist information based on the user's hobbies, preferences, and location information. The program processing of this system will be specifically explained below.

[1459] User registration and initial settings

[1460] User registration and initial setup:

[1461] First, the user downloads and installs the application. Then, they enter the required information, such as their name, email address, and password, on the account creation screen and press the register button. The device then sends this information to the server, which then stores the received user information in a database.

[1462] Profile Settings:

[1463] The user enters detailed information such as hobbies and interests, places to visit, places they want to visit in Japan, their purpose, and their native language. The device sends this information to the server, which then creates a user profile based on the received information and stores it in a database.

[1464] Spot suggestions upon arrival

[1465] Get GPS location:

[1466] When the user arrives at their travel destination and launches the app, the GPS function on the device is activated, and the current coordinates are acquired and sent to the server.

[1467] Search and suggest recommended places:

[1468] The server compares the received location information with the user profile and searches for tourist spots and store information around the current location based on the user's hobbies and preferences. The server generates a list of search results, adds detailed information in the user's native language, and sends it to the device. The device then displays the received information to the user.

[1469] As a concrete example, when a user arrives in Asakusa, Tokyo, the device sends GPS information to the server, which then uses that information to create a list of Sensoji Temple and recommended restaurants nearby, displaying it in the user's native language.

[1470] Detailed information provided upon arrival at the spot

[1471] Spot arrival detection:

[1472] When the user arrives at one of the suggested tourist spots, the device uses GPS to locate the user and notifies the server.

[1473] View more information:

[1474] The server searches for detailed information about tourist spots based on the location of the user's arrival and sends information about highlights, history, etc. to the user's device in their native language. The device then displays the received information to the user.

[1475] For example, when a user arrives at Sensoji Temple, the device notifies the user of the location, and the server displays the detailed history and highlights of the temple in the user's native language.

[1476] Dining and shopping support

[1477] Search for restaurants and shopping spots:

[1478] When a user wants to eat or shop, they use the search function within the app to search for nearby restaurants or shopping spots. The device sends the search criteria to the server, which then provides relevant store information in the user's native language based on the criteria.

[1479] Specifically, if a user wants to enjoy Japanese food around Asakusa, the app will display nearby Japanese restaurants and provide information on recommended sushi restaurants.

[1480] Menu ordering support:

[1481] When the user arrives at the restaurant of their choice, the device will confirm its location and activate the ordering support function. The server will provide the restaurant's menu information in the user's native language, which the device will then display to the user. It will also provide clear instructions on how to order.

[1482] Prepaid router set provided

[1483] Purchase and Setup:

[1484] Users purchase the app and prepaid router online before traveling and set it up after arriving in Japan, allowing them to use the app while always connected to the internet and obtain real-time tourist information.

[1485] Advertising revenue initiatives

[1486] Display ads:

[1487] The server selects advertisements related to the proposed tourist spots and store information and sends them to the terminal, which then displays the advertisements along with the tourist spot and store information to the user.

[1488] Ad click measurement and revenue generation:

[1489] When a user clicks on an advertisement, the device sends the click information to the server, which then counts the number of clicks and generates revenue. This revenue model makes the system sustainable.

[1490] As described above, this system provides users with a personalized tourism experience and realizes a sustainable business model through advertising revenue.

[1491] The processing flow will be explained below.

[1492] User registration and initial settings

[1493] Step 1:

[1494] User: Downloads and installs the application. After installation is complete, launches the app.

[1495] Step 2:

[1496] User: The account creation screen will appear. Enter your name, email address, and password, then click the Register button.

[1497] Step 3:

[1498] Terminal: Sends the entered information to the server.

[1499] Step 4:

[1500] Server: Stores the received user information in a database and sends a registration completion message to the terminal.

[1501] Step 5:

[1502] User: Enter detailed information such as hobbies and interests, places to visit, places you want to visit in Japan and your purpose, and your native language.

[1503] Step 6:

[1504] Terminal: Sends the entered details to the server.

[1505] Step 7:

[1506] Server: Creates a user profile based on the received details and stores it in a database.

[1507] Spot suggestions upon arrival

[1508] Step 8:

[1509] User: Arrives at travel destination and launches the app.

[1510] Step 9:

[1511] Device: Activate the GPS function and obtain the coordinates of your current location.

[1512] Step 10:

[1513] Device: Sends current location information to the server.

[1514] Step 11:

[1515] Server: Matches the received location information with the user profile.

[1516] Step 12:

[1517] Server: Searches for tourist spots and store information around the current location based on the user's hobbies and preferences.

[1518] Step 13:

[1519] Server: Generates a list of search results, adds detailed information in the user's native language, and sends it to the device.

[1520] Step 14:

[1521] Terminal: Displays the received information to the user.

[1522] Detailed information provided upon arrival at the spot

[1523] Step 15:

[1524] User: Travel to one of the suggested attractions.

[1525] Step 16:

[1526] Device: Monitors the user's location using GPS and detects when they arrive at a tourist spot.

[1527] Step 17:

[1528] Terminal: Notifies the server of the location of the spot where the user has arrived.

[1529] Step 18:

[1530] Server: Search for detailed information about tourist attractions based on arrival location.

[1531] Step 19:

[1532] Server: Sends detailed information about attractions, history, etc. to the device in the user's native language.

[1533] Step 20:

[1534] Terminal: Displays the received information to the user.

[1535] Dining and shopping support

[1536] Step 21:

[1537] User: If they want to eat or shop, they use the in-app search function to find restaurants and shopping spots near their current location.

[1538] Step 22:

[1539] Terminal: Sends search criteria to the server.

[1540] Step 23:

[1541] Server: Generates a list of nearby stores based on the search criteria, adds detailed information in the user's native language, and sends it to the device.

[1542] Step 24:

[1543] Terminal: Displays the received information to the user.

[1544] Step 25:

[1545] User: Arrive at the restaurant of their choice.

[1546] Step 26:

[1547] Terminal: Locate the store and launch ordering support features.

[1548] Step 27:

[1549] Server: Sends menu information for the restaurant in question to the device in the user's native language.

[1550] Step 28:

[1551] Terminal: Displays the received menu information to the user and guides them through ordering.

[1552] Prepaid router set provided

[1553] Step 29:

[1554] Users: Purchase the app and prepaid router online before traveling.

[1555] Step 30:

[1556] User: After arriving in Japan, set up a prepaid router and connect to the Internet.

[1557] Step 31:

[1558] User: Use the app while always connected to the Internet using a prepaid router.

[1559] Advertising revenue initiatives

[1560] Step 32:

[1561] Server: Selects advertisements related to the suggested tourist spots and store information and sends them to the device.

[1562] Step 33:

[1563] Device: Displays advertisements along with tourist attractions and store information.

[1564] Step 34:

[1565] User: Clicks on an ad that interests them.

[1566] Step 35:

[1567] Device: Sends ad click information to the server.

[1568] Step 36:

[1569] Server: Counts ad clicks and generates revenue.

[1570] By following the steps above, it is possible to implement a system that provides tourist information tailored to the user's preferences and realizes a sustainable business model through advertising revenue.

[1571] Example 1

[1572] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1573] Conventional tourist information systems lacked the ability to provide personalized information based on users' hobbies, preferences, and location information, making it difficult to maximize the travel experience. Furthermore, they lacked support for users to obtain detailed information on-site, which sometimes resulted in ineffective guidance. Furthermore, these systems lacked a mechanism for effectively generating advertising revenue, making sustainable operation difficult.

[1574] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1575] In this invention, the server includes: means for receiving user's hobbies, tastes, and location information; means for searching for and suggesting facilities and stores based on the received hobbies, tastes, and location information; means for providing detailed information on the suggested facilities and stores in the user's native language; means for displaying advertisements related to the detailed information; and means for measuring the number of advertisement views and clicks and generating revenue. This makes it possible to provide users with personalized tourist information and detailed local guidance, while also realizing sustainable operation of the system through advertising revenue.

[1576] "User" means an individual or organization that uses the system.

[1577] "Hobbies and tastes" refers to the user's personal interests and preferences, and is information related to travel destinations, purposes, etc.

[1578] "Location information" refers to the user's current geographic coordinate information obtained using the Global Positioning System or the like.

[1579] The Global Positioning System is a system that uses satellites such as GPS to determine locations on Earth.

[1580] "Facilities" refers to tourist destinations such as tourist attractions, historical buildings, and parks.

[1581] "Store" refers to commercial facilities such as restaurants and shopping malls.

[1582] A "search tool" is an algorithm or program that uses a database or API to find specific information.

[1583] "Suggestion means" refers to functions and algorithms for presenting search results to users.

[1584] "Detailed information" is additional information or explanation about a facility or store, including, for example, history, attractions, menus, etc.

[1585] "Providing means" refers to the algorithms and programs used to display information on the user's terminal.

[1586] "Advertisement" means information displayed to promote a product or service.

[1587] "Measurement means" refers to a program or system for recording the number of clicks and views of displayed advertisements.

[1588] A "revenue generation means" is a mechanism for generating advertising revenue based on measured data.

[1589] A "profile" is a data set that integrates a user's hobbies, preferences, location information, and personal information.

[1590] The "order support function" is a support function that helps users to smoothly place orders at restaurants.

[1591] This invention is a system that generates advertising revenue by suggesting tourist information based on the user's hobbies, preferences, and location information. The program processing of this system will be specifically explained below.

[1592] User registration and initial settings

[1593] User registration and initial settings

[1594] A user first downloads and installs the application. Next, they open the account creation screen, enter their name, email address, and password, and press the Register button. The device then sends this information to the server using an HTTP POST request. The server verifies the received information and, if there are no errors, stores it in a MySQL database.

[1595] Profile Settings

[1596] Users enter detailed information such as their hobbies and interests, places they want to visit in Japan, their purpose, and their native language. The device sends this information in JSON format to the server, which then creates a profile based on the received information and stores it in a database.

[1597] Spot suggestions upon arrival

[1598] Acquiring GPS location information

[1599] When a user arrives at their travel destination and launches the app, the GPS function on the device automatically activates, obtaining the current latitude and longitude data and sending that information to the server.

[1600] Search and suggest recommended spots

[1601] The server compares the received GPS data with the user's profile information. It uses Elasticsearch to quickly search the data. It generates a list of tourist attractions and shops near the current location, adding detailed information in the user's native language. It then sends this information to the user's device, which then displays it.

[1602] As a concrete example, when a user arrives in Asakusa, Tokyo, the device sends GPS information to the server, which then uses that information to create a list of Sensoji Temple and recommended restaurants nearby, displaying it in the user's native language.

[1603] Detailed information provided upon arrival at the spot

[1604] Spot arrival detection

[1605] When the user arrives at the suggested spot, the device will again check its location using GPS and notify the server of this location information.

[1606] Viewing detailed information

[1607] The server searches for detailed information about tourist attractions at that location based on the received location information. The server obtains the detailed information using a specific API (for example, Wikipedia API). The server translates the obtained information into the user's native language and sends it to the device. The device then displays the information to the user.

[1608] For example, when a user arrives at Sensoji Temple, the device notifies the user of the location, and the server displays the detailed history and highlights of the temple in the user's native language.

[1609] Dining and shopping support

[1610] Search for restaurants and shopping spots

[1611] The user enters search criteria for desired dining or shopping within the app, and the device sends the entered criteria (type of cuisine, price range, distance, etc.) to the server.

[1612] Providing search results

[1613] The server searches for suitable restaurants and shopping spots based on the received criteria. The search uses a specific database or API (for example, Google Places API). The search results are added with detailed information in the user's native language and sent to the device. The device then displays the received information to the user.

[1614] Menu ordering support

[1615] When the user arrives at the restaurant of their choice, the device locates them and activates the ordering support function. The server provides the restaurant's menu information in the user's native language, which the device displays. If necessary, the device also provides instructions on how to order in a specific way (e.g., by scanning a QR code).

[1616] Prepaid router set provided

[1617] Purchase and Setup

[1618] Users purchase the app and prepaid router online before traveling. The purchase process is completed through a web portal. Upon arrival in Japan, users receive the prepaid router and follow a simple setup procedure. The app includes a setup guide, which makes setup easy.

[1619] Advertising revenue initiatives

[1620] Displaying ads

[1621] The server selects advertisements related to tourist spots and store information recommended to the user. Advertisements are selected using Google AdSense or the RTB (Real-Time Bidding) platform. Advertisement data is sent to the device, which then displays the advertisements along with tourist spot information.

[1622] Ad click measurement and revenue generation

[1623] When a user clicks on an ad, the device sends the click information to the server, which aggregates the click data and generates revenue, which is monitored in real time by a server-side analytics tool (e.g., Google Analytics).

[1624] Prompt Sentence Examples

[1625] Example prompts to be input to the generative AI model:

[1626] The user arrives at their travel destination and launches the app. GPS information is acquired and their current coordinates are sent to the server. Based on the user's profile information and current location, create a list of recommended tourist spots. The list should also include detailed information about each spot and be provided in the user's native language.

[1627] The above is an embodiment of the present invention. The system provides users with personalized tourist information and detailed local guidance, and is sustainable through advertising revenue.

[1628] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1629] Step 1: User registration and initial setup

[1630] Input: The user enters their name, email address, and password.

[1631] How it works: A user first downloads and installs the application, then enters their name, email address, and password on the account creation screen and clicks the Register button.

[1632] Data processing: The device sends this information to the server using an HTTP POST request, which validates the information and stores it in a MySQL database if there are no errors.

[1633] Output: The user's account information is saved on the server and registration is complete.

[1634] Step 2: Profile Settings

[1635] Input: The user enters detailed information such as hobbies and interests, places they would like to visit in Japan, their purpose, and their native language.

[1636] How it works: The user enters these details in the app and hits submit.

[1637] Data processing: The device sends this information in JSON format to the server, which then creates a profile based on the received information and stores it in a database.

[1638] Output: The user's profile information is saved on the server and the profile is complete.

[1639] Step 3: Get GPS location

[1640] Input: The user arrives at their travel destination and launches the app.

[1641] How it works: The GPS function on your device will automatically start up and obtain your current latitude and longitude data.

[1642] Data processing: The device sends its current location information to the server.

[1643] Output: The current location is sent to the server.

[1644] Step 4: Search and suggest recommended spots

[1645] Input: GPS data received by the server and user profile information.

[1646] How it works: The server collates this information and lists tourist attractions and stores near the current location.

[1647] Data processing: The server uses Elasticsearch to quickly search the data and generate a list with additional details in the user's native language.

[1648] Output: A list of tourist attractions and stores is sent to the user's device.

[1649] Step 5: View Spot Suggestions

[1650] Input: A list of attractions and stores sent by the server.

[1651] Action: The terminal displays the received information to the user.

[1652] Output: The user is shown a list of attractions and shops, and can check their details.

[1653] Step 6: Detect spot arrivals

[1654] Input: User arrives at a suggested spot.

[1655] What it does: The device uses GPS to reconfirm the user's location.

[1656] Data processing: The device notifies the server of the newly acquired location information.

[1657] Output: The user's location is sent to the server and their arrival is confirmed.

[1658] Step 7: Provide more information

[1659] Input: User arrival information received by the server.

[1660] How it works: The server retrieves detailed information about tourist attractions at that location and translates it into your native language.

[1661] Data processing: The server uses a specific API to get detailed information and perform translation.

[1662] Output: The translated details are sent to the user's device.

[1663] Step 8: Viewing detailed information

[1664] Input: The details sent by the server.

[1665] Action: The terminal displays the received details to the user.

[1666] Output: The user is presented with detailed information about the attraction.

[1667] Step 9: Find restaurants and shopping spots

[1668] Input: The user enters search criteria for dining or shopping.

[1669] How it works: A user enters search criteria within the app and presses the search button.

[1670] Data processing: The device sends the search criteria to the server, which uses a specific database or API to search for information based on the criteria and adds detailed information in the user's native language.

[1671] Output: Information about related restaurants and shopping spots is sent to the user's device.

[1672] Step 10: Displaying search results

[1673] Input: Information about restaurants and shopping spots sent from the server.

[1674] Action: The terminal displays the received information to the user.

[1675] Output: Information about restaurants and shopping spots is displayed to the user.

[1676] Step 11: Menu ordering support

[1677] Input: The location of the restaurant selected by the user.

[1678] How it works: When a user arrives at a restaurant, the device verifies the user's location and activates the ordering support function.

[1679] Data processing: The server provides the menu information for the relevant store in the user's native language, which is then displayed on the device.

[1680] Output: The user is presented with ordering support information and instructions on how to place an order.

[1681] Step 12: Ad selection and display

[1682] Input: Tourist attractions and store information suggested by the server.

[1683] Operation: The server selects advertisements relevant to the user and sends the data to the device.

[1684] Data processing: The server selects ads using Google AdSense or RTB platforms.

[1685] Output: The ad is displayed to the user along with the tourist attraction information.

[1686] Step 13: Measure ad clicks and generate revenue

[1687] Input: User clicks on an ad.

[1688] How it works: The device sends ad click information to the server.

[1689] Data processing: The server aggregates click data and generates revenue using analytics tools such as Google Analytics.

[1690] Output: Ad revenue based on click data is generated on the server.

[1691] (Application example 1)

[1692] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1693] Conventional tourist information systems have been limited in the provision of personalized information based on users' hobbies, preferences, and location information, and have not been able to fully meet user needs. Furthermore, the range of information provided on tourist spots and stores is narrow, making it difficult to provide detailed information in real time. Furthermore, advertising revenue models have not adequately implemented personalized advertising display and monetization based on user behavior. The purpose of this invention is to solve these problems and realize an effective advertising revenue model while providing users with more abundant and personalized tourist information.

[1694] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1695] In this invention, the server includes a means for receiving a user's hobbies, preferences, and location information, a means for searching for and suggesting tourist spots and stores based on the received hobbies, preferences, and location information, a means for providing detailed information on the suggested tourist spots and stores in the user's native language, and a means for displaying the user's movement and tourist information within the virtual space. This allows the user to receive personalized tourist information in real time. The server also includes a means for generating personalized advertisements based on the user's behavior and interests, improving the effectiveness of advertisements for users and enabling effective monetization.

[1696] "User" refers to an individual who uses the system.

[1697] "Hobbies and tastes" refers to information related to a user's interests and preferences.

[1698] "Location information" refers to geographic data such as the latitude and longitude of a user's current location.

[1699] "Virtual space" refers to a virtual space generated on a computer system.

[1700] "Tourist spots" refer to places and attractions that tourists visit.

[1701] "Store" refers to a place for offering goods or services.

[1702] "Real-time tracking" means knowing a user's location almost instantly and monitoring their movements at every moment.

[1703] "Network Equipment" refers to equipment for connecting to the Internet or other communications networks.

[1704] "Advertising" refers to a message promoting a product or service.

[1705] "Personalized advertising" refers to advertising that is individually optimized based on a user's hobbies, preferences, and behavioral history.

[1706] "Revenue" refers to the profits earned from advertising clicks or views.

[1707] "Detailed information" refers to detailed information about tourist attractions and stores.

[1708] This invention is a system that provides users with personalized tourist information in real time when they visit tourist spots and earns revenue through advertising. This system is characterized by suggesting tourist spots and stores based on the user's hobbies, preferences, and location information.

[1709] System Program

[1710] The server starts when the user downloads the application and registers their profile information. The user enters details such as their name, email address, hobbies and interests, places they would like to visit in Japan, their purpose, and their native language. This information is sent to the server and stored in a database.

[1711] When a user arrives at a location and launches the application, the device uses its GPS to obtain the current latitude and longitude coordinates and sends that location information to the server. The server then matches the received location information with the user's profile to search for nearby tourist attractions and stores. The server then generates a list of search results and provides detailed information in the user's native language. Additionally, advertisements related to the suggested tourist attractions and stores are also displayed.

[1712] Specific examples

[1713] For example, if a user arrives at Asakusa in Tokyo, their device sends GPS information to the server, which then uses that information to create a list of Sensoji Temple and recommended restaurants nearby. This information is provided in the user's native language, enhancing their understanding of the tourist destination and improving convenience. Furthermore, personalized ads are generated based on the user's behavior and interests, allowing them to see highly relevant ads.

[1714] Hardware and software used

[1715] Device: Smartphone or tablet with GPS functionality

[1716] Server: Database and API server

[1717] software:

[1718] Software for obtaining GPS information (e.g. geopy)

[1719] Libraries for network communication (e.g., requests)

[1720] Database management system (e.g. MySQL)

[1721] Machine learning models for generating personalized ads (e.g., generative AI models)

[1722] Example prompts for generative AI models

[1723] "Write a prompt for an application that provides recommended tourist spots and restaurants for history-loving tourists traveling in Tokyo, Japan. The application will combine detailed historical information about the area to be visited with store information provided in the user's native language, and will also include a revenue model based on ad clicks."

[1724] This system allows users to receive personalized tourist information in real time, deepening their understanding of tourist destinations and further enriching their trips. In addition, monetization through effective advertising makes the system sustainable to maintain and operate.

[1725] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1726] Step 1:

[1727] The user downloads and installs the application. Next, the user launches the application, enters the required information such as name, email address, and password on the account creation screen, and presses the register button. This information is sent from the device to the server, and the server stores the received user information in a database.

[1728] Step 2:

[1729] On the profile setting screen, users enter detailed information such as their hobbies and interests, places they would like to visit in Japan, their purpose, and their native language. This information is also sent from the device to the server, which then creates a user profile based on the received information and stores it in a database.

[1730] Step 3:

[1731] The user arrives at their travel destination and launches the application. The device activates its GPS function to obtain current location information (latitude and longitude). The obtained location information is sent from the device to the server. The server receives this location information and stores it in a database.

[1732] Step 4:

[1733] The server compares the received location information with the user profile and searches for tourist spots and stores near the current location based on the user's hobbies and preferences. This search result list is generated with detailed information added in the user's native language. The generated list is sent from the server to the device, which then displays the received information to the user.

[1734] Step 5:

[1735] If the user becomes interested in a suggested tourist spot or store and actually visits it, the device again uses its GPS function to confirm its location and notify the server. The server then searches for more detailed tourist spot and store information based on the user's location and sends it to the device in the user's native language. The device then displays the received information to the user.

[1736] Step 6:

[1737] When a user wants to eat, drink, or shop, they use the search function within the application to search for nearby restaurants and shopping spots. The device sends the search criteria to the server, which then searches for relevant store information based on the criteria. The results are provided in the user's native language and displayed on the device.

[1738] Step 7:

[1739] When the user arrives at the restaurant of their choice, the device checks their GPS location and notifies the server of their location. The server then provides the restaurant's menu information in the user's native language, which the device receives and displays to the user. The device also provides clear instructions on how to order.

[1740] Step 8:

[1741] When a user displays information about a particular tourist spot or store, the server selects relevant advertisements and sends them to the device. The device then displays the advertisements along with the tourist spot or store information to the user. When a user clicks on an advertisement, the device sends click information to the server, which then counts the number of clicks and generates revenue.

[1742] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1743] This invention is a system that generates advertising revenue by suggesting tourist information based on the user's hobbies, preferences, location information, and emotions. The program processing of this system will be specifically explained below.

[1744] User registration and initial settings

[1745] User registration and initial setup:

[1746] First, the user downloads and installs the application. Then, they enter the required information, such as their name, email address, and password, on the account creation screen and press the register button. The device then sends this information to the server, which then stores the received user information in a database.

[1747] Profile Settings:

[1748] The user enters detailed information such as hobbies and interests, places to visit, places they want to visit in Japan, their purpose, and their native language. The device sends this information to the server, which then creates a user profile based on the received information and stores it in a database.

[1749] Spot suggestions upon arrival

[1750] Get GPS location:

[1751] When the user arrives at their travel destination and launches the app, the GPS function on the device is activated, and the current coordinates are acquired and sent to the server.

[1752] Search and suggest recommended places:

[1753] The server compares the received location information with the user profile and searches for tourist attractions and store information based on the user's hobbies and preferences and real-time location information. The server generates a list of search results, adds detailed information in the user's native language, and sends it to the device. The device then displays the received information to the user.

[1754] As a concrete example, when a user arrives in Asakusa, Tokyo, the device sends GPS information to the server, which then uses that information to create a list of Sensoji Temple and recommended restaurants nearby, displaying it in the user's native language.

[1755] Detailed information provided upon arrival at the spot

[1756] Spot arrival detection:

[1757] The user travels to one of the suggested tourist spots. The device uses GPS to locate the user and notifies the server.

[1758] View more information:

[1759] The server searches for detailed information about tourist spots based on the location of the user's arrival and sends information about highlights, history, etc. to the user's device in their native language. The device then displays the received information to the user.

[1760] For example, when a user arrives at Sensoji Temple, the device notifies the user of the location, and the server displays the detailed history and highlights of the temple in the user's native language.

[1761] Dining and shopping support

[1762] Search for restaurants and shopping spots:

[1763] When a user wants to eat or shop, they use the search function within the app to search for nearby restaurants or shopping spots. The device sends the search criteria to the server, which then provides relevant store information in the user's native language based on the criteria.

[1764] Specifically, if a user wants to enjoy Japanese food around Asakusa, the app will display nearby Japanese restaurants and provide information on recommended sushi restaurants.

[1765] Menu ordering support:

[1766] When the user arrives at the restaurant of their choice, the device will confirm its location and activate the ordering support function. The server will provide the restaurant's menu information in the user's native language, which the device will then display to the user. It will also provide clear instructions on how to order.

[1767] Utilizing the Emotion Engine

[1768] Emotion Recognition:

[1769] The device inputs the user's facial expressions and voice into an emotion engine, which analyzes their emotions in real time. The server receives the analysis results and determines the user's current emotional state.

[1770] Suggestion adjustments:

[1771] The server then adjusts the recommendations for tourist spots and shops based on the user's emotions analyzed by the emotion engine. For example, if the user is tired, it will suggest places to relax and restaurants.

[1772] For example, if the emotion engine determines that a user is tired while touring a tourist spot, the server will list cafes and rest spots and provide information in the user's native language.

[1773] Ad customization:

[1774] The server customizes the advertisement display based on the user's emotional state: if the user is relaxed, it displays advertisements for travel services, and if the user is excited, it displays advertisements for activities.

[1775] Prepaid router set provided

[1776] Purchase and Setup:

[1777] Users purchase the app and prepaid router online before traveling and set it up after arriving in Japan, allowing them to use the app while always connected to the internet and obtain real-time tourist information.

[1778] Advertising revenue initiatives

[1779] Display ads:

[1780] The server selects advertisements related to the proposed tourist spots and store information and sends them to the terminal, which then displays the advertisements along with the tourist spot and store information to the user.

[1781] Ad click measurement and revenue generation:

[1782] When a user clicks on an advertisement, the device sends the click information to the server, which then counts the number of clicks and generates revenue. This revenue model makes the system sustainable.

[1783] As described above, this system provides tourist information tailored to the user's tastes and emotions, and can realize a sustainable business model through advertising revenue.

[1784] The processing flow will be explained below.

[1785] User registration and initial settings

[1786] Step 1:

[1787] User: Downloads and installs the application. After installation is complete, launches the app.

[1788] Step 2:

[1789] User: The account creation screen will appear. Enter your name, email address, and password, then click the Register button.

[1790] Step 3:

[1791] Terminal: Sends the entered information to the server.

[1792] Step 4:

[1793] Server: Stores the received user information in a database and sends a registration completion message to the terminal.

[1794] Step 5:

[1795] User: Enter detailed information such as hobbies and interests, places to visit, places you want to visit in Japan and your purpose, and your native language.

[1796] Step 6:

[1797] Terminal: Sends the entered details to the server.

[1798] Step 7:

[1799] Server: Creates a user profile based on the received details and stores it in a database.

[1800] Spot suggestions upon arrival

[1801] Step 8:

[1802] User: Arrives at travel destination and launches the app.

[1803] Step 9:

[1804] Device: Activate the GPS function and obtain the coordinates of your current location.

[1805] Step 10:

[1806] Device: Sends current location information to the server.

[1807] Step 11:

[1808] Server: Matches the received location information with the user profile.

[1809] Step 12:

[1810] Server: Searches for tourist spots and store information around the current location based on the user's hobbies and preferences. It also makes suggestions that take the user's emotions into account using an emotion engine.

[1811] Step 13:

[1812] Server: Generates a list of search results, adds detailed information in the user's native language, and sends it to the device.

[1813] Step 14:

[1814] Terminal: Displays the received information to the user.

[1815] Detailed information provided upon arrival at the spot

[1816] Step 15:

[1817] User: Travel to one of the suggested attractions.

[1818] Step 16:

[1819] Device: Monitors the user's location using GPS and detects when they arrive at a tourist spot.

[1820] Step 17:

[1821] Terminal: Notifies the server of the location of the spot where the user has arrived.

[1822] Step 18:

[1823] Server: Search for detailed information about tourist attractions based on arrival location.

[1824] Step 19:

[1825] Server: Sends detailed information about attractions, history, etc. to the device in the user's native language.

[1826] Step 20:

[1827] Terminal: Displays the received information to the user.

[1828] Dining and shopping support

[1829] Step 21:

[1830] User: If they want to eat or shop, they use the in-app search function to find restaurants and shopping spots near their current location.

[1831] Step 22:

[1832] Terminal: Sends search criteria to the server.

[1833] Step 23:

[1834] Server: Generates a list of nearby stores based on search criteria. It also uses an emotion engine to make suggestions that take user emotions into account.

[1835] Step 24:

[1836] Server: Adds detailed information in the user's native language and sends it to the device.

[1837] Step 25:

[1838] Terminal: Displays the received information to the user.

[1839] Step 26:

[1840] User: Arrive at the restaurant of their choice.

[1841] Step 27:

[1842] Terminal: Locate the store and launch ordering support features.

[1843] Step 28:

[1844] Server: Sends menu information for the restaurant in question to the device in the user's native language.

[1845] Step 29:

[1846] Terminal: Displays the received menu information to the user and guides them through ordering.

[1847] Utilizing the Emotion Engine

[1848] Step 30:

[1849] Device: The user's facial expressions and voice are input into an emotion engine, which analyzes emotions in real time.

[1850] Step 31:

[1851] Server: Receives the emotion data analyzed by the emotion engine and understands the user's current emotional state.

[1852] Step 32:

[1853] Server: Adjusts recommendations for tourist spots and shops based on emotion data. For example, if the user is tired, it suggests places to relax.

[1854] Step 33:

[1855] Server: Customize emotional advertising and select ads that match the user's interests and mood.

[1856] Prepaid router set provided

[1857] Step 34:

[1858] Users: Purchase the app and prepaid router online before traveling.

[1859] Step 35:

[1860] User: After arriving in Japan, set up a prepaid router and connect to the Internet.

[1861] Step 36:

[1862] User: Use the app while always connected to the Internet using a prepaid router.

[1863] Advertising revenue initiatives

[1864] Step 37:

[1865] Server: Selects advertisements related to the suggested tourist spots and store information and sends them to the device.

[1866] Step 38:

[1867] Device: Displays advertisements along with tourist attractions and store information.

[1868] Step 39:

[1869] User: Clicks on an ad that interests them.

[1870] Step 40:

[1871] Device: Sends ad click information to the server.

[1872] Step 41:

[1873] Server: Counts ad clicks and generates revenue.

[1874] By following the steps above, it is possible to implement a system that provides tourist information tailored to the user's tastes and emotions, and realizes a sustainable business model through advertising revenue.

[1875] Example 2

[1876] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1877] Conventional tourist information systems provide suggestions based on a user's hobbies, preferences, and location information, but do not take into account the user's emotional state. As a result, they are unable to recommend tourist spots or stores that best suit the user's situation and emotions, resulting in a decrease in user satisfaction. Furthermore, since advertising does not take into account the user's real-time emotions, it is difficult to display effective advertisements.

[1878] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1879] In this invention, the server includes means for receiving user's hobbies, preferences and location information, means for searching for and suggesting tourist spots and shops based on the received hobbies, preferences and location information, means for providing detailed information on the suggested tourist spots and shops in the user's native language, emotion analysis means using an engine for analyzing the user's emotions, and means for adjusting the suggested tourist spots and shops based on the emotions analyzed by the emotion analysis means, thereby making it possible to suggest optimal tourist spots and shops according to the user's emotional state.

[1880] "User" refers to an individual who uses the system to obtain tourist information.

[1881] "Hobbies and Preferences" is information about a user's preferred activities and areas of interest.

[1882] "Location information" refers to the user's current geographic coordinate information obtained using technology such as GPS.

[1883] "Search" is the operation of locating related tourist spots and stores from a database based on the user's hobbies, preferences and location information.

[1884] "Suggestion" is the act of informing the user of information about the tourist spots or stores that were searched for.

[1885] "Detailed information" refers to specific explanations and data about tourist spots and stores, and is supplementary information to help users understand the site.

[1886] A "native language" is a language that a user uses on a daily basis and that is easiest for the user to understand.

[1887] "Emotion analysis means" refers to technology that analyzes emotions in real time from a user's facial expressions, voice, etc.

[1888] The Global Positioning System is a system that uses artificial satellites to measure the position of any point on Earth with high precision.

[1889] "Real time" refers to a state in which information processing and communication are carried out the instant an event occurs, without any time lag.

[1890] An "advertisement" is a message that provides users with information about a specific product or service and encourages them to purchase it.

[1891] "Revenue" refers to the monetary profits earned from advertising displays, clicks, etc.

[1892] The "system" refers to the entire hardware and software required to realize the above-mentioned functions.

[1893] This invention is a system that generates advertising revenue by suggesting tourist information based on the user's hobbies, preferences, location information, and emotions. The system's main components are a server, terminals, and users, and information is exchanged between them.

[1894] User registration and initial settings

[1895] First, a user downloads and installs the application from the smartphone's app store. After installation, the user enters their name, email address, and password on the account creation screen and presses the register button. The device sends this information to the server, which then stores the received user information in a database.

[1896] Next, the user sets up a profile, entering detailed information such as hobbies, preferences, places to visit, places they want to visit in Japan, their purpose, and their native language. The device sends this information to the server, which then creates a user profile based on the received information and stores it in a database.

[1897] Spot suggestions upon arrival

[1898] When a user arrives at their travel destination and launches the app, the device's GPS function acquires their current coordinates and sends them to the server. The server compares the received location information with the user's profile and searches for tourist spots and store information based on the user's hobbies, preferences, and real-time location information. The server then adds detailed information in the user's native language and sends it to the device, where it is displayed to the user.

[1899] Detailed information provided upon arrival at the spot

[1900] When the user arrives at one of the suggested tourist spots, the device uses GPS to confirm the location and notifies the server. The server then searches for detailed information about the tourist spot based on the user's location and sends it to the device in the user's native language, including information about its highlights and history. The device then displays this information to the user.

[1901] Dining and shopping support

[1902] When a user wants to eat or shop, they use the app's search function to find nearby restaurants or shopping spots. The device sends the search criteria to the server, which then provides relevant store information in the user's native language based on the criteria.

[1903] Utilizing the Emotion Engine

[1904] The device inputs the user's facial expressions and voice into an emotion engine, which analyzes their emotions in real time. The server receives the analysis results and determines the user's current emotional state. The server then adjusts its recommendations for tourist spots and shops based on the emotion analysis results, providing the user with the most appropriate information. For example, if the user is tired, it can suggest places to relax or restaurants.

[1905] Advertising revenue initiatives

[1906] The server selects advertisements related to the recommendations and sends them to the device. The device displays them to the user. The server then measures the number of advertisements displayed and clicked, generating revenue. This revenue model makes the system sustainable.

[1907] Prepaid router set provided

[1908] Users can purchase the app and prepaid router online before traveling and set it up after arriving in Japan, allowing them to stay connected to the internet at all times, accessing real-time tourist information and getting detailed information about suggested locations.

[1909] Examples of concrete examples and prompts

[1910] For example, when a user arrives at Asakusa in Tokyo, the device sends GPS information to the server, which then lists Sensoji Temple and recommended restaurants nearby, displaying them in the user's native language.Also, when the user arrives at Sensoji Temple, the device notifies the user of its location, and the server displays the detailed history and highlights of Sensoji Temple in the user's native language.

[1911] Example prompt sentence:

[1912] How do I set up the initial user registration?

[1913] What are some recommended tourist spots in Asakusa?

[1914] I'd like to know more about the dining and shopping support features.

[1915] Show me tourist spot suggestions based on your current emotional state.

[1916] The above is a specific embodiment for carrying out the present invention.

[1917] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1918] Step 1: User registration and initial setup

[1919] 1. The user downloads and installs the application from the smartphone's app store.

[1920] Input: Internet connection, app store access

[1921] Output: Application installed

[1922] What happens: A user opens the Apple App Store or Google Play Store, searches for an app, and presses the download button.

[1923] 2. The user enters their name, email address, and password on the account creation screen and presses the registration button.

[1924] Input: Name, Email Address, Password

[1925] Data processing: Converting the input information into a format for sending to the server

[1926] Output: Submit registration information

[1927] What happens: The user fills in the form with the required information and clicks the registration button.

[1928] 3. The terminal sends the user's input information to the server.

[1929] Input: Registration information

[1930] Data processing: Encryption of information and transmission to server

[1931] Output: Transfer of information to the server

[1932] What happens: The device performs an encryption process to securely transmit the entered information to the server.

[1933] 4. The server stores the received user information in a database.

[1934] Input: User information

[1935] Data processing: Converting data into a format for saving to a database

[1936] Output: Save successful message

[1937] What happens: The server opens a database connection, runs a query to save the user information, and returns a success message.

[1938] Step 2: Profile Settings

[1939] 1. The user enters detailed information such as hobbies and preferences, places to visit, places they would like to visit in Japan and their purpose, and their native language.

[1940] Input: Hobbies, preferences, places visited, native language, etc.

[1941] Data processing: Format conversion of input information

[1942] Output: Sending input information

[1943] Specific behavior: The user fills in a form with details such as hobbies, preferences, and destination.

[1944] 2. The terminal sends the entered information to the server.

[1945] Input: User details

[1946] Data processing: Encryption of information and transmission to server

[1947] Output: Transfer of information to the server

[1948] Specific operation: The device encrypts the entered information and sends it securely to the server.

[1949] 3. The server creates a user profile based on the received information and stores it in a database.

[1950] Input: User details

[1951] Data processing: Data structure conversion for profile creation

[1952] Output: Profile saved successfully message

[1953] What happens: The server opens a database connection and runs a query to create and save a user profile.

[1954] Step 3: Suggesting spots when you arrive

[1955] 1. The user arrives at their travel destination and launches the app.

[1956] Input: GPS location request

[1957] Output: App launched

[1958] Specific operation: After the user arrives at their travel destination, they tap the app to launch it.

[1959] 2. The device will activate its built-in GPS function and obtain its current coordinates.

[1960] Input: Current location request

[1961] Data Calculation: Acquisition and analysis of GPS data

[1962] Output: current position

[1963] Specific operations: The device turns on the GPS function and obtains the coordinate data of the current location.

[1964] 3. The device sends the acquired location information to the server.

[1965] Input: Obtained location information

[1966] Data processing: Encryption and transmission of location information

[1967] Output: Location information sent to the server

[1968] Specific operation: The device encrypts the location information and sends it to the server.

[1969] 4. The server compares the received location information with the user profile and searches for tourist spots and store information based on the user's hobbies and preferences.

[1970] Input: Current location, user profile

[1971] Data operations: performing database queries and retrieving results

[1972] Output: Search results

[1973] Specific operation: The server searches the database based on the user's location information and profile to extract the most suitable tourist spots and stores.

[1974] 5. The server generates a list of search results, adds detailed information in the user's native language, and sends it to the terminal.

[1975] Input: Search results

[1976] Data processing: translation into native language and list generation

[1977] Output: List sent to terminal

[1978] Specific operation: The server converts the search results into the user's native language, generates a suggestion list, and sends it to the device.

[1979] 6. The terminal displays the received information to the user.

[1980] Input: Suggestion list

[1981] Output: The displayed information

[1982] Specific operation: The device displays the received list on the app's user interface. For example, if the user arrives in Asakusa, Tokyo, the device will display a list of Sensoji Temple and recommended restaurants.

[1983] Step 4: Provide details when you arrive at the spot

[1984] 1. The user travels to one of the suggested tourist spots.

[1985] Input: Start moving

[1986] Output: Arrival at destination

[1987] Specific behavior: Move to the tourist spot selected by the user.

[1988] 2. The device uses GPS to confirm its location and notify the server.

[1989] Input: Current location request

[1990] Data calculation: Acquisition and transmission of GPS data

[1991] Output: Location notification to the server

[1992] Specific operation: The device checks the user's current location and sends the location data to the server.

[1993] 3. The server searches for detailed information about tourist spots based on the arrival location and sends information about highlights, history, and other information to the terminal in the user's native language.

[1994] Input: Destination location information

[1995] Data operations: performing database queries and translating information

[1996] Output: Send detailed information

[1997] Specific operation: The server searches for detailed information about the spot you have arrived at, translates it into your native language, and sends it to your device.

[1998] 4. The terminal displays the received information to the user.

[1999] Input: More information

[2000] Output: The displayed information

[2001] Specific operation: The device displays the received details on the app's user interface. For example, when the user arrives at Sensoji Temple, the device displays the history and attractions of the temple.

[2002] Step 5: Food and shopping assistance

[2003] 1. Users use the app's search function to find nearby restaurants and shopping spots.

[2004] Input: Enter search criteria

[2005] Output: Search request

[2006] What happens: A user enters a search term into the in-app search bar.

[2007] 2. The terminal sends the search criteria to the server.

[2008] Input: Search criteria

[2009] Data calculation: Encryption and transmission of search conditions

[2010] Output: Search request sent to the server

[2011] Specific operation: The device encrypts the entered search criteria before sending them to the server.

[2012] 3. The server provides relevant store information in the user's native language based on the search criteria.

[2013] Input: Search criteria

[2014] Data operations: performing database queries, translating into native language

[2015] Output: Send search results

[2016] Specific operation: The server searches the database, translates store information that matches the search criteria into the user's native language, and sends it to the terminal.

[2017] 4. The terminal displays the received information to the user.

[2018] Input: Search results

[2019] Output: The displayed information

[2020] Specific operation: The device displays the received information, for example, information about nearby Japanese restaurants or sushi restaurants.

[2021] 5. When the user arrives at the restaurant of their choice, the device will confirm the location and activate the ordering support function.

[2022] Input: Start moving

[2023] Output: Order Support Start

[2024] Specific operation: The user arrives at the store and the device confirms their location.

[2025] 6. The server provides menu information for the restaurant in the user's native language, and the terminal displays it to the user.

[2026] Input: Current location

[2027] Data Calculation: Retrieving and translating menu information

[2028] Output: Sending menu information

[2029] Specific operation: The server translates the listed menu information into the user's native language and sends it to the terminal.

[2030] Step 6: Leverage your emotional engine

[2031] 1. The device inputs the user's facial expressions and voice into an emotion engine and analyzes emotions in real time.

[2032] Input: facial expression data, voice data

[2033] Data Computing: Sentiment Analysis

[2034] Output: Emotion analysis results

[2035] How it works: The device uses a camera and microphone to capture the user's facial expressions and voice, and inputs them into a generative AI model.

[2036] 2. The server receives the analysis results and determines the user's current emotional state.

[2037] Input: Sentiment analysis results

[2038] Data Computing: Emotional State Recognition

[2039] Output: Emotional state data

[2040] Specific operation: The server analyzes the data received from the emotion engine and understands the user's emotional state.

[2041] 3. The server adjusts the suggestions for tourist spots and stores based on the results of the sentiment analysis, providing the user with the most appropriate information.

[2042] Input: Emotional state data

[2043] Data calculations: adjusting proposals

[2044] Output: A refined list of suggestions

[2045] Specific operation: The server optimizes tourist spot and store information according to the user's emotional state and sends it to the device. For example, if the user is tired, it suggests places to relax and restaurants.

[2046] Step 7: Ad revenue initiatives

[2047] 1. The server selects advertisements related to the proposal and sends them to the terminal.

[2048] Input: Suggestion list

[2049] Data calculation: Ad selection

[2050] Output: Sending advertising data

[2051] Specific operation: The server selects advertisements related to the suggested tourist spots and stores and sends them to the terminal.

[2052] 2. The device displays the advertisement to the user.

[2053] Input: Ad data

[2054] Output: Served ad

[2055] Specific operation: The device receives the advertising data and displays it within the app.

[2056] 3. When a user clicks on an ad, the device sends the click information to the server.

[2057] Input: Click event

[2058] Output: Send click information

[2059] What happens: When a user clicks on an ad, that information is sent to a server.

[2060] 4. The server counts clicks and generates revenue.

[2061] Input: Click information

[2062] Data Computing: Click Counting and Revenue Generation

[2063] Output: Revenue data

[2064] How it works: The server counts the number of clicks and calculates revenue based on that. This revenue model makes the system sustainable.

[2065] The above are the specific processing steps of this system. At each step, the necessary data processing and calculations are performed based on the input information, and the optimal output is obtained, providing the user with convenient and effective tourist information.

[2066] (Application example 2)

[2067] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2068] Conventional tourist information suggestion systems suggest tourist spots and shops based on the user's hobbies, preferences, and location information. However, they lacked a mechanism to consider the user's emotional state, and suggested spots suited to the user's physical condition and emotions were not suggested, which did not improve satisfaction. In addition, advertisements for suggested tourist spots and shops were not adjusted based on the user's emotions, reducing the effectiveness of the advertisements.

[2069] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving the user's hobbies, preferences, and location information, means for searching for and suggesting tourist spots and stores based on the received hobbies, preferences, and location information, means for providing detailed information on the suggested tourist spots and stores in the user's native language, means for analyzing the user's emotions, and means for adjusting the suggested tourist spots and stores based on the emotions. This makes it possible to suggest tourist spots and stores that suit the user's emotions.

[2070] "User" refers to an individual who uses the system.

[2071] "Hobbies and Preferences" refers to the activities and preferences that interest a user.

[2072] "Location information" refers to geographic data that indicates a user's current location.

[2073] "Tourist destination" refers to a place that tourists visit.

[2074] "Store" refers to a facility that sells goods or provides services.

[2075] "Detailed information" refers to specific information about tourist attractions and stores.

[2076] "Native language" refers to the language with which the user is most familiar.

[2077] "Emotion" refers to a temporary psychological state of a user.

[2078] "Analysis" refers to the detailed analysis of data.

[2079] "Suggestion" refers to recommending a particular action or choice to the user.

[2080] "Advertising" refers to information that promotes a product or service.

[2081] "Customization" refers to adjusting something to meet specific conditions.

[2082] "GPS" refers to Global Positioning System.

[2083] "Real-time" refers to information being processed immediately, without delay.

[2084] "Revenue" refers to profits earned from advertising clicks and impressions.

[2085] A "server" refers to a computer system that stores and processes data on a network.

[2086] This invention is a system that generates advertising revenue by individually suggesting tourist spots and stores based on the user's hobbies, preferences, location information, and emotions. We will explain the program and processing required to realize this system.

[2087] User registration and initial settings

[2088] The user downloads and installs the application on their device. They enter the required information, such as their name, email address, and password, on the account creation screen and press the register button. The device sends this information to the server, which then stores the received user information in a database.

[2089] Profile Settings

[2090] The user enters detailed information such as hobbies, preferences, places to visit, places they want to visit, their purpose, and their native language. The device sends this information to the server, which then creates a user profile based on the received information and stores it in a database.

[2091] Spot suggestions upon arrival

[2092] The user arrives at their travel destination and launches the app. The GPS function on the device is activated, obtaining their current coordinates and sending them to the server. The server compares the received location information with the user profile and searches for tourist spots and store information based on the user's hobbies, preferences, and real-time location information. The server generates a list of search results, adds detailed information in the user's native language, and sends it to the device. The device then displays the received information to the user. As a concrete example, if the user arrives in Asakusa, Tokyo, the device sends GPS information to the server, and the server uses that information to create a list of tourist spots and restaurants around Asakusa, displaying it in the user's native language.

[2093] Detailed information provided upon arrival at the spot

[2094] The user travels to one of the suggested tourist spots. The device uses GPS to confirm the location and notifies the server. The server searches for detailed information about the tourist spot based on the arrival location and sends information about its highlights and history to the device in the user's native language. The device then displays the received information to the user. For example, when the user arrives at Sensoji Temple, the device notifies the user of the location, and the server displays detailed information about the temple's history and highlights in the user's native language.

[2095] Dining and shopping support

[2096] When a user wants to eat or shop, they use the search function within the app to find nearby restaurants and shopping spots. The device sends the search criteria to the server, which then provides relevant store information in the user's native language based on the criteria. For example, if a user wants to enjoy Japanese food around Asakusa, the app will display nearby Japanese restaurants and provide information on recommended sushi restaurants.

[2097] Utilizing the Emotion Engine

[2098] The device inputs the user's facial expressions and voice into an emotion engine, which analyzes their emotions in real time. The server receives the analysis results and understands the user's current emotional state. The server then adjusts the recommendations of tourist spots and stores based on the user's emotions analyzed by the emotion engine. For example, if the user is tired, it will suggest places to relax and restaurants. If the emotion engine determines that the user is tired while touring tourist spots, the server will create a list of cafes and rest spots and provide guidance in the user's native language.

[2099] Ad customization

[2100] The server customizes the advertisement display based on the user's emotional state. If the user is relaxed, it displays advertisements for travel services, and if the user is excited, it displays advertisements for activities. Specifically, it uses the following prompt sentence:

[2101] Example prompt sentence:

[2102] "If the emotion engine detects that the user has arrived at Sensoji Temple and is very excited, the server will display an advertisement for a sightseeing boat as a nearby activity."

[2103] Hardware and software used

[2104] Hardware: Smartphones (Android and iOS)

[2105] software:

[2106] GPS tracking: geopy

[2107] Sentiment analysis: Google Cloud Natural Language API

[2108] Backend server: Python Flask

[2109] Database: Firebase Firestore

[2110] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2111] Step 1: Register and set up your profile

[2112] Input: The user enters information required by the app (such as name, email address, password, hobbies and preferences, native language, etc.).

[2113] Operation: The terminal sends the user's input information to the server.

[2114] Data calculation: The server stores the received information in a database (Firebase Firestore) and creates a user profile.

[2115] Output: A user account is created and the profile information is saved in the database.

[2116] Step 2: Obtaining location information

[2117] Input: A user arrives at a specific location and launches the app.

[2118] How it works: The device uses its GPS (geopy) to get its current coordinates and sends them to the server.

[2119] Data calculation: The server processes the received location information in real time.

[2120] Output: The user's current location data is saved on the server.

[2121] Step 3: Proposing tourist spots and stores

[2122] Input: User location, hobbies and preferences profile data.

[2123] How it works: The server matches the location information with the profile data to search for information on tourist attractions and stores.

[2124] Data calculation: The server lists the search results and translates the details into the user's native language.

[2125] Output: The list of tourist attractions and shops and their details are sent to the terminal and displayed to the user.

[2126] Step 4: Provide details when you arrive at the spot

[2127] Input: The user arrives at the suggested location (detected by the device's GPS).

[2128] Operation: The terminal sends arrival information to the server.

[2129] Data calculation: The server searches and translates detailed information (sights, history, etc.) based on the destination.

[2130] Output: Detailed information is sent to the terminal and displayed to the user.

[2131] Step 5: Food and shopping assistance

[2132] Input: A user wants to eat or shop and enters search criteria into the app.

[2133] Operation: The device sends search criteria to the server.

[2134] Data calculation: The server searches for store information based on the conditions and provides it in the user's native language.

[2135] Output: The store information is sent to the terminal and displayed to the user.

[2136] Step 6: Leverage your emotional engine

[2137] Input: User's facial and voice data.

[2138] How it works: The device inputs data into an emotion engine (Google Cloud Natural Language API) and analyzes emotions.

[2139] Data calculation: The server receives the analysis results (emotional state) and stores them in a database.

[2140] Output: The sentiment analysis results are saved on the server.

[2141] Step 7: Adjust your suggestions based on emotion

[2142] Input: Sentiment analysis results, a list of suggested tourist spots and stores.

[2143] How it works: The server adjusts the suggestion list based on the results of sentiment analysis. For example, if the user is tired, it will prioritize suggestions for places to relax.

[2144] Data operations: Arrangement of proposal lists.

[2145] Output: The adjusted suggestion list is sent to the device and displayed to the user.

[2146] Step 8: Customize your ads

[2147] Input: Sentiment analysis results, a list of suggested tourist spots and stores.

[2148] How it works: The server customizes relevant ads based on emotions.

[2149] Data processing: Selection and customization of advertising content.

[2150] Output: The customized advertisement is sent to the device and displayed to the user.

[2151] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2152] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2153] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2154] [Fourth embodiment]

[2155] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2156] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2157] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2158] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2159] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2160] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2161] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2162] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2163] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2164] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2165] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2166] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2167] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2168] This invention is a system that generates advertising revenue by suggesting tourist information based on the user's hobbies, preferences, and location information. The program processing of this system will be specifically explained below.

[2169] User registration and initial settings

[2170] User registration and initial setup:

[2171] First, the user downloads and installs the application. Then, they enter the required information, such as their name, email address, and password, on the account creation screen and press the register button. The device then sends this information to the server, which then stores the received user information in a database.

[2172] Profile Settings:

[2173] The user enters detailed information such as hobbies and interests, places to visit, places they want to visit in Japan, their purpose, and their native language. The device sends this information to the server, which then creates a user profile based on the received information and stores it in a database.

[2174] Spot suggestions upon arrival

[2175] Get GPS location:

[2176] When the user arrives at their travel destination and launches the app, the GPS function on the device is activated, and the current coordinates are acquired and sent to the server.

[2177] Search and suggest recommended places:

[2178] The server compares the received location information with the user profile and searches for tourist spots and store information around the current location based on the user's hobbies and preferences. The server generates a list of search results, adds detailed information in the user's native language, and sends it to the device. The device then displays the received information to the user.

[2179] As a concrete example, when a user arrives in Asakusa, Tokyo, the device sends GPS information to the server, which then uses that information to create a list of Sensoji Temple and recommended restaurants nearby, displaying it in the user's native language.

[2180] Detailed information provided upon arrival at the spot

[2181] Spot arrival detection:

[2182] When the user arrives at one of the suggested tourist spots, the device uses GPS to locate the user and notifies the server.

[2183] View more information:

[2184] The server searches for detailed information about tourist spots based on the location of the user's arrival and sends information about highlights, history, etc. to the user's device in their native language. The device then displays the received information to the user.

[2185] For example, when a user arrives at Sensoji Temple, the device notifies the user of the location, and the server displays the detailed history and highlights of the temple in the user's native language.

[2186] Dining and shopping support

[2187] Search for restaurants and shopping spots:

[2188] When a user wants to eat or shop, they use the search function within the app to search for nearby restaurants or shopping spots. The device sends the search criteria to the server, which then provides relevant store information in the user's native language based on the criteria.

[2189] Specifically, if a user wants to enjoy Japanese food around Asakusa, the app will display nearby Japanese restaurants and provide information on recommended sushi restaurants.

[2190] Menu ordering support:

[2191] When the user arrives at the restaurant of their choice, the device will confirm its location and activate the ordering support function. The server will provide the restaurant's menu information in the user's native language, which the device will then display to the user. It will also provide clear instructions on how to order.

[2192] Prepaid router set provided

[2193] Purchase and Setup:

[2194] Users purchase the app and prepaid router online before traveling and set it up after arriving in Japan, allowing them to use the app while always connected to the internet and obtain real-time tourist information.

[2195] Advertising revenue initiatives

[2196] Display ads:

[2197] The server selects advertisements related to the proposed tourist spots and store information and sends them to the terminal, which then displays the advertisements along with the tourist spot and store information to the user.

[2198] Ad click measurement and revenue generation:

[2199] When a user clicks on an advertisement, the device sends the click information to the server, which then counts the number of clicks and generates revenue. This revenue model makes the system sustainable.

[2200] As described above, this system provides users with a personalized tourism experience and realizes a sustainable business model through advertising revenue.

[2201] The processing flow will be explained below.

[2202] User registration and initial settings

[2203] Step 1:

[2204] User: Downloads and installs the application. After installation is complete, launches the app.

[2205] Step 2:

[2206] User: The account creation screen will appear. Enter your name, email address, and password, then click the Register button.

[2207] Step 3:

[2208] Terminal: Sends the entered information to the server.

[2209] Step 4:

[2210] Server: Stores the received user information in a database and sends a registration completion message to the terminal.

[2211] Step 5:

[2212] User: Enter detailed information such as hobbies and interests, places to visit, places you want to visit in Japan and your purpose, and your native language.

[2213] Step 6:

[2214] Terminal: Sends the entered details to the server.

[2215] Step 7:

[2216] Server: Creates a user profile based on the received details and stores it in a database.

[2217] Spot suggestions upon arrival

[2218] Step 8:

[2219] User: Arrives at travel destination and launches the app.

[2220] Step 9:

[2221] Device: Activate the GPS function and obtain the coordinates of your current location.

[2222] Step 10:

[2223] Device: Sends current location information to the server.

[2224] Step 11:

[2225] Server: Matches the received location information with the user profile.

[2226] Step 12:

[2227] Server: Searches for tourist spots and store information around the current location based on the user's hobbies and preferences.

[2228] Step 13:

[2229] Server: Generates a list of search results, adds detailed information in the user's native language, and sends it to the device.

[2230] Step 14:

[2231] Terminal: Displays the received information to the user.

[2232] Detailed information provided upon arrival at the spot

[2233] Step 15:

[2234] User: Travel to one of the suggested attractions.

[2235] Step 16:

[2236] Device: Monitors the user's location using GPS and detects when they arrive at a tourist spot.

[2237] Step 17:

[2238] Terminal: Notifies the server of the location of the spot where the user has arrived.

[2239] Step 18:

[2240] Server: Search for detailed information about tourist attractions based on arrival location.

[2241] Step 19:

[2242] Server: Sends detailed information about attractions, history, etc. to the device in the user's native language.

[2243] Step 20:

[2244] Terminal: Displays the received information to the user.

[2245] Dining and shopping support

[2246] Step 21:

[2247] User: If they want to eat or shop, they use the in-app search function to find restaurants and shopping spots near their current location.

[2248] Step 22:

[2249] Terminal: Sends search criteria to the server.

[2250] Step 23:

[2251] Server: Generates a list of nearby stores based on the search criteria, adds detailed information in the user's native language, and sends it to the device.

[2252] Step 24:

[2253] Terminal: Displays the received information to the user.

[2254] Step 25:

[2255] User: Arrive at the restaurant of their choice.

[2256] Step 26:

[2257] Terminal: Locate the store and launch ordering support features.

[2258] Step 27:

[2259] Server: Sends menu information for the restaurant in question to the device in the user's native language.

[2260] Step 28:

[2261] Terminal: Displays the received menu information to the user and guides them through ordering.

[2262] Prepaid router set provided

[2263] Step 29:

[2264] Users: Purchase the app and prepaid router online before traveling.

[2265] Step 30:

[2266] User: After arriving in Japan, set up a prepaid router and connect to the Internet.

[2267] Step 31:

[2268] User: Use the app while always connected to the Internet using a prepaid router.

[2269] Advertising revenue initiatives

[2270] Step 32:

[2271] Server: Selects advertisements related to the suggested tourist spots and store information and sends them to the device.

[2272] Step 33:

[2273] Device: Displays advertisements along with tourist attractions and store information.

[2274] Step 34:

[2275] User: Clicks on an ad that interests them.

[2276] Step 35:

[2277] Device: Sends ad click information to the server.

[2278] Step 36:

[2279] Server: Counts ad clicks and generates revenue.

[2280] By following the steps above, it is possible to implement a system that provides tourist information tailored to the user's preferences and realizes a sustainable business model through advertising revenue.

[2281] Example 1

[2282] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2283] Conventional tourist information systems lacked the ability to provide personalized information based on users' hobbies, preferences, and location information, making it difficult to maximize the travel experience. Furthermore, they lacked support for users to obtain detailed information on-site, which sometimes resulted in ineffective guidance. Furthermore, these systems lacked a mechanism for effectively generating advertising revenue, making sustainable operation difficult.

[2284] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2285] In this invention, the server includes: means for receiving user's hobbies, tastes, and location information; means for searching for and suggesting facilities and stores based on the received hobbies, tastes, and location information; means for providing detailed information on the suggested facilities and stores in the user's native language; means for displaying advertisements related to the detailed information; and means for measuring the number of advertisement views and clicks and generating revenue. This makes it possible to provide users with personalized tourist information and detailed local guidance, while also realizing sustainable operation of the system through advertising revenue.

[2286] "User" means an individual or organization that uses the system.

[2287] "Hobbies and tastes" refers to the user's personal interests and preferences, and is information related to travel destinations, purposes, etc.

[2288] "Location information" refers to the user's current geographic coordinate information obtained using the Global Positioning System or the like.

[2289] The Global Positioning System is a system that uses satellites such as GPS to determine locations on Earth.

[2290] "Facilities" refers to tourist destinations such as tourist attractions, historical buildings, and parks.

[2291] "Store" refers to commercial facilities such as restaurants and shopping malls.

[2292] A "search tool" is an algorithm or program that uses a database or API to find specific information.

[2293] "Suggestion means" refers to functions and algorithms for presenting search results to users.

[2294] "Detailed information" is additional information or explanation about a facility or store, including, for example, history, attractions, menus, etc.

[2295] "Providing means" refers to the algorithms and programs used to display information on the user's terminal.

[2296] "Advertisement" means information displayed to promote a product or service.

[2297] "Measurement means" refers to a program or system for recording the number of clicks and views of displayed advertisements.

[2298] A "revenue generation means" is a mechanism for generating advertising revenue based on measured data.

[2299] A "profile" is a data set that integrates a user's hobbies, preferences, location information, and personal information.

[2300] The "order support function" is a support function that helps users to smoothly place orders at restaurants.

[2301] This invention is a system that generates advertising revenue by suggesting tourist information based on the user's hobbies, preferences, and location information. The program processing of this system will be specifically explained below.

[2302] User registration and initial settings

[2303] User registration and initial settings

[2304] A user first downloads and installs the application. Next, they open the account creation screen, enter their name, email address, and password, and press the Register button. The device then sends this information to the server using an HTTP POST request. The server verifies the received information and, if there are no errors, stores it in a MySQL database.

[2305] Profile Settings

[2306] Users enter detailed information such as their hobbies and interests, places they want to visit in Japan, their purpose, and their native language. The device sends this information in JSON format to the server, which then creates a profile based on the received information and stores it in a database.

[2307] Spot suggestions upon arrival

[2308] Acquiring GPS location information

[2309] When a user arrives at their travel destination and launches the app, the GPS function on the device automatically activates, obtaining the current latitude and longitude data and sending that information to the server.

[2310] Search and suggest recommended spots

[2311] The server compares the received GPS data with the user's profile information. It uses Elasticsearch to quickly search the data. It generates a list of tourist attractions and shops near the current location, adding detailed information in the user's native language. It then sends this information to the user's device, which then displays it.

[2312] As a concrete example, when a user arrives in Asakusa, Tokyo, the device sends GPS information to the server, which then uses that information to create a list of Sensoji Temple and recommended restaurants nearby, displaying it in the user's native language.

[2313] Detailed information provided upon arrival at the spot

[2314] Spot arrival detection

[2315] When the user arrives at the suggested spot, the device will again check its location using GPS and notify the server of this location information.

[2316] Viewing detailed information

[2317] The server searches for detailed information about tourist attractions at that location based on the received location information. The server obtains the detailed information using a specific API (for example, Wikipedia API). The server translates the obtained information into the user's native language and sends it to the device. The device then displays the information to the user.

[2318] For example, when a user arrives at Sensoji Temple, the device notifies the user of the location, and the server displays the detailed history and highlights of the temple in the user's native language.

[2319] Dining and shopping support

[2320] Search for restaurants and shopping spots

[2321] The user enters search criteria for desired dining or shopping within the app, and the device sends the entered criteria (type of cuisine, price range, distance, etc.) to the server.

[2322] Providing search results

[2323] The server searches for suitable restaurants and shopping spots based on the received criteria. The search uses a specific database or API (for example, Google Places API). The search results are added with detailed information in the user's native language and sent to the device. The device then displays the received information to the user.

[2324] Menu ordering support

[2325] When the user arrives at the restaurant of their choice, the device locates them and activates the ordering support function. The server provides the restaurant's menu information in the user's native language, which the device displays. If necessary, the device also provides instructions on how to order in a specific way (e.g., by scanning a QR code).

[2326] Prepaid router set provided

[2327] Purchase and Setup

[2328] Users purchase the app and prepaid router online before traveling. The purchase process is completed through a web portal. Upon arrival in Japan, users receive the prepaid router and follow a simple setup procedure. The app includes a setup guide, which makes setup easy.

[2329] Advertising revenue initiatives

[2330] Displaying ads

[2331] The server selects advertisements related to tourist spots and store information recommended to the user. Advertisements are selected using Google AdSense or the RTB (Real-Time Bidding) platform. Advertisement data is sent to the device, which then displays the advertisements along with tourist spot information.

[2332] Ad click measurement and revenue generation

[2333] When a user clicks on an ad, the device sends the click information to the server, which aggregates the click data and generates revenue, which is monitored in real time by a server-side analytics tool (e.g., Google Analytics).

[2334] Prompt Sentence Examples

[2335] Example prompts to be input to the generative AI model:

[2336] The user arrives at their travel destination and launches the app. GPS information is acquired and their current coordinates are sent to the server. Based on the user's profile information and current location, create a list of recommended tourist spots. The list should also include detailed information about each spot and be provided in the user's native language.

[2337] The above is an embodiment of the present invention. The system provides users with personalized tourist information and detailed local guidance, and is sustainable through advertising revenue.

[2338] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2339] Step 1: User registration and initial setup

[2340] Input: The user enters their name, email address, and password.

[2341] How it works: A user first downloads and installs the application, then enters their name, email address, and password on the account creation screen and clicks the Register button.

[2342] Data processing: The device sends this information to the server using an HTTP POST request, which validates the information and stores it in a MySQL database if there are no errors.

[2343] Output: The user's account information is saved on the server and registration is complete.

[2344] Step 2: Profile Settings

[2345] Input: The user enters detailed information such as hobbies and interests, places they would like to visit in Japan, their purpose, and their native language.

[2346] How it works: The user enters these details in the app and hits submit.

[2347] Data processing: The device sends this information in JSON format to the server, which then creates a profile based on the received information and stores it in a database.

[2348] Output: The user's profile information is saved on the server and the profile is complete.

[2349] Step 3: Get GPS location

[2350] Input: The user arrives at their travel destination and launches the app.

[2351] How it works: The GPS function on your device will automatically start up and obtain your current latitude and longitude data.

[2352] Data processing: The device sends its current location information to the server.

[2353] Output: The current location is sent to the server.

[2354] Step 4: Search and suggest recommended spots

[2355] Input: GPS data received by the server and user profile information.

[2356] How it works: The server collates this information and lists tourist attractions and stores near the current location.

[2357] Data processing: The server uses Elasticsearch to quickly search the data and generate a list with additional details in the user's native language.

[2358] Output: A list of tourist attractions and stores is sent to the user's device.

[2359] Step 5: View Spot Suggestions

[2360] Input: A list of attractions and stores sent by the server.

[2361] Action: The terminal displays the received information to the user.

[2362] Output: The user is shown a list of attractions and shops, and can check their details.

[2363] Step 6: Detect spot arrivals

[2364] Input: User arrives at a suggested spot.

[2365] What it does: The device uses GPS to reconfirm the user's location.

[2366] Data processing: The device notifies the server of the newly acquired location information.

[2367] Output: The user's location is sent to the server and their arrival is confirmed.

[2368] Step 7: Provide more information

[2369] Input: User arrival information received by the server.

[2370] How it works: The server retrieves detailed information about tourist attractions at that location and translates it into your native language.

[2371] Data processing: The server uses a specific API to get detailed information and perform translation.

[2372] Output: The translated details are sent to the user's device.

[2373] Step 8: Viewing detailed information

[2374] Input: The details sent by the server.

[2375] Action: The terminal displays the received details to the user.

[2376] Output: The user is presented with detailed information about the attraction.

[2377] Step 9: Find restaurants and shopping spots

[2378] Input: The user enters search criteria for dining or shopping.

[2379] How it works: A user enters search criteria within the app and presses the search button.

[2380] Data processing: The device sends the search criteria to the server, which uses a specific database or API to search for information based on the criteria and adds detailed information in the user's native language.

[2381] Output: Information about related restaurants and shopping spots is sent to the user's device.

[2382] Step 10: Displaying search results

[2383] Input: Information about restaurants and shopping spots sent from the server.

[2384] Action: The terminal displays the received information to the user.

[2385] Output: Information about restaurants and shopping spots is displayed to the user.

[2386] Step 11: Menu ordering support

[2387] Input: The location of the restaurant selected by the user.

[2388] How it works: When a user arrives at a restaurant, the device verifies the user's location and activates the ordering support function.

[2389] Data processing: The server provides the menu information for the relevant store in the user's native language, which is then displayed on the device.

[2390] Output: The user is presented with ordering support information and instructions on how to place an order.

[2391] Step 12: Ad selection and display

[2392] Input: Tourist attractions and store information suggested by the server.

[2393] Operation: The server selects advertisements relevant to the user and sends the data to the device.

[2394] Data processing: The server selects ads using Google AdSense or RTB platforms.

[2395] Output: The ad is displayed to the user along with the tourist attraction information.

[2396] Step 13: Measure ad clicks and generate revenue

[2397] Input: User clicks on an ad.

[2398] How it works: The device sends ad click information to the server.

[2399] Data processing: The server aggregates click data and generates revenue using analytics tools such as Google Analytics.

[2400] Output: Ad revenue based on click data is generated on the server.

[2401] (Application example 1)

[2402] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2403] Conventional tourist information systems have been limited in the provision of personalized information based on users' hobbies, preferences, and location information, and have not been able to fully meet user needs. Furthermore, the range of information provided on tourist spots and stores is narrow, making it difficult to provide detailed information in real time. Furthermore, advertising revenue models have not adequately implemented personalized advertising display and monetization based on user behavior. The purpose of this invention is to solve these problems and realize an effective advertising revenue model while providing users with more abundant and personalized tourist information.

[2404] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2405] In this invention, the server includes a means for receiving a user's hobbies, preferences, and location information, a means for searching for and suggesting tourist spots and stores based on the received hobbies, preferences, and location information, a means for providing detailed information on the suggested tourist spots and stores in the user's native language, and a means for displaying the user's movement and tourist information within the virtual space. This allows the user to receive personalized tourist information in real time. The server also includes a means for generating personalized advertisements based on the user's behavior and interests, improving the effectiveness of advertisements for users and enabling effective monetization.

[2406] "User" refers to an individual who uses the system.

[2407] "Hobbies and tastes" refers to information related to a user's interests and preferences.

[2408] "Location information" refers to geographic data such as the latitude and longitude of a user's current location.

[2409] "Virtual space" refers to a virtual space generated on a computer system.

[2410] "Tourist spots" refer to places and attractions that tourists visit.

[2411] "Store" refers to a place for offering goods or services.

[2412] "Real-time tracking" means knowing a user's location almost instantly and monitoring their movements at every moment.

[2413] "Network Equipment" refers to equipment for connecting to the Internet or other communications networks.

[2414] "Advertising" refers to a message promoting a product or service.

[2415] "Personalized advertising" refers to advertising that is individually optimized based on a user's hobbies, preferences, and behavioral history.

[2416] "Revenue" refers to the profits earned from advertising clicks or views.

[2417] "Detailed information" refers to detailed information about tourist attractions and stores.

[2418] This invention is a system that provides users with personalized tourist information in real time when they visit tourist spots and earns revenue through advertising. This system is characterized by suggesting tourist spots and stores based on the user's hobbies, preferences, and location information.

[2419] System Program

[2420] The server starts when the user downloads the application and registers their profile information. The user enters details such as their name, email address, hobbies and interests, places they would like to visit in Japan, their purpose, and their native language. This information is sent to the server and stored in a database.

[2421] When a user arrives at a location and launches the application, the device uses its GPS to obtain the current latitude and longitude coordinates and sends that location information to the server. The server then matches the received location information with the user's profile to search for nearby tourist attractions and stores. The server then generates a list of search results and provides detailed information in the user's native language. Additionally, advertisements related to the suggested tourist attractions and stores are also displayed.

[2422] Specific examples

[2423] For example, if a user arrives at Asakusa in Tokyo, their device sends GPS information to the server, which then uses that information to create a list of Sensoji Temple and recommended restaurants nearby. This information is provided in the user's native language, enhancing their understanding of the tourist destination and improving convenience. Furthermore, personalized ads are generated based on the user's behavior and interests, allowing them to see highly relevant ads.

[2424] Hardware and software used

[2425] Device: Smartphone or tablet with GPS functionality

[2426] Server: Database and API server

[2427] software:

[2428] Software for obtaining GPS information (e.g. geopy)

[2429] Libraries for network communication (e.g., requests)

[2430] Database management system (e.g. MySQL)

[2431] Machine learning models for generating personalized ads (e.g., generative AI models)

[2432] Example prompts for generative AI models

[2433] "Write a prompt for an application that provides recommended tourist spots and restaurants for history-loving tourists traveling in Tokyo, Japan. The application will combine detailed historical information about the area to be visited with store information provided in the user's native language, and will also include a revenue model based on ad clicks."

[2434] This system allows users to receive personalized tourist information in real time, deepening their understanding of tourist destinations and further enriching their trips. In addition, monetization through effective advertising makes the system sustainable to maintain and operate.

[2435] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2436] Step 1:

[2437] The user downloads and installs the application. Next, the ...

Claims

1. A means for receiving user's hobbies, preferences and location information; A means for searching for and suggesting tourist spots and stores based on the received hobbies, preferences and location information; means for providing detailed information about the suggested tourist spots and stores in the user's native language; A system including:

2. means for acquiring location information of the user using a GPS; means for tracking the user's current location in real time based on the location information; a means for displaying detailed information when the user arrives at the tourist spot or store; The system of claim 1 further comprising:

3. a means for displaying advertisements related to the proposed tourist spots and stores; means for measuring impressions and clicks on said advertisements and generating revenue; The system of claim 1 further comprising:

Images