System

Abstract

A system is provided.SOLUTION: A system comprising: means for registering a user's hometown; means for recommending a niche landmark near the registered hometown based on data of another application; means for giving a point when the user visits the recommended place and performs an action; means for transferring the given point to another piece of electronic money; and means for giving the point to an organization having jurisdiction over the place.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] This invention relates to a system for resolving depopulation and economic stagnation in rural areas and promoting regional revitalization. Conventional regional revitalization measures have been limited to specific age groups and tastes, making it difficult to efficiently attract target users. Furthermore, local landmarks and facilities have not been able to effectively appeal to specific target groups, resulting in insufficient visitor growth and economic support. This invention aims to solve these problems and promote sustainable growth of the local economy. [Means for solving the problem]

[0005] This invention provides a system that allows users to register their hometown and recommends niche landmarks near that hometown based on data from other applications. The system awards points when users visit recommended locations and take actions (such as word-of-mouth, scanning QR codes, or tipping), and includes a means for transferring those points to other electronic money and a means for awarding points to organizations that have jurisdiction over the locations. This system makes recommendations that are in line with the user's interests, helping to revitalize the local economy. Specifically, the system includes the following means:

[0006] 1. A way for users to register their hometown.

[0007] 2. A means of recommending niche landmarks near registered hometowns based on data from other applications.

[0008] 3. A means of awarding points to users by visiting recommended locations and taking action.

[0009] 4. A means for transferring awarded points to other electronic money and a means for awarding points to an organization that has jurisdiction over that location.

[0010] 5. A means of recording user actions and sending them to a server.

[0011] 6. Means of collecting and analyzing user interest data from other applications.

[0012] By combining these methods, it is possible to widely and effectively promote the appeal of a region and promote regional revitalization.

[0013] "User" refers to an individual or organization that uses this system, who registers their hometown in the system and receives landmark recommendations.

[0014] "Area of ​​origin" refers to the area where a user registers their place of residence or where they have lived in the past, and is information registered at the city, ward, town, or village level.

[0015] "Niche landmarks" refer to places or facilities that are unique to their local area but are not widely known to the general public, such as tourist attractions, commercial facilities, and photo spots.

[0016] "Application data" refers to information collected from other software and services the user uses, including email, calendar, social media, and other data.

[0017] "Recommendation" refers to selecting and recommending specific landmarks based on the user's interests and preferences.

[0018] "Action" refers to the actions or activities that users actually perform at recommended landmarks, including posting reviews, scanning QR codes, and donating.

[0019] "Points" refer to virtual units of value awarded for user actions, which can later be exchanged for other electronic money.

[0020] "Electronic money" is a means of payment in the form of virtually managed currency, and has value that can be exchanged for points.

[0021] "Governing Body" refers to the local government or related body that manages or operates the recommended landmark or facility.

[0022] "Server" refers to the computer system that manages the entire system and processes user data, recommendations, point allocation, etc.

[0023] "Interest Data" refers to information reflecting your interests and preferences, including data collected from other applications.

[0024] "Analysis" refers to the method of analyzing collected data to understand users' hobbies, preferences, and behavioral patterns. [Brief explanation of the drawings]

[0025] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0026] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0027] First, the terms used in the following description will be explained.

[0028] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0029] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0030] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0031] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0032] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0033] [First embodiment]

[0034] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0035] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0036] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0037] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0038] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0039] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0040] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0041] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0042] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0043] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0044] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0045] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0046] This invention is a system in which a user registers their hometown, recommends niche landmarks in that area based on other application data, and awards points when the user visits them. A specific embodiment of this system is described below.

[0047] 1. User registration and hometown setting

[0048] Terminal (user)

[0049] The user downloads, installs, and launches the app.

[0050] A user creates an account by entering an email address and password on the account registration screen.

[0051] After creating an account, a screen for setting the area of ​​origin will appear, and the user will select their area of ​​origin (city, town, or village level) from the drop-down menu and press the confirm button.

[0052] server

[0053] The registered hometown information is stored in a database and associated with user information.

[0054] 2. Collecting User Interest Data

[0055] Terminal (user)

[0056] In the settings screen, users allow access to other applications (email, calendar, social media, etc.).

[0057] The information about the allowed applications is sent to the server.

[0058] server

[0059] Collect and analyze user interest data from permitted applications to create a user interest profile.

[0060] 3. Local landmark recommendations

[0061] server

[0062] It runs an algorithm to select appropriate landmarks based on the user's interest data and hometown.

[0063] Recommendation information is sent to the user's device.

[0064] Terminal (user)

[0065] The received recommendation information is displayed to the user as a notification, and detailed information can be displayed by tapping on it.

[0066] 4. Recording landmark visits and actions

[0067] Terminal (user)

[0068] Users visit recommended landmarks and perform actions suggested within the app (such as writing a review, scanning a QR code, or donating).

[0069] Send the result of the action to the server.

[0070] server

[0071] The information of the received action is recorded in a database, and points to be awarded to the user are calculated based on the action.

[0072] 5. Points allocation and management

[0073] server

[0074] The calculated points are awarded to the user's account, and at the same time, points are awarded to the account of the organization that has jurisdiction over the location.

[0075] Terminal (user)

[0076] Display the new points balance as a notification to the user.

[0077] 6. Points Conversion and Redemption

[0078] Terminal (user)

[0079] The user opens the point conversion settings screen within the app, selects the number of points they want to convert and the conversion destination (e.g., PayPal), and submits the request.

[0080] server

[0081] It receives a user request and executes the process of converting points into the specified electronic money.

[0082] Notify the user of the conversion results.

[0083] Specific examples

[0084] For example, suppose a user is from City A and registers City A as their hometown. The server analyzes data such as the user's social media posts and calendar appointments to determine that the user likes to visit cafes.

[0085] 1. The server recommends a niche cafe called "Cafe B" in City A and notifies the user's device.

[0086] 2. The user visits "B Cafe" and scans the QR code presented inside the store.

[0087] 3. The server receives this action and awards 10 points to the user, and also awards 10 points to the City A Chamber of Commerce, which oversees Cafe B.

[0088] 4. When the user submits a request to convert 10 points into electronic money within the app, the server converts the points into PayPal and notifies the user.

[0089] In this way, a series of processes is realized in which local landmarks that match the user's interests are recommended and points are awarded for the action of visiting them.

[0090] The processing flow will be explained below.

[0091] User registration and hometown setting

[0092] Step 1:

[0093] The user downloads and installs the app.

[0094] Step 2:

[0095] The device launches the app and displays the account registration screen to the user.

[0096] Step 3:

[0097] The user enters an email address and password to create an account.

[0098] Step 4:

[0099] The device displays a screen for entering the region of origin.

[0100] Step 5:

[0101] The user selects their hometown from the drop-down menu and presses the confirm button.

[0102] Step 6:

[0103] The terminal transmits the input area information to the server.

[0104] Step 7:

[0105] The server stores the location information in a database and associates it with the user information.

[0106] User interest data collection

[0107] Step 1:

[0108] The device will ask for permission to access other applications on the settings screen.

[0109] Step 2:

[0110] The user selects the application for which they want to grant permission and gives their consent.

[0111] Step 3:

[0112] The server collects data related to the user's interests through the API of authorized applications.

[0113] Step 4:

[0114] The server analyzes the collected data and creates a profile of the user's interests.

[0115] Local landmark recommendations

[0116] Step 1:

[0117] The server selects appropriate landmarks based on the user's interest data and hometown.

[0118] Step 2:

[0119] The server generates recommendation information and sends it to the user's device.

[0120] Step 3:

[0121] The device notifies the user of recommended information.

[0122] Step 4:

[0123] The user taps the notification to view more information.

[0124] Landmark visits and action recording

[0125] Step 1:

[0126] The user visits the recommended landmark.

[0127] Step 2:

[0128] The device will suggest actions to take at the landmark (post a review, scan a QR code, or donate).

[0129] Step 3:

[0130] The user performs the suggested action (e.g., scans a QR code).

[0131] Step 4:

[0132] The device sends the result of the action to the server.

[0133] Step 5:

[0134] The server records the action information it receives in a database.

[0135] Points allocation and management

[0136] Step 1:

[0137] The server calculates the points to be awarded to the user based on the recorded actions.

[0138] Step 2:

[0139] The server also simultaneously calculates points for the organization that has jurisdiction over that location.

[0140] Step 3:

[0141] The server will then credit the calculated points to the user's account.

[0142] Step 4:

[0143] The server will also award points to the governing body's account.

[0144] Step 5:

[0145] The terminal will notify the user of the new points balance.

[0146] Points conversion and redemption

[0147] Step 1:

[0148] The user opens the points conversion settings screen within the app.

[0149] Step 2:

[0150] The user selects the number of points they wish to convert and the destination (e.g., PayPal) and submits the request.

[0151] Step 3:

[0152] The server receives the user's request and converts the points into the specified electronic money.

[0153] Step 4:

[0154] The server notifies the user of the conversion results.

[0155] In this way, a series of processing steps from recommending landmarks based on the user's interests to visiting, recording actions, and awarding and using points are specifically explained.

[0156] Example 1

[0157] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0158] Conventional regional information provision systems lack the functionality to recommend specific places based on the user's region of origin or to award points for individual actions that correspond to the user's interests, and the management of points and conversion into electronic money is cumbersome.Furthermore, points are not distributed to organizations that manage the region, making it difficult to contribute to regional development.

[0159] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0160] In this invention, the server includes means for a user to register his or her hometown, means for selecting specific places near the registered hometown based on information from other applications, means for analyzing data collected from other applications and creating a user interest profile, means for awarding points when the user visits recommended places and performs specific actions, means for converting the awarded points into other electronic money, and means for awarding points to an organization that manages the places. This allows users to easily find specific places based on their interests, earn points by visiting them, and easily convert them into electronic money, and it also becomes possible for points to be distributed automatically to local management organizations.

[0161] A "user" is an individual who uses the system to register their hometown, visit specific recommended locations, and take action.

[0162] "Area of ​​origin" refers to the area where the user was born and raised (at the city, town, or village level) that the user registers within the application.

[0163] "Specific locations" are landmarks or facilities near the user's hometown that are recommended by the system.

[0164] "Information from other applications" refers to data collected from external applications such as email, calendars, and social media.

[0165] An "interest profile" is data that describes a user's interests and preferences, created by analyzing data collected from other applications.

[0166] "Recommendation" refers to the system suggesting specific locations based on a user's interest profile and hometown.

[0167] An "action" is a specific activity a user performs at a recommended location (such as posting a review, scanning a QR code, or donating).

[0168] "Points" are a form of reward given by the system when a user performs an action.

[0169] "Electronic money" refers to online payment methods (e.g., PayPal) that can be used to convert points awarded within the system.

[0170] "Organization" refers to the organization or local group that manages or operates the specific recommended location.

[0171] This invention is a system that allows users to register their hometowns, recommends specific places in those areas based on data collected from other applications, and awards points when the users visit those places. A specific embodiment of this system is described below.

[0172] User registration and hometown setting

[0173] Terminal (user)

[0174] A user downloads and installs the application on their mobile device, then launches the application after installation.

[0175] Within the application, the user accesses the account registration screen and enters the required information (email address, password) to create an account.

[0176] After creating an account, users are taken to the hometown setting screen, where they select their hometown from the drop-down menu provided and press the confirm button.

[0177] server

[0178] The information about the place of origin entered by the user is received and stored in a database, which is then associated with the user information.

[0179] User interest data collection

[0180] Terminal (user)

[0181] In the settings screen, users can grant permission to the option to allow access to other applications (e.g., email, calendar, social networking sites).

[0182] It collects the necessary information from authorized applications and sends the data to the server.

[0183] server

[0184] It receives and analyzes data from authorized applications to create a profile of the user's interests, which is then stored in a database.

[0185] Recommend specific places in the area

[0186] server

[0187] It runs an algorithm that selects the appropriate specific location based on the user's interest data and hometown information.

[0188] Information about the selected specific location is sent to the user's device.

[0189] Notification and display of recommended information

[0190] Terminal (user)

[0191] Recommendations are displayed as notifications on the user's device, and when the user taps the notification, detailed information is displayed.

[0192] Recording specific location visits and actions

[0193] Terminal (user)

[0194] The user visits a specific recommended location and performs an action provided within the application (e.g., leaving a review or scanning a QR code).

[0195] Send the results of the action to the server.

[0196] server

[0197] The received action information is recorded in a database and points are awarded to the user based on the action taken, as well as to the organization that manages the location.

[0198] Points allocation and management

[0199] server

[0200] The calculated points are credited to the user's account and the user is notified of the new points balance.

[0201] Terminal (user)

[0202] You will receive a notification to check your new points balance.

[0203] Points conversion and redemption

[0204] Terminal (user)

[0205] Open the point conversion settings screen within the application, select the number of points the user wants to convert and the conversion destination (e.g., PayPal), and submit the request.

[0206] server

[0207] Receives a user's request and converts points into the specified electronic money.

[0208] Notify the user of the conversion results.

[0209] Specific examples

[0210] For example, suppose a user registers "City A" as their hometown. The server analyzes the user's social media posts and calendar entries to determine that the user "likes to visit cafes." The server recommends "Cafe B in City A" and sends a notification to the user's device. The user visits "Cafe B" and scans a QR code inside the store. As a result, the user is awarded 10 points, and 10 points are also awarded to the "local organization in City A." The user then sends a request within the app to convert the 10 points into electronic money (e.g., PayPal), and the server immediately processes the conversion and notifies the user of the result.

[0211] Prompt Sentence Examples

[0212] "Please set City A as your hometown."

[0213] "Analyze user interests through social media posts and calendar events."

[0214] "Please recommend suitable cafes for users who like to go cafe-hopping in City A."

[0215] "Please calculate and award points based on users' visits to Cafe B."

[0216] "Convert your points into PayPal"

[0217] The above is an embodiment of the present invention.

[0218] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0219] Step 1: Download and install the app

[0220] Terminal (user)

[0221] A user downloads an application from an app store, installs it, and then launches it.

[0222] Input: User's device, app store

[0223] Output: Installed applications

[0224] Specifically, an application icon is generated on the device.

[0225] Step 2: Register an account

[0226] Terminal (user)

[0227] On the account registration screen, enter your email address and password to create an account.

[0228] Input: User's email address, password

[0229] Output: Account information

[0230] Specifically, the user's account data is sent to the server.

[0231] server

[0232] The received account information is stored in the database.

[0233] Input: User account information

[0234] Output: Account data stored in the database

[0235] Step 3: Set your hometown

[0236] Terminal (user)

[0237] On the hometown setting screen, select your hometown from the drop-down menu and press the Confirm button.

[0238] Input: User's chosen hometown

[0239] Output: Selected hometown information

[0240] As a specific operation, the selected hometown information is sent to the server.

[0241] server

[0242] The received hometown information is stored in a database and associated with the user information.

[0243] Input: User's hometown information

[0244] Output: User information and associated hometown data

[0245] Step 4: Permissions for other applications

[0246] Terminal (user)

[0247] On the settings screen, allow access to other applications (email, calendar, SNS, etc.).

[0248] Input: Access permission information for other applications

[0249] Output: Access permission information

[0250] As a specific operation, the access permission information is sent to the server.

[0251] Step 5: Collect and analyze interest data

[0252] server

[0253] Collect and analyze data from permitted applications to create a profile of your interests.

[0254] Input: Data collected from other applications

[0255] Output: User interest profile

[0256] Specifically, the collected data is analyzed algorithmically to generate an interest profile.

[0257] Step 6: Recommend specific locations

[0258] server

[0259] Based on the user's interest data and hometown information, appropriate specific locations are selected and recommendation information is sent to the user's device.

[0260] Input: User interest profile, hometown information

[0261] Output: Recommendation information

[0262] Specifically, a recommendation algorithm is executed, and information about recommended locations is sent to the terminal.

[0263] Step 7: Notification and display of recommended information

[0264] Terminal (user)

[0265] The received recommendation information is displayed as a notification, and when the user taps the notification, detailed information will be displayed.

[0266] Input: Recommendation information

[0267] Output: Notification, display of detailed information

[0268] Specifically, a notification will appear on the device and you can tap to open more information.

[0269] Step 8: Visit specific locations and take action

[0270] Terminal (user)

[0271] The user visits a specific recommended location and performs an action (such as writing a review or scanning a QR code).

[0272] Input: Action execution information

[0273] Output: Action result

[0274] Specifically, information about the actions performed by the user is sent to the server.

[0275] Step 9: Recording Action Results and Calculating Points

[0276] server

[0277] The received action results are recorded in a database, and points are calculated based on the action. Points are also awarded to the management organization.

[0278] Input: Action result

[0279] Output: Point calculation results, point allocation information

[0280] Specifically, points are awarded to users and management organizations based on the action results recorded in the database.

[0281] Step 10: Points balance notification

[0282] server

[0283] Notify the user of their new points balance.

[0284] Input: Point allocation information

[0285] Output: Point balance notification

[0286] Specifically, the new point balance after points are awarded is notified to the terminal.

[0287] Step 11: Request to convert points

[0288] Terminal (user)

[0289] Open the point conversion settings screen within the app, select the number of points you want to convert and the conversion destination (e.g. PayPal), and submit your request.

[0290] Input: Conversion request information, number of points, conversion destination

[0291] Output: Transformation request

[0292] As a specific operation, conversion request information is sent to the server.

[0293] Step 12: Point conversion processing and notification

[0294] server

[0295] The system receives a user's request, converts the points into the specified electronic money, and notifies the user of the conversion result.

[0296] Input: Conversion request information

[0297] Output: Conversion results, notification

[0298] Specifically, points are converted into electronic money, and the result is notified to the terminal.

[0299] (Application example 1)

[0300] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0301] Conventional landmark recommendation systems require users to manually select and navigate to destinations, making it difficult to provide efficient visit plans, especially when using autonomous vehicles. Effective personalized landmark recommendations based on hometown and interest data, as well as smooth visits using autonomous vehicles, are also desirable. Furthermore, the awarding of points through actions at visited destinations requires manual operation and is time-consuming. There is also a need for a system that simplifies the transfer of points to electronic money and the awarding of points to relevant organizations.

[0302] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0303] In this invention, the server includes: means for a user to register a hometown; means for recommending niche landmarks near the registered hometown based on data from other applications; means for awarding points when the user visits the recommended locations and performs an action; means for transferring the awarded points to other electronic money and means for awarding points to an organization having jurisdiction over the locations; means for a user to automatically visit the recommended landmarks based on the hometown and interest data in an autonomous vehicle; and means for awarding points when the user performs a specified action at the visited location. This enables users to take efficient and personalized landmark tours using autonomous vehicles, and points are automatically awarded based on actions taken during visits, allowing for smooth transfer to electronic money and awarding of points to the organization having jurisdiction.

[0304] An "autonomous vehicle" is a vehicle that operates using a self-control system without human intervention.

[0305] "Hometown" refers to the area registered by the user as their place of residence or birthplace.

[0306] A "niche landmark" is a place that is not widely known but is worth visiting depending on your particular interests or tastes.

[0307] "Recommending" means suggesting specific information or places based on a user's interests and preferences.

[0308] An "action" is a specific action a user takes at a recommended location, such as scanning a QR code or taking a photo.

[0309] "Points" are virtual currency or rewards that users can earn by performing certain actions.

[0310] "Electronic money" means currency stored and used in digital form.

[0311] "Governing Body" means an organization or body that governs or operates a particular area or service.

[0312] “Interest Data” means information that describes your preferences and interests and is collected from other applications.

[0313] This invention is a system that provides users with personalized landmark visits using autonomous vehicles. This system recommends niche landmarks within the autonomous vehicle based on the user's hometown and interest data, and awards points based on actions taken at the visited locations. The points can also be converted into other electronic money, and points can also be awarded to the relevant organization. Specific embodiments of this invention are described below.

[0314] 1. User registration and hometown setting

[0315] Terminal (user)

[0316] The user downloads, installs, and launches the application.

[0317] The user creates an account by entering an email address and password on the account registration screen.

[0318] After creating your account, on the hometown setting screen that appears, select your hometown from the drop-down menu and press the Confirm button.

[0319] server

[0320] The registered hometown information is stored in a database and associated with user information.

[0321] 2. Collecting User Interest Data

[0322] Terminal (user)

[0323] On the settings screen, allow access to other applications (email, calendar, SNS, etc.).

[0324] The information about the allowed applications is sent to the server.

[0325] server

[0326] Collect and analyze your interest data from permitted applications to create interest profiles.

[0327] 3. Local landmark recommendations

[0328] server

[0329] It runs an algorithm to select appropriate landmarks based on the user's interest data and hometown.

[0330] Recommendation information is sent to the user's device.

[0331] Terminal (user)

[0332] The received recommendation information is displayed to the user as a notification, and detailed information can be displayed by tapping on it.

[0333] 4. Autonomous visit and action recording

[0334] Autonomous vehicles

[0335] When a user gets into an autonomous vehicle, a visit plan to pre-recommended landmarks is automatically set up.

[0336] When the vehicle arrives at a designated landmark, the user will receive a notification.

[0337] Terminal (user)

[0338] The user performs the action suggested at the destination (scanning a QR code or taking a photo).

[0339] Send the result of the action to the server.

[0340] server

[0341] The information of the received actions is recorded in a database and points are awarded to the user based on the actions.

[0342] 5. Point Management and Use

[0343] server

[0344] The calculated points are awarded to the user's account, and at the same time, points are awarded to the account of the organization that has jurisdiction over the location.

[0345] A request for point conversion is received and processing for converting the points into designated electronic money is executed.

[0346] Notify the user of the conversion results.

[0347] Terminal (user)

[0348] Show the point balance to the user as a notification and send a request on the point conversion setting screen.

[0349] Specific examples

[0350] For example, suppose a user is from City A and enjoys visiting cafes. When getting into an autonomous vehicle, the system will recommend niche cafes in City A and automatically create a visit plan based on the user's interests. When the user arrives at a destination, they will receive a notification and be awarded points for taking actions such as scanning a QR code.

[0351] Prompt Sentence Examples

[0352] The user is from "City A" and is interested in "cafes" and "museums." Please recommend landmarks that can be visited from the user's current location.

[0353] In this way, the present invention provides an efficient and personalized landmark tour using an autonomous vehicle, and enables automatic points acquisition and smooth conversion to electronic money, which can contribute to promotions tailored to users' interests and regional revitalization.

[0354] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0355] Step 1:

[0356] User registration and hometown setting

[0357] Specific behavior:

[0358] The device (user) downloads, installs, and launches the application. The user creates an account by entering an email address and password on the account registration screen. After creating the account, the user selects their hometown from the drop-down menu on the hometown setting screen and presses the confirm button.

[0359] input:

[0360] User email address, password, and region of origin

[0361] Data processing / data calculation:

[0362] The server stores the entered user information in a database and associates it with the user information.

[0363] output:

[0364] User account registration completion notification

[0365] Step 2:

[0366] User interest data collection

[0367] Specific behavior:

[0368] The device (user) allows access to other applications (email, calendar, SNS, etc.) on the settings screen. Information about the allowed applications is sent to the server.

[0369] input:

[0370] Allowed Applications Data

[0371] Data processing / data calculation:

[0372] The server collects user interest data from authorized applications and uses machine learning algorithms to create an interest profile.

[0373] output:

[0374] User interest profiles

[0375] Step 3:

[0376] Local landmark recommendations

[0377] Specific behavior:

[0378] The server runs an algorithm to select appropriate landmarks based on the user's interest data and hometown, and sends the recommended information to the user's device.

[0379] input:

[0380] User interest profile, hometown

[0381] Data processing / data calculation:

[0382] The server uses a generative AI model to identify niche landmarks that match the user's interests.

[0383] output:

[0384] Recommended landmark information

[0385] Step 4:

[0386] Autonomous visit and action recording

[0387] Specific behavior:

[0388] The autonomous vehicle automatically sets up a visit plan to recommended landmarks in advance. The user gets into the vehicle and performs a specified action at the destination (scanning a QR code or taking a photo). The results of the action are sent from the device to the server.

[0389] input:

[0390] Recommended landmark information, user visit actions

[0391] Data processing / data calculation:

[0392] The server records the user's visit actions in a database, analyzes the content of the actions, and calculates points.

[0393] output:

[0394] Record of visit actions and awarded points

[0395] Step 5:

[0396] Points management and usage

[0397] Specific behavior:

[0398] The server will then add the calculated points to the user's account and simultaneously add points to the account of the organization that has jurisdiction over the location. Upon receiving a point conversion request, the server will execute the conversion process into the specified electronic money and notify the user of the result.

[0399] input:

[0400] User's point conversion request

[0401] Data processing / data calculation:

[0402] The server converts the points into electronic money and records the conversion results in a database.

[0403] output:

[0404] Notification of converted electronic money and point balance

[0405] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0406] This invention is a system that allows users to register their hometown, recommends niche landmarks in that area based on other application data, and further analyzes the user's emotional data to adjust the recommendations. A specific embodiment of this system is described below.

[0407] 1. User registration and hometown setting

[0408] Terminal (user)

[0409] The user downloads, installs, and launches the app.

[0410] A user creates an account by entering an email address and password on the account registration screen.

[0411] After creating an account, a screen for setting the area of ​​origin will appear, and the user will select their area of ​​origin (city, town, or village level) from the drop-down menu and press the confirm button.

[0412] server

[0413] The registered hometown information is stored in a database and associated with user information.

[0414] 2. Collecting User Interest Data

[0415] Terminal (user)

[0416] In the settings screen, users allow access to other applications (email, calendar, social media, etc.).

[0417] The information about the allowed applications is sent to the server.

[0418] server

[0419] Collect and analyze user interest data from permitted applications to create a user interest profile.

[0420] 3. Local landmark recommendations

[0421] server

[0422] It runs an algorithm to select appropriate landmarks based on the user's interest data and hometown.

[0423] Using an emotion engine, recommendations are adjusted based on past recommendations and emotional data from the visit.

[0424] Recommendation information is sent to the user's device.

[0425] Terminal (user)

[0426] The received recommendation information is displayed to the user as a notification, and detailed information can be displayed by tapping on it.

[0427] 4. Recording landmark visits and actions

[0428] Terminal (user)

[0429] Users visit recommended landmarks and perform actions suggested within the app (such as writing a review, scanning a QR code, or donating).

[0430] The emotion engine recognizes emotions from the user's facial expressions and voice and records emotional data during the visit.

[0431] The action result and emotion data are sent to the server.

[0432] server

[0433] The received action and emotion data is recorded in a database, and points are calculated to be awarded to the user based on the action.

[0434] 5. Points allocation and management

[0435] server

[0436] The calculated points are awarded to the user's account, and at the same time, points are awarded to the account of the organization that has jurisdiction over the location.

[0437] Terminal (user)

[0438] Display the new points balance as a notification to the user.

[0439] 6. Points Conversion and Redemption

[0440] Terminal (user)

[0441] The user opens the point conversion settings screen within the app, selects the number of points they want to convert and the conversion destination (e.g., PayPal), and submits the request.

[0442] server

[0443] It receives a user request and executes the process of converting points into the specified electronic money.

[0444] Notify the user of the conversion results.

[0445] Specific examples

[0446] For example, suppose a user is from City A and registers City A as their hometown. The server analyzes the user's social media posts, calendar appointments, and even emotional data from past visits to determine that the user likes to visit cafes.

[0447] 1. The server recommends a niche cafe called "Cafe B" in City A and notifies the user's device.

[0448] 2. The user visits "B Cafe" and scans the QR code presented inside the store.

[0449] 3. The emotion engine recognizes emotions from the user's facial expressions when scanned and records emotional data during the visit.

[0450] 4. The server receives this action and emotion data, awards 10 points to the user, and simultaneously awards 10 points to the City A Chamber of Commerce, which oversees Cafe B.

[0451] 5. When the user submits a request to convert 10 points into electronic money within the app, the server converts the points into PayPal and notifies the user.

[0452] In this way, a series of processing steps from recommending landmarks based on the user's interests to visiting, recording actions, recognizing and using emotional data, and awarding and using points are specifically explained.

[0453] The processing flow will be explained below.

[0454] User registration and hometown setting

[0455] Step 1:

[0456] The user downloads and installs the app.

[0457] Step 2:

[0458] The device launches the app and displays the account registration screen to the user.

[0459] Step 3:

[0460] The user enters an email address and password to create an account.

[0461] Step 4:

[0462] The device displays a screen for entering the region of origin.

[0463] Step 5:

[0464] The user selects their hometown from the drop-down menu and presses the confirm button.

[0465] Step 6:

[0466] The terminal transmits the input area information to the server.

[0467] Step 7:

[0468] The server stores the location information in a database and associates it with the user information.

[0469] User interest data collection

[0470] Step 1:

[0471] The device will ask for permission to access other applications on the settings screen.

[0472] Step 2:

[0473] The user selects the application for which they want to grant permission and gives their consent.

[0474] Step 3:

[0475] The server collects data related to the user's interests through the API of authorized applications.

[0476] Step 4:

[0477] The server analyzes the collected data and creates a profile of the user's interests.

[0478] Local landmark recommendations

[0479] Step 1:

[0480] The server selects appropriate landmarks based on the user's interest data and hometown.

[0481] Step 2:

[0482] The server uses an emotion engine to adjust the recommendation content, taking into account past recommendations and emotional data from the visit.

[0483] Step 3:

[0484] The server generates recommendation information and sends it to the user's device.

[0485] Step 4:

[0486] The device notifies the user of recommended information.

[0487] Step 5:

[0488] The user taps the notification to view more information.

[0489] Landmark visits and action recording

[0490] Step 1:

[0491] The user visits the recommended landmark.

[0492] Step 2:

[0493] The device displays the actions offered at the landmark (such as writing a review, scanning a QR code, or donating).

[0494] Step 3:

[0495] The user performs the suggested action (e.g., scans a QR code).

[0496] Step 4:

[0497] The emotion engine recognizes emotions from the user's facial expressions and voice.

[0498] Step 5:

[0499] The device sends the action results and emotion data to the server.

[0500] Step 6:

[0501] The server records the received actions and emotion data in a database.

[0502] Points allocation and management

[0503] Step 1:

[0504] The server calculates the points to be awarded to the user based on the recorded actions.

[0505] Step 2:

[0506] The server also simultaneously calculates points for the organization that has jurisdiction over that location.

[0507] Step 3:

[0508] The server will then credit the calculated points to the user's account.

[0509] Step 4:

[0510] The server will also award points to the governing body's account.

[0511] Step 5:

[0512] The terminal will notify the user of the new points balance.

[0513] Points conversion and redemption

[0514] Step 1:

[0515] The user opens the points conversion settings screen within the app.

[0516] Step 2:

[0517] The user selects the number of points they wish to convert and the destination (e.g., PayPal) and submits the request.

[0518] Step 3:

[0519] The server receives the user's request and converts the points into the specified electronic money.

[0520] Step 4:

[0521] The server notifies the user of the conversion results.

[0522] In this way, a series of processing steps from recommendations that take into account not only the user's interests but also their emotional data to the awarding and use of points is specifically explained.

[0523] Example 2

[0524] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0525] Modern users want to be recommended activities based on their interests and hometowns, but existing systems have difficulty combining these factors appropriately. They also lack mechanisms for providing appropriate rewards for recommended activities and for utilizing emotional data based on those activities. To address these needs, a system is needed that can comprehensively manage data based on users' interests, hometowns, and activities and make recommendations.

[0526] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for a user to register their hometown, a means for recommending niche tourist spots near the registered hometown based on data from other software, a means for collecting and analyzing user interest data to create an interest profile, a means for adjusting the recommendation content taking into account past recommendations and emotional data at the time of visit, a means for awarding points for visiting recommended tourist spots and taking actions, a means for converting the awarded points into other electronic money, and a means for awarding points to the organization that has jurisdiction over the location. This allows users to receive recommendations of tourist spots appropriate to their interests and emotions, and to receive rewards based on their actions during the visit.

[0527] "User" means an individual who uses the System.

[0528] "Hometown" refers to the geographic location that a user registers as their hometown.

[0529] A "niche tourist destination" is a place that is not well known as a tourist destination, but is attractive to users with specific interests or hobbies.

[0530] "Software" means computer programs and applications used to collect and analyze user interest and behavior data.

[0531] "Interest data" is data that indicates a user's interests, including social media posts, calendar events, and email content.

[0532] An "interest profile" is data that reflects a user's interests and hobbies, analyzed through the analysis of collected interest data.

[0533] A "recommendation algorithm" is a computational method for recommending appropriate tourist spots and activities based on a user's region of origin and interest profile.

[0534] "Emotional data" refers to data that indicates the emotions a user shows during a specific action or visit, and can also be recognized from facial expressions and voice.

[0535] "Action" refers to the specific actions that users take when visiting a recommended tourist spot (e.g., posting a review, scanning a QR code, giving a tip, etc.).

[0536] "Points" are numerical rewards given to users as a result of their actions.

[0537] "Electronic money" refers to a digital form of currency that is used to convert points.

[0538] "Organization" means an organization that manages and operates a particular tourist destination.

[0539] This invention is a system that allows users to register their hometown, recommends niche tourist spots in that area based on data from other software, and further analyzes the user's emotional data to adjust the recommendations. Specific implementation methods using each hardware and software are described below.

[0540] 1. User registration and hometown setting

[0541] Terminal (user)

[0542] Users download and install the application onto their smartphone, PC, or other device. After launching the app, they first create an account by entering their email address and password on the account registration screen. After creating the account, they are automatically taken to the hometown setting screen. From there, they select their hometown (at the city, town, or village level) from the drop-down menu and press the "Confirm" button.

[0543] server

[0544] The server stores the email address and hashed password entered by the user in a database, as well as the region of origin selected by the user, and associates this information with the user's information.

[0545] 2. Collecting User Interest Data

[0546] Terminal (user)

[0547] Users select options in the settings screen to allow access to other software (email, calendar, social networking sites, etc.), which then sends data from each piece of software to the server.

[0548] server

[0549] The server analyzes the data obtained from the authorized software and creates an interest profile that reflects the user's interests, using techniques such as natural language processing and machine learning algorithms.

[0550] 3. Local landmark recommendations

[0551] server

[0552] The server runs a recommendation algorithm based on the user's interest profile and hometown, selects appropriate tourist destinations, and uses an emotion engine to adjust the recommendations based on past recommendations and emotional data from the visit. The adjusted recommendations are then sent to the user's device.

[0553] Terminal (user)

[0554] The user's device will display the received recommendation information as a notification, and the user can tap the notification to view more information.

[0555] 4. Recording landmark visits and actions

[0556] Terminal (user)

[0557] Users visit recommended tourist spots and follow the in-app guide to perform the actions suggested (e.g., posting reviews, scanning QR codes, donating money, etc.). The emotion engine recognizes emotions from the user's facial expressions and voice, and records emotional data from the visit. The action results and emotional data are sent to the server.

[0558] server

[0559] The server records the received action and emotion data in a database and calculates points to be awarded to the user based on the action.

[0560] 5. Points allocation and management

[0561] server

[0562] The server assigns the calculated points to the user's account and also assigns points to the account of the organization that has jurisdiction over the location.

[0563] Terminal (user)

[0564] The terminal will display the new points balance to the user as a notification.

[0565] 6. Points Conversion and Redemption

[0566] Terminal (user)

[0567] Users open the point conversion settings screen within the app, select the number of points they want to convert and the conversion destination (e.g., PayPal), and submit their request.

[0568] server

[0569] The server receives the user's request, converts the points into the specified electronic money, and notifies the user of the conversion result.

[0570] Specific examples

[0571] For example, if a user is "from City A" and registers "City A" as their hometown, the server will analyze social media posts, calendar appointments, and even emotional data from past visits to determine that the user likes to visit cafes.

[0572] The server recommends a niche cafe in City A, "Cafe B," and notifies the user's device. The user visits "Cafe B" and scans the QR code presented inside the store. The emotion engine recognizes the emotion from the user's facial expression at the time and records the emotion data from the visit. The server receives this action and emotion data, awards 10 points to the user, and simultaneously awards 10 points to the organization that oversees "Cafe B." When the user sends a request within the app to convert the points into electronic money, the server converts the points into PayPal and notifies the user.

[0573] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0574] Step 1: User Registration

[0575] Terminal (user)

[0576] A user downloads and installs an application on their smartphone or computer. They launch the app, enter their email address and password on the account registration screen, and press the register button. The input information (email address, password) is sent. The output is the data sent to the server.

[0577] server

[0578] The server receives the entered email address and password, stores them in a database along with a hashed password for security, generates a registration completion message and sends it to the user's device, and outputs the user information stored in the database and a completion notification to the user.

[0579] Step 2: Set your hometown

[0580] Terminal (user)

[0581] After registering an account, the user selects their hometown (at the city / ward / town / village level) from the drop-down menu on the hometown setting screen and presses the confirm button. The input information (hometown) is sent. The output is the data sent to the server.

[0582] server

[0583] The server receives the user's hometown information and stores it in a database along with the user information. It then generates a setup completion message and sends it to the user's device. The output is the hometown information stored in the database and a completion notification to the user.

[0584] Step 3: App integration permission

[0585] Terminal (user)

[0586] The user sets access permissions for other software (email, calendar, SNS, etc.) on the settings screen. In response to the permission confirmation message, the user presses the "Allow" button. The input information (permission status) is sent. The output is the data sent to the server.

[0587] server

[0588] The server receives permission data from each software and collects user interest data. The output is the received data.

[0589] Step 4: Analyze interest data

[0590] server

[0591] The server analyzes the received interest data and creates an interest profile for the user using natural language processing and machine learning algorithms. The input is the collected data, and the output is the generated interest profile.

[0592] Step 5: Recommend tourist spots

[0593] server

[0594] The server runs a recommendation algorithm based on the user's interest profile and hometown information. It selects appropriate tourist destinations and then uses an emotion engine to adjust the recommendations based on past recommendations and emotional data from the visit. The input is the interest profile, hometown information, and emotional data, and the output is the adjusted recommendation information.

[0595] Terminal (user)

[0596] The user's device receives the recommendation information and displays it as a notification. When the user taps the notification, detailed information is displayed. The output is the displayed recommendation information.

[0597] Step 6: Visit landmarks and record actions

[0598] Terminal (user)

[0599] Users visit recommended tourist spots and follow the in-app guide to perform the actions suggested (such as posting a review, scanning a QR code, or donating). The emotion engine recognizes emotions from the user's facial expressions and voice, and records emotional data from the visit. This data is sent to the server. The input is the location visit, the actions performed, and the emotional data, and the output is the recorded data.

[0600] server

[0601] The server records the received actions and emotion data in a database and calculates the points to be awarded to the user based on the actions. The input is the submitted actions and emotion data, and the output is the calculated points.

[0602] Step 7: Points allocation and management

[0603] server

[0604] The server assigns the calculated points to the user's account and also assigns points to the account of the organization that has jurisdiction over the location. The input is the calculated points, and the output is the assigned points information.

[0605] Terminal (user)

[0606] The user's device displays the new points balance to the user as a notification. The output is the displayed points balance.

[0607] Step 8: Convert and use your points

[0608] Terminal (user)

[0609] The user opens the point conversion settings screen in the app, selects the number of points they want to convert and the conversion destination (e.g., PayPal), and submits a request. The input is the point conversion request, and the output is the data to be sent to the server.

[0610] server

[0611] The server receives the user's request, converts the points into the specified electronic money, and notifies the user of the conversion result. The input is the point conversion request, and the output is the converted electronic money and a notification message.

[0612] In this way, the entire process is explained concretely and in detail.

[0613] (Application example 2)

[0614] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0615] The problem that this invention aims to solve is to provide a system that allows users to efficiently obtain useful information related to their hometowns, while providing personalized recommendations based on the user's emotional data and interests, and furthermore, allowing these activities to contribute to the revitalization of the local economy and culture. Specifically, the problem is to recommend attractive local landmarks and brick-and-mortar stores based on the user's interests and emotions, award points based on actions taken when visiting those stores, and smoothly carry out the entire process of transferring these points to other electronic money.

[0616] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0617] In this invention, the server includes a means for a user to register their hometown, a means for recommending niche landmarks near the registered hometown based on data from other applications, a means for awarding points when the user visits a recommended place and performs an action, a means for transferring the awarded points to other electronic money and a means for awarding points to an organization that has jurisdiction over the place, and a means for analyzing the user's emotional data and adjusting the content of recommendations. This allows the server to efficiently recommend landmarks and brick-and-mortar stores that best suit the user's interests, thereby revitalizing local communities and improving the user experience.

[0618] "User" refers to a person who uses the system.

[0619] "Hometown" refers to the area where the user was born and raised, or the area to which they have a particular attachment.

[0620] A "niche landmark" refers to a tourist attraction or facility that is not well known to the general public but has particular value or appeal in a particular area.

[0621] "Data from other applications" refers to information obtained from other applications you use, such as social media posts or calendar entries.

[0622] "Recommend" refers to recommending a specific landmark or store to the user.

[0623] "Emotional data" refers to the emotional state analyzed from the user's facial expressions, voice, etc.

[0624] "Points" refer to units of virtual value that can be used in the future and are awarded to users when they perform certain actions.

[0625] "Electronic money" refers to digital currency and electronic bankbooks that can be used over the Internet.

[0626] "User Interest Data" means information about your interests and preferences, including, for example, data about your hobbies or favorite places.

[0627] "Server" refers to a computer system that receives information from users, analyzes it, and provides appropriate services.

[0628] The present invention relates to a system that allows a user to register their hometown, recommends niche landmarks in that area based on other application data, and further analyzes the user's emotional data to adjust the recommendation content. A specific embodiment of the present invention is described below.

[0629] 1. User registration and hometown setting

[0630] Terminal (user)

[0631] The user downloads and installs the application, then launches it. The user creates an account by entering an email address and password on the account registration screen. After creating the account, the hometown setting screen is displayed, and the user selects their hometown from the drop-down menu and presses the confirm button.

[0632] server

[0633] The server stores the registered hometown information in a database and associates it with user information.

[0634] 2. Collecting User Interest Data

[0635] Terminal (user)

[0636] The user allows access to other applications (email, calendar, social networking, etc.) in the settings screen.

[0637] server

[0638] It collects user interest data from authorized applications and analyzes it to create a user interest profile. It uses Python and Flask for analysis and a SQLite database.

[0639] 3. Local landmark recommendations

[0640] server

[0641] The server runs an algorithm to select appropriate landmarks based on the user's interest data and hometown. An emotion engine is used to adjust the recommendations, taking into account past recommendations and emotional data from the visit. It utilizes Python libraries and machine learning models.

[0642] Terminal (user)

[0643] The received recommendation information is displayed to the user as a notification, and detailed information can be displayed by tapping on it.

[0644] 4. Recording landmark visits and actions

[0645] Terminal (user)

[0646] The user visits a recommended landmark and performs an action suggested within the app (such as posting a review, scanning a QR code, or donating). The emotion engine recognizes the user's emotions from their facial expressions and voice, and records the emotional data from the visit. The action results and emotional data are then sent to the server.

[0647] server

[0648] The received action and emotion data is recorded in a database, and points are calculated to be awarded to the user based on the action.

[0649] 5. Points allocation and management

[0650] server

[0651] The calculated points are credited to the user's account and simultaneously credited to the account of the organization responsible for the location. A notification is generated to the user, displaying the new points balance.

[0652] 6. Points Conversion and Redemption

[0653] Terminal (user)

[0654] The user opens the point conversion settings screen within the app, selects the number of points they want to convert and the conversion destination, and submits the request.

[0655] server

[0656] Receives a user request, converts points into the specified electronic money, and notifies the user of the conversion result.

[0657] Specific examples

[0658] For example, consider a case where a user has registered a "certain city" as their "hometown." Suppose that analysis of social media posts and calendar events reveals that this user likes to visit cafes.

[0659] 1. Based on the user's interest data, the server recommends niche cafes in a certain city and notifies the user's device.

[0660] 2. The user visits the recommended cafe and scans the QR code displayed inside the store.

[0661] 3. The emotion engine recognizes "enjoyment" from the user's facial expression when scanned and records emotional data from the visit.

[0662] 4. The server receives this action and emotion data and awards 10 points to the user, as well as the organization that oversees the cafe.

[0663] 5. When the user sends a request to convert 10 points into electronic money within the app, the server converts the points into electronic money and notifies the user of the result.

[0664] Example prompts for generative AI models

[0665] The user has registered their hometown as "a certain city." Since the user likes to go cafe hopping, please recommend niche cafes within "a certain city." If the user submits emotion data as "fun," please award the user 10 points and display their point balance.

[0666] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0667] Step 1:

[0668] User registration and hometown setting

[0669] The device (user) downloads and installs the application, then launches it. The user creates an account by entering an email address and password. Next, a screen for setting the hometown appears, and the user selects their hometown from the drop-down menu and presses the confirm button.

[0670] Input: User's email address, password, hometown

[0671] Output: User information and hometown registered in the database

[0672] Specific behavior:

[0673] 1. Launching the application

[0674] 2. Enter your email address and password

[0675] 3. Select and confirm your hometown

[0676] Step 2:

[0677] User interest data collection

[0678] The device (user) allows access to other applications (e.g., email, calendar, SNS) on the settings screen. Based on that permission, the server collects and analyzes the user's interest data from other applications.

[0679] Input: User interest data (obtained from other applications)

[0680] Output: Interest profile

[0681] Specific behavior:

[0682] 1. Check permissions

[0683] 2. Data collection

[0684] 3. Creating an Interest Profile

[0685] Step 3:

[0686] Local landmark recommendations

[0687] The server runs an algorithm to select appropriate landmarks based on the user's interest data and hometown. It uses an emotion engine to adjust the recommendations based on past recommendations and emotional data from the visit. The server then sends the optimal recommendations to the user's device.

[0688] Input: User interest data, hometown, past emotional data

[0689] Output: Recommended landmark information

[0690] Specific behavior:

[0691] 1. Landmark selection based on interest data and hometown

[0692] 2. Optimizing recommendation content using an emotion engine

[0693] 3. Sending recommendation information

[0694] Step 4:

[0695] Landmark visits and action recording

[0696] The device (user) visits the recommended landmark and performs the action suggested in the app (e.g., scanning a QR code, posting a review). The emotion engine recognizes the user's emotions from their facial expressions and voice, records the emotional data during the visit, and sends it to the server along with the action results.

[0697] Input: Landmark information of visited destinations, user actions and emotion data

[0698] Output: Action results and emotion data sent to the server

[0699] Specific behavior:

[0700] 1. Landmark visit

[0701] 2. Scan QR codes and post reviews

[0702] 3. Analysis of facial expressions and voice data and recording of emotions

[0703] 4. Sending data to the server

[0704] Step 5:

[0705] Points allocation and management

[0706] The server calculates points based on the received action and emotion data. The points are awarded to the user's account and simultaneously to the account of the organization that oversees the landmark. The award result is then notified to the user's device.

[0707] Input: Action results and emotion data

[0708] Output: User and jurisdiction points balance

[0709] Specific behavior:

[0710] 1. Points Calculation

[0711] 2. Points Award

[0712] 3. Notification of point balance

[0713] Step 6:

[0714] Points conversion and redemption

[0715] The terminal (user) inputs the number of points they want to convert and the destination (electronic money) information on the point conversion setting screen and sends a request. The server receives the request, converts the points into the specified electronic money, and notifies the user of the conversion result.

[0716] Input: Number of points to convert and destination information

[0717] Output: Converted electronic money balance and notification

[0718] Specific behavior:

[0719] 1. Display the conversion settings screen

[0720] 2. Enter the number of points and conversion information

[0721] 3. Convert points into electronic money

[0722] 4. Notification of conversion results

[0723] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0724] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0725] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0726] [Second embodiment]

[0727] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0728] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0729] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0730] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0731] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0732] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0733] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0734] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0735] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0736] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0737] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0738] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0739] This invention is a system in which a user registers their hometown, recommends niche landmarks in that area based on other application data, and awards points when the user visits them. A specific embodiment of this system is described below.

[0740] 1. User registration and hometown setting

[0741] Terminal (user)

[0742] The user downloads, installs, and launches the app.

[0743] A user creates an account by entering an email address and password on the account registration screen.

[0744] After creating an account, a screen for setting the area of ​​origin will appear, and the user will select their area of ​​origin (city, town, or village level) from the drop-down menu and press the confirm button.

[0745] server

[0746] The registered hometown information is stored in a database and associated with user information.

[0747] 2. Collecting User Interest Data

[0748] Terminal (user)

[0749] In the settings screen, users allow access to other applications (email, calendar, social media, etc.).

[0750] The information about the allowed applications is sent to the server.

[0751] server

[0752] Collect and analyze user interest data from permitted applications to create a user interest profile.

[0753] 3. Local landmark recommendations

[0754] server

[0755] It runs an algorithm to select appropriate landmarks based on the user's interest data and hometown.

[0756] Recommendation information is sent to the user's device.

[0757] Terminal (user)

[0758] The received recommendation information is displayed to the user as a notification, and detailed information can be displayed by tapping on it.

[0759] 4. Recording landmark visits and actions

[0760] Terminal (user)

[0761] Users visit recommended landmarks and perform actions suggested within the app (such as writing a review, scanning a QR code, or donating).

[0762] Send the result of the action to the server.

[0763] server

[0764] The information of the received action is recorded in a database, and points to be awarded to the user are calculated based on the action.

[0765] 5. Points allocation and management

[0766] server

[0767] The calculated points are awarded to the user's account, and at the same time, points are awarded to the account of the organization that has jurisdiction over the location.

[0768] Terminal (user)

[0769] Display the new points balance as a notification to the user.

[0770] 6. Points Conversion and Redemption

[0771] Terminal (user)

[0772] The user opens the point conversion settings screen within the app, selects the number of points they want to convert and the conversion destination (e.g., PayPal), and submits the request.

[0773] server

[0774] It receives a user request and executes the process of converting points into the specified electronic money.

[0775] Notify the user of the conversion results.

[0776] Specific examples

[0777] For example, suppose a user is from City A and registers City A as their hometown. The server analyzes data such as the user's social media posts and calendar appointments to determine that the user likes to visit cafes.

[0778] 1. The server recommends a niche cafe called "Cafe B" in City A and notifies the user's device.

[0779] 2. The user visits "B Cafe" and scans the QR code presented inside the store.

[0780] 3. The server receives this action and awards 10 points to the user, and also awards 10 points to the City A Chamber of Commerce, which oversees Cafe B.

[0781] 4. When the user submits a request to convert 10 points into electronic money within the app, the server converts the points into PayPal and notifies the user.

[0782] In this way, a series of processes is realized in which local landmarks that match the user's interests are recommended and points are awarded for the action of visiting them.

[0783] The processing flow will be explained below.

[0784] User registration and hometown setting

[0785] Step 1:

[0786] The user downloads and installs the app.

[0787] Step 2:

[0788] The device launches the app and displays the account registration screen to the user.

[0789] Step 3:

[0790] The user enters an email address and password to create an account.

[0791] Step 4:

[0792] The device displays a screen for entering the region of origin.

[0793] Step 5:

[0794] The user selects their hometown from the drop-down menu and presses the confirm button.

[0795] Step 6:

[0796] The terminal transmits the input area information to the server.

[0797] Step 7:

[0798] The server stores the location information in a database and associates it with the user information.

[0799] User interest data collection

[0800] Step 1:

[0801] The device will ask for permission to access other applications on the settings screen.

[0802] Step 2:

[0803] The user selects the application for which they want to grant permission and gives their consent.

[0804] Step 3:

[0805] The server collects data related to the user's interests through the API of authorized applications.

[0806] Step 4:

[0807] The server analyzes the collected data and creates a profile of the user's interests.

[0808] Local landmark recommendations

[0809] Step 1:

[0810] The server selects appropriate landmarks based on the user's interest data and hometown.

[0811] Step 2:

[0812] The server generates recommendation information and sends it to the user's device.

[0813] Step 3:

[0814] The device notifies the user of recommended information.

[0815] Step 4:

[0816] The user taps the notification to view more information.

[0817] Landmark visits and action recording

[0818] Step 1:

[0819] The user visits the recommended landmark.

[0820] Step 2:

[0821] The device will suggest actions to take at the landmark (post a review, scan a QR code, or donate).

[0822] Step 3:

[0823] The user performs the suggested action (e.g., scans a QR code).

[0824] Step 4:

[0825] The device sends the result of the action to the server.

[0826] Step 5:

[0827] The server records the action information it receives in a database.

[0828] Points allocation and management

[0829] Step 1:

[0830] The server calculates the points to be awarded to the user based on the recorded actions.

[0831] Step 2:

[0832] The server also simultaneously calculates points for the organization that has jurisdiction over that location.

[0833] Step 3:

[0834] The server will then credit the calculated points to the user's account.

[0835] Step 4:

[0836] The server will also award points to the governing body's account.

[0837] Step 5:

[0838] The terminal will notify the user of the new points balance.

[0839] Points conversion and redemption

[0840] Step 1:

[0841] The user opens the points conversion settings screen within the app.

[0842] Step 2:

[0843] The user selects the number of points they wish to convert and the destination (e.g., PayPal) and submits the request.

[0844] Step 3:

[0845] The server receives the user's request and converts the points into the specified electronic money.

[0846] Step 4:

[0847] The server notifies the user of the conversion results.

[0848] In this way, a series of processing steps from recommending landmarks based on the user's interests to visiting, recording actions, and awarding and using points are specifically explained.

[0849] Example 1

[0850] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0851] Conventional regional information provision systems lack the functionality to recommend specific places based on the user's region of origin or to award points for individual actions that correspond to the user's interests, and the management of points and conversion into electronic money is cumbersome.Furthermore, points are not distributed to organizations that manage the region, making it difficult to contribute to regional development.

[0852] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0853] In this invention, the server includes means for a user to register his or her hometown, means for selecting specific places near the registered hometown based on information from other applications, means for analyzing data collected from other applications and creating a user interest profile, means for awarding points when the user visits recommended places and performs specific actions, means for converting the awarded points into other electronic money, and means for awarding points to an organization that manages the places. This allows users to easily find specific places based on their interests, earn points by visiting them, and easily convert them into electronic money, and it also becomes possible for points to be distributed automatically to local management organizations.

[0854] A "user" is an individual who uses the system to register their hometown, visit specific recommended locations, and take action.

[0855] "Area of ​​origin" refers to the area where the user was born and raised (at the city, town, or village level) that the user registers within the application.

[0856] "Specific locations" are landmarks or facilities near the user's hometown that are recommended by the system.

[0857] "Information from other applications" refers to data collected from external applications such as email, calendars, and social media.

[0858] An "interest profile" is data that describes a user's interests and preferences, created by analyzing data collected from other applications.

[0859] "Recommendation" refers to the system suggesting specific locations based on a user's interest profile and hometown.

[0860] An "action" is a specific activity a user performs at a recommended location (such as posting a review, scanning a QR code, or donating).

[0861] "Points" are a form of reward given by the system when a user performs an action.

[0862] "Electronic money" refers to online payment methods (e.g., PayPal) that can be used to convert points awarded within the system.

[0863] "Organization" refers to the organization or local group that manages or operates the specific recommended location.

[0864] This invention is a system that allows users to register their hometowns, recommends specific places in those areas based on data collected from other applications, and awards points when the users visit those places. A specific embodiment of this system is described below.

[0865] User registration and hometown setting

[0866] Terminal (user)

[0867] A user downloads and installs the application on their mobile device, then launches the application after installation.

[0868] Within the application, the user accesses the account registration screen and enters the required information (email address, password) to create an account.

[0869] After creating an account, users are taken to the hometown setting screen, where they select their hometown from the drop-down menu provided and press the confirm button.

[0870] server

[0871] The information about the place of origin entered by the user is received and stored in a database, which is then associated with the user information.

[0872] User interest data collection

[0873] Terminal (user)

[0874] In the settings screen, users can grant permission to the option to allow access to other applications (e.g., email, calendar, social networking sites).

[0875] It collects the necessary information from authorized applications and sends the data to the server.

[0876] server

[0877] It receives and analyzes data from authorized applications to create a profile of the user's interests, which is then stored in a database.

[0878] Recommend specific places in the area

[0879] server

[0880] It runs an algorithm that selects the appropriate specific location based on the user's interest data and hometown information.

[0881] Information about the selected specific location is sent to the user's device.

[0882] Notification and display of recommended information

[0883] Terminal (user)

[0884] Recommendations are displayed as notifications on the user's device, and when the user taps the notification, detailed information is displayed.

[0885] Recording specific location visits and actions

[0886] Terminal (user)

[0887] The user visits a specific recommended location and performs an action provided within the application (e.g., leaving a review or scanning a QR code).

[0888] Send the results of the action to the server.

[0889] server

[0890] The received action information is recorded in a database and points are awarded to the user based on the action taken, as well as to the organization that manages the location.

[0891] Points allocation and management

[0892] server

[0893] The calculated points are credited to the user's account and the user is notified of the new points balance.

[0894] Terminal (user)

[0895] You will receive a notification to check your new points balance.

[0896] Points conversion and redemption

[0897] Terminal (user)

[0898] Open the point conversion settings screen within the application, select the number of points the user wants to convert and the conversion destination (e.g., PayPal), and submit the request.

[0899] server

[0900] Receives a user's request and converts points into the specified electronic money.

[0901] Notify the user of the conversion results.

[0902] Specific examples

[0903] For example, suppose a user registers "City A" as their hometown. The server analyzes the user's social media posts and calendar entries to determine that the user "likes to visit cafes." The server recommends "Cafe B in City A" and sends a notification to the user's device. The user visits "Cafe B" and scans a QR code inside the store. As a result, the user is awarded 10 points, and 10 points are also awarded to the "local organization in City A." The user then sends a request within the app to convert the 10 points into electronic money (e.g., PayPal), and the server immediately processes the conversion and notifies the user of the result.

[0904] Prompt Sentence Examples

[0905] "Please set City A as your hometown."

[0906] "Analyze user interests through social media posts and calendar events."

[0907] "Please recommend suitable cafes for users who like to go cafe-hopping in City A."

[0908] "Please calculate and award points based on users' visits to Cafe B."

[0909] "Convert your points into PayPal"

[0910] The above is an embodiment of the present invention.

[0911] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0912] Step 1: Download and install the app

[0913] Terminal (user)

[0914] A user downloads an application from an app store, installs it, and then launches it.

[0915] Input: User's device, app store

[0916] Output: Installed applications

[0917] Specifically, an application icon is generated on the device.

[0918] Step 2: Register an account

[0919] Terminal (user)

[0920] On the account registration screen, enter your email address and password to create an account.

[0921] Input: User's email address, password

[0922] Output: Account information

[0923] Specifically, the user's account data is sent to the server.

[0924] server

[0925] The received account information is stored in the database.

[0926] Input: User account information

[0927] Output: Account data stored in the database

[0928] Step 3: Set your hometown

[0929] Terminal (user)

[0930] On the hometown setting screen, select your hometown from the drop-down menu and press the Confirm button.

[0931] Input: User's chosen hometown

[0932] Output: Selected hometown information

[0933] As a specific operation, the selected hometown information is sent to the server.

[0934] server

[0935] The received hometown information is stored in a database and associated with the user information.

[0936] Input: User's hometown information

[0937] Output: User information and associated hometown data

[0938] Step 4: Permissions for other applications

[0939] Terminal (user)

[0940] On the settings screen, allow access to other applications (email, calendar, SNS, etc.).

[0941] Input: Access permission information for other applications

[0942] Output: Access permission information

[0943] As a specific operation, the access permission information is sent to the server.

[0944] Step 5: Collect and analyze interest data

[0945] server

[0946] Collect and analyze data from permitted applications to create a profile of your interests.

[0947] Input: Data collected from other applications

[0948] Output: User interest profile

[0949] Specifically, the collected data is analyzed algorithmically to generate an interest profile.

[0950] Step 6: Recommend specific locations

[0951] server

[0952] Based on the user's interest data and hometown information, appropriate specific locations are selected and recommendation information is sent to the user's device.

[0953] Input: User interest profile, hometown information

[0954] Output: Recommendation information

[0955] Specifically, a recommendation algorithm is executed, and information about recommended locations is sent to the terminal.

[0956] Step 7: Notification and display of recommended information

[0957] Terminal (user)

[0958] The received recommendation information is displayed as a notification, and when the user taps the notification, detailed information will be displayed.

[0959] Input: Recommendation information

[0960] Output: Notification, display of detailed information

[0961] Specifically, a notification will appear on the device and you can tap to open more information.

[0962] Step 8: Visit specific locations and take action

[0963] Terminal (user)

[0964] The user visits a specific recommended location and performs an action (such as writing a review or scanning a QR code).

[0965] Input: Action execution information

[0966] Output: Action result

[0967] Specifically, information about the actions performed by the user is sent to the server.

[0968] Step 9: Recording Action Results and Calculating Points

[0969] server

[0970] The received action results are recorded in a database, and points are calculated based on the action. Points are also awarded to the management organization.

[0971] Input: Action result

[0972] Output: Point calculation results, point allocation information

[0973] Specifically, points are awarded to users and management organizations based on the action results recorded in the database.

[0974] Step 10: Points balance notification

[0975] server

[0976] Notify the user of their new points balance.

[0977] Input: Point allocation information

[0978] Output: Point balance notification

[0979] Specifically, the new point balance after points are awarded is notified to the terminal.

[0980] Step 11: Request to convert points

[0981] Terminal (user)

[0982] Open the point conversion settings screen within the app, select the number of points you want to convert and the conversion destination (e.g. PayPal), and submit your request.

[0983] Input: Conversion request information, number of points, conversion destination

[0984] Output: Transformation request

[0985] As a specific operation, conversion request information is sent to the server.

[0986] Step 12: Point conversion processing and notification

[0987] server

[0988] The system receives a user's request, converts the points into the specified electronic money, and notifies the user of the conversion result.

[0989] Input: Conversion request information

[0990] Output: Conversion results, notification

[0991] Specifically, points are converted into electronic money, and the result is notified to the terminal.

[0992] (Application example 1)

[0993] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0994] Conventional landmark recommendation systems require users to manually select and navigate to destinations, making it difficult to provide efficient visit plans, especially when using autonomous vehicles. Effective personalized landmark recommendations based on hometown and interest data, as well as smooth visits using autonomous vehicles, are also desirable. Furthermore, the awarding of points through actions at visited destinations requires manual operation and is time-consuming. There is also a need for a system that simplifies the transfer of points to electronic money and the awarding of points to relevant organizations.

[0995] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0996] In this invention, the server includes: means for a user to register a hometown; means for recommending niche landmarks near the registered hometown based on data from other applications; means for awarding points when the user visits the recommended locations and performs an action; means for transferring the awarded points to other electronic money and means for awarding points to an organization having jurisdiction over the locations; means for a user to automatically visit the recommended landmarks based on the hometown and interest data in an autonomous vehicle; and means for awarding points when the user performs a specified action at the visited location. This enables users to take efficient and personalized landmark tours using autonomous vehicles, and points are automatically awarded based on actions taken during visits, allowing for smooth transfer to electronic money and awarding of points to the organization having jurisdiction.

[0997] An "autonomous vehicle" is a vehicle that operates using a self-control system without human intervention.

[0998] "Hometown" refers to the area registered by the user as their place of residence or birthplace.

[0999] A "niche landmark" is a place that is not widely known but is worth visiting depending on your particular interests or tastes.

[1000] "Recommending" means suggesting specific information or places based on a user's interests and preferences.

[1001] An "action" is a specific action a user takes at a recommended location, such as scanning a QR code or taking a photo.

[1002] "Points" are virtual currency or rewards that users can earn by performing certain actions.

[1003] "Electronic money" means currency stored and used in digital form.

[1004] "Governing Body" means an organization or body that governs or operates a particular area or service.

[1005] “Interest Data” means information that describes your preferences and interests and is collected from other applications.

[1006] This invention is a system that provides users with personalized landmark visits using autonomous vehicles. This system recommends niche landmarks within the autonomous vehicle based on the user's hometown and interest data, and awards points based on actions taken at the visited locations. The points can also be converted into other electronic money, and points can also be awarded to the relevant organization. Specific embodiments of this invention are described below.

[1007] 1. User registration and hometown setting

[1008] Terminal (user)

[1009] The user downloads, installs, and launches the application.

[1010] The user creates an account by entering an email address and password on the account registration screen.

[1011] After creating your account, on the hometown setting screen that appears, select your hometown from the drop-down menu and press the Confirm button.

[1012] server

[1013] The registered hometown information is stored in a database and associated with user information.

[1014] 2. Collecting User Interest Data

[1015] Terminal (user)

[1016] On the settings screen, allow access to other applications (email, calendar, SNS, etc.).

[1017] The information about the allowed applications is sent to the server.

[1018] server

[1019] Collect and analyze your interest data from permitted applications to create interest profiles.

[1020] 3. Local landmark recommendations

[1021] server

[1022] It runs an algorithm to select appropriate landmarks based on the user's interest data and hometown.

[1023] Recommendation information is sent to the user's device.

[1024] Terminal (user)

[1025] The received recommendation information is displayed to the user as a notification, and detailed information can be displayed by tapping on it.

[1026] 4. Autonomous visit and action recording

[1027] Autonomous vehicles

[1028] When a user gets into an autonomous vehicle, a visit plan to pre-recommended landmarks is automatically set up.

[1029] When the vehicle arrives at a designated landmark, the user will receive a notification.

[1030] Terminal (user)

[1031] The user performs the action suggested at the destination (scanning a QR code or taking a photo).

[1032] Send the result of the action to the server.

[1033] server

[1034] The information of the received actions is recorded in a database and points are awarded to the user based on the actions.

[1035] 5. Point Management and Use

[1036] server

[1037] The calculated points are awarded to the user's account, and at the same time, points are awarded to the account of the organization that has jurisdiction over the location.

[1038] A request for point conversion is received and processing for converting the points into designated electronic money is executed.

[1039] Notify the user of the conversion results.

[1040] Terminal (user)

[1041] Show the point balance to the user as a notification and send a request on the point conversion setting screen.

[1042] Specific examples

[1043] For example, suppose a user is from City A and enjoys visiting cafes. When getting into an autonomous vehicle, the system will recommend niche cafes in City A and automatically create a visit plan based on the user's interests. When the user arrives at a destination, they will receive a notification and be awarded points for taking actions such as scanning a QR code.

[1044] Prompt Sentence Examples

[1045] The user is from "City A" and is interested in "cafes" and "museums." Please recommend landmarks that can be visited from the user's current location.

[1046] In this way, the present invention provides an efficient and personalized landmark tour using an autonomous vehicle, and enables automatic points acquisition and smooth conversion to electronic money, which can contribute to promotions tailored to users' interests and regional revitalization.

[1047] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1048] Step 1:

[1049] User registration and hometown setting

[1050] Specific behavior:

[1051] The device (user) downloads, installs, and launches the application. The user creates an account by entering an email address and password on the account registration screen. After creating the account, the user selects their hometown from the drop-down menu on the hometown setting screen and presses the confirm button.

[1052] input:

[1053] User email address, password, and region of origin

[1054] Data processing / data calculation:

[1055] The server stores the entered user information in a database and associates it with the user information.

[1056] output:

[1057] User account registration completion notification

[1058] Step 2:

[1059] User interest data collection

[1060] Specific behavior:

[1061] The device (user) allows access to other applications (email, calendar, SNS, etc.) on the settings screen. Information about the allowed applications is sent to the server.

[1062] input:

[1063] Allowed Applications Data

[1064] Data processing / data calculation:

[1065] The server collects user interest data from authorized applications and uses machine learning algorithms to create an interest profile.

[1066] output:

[1067] User interest profiles

[1068] Step 3:

[1069] Local landmark recommendations

[1070] Specific behavior:

[1071] The server runs an algorithm to select appropriate landmarks based on the user's interest data and hometown, and sends the recommended information to the user's device.

[1072] input:

[1073] User interest profile, hometown

[1074] Data processing / data calculation:

[1075] The server uses a generative AI model to identify niche landmarks that match the user's interests.

[1076] output:

[1077] Recommended landmark information

[1078] Step 4:

[1079] Autonomous visit and action recording

[1080] Specific behavior:

[1081] The autonomous vehicle automatically sets up a visit plan to recommended landmarks in advance. The user gets into the vehicle and performs a specified action at the destination (scanning a QR code or taking a photo). The results of the action are sent from the device to the server.

[1082] input:

[1083] Recommended landmark information, user visit actions

[1084] Data processing / data calculation:

[1085] The server records the user's visit actions in a database, analyzes the content of the actions, and calculates points.

[1086] output:

[1087] Record of visit actions and awarded points

[1088] Step 5:

[1089] Points management and usage

[1090] Specific behavior:

[1091] The server will then add the calculated points to the user's account and simultaneously add points to the account of the organization that has jurisdiction over the location. Upon receiving a point conversion request, the server will execute the conversion process into the specified electronic money and notify the user of the result.

[1092] input:

[1093] User's point conversion request

[1094] Data processing / data calculation:

[1095] The server converts the points into electronic money and records the conversion results in a database.

[1096] output:

[1097] Notification of converted electronic money and point balance

[1098] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1099] This invention is a system that allows users to register their hometown, recommends niche landmarks in that area based on other application data, and further analyzes the user's emotional data to adjust the recommendations. A specific embodiment of this system is described below.

[1100] 1. User registration and hometown setting

[1101] Terminal (user)

[1102] The user downloads, installs, and launches the app.

[1103] A user creates an account by entering an email address and password on the account registration screen.

[1104] After creating an account, a screen for setting the area of ​​origin will appear, and the user will select their area of ​​origin (city, town, or village level) from the drop-down menu and press the confirm button.

[1105] server

[1106] The registered hometown information is stored in a database and associated with user information.

[1107] 2. Collecting User Interest Data

[1108] Terminal (user)

[1109] In the settings screen, users allow access to other applications (email, calendar, social media, etc.).

[1110] The information about the allowed applications is sent to the server.

[1111] server

[1112] Collect and analyze user interest data from permitted applications to create a user interest profile.

[1113] 3. Local landmark recommendations

[1114] server

[1115] It runs an algorithm to select appropriate landmarks based on the user's interest data and hometown.

[1116] Using an emotion engine, recommendations are adjusted based on past recommendations and emotional data from the visit.

[1117] Recommendation information is sent to the user's device.

[1118] Terminal (user)

[1119] The received recommendation information is displayed to the user as a notification, and detailed information can be displayed by tapping on it.

[1120] 4. Recording landmark visits and actions

[1121] Terminal (user)

[1122] Users visit recommended landmarks and perform actions suggested within the app (such as writing a review, scanning a QR code, or donating).

[1123] The emotion engine recognizes emotions from the user's facial expressions and voice and records emotional data during the visit.

[1124] The action result and emotion data are sent to the server.

[1125] server

[1126] The received action and emotion data is recorded in a database, and points are calculated to be awarded to the user based on the action.

[1127] 5. Points allocation and management

[1128] server

[1129] The calculated points are awarded to the user's account, and at the same time, points are awarded to the account of the organization that has jurisdiction over the location.

[1130] Terminal (user)

[1131] Display the new points balance as a notification to the user.

[1132] 6. Points Conversion and Redemption

[1133] Terminal (user)

[1134] The user opens the point conversion settings screen within the app, selects the number of points they want to convert and the conversion destination (e.g., PayPal), and submits the request.

[1135] server

[1136] It receives a user request and executes the process of converting points into the specified electronic money.

[1137] Notify the user of the conversion results.

[1138] Specific examples

[1139] For example, suppose a user is from City A and registers City A as their hometown. The server analyzes the user's social media posts, calendar appointments, and even emotional data from past visits to determine that the user likes to visit cafes.

[1140] 1. The server recommends a niche cafe called "Cafe B" in City A and notifies the user's device.

[1141] 2. The user visits "B Cafe" and scans the QR code presented inside the store.

[1142] 3. The emotion engine recognizes emotions from the user's facial expressions when scanned and records emotional data during the visit.

[1143] 4. The server receives this action and emotion data, awards 10 points to the user, and simultaneously awards 10 points to the City A Chamber of Commerce, which oversees Cafe B.

[1144] 5. When the user submits a request to convert 10 points into electronic money within the app, the server converts the points into PayPal and notifies the user.

[1145] In this way, a series of processing steps from recommending landmarks based on the user's interests to visiting, recording actions, recognizing and using emotional data, and awarding and using points are specifically explained.

[1146] The processing flow will be explained below.

[1147] User registration and hometown setting

[1148] Step 1:

[1149] The user downloads and installs the app.

[1150] Step 2:

[1151] The device launches the app and displays the account registration screen to the user.

[1152] Step 3:

[1153] The user enters an email address and password to create an account.

[1154] Step 4:

[1155] The device displays a screen for entering the region of origin.

[1156] Step 5:

[1157] The user selects their hometown from the drop-down menu and presses the confirm button.

[1158] Step 6:

[1159] The terminal transmits the input area information to the server.

[1160] Step 7:

[1161] The server stores the location information in a database and associates it with the user information.

[1162] User interest data collection

[1163] Step 1:

[1164] The device will ask for permission to access other applications on the settings screen.

[1165] Step 2:

[1166] The user selects the application for which they want to grant permission and gives their consent.

[1167] Step 3:

[1168] The server collects data related to the user's interests through the API of authorized applications.

[1169] Step 4:

[1170] The server analyzes the collected data and creates a profile of the user's interests.

[1171] Local landmark recommendations

[1172] Step 1:

[1173] The server selects appropriate landmarks based on the user's interest data and hometown.

[1174] Step 2:

[1175] The server uses an emotion engine to adjust the recommendation content, taking into account past recommendations and emotional data from the visit.

[1176] Step 3:

[1177] The server generates recommendation information and sends it to the user's device.

[1178] Step 4:

[1179] The device notifies the user of recommended information.

[1180] Step 5:

[1181] The user taps the notification to view more information.

[1182] Landmark visits and action recording

[1183] Step 1:

[1184] The user visits the recommended landmark.

[1185] Step 2:

[1186] The device displays the actions offered at the landmark (such as writing a review, scanning a QR code, or donating).

[1187] Step 3:

[1188] The user performs the suggested action (e.g., scans a QR code).

[1189] Step 4:

[1190] The emotion engine recognizes emotions from the user's facial expressions and voice.

[1191] Step 5:

[1192] The device sends the action results and emotion data to the server.

[1193] Step 6:

[1194] The server records the received actions and emotion data in a database.

[1195] Points allocation and management

[1196] Step 1:

[1197] The server calculates the points to be awarded to the user based on the recorded actions.

[1198] Step 2:

[1199] The server also simultaneously calculates points for the organization that has jurisdiction over that location.

[1200] Step 3:

[1201] The server will then credit the calculated points to the user's account.

[1202] Step 4:

[1203] The server will also award points to the governing body's account.

[1204] Step 5:

[1205] The terminal will notify the user of the new points balance.

[1206] Points conversion and redemption

[1207] Step 1:

[1208] The user opens the points conversion settings screen within the app.

[1209] Step 2:

[1210] The user selects the number of points they wish to convert and the destination (e.g., PayPal) and submits the request.

[1211] Step 3:

[1212] The server receives the user's request and converts the points into the specified electronic money.

[1213] Step 4:

[1214] The server notifies the user of the conversion results.

[1215] In this way, a series of processing steps from recommendations that take into account not only the user's interests but also their emotional data to the awarding and use of points is specifically explained.

[1216] Example 2

[1217] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1218] Modern users want to be recommended activities based on their interests and hometowns, but existing systems have difficulty combining these factors appropriately. They also lack mechanisms for providing appropriate rewards for recommended activities and for utilizing emotional data based on those activities. To address these needs, a system is needed that can comprehensively manage data based on users' interests, hometowns, and activities and make recommendations.

[1219] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for a user to register their hometown, a means for recommending niche tourist spots near the registered hometown based on data from other software, a means for collecting and analyzing user interest data to create an interest profile, a means for adjusting the recommendation content taking into account past recommendations and emotional data at the time of visit, a means for awarding points for visiting recommended tourist spots and taking actions, a means for converting the awarded points into other electronic money, and a means for awarding points to the organization that has jurisdiction over the location. This allows users to receive recommendations of tourist spots appropriate to their interests and emotions, and to receive rewards based on their actions during the visit.

[1220] "User" means an individual who uses the System.

[1221] "Hometown" refers to the geographic location that a user registers as their hometown.

[1222] A "niche tourist destination" is a place that is not well known as a tourist destination, but is attractive to users with specific interests or hobbies.

[1223] "Software" means computer programs and applications used to collect and analyze user interest and behavior data.

[1224] "Interest data" is data that indicates a user's interests, including social media posts, calendar events, and email content.

[1225] An "interest profile" is data that reflects a user's interests and hobbies, analyzed through the analysis of collected interest data.

[1226] A "recommendation algorithm" is a computational method for recommending appropriate tourist spots and activities based on a user's region of origin and interest profile.

[1227] "Emotional data" refers to data that indicates the emotions a user shows during a specific action or visit, and can also be recognized from facial expressions and voice.

[1228] "Action" refers to the specific actions that users take when visiting a recommended tourist spot (e.g., posting a review, scanning a QR code, giving a tip, etc.).

[1229] "Points" are numerical rewards given to users as a result of their actions.

[1230] "Electronic money" refers to a digital form of currency that is used to convert points.

[1231] "Organization" means an organization that manages and operates a particular tourist destination.

[1232] This invention is a system that allows users to register their hometown, recommends niche tourist spots in that area based on data from other software, and further analyzes the user's emotional data to adjust the recommendations. Specific implementation methods using each hardware and software are described below.

[1233] 1. User registration and hometown setting

[1234] Terminal (user)

[1235] Users download and install the application onto their smartphone, PC, or other device. After launching the app, they first create an account by entering their email address and password on the account registration screen. After creating the account, they are automatically taken to the hometown setting screen. From there, they select their hometown (at the city, town, or village level) from the drop-down menu and press the "Confirm" button.

[1236] server

[1237] The server stores the email address and hashed password entered by the user in a database, as well as the region of origin selected by the user, and associates this information with the user's information.

[1238] 2. Collecting User Interest Data

[1239] Terminal (user)

[1240] Users select options in the settings screen to allow access to other software (email, calendar, social networking sites, etc.), which then sends data from each piece of software to the server.

[1241] server

[1242] The server analyzes the data obtained from the authorized software and creates an interest profile that reflects the user's interests, using techniques such as natural language processing and machine learning algorithms.

[1243] 3. Local landmark recommendations

[1244] server

[1245] The server runs a recommendation algorithm based on the user's interest profile and hometown, selects appropriate tourist destinations, and uses an emotion engine to adjust the recommendations based on past recommendations and emotional data from the visit. The adjusted recommendations are then sent to the user's device.

[1246] Terminal (user)

[1247] The user's device will display the received recommendation information as a notification, and the user can tap the notification to view more information.

[1248] 4. Recording landmark visits and actions

[1249] Terminal (user)

[1250] Users visit recommended tourist spots and follow the in-app guide to perform the actions suggested (e.g., posting reviews, scanning QR codes, donating money, etc.). The emotion engine recognizes emotions from the user's facial expressions and voice, and records emotional data from the visit. The action results and emotional data are sent to the server.

[1251] server

[1252] The server records the received action and emotion data in a database and calculates points to be awarded to the user based on the action.

[1253] 5. Points allocation and management

[1254] server

[1255] The server assigns the calculated points to the user's account and also assigns points to the account of the organization that has jurisdiction over the location.

[1256] Terminal (user)

[1257] The terminal will display the new points balance to the user as a notification.

[1258] 6. Points Conversion and Redemption

[1259] Terminal (user)

[1260] Users open the point conversion settings screen within the app, select the number of points they want to convert and the conversion destination (e.g., PayPal), and submit their request.

[1261] server

[1262] The server receives the user's request, converts the points into the specified electronic money, and notifies the user of the conversion result.

[1263] Specific examples

[1264] For example, if a user is "from City A" and registers "City A" as their hometown, the server will analyze social media posts, calendar appointments, and even emotional data from past visits to determine that the user likes to visit cafes.

[1265] The server recommends a niche cafe in City A, "Cafe B," and notifies the user's device. The user visits "Cafe B" and scans the QR code presented inside the store. The emotion engine recognizes the emotion from the user's facial expression at the time and records the emotion data from the visit. The server receives this action and emotion data, awards 10 points to the user, and simultaneously awards 10 points to the organization that oversees "Cafe B." When the user sends a request within the app to convert the points into electronic money, the server converts the points into PayPal and notifies the user.

[1266] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1267] Step 1: User Registration

[1268] Terminal (user)

[1269] A user downloads and installs an application on their smartphone or computer. They launch the app, enter their email address and password on the account registration screen, and press the register button. The input information (email address, password) is sent. The output is the data sent to the server.

[1270] server

[1271] The server receives the entered email address and password, stores them in a database along with a hashed password for security, generates a registration completion message and sends it to the user's device, and outputs the user information stored in the database and a completion notification to the user.

[1272] Step 2: Set your hometown

[1273] Terminal (user)

[1274] After registering an account, the user selects their hometown (at the city / ward / town / village level) from the drop-down menu on the hometown setting screen and presses the confirm button. The input information (hometown) is sent. The output is the data sent to the server.

[1275] server

[1276] The server receives the user's hometown information and stores it in a database along with the user information. It then generates a setup completion message and sends it to the user's device. The output is the hometown information stored in the database and a completion notification to the user.

[1277] Step 3: App integration permission

[1278] Terminal (user)

[1279] The user sets access permissions for other software (email, calendar, SNS, etc.) on the settings screen. In response to the permission confirmation message, the user presses the "Allow" button. The input information (permission status) is sent. The output is the data sent to the server.

[1280] server

[1281] The server receives permission data from each software and collects user interest data. The output is the received data.

[1282] Step 4: Analyze interest data

[1283] server

[1284] The server analyzes the received interest data and creates an interest profile for the user using natural language processing and machine learning algorithms. The input is the collected data, and the output is the generated interest profile.

[1285] Step 5: Recommend tourist spots

[1286] server

[1287] The server runs a recommendation algorithm based on the user's interest profile and hometown information. It selects appropriate tourist destinations and then uses an emotion engine to adjust the recommendations based on past recommendations and emotional data from the visit. The input is the interest profile, hometown information, and emotional data, and the output is the adjusted recommendation information.

[1288] Terminal (user)

[1289] The user's device receives the recommendation information and displays it as a notification. When the user taps the notification, detailed information is displayed. The output is the displayed recommendation information.

[1290] Step 6: Visit landmarks and record actions

[1291] Terminal (user)

[1292] Users visit recommended tourist spots and follow the in-app guide to perform the actions suggested (such as posting a review, scanning a QR code, or donating). The emotion engine recognizes emotions from the user's facial expressions and voice, and records emotional data from the visit. This data is sent to the server. The input is the location visit, the actions performed, and the emotional data, and the output is the recorded data.

[1293] server

[1294] The server records the received actions and emotion data in a database and calculates the points to be awarded to the user based on the actions. The input is the submitted actions and emotion data, and the output is the calculated points.

[1295] Step 7: Points allocation and management

[1296] server

[1297] The server assigns the calculated points to the user's account and also assigns points to the account of the organization that has jurisdiction over the location. The input is the calculated points, and the output is the assigned points information.

[1298] Terminal (user)

[1299] The user's device displays the new points balance to the user as a notification. The output is the displayed points balance.

[1300] Step 8: Convert and use your points

[1301] Terminal (user)

[1302] The user opens the point conversion settings screen in the app, selects the number of points they want to convert and the conversion destination (e.g., PayPal), and submits a request. The input is the point conversion request, and the output is the data to be sent to the server.

[1303] server

[1304] The server receives the user's request, converts the points into the specified electronic money, and notifies the user of the conversion result. The input is the point conversion request, and the output is the converted electronic money and a notification message.

[1305] In this way, the entire process is explained concretely and in detail.

[1306] (Application example 2)

[1307] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1308] The problem that this invention aims to solve is to provide a system that allows users to efficiently obtain useful information related to their hometowns, while providing personalized recommendations based on the user's emotional data and interests, and furthermore, allowing these activities to contribute to the revitalization of the local economy and culture. Specifically, the problem is to recommend attractive local landmarks and brick-and-mortar stores based on the user's interests and emotions, award points based on actions taken when visiting those stores, and smoothly carry out the entire process of transferring these points to other electronic money.

[1309] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1310] In this invention, the server includes a means for a user to register their hometown, a means for recommending niche landmarks near the registered hometown based on data from other applications, a means for awarding points when the user visits a recommended place and performs an action, a means for transferring the awarded points to other electronic money and a means for awarding points to an organization that has jurisdiction over the place, and a means for analyzing the user's emotional data and adjusting the content of recommendations. This allows the server to efficiently recommend landmarks and brick-and-mortar stores that best suit the user's interests, thereby revitalizing local communities and improving the user experience.

[1311] "User" refers to a person who uses the system.

[1312] "Hometown" refers to the area where the user was born and raised, or the area to which they have a particular attachment.

[1313] A "niche landmark" refers to a tourist attraction or facility that is not well known to the general public but has particular value or appeal in a particular area.

[1314] "Data from other applications" refers to information obtained from other applications you use, such as social media posts or calendar entries.

[1315] "Recommend" refers to recommending a specific landmark or store to the user.

[1316] "Emotional data" refers to the emotional state analyzed from the user's facial expressions, voice, etc.

[1317] "Points" refer to units of virtual value that can be used in the future and are awarded to users when they perform certain actions.

[1318] "Electronic money" refers to digital currency and electronic bankbooks that can be used over the Internet.

[1319] "User Interest Data" means information about your interests and preferences, including, for example, data about your hobbies or favorite places.

[1320] "Server" refers to a computer system that receives information from users, analyzes it, and provides appropriate services.

[1321] The present invention relates to a system that allows a user to register their hometown, recommends niche landmarks in that area based on other application data, and further analyzes the user's emotional data to adjust the recommendation content. A specific embodiment of the present invention is described below.

[1322] 1. User registration and hometown setting

[1323] Terminal (user)

[1324] The user downloads and installs the application, then launches it. The user creates an account by entering an email address and password on the account registration screen. After creating the account, the hometown setting screen is displayed, and the user selects their hometown from the drop-down menu and presses the confirm button.

[1325] server

[1326] The server stores the registered hometown information in a database and associates it with user information.

[1327] 2. Collecting User Interest Data

[1328] Terminal (user)

[1329] The user allows access to other applications (email, calendar, social networking, etc.) in the settings screen.

[1330] server

[1331] It collects user interest data from authorized applications and analyzes it to create a user interest profile. It uses Python and Flask for analysis and a SQLite database.

[1332] 3. Local landmark recommendations

[1333] server

[1334] The server runs an algorithm to select appropriate landmarks based on the user's interest data and hometown. An emotion engine is used to adjust the recommendations, taking into account past recommendations and emotional data from the visit. It utilizes Python libraries and machine learning models.

[1335] Terminal (user)

[1336] The received recommendation information is displayed to the user as a notification, and detailed information can be displayed by tapping on it.

[1337] 4. Recording landmark visits and actions

[1338] Terminal (user)

[1339] The user visits a recommended landmark and performs an action suggested within the app (such as posting a review, scanning a QR code, or donating). The emotion engine recognizes the user's emotions from their facial expressions and voice, and records the emotional data from the visit. The action results and emotional data are then sent to the server.

[1340] server

[1341] The received action and emotion data is recorded in a database, and points are calculated to be awarded to the user based on the action.

[1342] 5. Points allocation and management

[1343] server

[1344] The calculated points are credited to the user's account and simultaneously credited to the account of the organization responsible for the location. A notification is generated to the user, displaying the new points balance.

[1345] 6. Points Conversion and Redemption

[1346] Terminal (user)

[1347] The user opens the point conversion settings screen within the app, selects the number of points they want to convert and the conversion destination, and submits the request.

[1348] server

[1349] Receives a user request, converts points into the specified electronic money, and notifies the user of the conversion result.

[1350] Specific examples

[1351] For example, consider a case where a user has registered a "certain city" as their "hometown." Suppose that analysis of social media posts and calendar events reveals that this user likes to visit cafes.

[1352] 1. Based on the user's interest data, the server recommends niche cafes in a certain city and notifies the user's device.

[1353] 2. The user visits the recommended cafe and scans the QR code displayed inside the store.

[1354] 3. The emotion engine recognizes "enjoyment" from the user's facial expression when scanned and records emotional data from the visit.

[1355] 4. The server receives this action and emotion data and awards 10 points to the user, as well as the organization that oversees the cafe.

[1356] 5. When the user sends a request to convert 10 points into electronic money within the app, the server converts the points into electronic money and notifies the user of the result.

[1357] Example prompts for generative AI models

[1358] The user has registered their hometown as "a certain city." Since the user likes to go cafe hopping, please recommend niche cafes within "a certain city." If the user submits emotion data as "fun," please award the user 10 points and display their point balance.

[1359] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1360] Step 1:

[1361] User registration and hometown setting

[1362] The device (user) downloads and installs the application, then launches it. The user creates an account by entering an email address and password. Next, a screen for setting the hometown appears, and the user selects their hometown from the drop-down menu and presses the confirm button.

[1363] Input: User's email address, password, hometown

[1364] Output: User information and hometown registered in the database

[1365] Specific behavior:

[1366] 1. Launching the application

[1367] 2. Enter your email address and password

[1368] 3. Select and confirm your hometown

[1369] Step 2:

[1370] User interest data collection

[1371] The device (user) allows access to other applications (e.g., email, calendar, SNS) on the settings screen. Based on that permission, the server collects and analyzes the user's interest data from other applications.

[1372] Input: User interest data (obtained from other applications)

[1373] Output: Interest profile

[1374] Specific behavior:

[1375] 1. Check permissions

[1376] 2. Data collection

[1377] 3. Creating an Interest Profile

[1378] Step 3:

[1379] Local landmark recommendations

[1380] The server runs an algorithm to select appropriate landmarks based on the user's interest data and hometown. It uses an emotion engine to adjust the recommendations based on past recommendations and emotional data from the visit. The server then sends the optimal recommendations to the user's device.

[1381] Input: User interest data, hometown, past emotional data

[1382] Output: Recommended landmark information

[1383] Specific behavior:

[1384] 1. Landmark selection based on interest data and hometown

[1385] 2. Optimizing recommendation content using an emotion engine

[1386] 3. Sending recommendation information

[1387] Step 4:

[1388] Landmark visits and action recording

[1389] The device (user) visits the recommended landmark and performs the action suggested in the app (e.g., scanning a QR code, posting a review). The emotion engine recognizes the user's emotions from their facial expressions and voice, records the emotional data during the visit, and sends it to the server along with the action results.

[1390] Input: Landmark information of visited destinations, user actions and emotion data

[1391] Output: Action results and emotion data sent to the server

[1392] Specific behavior:

[1393] 1. Landmark visit

[1394] 2. Scan QR codes and post reviews

[1395] 3. Analysis of facial expressions and voice data and recording of emotions

[1396] 4. Sending data to the server

[1397] Step 5:

[1398] Points allocation and management

[1399] The server calculates points based on the received action and emotion data. The points are awarded to the user's account and simultaneously to the account of the organization that oversees the landmark. The award result is then notified to the user's device.

[1400] Input: Action results and emotion data

[1401] Output: User and jurisdiction points balance

[1402] Specific behavior:

[1403] 1. Points Calculation

[1404] 2. Points Award

[1405] 3. Notification of point balance

[1406] Step 6:

[1407] Points conversion and redemption

[1408] The terminal (user) inputs the number of points they want to convert and the destination (electronic money) information on the point conversion setting screen and sends a request. The server receives the request, converts the points into the specified electronic money, and notifies the user of the conversion result.

[1409] Input: Number of points to convert and destination information

[1410] Output: Converted electronic money balance and notification

[1411] Specific behavior:

[1412] 1. Display the conversion settings screen

[1413] 2. Enter the number of points and conversion information

[1414] 3. Convert points into electronic money

[1415] 4. Notification of conversion results

[1416] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1417] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1418] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1419] [Third embodiment]

[1420] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1421] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1422] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1423] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1424] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1425] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1426] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1427] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1428] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1429] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1430] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1431] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1432] This invention is a system in which a user registers their hometown, recommends niche landmarks in that area based on other application data, and awards points when the user visits them. A specific embodiment of this system is described below.

[1433] 1. User registration and hometown setting

[1434] Terminal (user)

[1435] The user downloads, installs, and launches the app.

[1436] A user creates an account by entering an email address and password on the account registration screen.

[1437] After creating an account, a screen for setting the area of ​​origin will appear, and the user will select their area of ​​origin (city, town, or village level) from the drop-down menu and press the confirm button.

[1438] server

[1439] The registered hometown information is stored in a database and associated with user information.

[1440] 2. Collecting User Interest Data

[1441] Terminal (user)

[1442] In the settings screen, users allow access to other applications (email, calendar, social media, etc.).

[1443] The information about the allowed applications is sent to the server.

[1444] server

[1445] Collect and analyze user interest data from permitted applications to create a user interest profile.

[1446] 3. Local landmark recommendations

[1447] server

[1448] It runs an algorithm to select appropriate landmarks based on the user's interest data and hometown.

[1449] Recommendation information is sent to the user's device.

[1450] Terminal (user)

[1451] The received recommendation information is displayed to the user as a notification, and detailed information can be displayed by tapping on it.

[1452] 4. Recording landmark visits and actions

[1453] Terminal (user)

[1454] Users visit recommended landmarks and perform actions suggested within the app (such as writing a review, scanning a QR code, or donating).

[1455] Send the result of the action to the server.

[1456] server

[1457] The information of the received action is recorded in a database, and points to be awarded to the user are calculated based on the action.

[1458] 5. Points allocation and management

[1459] server

[1460] The calculated points are awarded to the user's account, and at the same time, points are awarded to the account of the organization that has jurisdiction over the location.

[1461] Terminal (user)

[1462] Display the new points balance as a notification to the user.

[1463] 6. Points Conversion and Redemption

[1464] Terminal (user)

[1465] The user opens the point conversion settings screen within the app, selects the number of points they want to convert and the conversion destination (e.g., PayPal), and submits the request.

[1466] server

[1467] It receives a user request and executes the process of converting points into the specified electronic money.

[1468] Notify the user of the conversion results.

[1469] Specific examples

[1470] For example, suppose a user is from City A and registers City A as their hometown. The server analyzes data such as the user's social media posts and calendar appointments to determine that the user likes to visit cafes.

[1471] 1. The server recommends a niche cafe called "Cafe B" in City A and notifies the user's device.

[1472] 2. The user visits "B Cafe" and scans the QR code presented inside the store.

[1473] 3. The server receives this action and awards 10 points to the user, and also awards 10 points to the City A Chamber of Commerce, which oversees Cafe B.

[1474] 4. When the user submits a request to convert 10 points into electronic money within the app, the server converts the points into PayPal and notifies the user.

[1475] In this way, a series of processes is realized in which local landmarks that match the user's interests are recommended and points are awarded for the action of visiting them.

[1476] The processing flow will be explained below.

[1477] User registration and hometown setting

[1478] Step 1:

[1479] The user downloads and installs the app.

[1480] Step 2:

[1481] The device launches the app and displays the account registration screen to the user.

[1482] Step 3:

[1483] The user enters an email address and password to create an account.

[1484] Step 4:

[1485] The device displays a screen for entering the region of origin.

[1486] Step 5:

[1487] The user selects their hometown from the drop-down menu and presses the confirm button.

[1488] Step 6:

[1489] The terminal transmits the input area information to the server.

[1490] Step 7:

[1491] The server stores the location information in a database and associates it with the user information.

[1492] User interest data collection

[1493] Step 1:

[1494] The device will ask for permission to access other applications on the settings screen.

[1495] Step 2:

[1496] The user selects the application for which they want to grant permission and gives their consent.

[1497] Step 3:

[1498] The server collects data related to the user's interests through the API of authorized applications.

[1499] Step 4:

[1500] The server analyzes the collected data and creates a profile of the user's interests.

[1501] Local landmark recommendations

[1502] Step 1:

[1503] The server selects appropriate landmarks based on the user's interest data and hometown.

[1504] Step 2:

[1505] The server generates recommendation information and sends it to the user's device.

[1506] Step 3:

[1507] The device notifies the user of recommended information.

[1508] Step 4:

[1509] The user taps the notification to view more information.

[1510] Landmark visits and action recording

[1511] Step 1:

[1512] The user visits the recommended landmark.

[1513] Step 2:

[1514] The device will suggest actions to take at the landmark (post a review, scan a QR code, or donate).

[1515] Step 3:

[1516] The user performs the suggested action (e.g., scans a QR code).

[1517] Step 4:

[1518] The device sends the result of the action to the server.

[1519] Step 5:

[1520] The server records the action information it receives in a database.

[1521] Points allocation and management

[1522] Step 1:

[1523] The server calculates the points to be awarded to the user based on the recorded actions.

[1524] Step 2:

[1525] The server also simultaneously calculates points for the organization that has jurisdiction over that location.

[1526] Step 3:

[1527] The server will then credit the calculated points to the user's account.

[1528] Step 4:

[1529] The server will also award points to the governing body's account.

[1530] Step 5:

[1531] The terminal will notify the user of the new points balance.

[1532] Points conversion and redemption

[1533] Step 1:

[1534] The user opens the points conversion settings screen within the app.

[1535] Step 2:

[1536] The user selects the number of points they wish to convert and the destination (e.g., PayPal) and submits the request.

[1537] Step 3:

[1538] The server receives the user's request and converts the points into the specified electronic money.

[1539] Step 4:

[1540] The server notifies the user of the conversion results.

[1541] In this way, a series of processing steps from recommending landmarks based on the user's interests to visiting, recording actions, and awarding and using points are specifically explained.

[1542] Example 1

[1543] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1544] Conventional regional information provision systems lack the functionality to recommend specific places based on the user's region of origin or to award points for individual actions that correspond to the user's interests, and the management of points and conversion into electronic money is cumbersome.Furthermore, points are not distributed to organizations that manage the region, making it difficult to contribute to regional development.

[1545] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1546] In this invention, the server includes means for a user to register his or her hometown, means for selecting specific places near the registered hometown based on information from other applications, means for analyzing data collected from other applications and creating a user interest profile, means for awarding points when the user visits recommended places and performs specific actions, means for converting the awarded points into other electronic money, and means for awarding points to an organization that manages the places. This allows users to easily find specific places based on their interests, earn points by visiting them, and easily convert them into electronic money, and it also becomes possible for points to be distributed automatically to local management organizations.

[1547] A "user" is an individual who uses the system to register their hometown, visit specific recommended locations, and take action.

[1548] "Area of ​​origin" refers to the area where the user was born and raised (at the city, town, or village level) that the user registers within the application.

[1549] "Specific locations" are landmarks or facilities near the user's hometown that are recommended by the system.

[1550] "Information from other applications" refers to data collected from external applications such as email, calendars, and social media.

[1551] An "interest profile" is data that describes a user's interests and preferences, created by analyzing data collected from other applications.

[1552] "Recommendation" refers to the system suggesting specific locations based on a user's interest profile and hometown.

[1553] An "action" is a specific activity a user performs at a recommended location (such as posting a review, scanning a QR code, or donating).

[1554] "Points" are a form of reward given by the system when a user performs an action.

[1555] "Electronic money" refers to online payment methods (e.g., PayPal) that can be used to convert points awarded within the system.

[1556] "Organization" refers to the organization or local group that manages or operates the specific recommended location.

[1557] This invention is a system that allows users to register their hometowns, recommends specific places in those areas based on data collected from other applications, and awards points when the users visit those places. A specific embodiment of this system is described below.

[1558] User registration and hometown setting

[1559] Terminal (user)

[1560] A user downloads and installs the application on their mobile device, then launches the application after installation.

[1561] Within the application, the user accesses the account registration screen and enters the required information (email address, password) to create an account.

[1562] After creating an account, users are taken to the hometown setting screen, where they select their hometown from the drop-down menu provided and press the confirm button.

[1563] server

[1564] The information about the place of origin entered by the user is received and stored in a database, which is then associated with the user information.

[1565] User interest data collection

[1566] Terminal (user)

[1567] In the settings screen, users can grant permission to the option to allow access to other applications (e.g., email, calendar, social networking sites).

[1568] It collects the necessary information from authorized applications and sends the data to the server.

[1569] server

[1570] It receives and analyzes data from authorized applications to create a profile of the user's interests, which is then stored in a database.

[1571] Recommend specific places in the area

[1572] server

[1573] It runs an algorithm that selects the appropriate specific location based on the user's interest data and hometown information.

[1574] Information about the selected specific location is sent to the user's device.

[1575] Notification and display of recommended information

[1576] Terminal (user)

[1577] Recommendations are displayed as notifications on the user's device, and when the user taps the notification, detailed information is displayed.

[1578] Recording specific location visits and actions

[1579] Terminal (user)

[1580] The user visits a specific recommended location and performs an action provided within the application (e.g., leaving a review or scanning a QR code).

[1581] Send the results of the action to the server.

[1582] server

[1583] The received action information is recorded in a database and points are awarded to the user based on the action taken, as well as to the organization that manages the location.

[1584] Points allocation and management

[1585] server

[1586] The calculated points are credited to the user's account and the user is notified of the new points balance.

[1587] Terminal (user)

[1588] You will receive a notification to check your new points balance.

[1589] Points conversion and redemption

[1590] Terminal (user)

[1591] Open the point conversion settings screen within the application, select the number of points the user wants to convert and the conversion destination (e.g., PayPal), and submit the request.

[1592] server

[1593] Receives a user's request and converts points into the specified electronic money.

[1594] Notify the user of the conversion results.

[1595] Specific examples

[1596] For example, suppose a user registers "City A" as their hometown. The server analyzes the user's social media posts and calendar entries to determine that the user "likes to visit cafes." The server recommends "Cafe B in City A" and sends a notification to the user's device. The user visits "Cafe B" and scans a QR code inside the store. As a result, the user is awarded 10 points, and 10 points are also awarded to the "local organization in City A." The user then sends a request within the app to convert the 10 points into electronic money (e.g., PayPal), and the server immediately processes the conversion and notifies the user of the result.

[1597] Prompt Sentence Examples

[1598] "Please set City A as your hometown."

[1599] "Analyze user interests through social media posts and calendar events."

[1600] "Please recommend suitable cafes for users who like to go cafe-hopping in City A."

[1601] "Please calculate and award points based on users' visits to Cafe B."

[1602] "Convert your points into PayPal"

[1603] The above is an embodiment of the present invention.

[1604] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1605] Step 1: Download and install the app

[1606] Terminal (user)

[1607] A user downloads an application from an app store, installs it, and then launches it.

[1608] Input: User's device, app store

[1609] Output: Installed applications

[1610] Specifically, an application icon is generated on the device.

[1611] Step 2: Register an account

[1612] Terminal (user)

[1613] On the account registration screen, enter your email address and password to create an account.

[1614] Input: User's email address, password

[1615] Output: Account information

[1616] Specifically, the user's account data is sent to the server.

[1617] server

[1618] The received account information is stored in the database.

[1619] Input: User account information

[1620] Output: Account data stored in the database

[1621] Step 3: Set your hometown

[1622] Terminal (user)

[1623] On the hometown setting screen, select your hometown from the drop-down menu and press the Confirm button.

[1624] Input: User's chosen hometown

[1625] Output: Selected hometown information

[1626] As a specific operation, the selected hometown information is sent to the server.

[1627] server

[1628] The received hometown information is stored in a database and associated with the user information.

[1629] Input: User's hometown information

[1630] Output: User information and associated hometown data

[1631] Step 4: Permissions for other applications

[1632] Terminal (user)

[1633] On the settings screen, allow access to other applications (email, calendar, SNS, etc.).

[1634] Input: Access permission information for other applications

[1635] Output: Access permission information

[1636] As a specific operation, the access permission information is sent to the server.

[1637] Step 5: Collect and analyze interest data

[1638] server

[1639] Collect and analyze data from permitted applications to create a profile of your interests.

[1640] Input: Data collected from other applications

[1641] Output: User interest profile

[1642] Specifically, the collected data is analyzed algorithmically to generate an interest profile.

[1643] Step 6: Recommend specific locations

[1644] server

[1645] Based on the user's interest data and hometown information, appropriate specific locations are selected and recommendation information is sent to the user's device.

[1646] Input: User interest profile, hometown information

[1647] Output: Recommendation information

[1648] Specifically, a recommendation algorithm is executed, and information about recommended locations is sent to the terminal.

[1649] Step 7: Notification and display of recommended information

[1650] Terminal (user)

[1651] The received recommendation information is displayed as a notification, and when the user taps the notification, detailed information will be displayed.

[1652] Input: Recommendation information

[1653] Output: Notification, display of detailed information

[1654] Specifically, a notification will appear on the device and you can tap to open more information.

[1655] Step 8: Visit specific locations and take action

[1656] Terminal (user)

[1657] The user visits a specific recommended location and performs an action (such as writing a review or scanning a QR code).

[1658] Input: Action execution information

[1659] Output: Action result

[1660] Specifically, information about the actions performed by the user is sent to the server.

[1661] Step 9: Recording Action Results and Calculating Points

[1662] server

[1663] The received action results are recorded in a database, and points are calculated based on the action. Points are also awarded to the management organization.

[1664] Input: Action result

[1665] Output: Point calculation results, point allocation information

[1666] Specifically, points are awarded to users and management organizations based on the action results recorded in the database.

[1667] Step 10: Points balance notification

[1668] server

[1669] Notify the user of their new points balance.

[1670] Input: Point allocation information

[1671] Output: Point balance notification

[1672] Specifically, the new point balance after points are awarded is notified to the terminal.

[1673] Step 11: Request to convert points

[1674] Terminal (user)

[1675] Open the point conversion settings screen within the app, select the number of points you want to convert and the conversion destination (e.g. PayPal), and submit your request.

[1676] Input: Conversion request information, number of points, conversion destination

[1677] Output: Transformation request

[1678] As a specific operation, conversion request information is sent to the server.

[1679] Step 12: Point conversion processing and notification

[1680] server

[1681] The system receives a user's request, converts the points into the specified electronic money, and notifies the user of the conversion result.

[1682] Input: Conversion request information

[1683] Output: Conversion results, notification

[1684] Specifically, points are converted into electronic money, and the result is notified to the terminal.

[1685] (Application example 1)

[1686] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1687] Conventional landmark recommendation systems require users to manually select and navigate to destinations, making it difficult to provide efficient visit plans, especially when using autonomous vehicles. Effective personalized landmark recommendations based on hometown and interest data, as well as smooth visits using autonomous vehicles, are also desirable. Furthermore, the awarding of points through actions at visited destinations requires manual operation and is time-consuming. There is also a need for a system that simplifies the transfer of points to electronic money and the awarding of points to relevant organizations.

[1688] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1689] In this invention, the server includes: means for a user to register a hometown; means for recommending niche landmarks near the registered hometown based on data from other applications; means for awarding points when the user visits the recommended locations and performs an action; means for transferring the awarded points to other electronic money and means for awarding points to an organization having jurisdiction over the locations; means for a user to automatically visit the recommended landmarks based on the hometown and interest data in an autonomous vehicle; and means for awarding points when the user performs a specified action at the visited location. This enables users to take efficient and personalized landmark tours using autonomous vehicles, and points are automatically awarded based on actions taken during visits, allowing for smooth transfer to electronic money and awarding of points to the organization having jurisdiction.

[1690] An "autonomous vehicle" is a vehicle that operates using a self-control system without human intervention.

[1691] "Hometown" refers to the area registered by the user as their place of residence or birthplace.

[1692] A "niche landmark" is a place that is not widely known but is worth visiting depending on your particular interests or tastes.

[1693] "Recommending" means suggesting specific information or places based on a user's interests and preferences.

[1694] An "action" is a specific action a user takes at a recommended location, such as scanning a QR code or taking a photo.

[1695] "Points" are virtual currency or rewards that users can earn by performing certain actions.

[1696] "Electronic money" means currency stored and used in digital form.

[1697] "Governing Body" means an organization or body that governs or operates a particular area or service.

[1698] “Interest Data” means information that describes your preferences and interests and is collected from other applications.

[1699] This invention is a system that provides users with personalized landmark visits using autonomous vehicles. This system recommends niche landmarks within the autonomous vehicle based on the user's hometown and interest data, and awards points based on actions taken at the visited locations. The points can also be converted into other electronic money, and points can also be awarded to the relevant organization. Specific embodiments of this invention are described below.

[1700] 1. User registration and hometown setting

[1701] Terminal (user)

[1702] The user downloads, installs, and launches the application.

[1703] The user creates an account by entering an email address and password on the account registration screen.

[1704] After creating your account, on the hometown setting screen that appears, select your hometown from the drop-down menu and press the Confirm button.

[1705] server

[1706] The registered hometown information is stored in a database and associated with user information.

[1707] 2. Collecting User Interest Data

[1708] Terminal (user)

[1709] On the settings screen, allow access to other applications (email, calendar, SNS, etc.).

[1710] The information about the allowed applications is sent to the server.

[1711] server

[1712] Collect and analyze your interest data from permitted applications to create interest profiles.

[1713] 3. Local landmark recommendations

[1714] server

[1715] It runs an algorithm to select appropriate landmarks based on the user's interest data and hometown.

[1716] Recommendation information is sent to the user's device.

[1717] Terminal (user)

[1718] The received recommendation information is displayed to the user as a notification, and detailed information can be displayed by tapping on it.

[1719] 4. Autonomous visit and action recording

[1720] Autonomous vehicles

[1721] When a user gets into an autonomous vehicle, a visit plan to pre-recommended landmarks is automatically set up.

[1722] When the vehicle arrives at a designated landmark, the user will receive a notification.

[1723] Terminal (user)

[1724] The user performs the action suggested at the destination (scanning a QR code or taking a photo).

[1725] Send the result of the action to the server.

[1726] server

[1727] The information of the received actions is recorded in a database and points are awarded to the user based on the actions.

[1728] 5. Point Management and Use

[1729] server

[1730] The calculated points are awarded to the user's account, and at the same time, points are awarded to the account of the organization that has jurisdiction over the location.

[1731] A request for point conversion is received and processing for converting the points into designated electronic money is executed.

[1732] Notify the user of the conversion results.

[1733] Terminal (user)

[1734] Show the point balance to the user as a notification and send a request on the point conversion setting screen.

[1735] Specific examples

[1736] For example, suppose a user is from City A and enjoys visiting cafes. When getting into an autonomous vehicle, the system will recommend niche cafes in City A and automatically create a visit plan based on the user's interests. When the user arrives at a destination, they will receive a notification and be awarded points for taking actions such as scanning a QR code.

[1737] Prompt Sentence Examples

[1738] The user is from "City A" and is interested in "cafes" and "museums." Please recommend landmarks that can be visited from the user's current location.

[1739] In this way, the present invention provides an efficient and personalized landmark tour using an autonomous vehicle, and enables automatic points acquisition and smooth conversion to electronic money, which can contribute to promotions tailored to users' interests and regional revitalization.

[1740] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1741] Step 1:

[1742] User registration and hometown setting

[1743] Specific behavior:

[1744] The device (user) downloads, installs, and launches the application. The user creates an account by entering an email address and password on the account registration screen. After creating the account, the user selects their hometown from the drop-down menu on the hometown setting screen and presses the confirm button.

[1745] input:

[1746] User email address, password, and region of origin

[1747] Data processing / data calculation:

[1748] The server stores the entered user information in a database and associates it with the user information.

[1749] output:

[1750] User account registration completion notification

[1751] Step 2:

[1752] User interest data collection

[1753] Specific behavior:

[1754] The device (user) allows access to other applications (email, calendar, SNS, etc.) on the settings screen. Information about the allowed applications is sent to the server.

[1755] input:

[1756] Allowed Applications Data

[1757] Data processing / data calculation:

[1758] The server collects user interest data from authorized applications and uses machine learning algorithms to create an interest profile.

[1759] output:

[1760] User interest profiles

[1761] Step 3:

[1762] Local landmark recommendations

[1763] Specific behavior:

[1764] The server runs an algorithm to select appropriate landmarks based on the user's interest data and hometown, and sends the recommended information to the user's device.

[1765] input:

[1766] User interest profile, hometown

[1767] Data processing / data calculation:

[1768] The server uses a generative AI model to identify niche landmarks that match the user's interests.

[1769] output:

[1770] Recommended landmark information

[1771] Step 4:

[1772] Autonomous visit and action recording

[1773] Specific behavior:

[1774] The autonomous vehicle automatically sets up a visit plan to recommended landmarks in advance. The user gets into the vehicle and performs a specified action at the destination (scanning a QR code or taking a photo). The results of the action are sent from the device to the server.

[1775] input:

[1776] Recommended landmark information, user visit actions

[1777] Data processing / data calculation:

[1778] The server records the user's visit actions in a database, analyzes the content of the actions, and calculates points.

[1779] output:

[1780] Record of visit actions and awarded points

[1781] Step 5:

[1782] Points management and usage

[1783] Specific behavior:

[1784] The server will then add the calculated points to the user's account and simultaneously add points to the account of the organization that has jurisdiction over the location. Upon receiving a point conversion request, the server will execute the conversion process into the specified electronic money and notify the user of the result.

[1785] input:

[1786] User's point conversion request

[1787] Data processing / data calculation:

[1788] The server converts the points into electronic money and records the conversion results in a database.

[1789] output:

[1790] Notification of converted electronic money and point balance

[1791] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1792] This invention is a system that allows users to register their hometown, recommends niche landmarks in that area based on other application data, and further analyzes the user's emotional data to adjust the recommendations. A specific embodiment of this system is described below.

[1793] 1. User registration and hometown setting

[1794] Terminal (user)

[1795] The user downloads, installs, and launches the app.

[1796] A user creates an account by entering an email address and password on the account registration screen.

[1797] After creating an account, a screen for setting the area of ​​origin will appear, and the user will select their area of ​​origin (city, town, or village level) from the drop-down menu and press the confirm button.

[1798] server

[1799] The registered hometown information is stored in a database and associated with user information.

[1800] 2. Collecting User Interest Data

[1801] Terminal (user)

[1802] In the settings screen, users allow access to other applications (email, calendar, social media, etc.).

[1803] The information about the allowed applications is sent to the server.

[1804] server

[1805] Collect and analyze user interest data from permitted applications to create a user interest profile.

[1806] 3. Local landmark recommendations

[1807] server

[1808] It runs an algorithm to select appropriate landmarks based on the user's interest data and hometown.

[1809] Using an emotion engine, recommendations are adjusted based on past recommendations and emotional data from the visit.

[1810] Recommendation information is sent to the user's device.

[1811] Terminal (user)

[1812] The received recommendation information is displayed to the user as a notification, and detailed information can be displayed by tapping on it.

[1813] 4. Recording landmark visits and actions

[1814] Terminal (user)

[1815] Users visit recommended landmarks and perform actions suggested within the app (such as writing a review, scanning a QR code, or donating).

[1816] The emotion engine recognizes emotions from the user's facial expressions and voice and records emotional data during the visit.

[1817] The action result and emotion data are sent to the server.

[1818] server

[1819] The received action and emotion data is recorded in a database, and points are calculated to be awarded to the user based on the action.

[1820] 5. Points allocation and management

[1821] server

[1822] The calculated points are awarded to the user's account, and at the same time, points are awarded to the account of the organization that has jurisdiction over the location.

[1823] Terminal (user)

[1824] Display the new points balance as a notification to the user.

[1825] 6. Points Conversion and Redemption

[1826] Terminal (user)

[1827] The user opens the point conversion settings screen within the app, selects the number of points they want to convert and the conversion destination (e.g., PayPal), and submits the request.

[1828] server

[1829] It receives a user request and executes the process of converting points into the specified electronic money.

[1830] Notify the user of the conversion results.

[1831] Specific examples

[1832] For example, suppose a user is from City A and registers City A as their hometown. The server analyzes the user's social media posts, calendar appointments, and even emotional data from past visits to determine that the user likes to visit cafes.

[1833] 1. The server recommends a niche cafe called "Cafe B" in City A and notifies the user's device.

[1834] 2. The user visits "B Cafe" and scans the QR code presented inside the store.

[1835] 3. The emotion engine recognizes emotions from the user's facial expressions when scanned and records emotional data during the visit.

[1836] 4. The server receives this action and emotion data, awards 10 points to the user, and simultaneously awards 10 points to the City A Chamber of Commerce, which oversees Cafe B.

[1837] 5. When the user submits a request to convert 10 points into electronic money within the app, the server converts the points into PayPal and notifies the user.

[1838] In this way, a series of processing steps from recommending landmarks based on the user's interests to visiting, recording actions, recognizing and using emotional data, and awarding and using points are specifically explained.

[1839] The processing flow will be explained below.

[1840] User registration and hometown setting

[1841] Step 1:

[1842] The user downloads and installs the app.

[1843] Step 2:

[1844] The device launches the app and displays the account registration screen to the user.

[1845] Step 3:

[1846] The user enters an email address and password to create an account.

[1847] Step 4:

[1848] The device displays a screen for entering the region of origin.

[1849] Step 5:

[1850] The user selects their hometown from the drop-down menu and presses the confirm button.

[1851] Step 6:

[1852] The terminal transmits the input area information to the server.

[1853] Step 7:

[1854] The server stores the location information in a database and associates it with the user information.

[1855] User interest data collection

[1856] Step 1:

[1857] The device will ask for permission to access other applications on the settings screen.

[1858] Step 2:

[1859] The user selects the application for which they want to grant permission and gives their consent.

[1860] Step 3:

[1861] The server collects data related to the user's interests through the API of authorized applications.

[1862] Step 4:

[1863] The server analyzes the collected data and creates a profile of the user's interests.

[1864] Local landmark recommendations

[1865] Step 1:

[1866] The server selects appropriate landmarks based on the user's interest data and hometown.

[1867] Step 2:

[1868] The server uses an emotion engine to adjust the recommendation content, taking into account past recommendations and emotional data from the visit.

[1869] Step 3:

[1870] The server generates recommendation information and sends it to the user's device.

[1871] Step 4:

[1872] The device notifies the user of recommended information.

[1873] Step 5:

[1874] The user taps the notification to view more information.

[1875] Landmark visits and action recording

[1876] Step 1:

[1877] The user visits the recommended landmark.

[1878] Step 2:

[1879] The device displays the actions offered at the landmark (such as writing a review, scanning a QR code, or donating).

[1880] Step 3:

[1881] The user performs the suggested action (e.g., scans a QR code).

[1882] Step 4:

[1883] The emotion engine recognizes emotions from the user's facial expressions and voice.

[1884] Step 5:

[1885] The device sends the action results and emotion data to the server.

[1886] Step 6:

[1887] The server records the received actions and emotion data in a database.

[1888] Points allocation and management

[1889] Step 1:

[1890] The server calculates the points to be awarded to the user based on the recorded actions.

[1891] Step 2:

[1892] The server also simultaneously calculates points for the organization that has jurisdiction over that location.

[1893] Step 3:

[1894] The server will then credit the calculated points to the user's account.

[1895] Step 4:

[1896] The server will also award points to the governing body's account.

[1897] Step 5:

[1898] The terminal will notify the user of the new points balance.

[1899] Points conversion and redemption

[1900] Step 1:

[1901] The user opens the points conversion settings screen within the app.

[1902] Step 2:

[1903] The user selects the number of points they wish to convert and the destination (e.g., PayPal) and submits the request.

[1904] Step 3:

[1905] The server receives the user's request and converts the points into the specified electronic money.

[1906] Step 4:

[1907] The server notifies the user of the conversion results.

[1908] In this way, a series of processing steps from recommendations that take into account not only the user's interests but also their emotional data to the awarding and use of points is specifically explained.

[1909] Example 2

[1910] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1911] Modern users want to be recommended activities based on their interests and hometowns, but existing systems have difficulty combining these factors appropriately. They also lack mechanisms for providing appropriate rewards for recommended activities and for utilizing emotional data based on those activities. To address these needs, a system is needed that can comprehensively manage data based on users' interests, hometowns, and activities and make recommendations.

[1912] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for a user to register their hometown, a means for recommending niche tourist spots near the registered hometown based on data from other software, a means for collecting and analyzing user interest data to create an interest profile, a means for adjusting the recommendation content taking into account past recommendations and emotional data at the time of visit, a means for awarding points for visiting recommended tourist spots and taking actions, a means for converting the awarded points into other electronic money, and a means for awarding points to the organization that has jurisdiction over the location. This allows users to receive recommendations of tourist spots appropriate to their interests and emotions, and to receive rewards based on their actions during the visit.

[1913] "User" means an individual who uses the System.

[1914] "Hometown" refers to the geographic location that a user registers as their hometown.

[1915] A "niche tourist destination" is a place that is not well known as a tourist destination, but is attractive to users with specific interests or hobbies.

[1916] "Software" means computer programs and applications used to collect and analyze user interest and behavior data.

[1917] "Interest data" is data that indicates a user's interests, including social media posts, calendar events, and email content.

[1918] An "interest profile" is data that reflects a user's interests and hobbies, analyzed through the analysis of collected interest data.

[1919] A "recommendation algorithm" is a computational method for recommending appropriate tourist spots and activities based on a user's region of origin and interest profile.

[1920] "Emotional data" refers to data that indicates the emotions a user shows during a specific action or visit, and can also be recognized from facial expressions and voice.

[1921] "Action" refers to the specific actions that users take when visiting a recommended tourist spot (e.g., posting a review, scanning a QR code, giving a tip, etc.).

[1922] "Points" are numerical rewards given to users as a result of their actions.

[1923] "Electronic money" refers to a digital form of currency that is used to convert points.

[1924] "Organization" means an organization that manages and operates a particular tourist destination.

[1925] This invention is a system that allows users to register their hometown, recommends niche tourist spots in that area based on data from other software, and further analyzes the user's emotional data to adjust the recommendations. Specific implementation methods using each hardware and software are described below.

[1926] 1. User registration and hometown setting

[1927] Terminal (user)

[1928] Users download and install the application onto their smartphone, PC, or other device. After launching the app, they first create an account by entering their email address and password on the account registration screen. After creating the account, they are automatically taken to the hometown setting screen. From there, they select their hometown (at the city, town, or village level) from the drop-down menu and press the "Confirm" button.

[1929] server

[1930] The server stores the email address and hashed password entered by the user in a database, as well as the region of origin selected by the user, and associates this information with the user's information.

[1931] 2. Collecting User Interest Data

[1932] Terminal (user)

[1933] Users select options in the settings screen to allow access to other software (email, calendar, social networking sites, etc.), which then sends data from each piece of software to the server.

[1934] server

[1935] The server analyzes the data obtained from the authorized software and creates an interest profile that reflects the user's interests, using techniques such as natural language processing and machine learning algorithms.

[1936] 3. Local landmark recommendations

[1937] server

[1938] The server runs a recommendation algorithm based on the user's interest profile and hometown, selects appropriate tourist destinations, and uses an emotion engine to adjust the recommendations based on past recommendations and emotional data from the visit. The adjusted recommendations are then sent to the user's device.

[1939] Terminal (user)

[1940] The user's device will display the received recommendation information as a notification, and the user can tap the notification to view more information.

[1941] 4. Recording landmark visits and actions

[1942] Terminal (user)

[1943] Users visit recommended tourist spots and follow the in-app guide to perform the actions suggested (e.g., posting reviews, scanning QR codes, donating money, etc.). The emotion engine recognizes emotions from the user's facial expressions and voice, and records emotional data from the visit. The action results and emotional data are sent to the server.

[1944] server

[1945] The server records the received action and emotion data in a database and calculates points to be awarded to the user based on the action.

[1946] 5. Points allocation and management

[1947] server

[1948] The server assigns the calculated points to the user's account and also assigns points to the account of the organization that has jurisdiction over the location.

[1949] Terminal (user)

[1950] The terminal will display the new points balance to the user as a notification.

[1951] 6. Points Conversion and Redemption

[1952] Terminal (user)

[1953] Users open the point conversion settings screen within the app, select the number of points they want to convert and the conversion destination (e.g., PayPal), and submit their request.

[1954] server

[1955] The server receives the user's request, converts the points into the specified electronic money, and notifies the user of the conversion result.

[1956] Specific examples

[1957] For example, if a user is "from City A" and registers "City A" as their hometown, the server will analyze social media posts, calendar appointments, and even emotional data from past visits to determine that the user likes to visit cafes.

[1958] The server recommends a niche cafe in City A, "Cafe B," and notifies the user's device. The user visits "Cafe B" and scans the QR code presented inside the store. The emotion engine recognizes the emotion from the user's facial expression at the time and records the emotion data from the visit. The server receives this action and emotion data, awards 10 points to the user, and simultaneously awards 10 points to the organization that oversees "Cafe B." When the user sends a request within the app to convert the points into electronic money, the server converts the points into PayPal and notifies the user.

[1959] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1960] Step 1: User Registration

[1961] Terminal (user)

[1962] A user downloads and installs an application on their smartphone or computer. They launch the app, enter their email address and password on the account registration screen, and press the register button. The input information (email address, password) is sent. The output is the data sent to the server.

[1963] server

[1964] The server receives the entered email address and password, stores them in a database along with a hashed password for security, generates a registration completion message and sends it to the user's device, and outputs the user information stored in the database and a completion notification to the user.

[1965] Step 2: Set your hometown

[1966] Terminal (user)

[1967] After registering an account, the user selects their hometown (at the city / ward / town / village level) from the drop-down menu on the hometown setting screen and presses the confirm button. The input information (hometown) is sent. The output is the data sent to the server.

[1968] server

[1969] The server receives the user's hometown information and stores it in a database along with the user information. It then generates a setup completion message and sends it to the user's device. The output is the hometown information stored in the database and a completion notification to the user.

[1970] Step 3: App integration permission

[1971] Terminal (user)

[1972] The user sets access permissions for other software (email, calendar, SNS, etc.) on the settings screen. In response to the permission confirmation message, the user presses the "Allow" button. The input information (permission status) is sent. The output is the data sent to the server.

[1973] server

[1974] The server receives permission data from each software and collects user interest data. The output is the received data.

[1975] Step 4: Analyze interest data

[1976] server

[1977] The server analyzes the received interest data and creates an interest profile for the user using natural language processing and machine learning algorithms. The input is the collected data, and the output is the generated interest profile.

[1978] Step 5: Recommend tourist spots

[1979] server

[1980] The server runs a recommendation algorithm based on the user's interest profile and hometown information. It selects appropriate tourist destinations and then uses an emotion engine to adjust the recommendations based on past recommendations and emotional data from the visit. The input is the interest profile, hometown information, and emotional data, and the output is the adjusted recommendation information.

[1981] Terminal (user)

[1982] The user's device receives the recommendation information and displays it as a notification. When the user taps the notification, detailed information is displayed. The output is the displayed recommendation information.

[1983] Step 6: Visit landmarks and record actions

[1984] Terminal (user)

[1985] Users visit recommended tourist spots and follow the in-app guide to perform the actions suggested (such as posting a review, scanning a QR code, or donating). The emotion engine recognizes emotions from the user's facial expressions and voice, and records emotional data from the visit. This data is sent to the server. The input is the location visit, the actions performed, and the emotional data, and the output is the recorded data.

[1986] server

[1987] The server records the received actions and emotion data in a database and calculates the points to be awarded to the user based on the actions. The input is the submitted actions and emotion data, and the output is the calculated points.

[1988] Step 7: Points allocation and management

[1989] server

[1990] The server assigns the calculated points to the user's account and also assigns points to the account of the organization that has jurisdiction over the location. The input is the calculated points, and the output is the assigned points information.

[1991] Terminal (user)

[1992] The user's device displays the new points balance to the user as a notification. The output is the displayed points balance.

[1993] Step 8: Convert and use your points

[1994] Terminal (user)

[1995] The user opens the point conversion settings screen in the app, selects the number of points they want to convert and the conversion destination (e.g., PayPal), and submits a request. The input is the point conversion request, and the output is the data to be sent to the server.

[1996] server

[1997] The server receives the user's request, converts the points into the specified electronic money, and notifies the user of the conversion result. The input is the point conversion request, and the output is the converted electronic money and a notification message.

[1998] In this way, the entire process is explained concretely and in detail.

[1999] (Application example 2)

[2000] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2001] The problem that this invention aims to solve is to provide a system that allows users to efficiently obtain useful information related to their hometowns, while providing personalized recommendations based on the user's emotional data and interests, and furthermore, allowing these activities to contribute to the revitalization of the local economy and culture. Specifically, the problem is to recommend attractive local landmarks and brick-and-mortar stores based on the user's interests and emotions, award points based on actions taken when visiting those stores, and smoothly carry out the entire process of transferring these points to other electronic money.

[2002] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2003] In this invention, the server includes a means for a user to register their hometown, a means for recommending niche landmarks near the registered hometown based on data from other applications, a means for awarding points when the user visits a recommended place and performs an action, a means for transferring the awarded points to other electronic money and a means for awarding points to an organization that has jurisdiction over the place, and a means for analyzing the user's emotional data and adjusting the content of recommendations. This allows the server to efficiently recommend landmarks and brick-and-mortar stores that best suit the user's interests, thereby revitalizing local communities and improving the user experience.

[2004] "User" refers to a person who uses the system.

[2005] "Hometown" refers to the area where the user was born and raised, or the area to which they have a particular attachment.

[2006] A "niche landmark" refers to a tourist attraction or facility that is not well known to the general public but has particular value or appeal in a particular area.

[2007] "Data from other applications" refers to information obtained from other applications you use, such as social media posts or calendar entries.

[2008] "Recommend" refers to recommending a specific landmark or store to the user.

[2009] "Emotional data" refers to the emotional state analyzed from the user's facial expressions, voice, etc.

[2010] "Points" refer to units of virtual value that can be used in the future and are awarded to users when they perform certain actions.

[2011] "Electronic money" refers to digital currency and electronic bankbooks that can be used over the Internet.

[2012] "User Interest Data" means information about your interests and preferences, including, for example, data about your hobbies or favorite places.

[2013] "Server" refers to a computer system that receives information from users, analyzes it, and provides appropriate services.

[2014] The present invention relates to a system that allows a user to register their hometown, recommends niche landmarks in that area based on other application data, and further analyzes the user's emotional data to adjust the recommendation content. A specific embodiment of the present invention is described below.

[2015] 1. User registration and hometown setting

[2016] Terminal (user)

[2017] The user downloads and installs the application, then launches it. The user creates an account by entering an email address and password on the account registration screen. After creating the account, the hometown setting screen is displayed, and the user selects their hometown from the drop-down menu and presses the confirm button.

[2018] server

[2019] The server stores the registered hometown information in a database and associates it with user information.

[2020] 2. Collecting User Interest Data

[2021] Terminal (user)

[2022] The user allows access to other applications (email, calendar, social networking, etc.) in the settings screen.

[2023] server

[2024] It collects user interest data from authorized applications and analyzes it to create a user interest profile. It uses Python and Flask for analysis and a SQLite database.

[2025] 3. Local landmark recommendations

[2026] server

[2027] The server runs an algorithm to select appropriate landmarks based on the user's interest data and hometown. An emotion engine is used to adjust the recommendations, taking into account past recommendations and emotional data from the visit. It utilizes Python libraries and machine learning models.

[2028] Terminal (user)

[2029] The received recommendation information is displayed to the user as a notification, and detailed information can be displayed by tapping on it.

[2030] 4. Recording landmark visits and actions

[2031] Terminal (user)

[2032] The user visits a recommended landmark and performs an action suggested within the app (such as posting a review, scanning a QR code, or donating). The emotion engine recognizes the user's emotions from their facial expressions and voice, and records the emotional data from the visit. The action results and emotional data are then sent to the server.

[2033] server

[2034] The received action and emotion data is recorded in a database, and points are calculated to be awarded to the user based on the action.

[2035] 5. Points allocation and management

[2036] server

[2037] The calculated points are credited to the user's account and simultaneously credited to the account of the organization responsible for the location. A notification is generated to the user, displaying the new points balance.

[2038] 6. Points Conversion and Redemption

[2039] Terminal (user)

[2040] The user opens the point conversion settings screen within the app, selects the number of points they want to convert and the conversion destination, and submits the request.

[2041] server

[2042] Receives a user request, converts points into the specified electronic money, and notifies the user of the conversion result.

[2043] Specific examples

[2044] For example, consider a case where a user has registered a "certain city" as their "hometown." Suppose that analysis of social media posts and calendar events reveals that this user likes to visit cafes.

[2045] 1. Based on the user's interest data, the server recommends niche cafes in a certain city and notifies the user's device.

[2046] 2. The user visits the recommended cafe and scans the QR code displayed inside the store.

[2047] 3. The emotion engine recognizes "enjoyment" from the user's facial expression when scanned and records emotional data from the visit.

[2048] 4. The server receives this action and emotion data and awards 10 points to the user, as well as the organization that oversees the cafe.

[2049] 5. When the user sends a request to convert 10 points into electronic money within the app, the server converts the points into electronic money and notifies the user of the result.

[2050] Example prompts for generative AI models

[2051] The user has registered their hometown as "a certain city." Since the user likes to go cafe hopping, please recommend niche cafes within "a certain city." If the user submits emotion data as "fun," please award the user 10 points and display their point balance.

[2052] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2053] Step 1:

[2054] User registration and hometown setting

[2055] The device (user) downloads and installs the application, then launches it. The user creates an account by entering an email address and password. Next, a screen for setting the hometown appears, and the user selects their hometown from the drop-down menu and presses the confirm button.

[2056] Input: User's email address, password, hometown

[2057] Output: User information and hometown registered in the database

[2058] Specific behavior:

[2059] 1. Launching the application

[2060] 2. Enter your email address and password

[2061] 3. Select and confirm your hometown

[2062] Step 2:

[2063] User interest data collection

[2064] The device (user) allows access to other applications (e.g., email, calendar, SNS) on the settings screen. Based on that permission, the server collects and analyzes the user's interest data from other applications.

[2065] Input: User interest data (obtained from other applications)

[2066] Output: Interest profile

[2067] Specific behavior:

[2068] 1. Check permissions

[2069] 2. Data collection

[2070] 3. Creating an Interest Profile

[2071] Step 3:

[2072] Local landmark recommendations

[2073] The server runs an algorithm to select appropriate landmarks based on the user's interest data and hometown. It uses an emotion engine to adjust the recommendations based on past recommendations and emotional data from the visit. The server then sends the optimal recommendations to the user's device.

[2074] Input: User interest data, hometown, past emotional data

[2075] Output: Recommended landmark information

[2076] Specific behavior:

[2077] 1. Landmark selection based on interest data and hometown

[2078] 2. Optimizing recommendation content using an emotion engine

[2079] 3. Sending recommendation information

[2080] Step 4:

[2081] Landmark visits and action recording

[2082] The device (user) visits the recommended landmark and performs the action suggested in the app (e.g., scanning a QR code, posting a review). The emotion engine recognizes the user's emotions from their facial expressions and voice, records the emotional data during the visit, and sends it to the server along with the action results.

[2083] Input: Landmark information of visited destinations, user actions and emotion data

[2084] Output: Action results and emotion data sent to the server

[2085] Specific behavior:

[2086] 1. Landmark visit

[2087] 2. Scan QR codes and post reviews

[2088] 3. Analysis of facial expressions and voice data and recording of emotions

[2089] 4. Sending data to the server

[2090] Step 5:

[2091] Points allocation and management

[2092] The server calculates points based on the received action and emotion data. The points are awarded to the user's account and simultaneously to the account of the organization that oversees the landmark. The award result is then notified to the user's device.

[2093] Input: Action results and emotion data

[2094] Output: User and jurisdiction points balance

[2095] Specific behavior:

[2096] 1. Points Calculation

[2097] 2. Points Award

[2098] 3. Notification of point balance

[2099] Step 6:

[2100] Points conversion and redemption

[2101] The terminal (user) inputs the number of points they want to convert and the destination (electronic money) information on the point conversion setting screen and sends a request. The server receives the request, converts the points into the specified electronic money, and notifies the user of the conversion result.

[2102] Input: Number of points to convert and destination information

[2103] Output: Converted electronic money balance and notification

[2104] Specific behavior:

[2105] 1. Display the conversion settings screen

[2106] 2. Enter the number of points and conversion information

[2107] 3. Convert points into electronic money

[2108] 4. Notification of conversion results

[2109] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2110] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2111] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2112] [Fourth embodiment]

[2113] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2114] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2115] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2116] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2117] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2118] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2119] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2120] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2121] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2122] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2123] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2124] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2125] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2126] This invention is a system in which a user registers their hometown, recommends niche landmarks in that area based on other application data, and awards points when the user visits them. A specific embodiment of this system is described below.

[2127] 1. User registration and hometown setting

[2128] Terminal (user)

[2129] The user downloads, installs, and launches the app.

[2130] A user creates an account by entering an email address and password on the account registration screen.

[2131] After creating an account, a screen for setting the area of ​​origin will appear, and the user will select their area of ​​origin (city, town, or village level) from the drop-down menu and press the confirm button.

[2132] server

[2133] The registered hometown information is stored in a database and associated with user information.

[2134] 2. Collecting User Interest Data

[2135] Terminal (user)

[2136] In the settings screen, users allow access to other applications (email, calendar, social media, etc.).

[2137] The information about the allowed applications is sent to the server.

[2138] server

[2139] Collect and analyze user interest data from permitted applications to create a user interest profile.

[2140] 3. Local landmark recommendations

[2141] server

[2142] It runs an algorithm to select appropriate landmarks based on the user's interest data and hometown.

[2143] Recommendation information is sent to the user's device.

[2144] Terminal (user)

[2145] The received recommendation information is displayed to the user as a notification, and detailed information can be displayed by tapping on it.

[2146] 4. Recording landmark visits and actions

[2147] Terminal (user)

[2148] Users visit recommended landmarks and perform actions suggested within the app (such as writing a review, scanning a QR code, or donating).

[2149] Send the result of the action to the server.

[2150] server

[2151] The information of the received action is recorded in a database, and points to be awarded to the user are calculated based on the action.

[2152] 5. Points allocation and management

[2153] server

[2154] The calculated points are awarded to the user's account, and at the same time, points are awarded to the account of the organization that has jurisdiction over the location.

[2155] Terminal (user)

[2156] Display the new points balance as a notification to the user.

[2157] 6. Points Conversion and Redemption

[2158] Terminal (user)

[2159] The user opens the point conversion settings screen within the app, selects the number of points they want to convert and the conversion destination (e.g., PayPal), and submits the request.

[2160] server

[2161] It receives a user request and executes the process of converting points into the specified electronic money.

[2162] Notify the user of the conversion results.

[2163] Specific examples

[2164] For example, suppose a user is from City A and registers City A as their hometown. The server analyzes data such as the user's social media posts and calendar appointments to determine that the user likes to visit cafes.

[2165] 1. The server recommends a niche cafe called "Cafe B" in City A and notifies the user's device.

[2166] 2. The user visits "B Cafe" and scans the QR code presented inside the store.

[2167] 3. The server receives this action and awards 10 points to the user, and also awards 10 points to the City A Chamber of Commerce, which oversees Cafe B.

[2168] 4. When the user submits a request to convert 10 points into electronic money within the app, the server converts the points into PayPal and notifies the user.

[2169] In this way, a series of processes is realized in which local landmarks that match the user's interests are recommended and points are awarded for the action of visiting them.

[2170] The processing flow will be explained below.

[2171] User registration and hometown setting

[2172] Step 1:

[2173] The user downloads and installs the app.

[2174] Step 2:

[2175] The device launches the app and displays the account registration screen to the user.

[2176] Step 3:

[2177] The user enters an email address and password to create an account.

[2178] Step 4:

[2179] The device displays a screen for entering the region of origin.

[2180] Step 5:

[2181] The user selects their hometown from the drop-down menu and presses the confirm button.

[2182] Step 6:

[2183] The terminal transmits the input area information to the server.

[2184] Step 7:

[2185] The server stores the location information in a database and associates it with the user information.

[2186] User interest data collection

[2187] Step 1:

[2188] The device will ask for permission to access other applications on the settings screen.

[2189] Step 2:

[2190] The user selects the application for which they want to grant permission and gives their consent.

[2191] Step 3:

[2192] The server collects data related to the user's interests through the API of authorized applications.

[2193] Step 4:

[2194] The server analyzes the collected data and creates a profile of the user's interests.

[2195] Local landmark recommendations

[2196] Step 1:

[2197] The server selects appropriate landmarks based on the user's interest data and hometown.

[2198] Step 2:

[2199] The server generates recommendation information and sends it to the user's device.

[2200] Step 3:

[2201] The device notifies the user of recommended information.

[2202] Step 4:

[2203] The user taps the notification to view more information.

[2204] Landmark visits and action recording

[2205] Step 1:

[2206] The user visits the recommended landmark.

[2207] Step 2:

[2208] The device will suggest actions to take at the landmark (post a review, scan a QR code, or donate).

[2209] Step 3:

[2210] The user performs the suggested action (e.g., scans a QR code).

[2211] Step 4:

[2212] The device sends the result of the action to the server.

[2213] Step 5:

[2214] The server records the action information it receives in a database.

[2215] Points allocation and management

[2216] Step 1:

[2217] The server calculates the points to be awarded to the user based on the recorded actions.

[2218] Step 2:

[2219] The server also simultaneously calculates points for the organization that has jurisdiction over that location.

[2220] Step 3:

[2221] The server will then credit the calculated points to the user's account.

[2222] Step 4:

[2223] The server will also award points to the governing body's account.

[2224] Step 5:

[2225] The terminal will notify the user of the new points balance.

[2226] Points conversion and redemption

[2227] Step 1:

[2228] The user opens the points conversion settings screen within the app.

[2229] Step 2:

[2230] The user selects the number of points they wish to convert and the destination (e.g., PayPal) and submits the request.

[2231] Step 3:

[2232] The server receives the user's request and converts the points into the specified electronic money.

[2233] Step 4:

[2234] The server notifies the user of the conversion results.

[2235] In this way, a series of processing steps from recommending landmarks based on the user's interests to visiting, recording actions, and awarding and using points are specifically explained.

[2236] Example 1

[2237] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2238] Conventional regional information provision systems lack the functionality to recommend specific places based on the user's region of origin or to award points for individual actions that correspond to the user's interests, and the management of points and conversion into electronic money is cumbersome.Furthermore, points are not distributed to organizations that manage the region, making it difficult to contribute to regional development.

[2239] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2240] In this invention, the server includes means for a user to register his or her hometown, means for selecting specific places near the registered hometown based on information from other applications, means for analyzing data collected from other applications and creating a user interest profile, means for awarding points when the user visits recommended places and performs specific actions, means for converting the awarded points into other electronic money, and means for awarding points to an organization that manages the places. This allows users to easily find specific places based on their interests, earn points by visiting them, and easily convert them into electronic money, and it also becomes possible for points to be distributed automatically to local management organizations.

[2241] A "user" is an individual who uses the system to register their hometown, visit specific recommended locations, and take action.

[2242] "Area of ​​origin" refers to the area where the user was born and raised (at the city, town, or village level) that the user registers within the application.

[2243] "Specific locations" are landmarks or facilities near the user's hometown that are recommended by the system.

[2244] "Information from other applications" refers to data collected from external applications such as email, calendars, and social media.

[2245] An "interest profile" is data that describes a user's interests and preferences, created by analyzing data collected from other applications.

[2246] "Recommendation" refers to the system suggesting specific locations based on a user's interest profile and hometown.

[2247] An "action" is a specific activity a user performs at a recommended location (such as posting a review, scanning a QR code, or donating).

[2248] "Points" are a form of reward given by the system when a user performs an action.

[2249] "Electronic money" refers to online payment methods (e.g., PayPal) that can be used to convert points awarded within the system.

[2250] "Organization" refers to the organization or local group that manages or operates the specific recommended location.

[2251] This invention is a system that allows users to register their hometowns, recommends specific places in those areas based on data collected from other applications, and awards points when the users visit those places. A specific embodiment of this system is described below.

[2252] User registration and hometown setting

[2253] Terminal (user)

[2254] A user downloads and installs the application on their mobile device, then launches the application after installation.

[2255] Within the application, the user accesses the account registration screen and enters the required information (email address, password) to create an account.

[2256] After creating an account, users are taken to the hometown setting screen, where they select their hometown from the drop-down menu provided and press the confirm button.

[2257] server

[2258] The information about the place of origin entered by the user is received and stored in a database, which is then associated with the user information.

[2259] User interest data collection

[2260] Terminal (user)

[2261] In the settings screen, users can grant permission to the option to allow access to other applications (e.g., email, calendar, social networking sites).

[2262] It collects the necessary information from authorized applications and sends the data to the server.

[2263] server

[2264] It receives and analyzes data from authorized applications to create a profile of the user's interests, which is then stored in a database.

[2265] Recommend specific places in the area

[2266] server

[2267] It runs an algorithm that selects the appropriate specific location based on the user's interest data and hometown information.

[2268] Information about the selected specific location is sent to the user's device.

[2269] Notification and display of recommended information

[2270] Terminal (user)

[2271] Recommendations are displayed as notifications on the user's device, and when the user taps the notification, detailed information is displayed.

[2272] Recording specific location visits and actions

[2273] Terminal (user)

[2274] The user visits a specific recommended location and performs an action provided within the application (e.g., leaving a review or scanning a QR code).

[2275] Send the results of the action to the server.

[2276] server

[2277] The received action information is recorded in a database and points are awarded to the user based on the action taken, as well as to the organization that manages the location.

[2278] Points allocation and management

[2279] server

[2280] The calculated points are credited to the user's account and the user is notified of the new points balance.

[2281] Terminal (user)

[2282] You will receive a notification to check your new points balance.

[2283] Points conversion and redemption

[2284] Terminal (user)

[2285] Open the point conversion settings screen within the application, select the number of points the user wants to convert and the conversion destination (e.g., PayPal), and submit the request.

[2286] server

[2287] Receives a user's request and converts points into the specified electronic money.

[2288] Notify the user of the conversion results.

[2289] Specific examples

[2290] For example, suppose a user registers "City A" as their hometown. The server analyzes the user's social media posts and calendar entries to determine that the user "likes to visit cafes." The server recommends "Cafe B in City A" and sends a notification to the user's device. The user visits "Cafe B" and scans a QR code inside the store. As a result, the user is awarded 10 points, and 10 points are also awarded to the "local organization in City A." The user then sends a request within the app to convert the 10 points into electronic money (e.g., PayPal), and the server immediately processes the conversion and notifies the user of the result.

[2291] Prompt Sentence Examples

[2292] "Please set City A as your hometown."

[2293] "Analyze user interests through social media posts and calendar events."

[2294] "Please recommend suitable cafes for users who like to go cafe-hopping in City A."

[2295] "Please calculate and award points based on users' visits to Cafe B."

[2296] "Convert your points into PayPal"

[2297] The above is an embodiment of the present invention.

[2298] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2299] Step 1: Download and install the app

[2300] Terminal (user)

[2301] A user downloads an application from an app store, installs it, and then launches it.

[2302] Input: User's device, app store

[2303] Output: Installed applications

[2304] Specifically, an application icon is generated on the device.

[2305] Step 2: Register an account

[2306] Terminal (user)

[2307] On the account registration screen, enter your email address and password to create an account.

[2308] Input: User's email address, password

[2309] Output: Account information

[2310] Specifically, the user's account data is sent to the server.

[2311] server

[2312] The received account information is stored in the database.

[2313] Input: User account information

[2314] Output: Account data stored in the database

[2315] Step 3: Set your hometown

[2316] Terminal (user)

[2317] On the hometown setting screen, select your hometown from the drop-down menu and press the Confirm button.

[2318] Input: User's chosen hometown

[2319] Output: Selected hometown information

[2320] As a specific operation, the selected hometown information is sent to the server.

[2321] server

[2322] The received hometown information is stored in a database and associated with the user information.

[2323] Input: User's hometown information

[2324] Output: User information and associated hometown data

[2325] Step 4: Permissions for other applications

[2326] Terminal (user)

[2327] On the settings screen, allow access to other applications (email, calendar, SNS, etc.).

[2328] Input: Access permission information for other applications

[2329] Output: Access permission information

[2330] As a specific operation, the access permission information is sent to the server.

[2331] Step 5: Collect and analyze interest data

[2332] server

[2333] Collect and analyze data from permitted applications to create a profile of your interests.

[2334] Input: Data collected from other applications

[2335] Output: User interest profile

[2336] Specifically, the collected data is analyzed algorithmically to generate an interest profile.

[2337] Step 6: Recommend specific locations

[2338] server

[2339] Based on the user's interest data and hometown information, appropriate specific locations are selected and recommendation information is sent to the user's device.

[2340] Input: User interest profile, hometown information

[2341] Output: Recommendation information

[2342] Specifically, a recommendation algorithm is executed, and information about recommended locations is sent to the terminal.

[2343] Step 7: Notification and display of recommended information

[2344] Terminal (user)

[2345] The received recommendation information is displayed as a notification, and when the user taps the notification, detailed information will be displayed.

[2346] Input: Recommendation information

[2347] Output: Notification, display of detailed information

[2348] Specifically, a notification will appear on the device and you can tap to open more information.

[2349] Step 8: Visit specific locations and take action

[2350] Terminal (user)

[2351] The user visits a specific recommended location and performs an action (such as writing a review or scanning a QR code).

[2352] Input: Action execution information

[2353] Output: Action result

[2354] Specifically, information about the actions performed by the user is sent to the server.

[2355] Step 9: Recording Action Results and Calculating Points

[2356] server

[2357] The received action results are recorded in a database, and points are calculated based on the action. Points are also awarded to the management organization.

[2358] Input: Action result

[2359] Output: Point calculation results, point allocation information

[2360] Specifically, points are awarded to users and management organizations based on the action results recorded in the database.

[2361] Step 10: Points balance notification

[2362] server

[2363] Notify the user of their new points balance.

[2364] Input: Point allocation information

[2365] Output: Point balance notification

[2366] Specifically, the new point balance after points are awarded is notified to the terminal.

[2367] Step 11: Request to convert points

[2368] Terminal (user)

[2369] Open the point conversion settings screen within the app, select the number of points you want to convert and the conversion destination (e.g. PayPal), and submit your request.

[2370] Input: Conversion request information, number of points, conversion destination

[2371] Output: Transformation request

[2372] As a specific operation, conversion request information is sent to the server.

[2373] Step 12: Point conversion processing and notification

[2374] server

[2375] The system receives a user's request, converts the points into the specified electronic money, and notifies the user of the conversion result.

[2376] Input: Conversion request information

[2377] Output: Conversion results, notification

[2378] Specifically, points are converted into electronic money, and the result is notified to the terminal.

[2379] (Application example 1)

[2380] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2381] Conventional landmark recommendation systems require users to manually select and navigate to destinations, making it difficult to provide efficient visit plans, especially when using autonomous vehicles. Effective personalized landmark recommendations based on hometown and interest data, as well as smooth visits using autonomous vehicles, are also desirable. Furthermore, the awarding of points through actions at visited destinations requires manual operation and is time-consuming. There is also a need for a system that simplifies the transfer of points to electronic money and the awarding of points to relevant organizations.

[2382] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2383] In this invention, the server includes: means for a user to register a hometown; means for recommending niche landmarks near the registered hometown based on data from other applications; means for awarding points when the user visits the recommended locations and performs an action; means for transferring the awarded points to other electronic money and means for awarding points to an organization having jurisdiction over the locations; means for a user to automatically visit the recommended landmarks based on the hometown and interest data in an autonomous vehicle; and means for awarding points when the user performs a specified action at the visited location. This enables users to take efficient and personalized landmark tours using autonomous vehicles, and points are automatically awarded based on actions taken during visits, allowing for smooth transfer to electronic money and awarding of points to the organization having jurisdiction.

[2384] An "autonomous vehicle" is a vehicle that operates using a self-control system without human intervention.

[2385] "Hometown" refers to the area registered by the user as their place of residence or birthplace.

[2386] A "niche landmark" is a place that is not widely known but is worth visiting depending on your particular interests or tastes.

[2387] "Recommending" means suggesting specific information or places based on a user's interests and preferences.

[2388] An "action" is a specific action a user takes at a recommended location, such as scanning a QR code or taking a photo.

[2389] "Points" are virtual currency or rewards that users can earn by performing certain actions.

[2390] "Electronic money" means currency stored and used in digital form.

[2391] "Governing Body" means an organization or body that governs or operates a particular area or service.

[2392] “Interest Data” means information that describes your preferences and interests and is collected from other applications.

[2393] This invention is a system that provides users with personalized landmark visits using autonomous vehicles. This system recommends niche landmarks within the autonomous vehicle based on the user's hometown and interest data, and awards points based on actions taken at the visited locations. The points can also be converted into other electronic money, and points can also be awarded to the relevant organization. Specific embodiments of this invention are described below.

[2394] 1. User registration and hometown setting

[2395] Terminal (user)

[2396] The user downloads, installs, and launches the application.

[2397] The user creates an account by entering an email address and password on the account registration screen.

[2398] After creating your account, on the hometown setting screen that appears, select your hometown from the drop-down menu and press the Confirm button.

[2399] server

[2400] The registered hometown information is stored in a database and associated with user information.

[2401] 2. Collecting User Interest Data

[2402] Terminal (user)

[2403] On the settings screen, allow access to other applications (email, calendar, SNS, etc.).

[2404] The information about the allowed applications is sent to the server.

[2405] server

[2406] Collect and analyze your interest data from permitted applications to create interest profiles.

[2407] 3. Local landmark recommendations

[2408] server

[2409] It runs an algorithm to select appropriate landmarks based on the user's interest data and hometown.

[2410] Recommendation information is sent to the user's device.

[2411] Terminal (user)

[2412] The received recommendation information is displayed to the user as a notification, and detailed information can be displayed by tapping on it.

[2413] 4. Autonomous visit and action recording

[2414] Autonomous vehicles

[2415] When a user gets into an autonomous vehicle, a visit plan to pre-recommended landmarks is automatically set up.

[2416] When the vehicle arrives at a designated landmark, the user will receive a notification.

[2417] Terminal (user)

[2418] The user performs the action suggested at the destination (scanning a QR code or taking a photo).

[2419] Send the result of the action to the server.

[2420] server

[2421] The information of the received actions is recorded in a database and points are awarded to the user based on the actions.

[2422] 5. Point Management and Use

[2423] server

[2424] The calculated points are awarded to the user's account, and at the same time, points are awarded to the account of the organization that has jurisdiction over the location.

[2425] A request for point conversion is received and processing for converting the points into designated electronic money is executed.

[2426] Notify the user of the conversion results.

[2427] Terminal (user)

[2428] Show the point balance to the user as a notification and send a request on the point conversion setting screen.

[2429] Specific examples

[2430] For example, suppose a user is from City A and enjoys visiting cafes. When getting into an autonomous vehicle, the system will recommend niche cafes in City A and automatically create a visit plan based on the user's interests. When the user arrives at a destination, they will receive a notification and be awarded points for taking actions such as scanning a QR code.

[2431] Prompt Sentence Examples

[2432] The user is from "City A" and is interested in "cafes" and "museums." Please recommend landmarks that can be visited from the user's current location.

[2433] In this way, the present invention provides an efficient and personalized landmark tour using an autonomous vehicle, and enables automatic points acquisition and smooth conversion to electronic money, which can contribute to promotions tailored to users' interests and regional revitalization.

[2434] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2435] Step 1:

[2436] User registration and hometown setting

[2437] Specific behavior:

[2438] The device (user) downloads, installs, and launches the application. The user creates an account by entering an email address and password on the account registration screen. After creating the account, the user selects their hometown from the drop-down menu on the hometown setting screen and presses the confirm button.

[2439] input:

[2440] User email address, password, and region of origin

[2441] Data processing / data calculation:

[2442] The server stores the entered user information in a database and associates it with the user information.

[2443] output:

[2444] User account registration completion notification

[2445] Step 2:

[2446] User interest data collection

[2447] Specific behavior:

[2448] The device (user) allows access to other applications (email, calendar, SNS, etc.) on the settings screen. Information about the allowed applications is sent to the server.

[2449] input:

[2450] Allowed Applications Data

[2451] Data processing / data calculation:

[2452] The server collects user interest data from authorized applications and uses machine learning algorithms to create an interest profile.

[2453] output:

[2454] User interest profiles

[2455] Step 3:

[2456] Local landmark recommendations

[2457] Specific behavior:

[2458] The server runs an algorithm to select appropriate landmarks based on the user's interest data and hometown, and sends the recommended information to the user's device.

[2459] input:

[2460] User interest profile, hometown

[2461] Data processing / data calculation:

[2462] The server uses a generative AI model to identify niche landmarks that match the user's interests.

[2463] output:

[2464] Recommended landmark information

[2465] Step 4:

[2466] Autonomous visit and action recording

[2467] Specific behavior:

[2468] The autonomous vehicle automatically sets up a visit plan to recommended landmarks in advance. The user gets into the vehicle and performs a specified action at the destination (scanning a QR code or taking a photo). The results of the action are sent from the device to the server.

[2469] input:

[2470] Recommended landmark information, user visit actions

[2471] Data processing / data calculation:

[2472] The server records the user's visit actions in a database, analyzes the content of the actions, and calculates points.

[2473] output:

[2474] Record of visit actions and awarded points

[2475] Step 5:

[2476] Points management and usage

[2477] Specific behavior:

[2478] The server will then add the calculated points to the user's account and simultaneously add points to the account of the organization that has jurisdiction over the location. Upon receiving a point conversion request, the server will execute the conversion process into the specified electronic money and notify the user of the result.

[2479] input:

[2480] User's point conversion request

[2481] Data processing / data calculation:

[2482] The server converts the points into electronic money and records the conversion results in a database.

[2483] output:

[2484] Notification of converted electronic money and point balance

[2485] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2486] This invention is a system that allows users to register their hometown, recommends niche landmarks in that area based on other application data, and further analyzes the user's emotional data to adjust the recommendations. A specific embodiment of this system is described below.

[2487] 1. User registration and hometown setting

[2488] Terminal (user)

[2489] The user downloads, installs, and launches the app.

[2490] A user creates an account by entering an email address and password on the account registration screen.

[2491] After creating an account, a screen for setting the area of ​​origin will appear, and the user will select their area of ​​origin (city, town, or village level) from the drop-down menu and press the confirm button.

[2492] server

[2493] The registered hometown information is stored in a database and associated with user information.

[2494] 2. Collecting User Interest Data

[2495] Terminal (user)

[2496] In the settings screen, users allow access to other applications (email, calendar, social media, etc.).

[2497] The information about the allowed applications is sent to the server.

[2498] server

[2499] Collect and analyze user interest data from permitted applications to create a user interest profile.

[2500] 3. Local landmark recommendations

[2501] server

[2502] It runs an algorithm to select appropriate landmarks based on the user's interest data and hometown.

[2503] Using an emotion engine, recommendations are adjusted based on past recommendations and emotional data from the visit.

[2504] Recommendation information is sent to the user's device.

[2505] Terminal (user)

[2506] The received recommendation information is displayed to the user as a notification, and detailed information can be displayed by tapping on it.

[2507] 4. Recording landmark visits and actions

[2508] Terminal (user)

[2509] Users visit recommended landmarks and perform actions suggested within the app (such as writing a review, scanning a QR code, or donating).

[2510] The emotion engine recognizes emotions from the user's facial expressions and voice and records emotional data during the visit.

[2511] The action result and emotion data are sent to the server.

[2512] server

[2513] The received action and emotion data is recorded in a database, and points are calculated to be awarded to the user based on the action.

[2514] 5. Points allocation and management

[2515] server

[2516] The calculated points are awarded to the user's account, and at the same time, points are awarded to the account of the organization that has jurisdiction over the location.

[2517] Terminal (user)

[2518] Display the new points balance as a notification to the user.

[2519] 6. Points Conversion and Redemption

[2520] Terminal (user)

[2521] The user opens the point conversion settings screen within the app, selects the number of points they want to convert and the conversion destination (e.g., PayPal), and submits the request.

[2522] server

[2523] It receives a user request and executes the process of converting points into the specified electronic money.

[2524] Notify the user of the conversion results.

[2525] Specific examples

[2526] For example, suppose a user is from City A and registers City A as their hometown. The server analyzes the user's social media posts, calendar appointments, and even emotional data from past visits to determine that the user likes to visit cafes.

[2527] 1. The server recommends a niche cafe called "Cafe B" in City A and notifies the user's device.

[2528] 2. The user visits "B Cafe" and scans the QR code presented inside the store.

[2529] 3. The emotion engine recognizes emotions from the user's facial expressions when scanned and records emotional data during the visit.

[2530] 4. The server receives this action and emotion data, awards 10 points to the user, and simultaneously awards 10 points to the City A Chamber of Commerce, which oversees Cafe B.

[2531] 5. When the user submits a request to convert 10 points into electronic money within the app, the server converts the points into PayPal and notifies the user.

[2532] In this way, a series of processing steps from recommending landmarks based on the user's interests to visiting, recording actions, recognizing and using emotional data, and awarding and using points are specifically explained.

[2533] The processing flow will be explained below.

[2534] User registration and hometown setting

[2535] Step 1:

[2536] The user downloads and installs the app.

[2537] Step 2:

[2538] The device launches the app and displays the account registration screen to the user.

[2539] Step 3:

[2540] The user enters an email address and password to create an account.

[2541] Step 4:

[2542] The device displays a screen for entering the region of origin.

[2543] Step 5:

[2544] The user selects their hometown from the drop-down menu and presses the confirm button.

[2545] Step 6:

[2546] The terminal transmits the input area information to the server.

[2547] Step 7:

[2548] The server stores the location information in a database and associates it with the user information.

[2549] User interest data collection

[2550] Step 1:

[2551] The device will ask for permission to access other applications on the settings screen.

[2552] Step 2:

[2553] The user selects the application for which they want to grant permission and gives their consent.

[2554] Step 3:

[2555] The server collects data related to the user's interests through the API of authorized applications.

[2556] Step 4:

[2557] The server analyzes the collected data and creates a profile of the user's interests.

[2558] Local landmark recommendations

[2559] Step 1:

[2560] The server selects appropriate landmarks based on the user's interest data and hometown.

[2561] Step 2:

[2562] The server uses an emotion engine to adjust the recommendation content, taking into account past recommendations and emotional data from the visit.

[2563] Step 3:

[2564] The server generates recommendation information and sends it to the user's device.

[2565] Step 4:

[2566] The device notifies the user of recommended information.

[2567] Step 5:

[2568] The user taps the notification to view more information.

[2569] Landmark visits and action recording

[2570] Step 1:

[2571] The user visits the recommended landmark.

[2572] Step 2:

[2573] The device displays the actions offered at the landmark (such as writing a review, scanning a QR code, or donating).

[2574] Step 3:

[2575] The user performs the suggested action (e.g., scans a QR code).

[2576] Step 4:

[2577] The emotion engine recognizes emotions from the user's facial expressions and voice.

[2578] Step 5:

[2579] The device sends the action results and emotion data to the server.

[2580] Step 6:

[2581] The server records the received actions and emotion data in a database.

[2582] Points allocation and management

[2583] Step 1:

[2584] The server calculates the points to be awarded to the user based on the recorded actions.

[2585] Step 2:

[2586] The server also simultaneously calculates points for the organization that has jurisdiction over that location.

[2587] Step 3:

[2588] The server will then credit the calculated points to the user's account.

[2589] Step 4:

[2590] The server will also award points to the governing body's account.

[2591] Step 5:

[2592] The terminal will notify the user of the new points balance.

[2593] Points conversion and redemption

[2594] Step 1:

[2595] The user opens the points conversion settings screen within the app.

[2596] Step 2:

[2597] The user selects the number of points they wish to convert and the destination (e.g., PayPal) and submits the request.

[2598] Step 3:

[2599] The server receives the user's request and converts the points into the specified electronic money.

[2600] Step 4:

[2601] The server notifies the user of the conversion results.

[2602] In this way, a series of processing steps from recommendations that take into account not only the user's interests but also their emotional data to the awarding and use of points is specifically explained.

[2603] Example 2

[2604] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2605] Modern users want to be recommended activities based on their interests and hometowns, but existing systems have difficulty combining these factors appropriately. They also lack mechanisms for providing appropriate rewards for recommended activities and for utilizing emotional data based on those activities. To address these needs, a system is needed that can comprehensively manage data based on users' interests, hometowns, and activities and make recommendations.

[2606] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for a user to register their hometown, a means for recommending niche tourist spots near the registered hometown based on data from other software, a means for collecting and analyzing user interest data to create an interest profile, a means for adjusting the recommendation content taking into account past recommendations and emotional data at the time of visit, a means for awarding points for visiting recommended tourist spots and taking actions, a means for converting the awarded points into other electronic money, and a means for awarding points to the organization that has jurisdiction over the location. This allows users to receive recommendations of tourist spots appropriate to their interests and emotions, and to receive rewards based on their actions during the visit.

[2607] "User" means an individual who uses the System.

[2608] "Hometown" refers to the geographic location that a user registers as their hometown.

[2609] A "niche tourist destination" is a place that is not well known as a tourist destination, but is attractive to users with specific interests or hobbies.

[2610] "Software" means computer programs and applications used to collect and analyze user interest and behavior data.

[2611] "Interest data" is data that indicates a user's interests, including social media posts, calendar events, and email content.

[2612] An "interest profile" is data that reflects a user's interests and hobbies, analyzed through the analysis of collected interest data.

[2613] A "recommendation algorithm" is a computational method for recommending appropriate tourist spots and activities based on a user's region of origin and interest profile.

[2614] "Emotional data" refers to data that indicates the emotions a user shows during a specific action or visit, and can also be recognized from facial expressions and voice.

[2615] "Action" refers to the specific actions that users take when visiting a recommended tourist spot (e.g., posting a review, scanning a QR code, giving a tip, etc.).

[2616] "Points" are numerical rewards given to users as a result of their actions.

[2617] "Electronic money" refers to a digital form of currency that is used to convert points.

[2618] "Organization" means an organization that manages and operates a particular tourist destination.

[2619] This invention is a system that allows users to register their hometown, recommends niche tourist spots in that area based on data from other software, and further analyzes the user's emotional data to adjust the recommendations. Specific implementation methods using each hardware and software are described below.

[2620] 1. User registration and hometown setting

[2621] Terminal (user)

[2622] Users download and install the application onto their smartphone, PC, or other device. After launching the app, they first create an account by entering their email address and password on the account registration screen. After creating the account, they are automatically taken to the hometown setting screen. From there, they select their hometown (at the city, town, or village level) from the drop-down menu and press the "Confirm" button.

[2623] server

[2624] The server stores the email address and hashed password entered by the user in a database, as well as the region of origin selected by the user, and associates this information with the user's information.

[2625] 2. Collecting User Interest Data

[2626] Terminal (user)

[2627] Users select options in the settings screen to allow access to other software (email, calendar, social networking sites, etc.), which then sends data from each piece of software to the server.

[2628] server

[2629] The server analyzes the data obtained from the authorized software and creates an interest profile that reflects the user's interests, using techniques such as natural language processing and machine learning algorithms.

[2630] 3. Local landmark recommendations

[2631] server

[2632] The server runs a recommendation algorithm based on the user's interest profile and hometown, selects appropriate tourist destinations, and uses an emotion engine to adjust the recommendations based on past recommendations and emotional data from the visit. The adjusted recommendations are then sent to the user's device.

[2633] Terminal (user)

[2634] The user's device will display the received recommendation information as a notification, and the user can tap the notification to view more information.

[2635] 4. Recording landmark visits and actions

[2636] Terminal (user)

[2637] Users visit recommended tourist spots and follow the in-app guide to perform the actions suggested (e.g., posting reviews, scanning QR codes, donating money, etc.). The emotion engine recognizes emotions from the user's facial expressions and voice, and records emotional data from the visit. The action results and emotional data are sent to the server.

[2638] server

[2639] The server records the received action and emotion data in a database and calculates points to be awarded to the user based on the action.

[2640] 5. Points allocation and management

[2641] server

[2642] The server assigns the calculated points to the user's account and also assigns points to the account of the organization that has jurisdiction over the location.

[2643] Terminal (user)

[2644] The terminal will display the new points balance to the user as a notification.

[2645] 6. Points Conversion and Redemption

[2646] Terminal (user)

[2647] Users open the point conversion settings screen within the app, select the number of points they want to convert and the conversion destination (e.g., PayPal), and submit their request.

[2648] server

[2649] The server receives the user's request, converts the points into the specified electronic money, and notifies the user of the conversion result.

[2650] Specific examples

[2651] For example, if a user is "from City A" and registers "City A" as their hometown, the server will analyze social media posts, calendar appointments, and even emotional data from past visits to determine that the user likes to visit cafes.

[2652] The server recommends a niche cafe in City A, "Cafe B," and notifies the user's device. The user visits "Cafe B" and scans the QR code presented inside the store. The emotion engine recognizes the emotion from the user's facial expression at the time and records the emotion data from the visit. The server receives this action and emotion data, awards 10 points to the user, and simultaneously awards 10 points to the organization that oversees "Cafe B." When the user sends a request within the app to convert the points into electronic money, the server converts the points into PayPal and notifies the user.

[2653] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2654] Step 1: User Registration

[2655] Terminal (user)

[2656] A user downloads and installs an application on their smartphone or computer. They launch the app, enter their email address and password on the account registration screen, and press the register button. The input information (email address, password) is sent. The output is the data sent to the server.

[2657] server

[2658] The server receives the entered email address and password, stores them in a database along with a hashed password for security, generates a registration completion message and sends it to the user's device, and outputs the user information stored in the database and a completion notification to the user.

[2659] Step 2: Set your hometown

[2660] Terminal (user)

[2661] After registering an account, the user selects their hometown (at the city / ward / town / village level) from the drop-down menu on the hometown setting screen and presses the confirm button. The input information (hometown) is sent. The output is the data sent to the server.

[2662] server

[2663] The server receives the user's hometown information and stores it in a database along with the user information. It then generates a setup completion message and sends it to the user's device. The output is the hometown information stored in the database and a completion notification to the user.

[2664] Step 3: App integration permission

[2665] Terminal (user)

[2666] The user sets access permissions for other software (email, calendar, SNS, etc.) on the settings screen. In response to the permission confirmation message, the user presses the "Allow" button. The input information (permission status) is sent. The output is the data sent to the server.

[2667] server

[2668] The server receives permission data from each software and collects user interest data. The output is the received data.

[2669] Step 4: Analyze interest data

[2670] server

[2671] The server analyzes the received interest data and creates an interest profile for the user using natural language processing and machine learning algorithms. The input is the collected data, and the output is the generated interest profile.

[2672] Step 5: Recommend tourist spots

[2673] server

[2674] The server runs a recommendation algorithm based on the user's interest profile and hometown information. It selects appropriate tourist destinations and then uses an emotion engine to adjust the recommendations based on past recommendations and emotional data from the visit. The input is the interest profile, hometown information, and emotional data, and the output is the adjusted recommendation information.

[2675] Terminal (user)

[2676] The user's device receives the recommendation information and displays it as a notification. When the user taps the notification, detailed information is displayed. The output is the displayed recommendation information.

[2677] Step 6: Visit landmarks and record actions

[2678] Terminal (user)

[2679] Users visit recommended tourist spots and follow the in-app guide to perform the actions suggested (such as posting a review, scanning a QR code, or donating). The emotion engine recognizes emotions from the user's facial expressions and voice, and records emotional data from the visit. This data is sent to the server. The input is the location visit, the actions performed, and the emotional data, and the output is the recorded data.

[2680] server

[2681] The server records the received actions and emotion data in a database and calculates the points to be awarded to the user based on the actions. The input is the submitted actions and emotion data, and the output is the calculated points.

[2682] Step 7: Points allocation and management

[2683] server

[2684] The server assigns the calculated points to the user's account and also assigns points to the account of the organization that has jurisdiction over the location. The input is the calculated points, and the output is the assigned points information.

[2685] Terminal (user)

[2686] The user's device displays the new points balance to the user as a notification. The output is the displayed points balance.

[2687] Step 8: Convert and use your points

[2688] Terminal (user)

[2689] The user opens the point conversion settings screen in the app, selects the number of points they want to convert and the conversion destination (e.g., PayPal), and submits a request. The input is the point conversion request, and the output is the data to be sent to the server.

[2690] server

[2691] The server receives the user's request, converts the points into the specified electronic money, and notifies the user of the conversion result. The input is the point conversion request, and the output is the converted electronic money and a notification message.

[2692] In this way, the entire process is explained concretely and in detail.

[2693] (Application example 2)

[2694] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2695] The problem that this invention aims to solve is to provide a system that allows users to efficiently obtain useful information related to their hometowns, while providing personalized recommendations based on the user's emotional data and interests, and furthermore, allowing these activities to contribute to the revitalization of the local economy and culture. Specifically, the problem is to recommend attractive local landmarks and brick-and-mortar stores based on the user's interests and emotions, award points based on actions taken when visiting those stores, and smoothly carry out the entire process of transferring these points to other electronic money.

[2696] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2697] In this invention, the server includes a means for a user to register their hometown, a means for recommending niche landmarks near the registered hometown based on data from other applications, a means for awarding points when the user visits a recommended place and performs an action, a means for transferring the awarded points to other electronic money and a means for awarding points to an organization that has jurisdiction over the place, and a means for analyzing the user's emotional data and adjusting the content of recommendations. This allows the server to efficiently recommend landmarks and brick-and-mortar stores that best suit the user's interests, thereby revitalizing local communities and improving the user experience.

[2698] "User" refers to a person who uses the system.

[2699] "Hometown" refers to the area where the user was born and raised, or the area to which they have a particular attachment.

[2700] A "niche landmark" refers to a tourist attraction or facility that is not well known to the general public but has particular value or appeal in a particular area.

[2701] "Data from other applications" refers to information obtained from other applications you use, such as social media posts or calendar entries.

[2702] "Recommend" refers to recommending a specific landmark or store to the user.

[2703] "Emotional data" refers to the emotional state analyzed from the user's facial expressions, voice, etc.

[2704] "Points" refer to units of virtual value that can be used in the future and are awarded to users when they perform certain actions.

[2705] "Electronic money" refers to digital currency and electronic bankbooks that can be used over the Internet.

[2706] "User Interest Data" means information about your interests and preferences, including, for example, data about your hobbies or favorite places.

[2707] "Server" refers to a computer system that receives information from users, analyzes it, and provides appropriate services.

[2708] The present invention relates to a system that allows a user to register their hometown, recommends niche landmarks in that area based on other application data, and further analyzes the user's emotional data to adjust the recommendation content. A specific embodiment of the present invention is described below.

[2709] 1. User registration and hometown setting

[2710] Terminal (user)

[2711] The user downloads and installs the application, then launches it. The user creates an account by entering an email address and password on the account registration screen. After creating the account, the hometown setting screen is displayed, and the user selects their hometown from the drop-down menu and presses the confirm button.

[2712] server

[2713] The server stores the registered hometown information in a database and associates it with user information.

[2714] 2. Collecting User Interest Data

[2715] Terminal (user)

[2716] The user allows access to other applications (email, calendar, social networking, etc.) in the settings screen.

[2717] server

[2718] It collects user interest data from authorized applications and analyzes it to create a user interest profile. It uses Python and Flask for analysis and a SQLite database.

[2719] 3. Local landmark recommendations

[2720] server

[2721] The server runs an algorithm to select appropriate landmarks based on the user's interest data and hometown. An emotion engine is used to adjust the recommendations, taking into account past recommendations and emotional data from the visit. It utilizes Python libraries and machine learning models.

[2722] Terminal (user)

[2723] The received recommendation information is displayed to the user as a notification, and detailed information can be displayed by tapping on it.

[2724] 4. Recording landmark visits and actions

[2725] Terminal (user)

[2726] The user visits a recommended landmark and performs an action suggested within the app (such as posting a review, scanning a QR code, or donating). The emotion engine recognizes the user's emotions from their facial expressions and voice, and records the emotional data from the visit. The action results and emotional data are then sent to the server.

[2727] server

[2728] The received action and emotion data is recorded in a database, and points are calculated to be awarded to the user based on the action.

[2729] 5. Points allocation and management

[2730] server

[2731] The calculated points are credited to the user's account and simultaneously credited to the account of the organization responsible for the location. A notification is generated to the user, displaying the new points balance.

[2732] 6. Points Conversion and Redemption

[2733] Terminal (user)

[2734] The user opens the point conversion settings screen within the app, selects the number of points they want to convert and the conversion destination, and submits the request.

[2735] server

[2736] Receives a user request, converts points into the specified electronic money, and notifies the user of the conversion result.

[2737] Specific examples

[2738] For example, consider a case where a user has registered a "certain city" as their "hometown." Suppose that analysis of social media posts and calendar events reveals that this user likes to visit cafes.

[2739] 1. Based on the user's interest data, the server recommends niche cafes in a certain city and notifies the user's device.

[2740] 2. The user visits the recommended cafe and scans the QR code displayed inside the store.

[2741] 3. The emotion engine recognizes "enjoyment" from the user's facial expression when scanned and records emotional data from the visit.

[2742] 4. The server receives this action and emotion data and awards 10 points to the user, as well as the organization that oversees the cafe.

[2743] 5. When the user sends a request to convert 10 points into electronic money within the app, the server converts the points into electronic money and notifies the user of the result.

[2744] Example prompts for generative AI models

[2745] The user has registered their hometown as "a certain city." Since the user likes to go cafe hopping, please recommend niche cafes within "a certain city." If the user submits emotion data as "fun," please award the user 10 points and display their point balance.

[2746] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2747] Step 1:

[2748] User registration and hometown setting

[2749] The device (user) downloads and installs the application, then launches it. The user creates an account by entering an email address and password. Next, a screen for setting the hometown appears, and the user selects their hometown from the drop-down menu and presses the confirm button.

[2750] Input: User's email address, password, hometown

[2751] Output: User information and hometown registered in the database

[2752] Specific behavior:

[2753] 1. Launching the application

[2754] 2. Enter your email address and password

[2755] 3. Select and confirm your hometown

[2756] Step 2:

[2757] User interest data collection

[2758] The device (user) allows access to other applications (e.g., email, calendar, SNS) on the settings screen. Based on that permission, the server collects and analyzes the user's interest data from other applications.

[2759] Input: User interest data (obtained from other applications)

[2760] Output: Interest profile

[2761] Specific behavior:

[2762] 1. Check permissions

[2763] 2. Data collection

[2764] 3. Creating an Interest Profile

[2765] Step 3:

[2766] Local landmark recommendations

[2767] The server runs an algorithm to select appropriate landmarks based on the user's interest data and hometown. It uses an emotion engine to adjust the recommendations based on past recommendations and emotional data from the visit. The server then sends the optimal recommendations to the user's device.

[2768] Input: User interest data, hometown, past emotional data

[2769] Output: Recommended landmark information

[2770] Specific behavior:

[2771] 1. Landmark selection based on interest data and hometown

[2772] 2. Optimizing recommendation content using an emotion engine

[2773] 3. Sending recommendation information

[2774] Step 4:

[2775] Landmark visits and action recording

[2776] The device (user) visits the recommended landmark and performs the action suggested in the app (e.g., scanning a QR code, posting a review). The emotion engine recognizes the user's emotions from their facial expressions and voice, records the emotional data during the visit, and sends it to the server along with the action results.

[2777] Input: Landmark information of visited destinations, user actions and emotion data

[2778] Output: Action results and emotion data sent to the server

[2779] Specific behavior:

[2780] 1. Landmark visit

[2781] 2. Scan QR codes and post reviews

[2782] 3. Analysis of facial expressions and voice data and recording of emotions

[2783] 4. Sending data to the server

[2784] Step 5:

[2785] Points allocation and management

[2786] The server calculates points based on the received action and emotion data. The points are awarded to the user's account and simultaneously to the account of the organization that oversees the landmark. The award result is then notified to the user's device.

[2787] Input: Action results and emotion data

[2788] Output: User and jurisdiction points balance

[2789] Specific behavior:

[2790] 1. Points Calculation

[2791] 2. Points Award

[2792] 3. Notification of point balance

[2793] Step 6:

[2794] Points conversion and redemption

[2795] The terminal (user) inputs the number of points they want to convert and the destination (electronic money) information on the point conversion setting screen and sends a request. The server receives the request, converts the points into the specified electronic money, and notifies the user of the conversion result.

[2796] Input: Number of points to convert and destination information

[2797] Output: Converted electronic money balance and notification

[2798] Specific behavior:

[2799] 1. Display the conversion settings screen

[2800] 2. Enter the number of points and conversion information

[2801] 3. Convert points into electronic money

[2802] 4. Notification of conversion results

[2803] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2804] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the ...

Claims

1. A means for users to register their hometown, A means for recommending niche landmarks near the registered hometown based on data from other applications; A method for users to earn points by visiting recommended places and taking action, A means for transferring the awarded points to other electronic money and a means for awarding the points to an organization having jurisdiction over the place; A system including:

2. 10. The system of claim 1, further comprising means for recording and transmitting user actions to a server.

3. 10. The system of claim 1, further comprising means for collecting and analyzing user interest data from other applications.

Images