System

Abstract

A system is provided.SOLUTION: A system comprising: means for obtaining location information of a user; means for providing surrounding tourist attraction information, a waiting time, and a shortest route based on the obtained location information; means for storing historical information of visiting tourist attractions and purchasing historical information; and means for recommending a next travel plan based on the stored historical information and purchasing historical information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Travelers want to travel efficiently and enjoy sightseeing at tourist destinations, but currently, information about waiting times and travel routes is not provided sufficiently, which often hinders planning. There is also a lack of tools to organize travel memories and use them to plan the next trip. For this reason, a new approach is needed to enjoy sightseeing efficiently and utilize past travel data. [Means for solving the problem]

[0005] To solve the above problems, the present invention provides a system including: means for acquiring user location information; means for providing information on nearby tourist attractions, waiting times, and the shortest route based on the acquired location information; means for saving history information on visits to tourist attractions and purchase history information; and means for recommending next travel plans based on the saved history information and purchase history information. The system also includes means for receiving travel destination information entered by the user; means for providing information on nearby restaurants and seat availability based on the travel destination information; and means for automatically organizing and editing saved photo data. This allows travelers to enjoy sightseeing efficiently and makes it easier for them to plan their next trip based on past travel data.

[0006] "Means for obtaining location information" refers to technology or devices for measuring the user's current location and providing that information to the system.

[0007] "Means for providing information on nearby tourist spots" refers to technologies and services that provide users with detailed information on nearby tourist spots based on location information.

[0008] "Means for providing waiting times" refers to technologies and systems that notify users of the current congestion situation and waiting times at specific locations or tourist attractions.

[0009] "Means for providing the shortest route" refers to technology or applications that calculate and provide the quickest route from the user's current location to their destination.

[0010] "Means for storing historical information" refers to technologies and systems for recording and storing data about the places a user visits and the services they use.

[0011] "Purchase history information" refers to a record of purchases made by a user during a trip.

[0012] "Means for recommending next travel plans" refers to technologies and systems that analyze past history information and purchase history information and suggest useful information and plans to users for their next trip.

[0013] "Means for receiving travel destination information" refers to the technology or interface that receives information about the destination or travel destination selected or entered by the user.

[0014] "Means for providing restaurant information" refers to technologies and services for providing users with detailed information about restaurants, cafes, and other eating and drinking establishments within a specified area.

[0015] "Means for providing seat availability" refers to technologies and systems that notify users of current seat availability and availability at nearby restaurants and other facilities.

[0016] "Means for automatically organizing and editing photo data" refers to technology or applications that automatically organize photos taken by users based on categories such as time and location, and perform editing processes as necessary. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] This invention relates to a system that allows travelers to efficiently visit tourist spots and plan their next trip based on their past travel history. This system acquires location information from a terminal and provides tourist spot information based on that information, stores and uses visit history and purchase history, and also recommends next travel plans.

[0039] System Overview

[0040] 1. Initial settings and user information entry

[0041] Device:

[0042] Users download an app specifically for this system and install it on their smartphones.

[0043] Launch the app and create a new account by entering basic account information such as your name and email address.

[0044] You can also enter details such as your travel preferences and past travel history.

[0045] server:

[0046] Receives account information sent from the device and stores it in a database.

[0047] If necessary, obtain past travel history and prepare it for analysis.

[0048] User:

[0049] A confirmation screen will appear asking whether you want to allow access to your location information, and if you allow it, your location information will be obtained.

[0050] 2. Selecting your destination and checking in

[0051] User:

[0052] After arriving at your destination, launch the app and press the "Check-in" button.

[0053] Device:

[0054] It uses the built-in GPS to determine the user's current location and sends that information to the server.

[0055] server:

[0056] Based on the received current location information, information on nearby tourist attractions and restaurants, waiting times, etc. is obtained and sent to the terminal.

[0057] Specific examples

[0058] Let us take the example of User A going on a trip to Kyoto.

[0059] 1. Initial settings and user information entry

[0060] Person A installs the app on his smartphone, creates an account, enters basic information, and allows access to GPS.

[0061] 2. Check-in in Kyoto

[0062] When Mr. A arrives in Kyoto, he launches the app and presses the "Check-in" button.

[0063] The app checks A's current location and displays information about nearby tourist attractions (e.g., Kinkaku-ji Temple, Kiyomizu-dera Temple, Gion) and restaurants.

[0064] 3. Real-time support during sightseeing

[0065] Device:

[0066] The app provides real-time information on waiting times at tourist spots, the shortest routes, and seat availability at restaurants.

[0067] When Person A selects a tourist spot and visits it, his / her progress is automatically recorded.

[0068] server:

[0069] Based on the received information, the congestion situation at tourist spots is updated in real time and notifications are sent to Mr. A as necessary.

[0070] 4. Purchasing history and photo organization

[0071] Device:

[0072] When Mr. A makes a payment using his smartphone, the information is automatically recorded.

[0073] Photos taken during your trip are automatically organized and categorized.

[0074] server:

[0075] Store purchase history and prepare it for later analysis.

[0076] The captured photo data is stored in the cloud, and slideshows and albums are generated using the automatic editing function.

[0077] 5. Recommendations for your next travel plan

[0078] server:

[0079] When the trip ends, the server analyzes Mr. A's travel data (visit history, purchase history, photo data).

[0080] For Mr. A's next trip, the app will recommend the best tourist spots, routes, and length of stay, and notify him / her via the app.

[0081] This system allows travelers to enjoy sightseeing efficiently and also makes it easier to plan their next trip.

[0082] The processing flow will be explained below.

[0083] Step 1:

[0084] User:

[0085] Download the app and complete the installation. Launch the app and create a new account by entering your account information (name, email address, travel preferences, etc.).

[0086] Step 2:

[0087] Device:

[0088] The account information entered by the user is sent to the server, and access to the GPS is requested, and if the user allows it, the current location information is obtained.

[0089] Step 3:

[0090] server:

[0091] The received account information is stored in a database. If there is past travel history, it is retrieved and prepared for analysis.

[0092] Step 4:

[0093] User:

[0094] After arriving at your travel destination, open the app and press the "Check-in" button. Check the information on tourist spots and restaurants provided within the app.

[0095] Step 5:

[0096] Device:

[0097] The system uses GPS to check the user's current location and sends that information to the server, which then displays the received information about tourist spots and restaurants to the user.

[0098] Step 6:

[0099] server:

[0100] Based on the current location information, information on nearby tourist attractions, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[0101] Step 7:

[0102] User:

[0103] Based on the tourist information displayed, select the places you want to visit and actually visit them.

[0104] Step 8:

[0105] Device:

[0106] The data of tourist spots visited by users is updated in real time and the duration of stay is recorded.

[0107] Step 9:

[0108] server:

[0109] The system regularly updates information on the congestion status and waiting times of tourist spots, and notifies users as necessary.

[0110] Step 10:

[0111] User:

[0112] Visit a restaurant and pay using your smartphone. Also, take photos while traveling.

[0113] Step 11:

[0114] Device:

[0115] Automatically records smartphone payment information and organizes photo data by category.

[0116] Step 12:

[0117] server:

[0118] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions.

[0119] Step 13:

[0120] server:

[0121] After the trip is over, the user's travel data (visit history, purchase history, photo data) is analyzed using a machine learning algorithm to recommend their next travel plan.

[0122] Step 14:

[0123] User:

[0124] Check your upcoming travel plans in the app and plan your next trip accordingly.

[0125] Example 1

[0126] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0127] With so many tourist spots and restaurants to visit, modern travelers are faced with the challenge of efficiently planning their trips. Obtaining the latest information in real time while traveling and optimizing their selection of tourist spots and restaurants is no easy task. Furthermore, organizing photos taken during a trip and proposing next travel plans that take into account past travel and purchase history can be time-consuming. To solve these challenges, a system is needed that automatically and efficiently provides information and improves the traveler experience.

[0128] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0129] In this invention, the server includes means for acquiring user location information, means for providing information on nearby tourist spots, waiting times, and the shortest route based on the acquired location information, means for saving history information on visits to tourist spots and purchase history information, means for recommending next travel plans based on the saved history information and purchase history information, means for automatically organizing image data taken during the trip, means for automatically recording transaction information on the smart device during the trip, means for transmitting information from the terminal to the server and means for saving image data in the cloud, and means for automatically creating albums and presentations based on the saved image data. This allows travelers to enjoy sightseeing efficiently and makes it possible to smoothly plan their next trip.

[0130] "Location Information" means geographic data obtained via GPS or other means that indicates a user's current location.

[0131] "Tourist attraction information" refers to detailed information about tourist attractions, including location, features, opening hours, admission fees, etc.

[0132] "Waiting time" refers to the time it takes for a user to receive service at a tourist spot, restaurant, or other facility.

[0133] The "shortest route" is information indicating the most time-efficient route when a user travels from their current location to their destination.

[0134] "History information" refers to records of tourist spots that a user has visited in the past and services that the user has used.

[0135] "Purchase history information" refers to records of purchases and transactions made by a user during their trip.

[0136] "Travel plan recommendations" refers to suggesting tourist spots and routes suitable for the user's next trip based on the user's past behavioral data.

[0137] "Photographed image data" refers to images that a user takes while traveling and saves as digital data.

[0138] "Means for automatic organization" refers to a function in which the system automatically classifies and organizes data without requiring manual operation by the user.

[0139] "Transaction information recording" refers to a function that automatically records data related to economic activities performed by a user while traveling, such as purchases and payments.

[0140] "Means for transmitting information to the server" refers to communication means for transmitting data from the terminal to the server.

[0141] "Cloud storage" refers to technology for storing digital data on remote servers via the internet.

[0142] "Means for creating albums and presentations" refers to a function for automatically generating albums and slideshow-style presentations based on stored image data.

[0143] The present invention relates to a system that allows travelers to efficiently visit tourist spots and plan their next trip based on their past travel history. The system is implemented using a user's smartphone, a server, cloud storage, and a generative AI model. A specific embodiment of the system is described below.

[0144] Entering initial settings and user information

[0145] User:

[0146] Users first download and install the app on their smartphone. Next, they launch the app and create a new account by entering basic account information such as their name and email address. They can also enter more detailed information such as their travel preferences and past travel history. By allowing access to location information, location information can be obtained.

[0147] Device:

[0148] The app temporarily stores the user's input information and proceeds with the account creation process. It checks the location access permission status and obtains location information with the user's consent.

[0149] server:

[0150] The server receives the account information and the access permission status of the location information sent from the terminal and stores them in a database.

[0151] Selecting your destination and checking in

[0152] User:

[0153] After arriving at their travel destination, the user launches the app and presses the "Check-in" button.

[0154] Device:

[0155] The app uses the built-in GPS to determine the user's current location and sends that location information to a server.

[0156] server:

[0157] Based on the received location information, the server provides information on nearby tourist attractions and restaurants, as well as waiting times and the shortest routes. This information is sent to the device and displayed to the user.

[0158] Real-time support during sightseeing

[0159] Device:

[0160] The app provides real-time information on waiting times at tourist attractions, the shortest routes, and restaurant availability. When users visit tourist attractions, their progress is automatically recorded.

[0161] server:

[0162] Based on the received information, the server updates the congestion status of tourist spots in real time and sends notifications to users as necessary.

[0163] Purchase history and photo organization

[0164] Device:

[0165] When a user makes a payment using their smartphone, the information is automatically recorded. Also, photos taken during the trip are automatically organized and categorized. This organized information is sent to the server.

[0166] server:

[0167] The server stores purchase history and prepares it for later analysis. The photos are stored in the cloud and automatically edited to create slideshows and albums.

[0168] Recommendations for your next travel plan

[0169] server:

[0170] Once the trip is over, the server analyzes the travel data (visit history, purchase history, photo data) and uses a generative AI model to recommend the best sightseeing spots, routes, and duration for the next trip, and notifies the user through the app.

[0171] Specific examples

[0172] For example, if a user travels to Kyoto, the system operates as follows.

[0173] 1. Initial setup and user information entry:

[0174] Users install the app on their smartphone, create an account, enter basic information, and allow access to their GPS.

[0175] 2. Check-in in Kyoto:

[0176] When a user arrives in Kyoto, they launch the app and press the "Check In" button. The app then checks their current location and provides information on nearby tourist attractions (e.g., temples, gardens, historical buildings) and dining options.

[0177] Specific prompt examples:

[0178] "Install the app, enter your name and email address, and register your travel preferences."

[0179] "When you arrive in Kyoto, open the app and click check-in."

[0180] "Provides real-time information on nearby tourist attractions and restaurants."

[0181] "It records your smartphone payment history and automatically organizes the photos you take."

[0182] "Recommend your next travel plan."

[0183] This invention allows travelers to enjoy sightseeing efficiently and also makes it possible to smoothly plan their next trip.

[0184] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0185] Step 1:

[0186] Entering initial settings and user information

[0187] Specific behavior:

[0188] User: The user first downloads and installs the app on their smartphone. They launch the app and enter basic account information such as their name and email address, as well as other details such as their travel preferences and past travel history. They are then asked to allow location access.

[0189] Input: User's name, email address, travel preferences, past travel history, location access permission (input)

[0190] Output: Account information, location access permission (output)

[0191] Device:

[0192] The app will temporarily store the information you entered and proceed with the account creation process. Confirm location access permissions.

[0193] Input: Account information entered by the user, location access permission status (input)

[0194] Output: Provisional account information, location access permission status (output)

[0195] server:

[0196] The account information and location information access permission status sent from the device are saved in a database.

[0197] Input: Account information and location access permission status sent from the device (input)

[0198] Output: Stored account information and permission data (output)

[0199] Step 2:

[0200] Selecting your destination and checking in

[0201] Specific behavior:

[0202] User: After arriving at their travel destination, they launch the app and press the "Check-in" button.

[0203] Input: User's current location, travel destination selection information (input)

[0204] Output: Check-in information (output)

[0205] Device:

[0206] It uses the built-in GPS function to determine the user's current location and sends that information to the server.

[0207] Input: GPS data (input)

[0208] Output: User's current location information (output)

[0209] server:

[0210] Based on the received location information, data is generated that provides information on nearby tourist attractions and restaurants, waiting times, and the shortest routes, and is sent to the terminal.

[0211] Input: Current location information sent from the device (input)

[0212] Output: Information on nearby tourist spots, waiting time, shortest route (output)

[0213] Step 3:

[0214] Real-time support during sightseeing

[0215] Specific behavior:

[0216] Device: The app provides real-time information on waiting times at tourist attractions, the shortest routes, and seat availability at restaurants. When users visit tourist attractions, their progress is automatically recorded.

[0217] Input: Real-time GPS data, tourist spot selection information (input)

[0218] Output: Waiting time information, shortest route, seat availability information, visit history (output)

[0219] server:

[0220] Based on the received real-time information, the system updates the congestion status of tourist spots and sends notifications to users.

[0221] Input: Real-time GPS data received from the device, visit history (input)

[0222] Output: Updated tourist destination information, congestion status, notifications (output)

[0223] Step 4:

[0224] Purchase history and photo organization

[0225] Specific behavior:

[0226] Terminal: When a user makes a payment using their smartphone, that information is automatically recorded. Photos taken during the trip are automatically organized, categorized, and sent to the server.

[0227] Input: Smartphone payment data, taken photo (input)

[0228] Output: Purchase history data, organized photo data (output)

[0229] server:

[0230] It receives purchase history and stores it in a database. It also stores photographic data in the cloud and uses an automatic editing function to generate slideshows and albums.

[0231] Input: Purchase history data received from the device, organized photo data (input)

[0232] Output: Saved purchase history data, photo data stored in the cloud, generated slideshows and albums (output)

[0233] Step 5:

[0234] Recommendations for your next travel plan

[0235] Specific behavior:

[0236] Server: After the trip is over, the server statistically analyzes the travel data (visit history, purchase history, photo data) and uses a generative AI model to recommend the best tourist spots, routes, and duration for the next trip.

[0237] Input: Travel data (visit history, purchase history, photo data) (input)

[0238] Output: Next travel plan, recommendations (output)

[0239] server:

[0240] Recommended tourist spots and routes are notified to the user's smartphone based on their account information.

[0241] Input: Recommendation information, user account information (input)

[0242] Output: Notification(Output)

[0243] Device:

[0244] Users will receive notifications and can check their upcoming travel plans.

[0245] Input: Notification(Input)

[0246] Output: Confirmed itinerary (output)

[0247] (Application example 1)

[0248] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0249] In recent years, there has been an increasing need for travelers to obtain information on sightseeing and dining at their travel destinations efficiently. There is a need for a system that can efficiently obtain information on tourist spots and surrounding restaurants, and support the planning of next trips based on visit and purchase history. Furthermore, to enrich the dining experience during travel, a system is needed that can obtain real-time information on the congestion status of surrounding restaurants, reservation information, and popular menu items.

[0250] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0251] In this invention, the server includes means for acquiring user location information, means for providing information on nearby tourist spots, waiting times, and shortest routes based on the acquired location information, means for saving history information on visits to tourist spots and purchase history information, means for recommending next travel plans based on the saved history information and purchase history information, means for providing information on nearby restaurants, popular menus, and congestion status based on the acquired location information, and means for providing reservation status of nearby restaurants. This allows travelers to enjoy sightseeing efficiently and have an optimal dining experience at their travel destination.

[0252] "User" refers to a traveler who uses the system and is the entity that provides individual location information, preference information, etc.

[0253] "Location Information" means data that allows a system to determine a user's current geographic location, obtained using GPS or other positioning technology.

[0254] "Tourist destination information" is information about tourist attractions, famous sites, natural landscapes, etc. that the user may visit.

[0255] "Waiting time" is information about the amount of time you need to wait to use a service at a tourist spot or restaurant.

[0256] The "shortest route" is information about the most efficient route from the current location to the destination.

[0257] "History information" is a record of tourist spots that a user has visited in the past and services that the user has used.

[0258] "Purchase history information" is a record of purchases made by a user in the past, and includes information about the products and services purchased.

[0259] "Recommendation" refers to making optimal suggestions for the user's next trip or activity based on their past behavior and preferences.

[0260] "Restaurant information" is information about nearby restaurants, including their locations, menus, opening hours, etc.

[0261] "Popular menu items" refers to information about dishes and drinks that are particularly highly rated or frequently ordered at restaurants.

[0262] "Crowding status" is information about the current level of crowding at places such as tourist spots and restaurants.

[0263] "Reservation status" refers to information used to guarantee the availability of seats or services in advance at restaurants and other services.

[0264] The present invention relates to a system that allows travelers to visit tourist spots efficiently and enrich their dining experience. This system provides real-time information on nearby tourist spots and restaurants based on the user's location information, and makes recommendations for subsequent travel plans.

[0265] System Overview

[0266] 1. Initial settings and user information entry

[0267] Terminal

[0268] First, users install the system's dedicated app on their smartphone, enter basic information (such as name and email address) to create an account, and then set it to allow GPS access.

[0269] server

[0270] Receives user account information sent from the device and stores it in a database. Obtains past travel history and prepares for analysis.

[0271] 2. Acquisition of location information and provision of tourist spot and restaurant information

[0272] User

[0273] After arriving at your destination, launch the app and press the "Check-in" button.

[0274] Terminal

[0275] It uses the built-in GPS to determine the user's current location and sends that information to the server.

[0276] server

[0277] Based on the received current location information, information on nearby tourist attractions and restaurants, waiting times, the shortest route, as well as popular menu items, congestion status, and reservation status at restaurants are obtained and sent to the device.

[0278] 3. Support during sightseeing

[0279] Terminal

[0280] The app provides real-time information on waiting times at tourist spots, the shortest routes, and seat availability and reservation status at restaurants. When users visit tourist spots or restaurants, their history is automatically recorded.

[0281] server

[0282] Based on the received location information and visit history, the system updates the congestion status of tourist spots and restaurants and sends notifications to the user as necessary.

[0283] 4. Purchasing history and photo organization

[0284] Terminal

[0285] When a user makes a payment using their smartphone, that information is automatically recorded, and photos taken during the trip are automatically organized and categorized.

[0286] server

[0287] It saves purchase history and prepares it for later analysis. The photos are stored in the cloud and automatically edited to create slideshows and albums.

[0288] 5. Recommendations for your next travel plan

[0289] server

[0290] Once the trip is over, the server analyzes the user's travel data (visit history, purchase history, photo data), and recommends the best sightseeing spots, routes, and duration for the next trip, and notifies the user through the app.

[0291] Specific examples

[0292] Consider the case where a user travels to a specific city. For example, the user visits a tourist spot, obtains information about nearby restaurants, and enjoys delicious food. The flow is as follows:

[0293] Specific examples

[0294] When a traveler arrives at a famous tourist spot, they launch the app and press the "Check-in" button. GPS identifies their current location and sends that information to the server. The server then uses that location information to provide real-time information about nearby tourist spots and restaurants. The traveler visits the tourist spot, finds nearby restaurants, and enjoys a meal. During this process, their visit history and purchase history are automatically recorded, and recommendations are made for the next trip.

[0295] Prompt Sentence Examples

[0296] "I want to develop an app that provides information about recommended restaurants near the user's current location when they visit a famous tourist spot. I want a function that uses the user's location information to display nearby restaurants, popular menu items, and crowding status in real time."

[0297] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0298] Step 1: Installing the app and initial setup

[0299] The device requires the user to install a system-specific app on their smartphone and enter basic information (such as name and email address), then allows GPS access. The entered information is sent from the device to the server.

[0300] Input: User's basic information (name, email address, etc.)

[0301] Output: User account information is saved on the server

[0302] Step 2: Obtaining and sending location information

[0303] When the user arrives at their travel destination and presses the "Check-in" button, the device uses its built-in GPS to determine their current location and sends that information to the server.

[0304] Input: User's "check-in" operation

[0305] Output: Current location latitude and longitude information is sent to the server

[0306] Step 3: Acquiring and providing information on tourist spots and restaurants

[0307] The server receives the latitude and longitude information of the current location and then obtains information about nearby tourist attractions and restaurants, including waiting times, the shortest route, popular menu items, congestion status, and reservation status. This information is then sent to the device.

[0308] Input: Current location latitude and longitude information

[0309] Output: Information on nearby tourist spots, restaurant information, waiting time, shortest route, popular menu items, congestion status, reservation status

[0310] Step 4: Providing real-time support

[0311] The device displays information about tourist spots and restaurants sent from the server to the user in real time, providing the shortest route to each location, waiting times, congestion status, etc. When the user visits a tourist spot or eats at a restaurant, the history is automatically recorded and sent to the server.

[0312] Input: Tourist information and restaurant information from the server

[0313] Output: User visit history and purchase history are recorded on the server

[0314] Step 5: Record and organize your purchase history and photos

[0315] When a user makes a smartphone payment at a restaurant, the device automatically records the purchase history information and sends it to the server. In addition, photos taken during the trip are automatically organized, categorized, and stored in the cloud.

[0316] Input: User's smartphone payment information, photographed photo

[0317] Output: Purchase history and photo data stored in the cloud

[0318] Step 6: Recommend your next travel plan

[0319] After the trip, the server analyzes the user's saved travel data (visit history, purchase history, photo data) and recommends the best sightseeing spots, routes, and duration for the next trip. This recommendation information is notified to the user via their device.

[0320] Input: User's travel data (visit history, purchase history, photo data)

[0321] Output: Recommendations for your next trip

[0322] As a specific example of how it works, when a user arrives at a tourist spot, launches the app, and presses the check-in button, the device acquires GPS information and sends it to the server. The server then uses this location information to acquire information about nearby tourist spots and restaurants, and sends it to the device. The user receives this information in real time, allowing them to efficiently choose their next tourist spot or place to eat. After the trip is over, the server also sends recommended information, making it easy to plan their next trip.

[0323] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0324] This invention relates to a system that acquires a user's location information and emotions, and based on that information, provides tourist information and recommends the user's next travel plan. The system combines an emotion engine to provide optimal information so that the user can have a more satisfying travel experience. The system's program processing is explained below in natural language.

[0325] System Overview

[0326] 1. Initial settings and user information entry

[0327] Device:

[0328] Users download the system's dedicated app and install it on their smartphones.

[0329] Launch the app and create a new account by entering basic account information such as your name and email address.

[0330] Configure settings to allow recognition of travel preferences, past travel history, and even emotions.

[0331] server:

[0332] Receives account information sent from the device and stores it in a database.

[0333] If necessary, obtain past travel history and prepare for analysis.

[0334] User:

[0335] By allowing access to location information and emotion recognition, you can obtain location information and emotion information.

[0336] 2. Selecting your destination and checking in

[0337] User:

[0338] After arriving at your destination, launch the app and press the "Check-in" button.

[0339] Check the information on tourist spots and restaurants provided within the app.

[0340] Device:

[0341] It uses GPS to check the user's current location and uses an emotion engine to analyze the user's emotions in real time.

[0342] The location information and the emotion information are transmitted to a server.

[0343] server:

[0344] Based on the received current location information and emotion information, information on nearby tourist spots, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[0345] Specific examples

[0346] Let's take the example of User B going on a trip to Tokyo.

[0347] 1. Initial settings and user information entry

[0348] Person B installs the app on his smartphone and creates an account, entering basic information and granting access to the GPS and emotion recognition functions.

[0349] 2. Check-in in Tokyo

[0350] When Mr. B arrives in Tokyo, he launches the app and presses the "Check-in" button.

[0351] The app checks B's current location and displays information about nearby tourist spots (such as Tokyo Tower, Sensoji Temple, and Shibuya Crossing) and restaurants. Meanwhile, using the built-in camera and microphone, the emotion engine analyzes B's facial expressions and tone of voice to recognize his or her emotions.

[0352] 3. Real-time support during sightseeing

[0353] Device:

[0354] The app provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability. In addition, the emotion engine periodically analyzes B's emotions and suggests tourist spots based on his / her current emotional state (for example, if he / she is feeling stressed, it will suggest a relaxing park).

[0355] server:

[0356] Based on the received information, the system periodically updates information on the congestion situation and waiting times at tourist spots, and sends notifications to Person B as necessary.

[0357] Emotional information is analyzed and used to gauge satisfaction at tourist spots and recommend the next destination.

[0358] 4. Purchasing history and photo organization

[0359] Device:

[0360] When Mr. B makes a payment using his smartphone, the information is automatically recorded.

[0361] Photos taken during a trip are automatically organized and categorized, and an emotion engine extracts photos taken during specific emotional moments to create special albums.

[0362] server:

[0363] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions (such as creating slideshows and applying filters).

[0364] 5. Recommendations for your next travel plan

[0365] server:

[0366] After the trip, Mr. B's travel data (visit history, purchase history, photo data, and emotional data) is analyzed using a machine learning algorithm to recommend his next travel plan. For example, the system will suggest the best next travel destinations and places to visit based on the tourist spots he has enjoyed in the past and the activities he has been interested in.

[0367] User:

[0368] Check your upcoming travel plans in the app and plan your next trip accordingly.

[0369] This system allows users to enjoy sightseeing efficiently and has a more personalized travel experience based on their emotions.

[0370] The processing flow will be explained below.

[0371] Step 1:

[0372] User:

[0373] Download the app and complete the installation. Launch the app and create a new account by entering your account information (name, email address, travel preferences, etc.).

[0374] Step 2:

[0375] Device:

[0376] The account information entered by the user is sent to the server, and permission to access GPS and emotion recognition is requested. If the user allows it, location information and emotion information are obtained.

[0377] Step 3:

[0378] server:

[0379] The received account information is stored in a database. If there is past travel history, it is retrieved and prepared for analysis.

[0380] Step 4:

[0381] User:

[0382] After arriving at your travel destination, open the app and press the "Check-in" button. Check the information on tourist spots and restaurants provided within the app.

[0383] Step 5:

[0384] Device:

[0385] It uses GPS to determine the user's current location and sends that information to the server, and uses an emotion engine to analyze the user's facial expressions and voice to assess their current emotions.

[0386] Step 6:

[0387] server:

[0388] Based on the current location information and emotion information, information on nearby tourist spots, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[0389] Step 7:

[0390] Device:

[0391] The received tourist spot and restaurant information is displayed on the app screen to notify the user. The emotion engine operates in real time to continuously monitor changes in the user's emotions.

[0392] Step 8:

[0393] User:

[0394] Based on the tourist information displayed, users can select a location to visit and actually visit it. If the emotions they felt while visiting a tourist spot changed, that information is recorded.

[0395] Step 9:

[0396] Device:

[0397] The data of tourist spots visited by the user is updated in real time and the time spent there is recorded. The emotion engine analyzes the user's emotions and provides information according to the situation (for example, suggesting a quiet place if you need to relax).

[0398] Step 10:

[0399] server:

[0400] The system regularly updates information on crowding and waiting times at tourist spots and notifies users as needed. It also analyzes travel experiences based on emotional data and uses it to make future recommendations.

[0401] Step 11:

[0402] User:

[0403] Visit a restaurant and pay using your smartphone. Also, take photos while traveling.

[0404] Step 12:

[0405] Device:

[0406] It automatically records smartphone payment information, organizes photo data by category, and extracts photos taken in specific emotional states to create special albums.

[0407] Step 13:

[0408] server:

[0409] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions.

[0410] Step 14:

[0411] server:

[0412] After the trip, the system analyzes the user's travel data (visit history, purchase history, photo data, and emotional data) using machine learning algorithms to recommend the next travel plan. It suggests the best next travel destinations and places to visit based on the tourist spots they have enjoyed in the past and the activities they are interested in.

[0413] Step 15:

[0414] User:

[0415] Check your upcoming travel plans in the app and plan your next trip accordingly.

[0416] Example 2

[0417] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0418] While conventional travel support systems provide information based on the user's location, they lack the ability to provide personalized information that takes into account the user's emotional state. Furthermore, organizing travel purchase history and photo data is time-consuming, making data management inefficient for use in planning the next trip. Furthermore, there is a need for a system that can quickly provide information on the congestion situation at visited tourist spots and real-time waiting times.

[0419] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0420] In this invention, the server includes means for acquiring location information and emotional state of the user, means for providing information on nearby tourist spots, waiting times and the shortest route based on the acquired location information and emotional information, and means for saving history information on visiting tourist spots, purchase history information and emotional state. This not only enables the user to receive personalized tourist spot information that takes into account their emotional state, but also enables automatic organization of purchase history and photo data, making it easier to use for planning their next trip.

[0421] "Location information" is data that indicates the specific geographic coordinates where a user is currently physically located.

[0422] "Emotional information" is data that indicates the user's emotional state and is obtained through facial expression recognition, voice analysis, and the like.

[0423] "Tourist destination information" refers to information related to tourist destinations, including, for example, highlights, opening hours, admission fees, and crowding levels.

[0424] "Wait time" is data that indicates the amount of time a user must wait to receive a service or experience at a particular location or event.

[0425] The "shortest route" is information indicating the route with the shortest travel distance from the starting point to the destination.

[0426] "History information" is recorded data of places visited by a user in the past and services used by the user.

[0427] "Purchase history information" is recorded data of products and services purchased by a user.

[0428] "Recommendation" means suggesting the next action to be taken based on the user's past actions and current situation.

[0429] The present invention is a system that acquires location information and emotion information of a user and, based on this, provides tourist spot information and recommends next travel plans. An embodiment of the system will be described in detail below.

[0430] Entering initial settings and user information

[0431] Device:

[0432] Users download and install the system's dedicated app on their smartphones, then launch the app and create a new account by entering basic information such as their name and email address, as well as travel preferences, past travel history, and permission to recognize emotions.

[0433] server:

[0434] Receives account information sent from the device and stores it in a database. If necessary, retrieves past travel history and prepares it for analysis.

[0435] User:

[0436] Allowing access to location information and emotion recognition allows us to obtain location information and emotion information.

[0437] Selecting your destination and checking in

[0438] User:

[0439] After arriving at your travel destination, open the app and press the "Check-in" button. Check the information on tourist spots and restaurants provided within the app.

[0440] Device:

[0441] The system uses GPS to check the user's current location, and the emotion engine analyzes emotions in real time using the built-in camera and microphone. Location and emotion information is sent to the server.

[0442] server:

[0443] Based on the received current location information and emotion information, information on nearby tourist spots, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[0444] Real-time support during sightseeing

[0445] Device:

[0446] The app provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability. Furthermore, an emotion engine periodically analyzes the user's emotions and suggests tourist spots based on their current emotional state (for example, if they're feeling stressed, it will suggest a park where they can relax).

[0447] server:

[0448] Based on the received information, the system periodically updates information on the congestion status and waiting times of tourist spots, and notifies users as necessary. Emotional information is analyzed and used to determine satisfaction with tourist spots and recommend the next destination.

[0449] Purchase history and photo organization

[0450] Device:

[0451] When a user makes a payment using their smartphone, that information is automatically recorded. Photos taken during the trip are automatically organized and categorized. Furthermore, an emotion engine extracts photos taken during specific emotional moments and creates special albums.

[0452] server:

[0453] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions (such as creating slideshows and applying filters).

[0454] Recommendations for your next travel plan

[0455] server:

[0456] After the trip, the system analyzes the user's travel data (visit history, purchase history, photo data, and emotional data) using machine learning algorithms. Based on the tourist spots they enjoyed in the past and the activities they were interested in, the system suggests the best travel destinations and places to visit next time.

[0457] User:

[0458] Check your upcoming travel plans in the app and plan your next trip accordingly.

[0459] Specific examples

[0460] Let's take the example of User B going on a trip to Tokyo.

[0461] Entering initial settings and user information

[0462] Person B installs the app on his smartphone and creates an account, entering basic information and granting access to the GPS and emotion recognition functions.

[0463] Check-in in Tokyo

[0464] When Person B arrives in Tokyo, he launches the app and presses the "Check-in" button. The app checks Person B's current location and displays information about nearby tourist spots (e.g., Tokyo Tower, Sensoji Temple, Shibuya Crossing) and restaurants. Meanwhile, using the built-in camera and microphone, the emotion engine analyzes Person B's facial expressions and tone of voice to recognize their emotions.

[0465] Real-time support during sightseeing

[0466] The app provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability. Furthermore, the emotion engine periodically analyzes B's emotions and suggests tourist spots based on his / her current emotional state (for example, if he / she is feeling stressed, it will suggest a relaxing park).

[0467] Purchase history and photo organization

[0468] When B makes a payment using his smartphone, the information is automatically recorded. Photos taken during the trip are automatically organized and categorized. Photos taken during specific moments of emotion are also extracted and a special album is created.

[0469] Recommendations for your next travel plan

[0470] After B's trip, his travel data (visit history, purchase history, photo data, and emotional data) are analyzed using a machine learning algorithm to recommend his next travel plan. For example, it suggests the best next travel destinations and places to visit based on the tourist spots he enjoyed in the past and the activities he was interested in.

[0471] Prompt Sentence Examples

[0472] "When the user is at Tokyo Tower, the system will send the user's current location information and emotional information to the server and suggest recommended tourist spots and restaurants."

[0473] The above is a specific embodiment of the system.

[0474] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0475] Program processing flow

[0476] Entering initial settings and user information

[0477] Step 1:

[0478] Device: Users download the system-specific app and install it on their smartphones.

[0479] Enter: Install app.

[0480] Output: App launch.

[0481] Step 2:

[0482] Device: Launch the app and enter basic information such as your name and email address to create a new account.

[0483] Input: Name, email address, password, etc.

[0484] Output: Save account information.

[0485] Step 3:

[0486] Device: Set travel preferences, past travel history, and emotion recognition permissions.

[0487] Input: Travel preferences, past travel history, emotion recognition permission

[0488] Output: A completed account profile.

[0489] Step 4:

[0490] Terminal: Sends the entered account information to the server.

[0491] Input: Account Information

[0492] Output: Send to server.

[0493] Step 5:

[0494] Server: Stores the received account information in a database, retrieves past travel history as needed, and prepares it for analysis.

[0495] Input: Account Information

[0496] Output: Save to database.

[0497] Step 6:

[0498] User: Allow location and emotion recognition access so that location and emotion information can be obtained.

[0499] Input: Location and emotion recognition permissions

[0500] Output: Permission settings.

[0501] Selecting your destination and checking in

[0502] Step 1:

[0503] User: After arriving at their travel destination, they launch the app and press the "Check-in" button.

[0504] Input: Arrive at destination and press "Check-in" button

[0505] Output: Check-in confirmation.

[0506] Step 2:

[0507] Device: Uses GPS to determine the user's location, and the emotion engine analyzes emotions in real time using the built-in camera and microphone.

[0508] Input: User's current location, built-in camera and microphone

[0509] Output: Location information and emotion information.

[0510] Step 3:

[0511] Device: Sends location information and emotion information to the server.

[0512] Input: Location and emotion

[0513] Output: Send to server.

[0514] Step 4:

[0515] Server: Based on the received current location information and emotion information, obtains information on nearby tourist spots, waiting times, shortest routes, and restaurant information, and sends this information to the device.

[0516] Input: Current location information, emotion information

[0517] Output: Information on nearby tourist attractions, waiting times, shortest routes, and restaurant information.

[0518] Step 5:

[0519] Terminal: Receives information from the server and displays it to the user.

[0520] Input: Information on nearby tourist attractions, waiting times, shortest routes, restaurant information

[0521] Output: What is displayed to the user.

[0522] Real-time support during sightseeing

[0523] Step 1:

[0524] Device: The app provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability.

[0525] Input: Waiting time at tourist spots, shortest route, seat availability information

[0526] Output: Display of real-time information.

[0527] Step 2:

[0528] On the device: The emotion engine periodically analyzes the user's emotions and suggests tourist spots based on their current emotional state.

[0529] Input: Emotion data

[0530] Output: Personalized tourist destination suggestions.

[0531] Step 3:

[0532] Terminal: Periodically sends behavioral data during sightseeing (places visited, length of stay, etc.) to the server.

[0533] Input: Behavioral data

[0534] Output: Send to server.

[0535] Step 4:

[0536] Server: Based on the received information, the server periodically updates information on the congestion status and waiting times of tourist spots, and sends notifications to users as necessary.

[0537] Input: Behavioral data

[0538] Output: Crowding status, wait time updates, notifications.

[0539] Purchase history and photo organization

[0540] Step 1:

[0541] Terminal: When a user makes a payment using their smartphone, the information is automatically recorded.

[0542] Enter purchasing information

[0543] Output: A record of purchase history.

[0544] Step 2:

[0545] On your device: Automatically organize and categorize photos taken during your trip.

[0546] Input: Photo data

[0547] Output: Classified photo data.

[0548] Step 3:

[0549] On device: The emotion engine extracts photos taken at specific emotional moments and generates a special album.

[0550] Input: Photo data, emotion data

[0551] Output: An album based on emotions.

[0552] Step 4:

[0553] Server: Stores captured photo data in the cloud and performs automatic editing functions (such as creating slideshows and applying filters).

[0554] Input: Photo data

[0555] Output: Cloud saved, edited photo data.

[0556] Recommendations for your next travel plan

[0557] Step 1:

[0558] Server: After the trip ends, the user's travel data (visit history, purchase history, photo data, and emotional data) is analyzed using machine learning algorithms.

[0559] Input: Trip data

[0560] Output: Analysis results.

[0561] Step 2:

[0562] Server: Based on the analysis results, suggests the best travel destinations or places to visit next based on tourist spots you have enjoyed in the past and activities you are interested in.

[0563] Input: Analysis results

[0564] Output: Next trip recommendation.

[0565] Step 3:

[0566] User: See upcoming travel plans within the app and plan their next trip accordingly.

[0567] Input: Next Trip Recommendation

[0568] Output: Next trip plan.

[0569] (Application example 2)

[0570] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0571] Conventional tourist information systems are limited in providing information about tourist spots and restaurants based on the user's current location, and do not adequately consider the user's emotional state. Furthermore, there are no comprehensive systems that can suggest tourist spots using real-time emotion recognition or improve the travel experience. As a result, users may experience lower travel satisfaction due to suggestions that do not match their emotional state. To address this issue, a system that utilizes the user's emotional information to provide more personalized tourist information and recommend next travel plans is needed.

[0572] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0573] In this invention, the server includes means for acquiring user location information, means for providing information on nearby tourist spots, waiting times, and the shortest route based on the acquired location information and emotion information, means for recognizing the user's emotion and suggesting tourist spots and transportation options based on that emotion, and means for saving history information on tourist spots visited and purchase history information. This makes it possible to provide tourist information that reflects the user's emotional state in real time, and by making suggestions that meet individual needs, it becomes possible to improve travel satisfaction.

[0574] definition statement

[0575] "User" refers to the user of the service and the entity that receives information and suggestions from the system.

[0576] "Location Information" means data that describes a user's current geographic location, such as data obtained through GPS or other location measurement technologies.

[0577] "Emotional information" is data that indicates the emotional state of a user extracted from facial expressions, tone of voice, behavioral patterns, etc.

[0578] "Tourist destination information" means information related to a particular tourist destination, such as overview, history, attractions, and activities.

[0579] "Waiting time" is information indicating the waiting time to enter a particular tourist attraction or facility.

[0580] The "shortest route" is information indicating the route that will allow the user to reach the destination specified by the user in the shortest time.

[0581] "Emotion recognition" is the process of identifying and digitizing a user's current emotional state.

[0582] "History information" is data that shows the overall information such as the places a user has visited in the past, the services they have used, and their behavioral records.

[0583] "Purchase history information" is a record of products and services purchased by a user in the past.

[0584] The "next travel plan" is the next travel destination and schedule suggested based on the user's past history information and emotional information.

[0585] "Restaurant information" refers to information about restaurants in a specified area, such as their names, menus, reviews, and opening hours.

[0586] "Availability" is information indicating the availability of seats at a particular restaurant.

[0587] "Photo data" is a collection of image files taken by a user, and is data stored in the form of visual information.

[0588] "Automatic organization and editing" refers to the process of using an algorithm to categorize photo data and process it as needed.

[0589] "Recommending travel plans" means suggesting travel destinations and plans of action that will satisfy the user.

[0590] MODE FOR CARRYING OUT THE INVENTION

[0591] The present invention relates to a system that provides tourist information and recommends next travel plans based on a user's emotional information and location information. The following description describes an embodiment of the invention based on the claims.

[0592] System Overview

[0593] 1. Initial settings and user information entry

[0594] Device:

[0595] Users download and install the system's dedicated application onto their device, then create a new account by entering basic account information such as their name and email address, as well as their travel preferences, past travel history, and permission to use emotion recognition.

[0596] server:

[0597] Receives account information sent from the device and stores it in a database. If necessary, retrieves past travel history and prepares it for analysis.

[0598] User:

[0599] Allowing access to location and emotion recognition allows the application to obtain location and emotion information.

[0600] 2. Selecting your destination and checking in

[0601] User:

[0602] After arriving at your travel destination, start the app and press the "Check-in" button. Check the information on tourist spots and restaurants provided within the app.

[0603] Device:

[0604] The system uses GPS to check the user's current location and uses an emotion engine to analyze the user's emotions in real time. The location information and emotion information are sent to the server.

[0605] server:

[0606] Based on the received current location information and emotion information, information on nearby tourist spots, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[0607] 3. Real-time support during sightseeing

[0608] Device:

[0609] The application provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability. In addition, an emotion engine periodically analyzes the user's emotions and suggests tourist spots based on their current emotional state.

[0610] server:

[0611] Based on the received information, the system periodically updates information on the congestion status and waiting times of tourist spots, and notifies users as necessary. Emotional information is analyzed and used to determine satisfaction with tourist spots and recommend the next destination.

[0612] 4. Purchasing history and photo organization

[0613] Device:

[0614] When a user makes a smart payment, the information is automatically recorded. Photos taken during travel are automatically organized and categorized. An emotion engine also extracts photos taken during specific emotional moments and creates special albums.

[0615] server:

[0616] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions (such as creating slideshows and applying filters).

[0617] 5. Recommendations for your next travel plan

[0618] server:

[0619] After the trip, the system analyzes the user's travel data (visit history, purchase history, photo data, and emotional data) using machine learning algorithms to recommend the next travel plan. Based on the tourist spots they have enjoyed in the past and the activities they have been interested in, the system suggests the best travel destinations and places to visit next time.

[0620] User:

[0621] See upcoming travel plans within the app and plan your next trip accordingly.

[0622] Specific examples of processing

[0623] 1. Use the camera to take a picture of the user's face and analyze their emotions using an emotion recognition API (e.g., Emotion API).

[0624] 2. Use the GPS sensor to get the user's current location.

[0625] 3. Based on the acquired emotion data and location information, the tourist attraction information API is called to obtain information about nearby tourist attractions.

[0626] 4. The results are displayed on the smart glasses display and suggestions are made to the user.

[0627] Prompt Sentence Examples

[0628] If the user is feeling tired, provide them with information on recommended tourist spots around Shibuya, Tokyo where they can relax.

[0629] This system allows users to obtain optimal travel information based on their emotional state and location in real time, enabling them to enjoy a highly satisfying travel experience.

[0630] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0631] Program processing steps

[0632] Step 1:

[0633] Input: The user downloads a system-specific application to their device and enters basic account information.

[0634] What it does: The user enters basic information like name and email address, travel preferences, past travel history, and permission to enable emotion recognition.

[0635] Output: The entered account information is sent to the server and stored in a database. This information is used to prepare for future service provision.

[0636] Step 2:

[0637] Input: The user arrives at their travel destination, launches the application, and presses the "Check-in" button.

[0638] Specific operation: The device uses GPS to determine the user's current location and uses an emotion engine to analyze the user's emotions in real time using the camera and microphone.

[0639] Output: The acquired location information and emotion information are sent to the server, which then uses this information to acquire information about nearby tourist spots, waiting times, the shortest route, and restaurant information, and sends it to the device.

[0640] Step 3:

[0641] Input: Location and emotion information received by the server.

[0642] Specific operation: The server calls the tourist attraction information API and collects information on nearby tourist attractions, waiting times, shortest routes, and restaurant information based on the acquired location information and emotion information.

[0643] Output: The acquired tourist spot information, waiting time information, shortest route information, and restaurant information are sent to the terminal.

[0644] Step 4:

[0645] Input: Tourist attraction information, waiting time information, shortest route information, and restaurant information sent from the server.

[0646] How it works: The device provides this information to the user in real time, and the emotion engine periodically analyzes the user's emotions and suggests tourist spots based on their current emotional state.

[0647] Output: Real-time tourist information and sentiment-based suggestions are displayed to the user.

[0648] Step 5:

[0649] Input: Photo data taken by the user during their trip and smart payment information.

[0650] How it works: The device automatically organizes and categorizes photos taken by the device. It also uses an emotion engine to extract photos taken with specific emotions and create special albums. Smart payment information is also recorded at the same time.

[0651] Output: Organized photo data and purchase history are stored on the server. A special album is created from photos taken at specific emotional moments.

[0652] Step 6:

[0653] Input: Stored travel data (visit history, purchase history, photo data, emotion data).

[0654] How it works: The server analyzes this data using machine learning algorithms to recommend your next travel itinerary, suggesting the best places to visit or travel to next based on the tourist spots you've visited in the past and the activities you're interested in.

[0655] Output: Next trip plan based on the analysis results will be displayed within the application.

[0656] In this way, users can receive optimal tourist information based on their emotional state and location information in real time, and next travel plans are also suggested, enabling a highly satisfying travel experience.

[0657] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0658] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0659] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0660] [Second embodiment]

[0661] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0662] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0663] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0664] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0665] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0666] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0667] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0668] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0669] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0670] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0671] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0672] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0673] This invention relates to a system that allows travelers to efficiently visit tourist spots and plan their next trip based on their past travel history. This system acquires location information from a terminal and provides tourist spot information based on that information, stores and uses visit history and purchase history, and also recommends next travel plans.

[0674] System Overview

[0675] 1. Initial settings and user information entry

[0676] Device:

[0677] Users download an app specifically for this system and install it on their smartphones.

[0678] Launch the app and create a new account by entering basic account information such as your name and email address.

[0679] You can also enter details such as your travel preferences and past travel history.

[0680] server:

[0681] Receives account information sent from the device and stores it in a database.

[0682] If necessary, obtain past travel history and prepare it for analysis.

[0683] User:

[0684] A confirmation screen will appear asking whether you want to allow access to your location information, and if you allow it, your location information will be obtained.

[0685] 2. Selecting your destination and checking in

[0686] User:

[0687] After arriving at your destination, launch the app and press the "Check-in" button.

[0688] Device:

[0689] It uses the built-in GPS to determine the user's current location and sends that information to the server.

[0690] server:

[0691] Based on the received current location information, information on nearby tourist attractions and restaurants, waiting times, etc. is obtained and sent to the terminal.

[0692] Specific examples

[0693] Let's take the example of User A going on a trip to Kyoto.

[0694] 1. Initial settings and user information entry

[0695] Person A installs the app on his smartphone, creates an account, enters basic information, and allows access to GPS.

[0696] 2. Check-in in Kyoto

[0697] When Mr. A arrives in Kyoto, he launches the app and presses the "Check-in" button.

[0698] The app checks A's current location and displays information about nearby tourist attractions (e.g., Kinkaku-ji Temple, Kiyomizu-dera Temple, Gion) and restaurants.

[0699] 3. Real-time support during sightseeing

[0700] Device:

[0701] The app provides real-time information on waiting times at tourist spots, the shortest routes, and seat availability at restaurants.

[0702] When Person A selects a tourist spot and visits it, his / her progress is automatically recorded.

[0703] server:

[0704] Based on the received information, the congestion situation at tourist spots is updated in real time and notifications are sent to Mr. A as necessary.

[0705] 4. Purchasing history and photo organization

[0706] Device:

[0707] When Mr. A makes a payment using his smartphone, the information is automatically recorded.

[0708] Photos taken during your trip are automatically organized and categorized.

[0709] server:

[0710] Store purchase history and prepare it for later analysis.

[0711] The captured photo data is stored in the cloud, and slideshows and albums are generated using the automatic editing function.

[0712] 5. Recommendations for your next travel plan

[0713] server:

[0714] When the trip ends, the server analyzes Mr. A's travel data (visit history, purchase history, photo data).

[0715] For Mr. A's next trip, the app will recommend the best tourist spots, routes, and length of stay, and notify him / her via the app.

[0716] This system allows travelers to enjoy sightseeing efficiently and also makes it easier to plan their next trip.

[0717] The processing flow will be explained below.

[0718] Step 1:

[0719] User:

[0720] Download the app and complete the installation. Launch the app and create a new account by entering your account information (name, email address, travel preferences, etc.).

[0721] Step 2:

[0722] Device:

[0723] The account information entered by the user is sent to the server, and access to the GPS is requested, and if the user allows it, the current location information is obtained.

[0724] Step 3:

[0725] server:

[0726] The received account information is stored in a database. If there is past travel history, it is retrieved and prepared for analysis.

[0727] Step 4:

[0728] User:

[0729] After arriving at your travel destination, open the app and press the "Check-in" button. Check the information on tourist spots and restaurants provided within the app.

[0730] Step 5:

[0731] Device:

[0732] The system uses GPS to check the user's current location and sends that information to the server, which then displays the received information about tourist spots and restaurants to the user.

[0733] Step 6:

[0734] server:

[0735] Based on the current location information, information on nearby tourist attractions, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[0736] Step 7:

[0737] User:

[0738] Based on the tourist information displayed, select the places you want to visit and actually visit them.

[0739] Step 8:

[0740] Device:

[0741] The data of tourist spots visited by users is updated in real time and the duration of stay is recorded.

[0742] Step 9:

[0743] server:

[0744] The system regularly updates information on the congestion status and waiting times of tourist spots, and notifies users as necessary.

[0745] Step 10:

[0746] User:

[0747] Visit a restaurant and pay using your smartphone. Also, take photos while traveling.

[0748] Step 11:

[0749] Device:

[0750] It automatically records smartphone payment information and organizes photo data by category.

[0751] Step 12:

[0752] server:

[0753] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions.

[0754] Step 13:

[0755] server:

[0756] After the trip is over, the user's travel data (visit history, purchase history, photo data) is analyzed using a machine learning algorithm to recommend their next travel plan.

[0757] Step 14:

[0758] User:

[0759] Check your upcoming travel plans in the app and plan your next trip accordingly.

[0760] Example 1

[0761] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0762] With so many tourist spots and restaurants to visit, modern travelers are faced with the challenge of efficiently planning their trips. Obtaining the latest information in real time while traveling and optimizing their selection of tourist spots and restaurants is no easy task. Furthermore, organizing photos taken during a trip and proposing next travel plans that take into account past travel and purchase history can be time-consuming. To solve these challenges, a system is needed that automatically and efficiently provides information and improves the traveler experience.

[0763] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0764] In this invention, the server includes means for acquiring user location information, means for providing information on nearby tourist spots, waiting times, and the shortest route based on the acquired location information, means for saving history information on visits to tourist spots and purchase history information, means for recommending next travel plans based on the saved history information and purchase history information, means for automatically organizing image data taken during the trip, means for automatically recording transaction information on the smart device during the trip, means for transmitting information from the terminal to the server and means for saving image data in the cloud, and means for automatically creating albums and presentations based on the saved image data. This allows travelers to enjoy sightseeing efficiently and makes it possible to smoothly plan their next trip.

[0765] "Location Information" means geographic data obtained via GPS or other means that indicates a user's current location.

[0766] "Tourist attraction information" refers to detailed information about tourist attractions, including location, features, opening hours, admission fees, etc.

[0767] "Waiting time" refers to the time it takes for a user to receive service at a tourist spot, restaurant, or other facility.

[0768] The "shortest route" is information indicating the most time-efficient route when a user travels from their current location to their destination.

[0769] "History information" refers to records of tourist spots that a user has visited in the past and services that the user has used.

[0770] "Purchase history information" refers to records of purchases and transactions made by a user during their trip.

[0771] "Travel plan recommendations" refers to suggesting tourist spots and routes suitable for the user's next trip based on the user's past behavioral data.

[0772] "Photographed image data" refers to images that a user takes while traveling and saves as digital data.

[0773] "Means for automatic organization" refers to a function in which the system automatically classifies and organizes data without requiring manual operation by the user.

[0774] "Transaction information recording" refers to a function that automatically records data related to economic activities performed by a user while traveling, such as purchases and payments.

[0775] "Means for transmitting information to the server" refers to communication means for transmitting data from the terminal to the server.

[0776] "Cloud storage" refers to technology for storing digital data on remote servers via the internet.

[0777] "Means for creating albums and presentations" refers to a function for automatically generating albums and slideshow-style presentations based on stored image data.

[0778] The present invention relates to a system that allows travelers to efficiently visit tourist spots and plan their next trip based on their past travel history. The system is implemented using a user's smartphone, a server, cloud storage, and a generative AI model. A specific embodiment of the system is described below.

[0779] Entering initial settings and user information

[0780] User:

[0781] Users first download and install the app on their smartphone. Next, they launch the app and create a new account by entering basic account information such as their name and email address. They can also enter more detailed information such as their travel preferences and past travel history. By allowing access to location information, location information can be obtained.

[0782] Device:

[0783] The app temporarily stores the user's input information and proceeds with the account creation process. It checks the location access permission status and obtains location information with the user's consent.

[0784] server:

[0785] The server receives the account information and the access permission status of the location information sent from the terminal and stores them in a database.

[0786] Selecting your destination and checking in

[0787] User:

[0788] After arriving at their travel destination, the user launches the app and presses the "Check-in" button.

[0789] Device:

[0790] The app uses the built-in GPS to determine the user's current location and sends that location information to a server.

[0791] server:

[0792] Based on the received location information, the server provides information on nearby tourist attractions and restaurants, as well as waiting times and the shortest routes. This information is sent to the device and displayed to the user.

[0793] Real-time support during sightseeing

[0794] Device:

[0795] The app provides real-time information on waiting times at tourist attractions, the shortest routes, and restaurant availability. When users visit tourist attractions, their progress is automatically recorded.

[0796] server:

[0797] Based on the received information, the server updates the congestion status of tourist spots in real time and sends notifications to users as necessary.

[0798] Purchase history and photo organization

[0799] Device:

[0800] When a user makes a payment using their smartphone, the information is automatically recorded. Also, photos taken during the trip are automatically organized and categorized. This organized information is sent to the server.

[0801] server:

[0802] The server stores purchase history and prepares it for later analysis, and the photos are stored in the cloud, where they are automatically edited to create slideshows and albums.

[0803] Recommendations for your next travel plan

[0804] server:

[0805] Once the trip is over, the server analyzes the travel data (visit history, purchase history, photo data) and uses a generative AI model to recommend the best sightseeing spots, routes, and duration for the next trip, and notifies the user through the app.

[0806] Specific examples

[0807] For example, if a user travels to Kyoto, the system operates as follows.

[0808] 1. Initial setup and user information entry:

[0809] Users install the app on their smartphone, create an account, enter basic information, and allow access to their GPS.

[0810] 2. Check-in in Kyoto:

[0811] When a user arrives in Kyoto, they launch the app and press the "Check In" button. The app then checks their current location and provides information on nearby tourist attractions (e.g., temples, gardens, historical buildings) and dining options.

[0812] Specific prompt examples:

[0813] "Install the app, enter your name and email address, and register your travel preferences."

[0814] "When you arrive in Kyoto, open the app and click check-in."

[0815] "Provides real-time information on nearby tourist attractions and restaurants."

[0816] "It records your smartphone payment history and automatically organizes the photos you take."

[0817] "Recommend your next travel plan."

[0818] This invention allows travelers to enjoy sightseeing efficiently and also makes it possible to smoothly plan their next trip.

[0819] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0820] Step 1:

[0821] Entering initial settings and user information

[0822] Specific behavior:

[0823] User: The user first downloads and installs the app on their smartphone. They launch the app and enter basic account information such as their name and email address, as well as other details such as their travel preferences and past travel history. They are then asked to allow location access.

[0824] Input: User's name, email address, travel preferences, past travel history, location access permission (input)

[0825] Output: Account information, location access permission (output)

[0826] Device:

[0827] The app will temporarily store the information you entered and proceed with the account creation process. Confirm location access permissions.

[0828] Input: Account information entered by the user, location access permission status (input)

[0829] Output: Provisional account information, location access permission status (output)

[0830] server:

[0831] The account information and location information access permission status sent from the device are saved in a database.

[0832] Input: Account information and location access permission status sent from the device (input)

[0833] Output: Stored account information and permission data (output)

[0834] Step 2:

[0835] Selecting your destination and checking in

[0836] Specific behavior:

[0837] User: After arriving at their travel destination, they launch the app and press the "Check-in" button.

[0838] Input: User's current location, travel destination selection information (input)

[0839] Output: Check-in information (output)

[0840] Device:

[0841] It uses the built-in GPS function to determine the user's current location and sends that information to the server.

[0842] Input: GPS data (input)

[0843] Output: User's current location information (output)

[0844] server:

[0845] Based on the received location information, data is generated that provides information on nearby tourist attractions and restaurants, waiting times, and the shortest routes, and is sent to the terminal.

[0846] Input: Current location information sent from the device (input)

[0847] Output: Information on nearby tourist spots, waiting time, shortest route (output)

[0848] Step 3:

[0849] Real-time support during sightseeing

[0850] Specific behavior:

[0851] Device: The app provides real-time information on waiting times at tourist attractions, the shortest routes, and seat availability at restaurants. When users visit tourist attractions, their progress is automatically recorded.

[0852] Input: Real-time GPS data, tourist spot selection information (input)

[0853] Output: Waiting time information, shortest route, seat availability information, visit history (output)

[0854] server:

[0855] Based on the received real-time information, the system updates the congestion status of tourist spots and sends notifications to users.

[0856] Input: Real-time GPS data received from the device, visit history (input)

[0857] Output: Updated tourist destination information, congestion status, notifications (output)

[0858] Step 4:

[0859] Purchase history and photo organization

[0860] Specific behavior:

[0861] Terminal: When a user makes a payment using their smartphone, that information is automatically recorded. Photos taken during the trip are automatically organized, categorized, and sent to the server.

[0862] Input: Smartphone payment data, taken photo (input)

[0863] Output: Purchase history data, organized photo data (output)

[0864] server:

[0865] It receives purchase history and stores it in a database. It also stores photographic data in the cloud and uses an automatic editing function to generate slideshows and albums.

[0866] Input: Purchase history data received from the device, organized photo data (input)

[0867] Output: Saved purchase history data, photo data stored in the cloud, generated slideshows and albums (output)

[0868] Step 5:

[0869] Recommendations for your next travel plan

[0870] Specific behavior:

[0871] Server: After the trip is over, the server statistically analyzes the travel data (visit history, purchase history, photo data) and uses a generative AI model to recommend the best tourist spots, routes, and duration for the next trip.

[0872] Input: Travel data (visit history, purchase history, photo data) (input)

[0873] Output: Next travel plan, recommendations (output)

[0874] server:

[0875] Recommended tourist spots and routes are notified to the user's smartphone based on their account information.

[0876] Input: Recommendation information, user account information (input)

[0877] Output: Notification(Output)

[0878] Device:

[0879] Users will receive notifications and can check their upcoming travel plans.

[0880] Input: Notification(Input)

[0881] Output: Confirmed itinerary (output)

[0882] (Application example 1)

[0883] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0884] In recent years, there has been an increasing need for travelers to obtain information on sightseeing and dining at their travel destinations efficiently. There is a need for a system that can efficiently obtain information on tourist spots and surrounding restaurants, and support the planning of next trips based on visit and purchase history. Furthermore, to enrich the dining experience during travel, a system is needed that can obtain real-time information on the congestion status of surrounding restaurants, reservation information, and popular menu items.

[0885] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0886] In this invention, the server includes means for acquiring user location information, means for providing information on nearby tourist spots, waiting times, and shortest routes based on the acquired location information, means for saving history information on visits to tourist spots and purchase history information, means for recommending next travel plans based on the saved history information and purchase history information, means for providing information on nearby restaurants, popular menus, and congestion status based on the acquired location information, and means for providing reservation status of nearby restaurants. This allows travelers to enjoy sightseeing efficiently and have an optimal dining experience at their travel destination.

[0887] "User" refers to a traveler who uses the system and is the entity that provides individual location information, preference information, etc.

[0888] "Location Information" means data that allows a system to determine a user's current geographic location, obtained using GPS or other positioning technology.

[0889] "Tourist destination information" is information about tourist attractions, famous sites, natural landscapes, etc. that the user may visit.

[0890] "Waiting time" is information about the amount of time you need to wait to use a service at a tourist spot or restaurant.

[0891] The "shortest route" is information about the most efficient route from the current location to the destination.

[0892] "History information" is a record of tourist spots that a user has visited in the past and services that the user has used.

[0893] "Purchase history information" is a record of purchases made by a user in the past, and includes information about the products and services purchased.

[0894] "Recommendation" refers to making optimal suggestions for the user's next trip or activity based on their past behavior and preferences.

[0895] "Restaurant information" is information about nearby restaurants, including their locations, menus, opening hours, etc.

[0896] "Popular menu items" refers to information about dishes and drinks that are particularly highly rated or frequently ordered at restaurants.

[0897] "Crowding status" is information about the current level of crowding at places such as tourist spots and restaurants.

[0898] "Reservation status" refers to information used to guarantee the availability of seats or services in advance at restaurants and other services.

[0899] The present invention relates to a system that allows travelers to visit tourist spots efficiently and enrich their dining experience. This system provides real-time information on nearby tourist spots and restaurants based on the user's location information, and makes recommendations for subsequent travel plans.

[0900] System Overview

[0901] 1. Initial settings and user information entry

[0902] Terminal

[0903] First, users install the system's dedicated app on their smartphones, enter basic information (such as name and email address) to create an account, and then set it to allow GPS access.

[0904] server

[0905] Receives user account information sent from the device and stores it in a database. Obtains past travel history and prepares for analysis.

[0906] 2. Acquisition of location information and provision of tourist spot and restaurant information

[0907] User

[0908] After arriving at your destination, launch the app and press the "Check-in" button.

[0909] Terminal

[0910] It uses the built-in GPS to determine the user's current location and sends that information to the server.

[0911] server

[0912] Based on the received current location information, information on nearby tourist attractions and restaurants, waiting times, the shortest route, as well as popular menu items, congestion status, and reservation status at restaurants are obtained and sent to the device.

[0913] 3. Support during sightseeing

[0914] Terminal

[0915] The app provides real-time information on waiting times at tourist spots, the shortest routes, and seat availability and reservation status at restaurants. When users visit tourist spots or restaurants, their history is automatically recorded.

[0916] server

[0917] Based on the received location information and visit history, the system updates the congestion status of tourist spots and restaurants and sends notifications to the user as necessary.

[0918] 4. Purchasing history and photo organization

[0919] Terminal

[0920] When a user makes a payment using their smartphone, that information is automatically recorded, and photos taken during the trip are automatically organized and categorized.

[0921] server

[0922] It saves purchase history and prepares it for later analysis. The photos are stored in the cloud and automatically edited to create slideshows and albums.

[0923] 5. Recommendations for your next travel plan

[0924] server

[0925] Once the trip is over, the server analyzes the user's travel data (visit history, purchase history, photo data), and recommends the best sightseeing spots, routes, and duration for the next trip, and notifies the user through the app.

[0926] Specific examples

[0927] Consider the case where a user travels to a specific city. For example, the user visits a tourist spot, obtains information about nearby restaurants, and enjoys delicious food. The flow is as follows:

[0928] Specific examples

[0929] When a traveler arrives at a famous tourist spot, they launch the app and press the "Check-in" button. GPS identifies their current location and sends that information to the server. The server then uses that location information to provide real-time information about nearby tourist spots and restaurants. The traveler visits the tourist spot, finds nearby restaurants, and enjoys a meal. During this process, their visit history and purchase history are automatically recorded, and recommendations are made for the next trip.

[0930] Prompt Sentence Examples

[0931] "I want to develop an app that provides information about recommended restaurants near the user's current location when they visit a famous tourist spot. I want a function that uses the user's location information to display nearby restaurants, popular menu items, and crowding status in real time."

[0932] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0933] Step 1: Installing the app and initial setup

[0934] The device requires the user to install a system-specific app on their smartphone and enter basic information (such as name and email address), then allows GPS access. The entered information is sent from the device to the server.

[0935] Input: User's basic information (name, email address, etc.)

[0936] Output: User account information is saved on the server

[0937] Step 2: Obtaining and sending location information

[0938] When the user arrives at their travel destination and presses the "Check-in" button, the device uses its built-in GPS to determine their current location and sends that information to the server.

[0939] Input: User's "check-in" operation

[0940] Output: Current location latitude and longitude information is sent to the server

[0941] Step 3: Acquiring and providing information on tourist spots and restaurants

[0942] The server receives the latitude and longitude information of the current location and then obtains information about nearby tourist attractions and restaurants, including waiting times, the shortest route, popular menu items, congestion status, and reservation status. This information is then sent to the device.

[0943] Input: Current location latitude and longitude information

[0944] Output: Information on nearby tourist spots, restaurant information, waiting time, shortest route, popular menu items, congestion status, reservation status

[0945] Step 4: Providing real-time support

[0946] The device displays information about tourist spots and restaurants sent from the server to the user in real time, providing the shortest route to each location, waiting times, congestion status, etc. When the user visits a tourist spot or eats at a restaurant, the history is automatically recorded and sent to the server.

[0947] Input: Tourist information and restaurant information from the server

[0948] Output: User visit history and purchase history are recorded on the server

[0949] Step 5: Record and organize your purchase history and photos

[0950] When a user makes a smartphone payment at a restaurant, the device automatically records the purchase history information and sends it to the server. In addition, photos taken during the trip are automatically organized, categorized, and stored in the cloud.

[0951] Input: User's smartphone payment information, photographed photo

[0952] Output: Purchase history and photo data stored in the cloud

[0953] Step 6: Recommend your next travel plan

[0954] After the trip, the server analyzes the user's saved travel data (visit history, purchase history, photo data) and recommends the best sightseeing spots, routes, and duration for the next trip. This recommendation information is notified to the user via their device.

[0955] Input: User's travel data (visit history, purchase history, photo data)

[0956] Output: Recommendations for your next trip

[0957] As a specific example of how it works, when a user arrives at a tourist spot, launches the app, and presses the check-in button, the device acquires GPS information and sends it to the server. The server then uses this location information to acquire information about nearby tourist spots and restaurants, and sends it to the device. The user receives this information in real time, allowing them to efficiently choose their next tourist spot or place to eat. After the trip is over, the server also sends recommended information, making it easy to plan their next trip.

[0958] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0959] This invention relates to a system that acquires a user's location information and emotions, and based on that information, provides tourist information and recommends the user's next travel plan. The system combines an emotion engine to provide optimal information so that the user can have a more satisfying travel experience. The system's program processing is explained below in natural language.

[0960] System Overview

[0961] 1. Initial settings and user information entry

[0962] Device:

[0963] Users download the system's dedicated app and install it on their smartphones.

[0964] Launch the app and create a new account by entering basic account information such as your name and email address.

[0965] Configure settings to allow recognition of travel preferences, past travel history, and even emotions.

[0966] server:

[0967] Receives account information sent from the device and stores it in a database.

[0968] If necessary, obtain past travel history and prepare for analysis.

[0969] User:

[0970] By allowing access to location information and emotion recognition, you can obtain location information and emotion information.

[0971] 2. Selecting your destination and checking in

[0972] User:

[0973] After arriving at your destination, launch the app and press the "Check-in" button.

[0974] Check the information on tourist spots and restaurants provided within the app.

[0975] Device:

[0976] It uses GPS to check the user's current location and uses an emotion engine to analyze the user's emotions in real time.

[0977] The location information and the emotion information are transmitted to a server.

[0978] server:

[0979] Based on the received current location information and emotion information, information on nearby tourist spots, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[0980] Specific examples

[0981] Let's take the example of User B going on a trip to Tokyo.

[0982] 1. Initial settings and user information entry

[0983] Person B installs the app on his smartphone and creates an account, entering basic information and granting access to the GPS and emotion recognition functions.

[0984] 2. Check-in in Tokyo

[0985] When Mr. B arrives in Tokyo, he launches the app and presses the "Check-in" button.

[0986] The app checks B's current location and displays information about nearby tourist spots (such as Tokyo Tower, Sensoji Temple, and Shibuya Crossing) and restaurants. Meanwhile, using the built-in camera and microphone, the emotion engine analyzes B's facial expressions and tone of voice to recognize his or her emotions.

[0987] 3. Real-time support during sightseeing

[0988] Device:

[0989] The app provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability. In addition, the emotion engine periodically analyzes B's emotions and suggests tourist spots based on his / her current emotional state (for example, if he / she is feeling stressed, it will suggest a relaxing park).

[0990] server:

[0991] Based on the received information, the system periodically updates information on the congestion situation and waiting times at tourist spots, and sends notifications to Person B as necessary.

[0992] Emotional information is analyzed and used to gauge satisfaction at tourist spots and recommend the next destination.

[0993] 4. Purchasing history and photo organization

[0994] Device:

[0995] When Mr. B makes a payment using his smartphone, the information is automatically recorded.

[0996] Photos taken during a trip are automatically organized and categorized, and an emotion engine extracts photos taken during specific emotional moments to create special albums.

[0997] server:

[0998] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions (such as creating slideshows and applying filters).

[0999] 5. Recommendations for your next travel plan

[1000] server:

[1001] After the trip, Mr. B's travel data (visit history, purchase history, photo data, and emotional data) is analyzed using a machine learning algorithm to recommend his next travel plan. For example, the system will suggest the best next travel destinations and places to visit based on the tourist spots he has enjoyed in the past and the activities he has been interested in.

[1002] User:

[1003] Check your upcoming travel plans in the app and plan your next trip accordingly.

[1004] This system allows users to enjoy sightseeing efficiently and has a more personalized travel experience based on their emotions.

[1005] The processing flow will be explained below.

[1006] Step 1:

[1007] User:

[1008] Download the app and complete the installation. Launch the app and create a new account by entering your account information (name, email address, travel preferences, etc.).

[1009] Step 2:

[1010] Device:

[1011] The account information entered by the user is sent to the server, and permission to access GPS and emotion recognition is requested. If the user allows it, location information and emotion information are obtained.

[1012] Step 3:

[1013] server:

[1014] The received account information is stored in a database. If there is past travel history, it is retrieved and prepared for analysis.

[1015] Step 4:

[1016] User:

[1017] After arriving at your travel destination, open the app and press the "Check-in" button. Check the information on tourist spots and restaurants provided within the app.

[1018] Step 5:

[1019] Device:

[1020] It uses GPS to determine the user's current location and sends that information to the server, and uses an emotion engine to analyze the user's facial expressions and voice to assess their current emotions.

[1021] Step 6:

[1022] server:

[1023] Based on the current location information and emotion information, information on nearby tourist spots, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[1024] Step 7:

[1025] Device:

[1026] The received tourist spot and restaurant information is displayed on the app screen to notify the user. The emotion engine operates in real time to continuously monitor changes in the user's emotions.

[1027] Step 8:

[1028] User:

[1029] Based on the tourist information displayed, users can select a location to visit and actually visit it. If the emotions they felt while visiting a tourist spot changed, that information is recorded.

[1030] Step 9:

[1031] Device:

[1032] The data of tourist spots visited by the user is updated in real time and the time spent there is recorded. The emotion engine analyzes the user's emotions and provides information according to the situation (for example, suggesting a quiet place if you need to relax).

[1033] Step 10:

[1034] server:

[1035] The system regularly updates information on the congestion status and waiting times at tourist spots and notifies users as needed. It also analyzes travel experiences based on emotional data and uses this information to make future recommendations.

[1036] Step 11:

[1037] User:

[1038] Visit a restaurant and pay using your smartphone. Also, take photos while traveling.

[1039] Step 12:

[1040] Device:

[1041] It automatically records smartphone payment information, organizes photo data into categories, and extracts photos taken in specific emotional states to create special albums.

[1042] Step 13:

[1043] server:

[1044] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions.

[1045] Step 14:

[1046] server:

[1047] After the trip, the system analyzes the user's travel data (visit history, purchase history, photo data, and emotional data) using machine learning algorithms to recommend the next travel plan. It suggests the best next travel destinations and places to visit based on the tourist spots they have enjoyed in the past and the activities they are interested in.

[1048] Step 15:

[1049] User:

[1050] Check your upcoming travel plans in the app and plan your next trip accordingly.

[1051] Example 2

[1052] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1053] While conventional travel support systems provide information based on the user's location, they lack the ability to provide personalized information that takes into account the user's emotional state. Furthermore, organizing travel purchase history and photo data is time-consuming, making data management inefficient for use in planning the next trip. Furthermore, there is a need for a system that can quickly provide information on the congestion situation at visited tourist spots and real-time waiting times.

[1054] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1055] In this invention, the server includes means for acquiring location information and emotional state of the user, means for providing information on nearby tourist spots, waiting times and the shortest route based on the acquired location information and emotional information, and means for saving history information on visiting tourist spots, purchase history information and emotional state. This not only enables the user to receive personalized tourist spot information that takes into account their emotional state, but also enables automatic organization of purchase history and photo data, making it easier to use for planning their next trip.

[1056] "Location information" is data that indicates the specific geographic coordinates where a user is currently physically located.

[1057] "Emotional information" is data that indicates the user's emotional state and is obtained through facial expression recognition, voice analysis, and the like.

[1058] "Tourist destination information" refers to information related to tourist destinations, including, for example, highlights, opening hours, admission fees, and crowding levels.

[1059] "Wait time" is data that indicates the amount of time a user must wait to receive a service or experience at a particular location or event.

[1060] The "shortest route" is information indicating the route with the shortest travel distance from the starting point to the destination.

[1061] "History information" is recorded data of places visited by a user in the past and services used by the user.

[1062] "Purchase history information" is recorded data of products and services purchased by a user.

[1063] "Recommendation" means suggesting the next action to be taken based on the user's past actions and current situation.

[1064] The present invention is a system that acquires location information and emotion information of a user and, based on this, provides tourist spot information and recommends next travel plans. An embodiment of the system will be described in detail below.

[1065] Entering initial settings and user information

[1066] Device:

[1067] Users download and install the system's dedicated app on their smartphones, then launch the app and create a new account by entering basic information such as their name and email address, as well as travel preferences, past travel history, and permission to recognize emotions.

[1068] server:

[1069] Receives account information sent from the device and stores it in a database. If necessary, retrieves past travel history and prepares it for analysis.

[1070] User:

[1071] Allowing access to location information and emotion recognition allows us to obtain location information and emotion information.

[1072] Selecting your destination and checking in

[1073] User:

[1074] After arriving at your travel destination, open the app and press the "Check-in" button. Check the information on tourist spots and restaurants provided within the app.

[1075] Device:

[1076] The system uses GPS to check the user's current location, and the emotion engine analyzes emotions in real time using the built-in camera and microphone. Location and emotion information is sent to the server.

[1077] server:

[1078] Based on the received current location information and emotion information, information on nearby tourist spots, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[1079] Real-time support during sightseeing

[1080] Device:

[1081] The app provides real-time information on waiting times at tourist attractions, the shortest routes, and restaurant availability. Furthermore, an emotion engine periodically analyzes the user's emotions and suggests tourist spots based on their current emotional state (for example, if they're feeling stressed, it will suggest a relaxing park).

[1082] server:

[1083] Based on the received information, the system periodically updates information on the congestion status and waiting times of tourist spots, and notifies users as necessary. Emotional information is analyzed and used to determine satisfaction with tourist spots and recommend the next destination.

[1084] Purchase history and photo organization

[1085] Device:

[1086] When a user makes a payment using their smartphone, that information is automatically recorded. Photos taken during the trip are automatically organized and categorized. Furthermore, an emotion engine extracts photos taken during specific emotional moments and creates special albums.

[1087] server:

[1088] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions (such as creating slideshows and applying filters).

[1089] Recommendations for your next travel plan

[1090] server:

[1091] After the trip, the system analyzes the user's travel data (visit history, purchase history, photo data, and emotional data) using machine learning algorithms. Based on the tourist spots they enjoyed in the past and the activities they were interested in, the system suggests the best travel destinations and places to visit next time.

[1092] User:

[1093] Check your upcoming travel plans in the app and plan your next trip accordingly.

[1094] Specific examples

[1095] Let's take the example of User B going on a trip to Tokyo.

[1096] Entering initial settings and user information

[1097] Person B installs the app on his smartphone and creates an account, entering basic information and granting access to the GPS and emotion recognition functions.

[1098] Check-in in Tokyo

[1099] When Person B arrives in Tokyo, he launches the app and presses the "Check-in" button. The app checks Person B's current location and displays information about nearby tourist spots (e.g., Tokyo Tower, Sensoji Temple, Shibuya Crossing) and restaurants. Meanwhile, using the built-in camera and microphone, the emotion engine analyzes Person B's facial expressions and tone of voice to recognize their emotions.

[1100] Real-time support during sightseeing

[1101] The app provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability. Furthermore, the emotion engine periodically analyzes B's emotions and suggests tourist spots based on his / her current emotional state (for example, if he / she is feeling stressed, it will suggest a relaxing park).

[1102] Purchase history and photo organization

[1103] When B makes a payment using his smartphone, the information is automatically recorded. Photos taken during the trip are automatically organized and categorized. Photos taken during specific moments of emotion are also extracted and a special album is created.

[1104] Recommendations for your next travel plan

[1105] After B's trip, his travel data (visit history, purchase history, photo data, and emotional data) are analyzed using a machine learning algorithm to recommend his next travel plan. For example, it suggests the best next travel destinations and places to visit based on the tourist spots he enjoyed in the past and the activities he was interested in.

[1106] Prompt Sentence Examples

[1107] "When the user is at Tokyo Tower, the system will send the user's current location information and emotion information to the server and suggest recommended tourist spots and restaurants."

[1108] The above is a specific embodiment of the system.

[1109] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1110] Program processing flow

[1111] Entering initial settings and user information

[1112] Step 1:

[1113] Device: Users download the system-specific app and install it on their smartphones.

[1114] Enter: Install app.

[1115] Output: App launch.

[1116] Step 2:

[1117] Device: Launch the app and enter basic information such as your name and email address to create a new account.

[1118] Input: Name, email address, password, etc.

[1119] Output: Save account information.

[1120] Step 3:

[1121] Device: Set travel preferences, past travel history, and emotion recognition permissions.

[1122] Input: Travel preferences, past travel history, emotion recognition permission

[1123] Output: A completed account profile.

[1124] Step 4:

[1125] Terminal: Sends the entered account information to the server.

[1126] Input: Account Information

[1127] Output: Send to server.

[1128] Step 5:

[1129] Server: Stores the received account information in a database, retrieves past travel history as needed, and prepares it for analysis.

[1130] Input: Account Information

[1131] Output: Save to database.

[1132] Step 6:

[1133] User: Allow location and emotion recognition access so that location and emotion information can be obtained.

[1134] Input: Location and emotion recognition permissions

[1135] Output: Permission settings.

[1136] Selecting your destination and checking in

[1137] Step 1:

[1138] User: After arriving at their travel destination, they launch the app and press the "Check-in" button.

[1139] Input: Arrive at destination and press "Check-in" button

[1140] Output: Check-in confirmation.

[1141] Step 2:

[1142] Device: Uses GPS to determine the user's location, and the emotion engine analyzes emotions in real time using the built-in camera and microphone.

[1143] Input: User's current location, built-in camera and microphone

[1144] Output: Location information and emotion information.

[1145] Step 3:

[1146] Device: Sends location information and emotion information to the server.

[1147] Input: Location and emotion

[1148] Output: Send to server.

[1149] Step 4:

[1150] Server: Based on the received current location information and emotion information, obtains information on nearby tourist spots, waiting times, shortest routes, and restaurant information, and sends this information to the device.

[1151] Input: Current location information, emotion information

[1152] Output: Information on nearby tourist attractions, waiting times, shortest routes, and restaurant information.

[1153] Step 5:

[1154] Terminal: Receives information from the server and displays it to the user.

[1155] Input: Information on nearby tourist attractions, waiting times, shortest routes, restaurant information

[1156] Output: What is displayed to the user.

[1157] Real-time support during sightseeing

[1158] Step 1:

[1159] Device: The app provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability.

[1160] Input: Waiting time at tourist spots, shortest route, seat availability information

[1161] Output: Display of real-time information.

[1162] Step 2:

[1163] On the device: The emotion engine periodically analyzes the user's emotions and suggests tourist spots based on their current emotional state.

[1164] Input: Emotion data

[1165] Output: Personalized tourist destination suggestions.

[1166] Step 3:

[1167] Terminal: Periodically sends behavioral data during sightseeing (places visited, length of stay, etc.) to the server.

[1168] Input: Behavioral data

[1169] Output: Send to server.

[1170] Step 4:

[1171] Server: Based on the received information, the server periodically updates information on the congestion status and waiting times of tourist spots, and sends notifications to users as necessary.

[1172] Input: Behavioral data

[1173] Output: Crowding status, wait time updates, notifications.

[1174] Purchase history and photo organization

[1175] Step 1:

[1176] Terminal: When a user makes a payment using their smartphone, the information is automatically recorded.

[1177] Enter purchasing info record

[1178] Output: A record of purchase history.

[1179] Step 2:

[1180] On your device: Automatically organize and categorize photos taken during your trip.

[1181] Input: Photo data

[1182] Output: Classified photo data.

[1183] Step 3:

[1184] On device: The emotion engine extracts photos taken at specific emotional moments and generates a special album.

[1185] Input: Photo data, emotion data

[1186] Output: An album based on emotions.

[1187] Step 4:

[1188] Server: Stores captured photo data in the cloud and performs automatic editing functions (such as creating slideshows and applying filters).

[1189] Input: Photo data

[1190] Output: Cloud saved, edited photo data.

[1191] Recommendations for your next travel plan

[1192] Step 1:

[1193] Server: After the trip ends, the user's travel data (visit history, purchase history, photo data, and emotional data) is analyzed using machine learning algorithms.

[1194] Input: Trip data

[1195] Output: Analysis results.

[1196] Step 2:

[1197] Server: Based on the analysis results, suggests the best travel destinations or places to visit next based on tourist spots you have enjoyed in the past and activities you are interested in.

[1198] Input: Analysis results

[1199] Output: Next trip recommendation.

[1200] Step 3:

[1201] User: See upcoming travel plans within the app and plan their next trip accordingly.

[1202] Input: Next Trip Recommendation

[1203] Output: Next trip plan.

[1204] (Application example 2)

[1205] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1206] Conventional tourist information systems are limited to providing information about tourist spots and restaurants based on the user's current location, and do not adequately consider the user's emotional state. Furthermore, there are no comprehensive systems that can suggest tourist spots using real-time emotion recognition or improve the travel experience. As a result, users may experience lower travel satisfaction due to suggestions that do not match their emotional state. To address this issue, a system that utilizes the user's emotional information to provide more personalized tourist information and recommend next travel plans is needed.

[1207] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1208] In this invention, the server includes means for acquiring user location information, means for providing information on nearby tourist spots, waiting times, and the shortest route based on the acquired location information and emotion information, means for recognizing the user's emotion and suggesting tourist spots and transportation options based on that emotion, and means for saving history information on tourist spots visited and purchase history information. This makes it possible to provide tourist information that reflects the user's emotional state in real time, and by making suggestions that meet individual needs, it becomes possible to improve travel satisfaction.

[1209] definition statement

[1210] "User" refers to the user of the service and the entity that receives information and suggestions from the system.

[1211] "Location Information" means data that describes a user's current geographic location, such as data obtained through GPS or other location measurement technologies.

[1212] "Emotional information" is data that indicates the emotional state of a user extracted from facial expressions, tone of voice, behavioral patterns, etc.

[1213] "Tourist destination information" means information related to a particular tourist destination, such as overview, history, attractions, and activities.

[1214] "Waiting time" is information indicating the waiting time to enter a particular tourist attraction or facility.

[1215] The "shortest route" is information indicating the route that will allow the user to reach the destination specified by the user in the shortest time.

[1216] "Emotion recognition" is the process of identifying and digitizing a user's current emotional state.

[1217] "History information" is data that shows the overall information such as the places a user has visited in the past, the services they have used, and their behavioral records.

[1218] "Purchase history information" is a record of products and services purchased by a user in the past.

[1219] The "next travel plan" is the next travel destination and schedule suggested based on the user's past history information and emotional information.

[1220] "Restaurant information" refers to information about restaurants in a specified area, such as their names, menus, reviews, and opening hours.

[1221] "Availability" is information indicating the availability of seats at a particular restaurant.

[1222] "Photo data" is a collection of image files taken by a user, and is data stored in the form of visual information.

[1223] "Automatic organization and editing" refers to the process of using an algorithm to categorize photo data and process it as needed.

[1224] "Recommending travel plans" means suggesting travel destinations and plans of action that will satisfy the user.

[1225] MODE FOR CARRYING OUT THE INVENTION

[1226] The present invention relates to a system that provides tourist information and recommends next travel plans based on a user's emotional information and location information. The following description describes an embodiment of the invention based on the claims.

[1227] System Overview

[1228] 1. Initial settings and user information entry

[1229] Device:

[1230] Users download and install the system's dedicated application onto their device, then create a new account by entering basic account information such as their name and email address, as well as their travel preferences, past travel history, and permission to use emotion recognition.

[1231] server:

[1232] Receives account information sent from the device and stores it in a database. If necessary, retrieves past travel history and prepares it for analysis.

[1233] User:

[1234] Allowing access to location and emotion recognition allows the application to obtain location and emotion information.

[1235] 2. Selecting your destination and checking in

[1236] User:

[1237] After arriving at your travel destination, start the app and press the "Check-in" button. Check the information on tourist spots and restaurants provided within the app.

[1238] Device:

[1239] The system uses GPS to check the user's current location and uses an emotion engine to analyze the user's emotions in real time. The location information and emotion information are sent to the server.

[1240] server:

[1241] Based on the received current location information and emotion information, information on nearby tourist spots, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[1242] 3. Real-time support during sightseeing

[1243] Device:

[1244] The application provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability. In addition, an emotion engine periodically analyzes the user's emotions and suggests tourist spots based on their current emotional state.

[1245] server:

[1246] Based on the received information, the system periodically updates information on the congestion status and waiting times of tourist spots, and notifies users as necessary. Emotional information is analyzed and used to determine satisfaction with tourist spots and recommend the next destination.

[1247] 4. Purchasing history and photo organization

[1248] Device:

[1249] When users make smart payments, the information is automatically recorded. Photos taken during travel are automatically organized and categorized. An emotion engine also extracts photos taken during specific emotional moments and creates special albums.

[1250] server:

[1251] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions (such as creating slideshows and applying filters).

[1252] 5. Recommendations for your next travel plan

[1253] server:

[1254] After the trip, the system analyzes the user's travel data (visit history, purchase history, photo data, and emotional data) using machine learning algorithms to recommend the next travel plan. It suggests the best next travel destinations and places to visit based on the tourist spots they have enjoyed in the past and the activities they have been interested in.

[1255] User:

[1256] See upcoming travel plans within the app and plan your next trip accordingly.

[1257] Specific examples of processing

[1258] 1. Use the camera to take a picture of the user's face and analyze their emotions using an emotion recognition API (e.g., Emotion API).

[1259] 2. Use the GPS sensor to get the user's current location.

[1260] 3. Based on the acquired emotion data and location information, the tourist attraction information API is called to obtain information about nearby tourist attractions.

[1261] 4. The results are displayed on the smart glasses display and suggestions are made to the user.

[1262] Prompt Sentence Examples

[1263] If the user is feeling tired, provide them with information on recommended tourist spots around Shibuya, Tokyo where they can relax.

[1264] This system allows users to obtain optimal travel information based on their emotional state and location in real time, enabling them to enjoy a highly satisfying travel experience.

[1265] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1266] Program processing steps

[1267] Step 1:

[1268] Input: The user downloads a system-specific application to their device and enters basic account information.

[1269] What it does: The user enters basic information like name and email address, travel preferences, past travel history, and permission to enable emotion recognition.

[1270] Output: The entered account information is sent to the server and stored in a database. This information is used to prepare for future service provision.

[1271] Step 2:

[1272] Input: The user arrives at their travel destination, launches the application, and presses the "Check-in" button.

[1273] Specific operation: The device uses GPS to determine the user's current location and uses an emotion engine to analyze the user's emotions in real time using the camera and microphone.

[1274] Output: The acquired location information and emotion information are sent to the server, which then uses this information to acquire information about nearby tourist spots, waiting times, the shortest route, and restaurant information, and sends it to the device.

[1275] Step 3:

[1276] Input: Location and emotion information received by the server.

[1277] Specific operation: The server calls the tourist attraction information API and collects information on nearby tourist attractions, waiting times, shortest routes, and restaurant information based on the acquired location information and emotion information.

[1278] Output: The acquired tourist spot information, waiting time information, shortest route information, and restaurant information are sent to the terminal.

[1279] Step 4:

[1280] Input: Tourist attraction information, waiting time information, shortest route information, and restaurant information sent from the server.

[1281] How it works: The device provides this information to the user in real time, and the emotion engine periodically analyzes the user's emotions and suggests tourist spots based on their current emotional state.

[1282] Output: Real-time tourist information and sentiment-based suggestions are displayed to the user.

[1283] Step 5:

[1284] Input: Photo data taken by the user during their trip and smart payment information.

[1285] How it works: The device automatically organizes and categorizes photos taken by the device. It also uses an emotion engine to extract photos taken with specific emotions and create special albums. Smart payment information is also recorded at the same time.

[1286] Output: Organized photo data and purchase history are stored on the server. A special album is created from photos taken at specific emotional moments.

[1287] Step 6:

[1288] Input: Stored travel data (visit history, purchase history, photo data, emotion data).

[1289] How it works: The server analyzes this data using machine learning algorithms to recommend your next travel itinerary, suggesting the best places to visit or travel to next based on the tourist spots you've visited in the past and the activities you're interested in.

[1290] Output: Next trip plan based on the analysis results will be displayed within the application.

[1291] In this way, users can receive optimal tourist information based on their emotional state and location information in real time, and next travel plans are also suggested, enabling a highly satisfying travel experience.

[1292] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1293] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1294] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1295] [Third embodiment]

[1296] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1297] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1298] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1299] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1300] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1301] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1302] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1303] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1304] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1305] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1306] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1307] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1308] This invention relates to a system that allows travelers to efficiently visit tourist spots and plan their next trip based on their past travel history. This system acquires location information from a terminal and provides tourist spot information based on that information, stores and uses visit history and purchase history, and also recommends next travel plans.

[1309] System Overview

[1310] 1. Initial settings and user information entry

[1311] Device:

[1312] Users download an app specifically for this system and install it on their smartphones.

[1313] Launch the app and create a new account by entering basic account information such as your name and email address.

[1314] You can also enter details such as your travel preferences and past travel history.

[1315] server:

[1316] Receives account information sent from the device and stores it in a database.

[1317] If necessary, obtain past travel history and prepare it for analysis.

[1318] User:

[1319] A confirmation screen will appear asking whether you want to allow access to your location information, and if you allow it, your location information will be obtained.

[1320] 2. Selecting your destination and checking in

[1321] User:

[1322] After arriving at your destination, launch the app and press the "Check-in" button.

[1323] Device:

[1324] It uses the built-in GPS to determine the user's current location and sends that information to the server.

[1325] server:

[1326] Based on the received current location information, information on nearby tourist attractions and restaurants, waiting times, etc. is obtained and sent to the terminal.

[1327] Specific examples

[1328] Let's take the example of User A going on a trip to Kyoto.

[1329] 1. Initial settings and user information entry

[1330] Person A installs the app on his smartphone, creates an account, enters basic information, and allows access to GPS.

[1331] 2. Check-in in Kyoto

[1332] When Mr. A arrives in Kyoto, he launches the app and presses the "Check-in" button.

[1333] The app checks A's current location and displays information about nearby tourist attractions (e.g., Kinkaku-ji Temple, Kiyomizu-dera Temple, Gion) and restaurants.

[1334] 3. Real-time support during sightseeing

[1335] Device:

[1336] The app provides real-time information on waiting times at tourist spots, the shortest routes, and seat availability at restaurants.

[1337] When Person A selects a tourist spot and visits it, his / her progress is automatically recorded.

[1338] server:

[1339] Based on the received information, the congestion situation at tourist spots is updated in real time and notifications are sent to Mr. A as necessary.

[1340] 4. Purchasing history and photo organization

[1341] Device:

[1342] When Mr. A makes a payment using his smartphone, the information is automatically recorded.

[1343] Photos taken during your trip are automatically organized and categorized.

[1344] server:

[1345] Store purchase history and prepare it for later analysis.

[1346] The captured photo data is stored in the cloud, and slideshows and albums are generated using the automatic editing function.

[1347] 5. Recommendations for your next travel plan

[1348] server:

[1349] When the trip ends, the server analyzes Mr. A's travel data (visit history, purchase history, photo data).

[1350] For Mr. A's next trip, the app will recommend the best tourist spots, routes, and length of stay, and notify him / her via the app.

[1351] This system allows travelers to enjoy sightseeing efficiently and also makes it easier to plan their next trip.

[1352] The processing flow will be explained below.

[1353] Step 1:

[1354] User:

[1355] Download the app and complete the installation. Launch the app and create a new account by entering your account information (name, email address, travel preferences, etc.).

[1356] Step 2:

[1357] Device:

[1358] The account information entered by the user is sent to the server, and access to the GPS is requested, and if the user allows it, the current location information is obtained.

[1359] Step 3:

[1360] server:

[1361] The received account information is stored in a database. If there is past travel history, it is retrieved and prepared for analysis.

[1362] Step 4:

[1363] User:

[1364] After arriving at your travel destination, open the app and press the "Check-in" button. Check the information on tourist spots and restaurants provided within the app.

[1365] Step 5:

[1366] Device:

[1367] The system uses GPS to check the user's current location and sends that information to the server, which then displays the received information about tourist spots and restaurants to the user.

[1368] Step 6:

[1369] server:

[1370] Based on the current location information, information on nearby tourist attractions, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[1371] Step 7:

[1372] User:

[1373] Based on the tourist information displayed, select the places you want to visit and actually visit them.

[1374] Step 8:

[1375] Device:

[1376] The data of tourist spots visited by users is updated in real time and the duration of stay is recorded.

[1377] Step 9:

[1378] server:

[1379] The system regularly updates information on the congestion status and waiting times of tourist spots, and notifies users as necessary.

[1380] Step 10:

[1381] User:

[1382] Visit a restaurant and pay using your smartphone. Also, take photos while traveling.

[1383] Step 11:

[1384] Device:

[1385] Automatically records smartphone payment information and organizes photo data by category.

[1386] Step 12:

[1387] server:

[1388] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions.

[1389] Step 13:

[1390] server:

[1391] After the trip is over, the user's travel data (visit history, purchase history, photo data) is analyzed using a machine learning algorithm to recommend their next travel plan.

[1392] Step 14:

[1393] User:

[1394] Check your upcoming travel plans in the app and plan your next trip accordingly.

[1395] Example 1

[1396] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1397] With so many tourist spots and restaurants to visit, modern travelers are faced with the challenge of efficiently planning their trips. Obtaining the latest information in real time while traveling and optimizing their selection of tourist spots and restaurants is no easy task. Furthermore, organizing photos taken during a trip and proposing next travel plans that take into account past travel and purchase history can be time-consuming. To solve these challenges, a system is needed that automatically and efficiently provides information and improves the traveler experience.

[1398] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1399] In this invention, the server includes means for acquiring user location information, means for providing information on nearby tourist spots, waiting times, and the shortest route based on the acquired location information, means for saving history information on visits to tourist spots and purchase history information, means for recommending next travel plans based on the saved history information and purchase history information, means for automatically organizing image data taken during the trip, means for automatically recording transaction information on the smart device during the trip, means for transmitting information from the terminal to the server and means for saving image data in the cloud, and means for automatically creating albums and presentations based on the saved image data. This allows travelers to enjoy sightseeing efficiently and makes it possible to smoothly plan their next trip.

[1400] "Location Information" means geographic data obtained via GPS or other means that indicates a user's current location.

[1401] "Tourist attraction information" refers to detailed information about tourist attractions, including location, features, opening hours, admission fees, etc.

[1402] "Waiting time" refers to the time it takes for a user to receive service at a tourist spot, restaurant, or other facility.

[1403] The "shortest route" is information indicating the most time-efficient route when a user travels from their current location to their destination.

[1404] "History information" refers to records of tourist spots that a user has visited in the past and services that the user has used.

[1405] "Purchase history information" refers to records of purchases and transactions made by a user during their trip.

[1406] "Travel plan recommendations" refers to suggesting suitable tourist spots and routes for the user's next trip based on the user's past behavioral data.

[1407] "Photographed image data" refers to images that a user takes while traveling and saves as digital data.

[1408] "Means for automatic organization" refers to a function in which the system automatically classifies and organizes data without requiring manual operation by the user.

[1409] "Transaction information recording" refers to a function that automatically records data related to economic activities performed by a user while traveling, such as purchases and payments.

[1410] "Means for transmitting information to the server" refers to communication means for transmitting data from the terminal to the server.

[1411] "Cloud storage" refers to technology for storing digital data on remote servers via the internet.

[1412] "Means for creating albums and presentations" refers to a function for automatically generating albums and slideshow-style presentations based on stored image data.

[1413] The present invention relates to a system that allows travelers to efficiently visit tourist spots and plan their next trip based on their past travel history. The system is implemented using a user's smartphone, a server, cloud storage, and a generative AI model. A specific embodiment of the system is described below.

[1414] Entering initial settings and user information

[1415] User:

[1416] Users first download and install the app on their smartphone. Next, they launch the app and create a new account by entering basic account information such as their name and email address. They can also enter more detailed information such as their travel preferences and past travel history. By allowing access to location information, location information can be obtained.

[1417] Device:

[1418] The app temporarily stores the user's input information and proceeds with the account creation process. It checks the location access permission status and obtains location information with the user's consent.

[1419] server:

[1420] The server receives the account information and the access permission status of the location information sent from the terminal and stores them in a database.

[1421] Selecting your destination and checking in

[1422] User:

[1423] After arriving at their travel destination, the user launches the app and presses the "Check-in" button.

[1424] Device:

[1425] The app uses the built-in GPS to determine the user's current location and sends that location information to a server.

[1426] server:

[1427] Based on the received location information, the server provides information on nearby tourist attractions and restaurants, as well as waiting times and the shortest routes. This information is sent to the device and displayed to the user.

[1428] Real-time support during sightseeing

[1429] Device:

[1430] The app provides real-time information on waiting times at tourist attractions, the shortest routes, and restaurant availability. When users visit tourist attractions, their progress is automatically recorded.

[1431] server:

[1432] Based on the received information, the server updates the congestion status of tourist spots in real time and sends notifications to users as necessary.

[1433] Purchase history and photo organization

[1434] Device:

[1435] When a user makes a payment using their smartphone, the information is automatically recorded. Also, photos taken during the trip are automatically organized and categorized. This organized information is sent to the server.

[1436] server:

[1437] The server stores purchase history and prepares it for later analysis. The photos are stored in the cloud and automatically edited to create slideshows and albums.

[1438] Recommendations for your next travel plan

[1439] server:

[1440] Once the trip is over, the server analyzes the travel data (visit history, purchase history, photo data) and uses a generative AI model to recommend the best sightseeing spots, routes, and duration for the next trip, and notifies the user through the app.

[1441] Specific examples

[1442] For example, if a user travels to Kyoto, the system operates as follows.

[1443] 1. Initial setup and user information entry:

[1444] Users install the app on their smartphone, create an account, enter basic information, and allow access to their GPS.

[1445] 2. Check-in in Kyoto:

[1446] When a user arrives in Kyoto, they launch the app and press the "Check In" button. The app then checks their current location and provides information on nearby tourist attractions (e.g., temples, gardens, historical buildings) and dining options.

[1447] Specific prompt examples:

[1448] "Install the app, enter your name and email address, and register your travel preferences."

[1449] "When you arrive in Kyoto, open the app and click check-in."

[1450] "Provides real-time information on nearby tourist attractions and restaurants."

[1451] "It records your smartphone payment history and automatically organizes the photos you take."

[1452] "Recommend your next travel plan."

[1453] This invention allows travelers to enjoy sightseeing efficiently and also makes it possible to smoothly plan their next trip.

[1454] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1455] Step 1:

[1456] Entering initial settings and user information

[1457] Specific behavior:

[1458] User: The user first downloads and installs the app on their smartphone. They launch the app and enter basic account information such as their name and email address, as well as other details such as their travel preferences and past travel history. They are then asked to allow location access.

[1459] Input: User's name, email address, travel preferences, past travel history, location access permission (input)

[1460] Output: Account information, location access permission (output)

[1461] Device:

[1462] The app will temporarily store the information you entered and proceed with the account creation process. Confirm location access permissions.

[1463] Input: Account information entered by the user, location access permission status (input)

[1464] Output: Provisional account information, location access permission status (output)

[1465] server:

[1466] The account information and location information access permission status sent from the device are saved in a database.

[1467] Input: Account information and location access permission status sent from the device (input)

[1468] Output: Stored account information and permission data (output)

[1469] Step 2:

[1470] Selecting your destination and checking in

[1471] Specific behavior:

[1472] User: After arriving at their travel destination, they launch the app and press the "Check-in" button.

[1473] Input: User's current location, travel destination selection information (input)

[1474] Output: Check-in information (output)

[1475] Device:

[1476] It uses the built-in GPS function to determine the user's current location and sends that information to the server.

[1477] Input: GPS data (input)

[1478] Output: User's current location information (output)

[1479] server:

[1480] Based on the received location information, data is generated that provides information on nearby tourist attractions and restaurants, waiting times, and the shortest routes, and is sent to the terminal.

[1481] Input: Current location information sent from the device (input)

[1482] Output: Information on nearby tourist spots, waiting time, shortest route (output)

[1483] Step 3:

[1484] Real-time support during sightseeing

[1485] Specific behavior:

[1486] Device: The app provides real-time information on waiting times at tourist attractions, the shortest routes, and seat availability at restaurants. When users visit tourist attractions, their progress is automatically recorded.

[1487] Input: Real-time GPS data, tourist spot selection information (input)

[1488] Output: Waiting time information, shortest route, seat availability information, visit history (output)

[1489] server:

[1490] Based on the received real-time information, the system updates the congestion status of tourist spots and sends notifications to users.

[1491] Input: Real-time GPS data received from the device, visit history (input)

[1492] Output: Updated tourist destination information, congestion status, notifications (output)

[1493] Step 4:

[1494] Purchase history and photo organization

[1495] Specific behavior:

[1496] Terminal: When a user makes a payment using their smartphone, that information is automatically recorded. Photos taken during the trip are automatically organized, categorized, and sent to the server.

[1497] Input: Smartphone payment data, taken photo (input)

[1498] Output: Purchase history data, organized photo data (output)

[1499] server:

[1500] It receives purchase history and stores it in a database. It also stores photographic data in the cloud and uses an automatic editing function to generate slideshows and albums.

[1501] Input: Purchase history data received from the device, organized photo data (input)

[1502] Output: Saved purchase history data, photo data stored in the cloud, generated slideshows and albums (output)

[1503] Step 5:

[1504] Recommendations for your next travel plan

[1505] Specific behavior:

[1506] Server: After the trip is over, the server statistically analyzes the travel data (visit history, purchase history, photo data) and uses a generative AI model to recommend the best tourist spots, routes, and duration for the next trip.

[1507] Input: Travel data (visit history, purchase history, photo data) (input)

[1508] Output: Next travel plan, recommendations (output)

[1509] server:

[1510] Recommended tourist spots and routes are notified to the user's smartphone based on their account information.

[1511] Input: Recommendation information, user account information (input)

[1512] Output: Notification(Output)

[1513] Device:

[1514] Users will receive notifications and can check their upcoming travel plans.

[1515] Input: Notification(Input)

[1516] Output: Confirmed itinerary (output)

[1517] (Application example 1)

[1518] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1519] In recent years, there has been an increasing need for travelers to obtain information on sightseeing and dining at their travel destinations efficiently. There is a need for a system that can efficiently obtain information on tourist spots and surrounding restaurants, and support the planning of next trips based on visit and purchase history. Furthermore, to enrich the dining experience during travel, a system is needed that can obtain real-time information on the congestion status of surrounding restaurants, reservation information, and popular menu items.

[1520] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1521] In this invention, the server includes means for acquiring user location information, means for providing information on nearby tourist spots, waiting times, and shortest routes based on the acquired location information, means for saving history information on visits to tourist spots and purchase history information, means for recommending next travel plans based on the saved history information and purchase history information, means for providing information on nearby restaurants, popular menus, and congestion status based on the acquired location information, and means for providing reservation status of nearby restaurants. This allows travelers to enjoy sightseeing efficiently and have an optimal dining experience at their travel destination.

[1522] "User" refers to a traveler who uses the system and is the entity that provides individual location information, preference information, etc.

[1523] "Location Information" means data that allows a system to determine a user's current geographic location, obtained using GPS or other positioning technology.

[1524] "Tourist destination information" is information about tourist attractions, famous sites, natural landscapes, etc. that the user may visit.

[1525] "Waiting time" is information about the amount of time you need to wait to use a service at a tourist spot or restaurant.

[1526] The "shortest route" is information about the most efficient route from the current location to the destination.

[1527] "History information" is a record of tourist spots that a user has visited in the past and services that the user has used.

[1528] "Purchase history information" is a record of purchases made by a user in the past, and includes information about the products and services purchased.

[1529] "Recommendation" refers to making optimal suggestions for the user's next trip or activity based on their past behavior and preferences.

[1530] "Restaurant information" is information about nearby restaurants, including their locations, menus, opening hours, etc.

[1531] "Popular menu items" refers to information about dishes and drinks that are particularly highly rated or frequently ordered at restaurants.

[1532] "Crowding status" is information about the current level of crowding at places such as tourist spots and restaurants.

[1533] "Reservation status" refers to information used to guarantee the availability of seats or services in advance at restaurants and other services.

[1534] The present invention relates to a system that allows travelers to visit tourist spots efficiently and enrich their dining experience. This system provides real-time information on nearby tourist spots and restaurants based on the user's location information, and makes recommendations for subsequent travel plans.

[1535] System Overview

[1536] 1. Initial settings and user information entry

[1537] Terminal

[1538] First, users install the system's dedicated app on their smartphones, enter basic information (such as name and email address) to create an account, and then set it to allow GPS access.

[1539] server

[1540] Receives user account information sent from the device and stores it in a database. Obtains past travel history and prepares for analysis.

[1541] 2. Acquisition of location information and provision of tourist spot and restaurant information

[1542] User

[1543] After arriving at your destination, launch the app and press the "Check-in" button.

[1544] Terminal

[1545] It uses the built-in GPS to determine the user's current location and sends that information to the server.

[1546] server

[1547] Based on the received current location information, information on nearby tourist attractions and restaurants, waiting times, the shortest route, as well as popular menu items, congestion status, and reservation status at restaurants are obtained and sent to the device.

[1548] 3. Support during sightseeing

[1549] Terminal

[1550] The app provides real-time information on waiting times at tourist spots, the shortest routes, and seat availability and reservation status at restaurants. When users visit tourist spots or restaurants, their history is automatically recorded.

[1551] server

[1552] Based on the received location information and visit history, the system updates the congestion status of tourist spots and restaurants and sends notifications to the user as necessary.

[1553] 4. Purchasing history and photo organization

[1554] Terminal

[1555] When a user makes a payment using their smartphone, that information is automatically recorded, and photos taken during the trip are automatically organized and categorized.

[1556] server

[1557] It stores purchase history and prepares it for later analysis. The photos are stored in the cloud and automatically edited to create slideshows and albums.

[1558] 5. Recommendations for your next travel plan

[1559] server

[1560] Once the trip is over, the server analyzes the user's travel data (visit history, purchase history, photo data), and recommends the best sightseeing spots, routes, and duration for the next trip, and notifies the user through the app.

[1561] Specific examples

[1562] Consider the case where a user travels to a specific city. For example, the user visits a tourist spot, obtains information about nearby restaurants, and enjoys delicious food. The flow is as follows:

[1563] Specific examples

[1564] When a traveler arrives at a famous tourist spot, they launch the app and press the "Check-in" button. GPS identifies their current location and sends that information to the server. The server then uses that location information to provide real-time information about nearby tourist spots and restaurants. The traveler visits the tourist spot, finds nearby restaurants, and enjoys a meal. During this process, their visit history and purchase history are automatically recorded, and recommendations are made for the next trip.

[1565] Prompt Sentence Examples

[1566] "I want to develop an app that provides information about recommended restaurants near the user's current location when they visit a famous tourist spot. I want a function that uses the user's location information to display nearby restaurants, popular menu items, and crowding status in real time."

[1567] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1568] Step 1: Installing the app and initial setup

[1569] The device requires the user to install a system-specific app on their smartphone and enter basic information (such as name and email address), then allows GPS access. The entered information is sent from the device to the server.

[1570] Input: User's basic information (name, email address, etc.)

[1571] Output: User account information is saved on the server

[1572] Step 2: Obtaining and sending location information

[1573] When the user arrives at their travel destination and presses the "Check-in" button, the device uses its built-in GPS to determine their current location and sends that information to the server.

[1574] Input: User's "check-in" operation

[1575] Output: Current location latitude and longitude information is sent to the server

[1576] Step 3: Acquiring and providing information on tourist spots and restaurants

[1577] The server receives the latitude and longitude information of the current location and then obtains information about nearby tourist attractions and restaurants, including waiting times, the shortest route, popular menu items, congestion status, and reservation status. This information is then sent to the device.

[1578] Input: Current location latitude and longitude information

[1579] Output: Information on nearby tourist spots, restaurant information, waiting time, shortest route, popular menu items, congestion status, reservation status

[1580] Step 4: Providing real-time support

[1581] The device displays information about tourist spots and restaurants sent from the server to the user in real time, providing the shortest route to each location, waiting times, congestion status, etc. When the user visits a tourist spot or eats at a restaurant, the history is automatically recorded and sent to the server.

[1582] Input: Tourist information and restaurant information from the server

[1583] Output: User visit history and purchase history are recorded on the server

[1584] Step 5: Record and organize your purchase history and photos

[1585] When a user makes a smartphone payment at a restaurant, the device automatically records the purchase history information and sends it to the server. In addition, photos taken during the trip are automatically organized, categorized, and stored in the cloud.

[1586] Input: User's smartphone payment information, photographed photo

[1587] Output: Purchase history and photo data stored in the cloud

[1588] Step 6: Recommend your next travel plan

[1589] After the trip, the server analyzes the user's saved travel data (visit history, purchase history, photo data) and recommends the best sightseeing spots, routes, and duration for the next trip. This recommendation information is notified to the user via their device.

[1590] Input: User's travel data (visit history, purchase history, photo data)

[1591] Output: Recommendations for your next trip

[1592] As a specific example of how it works, when a user arrives at a tourist spot, launches the app, and presses the check-in button, the device acquires GPS information and sends it to the server. The server then uses this location information to acquire information about nearby tourist spots and restaurants, and sends it to the device. The user receives this information in real time, allowing them to efficiently choose their next tourist spot or place to eat. After the trip is over, the server also sends recommended information, making it easy to plan their next trip.

[1593] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1594] This invention relates to a system that acquires a user's location information and emotions, and based on that information, provides tourist information and recommends the user's next travel plan. The system combines an emotion engine to provide optimal information so that the user can have a more satisfying travel experience. The system's program processing is explained below in natural language.

[1595] System Overview

[1596] 1. Initial settings and user information entry

[1597] Device:

[1598] Users download the system's dedicated app and install it on their smartphones.

[1599] Launch the app and create a new account by entering basic account information such as your name and email address.

[1600] Configure settings to allow recognition of travel preferences, past travel history, and even emotions.

[1601] server:

[1602] Receives account information sent from the device and stores it in a database.

[1603] If necessary, obtain past travel history and prepare for analysis.

[1604] User:

[1605] By allowing access to location information and emotion recognition, you can obtain location information and emotion information.

[1606] 2. Selecting your destination and checking in

[1607] User:

[1608] After arriving at your destination, launch the app and press the "Check-in" button.

[1609] Check the information on tourist spots and restaurants provided within the app.

[1610] Device:

[1611] It uses GPS to check the user's current location and uses an emotion engine to analyze the user's emotions in real time.

[1612] The location information and the emotion information are transmitted to a server.

[1613] server:

[1614] Based on the received current location information and emotion information, information on nearby tourist spots, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[1615] Specific examples

[1616] Let's take the example of User B going on a trip to Tokyo.

[1617] 1. Initial settings and user information entry

[1618] Person B installs the app on his smartphone and creates an account, entering basic information and granting access to the GPS and emotion recognition functions.

[1619] 2. Check-in in Tokyo

[1620] When Mr. B arrives in Tokyo, he launches the app and presses the "Check-in" button.

[1621] The app checks B's current location and displays information about nearby tourist spots (such as Tokyo Tower, Sensoji Temple, and Shibuya Crossing) and restaurants. Meanwhile, using the built-in camera and microphone, the emotion engine analyzes B's facial expressions and tone of voice to recognize his or her emotions.

[1622] 3. Real-time support during sightseeing

[1623] Device:

[1624] The app provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability. In addition, the emotion engine periodically analyzes B's emotions and suggests tourist spots based on his / her current emotional state (for example, if he / she is feeling stressed, it will suggest a relaxing park).

[1625] server:

[1626] Based on the received information, the system periodically updates information on the congestion situation and waiting times at tourist spots, and sends notifications to Person B as necessary.

[1627] Emotional information is analyzed and used to gauge satisfaction at tourist spots and recommend the next destination.

[1628] 4. Purchasing history and photo organization

[1629] Device:

[1630] When Mr. B makes a payment using his smartphone, the information is automatically recorded.

[1631] Photos taken during a trip are automatically organized and categorized, and an emotion engine extracts photos taken during specific emotional moments to create special albums.

[1632] server:

[1633] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions (such as creating slideshows and applying filters).

[1634] 5. Recommendations for your next travel plan

[1635] server:

[1636] After the trip, Mr. B's travel data (visit history, purchase history, photo data, and emotional data) is analyzed using a machine learning algorithm to recommend his next travel plan. For example, the system will suggest the best next travel destinations and places to visit based on the tourist spots he has enjoyed in the past and the activities he has been interested in.

[1637] User:

[1638] Check your upcoming travel plans in the app and plan your next trip accordingly.

[1639] This system allows users to enjoy sightseeing efficiently and has a more personalized travel experience based on their emotions.

[1640] The processing flow will be explained below.

[1641] Step 1:

[1642] User:

[1643] Download the app and complete the installation. Launch the app and create a new account by entering your account information (name, email address, travel preferences, etc.).

[1644] Step 2:

[1645] Device:

[1646] The account information entered by the user is sent to the server, and permission to access GPS and the emotion recognition function is requested. If the user allows it, location information and emotion information are obtained.

[1647] Step 3:

[1648] server:

[1649] The received account information is stored in a database. If there is past travel history, it is retrieved and prepared for analysis.

[1650] Step 4:

[1651] User:

[1652] After arriving at your travel destination, open the app and press the "Check-in" button. Check the information on tourist spots and restaurants provided within the app.

[1653] Step 5:

[1654] Device:

[1655] It uses GPS to determine the user's current location and sends that information to the server, and uses an emotion engine to analyze the user's facial expressions and voice to assess their current emotions.

[1656] Step 6:

[1657] server:

[1658] Based on the current location information and emotion information, information on nearby tourist spots, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[1659] Step 7:

[1660] Device:

[1661] The received tourist spot and restaurant information is displayed on the app screen to notify the user. The emotion engine operates in real time to continuously monitor changes in the user's emotions.

[1662] Step 8:

[1663] User:

[1664] Based on the tourist information displayed, users can select a location to visit and actually visit it. If the emotions they felt while visiting a tourist spot changed, that information is recorded.

[1665] Step 9:

[1666] Device:

[1667] The data of tourist spots visited by the user is updated in real time and the time spent there is recorded. The emotion engine analyzes the user's emotions and provides information according to the situation (for example, suggesting a quiet place if you need to relax).

[1668] Step 10:

[1669] server:

[1670] The system regularly updates information on the congestion status and waiting times at tourist spots and notifies users as needed. It also analyzes travel experiences based on emotional data and uses this information to make future recommendations.

[1671] Step 11:

[1672] User:

[1673] Visit a restaurant and pay using your smartphone. Also, take photos while traveling.

[1674] Step 12:

[1675] Device:

[1676] It automatically records smartphone payment information, organizes photo data into categories, and extracts photos taken in specific emotional states to create special albums.

[1677] Step 13:

[1678] server:

[1679] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions.

[1680] Step 14:

[1681] server:

[1682] After the trip, the system analyzes the user's travel data (visit history, purchase history, photo data, and emotional data) using machine learning algorithms to recommend the next travel plan. It suggests the best next travel destinations and places to visit based on the tourist spots they have enjoyed in the past and the activities they are interested in.

[1683] Step 15:

[1684] User:

[1685] Check your upcoming travel plans in the app and plan your next trip accordingly.

[1686] Example 2

[1687] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1688] While conventional travel support systems provide information based on the user's location, they lack the ability to provide personalized information that takes into account the user's emotional state. Furthermore, organizing travel purchase history and photo data is time-consuming, making data management inefficient for use in planning the next trip. Furthermore, there is a need for a system that can quickly provide information on the congestion situation at visited tourist spots and real-time waiting times.

[1689] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1690] In this invention, the server includes means for acquiring location information and emotional state of the user, means for providing information on nearby tourist spots, waiting times and the shortest route based on the acquired location information and emotional information, and means for saving history information on visiting tourist spots, purchase history information and emotional state. This not only enables the user to receive personalized tourist spot information that takes into account their emotional state, but also enables automatic organization of purchase history and photo data, making it easier to use for planning their next trip.

[1691] "Location information" is data that indicates the specific geographic coordinates where a user is currently physically located.

[1692] "Emotional information" is data that indicates the user's emotional state and is obtained through facial expression recognition, voice analysis, and the like.

[1693] "Tourist destination information" refers to information related to tourist destinations, including, for example, highlights, opening hours, admission fees, and crowding levels.

[1694] "Wait time" is data that indicates the amount of time a user must wait to receive a service or experience at a particular location or event.

[1695] The "shortest route" is information indicating the route with the shortest travel distance from the starting point to the destination.

[1696] "History information" is recorded data of places visited by a user in the past and services used by the user.

[1697] "Purchase history information" is recorded data of products and services purchased by a user.

[1698] "Recommendation" means suggesting the next action to be taken based on the user's past actions and current situation.

[1699] The present invention is a system that acquires location information and emotion information of a user and, based on this, provides tourist spot information and recommends next travel plans. An embodiment of the system will be described in detail below.

[1700] Entering initial settings and user information

[1701] Device:

[1702] Users download and install the system's dedicated app on their smartphones, then launch the app and create a new account by entering basic information such as their name and email address, as well as travel preferences, past travel history, and permission to recognize emotions.

[1703] server:

[1704] Receives account information sent from the device and stores it in a database. If necessary, retrieves past travel history and prepares it for analysis.

[1705] User:

[1706] Allowing access to location information and emotion recognition allows us to obtain location information and emotion information.

[1707] Selecting your destination and checking in

[1708] User:

[1709] After arriving at your travel destination, open the app and press the "Check-in" button. Check the information on tourist spots and restaurants provided within the app.

[1710] Device:

[1711] The system uses GPS to check the user's current location, and the emotion engine analyzes emotions in real time using the built-in camera and microphone. Location and emotion information is sent to the server.

[1712] server:

[1713] Based on the received current location information and emotion information, information on nearby tourist spots, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[1714] Real-time support during sightseeing

[1715] Device:

[1716] The app provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability. Furthermore, an emotion engine periodically analyzes the user's emotions and suggests tourist spots based on their current emotional state (for example, if they're feeling stressed, it will suggest a park where they can relax).

[1717] server:

[1718] Based on the received information, the system periodically updates information on the congestion status and waiting times of tourist spots, and notifies users as necessary. Emotional information is analyzed and used to determine satisfaction with tourist spots and recommend the next destination.

[1719] Purchase history and photo organization

[1720] Device:

[1721] When a user makes a payment using their smartphone, that information is automatically recorded. Photos taken during the trip are automatically organized and categorized. Furthermore, an emotion engine extracts photos taken during specific emotional moments and creates special albums.

[1722] server:

[1723] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions (such as creating slideshows and applying filters).

[1724] Recommendations for your next travel plan

[1725] server:

[1726] After the trip, the system analyzes the user's travel data (visit history, purchase history, photo data, and emotional data) using machine learning algorithms. Based on the tourist spots they enjoyed in the past and the activities they were interested in, the system suggests the best travel destinations and places to visit next time.

[1727] User:

[1728] Check your upcoming travel plans in the app and plan your next trip accordingly.

[1729] Specific examples

[1730] Let's take the example of User B going on a trip to Tokyo.

[1731] Entering initial settings and user information

[1732] Person B installs the app on his smartphone and creates an account, entering basic information and granting access to the GPS and emotion recognition functions.

[1733] Check-in in Tokyo

[1734] When Person B arrives in Tokyo, he launches the app and presses the "Check-in" button. The app checks Person B's current location and displays information about nearby tourist spots (e.g., Tokyo Tower, Sensoji Temple, Shibuya Crossing) and restaurants. Meanwhile, using the built-in camera and microphone, the emotion engine analyzes Person B's facial expressions and tone of voice to recognize their emotions.

[1735] Real-time support during sightseeing

[1736] The app provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability. Furthermore, the emotion engine periodically analyzes B's emotions and suggests tourist spots based on his / her current emotional state (for example, if he / she is feeling stressed, it will suggest a relaxing park).

[1737] Purchase history and photo organization

[1738] When B makes a payment using his smartphone, the information is automatically recorded. Photos taken during the trip are automatically organized and categorized. Photos taken during specific moments of emotion are also extracted and a special album is created.

[1739] Recommendations for your next travel plan

[1740] After B's trip, his travel data (visit history, purchase history, photo data, and emotional data) are analyzed using a machine learning algorithm to recommend his next travel plan. For example, it suggests the best next travel destinations and places to visit based on the tourist spots he enjoyed in the past and the activities he was interested in.

[1741] Prompt Sentence Examples

[1742] "When the user is at Tokyo Tower, the system will send the user's current location information and emotion information to the server and suggest recommended tourist spots and restaurants."

[1743] The above is a specific embodiment of the system.

[1744] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1745] Program processing flow

[1746] Entering initial settings and user information

[1747] Step 1:

[1748] Device: Users download the system-specific app and install it on their smartphones.

[1749] Enter: Install app.

[1750] Output: App launch.

[1751] Step 2:

[1752] Device: Launch the app and enter basic information such as your name and email address to create a new account.

[1753] Input: Name, email address, password, etc.

[1754] Output: Save account information.

[1755] Step 3:

[1756] Device: Set travel preferences, past travel history, and emotion recognition permissions.

[1757] Input: Travel preferences, past travel history, emotion recognition permission

[1758] Output: A completed account profile.

[1759] Step 4:

[1760] Terminal: Sends the entered account information to the server.

[1761] Input: Account Information

[1762] Output: Send to server.

[1763] Step 5:

[1764] Server: Stores the received account information in a database, retrieves past travel history as needed, and prepares it for analysis.

[1765] Input: Account Information

[1766] Output: Save to database.

[1767] Step 6:

[1768] User: Allow location and emotion recognition access so that location and emotion information can be obtained.

[1769] Input: Location and emotion recognition permissions

[1770] Output: Permission settings.

[1771] Selecting your destination and checking in

[1772] Step 1:

[1773] User: After arriving at their travel destination, they launch the app and press the "Check-in" button.

[1774] Input: Arrive at destination and press "Check-in" button

[1775] Output: Check-in confirmation.

[1776] Step 2:

[1777] Device: Uses GPS to determine the user's location, and the emotion engine analyzes emotions in real time using the built-in camera and microphone.

[1778] Input: User's current location, built-in camera and microphone

[1779] Output: Location information and emotion information.

[1780] Step 3:

[1781] Device: Sends location information and emotion information to the server.

[1782] Input: Location and emotion

[1783] Output: Send to server.

[1784] Step 4:

[1785] Server: Based on the received current location information and emotion information, obtains information on nearby tourist spots, waiting times, shortest routes, and restaurant information, and sends this information to the device.

[1786] Input: Current location information, emotion information

[1787] Output: Information on nearby tourist attractions, waiting times, shortest routes, and restaurant information.

[1788] Step 5:

[1789] Terminal: Receives information from the server and displays it to the user.

[1790] Input: Information on nearby tourist attractions, waiting times, shortest routes, restaurant information

[1791] Output: What is displayed to the user.

[1792] Real-time support during sightseeing

[1793] Step 1:

[1794] Device: The app provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability.

[1795] Input: Waiting time at tourist spots, shortest route, seat availability information

[1796] Output: Display of real-time information.

[1797] Step 2:

[1798] On the device: The emotion engine periodically analyzes the user's emotions and suggests tourist spots based on their current emotional state.

[1799] Input: Emotion data

[1800] Output: Personalized tourist destination suggestions.

[1801] Step 3:

[1802] Terminal: Periodically sends behavioral data during sightseeing (places visited, length of stay, etc.) to the server.

[1803] Input: Behavioral data

[1804] Output: Send to server.

[1805] Step 4:

[1806] Server: Based on the received information, the server periodically updates information on the congestion status and waiting times of tourist spots, and sends notifications to users as necessary.

[1807] Input: Behavioral data

[1808] Output: Crowding status, wait time updates, notifications.

[1809] Purchase history and photo organization

[1810] Step 1:

[1811] Terminal: When a user makes a payment using their smartphone, the information is automatically recorded.

[1812] Enter purchasing info record

[1813] Output: A record of purchase history.

[1814] Step 2:

[1815] On your device: Automatically organize and categorize photos taken during your trip.

[1816] Input: Photo data

[1817] Output: Classified photo data.

[1818] Step 3:

[1819] On device: The emotion engine extracts photos taken at specific emotional moments and generates a special album.

[1820] Input: Photo data, emotion data

[1821] Output: An album based on emotions.

[1822] Step 4:

[1823] Server: Stores captured photo data in the cloud and performs automatic editing functions (such as creating slideshows and applying filters).

[1824] Input: Photo data

[1825] Output: Cloud saved, edited photo data.

[1826] Recommendations for your next travel plan

[1827] Step 1:

[1828] Server: After the trip ends, the user's travel data (visit history, purchase history, photo data, and emotional data) is analyzed using machine learning algorithms.

[1829] Input: Trip data

[1830] Output: Analysis results.

[1831] Step 2:

[1832] Server: Based on the analysis results, suggests the best travel destinations or places to visit next based on tourist spots you have enjoyed in the past and activities you are interested in.

[1833] Input: Analysis results

[1834] Output: Next trip recommendation.

[1835] Step 3:

[1836] User: See upcoming travel plans within the app and plan their next trip accordingly.

[1837] Input: Next Trip Recommendation

[1838] Output: Next trip plan.

[1839] (Application example 2)

[1840] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1841] Conventional tourist information systems are limited to providing information about tourist spots and restaurants based on the user's current location, and do not adequately consider the user's emotional state. Furthermore, there are no comprehensive systems that can suggest tourist spots using real-time emotion recognition or improve the travel experience. As a result, users may experience lower travel satisfaction due to suggestions that do not match their emotional state. To address this issue, a system that utilizes the user's emotional information to provide more personalized tourist information and recommend next travel plans is needed.

[1842] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1843] In this invention, the server includes means for acquiring user location information, means for providing information on nearby tourist spots, waiting times, and the shortest route based on the acquired location information and emotion information, means for recognizing the user's emotion and suggesting tourist spots and transportation options based on that emotion, and means for saving history information on tourist spots visited and purchase history information. This makes it possible to provide tourist information that reflects the user's emotional state in real time, and by making suggestions that meet individual needs, it becomes possible to improve travel satisfaction.

[1844] definition statement

[1845] "User" refers to the user of the service and the entity that receives information and suggestions from the system.

[1846] "Location Information" means data that describes a user's current geographic location, such as data obtained through GPS or other location measurement technologies.

[1847] "Emotional information" is data that indicates the emotional state of a user extracted from facial expressions, tone of voice, behavioral patterns, etc.

[1848] "Tourist destination information" means information related to a particular tourist destination, such as overview, history, attractions, and activities.

[1849] "Waiting time" is information indicating the waiting time to enter a particular tourist attraction or facility.

[1850] The "shortest route" is information indicating the route that will allow the user to reach the destination specified by the user in the shortest time.

[1851] "Emotion recognition" is the process of identifying and digitizing a user's current emotional state.

[1852] "History information" is data that shows the overall information such as the places a user has visited in the past, the services they have used, and their behavioral records.

[1853] "Purchase history information" is a record of products and services purchased by a user in the past.

[1854] The "next travel plan" is the next travel destination and schedule suggested based on the user's past history information and emotional information.

[1855] "Restaurant information" refers to information about restaurants in a specified area, such as their names, menus, reviews, and opening hours.

[1856] "Availability" is information indicating the availability of seats at a particular restaurant.

[1857] "Photo data" is a collection of image files taken by a user, and is data stored in the form of visual information.

[1858] "Automatic organization and editing" refers to the process of using an algorithm to categorize photo data and process it as needed.

[1859] "Recommending travel plans" means suggesting travel destinations and plans of action that will satisfy the user.

[1860] MODE FOR CARRYING OUT THE INVENTION

[1861] The present invention relates to a system that provides tourist information and recommends next travel plans based on a user's emotional information and location information. The following description describes an embodiment of the invention based on the claims.

[1862] System Overview

[1863] 1. Initial settings and user information entry

[1864] Device:

[1865] Users download and install the system's dedicated application onto their device, then create a new account by entering basic account information such as their name and email address, as well as their travel preferences, past travel history, and permission to use emotion recognition.

[1866] server:

[1867] Receives account information sent from the device and stores it in a database. If necessary, retrieves past travel history and prepares it for analysis.

[1868] User:

[1869] Allowing access to location and emotion recognition allows the application to obtain location and emotion information.

[1870] 2. Selecting your destination and checking in

[1871] User:

[1872] After arriving at your travel destination, start the app and press the "Check-in" button. Check the information on tourist spots and restaurants provided within the app.

[1873] Device:

[1874] The system uses GPS to check the user's current location and uses an emotion engine to analyze the user's emotions in real time. The location information and emotion information are sent to the server.

[1875] server:

[1876] Based on the received current location information and emotion information, information on nearby tourist spots, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[1877] 3. Real-time support during sightseeing

[1878] Device:

[1879] The application provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability. In addition, an emotion engine periodically analyzes the user's emotions and suggests tourist spots based on their current emotional state.

[1880] server:

[1881] Based on the received information, the system periodically updates information on the congestion status and waiting times of tourist spots, and notifies users as necessary. Emotional information is analyzed and used to determine satisfaction with tourist spots and recommend the next destination.

[1882] 4. Purchasing history and photo organization

[1883] Device:

[1884] When users make smart payments, the information is automatically recorded. Photos taken during travel are automatically organized and categorized. An emotion engine also extracts photos taken during specific emotional moments and creates special albums.

[1885] server:

[1886] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions (such as creating slideshows and applying filters).

[1887] 5. Recommendations for your next travel plan

[1888] server:

[1889] After the trip, the system analyzes the user's travel data (visit history, purchase history, photo data, and emotional data) using machine learning algorithms to recommend the next travel plan. It suggests the best next travel destinations and places to visit based on the tourist spots they have enjoyed in the past and the activities they have been interested in.

[1890] User:

[1891] See upcoming travel plans within the app and plan your next trip accordingly.

[1892] Specific examples of processing

[1893] 1. Use the camera to take a picture of the user's face and analyze their emotions using an emotion recognition API (e.g., Emotion API).

[1894] 2. Use the GPS sensor to get the user's current location.

[1895] 3. Based on the acquired emotion data and location information, the tourist attraction information API is called to obtain information about nearby tourist attractions.

[1896] 4. The results are displayed on the smart glasses display and suggestions are made to the user.

[1897] Prompt Sentence Examples

[1898] If the user is feeling tired, provide them with information on recommended tourist spots around Shibuya, Tokyo where they can relax.

[1899] This system allows users to obtain optimal travel information based on their emotional state and location in real time, enabling them to enjoy a highly satisfying travel experience.

[1900] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1901] Program processing steps

[1902] Step 1:

[1903] Input: The user downloads a system-specific application to their device and enters basic account information.

[1904] What it does: The user enters basic information like name and email address, travel preferences, past travel history, and permission to enable emotion recognition.

[1905] Output: The entered account information is sent to the server and stored in a database. This information is used to prepare for future service provision.

[1906] Step 2:

[1907] Input: The user arrives at their travel destination, launches the application, and presses the "Check-in" button.

[1908] Specific operation: The device uses GPS to determine the user's current location and uses an emotion engine to analyze the user's emotions in real time using the camera and microphone.

[1909] Output: The acquired location information and emotion information are sent to the server, which then uses this information to acquire information about nearby tourist spots, waiting times, the shortest route, and restaurant information, and sends it to the device.

[1910] Step 3:

[1911] Input: Location and emotion information received by the server.

[1912] Specific operation: The server calls the tourist attraction information API and collects information on nearby tourist attractions, waiting times, shortest routes, and restaurant information based on the acquired location information and emotion information.

[1913] Output: The acquired tourist spot information, waiting time information, shortest route information, and restaurant information are sent to the terminal.

[1914] Step 4:

[1915] Input: Tourist attraction information, waiting time information, shortest route information, and restaurant information sent from the server.

[1916] How it works: The device provides this information to the user in real time, and the emotion engine periodically analyzes the user's emotions and suggests tourist spots based on their current emotional state.

[1917] Output: Real-time tourist information and sentiment-based suggestions are displayed to the user.

[1918] Step 5:

[1919] Input: Photo data taken by the user during their trip and smart payment information.

[1920] How it works: The device automatically organizes and categorizes photos taken by the device. It also uses an emotion engine to extract photos taken with specific emotions and create special albums. Smart payment information is also recorded at the same time.

[1921] Output: Organized photo data and purchase history are stored on the server. A special album is created from photos taken at specific emotional moments.

[1922] Step 6:

[1923] Input: Stored travel data (visit history, purchase history, photo data, emotion data).

[1924] How it works: The server analyzes this data using machine learning algorithms to recommend your next travel itinerary, suggesting the best places to visit or travel to next based on the tourist spots you've visited in the past and the activities you're interested in.

[1925] Output: Next trip plan based on the analysis results will be displayed within the application.

[1926] In this way, users can receive optimal tourist information based on their emotional state and location information in real time, and next travel plans are also suggested, enabling a highly satisfying travel experience.

[1927] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1928] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1929] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1930] [Fourth embodiment]

[1931] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1932] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1933] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1934] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1935] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1936] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1937] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1938] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1939] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1940] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1941] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1942] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1943] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1944] This invention relates to a system that allows travelers to efficiently visit tourist spots and plan their next trip based on their past travel history. This system acquires location information from a terminal and provides tourist spot information based on that information, stores and uses visit history and purchase history, and also recommends next travel plans.

[1945] System Overview

[1946] 1. Initial settings and user information entry

[1947] Device:

[1948] Users download an app specifically for this system and install it on their smartphones.

[1949] Launch the app and create a new account by entering basic account information such as your name and email address.

[1950] You can also enter details such as your travel preferences and past travel history.

[1951] server:

[1952] Receives account information sent from the device and stores it in a database.

[1953] If necessary, obtain past travel history and prepare it for analysis.

[1954] User:

[1955] A confirmation screen will appear asking whether you want to allow access to your location information, and if you allow it, your location information will be obtained.

[1956] 2. Selecting your destination and checking in

[1957] User:

[1958] After arriving at your destination, launch the app and press the "Check-in" button.

[1959] Device:

[1960] It uses the built-in GPS to determine the user's current location and sends that information to the server.

[1961] server:

[1962] Based on the received current location information, information on nearby tourist attractions and restaurants, waiting times, etc. is obtained and sent to the terminal.

[1963] Specific examples

[1964] Let's take the example of User A going on a trip to Kyoto.

[1965] 1. Initial settings and user information entry

[1966] Person A installs the app on his smartphone, creates an account, enters basic information, and allows access to GPS.

[1967] 2. Check-in in Kyoto

[1968] When Mr. A arrives in Kyoto, he launches the app and presses the "Check-in" button.

[1969] The app checks A's current location and displays information about nearby tourist attractions (e.g., Kinkaku-ji Temple, Kiyomizu-dera Temple, Gion) and restaurants.

[1970] 3. Real-time support during sightseeing

[1971] Device:

[1972] The app provides real-time information on waiting times at tourist spots, the shortest routes, and seat availability at restaurants.

[1973] When Person A selects a tourist spot and visits it, his / her progress is automatically recorded.

[1974] server:

[1975] Based on the received information, the congestion situation at tourist spots is updated in real time and notifications are sent to Mr. A as necessary.

[1976] 4. Purchasing history and photo organization

[1977] Device:

[1978] When Mr. A makes a payment using his smartphone, the information is automatically recorded.

[1979] Photos taken during your trip are automatically organized and categorized.

[1980] server:

[1981] Store purchase history and prepare it for later analysis.

[1982] The captured photo data is stored in the cloud, and slideshows and albums are generated using the automatic editing function.

[1983] 5. Recommendations for your next travel plan

[1984] server:

[1985] When the trip ends, the server analyzes Mr. A's travel data (visit history, purchase history, photo data).

[1986] For Mr. A's next trip, the app will recommend the best tourist spots, routes, and length of stay, and notify him / her via the app.

[1987] This system allows travelers to enjoy sightseeing efficiently and also makes it easier to plan their next trip.

[1988] The processing flow will be explained below.

[1989] Step 1:

[1990] User:

[1991] Download the app and complete the installation. Launch the app and create a new account by entering your account information (name, email address, travel preferences, etc.).

[1992] Step 2:

[1993] Device:

[1994] The account information entered by the user is sent to the server, and access to the GPS is requested, and if the user allows it, the current location information is obtained.

[1995] Step 3:

[1996] server:

[1997] The received account information is stored in a database. If there is past travel history, it is retrieved and prepared for analysis.

[1998] Step 4:

[1999] User:

[2000] After arriving at your travel destination, open the app and press the "Check-in" button. Check the information on tourist spots and restaurants provided within the app.

[2001] Step 5:

[2002] Device:

[2003] The system uses GPS to check the user's current location and sends that information to the server, which then displays the received information about tourist spots and restaurants to the user.

[2004] Step 6:

[2005] server:

[2006] Based on the current location information, information on nearby tourist attractions, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[2007] Step 7:

[2008] User:

[2009] Based on the tourist information displayed, select the places you want to visit and actually visit them.

[2010] Step 8:

[2011] Device:

[2012] The data of tourist spots visited by users is updated in real time and the duration of stay is recorded.

[2013] Step 9:

[2014] server:

[2015] The system regularly updates information on the congestion status and waiting times of tourist spots, and notifies users as necessary.

[2016] Step 10:

[2017] User:

[2018] Visit a restaurant and pay using your smartphone. Also, take photos while traveling.

[2019] Step 11:

[2020] Device:

[2021] Automatically records smartphone payment information and organizes photo data by category.

[2022] Step 12:

[2023] server:

[2024] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions.

[2025] Step 13:

[2026] server:

[2027] After the trip is over, the user's travel data (visit history, purchase history, photo data) is analyzed using a machine learning algorithm to recommend their next travel plan.

[2028] Step 14:

[2029] User:

[2030] Check your upcoming travel plans in the app and plan your next trip accordingly.

[2031] Example 1

[2032] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2033] With so many tourist spots and restaurants to visit, modern travelers are faced with the challenge of efficiently planning their trips. Obtaining the latest information in real time while traveling and optimizing their selection of tourist spots and restaurants is no easy task. Furthermore, organizing photos taken during a trip and proposing next travel plans that take into account past travel and purchase history can be time-consuming. To solve these challenges, a system is needed that automatically and efficiently provides information and improves the traveler experience.

[2034] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2035] In this invention, the server includes means for acquiring user location information, means for providing information on nearby tourist spots, waiting times, and the shortest route based on the acquired location information, means for saving history information on visits to tourist spots and purchase history information, means for recommending next travel plans based on the saved history information and purchase history information, means for automatically organizing image data taken during the trip, means for automatically recording transaction information on the smart device during the trip, means for transmitting information from the terminal to the server and means for saving image data in the cloud, and means for automatically creating albums and presentations based on the saved image data. This allows travelers to enjoy sightseeing efficiently and makes it possible to smoothly plan their next trip.

[2036] "Location Information" means geographic data obtained via GPS or other means that indicates a user's current location.

[2037] "Tourist attraction information" refers to detailed information about tourist attractions, including location, features, opening hours, admission fees, etc.

[2038] "Waiting time" refers to the time it takes for a user to receive service at a tourist spot, restaurant, or other facility.

[2039] The "shortest route" is information indicating the most time-efficient route when a user travels from their current location to their destination.

[2040] "History information" refers to records of tourist spots that a user has visited in the past and services that the user has used.

[2041] "Purchase history information" refers to records of purchases and transactions made by a user during their trip.

[2042] "Travel plan recommendations" refers to suggesting suitable tourist spots and routes for the user's next trip based on the user's past behavioral data.

[2043] "Photographed image data" refers to images that a user takes while traveling and saves as digital data.

[2044] "Means for automatic organization" refers to a function in which the system automatically classifies and organizes data without requiring manual operation by the user.

[2045] "Transaction information recording" refers to a function that automatically records data related to economic activities performed by a user while traveling, such as purchases and payments.

[2046] "Means for transmitting information to the server" refers to communication means for transmitting data from the terminal to the server.

[2047] "Cloud storage" refers to technology for storing digital data on remote servers via the internet.

[2048] "Means for creating albums and presentations" refers to a function for automatically generating albums and slideshow-style presentations based on stored image data.

[2049] The present invention relates to a system that allows travelers to efficiently visit tourist spots and plan their next trip based on their past travel history. The system is implemented using a user's smartphone, a server, cloud storage, and a generative AI model. A specific embodiment of the system is described below.

[2050] Entering initial settings and user information

[2051] User:

[2052] Users first download and install the app on their smartphone. Next, they launch the app and create a new account by entering basic account information such as their name and email address. They can also enter more detailed information such as their travel preferences and past travel history. By allowing access to location information, location information can be obtained.

[2053] Device:

[2054] The app temporarily stores the user's input information and proceeds with the account creation process. It checks the location access permission status and obtains location information with the user's consent.

[2055] server:

[2056] The server receives the account information and the access permission status of the location information sent from the terminal and stores them in a database.

[2057] Selecting your destination and checking in

[2058] User:

[2059] After arriving at their travel destination, the user launches the app and presses the "Check-in" button.

[2060] Device:

[2061] The app uses the built-in GPS to determine the user's current location and sends that location information to a server.

[2062] server:

[2063] Based on the received location information, the server provides information on nearby tourist attractions and restaurants, as well as waiting times and the shortest routes. This information is sent to the device and displayed to the user.

[2064] Real-time support during sightseeing

[2065] Device:

[2066] The app provides real-time information on waiting times at tourist attractions, the shortest routes, and restaurant availability. When users visit tourist attractions, their progress is automatically recorded.

[2067] server:

[2068] Based on the received information, the server updates the congestion status of tourist spots in real time and sends notifications to users as necessary.

[2069] Purchase history and photo organization

[2070] Device:

[2071] When a user makes a payment using their smartphone, the information is automatically recorded. Also, photos taken during the trip are automatically organized and categorized. This organized information is sent to the server.

[2072] server:

[2073] The server stores purchase history and prepares it for later analysis. The photos are stored in the cloud and automatically edited to create slideshows and albums.

[2074] Recommendations for your next travel plan

[2075] server:

[2076] Once the trip is over, the server analyzes the travel data (visit history, purchase history, photo data) and uses a generative AI model to recommend the best sightseeing spots, routes, and duration for the next trip, and notifies the user through the app.

[2077] Specific examples

[2078] For example, if a user travels to Kyoto, the system operates as follows.

[2079] 1. Initial setup and user information entry:

[2080] Users install the app on their smartphone, create an account, enter basic information, and allow access to their GPS.

[2081] 2. Check-in in Kyoto:

[2082] When a user arrives in Kyoto, they launch the app and press the "Check In" button. The app then checks their current location and provides information on nearby tourist attractions (e.g., temples, gardens, historical buildings) and dining options.

[2083] Specific prompt examples:

[2084] "Install the app, enter your name and email address, and register your travel preferences."

[2085] "When you arrive in Kyoto, open the app and click check-in."

[2086] "Provides real-time information on nearby tourist attractions and restaurants."

[2087] "It records your smartphone payment history and automatically organizes the photos you take."

[2088] "Recommend your next travel plan."

[2089] This invention allows travelers to enjoy sightseeing efficiently and also makes it possible to smoothly plan their next trip.

[2090] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2091] Step 1:

[2092] Entering initial settings and user information

[2093] Specific behavior:

[2094] User: The user first downloads and installs the app on their smartphone. They launch the app and enter basic account information such as their name and email address, as well as other details such as their travel preferences and past travel history. They are then asked to allow location access.

[2095] Input: User's name, email address, travel preferences, past travel history, location access permission (input)

[2096] Output: Account information, location access permission (output)

[2097] Device:

[2098] The app will temporarily store the information you entered and proceed with the account creation process. Confirm location access permissions.

[2099] Input: Account information entered by the user, location access permission status (input)

[2100] Output: Provisional account information, location access permission status (output)

[2101] server:

[2102] The account information and location information access permission status sent from the device are saved in a database.

[2103] Input: Account information and location access permission status sent from the device (input)

[2104] Output: Stored account information and permission data (output)

[2105] Step 2:

[2106] Selecting your destination and checking in

[2107] Specific behavior:

[2108] User: After arriving at their travel destination, they launch the app and press the "Check-in" button.

[2109] Input: User's current location, travel destination selection information (input)

[2110] Output: Check-in information (output)

[2111] Device:

[2112] It uses the built-in GPS function to determine the user's current location and sends that information to the server.

[2113] Input: GPS data (input)

[2114] Output: User's current location information (output)

[2115] server:

[2116] Based on the received location information, data is generated that provides information on nearby tourist attractions and restaurants, waiting times, and the shortest routes, and is sent to the terminal.

[2117] Input: Current location information sent from the device (input)

[2118] Output: Information on nearby tourist spots, waiting time, shortest route (output)

[2119] Step 3:

[2120] Real-time support during sightseeing

[2121] Specific behavior:

[2122] Device: The app provides real-time information on waiting times at tourist attractions, the shortest routes, and seat availability at restaurants. When users visit tourist attractions, their progress is automatically recorded.

[2123] Input: Real-time GPS data, tourist spot selection information (input)

[2124] Output: Waiting time information, shortest route, seat availability information, visit history (output)

[2125] server:

[2126] Based on the received real-time information, the system updates the congestion status of tourist spots and sends notifications to users.

[2127] Input: Real-time GPS data received from the device, visit history (input)

[2128] Output: Updated tourist destination information, congestion status, notifications (output)

[2129] Step 4:

[2130] Purchase history and photo organization

[2131] Specific behavior:

[2132] Terminal: When a user makes a payment using their smartphone, that information is automatically recorded. Photos taken during the trip are automatically organized, categorized, and sent to the server.

[2133] Input: Smartphone payment data, taken photo (input)

[2134] Output: Purchase history data, organized photo data (output)

[2135] server:

[2136] It receives purchase history and stores it in a database. It also stores photographic data in the cloud and uses an automatic editing function to generate slideshows and albums.

[2137] Input: Purchase history data received from the device, organized photo data (input)

[2138] Output: Saved purchase history data, photo data stored in the cloud, generated slideshows and albums (output)

[2139] Step 5:

[2140] Recommendations for your next travel plan

[2141] Specific behavior:

[2142] Server: After the trip is over, the server statistically analyzes the travel data (visit history, purchase history, photo data) and uses a generative AI model to recommend the best tourist spots, routes, and duration for the next trip.

[2143] Input: Travel data (visit history, purchase history, photo data) (input)

[2144] Output: Next travel plan, recommendations (output)

[2145] server:

[2146] Recommended tourist spots and routes are notified to the user's smartphone based on their account information.

[2147] Input: Recommendation information, user account information (input)

[2148] Output: Notification(Output)

[2149] Device:

[2150] Users will receive notifications and can check their upcoming travel plans.

[2151] Input: Notification(Input)

[2152] Output: Confirmed itinerary (output)

[2153] (Application example 1)

[2154] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2155] In recent years, there has been an increasing need for travelers to obtain information on sightseeing and dining at their travel destinations efficiently. There is a need for a system that can efficiently obtain information on tourist spots and surrounding restaurants, and support the planning of next trips based on visit and purchase history. Furthermore, to enrich the dining experience during travel, a system is needed that can obtain real-time information on the congestion status of surrounding restaurants, reservation information, and popular menu items.

[2156] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2157] In this invention, the server includes means for acquiring user location information, means for providing information on nearby tourist spots, waiting times, and shortest routes based on the acquired location information, means for saving history information on visits to tourist spots and purchase history information, means for recommending next travel plans based on the saved history information and purchase history information, means for providing information on nearby restaurants, popular menus, and congestion status based on the acquired location information, and means for providing reservation status of nearby restaurants. This allows travelers to enjoy sightseeing efficiently and have an optimal dining experience at their travel destination.

[2158] "User" refers to a traveler who uses the system and is the entity that provides individual location information, preference information, etc.

[2159] "Location Information" means data that allows a system to determine a user's current geographic location, obtained using GPS or other positioning technology.

[2160] "Tourist destination information" is information about tourist attractions, famous sites, natural landscapes, etc. that the user may visit.

[2161] "Waiting time" is information about the amount of time you need to wait to use a service at a tourist spot or restaurant.

[2162] The "shortest route" is information about the most efficient route from the current location to the destination.

[2163] "History information" is a record of tourist spots that a user has visited in the past and services that the user has used.

[2164] "Purchase history information" is a record of purchases made by a user in the past, and includes information about the products and services purchased.

[2165] "Recommendation" refers to making optimal suggestions for the user's next trip or activity based on their past behavior and preferences.

[2166] "Restaurant information" is information about nearby restaurants, including their locations, menus, opening hours, etc.

[2167] "Popular menu items" refers to information about dishes and drinks that are particularly highly rated or frequently ordered at restaurants.

[2168] "Crowding status" is information about the current level of crowding at places such as tourist spots and restaurants.

[2169] "Reservation status" refers to information used to guarantee the availability of seats or services in advance at restaurants and other services.

[2170] The present invention relates to a system that allows travelers to visit tourist spots efficiently and enrich their dining experience. This system provides real-time information on nearby tourist spots and restaurants based on the user's location information, and makes recommendations for subsequent travel plans.

[2171] System Overview

[2172] 1. Initial settings and user information entry

[2173] Terminal

[2174] First, users install the system's dedicated app on their smartphones, enter basic information (such as name and email address) to create an account, and then set it to allow GPS access.

[2175] server

[2176] Receives user account information sent from the device and stores it in a database. Obtains past travel history and prepares for analysis.

[2177] 2. Acquisition of location information and provision of tourist spot and restaurant information

[2178] User

[2179] After arriving at your destination, launch the app and press the "Check-in" button.

[2180] Terminal

[2181] It uses the built-in GPS to determine the user's current location and sends that information to the server.

[2182] server

[2183] Based on the received current location information, information on nearby tourist attractions and restaurants, waiting times, the shortest route, as well as popular menu items, congestion status, and reservation status at restaurants are obtained and sent to the device.

[2184] 3. Support during sightseeing

[2185] Terminal

[2186] The app provides real-time information on waiting times at tourist spots, the shortest routes, and seat availability and reservation status at restaurants. When users visit tourist spots or restaurants, their history is automatically recorded.

[2187] server

[2188] Based on the received location information and visit history, the system updates the congestion status of tourist spots and restaurants and sends notifications to the user as necessary.

[2189] 4. Purchasing history and photo organization

[2190] Terminal

[2191] When a user makes a payment using their smartphone, that information is automatically recorded, and photos taken during the trip are automatically organized and categorized.

[2192] server

[2193] It stores purchase history and prepares it for later analysis. The photos are stored in the cloud and automatically edited to create slideshows and albums.

[2194] 5. Recommendations for your next travel plan

[2195] server

[2196] Once the trip is over, the server analyzes the user's travel data (visit history, purchase history, photo data), and recommends the best sightseeing spots, routes, and duration for the next trip, and notifies the user through the app.

[2197] Specific examples

[2198] Consider the case where a user travels to a specific city. For example, the user visits a tourist spot, obtains information about nearby restaurants, and enjoys delicious food. The flow is as follows:

[2199] Specific examples

[2200] When a traveler arrives at a famous tourist spot, they launch the app and press the "Check-in" button. GPS identifies their current location and sends that information to the server. The server then uses that location information to provide real-time information about nearby tourist spots and restaurants. The traveler visits the tourist spot, finds nearby restaurants, and enjoys a meal. During this process, their visit history and purchase history are automatically recorded, and recommendations are made for the next trip.

[2201] Prompt Sentence Examples

[2202] "I want to develop an app that provides information about recommended restaurants near the user's current location when they visit a famous tourist spot. I want a function that uses the user's location information to display nearby restaurants, popular menu items, and crowding status in real time."

[2203] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2204] Step 1: Installing the app and initial setup

[2205] The device requires the user to install a system-specific app on their smartphone and enter basic information (such as name and email address), then allows GPS access. The entered information is sent from the device to the server.

[2206] Input: User's basic information (name, email address, etc.)

[2207] Output: User account information is saved on the server

[2208] Step 2: Obtaining and sending location information

[2209] When the user arrives at their travel destination and presses the "Check-in" button, the device uses its built-in GPS to determine their current location and sends that information to the server.

[2210] Input: User's "check-in" operation

[2211] Output: Current location latitude and longitude information is sent to the server

[2212] Step 3: Acquiring and providing information on tourist spots and restaurants

[2213] The server receives the latitude and longitude information of the current location and then obtains information about nearby tourist attractions and restaurants, including waiting times, the shortest route, popular menu items, congestion status, and reservation status. This information is then sent to the device.

[2214] Input: Current location latitude and longitude information

[2215] Output: Information on nearby tourist spots, restaurant information, waiting time, shortest route, popular menu items, congestion status, reservation status

[2216] Step 4: Providing real-time support

[2217] The device displays information about tourist spots and restaurants sent from the server to the user in real time, providing the shortest route to each location, waiting times, congestion status, etc. When the user visits a tourist spot or eats at a restaurant, the history is automatically recorded and sent to the server.

[2218] Input: Tourist information and restaurant information from the server

[2219] Output: User visit history and purchase history are recorded on the server

[2220] Step 5: Record and organize your purchase history and photos

[2221] When a user makes a smartphone payment at a restaurant, the device automatically records the purchase history information and sends it to the server. In addition, photos taken during the trip are automatically organized, categorized, and stored in the cloud.

[2222] Input: User's smartphone payment information, photographed photo

[2223] Output: Purchase history and photo data stored in the cloud

[2224] Step 6: Recommend your next travel plan

[2225] After the trip, the server analyzes the user's saved travel data (visit history, purchase history, photo data) and recommends the best sightseeing spots, routes, and duration for the next trip. This recommendation information is notified to the user via their device.

[2226] Input: User's travel data (visit history, purchase history, photo data)

[2227] Output: Recommendations for your next trip

[2228] As a specific example of how it works, when a user arrives at a tourist spot, launches the app, and presses the check-in button, the device acquires GPS information and sends it to the server. The server then uses this location information to acquire information about nearby tourist spots and restaurants, and sends it to the device. The user receives this information in real time, allowing them to efficiently choose their next tourist spot or place to eat. After the trip is over, the server also sends recommended information, making it easy to plan their next trip.

[2229] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2230] This invention relates to a system that acquires a user's location information and emotions, and based on that information, provides tourist information and recommends the user's next travel plan. The system combines an emotion engine to provide optimal information so that the user can have a more satisfying travel experience. The system's program processing is explained below in natural language.

[2231] System Overview

[2232] 1. Initial settings and user information entry

[2233] Device:

[2234] Users download the system's dedicated app and install it on their smartphones.

[2235] Launch the app and create a new account by entering basic account information such as your name and email address.

[2236] Configure settings to allow recognition of travel preferences, past travel history, and even emotions.

[2237] server:

[2238] Receives account information sent from the device and stores it in a database.

[2239] If necessary, obtain past travel history and prepare for analysis.

[2240] User:

[2241] By allowing access to location information and emotion recognition, you can obtain location information and emotion information.

[2242] 2. Selecting your destination and checking in

[2243] User:

[2244] After arriving at your destination, launch the app and press the "Check-in" button.

[2245] Check the information on tourist spots and restaurants provided within the app.

[2246] Device:

[2247] It uses GPS to check the user's current location and uses an emotion engine to analyze the user's emotions in real time.

[2248] The location information and the emotion information are transmitted to a server.

[2249] server:

[2250] Based on the received current location information and emotion information, information on nearby tourist spots, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[2251] Specific examples

[2252] Let's take the example of User B going on a trip to Tokyo.

[2253] 1. Initial settings and user information entry

[2254] Person B installs the app on his smartphone and creates an account, entering basic information and granting access to the GPS and emotion recognition functions.

[2255] 2. Check-in in Tokyo

[2256] When Mr. B arrives in Tokyo, he launches the app and presses the "Check-in" button.

[2257] The app checks B's current location and displays information about nearby tourist spots (such as Tokyo Tower, Sensoji Temple, and Shibuya Crossing) and restaurants. Meanwhile, using the built-in camera and microphone, the emotion engine analyzes B's facial expressions and tone of voice to recognize his or her emotions.

[2258] 3. Real-time support during sightseeing

[2259] Device:

[2260] The app provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability. In addition, the emotion engine periodically analyzes B's emotions and suggests tourist spots based on his / her current emotional state (for example, if he / she is feeling stressed, it will suggest a relaxing park).

[2261] server:

[2262] Based on the received information, the system periodically updates information on the congestion situation and waiting times at tourist spots, and sends notifications to Person B as necessary.

[2263] Emotional information is analyzed and used to gauge satisfaction at tourist spots and recommend the next destination.

[2264] 4. Purchasing history and photo organization

[2265] Device:

[2266] When Mr. B makes a payment using his smartphone, the information is automatically recorded.

[2267] Photos taken during a trip are automatically organized and categorized, and an emotion engine extracts photos taken during specific emotional moments to create special albums.

[2268] server:

[2269] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions (such as creating slideshows and applying filters).

[2270] 5. Recommendations for your next travel plan

[2271] server:

[2272] After the trip, Mr. B's travel data (visit history, purchase history, photo data, and emotional data) is analyzed using a machine learning algorithm to recommend his next travel plan. For example, the system will suggest the best next travel destinations and places to visit based on the tourist spots he has enjoyed in the past and the activities he has been interested in.

[2273] User:

[2274] Check your upcoming travel plans in the app and plan your next trip accordingly.

[2275] This system allows users to enjoy sightseeing efficiently and has a more personalized travel experience based on their emotions.

[2276] The processing flow will be explained below.

[2277] Step 1:

[2278] User:

[2279] Download the app and complete the installation. Launch the app and create a new account by entering your account information (name, email address, travel preferences, etc.).

[2280] Step 2:

[2281] Device:

[2282] The account information entered by the user is sent to the server, and permission to access GPS and the emotion recognition function is requested. If the user allows it, location information and emotion information are obtained.

[2283] Step 3:

[2284] server:

[2285] The received account information is stored in a database. If there is past travel history, it is retrieved and prepared for analysis.

[2286] Step 4:

[2287] User:

[2288] After arriving at your travel destination, open the app and press the "Check-in" button. Check the information on tourist spots and restaurants provided within the app.

[2289] Step 5:

[2290] Device:

[2291] It uses GPS to determine the user's current location and sends that information to the server, and uses an emotion engine to analyze the user's facial expressions and voice to assess their current emotions.

[2292] Step 6:

[2293] server:

[2294] Based on the current location information and emotion information, information on nearby tourist spots, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[2295] Step 7:

[2296] Device:

[2297] The received tourist spot and restaurant information is displayed on the app screen to notify the user. The emotion engine operates in real time to continuously monitor changes in the user's emotions.

[2298] Step 8:

[2299] User:

[2300] Based on the tourist information displayed, users can select a location to visit and actually visit it. If the emotions they felt while visiting a tourist spot changed, that information is recorded.

[2301] Step 9:

[2302] Device:

[2303] The data of tourist spots visited by the user is updated in real time and the time spent there is recorded. The emotion engine analyzes the user's emotions and provides information according to the situation (for example, suggesting a quiet place if you need to relax).

[2304] Step 10:

[2305] server:

[2306] The system regularly updates information on the congestion status and waiting times at tourist spots and notifies users as needed. It also analyzes travel experiences based on emotional data and uses this information to make future recommendations.

[2307] Step 11:

[2308] User:

[2309] Visit a restaurant and pay using your smartphone. Also, take photos while traveling.

[2310] Step 12:

[2311] Device:

[2312] It automatically records smartphone payment information, organizes photo data into categories, and extracts photos taken in specific emotional states to create special albums.

[2313] Step 13:

[2314] server:

[2315] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions.

[2316] Step 14:

[2317] server:

[2318] After the trip, the system analyzes the user's travel data (visit history, purchase history, photo data, and emotional data) using machine learning algorithms to recommend the next travel plan. It suggests the best next travel destinations and places to visit based on the tourist spots they have enjoyed in the past and the activities they are interested in.

[2319] Step 15:

[2320] User:

[2321] Check your upcoming travel plans in the app and plan your next trip accordingly.

[2322] Example 2

[2323] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2324] While conventional travel support systems provide information based on the user's location, they lack the ability to provide personalized information that takes into account the user's emotional state. Furthermore, organizing travel purchase history and photo data is time-consuming, making data management inefficient for use in planning the next trip. Furthermore, there is a need for a system that can quickly provide information on the congestion situation at visited tourist spots and real-time waiting times.

[2325] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2326] In this invention, the server includes means for acquiring location information and emotional state of the user, means for providing information on nearby tourist spots, waiting times and the shortest route based on the acquired location information and emotional information, and means for saving history information on visiting tourist spots, purchase history information and emotional state. This not only enables the user to receive personalized tourist spot information that takes into account their emotional state, but also enables automatic organization of purchase history and photo data, making it easier to use for planning their next trip.

[2327] "Location information" is data that indicates the specific geographic coordinates where a user is currently physically located.

[2328] "Emotional information" is data that indicates the user's emotional state and is obtained through facial expression recognition, voice analysis, and the like.

[2329] "Tourist destination information" refers to information related to tourist destinations, including, for example, highlights, opening hours, admission fees, and crowding levels.

[2330] "Wait time" is data that indicates the amount of time a user must wait to receive a service or experience at a particular location or event.

[2331] The "shortest route" is information indicating the route with the shortest travel distance from the starting point to the destination.

[2332] "History information" is recorded data of places visited by a user in the past and services used by the user.

[2333] "Purchase history information" is recorded data of products and services purchased by a user.

[2334] "Recommendation" means suggesting the next action to be taken based on the user's past actions and current situation.

[2335] The present invention is a system that acquires location information and emotion information of a user and, based on this, provides tourist spot information and recommends next travel plans. An embodiment of the system will be described in detail below.

[2336] Entering initial settings and user information

[2337] Device:

[2338] Users download and install the system's dedicated app on their smartphones, then launch the app and create a new account by entering basic information such as their name and email address, as well as travel preferences, past travel history, and permission to recognize emotions.

[2339] server:

[2340] Receives account information sent from the device and stores it in a database. If necessary, retrieves past travel history and prepares it for analysis.

[2341] User:

[2342] Allowing access to location information and emotion recognition allows us to obtain location information and emotion information.

[2343] Selecting your destination and checking in

[2344] User:

[2345] After arriving at your travel destination, open the app and press the "Check-in" button. Check the information on tourist spots and restaurants provided within the app.

[2346] Device:

[2347] The system uses GPS to check the user's current location, and the emotion engine analyzes emotions in real time using the built-in camera and microphone. Location and emotion information is sent to the server.

[2348] server:

[2349] Based on the received current location information and emotion information, information on nearby tourist spots, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[2350] Real-time support during sightseeing

[2351] Device:

[2352] The app provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability. Furthermore, an emotion engine periodically analyzes the user's emotions and suggests tourist spots based on their current emotional state (for example, if they're feeling stressed, it will suggest a park where they can relax).

[2353] server:

[2354] Based on the received information, the system periodically updates information on the congestion status and waiting times of tourist spots, and notifies users as necessary. Emotional information is analyzed and used to determine satisfaction with tourist spots and recommend the next destination.

[2355] Purchase history and photo organization

[2356] Device:

[2357] When a user makes a payment using their smartphone, that information is automatically recorded. Photos taken during the trip are automatically organized and categorized. Furthermore, an emotion engine extracts photos taken during specific emotional moments and creates special albums.

[2358] server:

[2359] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions (such as creating slideshows and applying filters).

[2360] Recommendations for your next travel plan

[2361] server:

[2362] After the trip, the system analyzes the user's travel data (visit history, purchase history, photo data, and emotional data) using machine learning algorithms. Based on the tourist spots they enjoyed in the past and the activities they were interested in, the system suggests the best travel destinations and places to visit next time.

[2363] User:

[2364] Check your upcoming travel plans in the app and plan your next trip accordingly.

[2365] Specific examples

[2366] Let's take the example of User B going on a trip to Tokyo.

[2367] Entering initial settings and user information

[2368] Person B installs the app on his smartphone and creates an account, entering basic information and granting access to the GPS and emotion recognition functions.

[2369] Check-in in Tokyo

[2370] When Person B arrives in Tokyo, he launches the app and presses the "Check-in" button. The app checks Person B's current location and displays information about nearby tourist spots (e.g., Tokyo Tower, Sensoji Temple, Shibuya Crossing) and restaurants. Meanwhile, using the built-in camera and microphone, the emotion engine analyzes Person B's facial expressions and tone of voice to recognize their emotions.

[2371] Real-time support during sightseeing

[2372] The app provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability. Furthermore, the emotion engine periodically analyzes B's emotions and suggests tourist spots based on his / her current emotional state (for example, if he / she is feeling stressed, it will suggest a relaxing park).

[2373] Purchase history and photo organization

[2374] When B makes a payment using his smartphone, the information is automatically recorded. Photos taken during the trip are automatically organized and categorized. Photos taken during specific moments of emotion are also extracted and a special album is created.

[2375] Recommendations for your next travel plan

[2376] After B's trip, his travel data (visit history, purchase history, photo data, and emotional data) are analyzed using a machine learning algorithm to recommend his next travel plan. For example, it suggests the best next travel destinations and places to visit based on the tourist spots he enjoyed in the past and the activities he was interested in.

[2377] Prompt Sentence Examples

[2378] "When the user is at Tokyo Tower, the system will send the user's current location information and emotion information to the server and suggest recommended tourist spots and restaurants."

[2379] The above is a specific embodiment of the system.

[2380] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2381] Program processing flow

[2382] Entering initial settings and user information

[2383] Step 1:

[2384] Device: Users download the system-specific app and install it on their smartphones.

[2385] Enter: Install app.

[2386] Output: App launch.

[2387] Step 2:

[2388] Device: Launch the app and enter basic information such as your name and email address to create a new account.

[2389] Input: Name, email address, password, etc.

[2390] Output: Save account information.

[2391] Step 3:

[2392] Device: Set travel preferences, past travel history, and emotion recognition permissions.

[2393] Input: Travel preferences, past travel history, emotion recognition permission

[2394] Output: A completed account profile.

[2395] Step 4:

[2396] Terminal: Sends the entered account information to the server.

[2397] Input: Account Information

[2398] Output: Send to server.

[2399] Step 5:

[2400] Server: Stores the received account information in a database, retrieves past travel history as needed, and prepares it for analysis.

[2401] Input: Account Information

[2402] Output: Save to database.

[2403] Step 6:

[2404] User: Allow location and emotion recognition access so that location and emotion information can be obtained.

[2405] Input: Location and emotion recognition permissions

[2406] Output: Permission settings.

[2407] Selecting your destination and checking in

[2408] Step 1:

[2409] User: After arriving at their travel destination, they launch the app and press the "Check-in" button.

[2410] Input: Arrive at destination and press "Check-in" button

[2411] Output: Check-in confirmation.

[2412] Step 2:

[2413] Device: Uses GPS to determine the user's location, and the emotion engine analyzes emotions in real time using the built-in camera and microphone.

[2414] Input: User's current location, built-in camera and microphone

[2415] Output: Location information and emotion information.

[2416] Step 3:

[2417] Device: Sends location information and emotion information to the server.

[2418] Input: Location and emotion

[2419] Output: Send to server.

[2420] Step 4:

[2421] Server: Based on the received current location information and emotion information, obtains information on nearby tourist spots, waiting times, shortest routes, and restaurant information, and sends this information to the device.

[2422] Input: Current location information, emotion information

[2423] Output: Information on nearby tourist attractions, waiting times, shortest routes, and restaurant information.

[2424] Step 5:

[2425] Terminal: Receives information from the server and displays it to the user.

[2426] Input: Information on nearby tourist attractions, waiting times, shortest routes, restaurant information

[2427] Output: What is displayed to the user.

[2428] Real-time support during sightseeing

[2429] Step 1:

[2430] Device: The app provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability.

[2431] Input: Waiting time at tourist spots, shortest route, seat availability information

[2432] Output: Display of real-time information.

[2433] Step 2:

[2434] On the device: The emotion engine periodically analyzes the user's emotions and suggests tourist spots based on their current emotional state.

[2435] Input: Emotion data

[2436] Output: Personalized tourist destination suggestions.

[2437] Step 3:

[2438] Terminal: Periodically sends behavioral data during sightseeing (places visited, length of stay, etc.) to the server.

[2439] Input: Behavioral data

[2440] Output: Send to server.

[2441] Step 4:

[2442] Server: Based on the received information, the server periodically updates information on the congestion status and waiting times of tourist spots, and sends notifications to users as necessary.

[2443] Input: Behavioral data

[2444] Output: Crowding status, wait time updates, notifications.

[2445] Purchase history and photo organization

[2446] Step 1:

[2447] Terminal: When a user makes a payment using their smartphone, the information is automatically recorded.

[2448] Enter purchasing information

[2449] Output: A record of purchase history.

[2450] Step 2:

[2451] On your device: Automatically organize and categorize photos taken during your trip.

[2452] Input: Photo data

[2453] Output: Classified photo data.

[2454] Step 3:

[2455] On device: The emotion engine extracts photos taken at specific emotional moments and generates a special album.

[2456] Input: Photo data, emotion data

[2457] Output: An album based on emotions.

[2458] Step 4:

[2459] Server: Stores captured photo data in the cloud and performs automatic editing functions (such as creating slideshows and applying filters).

[2460] Input: Photo data

[2461] Output: Cloud saved, edited photo data.

[2462] Recommendations for your next travel plan

[2463] Step 1:

[2464] Server: After the trip ends, the user's travel data (visit history, purchase history, photo data, and emotional data) is analyzed using machine learning algorithms.

[2465] Input: Trip data

[2466] Output: Analysis results.

[2467] Step 2:

[2468] Server: Based on the analysis results, suggests the best travel destinations or places to visit next based on the tourist spots you have enjoyed in the past and the activities you are interested in.

[2469] Input: Analysis results

[2470] Output: Next trip recommendation.

[2471] Step 3:

[2472] User: See upcoming travel plans within the app and plan their next trip accordingly.

[2473] Input: Next Trip Recommendation

[2474] Output: Next trip plan.

[2475] (Application example 2)

[2476] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2477] Conventional tourist information systems are limited to providing information about tourist spots and restaurants based on the user's current location, and do not adequately consider the user's emotional state. Furthermore, there are no comprehensive systems that can suggest tourist spots using real-time emotion recognition or improve the travel experience. As a result, users may experience lower travel satisfaction due to suggestions that do not match their emotional state. To address this issue, a system that utilizes the user's emotional information to provide more personalized tourist information and recommend next travel plans is needed.

[2478] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2479] In this invention, the server includes means for acquiring user location information, means for providing information on nearby tourist spots, waiting times, and the shortest route based on the acquired location information and emotion information, means for recognizing the user's emotion and suggesting tourist spots and transportation options based on that emotion, and means for saving history information on tourist spots visited and purchase history information. This makes it possible to provide tourist information that reflects the user's emotional state in real time, and by making suggestions that meet individual needs, it becomes possible to improve travel satisfaction.

[2480] definition statement

[2481] "User" refers to the user of the service and the entity that receives information and suggestions from the system.

[2482] "Location Information" means data that describes a user's current geographic location, such as data obtained through GPS or other location measurement technologies.

[2483] "Emotional information" is data that indicates the emotional state of a user extracted from facial expressions, tone of voice, behavioral patterns, etc.

[2484] "Tourist destination information" means information related to a particular tourist destination, such as overview, history, attractions, and activities.

[2485] "Waiting time" is information indicating the waiting time to enter a particular tourist attraction or facility.

[2486] The "shortest route" is information indicating the route that will allow the user to reach the destination specified by the user in the shortest time.

[2487] "Emotion recognition" is the process of identifying and digitizing a user's current emotional state.

[2488] "History information" is data that shows the overall information such as the places a user has visited in the past, the services they have used, and their behavioral records.

[2489] "Purchase history information" is a record of products and services purchased by a user in the past.

[2490] The "next travel plan" is the next travel destination and schedule suggested based on the user's past history information and emotional information.

[2491] "Restaurant information" refers to information about restaurants in a specified area, such as their names, menus, reviews, and opening hours.

[2492] "Availability" is information indicating the availability of seats at a particular restaurant.

[2493] "Photo data" is a collection of image files taken by a user, and is data stored in the form of visual information.

[2494] "Automatic organization and editing" refers to the process of using an algorithm to categorize photo data and process it as needed.

[2495] "Recommending travel plans" means suggesting travel destinations and plans of action that will satisfy the user.

[2496] MODE FOR CARRYING OUT THE INVENTION

[2497] The present invention relates to a system that provides tourist information and recommends next travel plans based on a user's emotional information and location information. The following description describes an embodiment of the invention based on the claims.

[2498] System Overview

[2499] 1. Initial settings and user information entry

[2500] Device:

[2501] Users download and install the system's dedicated application onto their device, then create a new account by entering basic account information such as their name and email address, as well as their travel preferences, past travel history, and permission to use emotion recognition.

[2502] server:

[2503] Receives account information sent from the device and stores it in a database. If necessary, retrieves past travel history and prepares it for analysis.

[2504] User:

[2505] Allowing access to location and emotion recognition allows the application to obtain location and emotion information.

[2506] 2. Selecting your destination and checking in

[2507] User:

[2508] After arriving at your travel destination, start the app and press the "Check-in" button. Check the information on tourist spots and restaurants provided within the app.

[2509] Device:

[2510] The system uses GPS to check the user's current location and uses an emotion engine to analyze the user's emotions in real time. The location information and emotion information are sent to the server.

[2511] server:

[2512] Based on the received current location information and emotion information, information on nearby tourist spots, waiting times, shortest routes, and restaurant information is obtained and sent to the terminal.

[2513] 3. Real-time support during sightseeing

[2514] Device:

[2515] The application provides real-time information on waiting times at tourist spots, the shortest routes, and restaurant availability. In addition, an emotion engine periodically analyzes the user's emotions and suggests tourist spots based on their current emotional state.

[2516] server:

[2517] Based on the received information, the system periodically updates information on the congestion status and waiting times of tourist spots, and notifies users as necessary. Emotional information is analyzed and used to determine satisfaction with tourist spots and recommend the next destination.

[2518] 4. Purchasing history and photo organization

[2519] Device:

[2520] When users make smart payments, the information is automatically recorded. Photos taken during travel are automatically organized and categorized. An emotion engine also extracts photos taken during specific emotional moments and creates special albums.

[2521] server:

[2522] Stores purchase history and prepares it for analysis. Stores captured photo data in the cloud and performs automatic editing functions (such as creating slideshows and applying filters).

[2523] 5. Recommendations for your next travel plan

[2524] server:

[2525] After the trip, the system analyzes the user's travel data (visit history, purchase history, photo data, and emotional data) using machine learning algorithms to recommend the next travel plan. It suggests the best next travel destinations and places to visit based on the tourist spots they have enjoyed in the past and the activities they have been interested in.

[2526] User:

[2527] See upcoming travel plans within the app and plan your next trip accordingly.

[2528] Specific examples of processing

[2529] 1. Use the camera to take a picture of the user's face and analyze their emotions using an emotion recognition API (e.g., Emotion API).

[2530] 2. Use the GPS sensor to get the user's current location.

[2531] 3. Based on the acquired emotion data and location information, the tourist attraction information API is called to obtain information about nearby tourist attractions.

[2532] 4. The results are displayed on the smart glasses display and suggestions are made to the user.

[2533] Prompt Sentence Examples

[2534] If the user is feeling tired, provide them with information ...

Claims

1. A means for acquiring user location information; A means for providing information on nearby tourist attractions, waiting times, and the shortest route based on the acquired location information; A means for storing history information of visits to tourist spots and purchase history information; A means for recommending next travel plans based on stored history information and purchase history information; A system including:

2. means for receiving travel destination information input by a user; A means for providing information on nearby restaurants and seat availability based on travel destination information; The system of claim 1 further comprising:

3. 10. The system of claim 1, further comprising means for automatically organizing and editing the stored photographic data.

Images