System

Abstract

To provide a system.SOLUTION: A system for creating a communication module for tourists and providing information for the tourists using the communication module, includes: means for collecting spot information including the congestion state, waiting time, and open time of a sightseeing spot; means for recognizing emotions of the tourists and providing the spot information on the sightseeing spot depending on the recognized emotions of the tourists; communication means for the tourists; and means for sharing evaluation of the sightseeing spot using the communication means.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] When tourists from overseas visit Japan, they face challenges such as language barriers, cultural differences, and a lack of local information, preventing them from fully experiencing the country's charms. There are also safety issues, such as limited access to information about tourist spots and events, and inadequate emergency response. [Means for solving the problem]

[0005] This invention is a system that creates prepaid SIM cards for overseas tourists and provides apps for users of those SIM cards. This system includes recommended sightseeing spots, itinerary planning, language and Japanese culture guides, local festival and event information, recommended shops and food guides, shopping guides, emergency contact, safety information, tourism information feedback, weather information, and communication between tourists. This allows tourists to efficiently obtain tourism information about Japan and strengthens emergency response. Furthermore, providing services to tourists can generate profits. [Brief explanation of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11]FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment Example 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0007] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0010] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0014] [First embodiment]

[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0019] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0022] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0023] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0027] "Example 1"

[0028] One aspect of the present invention is a system that creates prepaid SIM cards for overseas tourists and provides apps for users of those SIM cards. This system includes recommended sightseeing spots, itinerary planning, language and Japanese culture guides, local festival and event information, recommended shops and food guides, shopping guides, emergency contact and safety information, tourist information feedback, weather information, and communication between tourists. Specifically, tourists can obtain information about tourist spots and restaurants near their current location through the app. Real-time information on tourist spot congestion and weather is also provided. Furthermore, in emergencies, safety information is provided through the app, allowing tourists to take appropriate action quickly.

[0029] "Example 2"

[0030] Another aspect of the present invention is a system that can generate profits by providing services to tourists. Specifically, businesses such as tourist spots, restaurants, and shopping malls can post advertisements through the app. This allows businesses to effectively advertise to tourists, and tourists can obtain information that matches their interests.

[0031] "Example 3"

[0032] Furthermore, as an embodiment of the present invention, there is a system with functions to improve convenience for tourists. Specifically, tourists can obtain information such as the congestion status, waiting times, and opening hours of tourist spots through the app. In addition, ratings and reviews of tourist spots and restaurants can be shared, which can be helpful to other tourists. This allows tourists to enjoy sightseeing more efficiently.

[0033] The processing flow of each embodiment will be described below.

[0034] "Example 1"

[0035] Step 1: Tourists download the app and insert a prepaid SIM card.

[0036] Step 2: Tourists open the app and search for information on tourist attractions and restaurants near their current location.

[0037] Step 3: Real-time information about tourist attractions' congestion status and weather is displayed.

[0038] Step 4: In case of an emergency, safety information will be provided through the app and tourists will be able to take appropriate action promptly.

[0039] "Example 2"

[0040] Step 1: Tourist attractions, restaurants, shopping malls, and other businesses apply to advertise with the app administrator.

[0041] Step 2: The app administrator places the ad in the app.

[0042] Step 3: Tourists view advertisements through the app and use the business's services.

[0043] "Example 3"

[0044] Step 1: Tourists open the app and search for information such as tourist attraction congestion status, waiting times, and opening hours.

[0045] Step 2: Share your ratings and reviews of attractions and restaurants.

[0046] Step 3: Plan your trip by referring to the ratings and reviews of other tourists.

[0047] Example 1

[0048] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0049] Conventional tourist information systems have difficulty providing comprehensive information that tourists need, and language barriers and cultural differences have been particularly problematic for tourists from overseas. Furthermore, the provision of safety information in emergencies was insufficient, making it difficult for tourists to take appropriate action quickly. Furthermore, there was a lack of systems that provided real-time weather information and information on the congestion status of tourist spots, resulting in low convenience for tourists.

[0050] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0051] In this invention, the server includes a means for acquiring current location information, a means for providing information on tourist spots around the current location, a means for providing congestion status at tourist spots, a means for providing real-time weather information, and a means for notifying safety information in emergencies. This allows tourists to comprehensively receive the information they need, overcome language barriers and cultural differences, and take appropriate action quickly in emergencies. Furthermore, providing information on the congestion status of tourist spots and real-time weather information significantly improves convenience for tourists.

[0052] A "prepaid SIM for overseas tourists" is a communication card that tourists from overseas purchase in advance for use within Japan.

[0053] An "app" is a software program that runs on a mobile device such as a smartphone or tablet.

[0054] The "means for providing recommended tourist spots" is a function that suggests tourist spots that tourists should visit.

[0055] The "schedule planning means" is a function that provides information and tools for tourists to efficiently plan their travel itineraries.

[0056] "Language support measures" are translation and interpretation functions that make it easier for tourists to understand the local language.

[0057] "Cultural guide means" is a function that provides tourists with information about the culture and customs of the place they are visiting.

[0058] The "means for providing information on local festivals and events" is a function that provides tourists with information on festivals and events held in the destinations they visit.

[0059] "Recommended restaurants and food guide" is a function that introduces recommended restaurants and dishes to tourists at their destinations.

[0060] The "shopping guide means" is a function that provides tourists with information about shopping at the destination they are visiting.

[0061] "Emergency contact and safety information provision means" refers to functions that provide tourists with means to quickly contact each other in the event of an emergency and provide safety information.

[0062] "Tourist information feedback means" is a function that allows tourists to provide their opinions and evaluations of the tourist spots and services they visit.

[0063] The "weather information providing means" is a function that provides tourists with weather information about the destination.

[0064] "Means of communication between tourists" refers to a function that allows tourists to share information and communicate with each other.

[0065] "Means for obtaining current location information" is a function that obtains the tourist's current location using technology such as GPS.

[0066] The "means for providing information on tourist spots around the current location" is a function that provides information on tourist spots around the tourist's current location.

[0067] The "means for providing information on congestion status at tourist spots" is a function that provides tourists with real-time information on congestion status at tourist spots they are visiting.

[0068] The "real-time weather information providing means" is a function that provides tourists with real-time weather information about the destination.

[0069] "Emergency safety information notification means" is a function that quickly notifies tourists of safety information in emergencies such as earthquakes and typhoons.

[0070] This invention is a system that creates prepaid SIM cards for overseas tourists and provides apps for those who use those SIM cards. The system aims to comprehensively provide tourists with the information they need and improve the convenience and safety of their travels.

[0071] Hardware and software used

[0072] server

[0073] The server collects and provides information using databases, external APIs, and communication protocols. Specifically, it uses the following hardware and software:

[0074] Database management system: MySQL (registered trademark), PostgreSQL, etc.

[0075] External API: Google (registered trademark) Maps API, OpenWeatherMap API, Japan Meteorological Agency API, etc.

[0076] Communication protocol: HTTPS

[0077] Terminal

[0078] The device is a user's smartphone or tablet, and communicates with the server using GPS and an internet connection. Specifically, the device uses the following hardware and software:

[0079] GPS module: Built-in GPS function of the device

[0080] Internet connection: Wi-Fi, 4G / 5G

[0081] Applications: iOS app, ANDROID (registered trademark) app

[0082] Program processing

[0083] Server Processing

[0084] The server stores information about tourist attractions and restaurants in a database and provides appropriate information in response to user requests. Specifically, the server performs the following processes:

[0085] Information on tourist spot congestion and weather conditions is collected in real time and updated in the database.

[0086] Collects emergency safety information and notifies users.

[0087] Terminal handling

[0088] The device retrieves information from the server through the app and displays it to the user. Specifically, the device performs the following processes:

[0089] The system uses GPS to obtain your current location and displays information about nearby tourist attractions and restaurants.

[0090] Displays tourist spot congestion status and weather information in real time.

[0091] In case of an emergency, safety information is received from the server and notified to the user.

[0092] User operations

[0093] Through the app, users can:

[0094] Search for information on tourist attractions and restaurants near your current location.

[0095] Get information to plan your schedule.

[0096] In the event of an emergency, check safety information through the app and take appropriate action.

[0097] Specific examples

[0098] For example, if a user is visiting Tokyo for sightseeing, they can open the app and search for tourist spots near their current location. The app will display tourist spots such as Sensoji Temple and Tokyo Tower based on information obtained from the server. It also displays real-time information on the congestion status of tourist spots and weather information. Furthermore, in the event of an emergency, such as an earthquake or typhoon, safety information will be sent through the app.

[0099] Prompt Sentence Examples

[0100] "Generate prompts that allow a user visiting Tokyo to search for information on tourist attractions and restaurants near their current location, and check crowd and weather information in real time."

[0101] In this way, the system provides tourists with comprehensive information and supports a comfortable and safe journey.

[0102] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0103] Step 1:

[0104] The user launches the app.

[0105] A user launches an app by tapping it on the smartphone's home screen. When the app launches, the initial screen is displayed. The input is the user's operation, and the output is the initial screen of the app.

[0106] Step 2:

[0107] The device obtains your current location.

[0108] The device uses the GPS function to obtain the user's current location. Specifically, the device's location information service is enabled to obtain latitude and longitude data. The input is location information from the GPS, and the output is latitude and longitude data.

[0109] Step 3:

[0110] The device sends the current location information to the server.

[0111] The device sends the acquired location information to the server. The HTTPS protocol is used for transmission to ensure secure communication. The input is latitude and longitude data, and the output is a notification to the server that transmission is complete.

[0112] Step 4:

[0113] The server searches for information about tourist attractions and restaurants near the current location.

[0114] The server accesses the database and searches for information on tourist attractions and restaurants around the current location. Search results include the spot name, address, business hours, ratings, etc. The input is latitude and longitude data, and the output is information on tourist attractions and restaurants.

[0115] Step 5:

[0116] The server collects information on tourist spot congestion and weather.

[0117] The server uses external APIs to collect real-time information about tourist spot congestion and weather. For example, it uses the Google Maps API or OpenWeatherMap API. The input is the tourist spot ID and location information, and the output is congestion and weather information.

[0118] Step 6:

[0119] The server sends the collected information to the terminal.

[0120] The server sends the collected information about tourist spots and restaurants, their congestion status, and weather information to the device. Data is sent in JSON format. The input is information about tourist spots and restaurants, their congestion status, and weather information, and the output is a notification to the device that transmission has been completed.

[0121] Step 7:

[0122] The terminal displays the received information to the user.

[0123] The device analyzes the received information and displays it to the user. Specifically, it displays a list of tourist attractions and restaurants on the screen, and indicates congestion status and weather information using icons and text. The input is JSON data received from the server, and the output is the information displayed to the user.

[0124] Step 8:

[0125] The user checks out detailed information about attractions and restaurants.

[0126] Users can tap on attractions or restaurants of their choice from the displayed list to view detailed information, including photos, reviews, and access information. The input is the user's tap action, and the output is the display of detailed information.

[0127] Step 9:

[0128] In an emergency, the server collects safety information and sends it to the terminal.

[0129] In the event of an emergency, the server collects safety information such as earthquakes and typhoons and sends it to the terminal. The collection is done using APIs from the Japan Meteorological Agency and the Disaster Prevention Information Center. The input is emergency trigger information, and the output is safety information.

[0130] Step 10:

[0131] The terminal notifies the user of safety information.

[0132] The device notifies the user of the received safety information. The push notification function is used for notifications, and highly urgent information is immediately conveyed to the user. The input is the safety information received from the server, and the output is the notification to the user.

[0133] (Application example 1)

[0134] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0135] Conventional tourist applications only provide basic information such as tourist information and cultural guides, and do not provide enough information on shopping at physical stores, local events, or safety information. This makes it difficult for tourists to smoothly shop, participate in events, and take safety measures at local stores. In addition, the lack of real-time information on crowding and sales makes it less convenient for tourists.

[0136] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0137] In this invention, the server includes a means for providing store information around the current location, a means for providing store congestion status, a means for providing sale information, a means for providing safety information, and a means for providing local event information, which allows tourists to obtain store information, congestion status, sale information, safety information, and event information in real time.

[0138] A "prepaid SIM for overseas tourists" is a communication card that tourists from overseas purchase in advance for use in Japan.

[0139] "Recommended tourist spots" is information about tourist destinations and famous places that are recommended for tourists to visit.

[0140] The "schedule planning means" is a support function for tourists to efficiently plan their travel itineraries.

[0141] "Language and Japanese culture guide means" is a function that provides information to help tourists learn about Japanese language and culture.

[0142] The "local festival and event information means" is a function that provides information on festivals and events held in areas visited by tourists.

[0143] "Recommended restaurants and food guide" is a function that provides information on restaurants and food that are recommended for tourists to visit.

[0144] "Shopping guide means" is a function that provides information to help tourists enjoy shopping.

[0145] "Emergency contact and safety information means" is a function that provides tourists with means to contact others in an emergency and information on safety.

[0146] "Tourism information feedback means" is a function that allows tourists to provide feedback about the places they have visited and their experiences.

[0147] "Weather information means" is a function that provides weather information for the area that tourists visit.

[0148] "Means of communication between tourists" refers to a function that allows tourists to share information and communicate with each other.

[0149] The "means for providing information about stores around the current location" is a function that provides information about stores around the tourist's current location.

[0150] The "means for providing information on store congestion status" is a function that provides real-time information on the congestion status of stores that tourists are planning to visit.

[0151] The "bargain information providing means" is a function that provides information on bargains and sales being held at stores visited by tourists.

[0152] "Safety information provision means" is a function that provides information to tourists to help them enjoy their trip safely.

[0153] The "local event information providing means" is a function that provides information on events held in areas visited by tourists.

[0154] The system for carrying out the present invention provides an application that uses a prepaid SIM card for tourists. A specific embodiment of this system will be described below.

[0155] System Configuration

[0156] This system is composed of a server, the user's smartphone, and various APIs. The server manages tourist information, store information, weather information, safety information, event information, etc., and provides this information to the user's smartphone. A dedicated application is installed on the user's smartphone, and various information is obtained through this.

[0157] Hardware and software used

[0158] Hardware: Smartphone

[0159] Software: Python (registered trademark), Google Maps API, OpenWeatherMap API

[0160] Data processing and calculation

[0161] The server processes and calculates the data using the following means:

[0162] 1. Methods for providing store information around your current location:

[0163] The server uses the Google Maps API to obtain store information around the user's current location and provides it to the smartphone, allowing the user to easily find nearby stores.

[0164] 2. Store congestion information provided by:

[0165] The server obtains the store's congestion status in real time and provides it to the user, allowing the user to avoid crowds and enjoy shopping efficiently.

[0166] 3. Special Offer Information Delivery Methods:

[0167] The server collects sale information and provides it to the user, thereby enabling the user to make good purchases.

[0168] 4. Safety information provision means:

[0169] The server collects safety information and provides it to users in case of an emergency, allowing them to take appropriate action quickly.

[0170] 5. Local event information sources:

[0171] The server collects information about events held in the area and provides it to the user, allowing the user to find events that they can participate in while traveling.

[0172] Specific examples

[0173] For example, if a tourist in Tokyo uses this app, the user opens the app and checks recommended stores and product information around their current location. Real-time weather and local event information is also provided. In the event of an emergency, safety information is provided, allowing the user to take appropriate action quickly.

[0174] Prompt Sentence Examples

[0175] Create a guide app for tourists in Tokyo. This app will provide real-time information on recommended shops and products around the current location, weather information, local event information, and safety information. The APIs used are Google Maps API and OpenWeatherMap API.

[0176] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0177] Step 1:

[0178] The user launches the app and obtains their current location.

[0179] Input: GPS data from the user's smartphone

[0180] Output: Latitude and longitude information of current location

[0181] Specific operation: The user's smartphone uses the GPS sensor to obtain the latitude and longitude of their current location and sends it to the app.

[0182] Step 2:

[0183] The server obtains store information around the current location.

[0184] Input: Latitude and longitude information of current location

[0185] Output: Information about nearby stores (store name, address, business hours, etc.)

[0186] Specific operation: The server uses the Google Maps API to obtain information about nearby stores based on the latitude and longitude of the current location and sends it to the user's smartphone.

[0187] Step 3:

[0188] The server acquires the store's congestion status.

[0189] Input: Nearby store information

[0190] Output: Congestion status of each store (level of congestion, waiting time, etc.)

[0191] Specific operation: The server refers to data sources (e.g., store sensor information and user check-in data) to obtain the congestion status of each store in real time, calculates the congestion status, and sends it to the user's smartphone.

[0192] Step 4:

[0193] The server retrieves the sale information.

[0194] Input: Nearby store information

[0195] Output: Special sale information for each store (discounted items, sale period, etc.)

[0196] Specific operation: The server refers to a data source (e.g., the store's official website or advertising data) for collecting sale information from each store, obtains the sale information, and sends it to the user's smartphone.

[0197] Step 5:

[0198] The server retrieves weather information.

[0199] Input: Latitude and longitude information of current location

[0200] Output: Current location weather information (temperature, precipitation probability, etc.)

[0201] Specific operation: The server uses the OpenWeatherMap API to obtain weather information based on the latitude and longitude of the current location and sends it to the user's smartphone.

[0202] Step 6:

[0203] The server retrieves the safety information.

[0204] Input: Latitude and longitude information of current location

[0205] Output: Current location safety information (evacuation locations, emergency contacts, etc.)

[0206] Specific operation: The server refers to a data source for providing safety information (e.g., a government disaster prevention information site or a local safety information database), obtains the safety information, and sends it to the user's smartphone.

[0207] Step 7:

[0208] The server retrieves local event information.

[0209] Input: Latitude and longitude information of current location

[0210] Output: Local event information (event name, location, date and time, etc.)

[0211] Specific operation: The server refers to a data source that provides local event information (for example, a local tourist association website or an event information website), obtains the event information, and sends it to the user's smartphone.

[0212] Step 8:

[0213] Users can check various information through the app.

[0214] Input: Store information, crowding status, sale information, weather information, safety information, event information sent from the server

[0215] Output: Various information displayed on the user's smartphone

[0216] Specific operation: The user's smartphone receives various information sent from the server and displays it on the app interface. The user can then check this information and adjust their travel plans and activities.

[0217] Example 2

[0218] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0219] Conventional tourist service systems have limited the means by which tourist destinations, restaurants, shopping malls, and other businesses can effectively advertise, making it difficult for tourists to obtain information that matches their interests. Another problem is that the systems do not adequately provide functions to improve convenience for tourists.

[0220] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for receiving advertisement data, a means for saving the advertisement data in a database, a means for receiving a request from a user, a means for searching the database for advertisement data, a means for transmitting the search results to the user terminal, and a means for displaying the advertisement data on the user terminal. This allows businesses to effectively post advertisements and tourists to easily obtain information that matches their interests.

[0221] "Advertising data" refers to data that includes information about products and services offered by businesses.

[0222] A "database" is a system for systematically storing, searching, and managing advertising data.

[0223] A "user request" is a request containing search keywords and conditions sent by a user through an app.

[0224] "Server" means a computer system for receiving, storing, retrieving, and transmitting advertising data.

[0225] A "user terminal" is a device on which a user uses an app, and includes smartphones, tablets, etc.

[0226] "Search results" are a list of advertising data retrieved from a database based on a user request.

[0227] The "display means" is a function for visually displaying advertisement data on a user terminal.

[0228] MODE FOR CARRYING OUT THE INVENTION

[0229] This invention is a system that generates profits by providing services to tourists. Specifically, it is a system that allows businesses such as tourist spots, restaurants, and shopping malls to post advertisements through an app. This allows businesses to effectively advertise to tourists, and tourists to obtain information that matches their interests.

[0230] Hardware and software used

[0231] Server: Use a high-performance server machine and use Apache (registered trademark) or Nginx as web server software.

[0232] Database: Use a relational database such as MySQL or PostgreSQL.

[0233] Device: Smartphone or tablet, using native iOS or Android applications.

[0234] Program processing

[0235] 1. Registering advertising data

[0236] The server receives the advertising data sent by the business, who inputs information such as the advertising content, images, and link URL.

[0237] The server stores the received advertising data in a database, using a relational database such as MySQL or PostgreSQL.

[0238] The server checks the integrity of the data and converts the format of the data if necessary.

[0239] Specific working example:

[0240] When a business registers an advertisement for a "Kyoto restaurant," they enter the advertisement title, description, image URL, and destination URL.

[0241] The server receives this data and stores it in a database.

[0242] 2. Submitting a User Request

[0243] The user launches the app on their smartphone or tablet.

[0244] Users enter keywords of interest into the app's search bar, for example, "Kyoto restaurants."

[0245] The device sends the keyword entered by the user to the server, and the request may also include the user's location and device information.

[0246] Specific working example:

[0247] A user launches the app and types "Kyoto restaurants" into the search bar.

[0248] The terminal sends the search keywords to the server.

[0249] 3. Searching for advertising data

[0250] The server analyzes the request received from the user.

[0251] The server searches its database for advertising data that matches the request, using an SQL query.

[0252] The server formats the search results in a list.

[0253] Specific working example:

[0254] The server searches the database using the keyword "Kyoto restaurant" to retrieve relevant advertising data.

[0255] The server formats the acquired advertising data into a list format.

[0256] 4. Transmission of advertising data

[0257] The server then sends the formatted ad data to the device, often in JSON format.

[0258] The server may compress and / or encrypt the data before sending it.

[0259] Specific working example:

[0260] The server sends the formatted advertising data in JSON format to the terminal.

[0261] Compress and encrypt the data as needed.

[0262] 5. Display of advertising data

[0263] The terminal analyzes the advertisement data received from the server.

[0264] The device displays the analyzed data in a user interface using UI components such as list views and card views.

[0265] Users can tap on the displayed advertisement to view more information or access the operator's website.

[0266] Specific working example:

[0267] The device analyzes the received advertising data and displays it in a list view.

[0268] When users tap on an ad that interests them, they will be shown more information or taken to the operator's website.

[0269] Prompt Sentence Examples

[0270] An example of a prompt sentence to input to the generative AI model is as follows:

[0271] "Imagine a tourist visiting Kyoto. If the user opens the app and searches for 'Kyoto restaurants,' what kind of ads will be displayed?"

[0272] Using this prompt, the generative AI model can explain the flow of ad display based on a specific scenario.

[0273] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0274] Step 1: Register advertising data

[0275] Input: The business enters information such as advertising content, images, and destination URL.

[0276] The server receives the advertisement data sent from the business operator.

[0277] Data processing: The server checks the integrity of the received advertising data and converts the data format if necessary.

[0278] Output: Consistency checked ad data is generated.

[0279] Specific operation: When a business registers an advertisement for "Restaurants in Kyoto," it inputs the advertisement title, description, image URL, and destination URL. The server receives this data and stores it in a database.

[0280] Step 2: Submitting a User Request

[0281] Input: A user types a keyword of interest into the app's search bar.

[0282] The device sends the keyword entered by the user to the server, and the request may also include the user's location and device information.

[0283] Data processing: The terminal converts the user's input data into an appropriate format and sends it to the server.

[0284] Output: A search request is generated that is sent to the server.

[0285] Specific operation: The user launches the app and enters "Kyoto restaurants" in the search bar. The device sends this search keyword to the server.

[0286] Step 3: Finding advertising data

[0287] Input: The search request the server receives from the user.

[0288] The server analyzes the request received from the user.

[0289] Data processing: The server searches the database for advertising data that matches the request, using an SQL query.

[0290] Output: A list of ad data is generated as a search result.

[0291] Specific operation: The server searches the database for the keyword "Kyoto restaurant" to obtain relevant advertising data, and then formats the obtained advertising data into a list.

[0292] Step 4: Send advertising data

[0293] Input: Server formatted list of ad data.

[0294] The server then sends the formatted ad data to the device, often in JSON format.

[0295] Data processing: The server may compress or encrypt the data before sending it.

[0296] Output: Advertising data sent to the device is generated.

[0297] Specific operation: The server sends the formatted ad data in JSON format to the device, compressing and encrypting the data as needed.

[0298] Step 5: View your advertising data

[0299] Input: Advertising data received by the device from the server.

[0300] The terminal analyzes the advertisement data received from the server.

[0301] Data processing: The device displays the analyzed data in a user interface using UI components such as list views and card views.

[0302] Output: Advertising data is generated that is displayed to the user.

[0303] Specific operation: The device analyzes the received advertising data and displays it in a list view. When the user taps on an advertisement that interests them, they can view more information or be redirected to the operator's website.

[0304] (Application example 2)

[0305] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0306] There is a lack of effective ways to provide information about tourist attractions, restaurants, shopping malls, etc., and for businesses to advertise to tourists efficiently. Another issue is that it is difficult for tourists to obtain information customized based on their interests and current location.

[0307] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for providing recommended sightseeing spots and itinerary plans, a language and culture guide means, a means for providing local festival and event information, a means for providing recommended stores and food guides, a shopping guide means, a means for contacting tourists in emergencies and safety information, a means for providing tourist information feedback, a weather information means, a means for communicating between tourists, a means for providing customized advertisements using a generative AI model, and a means for providing information based on the user's interests and current location. This allows tourists to obtain information customized based on their interests and current location, and enables businesses to efficiently post advertisements to tourists.

[0308] A "prepaid communication module for overseas tourists" is a means of communication that tourists from overseas can use by paying a fee in advance.

[0309] "Recommended tourist spots" refers to information about tourist destinations and famous places that are recommended to tourists as being worth visiting.

[0310] The "schedule plan providing means" is a function that provides schedules and plans for tourists to enjoy sightseeing efficiently.

[0311] "Language and cultural guide means" is a function that provides information about the language and culture of the country or region that tourists visit.

[0312] The "local festival and event information means" is a function that provides information on festivals and events held in areas visited by tourists.

[0313] The "recommended store and food guide" is a function that provides tourists with information about stores and dishes that are recommended as being worth visiting.

[0314] The "shopping guide means" is a function that provides information about shopping in areas visited by tourists.

[0315] "Emergency contact and safety information means" is a function that provides tourists with contact means and safety information in the event of an emergency.

[0316] "Tourism information feedback means" is a function that allows tourists to provide their opinions and evaluations of the places they visit and the services they experience.

[0317] The "weather information means" is a function that provides information about the weather in the area that tourists visit.

[0318] "Means of communication between tourists" are means by which tourists share information and communicate with each other.

[0319] "Means for providing customized advertisements using generative AI models" refers to a function that uses generative AI models to provide customized advertisements based on tourists' interests and behavioral history.

[0320] "Means of providing information based on user interests and current location" is a function that provides relevant information based on tourists' interests and current location.

[0321] As an embodiment of this invention, we will build a service provision system for tourists. The system is realized using a smartphone application, a back-end server, a database, and a generative AI model.

[0322] Hardware and software used

[0323] Hardware: Smartphone (iOS or Android)

[0324] Software: Mobile application development frameworks (e.g., Flutter®), backend servers (e.g., Node.js, Django), databases (e.g., MySQL), generative AI models (e.g., GPT-4®)

[0325] System configuration

[0326] 1. User Registration and Profile Settings:

[0327] Users download the smartphone app and register, selecting categories of interest (tourist attractions, restaurants, shopping malls, etc.).

[0328] Use the smartphone's GPS function to obtain the user's current location information.

[0329] 2. Advertising:

[0330] Businesses can place advertisements through the app, which can consist of text, images, videos, etc.

[0331] Advertisements are displayed based on the interests and location of the businesses' target users.

[0332] 3. Leveraging generative AI models:

[0333] It uses generative AI models (such as GPT-4) to generate customized ads and information based on users' interests and behavioral history.

[0334] For example, if a user searches for "recommended tourist spots," the generative AI model will provide information on "recommended tourist spots" and "popular restaurants."

[0335] 4. Data processing and calculation:

[0336] Collects user behavior data (search history, click history, etc.) and stores it in a database.

[0337] Analyze the collected data and optimize advertising based on users' interests.

[0338] Specific examples

[0339] User scenario: A user visits a tourist spot and opens the app. The app obtains the user's current location and displays advertisements for nearby tourist spots and restaurants. When the user searches for "recommended tourist spots," the generative AI model provides information on "recommended tourist spots" and "popular restaurants."

[0340] Prompt Sentence Examples

[0341] Prompt: "What are some recommended tourist spots?"

[0342] In this way, a system can be realized that can generate profits by providing services to tourists.

[0343] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0344] Step 1:

[0345] A user downloads a smartphone app and registers an account. As input, they provide basic user information (such as name, email address, and interest categories). As output, the user profile is stored in a database. Specifically, when a user enters information into the app's registration form and presses the submit button, the server receives the information and stores it in the database.

[0346] Step 2:

[0347] The device uses its GPS function to obtain the user's current location information. The user's location information is required as input. The current location information is displayed in the app as output. Specifically, the app periodically obtains GPS data and sends it to the server.

[0348] Step 3:

[0349] Businesses place advertisements through the app. As input, they provide the advertisement content (text, images, videos, etc.). As output, the advertisement is saved in the database and displayed to the user. Specifically, the business uploads the advertisement from the advertisement management screen, and the server saves the advertisement in the database.

[0350] Step 4:

[0351] The server uses a generative AI model to generate customized advertisements and information based on the user's interests and behavioral history. User behavioral data (search history, click history, etc.) is used as input. Customized advertisements and information are generated as output. Specifically, the server analyzes the user's behavioral data and inputs prompt statements into the generative AI model to generate customized advertisements and information.

[0352] Step 5:

[0353] The server provides the generated advertisements and information to the user. As input, it uses the output data from the generative AI model. As output, the customized advertisements and information are displayed on the user's smartphone. Specifically, the server sends the generated advertisements and information to the user's app, which then displays them.

[0354] Step 6:

[0355] Users provide feedback on tourist information through the app. As input, they provide their feedback (text, rating, etc.). As output, the feedback is stored in the database. Specifically, when a user enters information into the feedback form and presses the submit button, the server receives the information and stores it in the database.

[0356] Step 7:

[0357] The server analyzes user behavior data and optimizes advertisements. It uses user behavior data as input and generates optimized advertisements as output. Specifically, the server retrieves user behavior data from the database and uses an analytical algorithm to optimize advertisements.

[0358] Step 8:

[0359] The device provides users with weather information, emergency contact information, and safety information. Weather data and safety information data are used as input. As output, this information is displayed on the user's smartphone. Specifically, the app periodically retrieves weather and safety information from the server and notifies the user.

[0360] Example 3

[0361] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0362] Conventional tourist information systems lack the functionality to provide real-time information such as tourist attraction congestion, waiting times, and opening hours, making it difficult for tourists to enjoy sightseeing efficiently. Furthermore, they have limited functionality for sharing ratings and reviews of tourist attractions and restaurants, making it difficult for tourists to refer to the opinions of other tourists. Furthermore, they lack the functionality to quickly provide information in response to user requests and to store ratings and reviews in a database, reducing convenience for tourists.

[0363] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0364] In this invention, the server includes means for providing information such as the congestion status, waiting times, and opening hours of tourist attractions, means for sharing ratings and reviews of tourist attractions and restaurants, means for receiving user requests and retrieving information from a database to respond, and means for saving user ratings and reviews in the database. This allows tourists to obtain information about tourist attractions in real time and refer to the ratings and reviews of other tourists, allowing them to enjoy sightseeing efficiently.

[0365] "Recommended tourist spots" refer to tourist destinations and famous places that are considered to be worth visiting for tourists.

[0366] "Schedule planning means" refers to a function that allows tourists to plan the places and times they will visit in order to enjoy sightseeing efficiently.

[0367] "Language and cultural guide means" refers to the function of providing information about the language and culture of the region tourists visit.

[0368] "Local festival and event information means" refers to the function of providing information about festivals and events held in areas visited by tourists.

[0369] "Recommended restaurants and food guide" refers to a function that introduces restaurants and dishes that are considered worth visiting to tourists.

[0370] "Shopping guide means" refers to the function of introducing tourists to shopping spots and products that are considered worth visiting.

[0371] "Emergency communication and safety information means" refers to functions that provide tourists with means to contact each other in an emergency and safety information.

[0372] "Tourism information feedback means" refers to the function of providing evaluations and opinions about tourist attractions and services that tourists have visited.

[0373] "Weather information means" refers to the function of providing weather information for areas visited by tourists.

[0374] "Means of communication between tourists" refers to functions that allow tourists to exchange information and communicate with each other.

[0375] "Means of providing information such as the current congestion situation, waiting times, and opening hours of tourist spots" refers to the function of providing tourists with information about the current congestion situation, waiting times, and opening hours of tourist spots they visit.

[0376] "Means for sharing ratings and reviews of tourist spots and restaurants" refers to a function that allows tourists to share ratings and reviews of tourist spots and restaurants they have visited with other tourists.

[0377] "Means for receiving a user request, retrieving information from a database, and responding" refers to a function for receiving an information request from a user, retrieving the necessary information from a database, and responding to the user.

[0378] "Means for saving user ratings and reviews in a database" refers to a function that saves ratings and reviews provided by users in a database and allows other users to refer to that information.

[0379] This invention is a system for improving convenience for tourists, and has the function of providing information such as the congestion status, waiting times, and opening hours of tourist spots. It also has the function of sharing ratings and reviews of tourist spots and restaurants. This system operates in cooperation with three parties: a server, a terminal, and a user.

[0380] Hardware and Software Configuration

[0381] 1. Server:

[0382] The server collects data such as tourist attraction congestion, waiting times, and opening times, and stores it in a database. Specifically, the data is collected and stored using a cloud service.

[0383] The server receives a request from the user and retrieves the necessary data from the database and responds. For example, if a user wants to know the congestion status of a particular tourist spot, the server retrieves that information from the database and provides it to the user.

[0384] 2. Device (user's smartphone or tablet):

[0385] The device provides an interface for users to search for information about tourist spots and post reviews through apps, specifically iOS and Android applications.

[0386] The device sends the user's request to the server and displays the data returned by the server. For example, if a user searches for the congestion status of a tourist spot, the device requests that information from the server and displays the returned data on the screen.

[0387] 3. User:

[0388] Through the app, users can obtain information about tourist spots, such as crowding levels, waiting times, and opening times. For example, if a user wants to know the "crowd situation at tourist spot A," they open the app and search.

[0389] Users can post ratings and reviews of tourist spots and restaurants and share information with other tourists. For example, a user can rate a restaurant they visited on a five-star scale and post a comment.

[0390] Specific examples

[0391] As a concrete example, the prompt sentence when the user wants to know "the congestion situation at tourist spot A" is shown below.

[0392] Example prompt sentence:

[0393] The user opens the app and searches for "Crowding status of tourist spot A." The device sends this request to the server, which retrieves the latest congestion status from the database and returns it to the device. The device then displays this information to the user.

[0394] This system allows tourists to obtain information about tourist spots in real time, allowing them to enjoy sightseeing efficiently. For example, if a user wants to know the "crowding situation at tourist spot A," they can obtain the latest information simply by opening the app and searching. In addition, users can share ratings and reviews of the tourist spots and restaurants they have visited with other tourists, allowing them to refer to the opinions of other tourists. The flow of the identification process in Example 3 will be described with reference to FIG. 15.

[0395] Step 1:

[0396] The user launches the app and searches for information about tourist spots.

[0397] Input: A user types "crowding status of tourist spot A" into the app's search bar.

[0398] Specific operation: The user launches the app on their smartphone or tablet and enters "crowding status of tourist spot A" in the search bar.

[0399] Step 2:

[0400] The terminal sends the user's request to the server.

[0401] Input: User's search keyword "Crowding status of tourist spot A."

[0402] Output: The HTTP request sent to the server.

[0403] How it works: The device receives user input and sends it to the server as an HTTP request, which includes search keywords, the user's location, and other information.

[0404] Step 3:

[0405] The server retrieves the necessary information from the database.

[0406] Input: The HTTP request sent from the device.

[0407] Output: Crowd data for tourist spot A retrieved from the database.

[0408] Specific operation: The server analyzes the received request and retrieves the latest data on "the congestion status of tourist spot A" from the database. The database stores information such as the tourist spot's congestion status, waiting time, and opening hours.

[0409] Step 4:

[0410] The server returns the acquired information to the terminal.

[0411] Input: Crowd data for tourist spot A retrieved from the database.

[0412] Output: The HTTP response sent back to the device.

[0413] Specific operation: The server converts the acquired data into JSON format and returns it to the terminal as an HTTP response.

[0414] Step 5:

[0415] The terminal displays the received information to the user.

[0416] Input: JSON data returned by the server.

[0417] Output: Crowd status information for tourist spot A displayed to the user.

[0418] Specific operation: The device parses the received JSON data and displays it on the screen in a format that is easy for the user to read. For example, it might say, "The current congestion situation at tourist spot A is medium. The waiting time is approximately 15 minutes."

[0419] Step 6:

[0420] Users post ratings and reviews of tourist attractions and restaurants.

[0421] Input: User-entered ratings and reviews.

[0422] Output: Rating and review data sent to device.

[0423] Specific behavior: The user enters ratings and reviews for the tourist spots and restaurants they visited within the app. For example, they enter a comment such as, "The view from the observation deck at tourist spot A was amazing. Five stars!"

[0424] Step 7:

[0425] The device sends the user's post to the server.

[0426] Input: Rating and review data entered by users.

[0427] Output: The HTTP request sent to the server.

[0428] What happens: The device sends the user's rating and review to the server as an HTTP request, which includes the rating star rating, comments, user ID, etc.

[0429] Step 8:

[0430] The server stores the posts in a database.

[0431] Input: Rating and review data submitted by the device.

[0432] Output: Ratings and reviews stored in a database.

[0433] What it does: The server stores the ratings and reviews it receives in a database, so that other users can refer to them.

[0434] (Application example 3)

[0435] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0436] Conventional tourist information systems have difficulty providing real-time information such as tourist attraction congestion, waiting times, and opening hours, making it difficult for tourists to enjoy sightseeing efficiently. Another issue is that they lack the functionality to share ratings and reviews of tourist attractions and restaurants, making it difficult for tourists to refer to the opinions of other tourists.

[0437] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes a means for displaying the congestion status of tourist spots, a means for predicting waiting times, a means for sharing opening hours, a means for sharing ratings and reviews, and a means for proposing recommended routes. This allows tourists to obtain information such as the congestion status, waiting times, and opening hours of tourist spots in real time, enabling them to enjoy sightseeing efficiently while referring to the ratings and reviews of other tourists.

[0438] A "prepaid communication module for overseas tourists" is a communication module that tourists visiting from overseas purchase in advance to use communication services in their local area.

[0439] An "application" is software that runs on devices such as smartphones and tablets and provides specific functions and services to users.

[0440] "Recommended tourist spots" are tourist spots that are recommended to tourists as being worth visiting.

[0441] The "schedule planning means" is a function that allows tourists to plan the places and times to visit in order to enjoy sightseeing efficiently.

[0442] "Language and Japanese Culture Guide" is a function that provides information to help tourists deepen their understanding of Japanese language and culture.

[0443] The "local festival and event information means" is a function that provides information on festivals and events held in areas visited by tourists.

[0444] The "recommended store and food guide" is a function that provides tourists with information about stores and dishes that are recommended as being worth visiting.

[0445] The "shopping guide means" is a function that provides information about shopping in areas visited by tourists.

[0446] "Emergency contact and safety information means" is a function that provides tourists with information to contact in an emergency and safety information.

[0447] "Tourism information feedback means" is a function that allows tourists to share their evaluations and opinions about the tourist spots and services they visit.

[0448] "Weather information means" is a function that provides weather information for the area that tourists visit.

[0449] "Means of communication between tourists" refers to a function that allows tourists to exchange information and communicate with each other.

[0450] The "means for displaying the congestion status of tourist spots" is a function that displays the current congestion status of tourist spots in real time.

[0451] The "waiting time prediction means" is a function that predicts waiting times at tourist spots and notifies users.

[0452] The "opening hours information means" is a function that displays the opening hours of tourist spots and stores.

[0453] "Rating and review sharing tool" is a function that allows users to post and view ratings and reviews of tourist spots and stores.

[0454] The "recommended route suggestion method" is a function that suggests recommended sightseeing routes taking into account congestion and waiting times.

[0455] As an embodiment of the present invention, an information providing system for tourists is constructed. The system is composed of a server, a user terminal (such as a smartphone), and a communication module.

[0456] System configuration

[0457] 1. Server:

[0458] The server includes a means for displaying the congestion status of tourist spots, a means for predicting waiting times, a means for providing information on opening hours, a means for sharing ratings and reviews, and a means for suggesting recommended routes.

[0459] The server collects real-time data on tourist attractions and provides it to the user terminal.

[0460] The server collects ratings and reviews from users and shares them with other users.

[0461] 2. User Device:

[0462] The user terminal is a device such as a smartphone or tablet, on which a dedicated application is installed.

[0463] The user terminal receives the information provided by the server and displays it to the user.

[0464] The user terminal transmits input from the user (ratings and reviews) to the server.

[0465] 3. Communication module:

[0466] The communication module is a prepaid communication module that tourists from overseas purchase in advance to use communication services in their local area.

[0467] The communication module supports communication between the user terminal and the server.

[0468] Data processing and calculation

[0469] Displaying the congestion status of tourist spots:

[0470] The server collects real-time data from tourist spots and analyzes congestion levels.

[0471] The analysis results are sent to the user terminal and displayed to the user.

[0472] Wait time prediction methods:

[0473] The server predicts waiting times at tourist attractions based on past data and current conditions.

[0474] The prediction result is transmitted to the user terminal and notified to the user.

[0475] Opening hours information means:

[0476] The server retrieves information about the opening hours of tourist spots and stores from the database and transmits it to the user terminal.

[0477] The user terminal displays the open time information to the user.

[0478] Rate and share your review via:

[0479] The server collects ratings and reviews from users and stores them in a database.

[0480] The server sends this information to the user's terminal so that other users can view the ratings and reviews.

[0481] Route suggestions by:

[0482] The server proposes the most suitable sightseeing route to the user, taking into consideration the congestion situation and waiting time.

[0483] The proposed route is transmitted to the user terminal and displayed to the user.

[0484] Specific examples

[0485] For example, if a user wants to know the congestion status of "Tokyo Tower," they can enter the "Tokyo Tower" ID into the application. The server will analyze the congestion status in real time and send the results to the user's device. The user's device will then display information such as the congestion status, waiting time, and opening hours.

[0486] Example prompt sentence:

[0487] "Please enter the tourist spot ID: Tokyo Tower"

[0488] In this way, tourists can obtain information about tourist spots in real time and enjoy sightseeing efficiently.

[0489] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0490] Step 1:

[0491] The user enters the tourist spot ID into the application. The entered ID is sent from the user's device to the server. The input data is the tourist spot ID, and the output is a request to the server.

[0492] Step 2:

[0493] The server retrieves real-time data of the tourist spot from the database based on the received tourist spot ID. The input data is the tourist spot ID, and the output is the real-time data of the tourist spot.

[0494] Step 3:

[0495] The server analyzes the acquired real-time data and calculates the current congestion status of the tourist spot. The input data is the real-time data of the tourist spot, and the output is the analysis result of the congestion status.

[0496] Step 4:

[0497] The server predicts waiting times at tourist attractions based on past data and current conditions. The input data is real-time and past data for tourist attractions, and the output is the predicted waiting time.

[0498] Step 5:

[0499] The server retrieves the opening hours of tourist attractions and stores from the database. The input data is the tourist attraction ID, and the output is the opening hours.

[0500] Step 6:

[0501] The server collects ratings and reviews from users and stores them in a database. The input data are user ratings and reviews, and the output is the results stored in the database.

[0502] Step 7:

[0503] The server proposes the optimal sightseeing route to the user, taking into account congestion and waiting times. The input data are the analysis results of congestion and predicted waiting times, and the output is the proposed recommended route.

[0504] Step 8:

[0505] The server sends the analysis results, prediction results, opening hours information, and recommended routes to the user's terminal. The input data are the analysis results, prediction results, opening hours information, and recommended routes, and the output is the data sent to the user's terminal.

[0506] Step 9:

[0507] The user terminal displays the received data to the user. The input data is the data sent from the server, and the output is the information displayed to the user.

[0508] Step 10:

[0509] The user visits tourist spots based on the displayed information. The input data is the information displayed on the user's device, and the output is the user's behavior.

[0510] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0511] "Example 1"

[0512] One embodiment of the present invention is a system incorporating an emotion engine. This system recognizes the emotions of tourists when they use an app and provides services accordingly. Specifically, when a tourist opens the app and searches for information on tourist attractions or restaurants, the emotion engine recognizes the tourist's emotions. For example, if a tourist expresses joy, the emotion engine collects that information and prioritizes displaying information on tourist attractions and restaurants related to joy. Also, if a tourist expresses anxiety, the emotion engine collects that information and prioritizes displaying information such as safety information and emergency contact information. This allows tourists to obtain information that corresponds to their emotions, resulting in a more comfortable sightseeing experience. "Example 2"

[0513] Another embodiment of the present invention is a system incorporating an emotion engine. This system recognizes the emotions of tourists when they use an app and displays advertisements that correspond to their emotions. Specifically, when a tourist opens the app and searches for information on tourist attractions or restaurants, the emotion engine recognizes the tourist's emotions. For example, if the tourist expresses excitement, the emotion engine collects that information and preferentially displays advertisements for tourist attractions and restaurants related to that excitement. This allows tourists to see advertisements that correspond to their emotions and are more likely to find them interesting.

[0514] "Example 3"

[0515] Furthermore, another embodiment of the present invention is a system that incorporates an emotion engine. This system recognizes the emotions of tourists when they use an app and provides communication that corresponds to their emotions. Specifically, when a tourist opens the app and communicates with other tourists, the emotion engine recognizes the tourist's emotions. For example, if a tourist expresses an emotion of enjoyment, the emotion engine collects that information and provides topics about tourist spots and restaurants related to the enjoyment. This allows tourists to enjoy communication that corresponds to their emotions.

[0516] The processing flow of each embodiment will be described below.

[0517] "Example 1"

[0518] Step 1: The tourist opens the app.

[0519] Step 2: Tourists search for information about tourist attractions and restaurants.

[0520] Step 3: The emotion engine recognizes the tourist's emotions.

[0521] Step 4: Based on the information collected by the emotion engine, information that corresponds to the tourist's emotions is displayed preferentially.

[0522] "Example 2"

[0523] Step 1: The tourist opens the app.

[0524] Step 2: Tourists search for information about tourist attractions and restaurants.

[0525] Step 3: The emotion engine recognizes the tourist's emotions.

[0526] Step 4: Based on the information collected by the emotion engine, advertisements that correspond to the tourist's emotions are displayed preferentially.

[0527] "Example 3"

[0528] Step 1: The tourist opens the app.

[0529] Step 2: Tourists communicate with other tourists.

[0530] Step 3: The emotion engine recognizes the tourist's emotions.

[0531] Step 4: Based on the information collected by the emotion engine, provide topics that correspond to the tourist's emotions.

[0532] Example 1

[0533] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0534] Conventional tourist information systems have difficulty providing tourists with the information they need, with language barriers and cultural differences being particularly problematic for international tourists. Furthermore, information provided was not tailored to the tourists' needs, which could result in a decline in the quality of their tourist experience. Furthermore, emergency communication and safety information provision was inadequate, making it difficult to ensure the safety of tourists.

[0535] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0536] In this invention, the server includes a means for providing recommended sightseeing spots, a means for providing itinerary plans, a language support means, a cultural guide means, a means for providing information on local festivals and events, a means for providing recommended stores and food guides, a shopping guide means, a means for providing emergency contact and safety information, a means for providing tourist information feedback, a means for providing weather information, a means for communication between tourists, and a means for providing information according to emotions using an emotion recognition engine. This allows for the appropriate provision of information required by tourists, overcoming language barriers and cultural differences, and enabling the provision of information according to tourists' emotions. Furthermore, the provision of emergency contact and safety information can be enhanced, ensuring the safety of tourists.

[0537] A "prepaid communication card for overseas tourists" is a communication card that tourists from overseas purchase in advance to use communication services in Japan.

[0538] The "means for providing recommended tourist spots" is a function for suggesting tourist spots that tourists should visit.

[0539] The "schedule planning means" is a support function for tourists to efficiently plan their travel itineraries.

[0540] "Language support measures" are translation and interpretation services provided to help tourists overcome language barriers.

[0541] "Cultural guide means" is a function that provides tourists with information about the culture and history of the destination they are visiting.

[0542] The "means for providing information on local festivals and events" is a function that provides tourists with information on festivals and events held in the destinations they visit.

[0543] The "recommended stores and food guide" is a function that introduces recommended stores and dishes to tourists at their destinations.

[0544] The "shopping guide means" is a function that provides tourists with information about shopping at their destinations.

[0545] "Emergency contact and safety information provision means" refers to functions that provide tourists with means to quickly contact each other in the event of an emergency and provide safety information.

[0546] "Tourist information feedback means" is a function that allows tourists to provide feedback on tourist spots and services at their destinations.

[0547] The "weather information providing means" is a function that provides tourists with weather information about the destination.

[0548] "Means of communication between tourists" refers to a function that allows tourists to share information and communicate with each other.

[0549] "Means for providing information according to emotions using an emotion recognition engine" is a function for recognizing the emotions of tourists and providing information according to those emotions.

[0550] MODE FOR CARRYING OUT THE INVENTION

[0551] This invention is a system that creates prepaid communication cards for overseas tourists and provides apps for those who use these cards. This system appropriately provides the information tourists need, overcomes language barriers and cultural differences, and enables information provision that responds to tourists' emotions. It also strengthens emergency communication and safety information provision, ensuring the safety of tourists.

[0552] Hardware and software used

[0553] This system uses the following hardware and software:

[0554] Server: Database management system (DBMS), real-time data processing system

[0555] Device: Smartphone, GPS function, camera, microphone

[0556] Software: Mobile applications, emotion recognition engines, translation software

[0557] Program processing

[0558] The server stores information about tourist attractions and restaurants in a database and provides appropriate information in response to user requests. The server also collects real-time weather information and tourist attraction congestion status and sends it to the app. In emergencies, safety information and emergency contact details are quickly provided.

[0559] The device (user's smartphone) displays the information received from the server through the app. When a user searches for information on tourist attractions or restaurants, the device sends the request to the server and displays the returned information. The device also uses its GPS function to identify the user's current location and provides information on nearby tourist attractions and restaurants.

[0560] Users open the app and search for information about tourist attractions and restaurants. When users select a specific attraction, detailed information about it will be displayed. Users can also provide feedback and communicate with other tourists through the app.

[0561] The emotion engine analyzes the user's emotions from their facial expressions and voice, and provides appropriate services based on that information. For example, if the user expresses joy, the emotion engine collects that information and prioritizes displaying information about tourist spots and restaurants related to joy. On the other hand, if the user expresses anxiety, the emotion engine collects that information and prioritizes displaying information such as safety information and emergency contact information.

[0562] Specific examples

[0563] The user opens the app and searches for "Tokyo Tower." The server returns detailed information about Tokyo Tower and displays it on the device. The user can also check the tower's congestion status and weather information in real time.

[0564] When a user opens the app and searches for tourist spots, the camera captures the user's facial expression, and the emotion engine recognizes the emotion of "joy." The server prioritizes displaying tourist spots related to joy, and the user can use that information to plan their sightseeing.

[0565] Prompt Sentence Examples

[0566] "Please search for information on tourist spots and display recommended spots around the current location. Also, please add a function to provide information based on the user's emotions."

[0567] In this way, the present invention provides tourists with a variety of information and realizes more personalized services by utilizing the emotion engine.

[0568] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0569] Step 1:

[0570] The user launches the app.

[0571] A user taps an app on their smartphone to launch it. The initial screen of the app is displayed. The input is the user's operation, and the output is the initial screen of the app.

[0572] Step 2:

[0573] The device obtains your current location.

[0574] The device uses its GPS function to obtain the user's current location. The current location information is used within the app. The input is GPS data, and the output is current location information. Specifically, the device receives a GPS signal and calculates the current location.

[0575] Step 3:

[0576] A user searches for information about tourist attractions and restaurants.

[0577] A user enters keywords such as "Tokyo Tower" or "sushi restaurant" into the search bar in an app. They then tap the search button. The input is the keyword entered by the user, and the output is a search request.

[0578] Step 4:

[0579] The device sends a search request to the server.

[0580] The terminal sends a search request containing the keywords entered by the user to the server. The request also includes the current location information. The input is the search request and the current location information, and the output is the request sent to the server.

[0581] Step 5:

[0582] The server retrieves the information from the database and returns it to the terminal.

[0583] The server retrieves information about "Tokyo Tower" and "sushi restaurants" from the database. It then sends the retrieved information back to the device. The input is a search request, and the output is information about tourist spots and restaurants. Specifically, the server executes a database query and retrieves the results.

[0584] Step 6:

[0585] The terminal displays the information.

[0586] The device displays the information received from the server within the app, allowing users to check detailed information about tourist attractions and restaurants. The input is information from the server, and the output is displayed on the app screen.

[0587] Step 7:

[0588] The emotion engine recognizes the user's emotions.

[0589] The device uses a camera and microphone to collect the user's facial expressions and voice. The emotion engine analyzes this data and recognizes the user's emotions. The input is facial expression data and voice data, and the output is recognized emotional information. Specifically, the emotion engine performs image analysis and voice analysis.

[0590] Step 8:

[0591] The server provides information according to the emotion.

[0592] Based on the information from the emotion engine, the server prioritizes providing information on tourist spots and restaurants that correspond to the user's emotions. The input is emotion information, and the output is information corresponding to the emotion. Specifically, the server analyzes the emotion information and filters related data.

[0593] Step 9:

[0594] The user provides feedback.

[0595] Users input feedback about tourist spots and restaurants in the app and tap the feedback button to submit. The input is the user's feedback, and the output is the feedback sent to the server.

[0596] Step 10:

[0597] The server stores the feedback in a database.

[0598] The server receives feedback from users and stores it in a database. The stored feedback can be shared with other users. The input is the user's feedback, and the output is storage in the database. Specifically, the server inserts the feedback data into the database.

[0599] (Application example 1)

[0600] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0601] Conventional tourism applications provide information without considering tourists' feelings, which can result in failure to provide the information tourists need. Furthermore, emergency contact and safety information is insufficient, making it difficult for tourists to enjoy sightseeing with peace of mind. Furthermore, the lack of communication methods between tourists can lead to a decline in the quality of the tourist experience.

[0602] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes a recommended sightseeing point means, an itinerary plan providing means, a language means, a Japanese culture guide means, a local festival and event information means, a recommended shop and food guide means, a shopping guide means, an emergency contact and safety information means, a tourist information feedback means, a weather information means, a means for communication between tourists, an emotion recognition means, and an emotion-based information providing means. This makes it possible to provide information according to the tourists' emotions, allowing tourists to enjoy sightseeing with peace of mind and improving the quality of their sightseeing experience.

[0603] "Recommended tourist spots" refer to tourist spots and famous places that tourists should visit.

[0604] "Itinerary planning means" refers to the function for planning and proposing travel itineraries for tourists.

[0605] "Language" refers to the language used by tourists, including translation and interpretation functions.

[0606] "Japanese cultural guide means" refers to the function of explaining Japanese culture and customs to tourists.

[0607] "Local festival and event information means" refers to the function of providing information on festivals and events held in tourist destinations.

[0608] "Recommended restaurants and food guide" refers to a function that introduces recommended restaurants and dishes to tourists.

[0609] "Shopping guide means" refers to a function that introduces recommended shopping spots and products to tourists.

[0610] "Emergency communication and safety information means" refers to functions that provide means for tourists to contact each other in the event of an emergency and safety information.

[0611] "Tourism information feedback means" refers to the function that enables tourists to provide feedback about the places and services they have visited.

[0612] "Weather information means" refers to a function for providing weather information for tourist destinations.

[0613] "Means of communication between tourists" refers to functions that allow tourists to share information and communicate with each other.

[0614] "Emotion recognition means" refers to the function for recognizing tourists' emotions.

[0615] "Emotion-based information provision means" refers to a function that provides appropriate information according to the tourists' emotions.

[0616] As an embodiment of the present invention, a smart tourist guide system for tourists is provided. The system includes an application installed on a smartphone or smart glasses used by tourists. Specific embodiments of this system are described below.

[0617] System configuration

[0618] The system consists of the following main components:

[0619] 1. Server: Manages tourist information, weather information, event information, etc. and provides it to user terminals.

[0620] 2. User device: A device such as a smartphone or smart glasses on which the application is installed.

[0621] 3. Emotion Recognition Engine: Software that recognizes the user's emotions and provides information based on them.

[0622] Hardware and software used

[0623] Hardware: Smartphones, smart glasses

[0624] Software: Emotion recognition engine, requests (HTTP request library)

[0625] Data processing and calculation

[0626] The server processes and calculates the data using the following means:

[0627] 1. Obtaining tourist spot information: The server obtains tourist spot information through the API and provides it to the user terminal.

[0628] 2. Obtaining weather information: The server obtains weather information through the API and provides it to the user's device.

[0629] 3. Emotion recognition: An emotion recognition engine installed on the user's device recognizes the user's emotions in real time.

[0630] 4. Providing information based on emotions: Based on the emotions recognized by the emotion recognition engine, the server provides appropriate information to the user terminal.

[0631] Specific examples

[0632] For example, if the user is in Tokyo, the system will operate as follows:

[0633] 1. When the user opens the application, the current location is recognized as "Tokyo."

[0634] 2. The server obtains information about tourist spots and weather around Tokyo through the API and provides it to the user's device.

[0635] 3. If the user expresses the emotion of "joy," the emotion recognition engine recognizes this, and the server provides tourist spot information to the user terminal with priority.

[0636] 4. If the user expresses an emotion of "anxiety," the emotion recognition engine will recognize it, and the server will provide safety information and emergency contact information to the user's device with priority.

[0637] Prompt Sentence Examples

[0638] "When a tourist in Tokyo expresses happiness, create an application that prioritizes displaying information about nearby tourist spots."

[0639] In this way, a system is provided that allows tourists to enjoy a more comfortable and safe sightseeing experience.

[0640] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0641] Step 1:

[0642] The user launches the application. As input, the user's current location information is obtained from the device. The device uses its GPS function to determine the current location and sends that information to the server. As output, the current location information is sent to the server.

[0643] Step 2:

[0644] The server receives the current location information and retrieves tourist spot information. The current location information is sent to the server as input. The server then sends a request to the tourist spot information API to retrieve tourist spot information around the current location. The tourist spot information is returned to the server as output.

[0645] Step 3:

[0646] The server gets weather information. As input, the current location information is sent to the server. The server sends a request to the weather information API to get the weather information for the current location. As output, the weather information is returned to the server.

[0647] Step 4:

[0648] The device uses an emotion recognition engine to recognize the user's emotions. The user's facial expressions and voice data are input to the device. The emotion recognition engine analyzes this data and identifies the user's emotions. The device generates recognized emotion information as output.

[0649] Step 5:

[0650] The terminal sends the recognized emotion information to the server. As input, emotion information is generated on the terminal. The terminal sends this information to the server. As output, emotion information is sent to the server.

[0651] Step 6:

[0652] The server selects appropriate information based on the emotion information. The emotion information, tourist spot information, and weather information are stored on the server as input. The server analyzes the emotion information and selects tourist spot information and safety information according to the user's emotion. The selected information is generated on the server as output.

[0653] Step 7:

[0654] The server sends the selected information to the terminal. As input, the selected information is generated at the server. The server sends this information to the terminal. As output, the selected information is sent to the terminal.

[0655] Step 8:

[0656] The terminal displays the received information to the user. As input, selected information is sent to the terminal. The terminal displays this information to the user. As output, the information becomes available for the user to review.

[0657] In this way, a system is realized that allows tourists to enjoy a more comfortable and safe sightseeing experience.

[0658] Example 2

[0659] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0660] Conventional tourist information systems do not display advertisements based on tourists' emotions, making it difficult to provide information that matches tourists' interests. Furthermore, the lack of emotion recognition functionality in applications used by tourists also creates a problem of being unable to improve the user experience.

[0661] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes an emotion recognition means, an emotion-based advertisement display means, and a tourist information provision means. This makes it possible to display advertisements according to the tourists' emotions and provide information that matches the tourists' interests and concerns. In addition, the emotion recognition function improves the user experience.

[0662] The "means for providing recommended tourist spots" is a function that suggests tourist spots that tourists should visit.

[0663] The "schedule planning means" is a function for efficiently planning a tourist's travel itinerary.

[0664] "Language guide means" refers to translation and interpretation functions that make it easier for tourists to understand the local language.

[0665] "Cultural guide means" is a function that provides tourists with information about the culture and customs of the place they are visiting.

[0666] The "local festival information provision means" is a function that provides tourists with information about festivals and events held in the area they are visiting.

[0667] The "event information providing means" is a function that provides tourists with information about various events being held at the destination.

[0668] "Means for providing information on recommended stores" is a function that suggests recommended stores and restaurants to tourists at their destinations.

[0669] The "Cuisine Guide" is a function that introduces tourists to local cuisine and recommended dishes at the destination they are visiting.

[0670] The "shopping guide means" is a function that provides tourists with information about shopping at the destination they are visiting.

[0671] "Emergency contact methods" is a function that allows tourists to contact others in an emergency.

[0672] "Safety information provision means" is a function that provides tourists with information about the safety of the destination they are visiting.

[0673] The "tourist information feedback means" is a function that enables tourists to provide feedback on the tourist information of the destination they are visiting.

[0674] The "weather information providing means" is a function that provides tourists with weather information about the destination.

[0675] "Means of communication between tourists" refers to a function that allows tourists to share information and communicate with each other.

[0676] "Emotion recognition means" is a function for recognizing the emotions of tourists.

[0677] The "means for displaying advertisements according to emotions" is a function that displays appropriate advertisements according to the emotions of tourists.

[0678] This invention is a system that generates profits by providing services to tourists. Specifically, tourist spots, restaurants, shopping malls, and other businesses can post advertisements through the app. In addition, by combining it with an emotion engine, it has the function of displaying advertisements according to the emotions of tourists.

[0679] Hardware and software used

[0680] Server: Manages the advertising database, runs the emotion engine, and stores user data.

[0681] Device: Smartphone or tablet used by tourists, with the application installed.

[0682] Emotion engine: Software for recognizing tourists' emotions. For example, using emotion recognition APIs from popular cloud services.

[0683] Application: An app used by tourists that displays advertisements and allows users to search for tourist information.

[0684] Program processing

[0685] When a user launches the app and searches for information on tourist attractions or restaurants, the device's camera and microphone capture the user's facial expressions and voice. This data is sent to the emotion engine, which analyzes the user's emotions. The analysis results are sent to the server, which selects appropriate advertisements from an advertising database based on the emotion data. The selected advertisements are sent to the device, and the app displays them on the user's screen.

[0686] Specific examples

[0687] For example, suppose a tourist is searching for tourist spots in Tokyo. The user opens the app and the camera captures the user's facial expression. If the emotion engine recognizes excitement from the user's facial expression, the server will prioritize displaying advertisements for Tokyo Disneyland and Odaiba, which are areas with a lot of activity.

[0688] Prompt Sentence Examples

[0689] An example of a prompt sentence to input to the generative AI model is as follows:

[0690] "When a tourist is searching for tourist attractions in Tokyo, explain what kind of ads you would show them if your emotion engine recognized the emotion of excitement."

[0691] By feeding this prompt into a generative AI model, a detailed explanation of how the system works and the criteria for selecting ads can be obtained.

[0692] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0693] Step 1:

[0694] A user launches an app. A user taps on a tourism app on their smartphone or tablet to launch it. The app displays the initial screen and offers the user options to search for tourist attractions and restaurants. The input is the user's operation, and the output is the display of the initial screen.

[0695] Step 2:

[0696] A user searches for tourist information. The user enters a keyword, such as "tourist spots in Tokyo," into the search bar within the app. The app sends the entered keyword to the server and requests related tourist information. The input is the user's search keyword, and the output is the request sent to the server.

[0697] Step 3:

[0698] The device captures the user's emotions. The device's camera and microphone capture the user's facial expressions and voice. For example, the camera captures the user's face and the microphone records the user's tone of voice. The input is the user's facial expressions and voice, and the output is the captured data.

[0699] Step 4:

[0700] The emotion engine analyzes emotions. The device sends the captured data to the emotion engine. The emotion engine uses the emotion recognition API of a general cloud service to analyze the user's emotions. For example, it recognizes the emotion "excitement" from the user's facial expression. The input is the captured data, and the output is analyzed emotion data.

[0701] Step 5:

[0702] The server selects an appropriate advertisement. Based on the emotion data received from the emotion engine, the server selects an appropriate advertisement from the advertisement database. For example, if the user expresses the emotion "excitement," the server selects advertisements for tourist spots and entertainment facilities with plenty of activities. The input is emotion data, and the output is the selected advertisement data.

[0703] Step 6:

[0704] The device displays the advertisement. The device receives the advertisement data sent from the server. The app displays the selected advertisement on the user's screen. For example, advertisements for Tokyo Disneyland or Odaiba are displayed. The input is the advertisement data from the server, and the output is the advertisement displayed on the user's screen.

[0705] (Application example 2)

[0706] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0707] Conventional tourist service systems do not adequately provide information tailored to the emotions and interests of tourists, making it difficult to increase tourist satisfaction. Furthermore, there is a lack of real-time, personalized information provided at tourist destinations and stores, making it necessary to improve tourist convenience.

[0708] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0709] In this invention, the server includes an emotion recognition means, an emotion-based advertisement display means, and a personalized information provision means, which makes it possible to recognize the emotions of tourists in real time and provide advertisements and information according to those emotions.

[0710] "International tourists" refers to tourists visiting from other countries.

[0711] A "prepaid SIM" is a SIM card that you pay for in advance.

[0712] "Recommended tourist spot means" refers to the function of recommending tourist spots to tourists.

[0713] "Itinerary planning means" refers to the function of planning and providing tourist travel itineraries.

[0714] "Language and Japanese culture guide means" refers to the function of providing tourists with information about Japanese language and culture.

[0715] "Local festival and event information means" refers to the function of providing tourists with information about local festivals and events.

[0716] "Recommended restaurants and food guide" refers to a function that recommends restaurants and dishes that tourists should visit.

[0717] "Shopping guide means" refers to the function of providing tourists with shopping information.

[0718] "Emergency contact and safety information means" refers to the function of providing tourists with emergency contact methods and safety information.

[0719] "Tourism information feedback means" refers to the function of collecting evaluations and opinions of tourists regarding the tourist spots and stores they visit.

[0720] "Weather information means" refers to the function of providing weather information to tourists.

[0721] "Means of communication between tourists" refers to functions that allow tourists to share information and communicate with each other.

[0722] "Emotion recognition means" refers to the function of recognizing emotions from tourists' facial expressions and tone of voice.

[0723] "Emotion-based advertising display means" refers to a function that displays appropriate advertisements based on recognized emotions.

[0724] "Personalized information provision means" refers to the function of providing customized information based on tourists' interests and past behavioral history.

[0725] This invention aims to improve tourist satisfaction and convenience by combining emotion recognition and personalized information provision in a service provision system for tourists. Specific embodiments for realizing this system are described below.

[0726] System configuration

[0727] The system consists of the following major components:

[0728] 1. Emotion recognition method: Using the smartphone camera and microphone, emotions are recognized from tourists' facial expressions and tone of voice.

[0729] 2. Emotion-based advertising: Prioritize advertisements for tourist attractions, restaurants, and shopping malls based on perceived emotions.

[0730] 3. Personalized information provision: Providing customized information based on tourists' interests and past behavioral history.

[0731] Hardware and software used

[0732] Hardware: Smartphone (camera, microphone)

[0733] Software: OpenCV (image processing library), Keras (deep learning library), Requests (HTTP request library)

[0734] Processing flow

[0735] emotion recognition

[0736] The server uses the smartphone's camera and microphone to capture the tourist's facial expressions and tone of voice, allowing it to recognize the tourist's emotions in real time. Specifically, it uses OpenCV for face detection and Keras for emotion prediction.

[0737] Advertisement display

[0738] The server then selects appropriate advertisements based on the recognized emotions and displays them on the smartphone. For example, if a tourist expresses "happiness," it will display an advertisement for a nearby popular restaurant.

[0739] Providing personalized information

[0740] The server provides customized information based on the tourist's past behavior history and interests, allowing the tourist to obtain information that matches their interests.

[0741] Specific examples

[0742] When tourists use their smartphone cameras, the app analyzes their facial expressions and recognizes the emotion "happiness," then displays advertisements for popular nearby restaurants and offers special discounts.

[0743] Prompt Sentence Examples

[0744] "Develop an application that analyzes facial expressions to recognize emotions when tourists use their smartphone cameras and then displays relevant advertisements based on those emotions."

[0745] The above is a specific embodiment for carrying out the present invention. This system makes it possible to provide information that responds to the emotions of tourists, thereby significantly improving tourist satisfaction and convenience.

[0746] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0747] Step 1:

[0748] The server uses the smartphone's camera and microphone to capture the tourist's facial expressions and tone of voice. The input is the camera video and audio data, and the output is the captured image and audio data. Specifically, it activates the smartphone's camera and microphone and collects data in real time.

[0749] Step 2:

[0750] The server performs face detection on the captured image data using OpenCV. The input is the image data obtained in step 1, and the output is the coordinate information of the detected face area. Specifically, the server applies a face detection algorithm to identify the position of the face in the image.

[0751] Step 3:

[0752] The server inputs the detected face region into a Keras deep learning model to predict emotions. The input is the image data of the face region obtained in step 2, and the output is the predicted emotion label. Specifically, the server preprocesses the face region and inputs it into the deep learning model to classify the emotion.

[0753] Step 4:

[0754] The server selects an appropriate advertisement based on the predicted emotion. The input is the emotion label obtained in step 3, and the output is the selected advertisement data. Specifically, it searches the database for advertisements that correspond to the emotion label and selects the most appropriate advertisement.

[0755] Step 5:

[0756] The server displays the selected advertisement on the smartphone. The input is the advertisement data obtained in step 4, and the output is the advertisement displayed on the smartphone screen. Specifically, the advertisement data is sent to the smartphone and displayed through the user interface.

[0757] Step 6:

[0758] The server provides personalized information based on the tourist's past behavior history and interests. The input is the tourist's behavior history data and interest data, and the output is customized information. Specifically, the server analyzes the behavior history and interest data, and selects and provides relevant information.

[0759] Step 7:

[0760] The user checks the provided advertisements and information and takes action as necessary. The input is the advertisement or information displayed on the smartphone, and the output is the user's behavior. Specific actions include the user clicking on an advertisement or visiting a tourist spot or store based on the provided information.

[0761] Example 3

[0762] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0763] When tourists visit tourist spots, they face the challenge of being unable to grasp information such as crowd levels, waiting times, and opening hours in real time. Furthermore, there is a lack of ways for them to share ratings and reviews of tourist spots and restaurants with other tourists, making it difficult to plan their trips efficiently. Furthermore, because information is not provided in response to tourists' emotions, it is not possible to provide the optimal tourist experience for each individual tourist.

[0764] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0765] In this invention, the server includes means for collecting and providing information on tourist attraction congestion, waiting times, and opening hours, means for sharing ratings and reviews of tourist attractions and restaurants, and means for recognizing tourist emotions and providing information on tourist attractions and restaurants accordingly. This allows tourists to grasp information on tourist attractions in real time and refer to the ratings and reviews of other tourists. It also makes it possible to provide information according to tourist emotions, thereby providing each tourist with the optimal sightseeing experience.

[0766] "Crowding status of tourist spots" is information indicating the number and density of visitors at tourist spots.

[0767] "Waiting time" refers to the time required to receive service at tourist spots, restaurants, etc.

[0768] "Opening hours" refers to the time when tourist attractions and facilities begin operating.

[0769] "Ratings" are numbers and comments that express visitors' satisfaction and opinions about tourist attractions and restaurants.

[0770] "Reviews" are detailed opinions and impressions written by visitors about tourist attractions and restaurants.

[0771] "Emotion recognition" means analyzing the emotional state of tourists from their facial expressions, voices, etc.

[0772] "Information on tourist attractions and restaurants" is detailed data and recommendations on tourist attractions and restaurants.

[0773] The "schedule planning means" is a function that proposes a schedule for tourists to enjoy sightseeing efficiently.

[0774] "Language and Japanese culture guide means" is a function that provides tourists with information about Japanese language and culture.

[0775] The "local festival and event information means" is a function that provides information about festivals and events held in a specific area.

[0776] "Recommended restaurants and food guide" is a function that provides tourists with information about recommended restaurants and food.

[0777] The "shopping guide means" is a function that provides tourists with information about recommended shopping spots and products.

[0778] "Emergency contact and safety information means" is a function that provides tourists with information to contact in an emergency and safety information.

[0779] "Tourist information feedback means" is a function that allows tourists to post ratings and reviews of tourist spots and restaurants they have visited.

[0780] "Weather information means" is a function that provides tourists with the current weather and forecast.

[0781] "Means of communication between tourists" refers to a function that allows tourists to share information and exchange opinions with other tourists.

[0782] This invention is a system for improving convenience for tourists, providing information on the congestion status, waiting times, and opening hours of tourist attractions, sharing ratings and reviews of tourist attractions and restaurants, and providing information based on tourist sentiment. A specific embodiment of this system is described below.

[0783] Hardware and software used

[0784] The server collects information on tourist attractions' congestion levels, waiting times, and opening hours and stores it in a database. This information is obtained from the tourist attraction's management system and real-time sensors. The server also stores ratings and reviews of tourist attractions and restaurants, making them available for other users to view. It also analyzes tourists' emotions using emotion recognition software (e.g., a general emotion recognition API).

[0785] The device (tourist's smartphone) connects to the server through a dedicated application and requests information about tourist spots. The device captures the tourist's facial expressions and voice through a camera and microphone and sends them to emotion recognition software.

[0786] Through the app, users (tourists) can check information such as the congestion status, waiting times, and opening hours of tourist spots, and can post ratings and reviews of the tourist spots and restaurants they visit. Users can also receive information about tourist spots and restaurants that reflect their own feelings.

[0787] Specific examples

[0788] 1. A user opens the app and sends a request to check the "Tokyo Tower congestion status."

[0789] 2. The server calculates the congestion situation based on real-time sensor information and sends it to the terminal.

[0790] 3. The user checks the information displayed in the app, saying "Tokyo Tower is currently crowded."

[0791] 4. The user opens the app and smiles at the camera.

[0792] 5. The device sends the smiling image to emotion recognition software, which analyzes the emotion of "enjoyment."

[0793] 6. The server selects information about amusement parks and theme parks based on the emotion of "fun" and sends it to the terminal.

[0794] 7. The user checks the information displayed in the app as "Recommended Amusement Parks: Theme Parks."

[0795] Prompt Sentence Examples

[0796] "How can I check the congestion status of tourist attractions in real time?"

[0797] "Please explain how the system works, which uses an emotion engine to suggest tourist spots based on tourists' emotions."

[0798] This system allows tourists to grasp information about tourist spots in real time and refer to the ratings and reviews of other tourists. It also makes it possible to provide information according to the tourists' feelings, thereby providing the optimal sightseeing experience for each individual tourist. The flow of the identification process in the third embodiment will be described with reference to FIG. 21.

[0799] Step 1:

[0800] A user opens the app and requests information about a tourist attraction.

[0801] Input: A user submits a request in the app to check the crowd status of a tourist spot (e.g., Tokyo Tower).

[0802] Specific operation: The user enters "Tokyo Tower" in the app's search bar and presses the search button.

[0803] Output: The request is sent to the server.

[0804] Step 2:

[0805] The server collects information on the congestion status, waiting times, and opening hours of tourist attractions.

[0806] Input: The request received by the server.

[0807] Specific operation: The server obtains real-time sensor information and data from the tourist attraction management system.

[0808] Data processing: Analyze the acquired data and calculate congestion levels, waiting times, and opening times.

[0809] Output: Sends the analysis results to the terminal.

[0810] Step 3:

[0811] The terminal displays the information received from the server to the user.

[0812] Input: Information on congestion status, waiting time, and opening hours sent from the server.

[0813] Specific operation: The data received by the device is displayed on the app screen.

[0814] Output: The user confirms information such as "Tokyo Tower is currently crowded."

[0815] Step 4:

[0816] Users post ratings and reviews of tourist attractions and restaurants.

[0817] Input: Ratings and reviews of attractions and restaurants visited by the user.

[0818] What happens: A user uses the app's rating and review feature to enter a comment or star rating.

[0819] Output: Ratings and reviews are sent to the server.

[0820] Step 5:

[0821] The server stores the received ratings and reviews in a database, making them available for other users to view.

[0822] Input: Ratings and reviews submitted by users.

[0823] What happens: The server stores the ratings and reviews in a database.

[0824] Output: Other users can view your ratings and reviews.

[0825] Step 6:

[0826] The user opens the app and shows their face to the camera.

[0827] Input: User's facial expression data.

[0828] Specific action: The user captures their facial expression using the app's camera function.

[0829] Output: The captured facial expression data is saved on the device.

[0830] Step 7:

[0831] The device transmits the captured facial expression data to emotion recognition software.

[0832] Input: Captured facial expression data.

[0833] Specific operation: The device sends facial expression data to emotion recognition software.

[0834] Data processing: Emotion recognition software analyzes facial expression data and recognizes emotions.

[0835] Output: The analysis results are sent to the server.

[0836] Step 8:

[0837] The server selects information about tourist attractions and restaurants based on the analysis results and sends it to the device.

[0838] Input: Analysis results sent from emotion recognition software.

[0839] Specific operation: The server selects information on relevant tourist attractions and restaurants based on the analysis results.

[0840] Output: The selected information is sent to the terminal.

[0841] Step 9:

[0842] The terminal displays the information received from the server to the user.

[0843] Input: Information about tourist attractions and restaurants sent from the server.

[0844] Specific operation: The data received by the device is displayed on the app screen.

[0845] Output: The user checks information such as "Recommended amusement parks: Theme parks."

[0846] (Application example 3)

[0847] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0848] Conventional tourism support systems make it difficult for tourists to obtain real-time information on tourist spots' congestion levels, waiting times, opening hours, and other factors, making it difficult to plan efficient sightseeing trips. Furthermore, communication between tourists was limited, and information provided was not tailored to their emotions, which could result in a decline in the quality of the tourist experience. Furthermore, there was a lack of ways to share ratings and reviews of tourist spots and restaurants, making it difficult to obtain information that would be useful to other tourists. There is a need to solve these issues and improve tourist convenience and satisfaction.

[0849] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0850] In this invention, the server includes a means for providing recommended sightseeing spots and itineraries, a language and Japanese culture guide, a means for providing local festival and event information, a means for providing recommended shops and food guides, a shopping guide, a means for contacting tourists in case of an emergency and providing safety information, a means for providing feedback on sightseeing information, a means for weather information, a means for communication between tourists, a means for providing information on the congestion status, waiting times, and opening hours of sightseeing spots, a means for sharing ratings and reviews of sightseeing spots and restaurants, and a means for recognizing tourists' emotions using an emotion engine and providing communication in response to the emotions. This allows tourists to obtain the information they need in real time and make efficient sightseeing plans. Furthermore, providing information in response to emotions can improve the quality of the sightseeing experience.

[0851] "Recommended tourist spots" refer to tourist destinations and famous places that are considered to be worth visiting for tourists.

[0852] "Schedule planning means" refers to the function of creating and providing schedules that allow tourists to enjoy sightseeing efficiently.

[0853] "Language and Japanese culture guide means" refers to the function of providing tourists with information about the Japanese language and Japanese culture.

[0854] "Local festival and event information means" refers to the function of providing tourists with information about festivals and events held in the area they are visiting.

[0855] "Recommended restaurants and food guide" refers to a function that provides tourists with information about restaurants and food that are considered worth visiting.

[0856] "Shopping guide means" refers to the function of providing tourists with information about shopping spots and products that are considered worth visiting.

[0857] "Emergency communication and safety information means" refers to functions that provide tourists with means to contact others in an emergency and safety information.

[0858] "Tourism information feedback means" refers to a function that allows tourists to share their evaluations and opinions about the tourist spots and facilities they visit.

[0859] "Weather information means" refers to the function of providing tourists with weather forecasts and meteorological information for the destinations they visit.

[0860] "Means of communication between tourists" refers to functions that allow tourists to exchange information and communicate with other tourists.

[0861] "Means of providing information on the congestion situation, waiting times, and opening hours of tourist spots" refers to the function of providing tourists with information on the congestion situation, waiting times, and opening hours of tourist spots they visit.

[0862] "Means for sharing ratings and reviews of tourist spots and restaurants" refers to a function that allows tourists to share ratings and reviews of tourist spots and restaurants they have visited with other tourists.

[0863] "Means of recognizing tourists' emotions using an emotion engine and providing communication accordingly" refers to the function of recognizing tourists' emotions and providing information and communication according to those emotions.

[0864] To implement this invention, it is necessary to build a system that provides applications for tourists. This system includes a server and user terminals (smartphones, tablets, etc.). The specific configuration and operation of the system are described below.

[0865] System Configuration

[0866] 1. Server:

[0867] Database: Stores tourist attractions, restaurants, event information, user ratings and reviews, weather information, etc.

[0868] Emotion engine: Includes an AI model to recognize user emotions and provide information accordingly.

[0869] API: An interface for receiving requests from user devices and providing the necessary data.

[0870] 2. User Device:

[0871] Application: Provides an interface for users to obtain tourist information, post ratings and reviews, and communicate with other tourists.

[0872] Camera and microphone: Used by the emotion engine to analyze the user's facial expressions and tone of voice.

[0873] Operation explanation

[0874] 1. Providing tourist information:

[0875] The user opens the application and requests information about attractions.

[0876] The server retrieves information about the relevant tourist spot (such as congestion status, waiting time, opening hours, etc.) from the database and sends it to the user's terminal.

[0877] Users can check tourist spot information in real time through the application.

[0878] 2. Share your ratings and reviews:

[0879] Users enter ratings and reviews of tourist spots and restaurants they have visited into the application.

[0880] The server stores these ratings and reviews in a database that can be accessed by other users.

[0881] Other users can use these ratings and reviews to plan their trips.

[0882] 3. Information provided by emotion engine:

[0883] While the user is using the application, the emotion engine analyzes the user's facial expressions and tone of voice via the camera and microphone.

[0884] The emotion engine recognizes the user's emotions and provides information on tourist spots and restaurants accordingly.

[0885] For example, if the user indicates an emotion of enjoyment, the emotion engine provides tourist attractions and event information related to enjoyment.

[0886] Specific examples

[0887] Check tourist attractions' crowds:

[0888] When a user types into the application, "Tell me how crowded it is at Tokyo Tower," the server retrieves the real-time congestion information from the database and provides it to the user.

[0889] Using the Emotion Engine:

[0890] When the camera detects a user smiling while using the application, the emotion engine recognizes the emotion of "fun" and displays the message, "Looking for tourist spots related to fun?"

[0891] Prompt Sentence Examples

[0892] "Tell me how crowded it is at Tokyo Tower."

[0893] "Tell me a restaurant you recommend."

[0894] "Tell me about a tourist spot that suits my mood right now."

[0895] In this way, tourists can obtain the information they need in real time, enabling them to plan their trips efficiently. In addition, providing information tailored to their emotions can improve the quality of their tourist experience.

[0896] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0897] Step 1:

[0898] A user launches the application and requests information about tourist attractions.

[0899] Input: The user types into the application, "Tell me how crowded Tokyo Tower is."

[0900] Output: The application sends a request to the server.

[0901] Specific operation: The user opens the application on their smartphone, enters "Tell me how crowded it is at Tokyo Tower" in the text box, and presses the send button.

[0902] Step 2:

[0903] The server receives the request and retrieves the information about the relevant tourist spot from the database.

[0904] Input: The server receives a request from the user.

[0905] Output: Obtain information on the congestion status, waiting time, and opening hours of "Tokyo Tower" from the database.

[0906] What happens: The server parses the request and executes a database query to retrieve the latest crowd levels, wait times, and opening hours for Tokyo Tower.

[0907] Step 3:

[0908] The server transmits the acquired information to the user terminal.

[0909] Input: Information about "Tokyo Tower" retrieved by the server from the database.

[0910] Output: Sends information to the user's terminal.

[0911] Specific operation: The server converts the acquired information into JSON format and sends it to the user device as an HTTP response.

[0912] Step 4:

[0913] The user terminal displays the information received from the server.

[0914] Input: Information on Tokyo Tower's congestion status, waiting time, and opening hours sent from the server.

[0915] Output: Display information to the user.

[0916] Specific operation: The application analyzes the received JSON data and displays on the screen, "The current congestion situation at Tokyo Tower is XX, the waiting time is XX minutes, and the opening hours are XX."

[0917] Step 5:

[0918] Users enter ratings and reviews of tourist spots and restaurants they have visited into the application.

[0919] Input: A user enters a rating or review into the application.

[0920] Output: The application sends the rating and review to the server.

[0921] Specific operation: The user enters ratings and reviews of tourist spots and restaurants they have visited in the text boxes and presses the submit button.

[0922] Step 6:

[0923] The server stores the ratings and reviews in a database.

[0924] Input: User-submitted ratings and reviews.

[0925] Output: Store the ratings and reviews in a database.

[0926] Specific behavior: The server executes an INSERT query to store the received ratings and reviews in the database.

[0927] Step 7:

[0928] The emotion engine recognizes the user's emotions and provides information accordingly.

[0929] Input: The user's facial expression and tone of voice.

[0930] Output: Information on tourist attractions and events according to emotions.

[0931] Specific behavior: When the user is using the application, the emotion engine analyzes the user's facial expressions and tone of voice through the camera and microphone, and if the user shows an emotion of enjoyment, it displays the message "Looking for tourist attractions related to enjoyment."

[0932] Step 8:

[0933] The user checks the information provided by the emotion engine and makes a sightseeing plan.

[0934] Input: Attraction and event information provided by the sentiment engine.

[0935] Output: The user makes a sightseeing plan.

[0936] Specific behavior: The user checks the information provided by the emotion engine, selects the tourist spots and events they want to visit, and plans their itinerary.

[0937] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0938] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0939] Another example of generative AI is Gemini (registered trademark) (Internet search engine). <url: https: gemini.google.com ?hl="ja">) are listed.

[0940] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0941] [Second embodiment]

[0942] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0943] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0944] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0945] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0946] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0947] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0948] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0949] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0950] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0951] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0952] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0953] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0954] "Example 1"

[0955] One aspect of the present invention is a system that creates prepaid SIM cards for overseas tourists and provides apps for users of those SIM cards. This system includes recommended sightseeing spots, itinerary planning, language and Japanese culture guides, local festival and event information, recommended shops and food guides, shopping guides, emergency contact and safety information, tourist information feedback, weather information, and communication between tourists. Specifically, tourists can obtain information about tourist spots and restaurants near their current location through the app. Real-time information on tourist spot congestion and weather is also provided. Furthermore, in emergencies, safety information is provided through the app, allowing tourists to take appropriate action quickly.

[0956] "Example 2"

[0957] Another aspect of the present invention is a system that can generate profits by providing services to tourists. Specifically, businesses such as tourist spots, restaurants, and shopping malls can post advertisements through the app. This allows businesses to effectively advertise to tourists, and tourists can obtain information that matches their interests.

[0958] "Example 3"

[0959] Furthermore, as an embodiment of the present invention, there is a system with functions to improve convenience for tourists. Specifically, tourists can obtain information such as the congestion status, waiting times, and opening hours of tourist spots through the app. In addition, ratings and reviews of tourist spots and restaurants can be shared, which can be helpful to other tourists. This allows tourists to enjoy sightseeing more efficiently.

[0960] The processing flow of each embodiment will be described below.

[0961] "Example 1"

[0962] Step 1: Tourists download the app and insert a prepaid SIM card.

[0963] Step 2: Tourists open the app and search for information on tourist attractions and restaurants near their current location.

[0964] Step 3: Real-time information about tourist attractions' congestion status and weather is displayed.

[0965] Step 4: In case of an emergency, safety information will be provided through the app and tourists will be able to take appropriate action promptly.

[0966] "Example 2"

[0967] Step 1: Tourist attractions, restaurants, shopping malls, and other businesses apply to advertise with the app administrator.

[0968] Step 2: The app administrator places the ad in the app.

[0969] Step 3: Tourists view advertisements through the app and use the business's services.

[0970] "Example 3"

[0971] Step 1: Tourists open the app and search for information such as tourist attraction congestion status, waiting times, and opening hours.

[0972] Step 2: Share your ratings and reviews of attractions and restaurants.

[0973] Step 3: Plan your trip by referring to the ratings and reviews of other tourists.

[0974] Example 1

[0975] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0976] Conventional tourist information systems have difficulty providing comprehensive information that tourists need, and language barriers and cultural differences have been particularly problematic for tourists from overseas. Furthermore, the provision of safety information in emergencies was insufficient, making it difficult for tourists to take appropriate action quickly. Furthermore, there was a lack of systems that provided real-time weather information and information on the congestion status of tourist spots, resulting in low convenience for tourists.

[0977] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0978] In this invention, the server includes a means for acquiring current location information, a means for providing information on tourist spots around the current location, a means for providing congestion status at tourist spots, a means for providing real-time weather information, and a means for notifying safety information in emergencies. This allows tourists to comprehensively receive the information they need, overcome language barriers and cultural differences, and take appropriate action quickly in emergencies. Furthermore, providing information on the congestion status of tourist spots and real-time weather information significantly improves convenience for tourists.

[0979] A "prepaid SIM for overseas tourists" is a communication card that tourists from overseas purchase in advance for use within Japan.

[0980] An "app" is a software program that runs on a mobile device such as a smartphone or tablet.

[0981] The "means for providing recommended tourist spots" is a function that suggests tourist spots that tourists should visit.

[0982] The "schedule planning means" is a function that provides information and tools for tourists to efficiently plan their travel itineraries.

[0983] "Language support measures" are translation and interpretation functions that make it easier for tourists to understand the local language.

[0984] "Cultural guide means" is a function that provides tourists with information about the culture and customs of the place they are visiting.

[0985] The "means for providing information on local festivals and events" is a function that provides tourists with information on festivals and events held in the destinations they visit.

[0986] "Recommended restaurants and food guide" is a function that introduces recommended restaurants and dishes to tourists at their destinations.

[0987] The "shopping guide means" is a function that provides tourists with information about shopping at the destination they are visiting.

[0988] "Emergency contact and safety information provision means" refers to functions that provide tourists with means to quickly contact each other in the event of an emergency and provide safety information.

[0989] "Tourist information feedback means" is a function that allows tourists to provide their opinions and evaluations of the tourist spots and services they visit.

[0990] The "weather information providing means" is a function that provides tourists with weather information about the destination.

[0991] "Means of communication between tourists" refers to a function that allows tourists to share information and communicate with each other.

[0992] "Means for obtaining current location information" is a function that obtains the tourist's current location using technology such as GPS.

[0993] The "means for providing information on tourist spots around the current location" is a function that provides information on tourist spots around the tourist's current location.

[0994] The "means for providing information on congestion status at tourist spots" is a function that provides tourists with real-time information on congestion status at tourist spots they are visiting.

[0995] The "real-time weather information providing means" is a function that provides tourists with real-time weather information about the destination.

[0996] "Emergency safety information notification means" is a function that quickly notifies tourists of safety information in emergencies such as earthquakes and typhoons.

[0997] This invention is a system that creates prepaid SIM cards for overseas tourists and provides apps for those who use those SIM cards. The system aims to comprehensively provide tourists with the information they need and improve the convenience and safety of their travels.

[0998] Hardware and software used

[0999] server

[1000] The server collects and provides information using databases, external APIs, and communication protocols. Specifically, it uses the following hardware and software:

[1001] Database management systems: MySQL, PostgreSQL, etc.

[1002] External API: Google Maps API, OpenWeatherMap API, Japan Meteorological Agency API, etc.

[1003] Communication protocol: HTTPS

[1004] Terminal

[1005] The device is a user's smartphone or tablet, and communicates with the server using GPS and an internet connection. Specifically, the device uses the following hardware and software:

[1006] GPS module: Built-in GPS function of the device

[1007] Internet connection: Wi-Fi, 4G / 5G

[1008] Application: iOS app, Android app

[1009] Program processing

[1010] Server Processing

[1011] The server stores information about tourist attractions and restaurants in a database and provides appropriate information in response to user requests. Specifically, the server performs the following processes:

[1012] Information on tourist spot congestion and weather conditions is collected in real time and updated in the database.

[1013] Collects emergency safety information and notifies users.

[1014] Terminal handling

[1015] The device retrieves information from the server through the app and displays it to the user. Specifically, the device performs the following processes:

[1016] The system uses GPS to obtain your current location and displays information about nearby tourist attractions and restaurants.

[1017] Displays tourist spot congestion status and weather information in real time.

[1018] In case of an emergency, safety information is received from the server and notified to the user.

[1019] User operations

[1020] Through the app, users can:

[1021] Search for information on tourist attractions and restaurants near your current location.

[1022] Get information to plan your schedule.

[1023] In the event of an emergency, check safety information through the app and take appropriate action.

[1024] Specific examples

[1025] For example, if a user is visiting Tokyo for sightseeing, they can open the app and search for tourist spots near their current location. The app will display tourist spots such as Sensoji Temple and Tokyo Tower based on information obtained from the server. It also displays real-time information on the congestion status of tourist spots and weather information. Furthermore, in the event of an emergency, such as an earthquake or typhoon, safety information will be sent through the app.

[1026] Prompt Sentence Examples

[1027] "Generate prompts that allow a user visiting Tokyo to search for information on tourist attractions and restaurants near their current location, and check crowd and weather information in real time."

[1028] In this way, the system provides tourists with comprehensive information and supports a comfortable and safe journey.

[1029] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1030] Step 1:

[1031] The user launches the app.

[1032] A user launches an app by tapping it on the smartphone's home screen. When the app launches, the initial screen is displayed. The input is the user's operation, and the output is the initial screen of the app.

[1033] Step 2:

[1034] The device obtains your current location.

[1035] The device uses the GPS function to obtain the user's current location. Specifically, the device's location information service is enabled to obtain latitude and longitude data. The input is location information from the GPS, and the output is latitude and longitude data.

[1036] Step 3:

[1037] The device sends the current location information to the server.

[1038] The device sends the acquired location information to the server. The HTTPS protocol is used for transmission to ensure secure communication. The input is latitude and longitude data, and the output is a notification to the server that transmission is complete.

[1039] Step 4:

[1040] The server searches for information about tourist attractions and restaurants near the current location.

[1041] The server accesses the database and searches for information on tourist attractions and restaurants around the current location. Search results include the spot name, address, business hours, ratings, etc. The input is latitude and longitude data, and the output is information on tourist attractions and restaurants.

[1042] Step 5:

[1043] The server collects information on tourist spot congestion and weather.

[1044] The server uses external APIs to collect real-time information about tourist spot congestion and weather. For example, it uses the Google Maps API or OpenWeatherMap API. The input is the tourist spot ID and location information, and the output is congestion and weather information.

[1045] Step 6:

[1046] The server sends the collected information to the terminal.

[1047] The server sends the collected information about tourist spots and restaurants, their congestion status, and weather information to the device. Data is sent in JSON format. The input is information about tourist spots and restaurants, their congestion status, and weather information, and the output is a notification to the device that transmission has been completed.

[1048] Step 7:

[1049] The terminal displays the received information to the user.

[1050] The device analyzes the received information and displays it to the user. Specifically, it displays a list of tourist attractions and restaurants on the screen, and indicates congestion status and weather information using icons and text. The input is JSON data received from the server, and the output is the information displayed to the user.

[1051] Step 8:

[1052] The user checks out detailed information about attractions and restaurants.

[1053] Users can tap on attractions or restaurants of their choice from the displayed list to view detailed information, including photos, reviews, and access information. The input is the user's tap action, and the output is the display of detailed information.

[1054] Step 9:

[1055] In an emergency, the server collects safety information and sends it to the terminal.

[1056] In the event of an emergency, the server collects safety information such as earthquakes and typhoons and sends it to the terminal. The collection is done using APIs from the Japan Meteorological Agency and the Disaster Prevention Information Center. The input is emergency trigger information, and the output is safety information.

[1057] Step 10:

[1058] The terminal notifies the user of safety information.

[1059] The device notifies the user of the received safety information. The push notification function is used for notifications, and highly urgent information is immediately conveyed to the user. The input is the safety information received from the server, and the output is the notification to the user.

[1060] (Application example 1)

[1061] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1062] Conventional tourist applications only provide basic information such as tourist information and cultural guides, and do not provide enough information on shopping at physical stores, local events, or safety information. This makes it difficult for tourists to smoothly shop, participate in events, and take safety measures at local stores. In addition, the lack of real-time information on crowding and sales makes it less convenient for tourists.

[1063] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1064] In this invention, the server includes a means for providing store information around the current location, a means for providing store congestion status, a means for providing sale information, a means for providing safety information, and a means for providing local event information, which allows tourists to obtain store information, congestion status, sale information, safety information, and event information in real time.

[1065] A "prepaid SIM for overseas tourists" is a communication card that tourists from overseas purchase in advance for use in Japan.

[1066] "Recommended tourist spots" is information about tourist destinations and famous places that are recommended for tourists to visit.

[1067] The "schedule planning means" is a support function for tourists to efficiently plan their travel itineraries.

[1068] "Language and Japanese culture guide means" is a function that provides information to help tourists learn about Japanese language and culture.

[1069] The "local festival and event information means" is a function that provides information on festivals and events held in areas visited by tourists.

[1070] "Recommended restaurants and food guide" is a function that provides information on restaurants and food that are recommended for tourists to visit.

[1071] "Shopping guide means" is a function that provides information to help tourists enjoy shopping.

[1072] "Emergency contact and safety information means" is a function that provides tourists with means to contact others in an emergency and information on safety.

[1073] "Tourism information feedback means" is a function that allows tourists to provide feedback about the places they have visited and their experiences.

[1074] "Weather information means" is a function that provides weather information for the area that tourists visit.

[1075] "Means of communication between tourists" refers to a function that allows tourists to share information and communicate with each other.

[1076] The "means for providing information about stores around the current location" is a function that provides information about stores around the tourist's current location.

[1077] The "means for providing information on store congestion status" is a function that provides real-time information on the congestion status of stores that tourists are planning to visit.

[1078] The "bargain information providing means" is a function that provides information on bargains and sales being held at stores visited by tourists.

[1079] "Safety information provision means" is a function that provides information to tourists to help them enjoy their trip safely.

[1080] The "local event information providing means" is a function that provides information on events held in areas visited by tourists.

[1081] The system for carrying out the present invention provides an application that uses a prepaid SIM card for tourists. A specific embodiment of this system will be described below.

[1082] System Configuration

[1083] This system is composed of a server, the user's smartphone, and various APIs. The server manages tourist information, store information, weather information, safety information, event information, etc., and provides this information to the user's smartphone. A dedicated application is installed on the user's smartphone, and various information is obtained through this.

[1084] Hardware and software used

[1085] Hardware: Smartphone

[1086] Software: Python, Google Maps API, OpenWeatherMap API

[1087] Data processing and calculation

[1088] The server processes and calculates the data using the following means:

[1089] 1. Methods for providing store information around your current location:

[1090] The server uses the Google Maps API to obtain store information around the user's current location and provides it to the smartphone, allowing the user to easily find nearby stores.

[1091] 2. Store congestion information provided by:

[1092] The server obtains the store's congestion status in real time and provides it to the user, allowing the user to avoid crowds and enjoy shopping efficiently.

[1093] 3. Special Offer Information Delivery Methods:

[1094] The server collects sale information and provides it to the user, thereby enabling the user to make good purchases.

[1095] 4. Safety information provision means:

[1096] The server collects safety information and provides it to users in case of an emergency, allowing them to take appropriate action quickly.

[1097] 5. Local event information sources:

[1098] The server collects information about events held in the area and provides it to the user, allowing the user to find events that they can participate in while traveling.

[1099] Specific examples

[1100] For example, if a tourist in Tokyo uses this app, the user opens the app and checks recommended stores and product information around their current location. Real-time weather and local event information is also provided. In the event of an emergency, safety information is provided, allowing the user to take appropriate action quickly.

[1101] Prompt Sentence Examples

[1102] Create a guide app for tourists in Tokyo. This app will provide real-time information on recommended shops and products around the current location, weather information, local event information, and safety information. The APIs used are Google Maps API and OpenWeatherMap API.

[1103] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1104] Step 1:

[1105] The user launches the app and obtains their current location.

[1106] Input: GPS data from the user's smartphone

[1107] Output: Latitude and longitude information of current location

[1108] Specific operation: The user's smartphone uses the GPS sensor to obtain the latitude and longitude of their current location and sends it to the app.

[1109] Step 2:

[1110] The server obtains store information around the current location.

[1111] Input: Latitude and longitude information of current location

[1112] Output: Information about nearby stores (store name, address, business hours, etc.)

[1113] Specific operation: The server uses the Google Maps API to obtain information about nearby stores based on the latitude and longitude of the current location and sends it to the user's smartphone.

[1114] Step 3:

[1115] The server acquires the store's congestion status.

[1116] Input: Nearby store information

[1117] Output: Congestion status of each store (level of congestion, waiting time, etc.)

[1118] Specific operation: The server refers to data sources (e.g., store sensor information and user check-in data) to obtain the congestion status of each store in real time, calculates the congestion status, and sends it to the user's smartphone.

[1119] Step 4:

[1120] The server retrieves the sale information.

[1121] Input: Nearby store information

[1122] Output: Special sale information for each store (discounted items, sale period, etc.)

[1123] Specific operation: The server refers to a data source (e.g., the store's official website or advertising data) for collecting sale information from each store, obtains the sale information, and sends it to the user's smartphone.

[1124] Step 5:

[1125] The server retrieves weather information.

[1126] Input: Latitude and longitude information of current location

[1127] Output: Current location weather information (temperature, precipitation probability, etc.)

[1128] Specific operation: The server uses the OpenWeatherMap API to obtain weather information based on the latitude and longitude of the current location and sends it to the user's smartphone.

[1129] Step 6:

[1130] The server retrieves the safety information.

[1131] Input: Latitude and longitude information of current location

[1132] Output: Current location safety information (evacuation locations, emergency contacts, etc.)

[1133] Specific operation: The server refers to a data source for providing safety information (e.g., a government disaster prevention information site or a local safety information database), obtains the safety information, and sends it to the user's smartphone.

[1134] Step 7:

[1135] The server retrieves local event information.

[1136] Input: Latitude and longitude information of current location

[1137] Output: Local event information (event name, location, date and time, etc.)

[1138] Specific operation: The server refers to a data source that provides local event information (for example, a local tourist association website or an event information website), obtains the event information, and sends it to the user's smartphone.

[1139] Step 8:

[1140] Users can check various information through the app.

[1141] Input: Store information, crowding status, sale information, weather information, safety information, event information sent from the server

[1142] Output: Various information displayed on the user's smartphone

[1143] Specific operation: The user's smartphone receives various information sent from the server and displays it on the app interface. The user can then check this information and adjust their travel plans and activities.

[1144] Example 2

[1145] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1146] Conventional tourist service systems have limited the means by which tourist destinations, restaurants, shopping malls, and other businesses can effectively advertise, making it difficult for tourists to obtain information that matches their interests. Another problem is that the systems do not adequately provide functions to improve convenience for tourists.

[1147] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for receiving advertisement data, a means for saving the advertisement data in a database, a means for receiving a request from a user, a means for searching the database for advertisement data, a means for transmitting the search results to the user terminal, and a means for displaying the advertisement data on the user terminal. This allows businesses to effectively post advertisements and tourists to easily obtain information that matches their interests.

[1148] "Advertising data" refers to data that includes information about products and services offered by businesses.

[1149] A "database" is a system for systematically storing, searching, and managing advertising data.

[1150] A "user request" is a request containing search keywords and conditions sent by a user through an app.

[1151] "Server" means a computer system for receiving, storing, retrieving, and transmitting advertising data.

[1152] A "user terminal" is a device on which a user uses an app, and includes smartphones, tablets, etc.

[1153] "Search results" are a list of advertising data retrieved from a database based on a user request.

[1154] The "display means" is a function for visually displaying advertisement data on a user terminal.

[1155] MODE FOR CARRYING OUT THE INVENTION

[1156] This invention is a system that generates profits by providing services to tourists. Specifically, it is a system that allows businesses such as tourist spots, restaurants, and shopping malls to post advertisements through an app. This allows businesses to effectively advertise to tourists, and tourists to obtain information that matches their interests.

[1157] Hardware and software used

[1158] Server: Use a high-performance server machine and use Apache or Nginx as web server software.

[1159] Database: Use a relational database such as MySQL or PostgreSQL.

[1160] Device: Smartphone or tablet, using native iOS or Android applications.

[1161] Program processing

[1162] 1. Registering advertising data

[1163] The server receives the advertising data sent by the business, who inputs information such as the advertising content, images, and link URL.

[1164] The server stores the received advertising data in a database, using a relational database such as MySQL or PostgreSQL.

[1165] The server checks the integrity of the data and converts the format of the data if necessary.

[1166] Specific working example:

[1167] When a business registers an advertisement for a "Kyoto restaurant," they enter the advertisement title, description, image URL, and destination URL.

[1168] The server receives this data and stores it in a database.

[1169] 2. Submitting a User Request

[1170] The user launches the app on their smartphone or tablet.

[1171] Users enter keywords of interest into the app's search bar, for example, "Kyoto restaurants."

[1172] The device sends the keyword entered by the user to the server, and the request may also include the user's location and device information.

[1173] Specific working example:

[1174] A user launches the app and types "Kyoto restaurants" into the search bar.

[1175] The terminal sends the search keywords to the server.

[1176] 3. Searching for advertising data

[1177] The server analyzes the request received from the user.

[1178] The server searches its database for advertising data that matches the request, using an SQL query.

[1179] The server formats the search results in a list.

[1180] Specific working example:

[1181] The server searches the database using the keyword "Kyoto restaurant" to retrieve relevant advertising data.

[1182] The server formats the acquired advertising data into a list format.

[1183] 4. Transmission of advertising data

[1184] The server then sends the formatted ad data to the device, often in JSON format.

[1185] The server may compress and / or encrypt the data before sending it.

[1186] Specific working example:

[1187] The server sends the formatted advertising data in JSON format to the terminal.

[1188] Compress and encrypt the data as needed.

[1189] 5. Display of advertising data

[1190] The terminal analyzes the advertisement data received from the server.

[1191] The device displays the analyzed data in a user interface using UI components such as list views and card views.

[1192] Users can tap on the displayed advertisement to view more information or access the operator's website.

[1193] Specific working example:

[1194] The device analyzes the received advertising data and displays it in a list view.

[1195] When users tap on an ad that interests them, they will be shown more information or taken to the operator's website.

[1196] Prompt Sentence Examples

[1197] An example of a prompt sentence to input to the generative AI model is as follows:

[1198] "Imagine a tourist visiting Kyoto. If the user opens the app and searches for 'Kyoto restaurants,' what kind of ads will be displayed?"

[1199] Using this prompt, the generative AI model can explain the flow of ad display based on a specific scenario.

[1200] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1201] Step 1: Register advertising data

[1202] Input: The business enters information such as advertising content, images, and destination URL.

[1203] The server receives the advertisement data sent from the business operator.

[1204] Data processing: The server checks the integrity of the received advertising data and converts the data format if necessary.

[1205] Output: Consistency checked ad data is generated.

[1206] Specific operation: When a business registers an advertisement for "Restaurants in Kyoto," it inputs the advertisement title, description, image URL, and destination URL. The server receives this data and stores it in a database.

[1207] Step 2: Submitting a User Request

[1208] Input: A user types a keyword of interest into the app's search bar.

[1209] The device sends the keyword entered by the user to the server, and the request may also include the user's location and device information.

[1210] Data processing: The terminal converts the user's input data into an appropriate format and sends it to the server.

[1211] Output: A search request is generated that is sent to the server.

[1212] Specific operation: The user launches the app and enters "Kyoto restaurants" in the search bar. The device sends this search keyword to the server.

[1213] Step 3: Finding advertising data

[1214] Input: The search request the server receives from the user.

[1215] The server analyzes the request received from the user.

[1216] Data processing: The server searches the database for advertising data that matches the request, using an SQL query.

[1217] Output: A list of ad data is generated as a search result.

[1218] Specific operation: The server searches the database for the keyword "Kyoto restaurant" to obtain relevant advertising data, and then formats the obtained advertising data into a list.

[1219] Step 4: Send advertising data

[1220] Input: Server formatted list of ad data.

[1221] The server then sends the formatted ad data to the device, often in JSON format.

[1222] Data processing: The server may compress or encrypt the data before sending it.

[1223] Output: Advertising data sent to the device is generated.

[1224] Specific operation: The server sends the formatted ad data in JSON format to the device, compressing and encrypting the data as needed.

[1225] Step 5: View your advertising data

[1226] Input: Advertising data received by the device from the server.

[1227] The terminal analyzes the advertisement data received from the server.

[1228] Data processing: The device displays the analyzed data in a user interface using UI components such as list views and card views.

[1229] Output: Advertising data is generated that is displayed to the user.

[1230] Specific operation: The device analyzes the received advertising data and displays it in a list view. When the user taps on an advertisement that interests them, they can view more information or be redirected to the operator's website.

[1231] (Application example 2)

[1232] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1233] There is a lack of effective ways to provide information about tourist attractions, restaurants, shopping malls, etc., and for businesses to advertise to tourists efficiently. Another issue is that it is difficult for tourists to obtain information customized based on their interests and current location.

[1234] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for providing recommended sightseeing spots and itinerary plans, a language and culture guide means, a means for providing local festival and event information, a means for providing recommended stores and food guides, a shopping guide means, a means for contacting tourists in emergencies and safety information, a means for providing tourist information feedback, a weather information means, a means for communicating between tourists, a means for providing customized advertisements using a generative AI model, and a means for providing information based on the user's interests and current location. This allows tourists to obtain information customized based on their interests and current location, and enables businesses to efficiently post advertisements to tourists.

[1235] A "prepaid communication module for overseas tourists" is a means of communication that tourists from overseas can use by paying a fee in advance.

[1236] "Recommended tourist spots" refers to information about tourist destinations and famous places that are recommended to tourists as being worth visiting.

[1237] The "schedule plan providing means" is a function that provides schedules and plans for tourists to enjoy sightseeing efficiently.

[1238] "Language and cultural guide means" is a function that provides information about the language and culture of the country or region that tourists visit.

[1239] The "local festival and event information means" is a function that provides information on festivals and events held in areas visited by tourists.

[1240] The "recommended store and food guide" is a function that provides tourists with information about stores and dishes that are recommended as being worth visiting.

[1241] The "shopping guide means" is a function that provides information about shopping in areas visited by tourists.

[1242] "Emergency contact and safety information means" is a function that provides tourists with contact means and safety information in the event of an emergency.

[1243] "Tourism information feedback means" is a function that allows tourists to provide their opinions and evaluations of the places they visit and the services they experience.

[1244] The "weather information means" is a function that provides information about the weather in the area that tourists visit.

[1245] "Means of communication between tourists" are means by which tourists share information and communicate with each other.

[1246] "Means for providing customized advertisements using generative AI models" refers to a function that uses generative AI models to provide customized advertisements based on tourists' interests and behavioral history.

[1247] "Means of providing information based on user interests and current location" is a function that provides relevant information based on tourists' interests and current location.

[1248] As an embodiment of this invention, we will build a service provision system for tourists. The system is realized using a smartphone application, a back-end server, a database, and a generative AI model.

[1249] Hardware and software used

[1250] Hardware: Smartphone (iOS or Android)

[1251] Software: Mobile application development frameworks (e.g., Flutter), backend servers (e.g., Node.js, Django), databases (e.g., MySQL), generative AI models (e.g., GPT-4)

[1252] System configuration

[1253] 1. User Registration and Profile Settings:

[1254] Users download the smartphone app and register, selecting categories of interest (tourist attractions, restaurants, shopping malls, etc.).

[1255] Use the smartphone's GPS function to obtain the user's current location information.

[1256] 2. Advertising:

[1257] Businesses can place advertisements through the app, which can consist of text, images, videos, etc.

[1258] Advertisements are displayed based on the interests and location of the businesses' target users.

[1259] 3. Leveraging generative AI models:

[1260] It uses generative AI models (such as GPT-4) to generate customized ads and information based on users' interests and behavioral history.

[1261] For example, if a user searches for "recommended tourist spots," the generative AI model will provide information on "recommended tourist spots" and "popular restaurants."

[1262] 4. Data processing and calculation:

[1263] Collects user behavior data (search history, click history, etc.) and stores it in a database.

[1264] Analyze the collected data and optimize advertising based on users' interests.

[1265] Specific examples

[1266] User scenario: A user visits a tourist spot and opens the app. The app obtains the user's current location and displays advertisements for nearby tourist spots and restaurants. When the user searches for "recommended tourist spots," the generative AI model provides information on "recommended tourist spots" and "popular restaurants."

[1267] Prompt Sentence Examples

[1268] Prompt: "What are some recommended tourist spots?"

[1269] In this way, a system can be realized that can generate profits by providing services to tourists.

[1270] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1271] Step 1:

[1272] A user downloads a smartphone app and registers an account. As input, they provide basic user information (such as name, email address, and interest categories). As output, the user profile is stored in a database. Specifically, when a user enters information into the app's registration form and presses the submit button, the server receives the information and stores it in the database.

[1273] Step 2:

[1274] The device uses its GPS function to obtain the user's current location information. The user's location information is required as input. The current location information is displayed in the app as output. Specifically, the app periodically obtains GPS data and sends it to the server.

[1275] Step 3:

[1276] Businesses place advertisements through the app. As input, they provide the advertisement content (text, images, videos, etc.). As output, the advertisement is saved in the database and displayed to the user. Specifically, the business uploads the advertisement from the advertisement management screen, and the server saves the advertisement in the database.

[1277] Step 4:

[1278] The server uses a generative AI model to generate customized advertisements and information based on the user's interests and behavioral history. User behavioral data (search history, click history, etc.) is used as input. Customized advertisements and information are generated as output. Specifically, the server analyzes the user's behavioral data and inputs prompt statements into the generative AI model to generate customized advertisements and information.

[1279] Step 5:

[1280] The server provides the generated advertisements and information to the user. As input, it uses the output data from the generative AI model. As output, the customized advertisements and information are displayed on the user's smartphone. Specifically, the server sends the generated advertisements and information to the user's app, which then displays them.

[1281] Step 6:

[1282] Users provide feedback on tourist information through the app. As input, they provide their feedback (text, rating, etc.). As output, the feedback is stored in the database. Specifically, when a user enters information into the feedback form and presses the submit button, the server receives the information and stores it in the database.

[1283] Step 7:

[1284] The server analyzes user behavior data and optimizes advertisements. It uses user behavior data as input and generates optimized advertisements as output. Specifically, the server retrieves user behavior data from the database and uses an analytical algorithm to optimize advertisements.

[1285] Step 8:

[1286] The device provides users with weather information, emergency contact information, and safety information. Weather data and safety information data are used as input. As output, this information is displayed on the user's smartphone. Specifically, the app periodically retrieves weather and safety information from the server and notifies the user.

[1287] Example 3

[1288] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1289] Conventional tourist information systems lack the functionality to provide real-time information such as tourist attraction congestion, waiting times, and opening hours, making it difficult for tourists to enjoy sightseeing efficiently. Furthermore, they have limited functionality for sharing ratings and reviews of tourist attractions and restaurants, making it difficult for tourists to refer to the opinions of other tourists. Furthermore, they lack the functionality to quickly provide information in response to user requests and to store ratings and reviews in a database, reducing convenience for tourists.

[1290] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1291] In this invention, the server includes means for providing information such as the congestion status, waiting times, and opening hours of tourist attractions, means for sharing ratings and reviews of tourist attractions and restaurants, means for receiving user requests and retrieving information from a database to respond, and means for saving user ratings and reviews in the database. This allows tourists to obtain information about tourist attractions in real time and refer to the ratings and reviews of other tourists, allowing them to enjoy sightseeing efficiently.

[1292] "Recommended tourist spots" refer to tourist destinations and famous places that are considered to be worth visiting for tourists.

[1293] "Schedule planning means" refers to a function that allows tourists to plan the places and times they will visit in order to enjoy sightseeing efficiently.

[1294] "Language and cultural guide means" refers to the function of providing information about the language and culture of the region tourists visit.

[1295] "Local festival and event information means" refers to the function of providing information about festivals and events held in areas visited by tourists.

[1296] "Recommended restaurants and food guide" refers to a function that introduces restaurants and dishes that are considered worth visiting to tourists.

[1297] "Shopping guide means" refers to the function of introducing tourists to shopping spots and products that are considered worth visiting.

[1298] "Emergency communication and safety information means" refers to functions that provide tourists with means to contact each other in an emergency and safety information.

[1299] "Tourism information feedback means" refers to the function of providing evaluations and opinions about tourist attractions and services that tourists have visited.

[1300] "Weather information means" refers to the function of providing weather information for areas visited by tourists.

[1301] "Means of communication between tourists" refers to functions that allow tourists to exchange information and communicate with each other.

[1302] "Means of providing information such as the current congestion situation, waiting times, and opening hours of tourist spots" refers to the function of providing tourists with information about the current congestion situation, waiting times, and opening hours of tourist spots they visit.

[1303] "Means for sharing ratings and reviews of tourist spots and restaurants" refers to a function that allows tourists to share ratings and reviews of tourist spots and restaurants they have visited with other tourists.

[1304] "Means for receiving a user request, retrieving information from a database, and responding" refers to a function for receiving an information request from a user, retrieving the necessary information from a database, and responding to the user.

[1305] "Means for saving user ratings and reviews in a database" refers to a function that saves ratings and reviews provided by users in a database and allows other users to refer to that information.

[1306] This invention is a system for improving convenience for tourists, and has the function of providing information such as the congestion status, waiting times, and opening hours of tourist spots. It also has the function of sharing ratings and reviews of tourist spots and restaurants. This system operates in cooperation with three parties: a server, a terminal, and a user.

[1307] Hardware and Software Configuration

[1308] 1. Server:

[1309] The server collects data such as tourist attraction congestion, waiting times, and opening times, and stores it in a database. Specifically, the data is collected and stored using a cloud service.

[1310] The server receives a request from the user and retrieves the necessary data from the database and responds. For example, if a user wants to know the congestion status of a particular tourist spot, the server retrieves that information from the database and provides it to the user.

[1311] 2. Device (user's smartphone or tablet):

[1312] The device provides an interface for users to search for information about tourist spots and post reviews through apps, specifically iOS and Android applications.

[1313] The device sends the user's request to the server and displays the data returned by the server. For example, if a user searches for the congestion status of a tourist spot, the device requests that information from the server and displays the returned data on the screen.

[1314] 3. User:

[1315] Through the app, users can obtain information about tourist spots, such as crowding levels, waiting times, and opening times. For example, if a user wants to know the "crowd situation at tourist spot A," they open the app and search.

[1316] Users can post ratings and reviews of tourist spots and restaurants and share information with other tourists. For example, a user can rate a restaurant they visited on a five-star scale and post a comment.

[1317] Specific examples

[1318] As a concrete example, the prompt sentence when the user wants to know "the congestion situation at tourist spot A" is shown below.

[1319] Example prompt sentence:

[1320] The user opens the app and searches for "Crowding status of tourist spot A." The device sends this request to the server, which retrieves the latest congestion status from the database and returns it to the device. The device then displays this information to the user.

[1321] This system allows tourists to obtain information about tourist spots in real time, allowing them to enjoy sightseeing efficiently. For example, if a user wants to know the "crowding situation at tourist spot A," they can obtain the latest information simply by opening the app and searching. In addition, users can share ratings and reviews of the tourist spots and restaurants they have visited with other tourists, allowing them to refer to the opinions of other tourists. The flow of the identification process in Example 3 will be described with reference to FIG. 15.

[1322] Step 1:

[1323] The user launches the app and searches for information about tourist spots.

[1324] Input: A user types "crowding status of tourist spot A" into the app's search bar.

[1325] Specific operation: The user launches the app on their smartphone or tablet and enters "crowding status of tourist spot A" in the search bar.

[1326] Step 2:

[1327] The terminal sends the user's request to the server.

[1328] Input: User's search keyword "Crowding status of tourist spot A."

[1329] Output: The HTTP request sent to the server.

[1330] How it works: The device receives user input and sends it to the server as an HTTP request, which includes search keywords, the user's location, and other information.

[1331] Step 3:

[1332] The server retrieves the necessary information from the database.

[1333] Input: The HTTP request sent from the device.

[1334] Output: Crowd data for tourist spot A retrieved from the database.

[1335] Specific operation: The server analyzes the received request and retrieves the latest data on "the congestion status of tourist spot A" from the database. The database stores information such as the tourist spot's congestion status, waiting time, and opening hours.

[1336] Step 4:

[1337] The server returns the acquired information to the terminal.

[1338] Input: Crowd data for tourist spot A retrieved from the database.

[1339] Output: The HTTP response sent back to the device.

[1340] Specific operation: The server converts the acquired data into JSON format and returns it to the terminal as an HTTP response.

[1341] Step 5:

[1342] The terminal displays the received information to the user.

[1343] Input: JSON data returned by the server.

[1344] Output: Crowd status information for tourist spot A displayed to the user.

[1345] Specific operation: The device parses the received JSON data and displays it on the screen in a format that is easy for the user to read. For example, it might say, "The current congestion situation at tourist spot A is medium. The waiting time is approximately 15 minutes."

[1346] Step 6:

[1347] Users post ratings and reviews of tourist attractions and restaurants.

[1348] Input: User-entered ratings and reviews.

[1349] Output: Rating and review data sent to device.

[1350] Specific behavior: The user enters ratings and reviews for the tourist spots and restaurants they visited within the app. For example, they enter a comment such as, "The view from the observation deck at tourist spot A was amazing. Five stars!"

[1351] Step 7:

[1352] The device sends the user's post to the server.

[1353] Input: Rating and review data entered by users.

[1354] Output: The HTTP request sent to the server.

[1355] What happens: The device sends the user's rating and review to the server as an HTTP request, which includes the rating star rating, comments, user ID, etc.

[1356] Step 8:

[1357] The server stores the posts in a database.

[1358] Input: Rating and review data submitted by the device.

[1359] Output: Ratings and reviews stored in a database.

[1360] What it does: The server stores the ratings and reviews it receives in a database, so that other users can refer to them.

[1361] (Application example 3)

[1362] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1363] Conventional tourist information systems have difficulty providing real-time information such as tourist attraction congestion, waiting times, and opening hours, making it difficult for tourists to enjoy sightseeing efficiently. Another issue is that they lack the functionality to share ratings and reviews of tourist attractions and restaurants, making it difficult for tourists to refer to the opinions of other tourists.

[1364] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes a means for displaying the congestion status of tourist spots, a means for predicting waiting times, a means for sharing opening hours, a means for sharing ratings and reviews, and a means for proposing recommended routes. This allows tourists to obtain information such as the congestion status, waiting times, and opening hours of tourist spots in real time, enabling them to enjoy sightseeing efficiently while referring to the ratings and reviews of other tourists.

[1365] A "prepaid communication module for overseas tourists" is a communication module that tourists visiting from overseas purchase in advance to use communication services in their local area.

[1366] An "application" is software that runs on devices such as smartphones and tablets and provides specific functions and services to users.

[1367] "Recommended tourist spots" are tourist spots that are recommended to tourists as being worth visiting.

[1368] The "schedule planning means" is a function that allows tourists to plan the places and times to visit in order to enjoy sightseeing efficiently.

[1369] "Language and Japanese Culture Guide" is a function that provides information to help tourists deepen their understanding of Japanese language and culture.

[1370] The "local festival and event information means" is a function that provides information on festivals and events held in areas visited by tourists.

[1371] The "recommended store and food guide" is a function that provides tourists with information about stores and dishes that are recommended as being worth visiting.

[1372] The "shopping guide means" is a function that provides information about shopping in areas visited by tourists.

[1373] "Emergency contact and safety information means" is a function that provides tourists with information to contact in an emergency and safety information.

[1374] "Tourism information feedback means" is a function that allows tourists to share their evaluations and opinions about the tourist spots and services they visit.

[1375] "Weather information means" is a function that provides weather information for the area that tourists visit.

[1376] "Means of communication between tourists" refers to a function that allows tourists to exchange information and communicate with each other.

[1377] The "means for displaying the congestion status of tourist spots" is a function that displays the current congestion status of tourist spots in real time.

[1378] The "waiting time prediction means" is a function that predicts waiting times at tourist spots and notifies users.

[1379] The "opening hours information means" is a function that displays the opening hours of tourist spots and stores.

[1380] "Rating and review sharing tool" is a function that allows users to post and view ratings and reviews of tourist spots and stores.

[1381] The "recommended route suggestion method" is a function that suggests recommended sightseeing routes taking into account congestion and waiting times.

[1382] As an embodiment of the present invention, an information providing system for tourists is constructed. The system is composed of a server, a user terminal (such as a smartphone), and a communication module.

[1383] System configuration

[1384] 1. Server:

[1385] The server includes a means for displaying the congestion status of tourist spots, a means for predicting waiting times, a means for providing information on opening hours, a means for sharing ratings and reviews, and a means for suggesting recommended routes.

[1386] The server collects real-time data on tourist attractions and provides it to the user terminal.

[1387] The server collects ratings and reviews from users and shares them with other users.

[1388] 2. User Device:

[1389] The user terminal is a device such as a smartphone or tablet, on which a dedicated application is installed.

[1390] The user terminal receives the information provided by the server and displays it to the user.

[1391] The user terminal transmits input from the user (ratings and reviews) to the server.

[1392] 3. Communication module:

[1393] The communication module is a prepaid communication module that tourists from overseas purchase in advance to use communication services in their local area.

[1394] The communication module supports communication between the user terminal and the server.

[1395] Data processing and calculation

[1396] Displaying the congestion status of tourist spots:

[1397] The server collects real-time data from tourist spots and analyzes congestion levels.

[1398] The analysis results are sent to the user terminal and displayed to the user.

[1399] Wait time prediction methods:

[1400] The server predicts waiting times at tourist attractions based on past data and current conditions.

[1401] The prediction result is transmitted to the user terminal and notified to the user.

[1402] Opening hours information means:

[1403] The server retrieves information about the opening hours of tourist spots and stores from the database and transmits it to the user terminal.

[1404] The user terminal displays the open time information to the user.

[1405] Rate and share your review via:

[1406] The server collects ratings and reviews from users and stores them in a database.

[1407] The server sends this information to the user's terminal so that other users can view the ratings and reviews.

[1408] Route suggestions by:

[1409] The server proposes the most suitable sightseeing route to the user, taking into consideration the congestion situation and waiting time.

[1410] The proposed route is transmitted to the user terminal and displayed to the user.

[1411] Specific examples

[1412] For example, if a user wants to know the congestion status of "Tokyo Tower," they can enter the "Tokyo Tower" ID into the application. The server will analyze the congestion status in real time and send the results to the user's device. The user's device will then display information such as the congestion status, waiting time, and opening hours.

[1413] Example prompt sentence:

[1414] "Please enter the tourist spot ID: Tokyo Tower"

[1415] In this way, tourists can obtain information about tourist spots in real time and enjoy sightseeing efficiently.

[1416] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1417] Step 1:

[1418] The user enters the tourist spot ID into the application. The entered ID is sent from the user's device to the server. The input data is the tourist spot ID, and the output is a request to the server.

[1419] Step 2:

[1420] The server retrieves real-time data of the tourist spot from the database based on the received tourist spot ID. The input data is the tourist spot ID, and the output is the real-time data of the tourist spot.

[1421] Step 3:

[1422] The server analyzes the acquired real-time data and calculates the current congestion status of the tourist spot. The input data is the real-time data of the tourist spot, and the output is the analysis result of the congestion status.

[1423] Step 4:

[1424] The server predicts waiting times at tourist attractions based on past data and current conditions. The input data is real-time and past data for tourist attractions, and the output is the predicted waiting time.

[1425] Step 5:

[1426] The server retrieves the opening hours of tourist attractions and stores from the database. The input data is the tourist attraction ID, and the output is the opening hours.

[1427] Step 6:

[1428] The server collects ratings and reviews from users and stores them in a database. The input data are user ratings and reviews, and the output is the results stored in the database.

[1429] Step 7:

[1430] The server proposes the optimal sightseeing route to the user, taking into account congestion and waiting times. The input data are the analysis results of congestion and predicted waiting times, and the output is the proposed recommended route.

[1431] Step 8:

[1432] The server sends the analysis results, prediction results, opening hours information, and recommended routes to the user's terminal. The input data are the analysis results, prediction results, opening hours information, and recommended routes, and the output is the data sent to the user's terminal.

[1433] Step 9:

[1434] The user terminal displays the received data to the user. The input data is the data sent from the server, and the output is the information displayed to the user.

[1435] Step 10:

[1436] The user visits tourist spots based on the displayed information. The input data is the information displayed on the user's device, and the output is the user's behavior.

[1437] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1438] "Example 1"

[1439] One embodiment of the present invention is a system incorporating an emotion engine. This system recognizes the emotions of tourists when they use an app and provides services accordingly. Specifically, when a tourist opens the app and searches for information on tourist attractions or restaurants, the emotion engine recognizes the tourist's emotions. For example, if a tourist expresses joy, the emotion engine collects that information and prioritizes displaying information on tourist attractions and restaurants related to joy. Also, if a tourist expresses anxiety, the emotion engine collects that information and prioritizes displaying information such as safety information and emergency contact information. This allows tourists to obtain information that corresponds to their emotions, resulting in a more comfortable sightseeing experience. "Example 2"

[1440] Another embodiment of the present invention is a system incorporating an emotion engine. This system recognizes the emotions of tourists when they use an app and displays advertisements that correspond to their emotions. Specifically, when a tourist opens the app and searches for information on tourist attractions or restaurants, the emotion engine recognizes the tourist's emotions. For example, if the tourist expresses excitement, the emotion engine collects that information and preferentially displays advertisements for tourist attractions and restaurants related to that excitement. This allows tourists to see advertisements that correspond to their emotions and are more likely to find them interesting.

[1441] "Example 3"

[1442] Furthermore, another embodiment of the present invention is a system that incorporates an emotion engine. This system recognizes the emotions of tourists when they use an app and provides communication that corresponds to their emotions. Specifically, when a tourist opens the app and communicates with other tourists, the emotion engine recognizes the tourist's emotions. For example, if a tourist expresses an emotion of enjoyment, the emotion engine collects that information and provides topics about tourist spots and restaurants related to the enjoyment. This allows tourists to enjoy communication that corresponds to their emotions.

[1443] The processing flow of each embodiment will be described below.

[1444] "Example 1"

[1445] Step 1: The tourist opens the app.

[1446] Step 2: Tourists search for information about tourist attractions and restaurants.

[1447] Step 3: The emotion engine recognizes the tourist's emotions.

[1448] Step 4: Based on the information collected by the emotion engine, information that corresponds to the tourist's emotions is displayed preferentially.

[1449] "Example 2"

[1450] Step 1: The tourist opens the app.

[1451] Step 2: Tourists search for information about tourist attractions and restaurants.

[1452] Step 3: The emotion engine recognizes the tourist's emotions.

[1453] Step 4: Based on the information collected by the emotion engine, advertisements that correspond to the tourist's emotions are displayed preferentially.

[1454] "Example 3"

[1455] Step 1: The tourist opens the app.

[1456] Step 2: Tourists communicate with other tourists.

[1457] Step 3: The emotion engine recognizes the tourist's emotions.

[1458] Step 4: Based on the information collected by the emotion engine, provide topics that correspond to the tourist's emotions.

[1459] Example 1

[1460] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1461] Conventional tourist information systems have difficulty providing tourists with the information they need, with language barriers and cultural differences being particularly problematic for international tourists. Furthermore, information provided was not tailored to the tourists' needs, which could result in a decline in the quality of their tourist experience. Furthermore, emergency communication and safety information provision was inadequate, making it difficult to ensure the safety of tourists.

[1462] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1463] In this invention, the server includes a means for providing recommended sightseeing spots, a means for providing itinerary plans, a language support means, a cultural guide means, a means for providing information on local festivals and events, a means for providing recommended stores and food guides, a shopping guide means, a means for providing emergency contact and safety information, a means for providing tourist information feedback, a means for providing weather information, a means for communication between tourists, and a means for providing information according to emotions using an emotion recognition engine. This allows for the appropriate provision of information required by tourists, overcoming language barriers and cultural differences, and enabling the provision of information according to tourists' emotions. Furthermore, the provision of emergency contact and safety information can be enhanced, ensuring the safety of tourists.

[1464] A "prepaid communication card for overseas tourists" is a communication card that tourists from overseas purchase in advance to use communication services in Japan.

[1465] The "means for providing recommended tourist spots" is a function for suggesting tourist spots that tourists should visit.

[1466] The "schedule planning means" is a support function for tourists to efficiently plan their travel itineraries.

[1467] "Language support measures" are translation and interpretation services provided to help tourists overcome language barriers.

[1468] "Cultural guide means" is a function that provides tourists with information about the culture and history of the destination they are visiting.

[1469] The "means for providing information on local festivals and events" is a function that provides tourists with information on festivals and events held in the destinations they visit.

[1470] The "recommended stores and food guide" is a function that introduces recommended stores and dishes to tourists at their destinations.

[1471] The "shopping guide means" is a function that provides tourists with information about shopping at their destinations.

[1472] "Emergency contact and safety information provision means" refers to functions that provide tourists with means to quickly contact each other in the event of an emergency and provide safety information.

[1473] "Tourist information feedback means" is a function that allows tourists to provide feedback on tourist spots and services at their destinations.

[1474] The "weather information providing means" is a function that provides tourists with weather information about the destination.

[1475] "Means of communication between tourists" refers to a function that allows tourists to share information and communicate with each other.

[1476] "Means for providing information according to emotions using an emotion recognition engine" is a function for recognizing the emotions of tourists and providing information according to those emotions.

[1477] MODE FOR CARRYING OUT THE INVENTION

[1478] This invention is a system that creates prepaid communication cards for overseas tourists and provides apps for those who use these cards. This system appropriately provides the information tourists need, overcomes language barriers and cultural differences, and enables information provision that responds to tourists' emotions. It also strengthens emergency communication and safety information provision, ensuring the safety of tourists.

[1479] Hardware and software used

[1480] This system uses the following hardware and software:

[1481] Server: Database management system (DBMS), real-time data processing system

[1482] Device: Smartphone, GPS function, camera, microphone

[1483] Software: Mobile applications, emotion recognition engines, translation software

[1484] Program processing

[1485] The server stores information about tourist attractions and restaurants in a database and provides appropriate information in response to user requests. The server also collects real-time weather information and tourist attraction congestion status and sends it to the app. In emergencies, safety information and emergency contact details are quickly provided.

[1486] The device (user's smartphone) displays the information received from the server through the app. When a user searches for information on tourist attractions or restaurants, the device sends the request to the server and displays the returned information. The device also uses its GPS function to identify the user's current location and provides information on nearby tourist attractions and restaurants.

[1487] Users open the app and search for information about tourist attractions and restaurants. When users select a specific attraction, detailed information about it will be displayed. Users can also provide feedback and communicate with other tourists through the app.

[1488] The emotion engine analyzes the user's emotions from their facial expressions and voice, and provides appropriate services based on that information. For example, if the user expresses joy, the emotion engine collects that information and prioritizes displaying information about tourist spots and restaurants related to joy. On the other hand, if the user expresses anxiety, the emotion engine collects that information and prioritizes displaying information such as safety information and emergency contact information.

[1489] Specific examples

[1490] The user opens the app and searches for "Tokyo Tower." The server returns detailed information about Tokyo Tower and displays it on the device. The user can also check the tower's congestion status and weather information in real time.

[1491] When a user opens the app and searches for tourist spots, the camera captures the user's facial expression, and the emotion engine recognizes the emotion of "joy." The server prioritizes displaying tourist spots related to joy, and the user can use that information to plan their sightseeing.

[1492] Prompt Sentence Examples

[1493] "Please search for information on tourist spots and display recommended spots around the current location. Also, please add a function to provide information based on the user's emotions."

[1494] In this way, the present invention provides tourists with a variety of information and realizes more personalized services by utilizing the emotion engine.

[1495] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1496] Step 1:

[1497] The user launches the app.

[1498] A user taps an app on their smartphone to launch it. The initial screen of the app is displayed. The input is the user's operation, and the output is the initial screen of the app.

[1499] Step 2:

[1500] The device obtains your current location.

[1501] The device uses its GPS function to obtain the user's current location. The current location information is used within the app. The input is GPS data, and the output is current location information. Specifically, the device receives a GPS signal and calculates the current location.

[1502] Step 3:

[1503] A user searches for information about tourist attractions and restaurants.

[1504] A user enters keywords such as "Tokyo Tower" or "sushi restaurant" into the search bar in an app. They then tap the search button. The input is the keyword entered by the user, and the output is a search request.

[1505] Step 4:

[1506] The device sends a search request to the server.

[1507] The terminal sends a search request containing the keywords entered by the user to the server. The request also includes the current location information. The input is the search request and the current location information, and the output is the request sent to the server.

[1508] Step 5:

[1509] The server retrieves the information from the database and returns it to the terminal.

[1510] The server retrieves information about "Tokyo Tower" and "sushi restaurants" from the database. It then sends the retrieved information back to the device. The input is a search request, and the output is information about tourist spots and restaurants. Specifically, the server executes a database query and retrieves the results.

[1511] Step 6:

[1512] The terminal displays the information.

[1513] The device displays the information received from the server within the app, allowing users to check detailed information about tourist attractions and restaurants. The input is information from the server, and the output is displayed on the app screen.

[1514] Step 7:

[1515] The emotion engine recognizes the user's emotions.

[1516] The device uses a camera and microphone to collect the user's facial expressions and voice. The emotion engine analyzes this data and recognizes the user's emotions. The input is facial expression data and voice data, and the output is recognized emotional information. Specifically, the emotion engine performs image analysis and voice analysis.

[1517] Step 8:

[1518] The server provides information according to the emotion.

[1519] Based on the information from the emotion engine, the server prioritizes providing information on tourist spots and restaurants that correspond to the user's emotions. The input is emotion information, and the output is information corresponding to the emotion. Specifically, the server analyzes the emotion information and filters related data.

[1520] Step 9:

[1521] The user provides feedback.

[1522] Users input feedback about tourist spots and restaurants in the app and tap the feedback button to submit. The input is the user's feedback, and the output is the feedback sent to the server.

[1523] Step 10:

[1524] The server stores the feedback in a database.

[1525] The server receives feedback from users and stores it in a database. The stored feedback can be shared with other users. The input is the user's feedback, and the output is storage in the database. Specifically, the server inserts the feedback data into the database.

[1526] (Application example 1)

[1527] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1528] Conventional tourism applications provide information without considering tourists' feelings, which can result in failure to provide the information tourists need. Furthermore, emergency contact and safety information is insufficient, making it difficult for tourists to enjoy sightseeing with peace of mind. Furthermore, the lack of communication methods between tourists can lead to a decline in the quality of the tourist experience.

[1529] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes a recommended sightseeing point means, an itinerary plan providing means, a language means, a Japanese culture guide means, a local festival and event information means, a recommended shop and food guide means, a shopping guide means, an emergency contact and safety information means, a tourist information feedback means, a weather information means, a means for communication between tourists, an emotion recognition means, and an emotion-based information providing means. This makes it possible to provide information according to the tourists' emotions, allowing tourists to enjoy sightseeing with peace of mind and improving the quality of their sightseeing experience.

[1530] "Recommended tourist spots" refer to tourist spots and famous places that tourists should visit.

[1531] "Itinerary planning means" refers to the function for planning and proposing travel itineraries for tourists.

[1532] "Language" refers to the language used by tourists, including translation and interpretation functions.

[1533] "Japanese cultural guide means" refers to the function of explaining Japanese culture and customs to tourists.

[1534] "Local festival and event information means" refers to the function of providing information on festivals and events held in tourist destinations.

[1535] "Recommended restaurants and food guide" refers to a function that introduces recommended restaurants and dishes to tourists.

[1536] "Shopping guide means" refers to a function that introduces recommended shopping spots and products to tourists.

[1537] "Emergency communication and safety information means" refers to functions that provide means for tourists to contact each other in the event of an emergency and safety information.

[1538] "Tourism information feedback means" refers to the function that enables tourists to provide feedback about the places and services they have visited.

[1539] "Weather information means" refers to a function for providing weather information for tourist destinations.

[1540] "Means of communication between tourists" refers to functions that allow tourists to share information and communicate with each other.

[1541] "Emotion recognition means" refers to the function for recognizing tourists' emotions.

[1542] "Emotion-based information provision means" refers to a function that provides appropriate information according to the tourists' emotions.

[1543] As an embodiment of the present invention, a smart tourist guide system for tourists is provided. The system includes an application installed on a smartphone or smart glasses used by tourists. Specific embodiments of this system are described below.

[1544] System configuration

[1545] The system consists of the following main components:

[1546] 1. Server: Manages tourist information, weather information, event information, etc. and provides it to user terminals.

[1547] 2. User device: A device such as a smartphone or smart glasses on which the application is installed.

[1548] 3. Emotion Recognition Engine: Software that recognizes the user's emotions and provides information based on them.

[1549] Hardware and software used

[1550] Hardware: Smartphones, smart glasses

[1551] Software: Emotion recognition engine, requests (HTTP request library)

[1552] Data processing and calculation

[1553] The server processes and calculates the data using the following means:

[1554] 1. Obtaining tourist spot information: The server obtains tourist spot information through the API and provides it to the user terminal.

[1555] 2. Obtaining weather information: The server obtains weather information through the API and provides it to the user's device.

[1556] 3. Emotion recognition: An emotion recognition engine installed on the user's device recognizes the user's emotions in real time.

[1557] 4. Providing information based on emotions: Based on the emotions recognized by the emotion recognition engine, the server provides appropriate information to the user terminal.

[1558] Specific examples

[1559] For example, if the user is in Tokyo, the system will operate as follows:

[1560] 1. When the user opens the application, the current location is recognized as "Tokyo."

[1561] 2. The server obtains information about tourist spots and weather around Tokyo through the API and provides it to the user's device.

[1562] 3. If the user expresses the emotion of "joy," the emotion recognition engine recognizes this, and the server provides tourist spot information to the user terminal with priority.

[1563] 4. If the user expresses an emotion of "anxiety," the emotion recognition engine will recognize it, and the server will provide safety information and emergency contact information to the user's device with priority.

[1564] Prompt Sentence Examples

[1565] "When a tourist in Tokyo expresses happiness, create an application that prioritizes displaying information about nearby tourist spots."

[1566] In this way, a system is provided that allows tourists to enjoy a more comfortable and safe sightseeing experience.

[1567] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1568] Step 1:

[1569] The user launches the application. As input, the user's current location information is obtained from the device. The device uses its GPS function to determine the current location and sends that information to the server. As output, the current location information is sent to the server.

[1570] Step 2:

[1571] The server receives the current location information and retrieves tourist spot information. The current location information is sent to the server as input. The server then sends a request to the tourist spot information API to retrieve tourist spot information around the current location. The tourist spot information is returned to the server as output.

[1572] Step 3:

[1573] The server gets weather information. As input, the current location information is sent to the server. The server sends a request to the weather information API to get the weather information for the current location. As output, the weather information is returned to the server.

[1574] Step 4:

[1575] The device uses an emotion recognition engine to recognize the user's emotions. The user's facial expressions and voice data are input to the device. The emotion recognition engine analyzes this data and identifies the user's emotions. The device generates recognized emotion information as output.

[1576] Step 5:

[1577] The terminal sends the recognized emotion information to the server. As input, emotion information is generated on the terminal. The terminal sends this information to the server. As output, emotion information is sent to the server.

[1578] Step 6:

[1579] The server selects appropriate information based on the emotion information. The emotion information, tourist spot information, and weather information are stored on the server as input. The server analyzes the emotion information and selects tourist spot information and safety information according to the user's emotion. The selected information is generated on the server as output.

[1580] Step 7:

[1581] The server sends the selected information to the terminal. As input, the selected information is generated at the server. The server sends this information to the terminal. As output, the selected information is sent to the terminal.

[1582] Step 8:

[1583] The terminal displays the received information to the user. As input, selected information is sent to the terminal. The terminal displays this information to the user. As output, the information becomes available for the user to review.

[1584] In this way, a system is realized that allows tourists to enjoy a more comfortable and safe sightseeing experience.

[1585] Example 2

[1586] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1587] Conventional tourist information systems do not display advertisements based on tourists' emotions, making it difficult to provide information that matches tourists' interests. Furthermore, the lack of emotion recognition functionality in applications used by tourists also creates a problem of being unable to improve the user experience.

[1588] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes an emotion recognition means, an emotion-based advertisement display means, and a tourist information provision means. This makes it possible to display advertisements according to the tourists' emotions and provide information that matches the tourists' interests and concerns. In addition, the emotion recognition function improves the user experience.

[1589] The "means for providing recommended tourist spots" is a function that suggests tourist spots that tourists should visit.

[1590] The "schedule planning means" is a function for efficiently planning a tourist's travel itinerary.

[1591] "Language guide means" refers to translation and interpretation functions that make it easier for tourists to understand the local language.

[1592] "Cultural guide means" is a function that provides tourists with information about the culture and customs of the place they are visiting.

[1593] The "local festival information provision means" is a function that provides tourists with information about festivals and events held in the area they are visiting.

[1594] The "event information providing means" is a function that provides tourists with information about various events being held at the destination.

[1595] "Means for providing information on recommended stores" is a function that suggests recommended stores and restaurants to tourists at their destinations.

[1596] The "Cuisine Guide" is a function that introduces tourists to local cuisine and recommended dishes at the destination they are visiting.

[1597] The "shopping guide means" is a function that provides tourists with information about shopping at the destination they are visiting.

[1598] "Emergency contact methods" is a function that allows tourists to contact others in an emergency.

[1599] "Safety information provision means" is a function that provides tourists with information about the safety of the destination they are visiting.

[1600] The "tourist information feedback means" is a function that enables tourists to provide feedback on the tourist information of the destination they are visiting.

[1601] The "weather information providing means" is a function that provides tourists with weather information about the destination.

[1602] "Means of communication between tourists" refers to a function that allows tourists to share information and communicate with each other.

[1603] "Emotion recognition means" is a function for recognizing the emotions of tourists.

[1604] The "means for displaying advertisements according to emotions" is a function that displays appropriate advertisements according to the emotions of tourists.

[1605] This invention is a system that generates profits by providing services to tourists. Specifically, tourist spots, restaurants, shopping malls, and other businesses can post advertisements through the app. In addition, by combining it with an emotion engine, it has the function of displaying advertisements according to the emotions of tourists.

[1606] Hardware and software used

[1607] Server: Manages the advertising database, runs the emotion engine, and stores user data.

[1608] Device: Smartphone or tablet used by tourists, with the application installed.

[1609] Emotion engine: Software for recognizing tourists' emotions. For example, using emotion recognition APIs from popular cloud services.

[1610] Application: An app used by tourists that displays advertisements and allows users to search for tourist information.

[1611] Program processing

[1612] When a user launches the app and searches for information on tourist attractions or restaurants, the device's camera and microphone capture the user's facial expressions and voice. This data is sent to the emotion engine, which analyzes the user's emotions. The analysis results are sent to the server, which selects appropriate advertisements from an advertising database based on the emotion data. The selected advertisements are sent to the device, and the app displays them on the user's screen.

[1613] Specific examples

[1614] For example, suppose a tourist is searching for tourist spots in Tokyo. The user opens the app and the camera captures the user's facial expression. If the emotion engine recognizes excitement from the user's facial expression, the server will prioritize displaying advertisements for Tokyo Disneyland and Odaiba, which are areas with a lot of activity.

[1615] Prompt Sentence Examples

[1616] An example of a prompt sentence to input to the generative AI model is as follows:

[1617] "When a tourist is searching for tourist attractions in Tokyo, explain what kind of ads you would show them if your emotion engine recognized the emotion of excitement."

[1618] By feeding this prompt into a generative AI model, a detailed explanation of how the system works and the criteria for selecting ads can be obtained.

[1619] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1620] Step 1:

[1621] A user launches an app. A user taps on a tourism app on their smartphone or tablet to launch it. The app displays the initial screen and offers the user options to search for tourist attractions and restaurants. The input is the user's operation, and the output is the display of the initial screen.

[1622] Step 2:

[1623] A user searches for tourist information. The user enters a keyword, such as "tourist spots in Tokyo," into the search bar within the app. The app sends the entered keyword to the server and requests related tourist information. The input is the user's search keyword, and the output is the request sent to the server.

[1624] Step 3:

[1625] The device captures the user's emotions. The device's camera and microphone capture the user's facial expressions and voice. For example, the camera captures the user's face and the microphone records the user's tone of voice. The input is the user's facial expressions and voice, and the output is the captured data.

[1626] Step 4:

[1627] The emotion engine analyzes emotions. The device sends the captured data to the emotion engine. The emotion engine uses the emotion recognition API of a general cloud service to analyze the user's emotions. For example, it recognizes the emotion "excitement" from the user's facial expression. The input is the captured data, and the output is analyzed emotion data.

[1628] Step 5:

[1629] The server selects an appropriate advertisement. Based on the emotion data received from the emotion engine, the server selects an appropriate advertisement from the advertisement database. For example, if the user expresses the emotion "excitement," the server selects advertisements for tourist spots and entertainment facilities with plenty of activities. The input is emotion data, and the output is the selected advertisement data.

[1630] Step 6:

[1631] The device displays the advertisement. The device receives the advertisement data sent from the server. The app displays the selected advertisement on the user's screen. For example, advertisements for Tokyo Disneyland or Odaiba are displayed. The input is the advertisement data from the server, and the output is the advertisement displayed on the user's screen.

[1632] (Application example 2)

[1633] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1634] Conventional tourist service systems do not adequately provide information tailored to the emotions and interests of tourists, making it difficult to increase tourist satisfaction. Furthermore, there is a lack of real-time, personalized information provided at tourist destinations and stores, making it necessary to improve tourist convenience.

[1635] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1636] In this invention, the server includes an emotion recognition means, an emotion-based advertisement display means, and a personalized information provision means, which makes it possible to recognize the emotions of tourists in real time and provide advertisements and information according to those emotions.

[1637] "International tourists" refers to tourists visiting from other countries.

[1638] A "prepaid SIM" is a SIM card that you pay for in advance.

[1639] "Recommended tourist spot means" refers to the function of recommending tourist spots to tourists.

[1640] "Itinerary planning means" refers to the function of planning and providing tourist travel itineraries.

[1641] "Language and Japanese culture guide means" refers to the function of providing tourists with information about Japanese language and culture.

[1642] "Local festival and event information means" refers to the function of providing tourists with information about local festivals and events.

[1643] "Recommended restaurants and food guide" refers to a function that recommends restaurants and dishes that tourists should visit.

[1644] "Shopping guide means" refers to the function of providing tourists with shopping information.

[1645] "Emergency contact and safety information means" refers to the function of providing tourists with emergency contact methods and safety information.

[1646] "Tourism information feedback means" refers to the function of collecting evaluations and opinions of tourists regarding the tourist spots and stores they visit.

[1647] "Weather information means" refers to the function of providing weather information to tourists.

[1648] "Means of communication between tourists" refers to functions that allow tourists to share information and communicate with each other.

[1649] "Emotion recognition means" refers to the function of recognizing emotions from tourists' facial expressions and tone of voice.

[1650] "Emotion-based advertising display means" refers to a function that displays appropriate advertisements based on recognized emotions.

[1651] "Personalized information provision means" refers to the function of providing customized information based on tourists' interests and past behavioral history.

[1652] This invention aims to improve tourist satisfaction and convenience by combining emotion recognition and personalized information provision in a service provision system for tourists. Specific embodiments for realizing this system are described below.

[1653] System configuration

[1654] The system consists of the following major components:

[1655] 1. Emotion recognition method: Using the smartphone camera and microphone, emotions are recognized from tourists' facial expressions and tone of voice.

[1656] 2. Emotion-based advertising: Prioritize advertisements for tourist attractions, restaurants, and shopping malls based on perceived emotions.

[1657] 3. Personalized information provision: Providing customized information based on tourists' interests and past behavioral history.

[1658] Hardware and software used

[1659] Hardware: Smartphone (camera, microphone)

[1660] Software: OpenCV (image processing library), Keras (deep learning library), Requests (HTTP request library)

[1661] Processing flow

[1662] emotion recognition

[1663] The server uses the smartphone's camera and microphone to capture the tourist's facial expressions and tone of voice, allowing it to recognize the tourist's emotions in real time. Specifically, it uses OpenCV for face detection and Keras for emotion prediction.

[1664] Advertisement display

[1665] The server then selects appropriate advertisements based on the recognized emotions and displays them on the smartphone. For example, if a tourist expresses "happiness," it will display an advertisement for a nearby popular restaurant.

[1666] Providing personalized information

[1667] The server provides customized information based on the tourist's past behavior history and interests, allowing the tourist to obtain information that matches their interests.

[1668] Specific examples

[1669] When tourists use their smartphone cameras, the app analyzes their facial expressions and recognizes the emotion "happiness," then displays advertisements for popular nearby restaurants and offers special discounts.

[1670] Prompt Sentence Examples

[1671] "Develop an application that analyzes facial expressions to recognize emotions when tourists use their smartphone cameras and then displays relevant advertisements based on those emotions."

[1672] The above is a specific embodiment for carrying out the present invention. This system makes it possible to provide information that responds to the emotions of tourists, thereby significantly improving tourist satisfaction and convenience.

[1673] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1674] Step 1:

[1675] The server uses the smartphone's camera and microphone to capture the tourist's facial expressions and tone of voice. The input is the camera video and audio data, and the output is the captured image and audio data. Specifically, it activates the smartphone's camera and microphone and collects data in real time.

[1676] Step 2:

[1677] The server performs face detection on the captured image data using OpenCV. The input is the image data obtained in step 1, and the output is the coordinate information of the detected face area. Specifically, the server applies a face detection algorithm to identify the position of the face in the image.

[1678] Step 3:

[1679] The server inputs the detected face region into a Keras deep learning model to predict emotions. The input is the image data of the face region obtained in step 2, and the output is the predicted emotion label. Specifically, the server preprocesses the face region and inputs it into the deep learning model to classify the emotion.

[1680] Step 4:

[1681] The server selects an appropriate advertisement based on the predicted emotion. The input is the emotion label obtained in step 3, and the output is the selected advertisement data. Specifically, it searches the database for advertisements that correspond to the emotion label and selects the most appropriate advertisement.

[1682] Step 5:

[1683] The server displays the selected advertisement on the smartphone. The input is the advertisement data obtained in step 4, and the output is the advertisement displayed on the smartphone screen. Specifically, the advertisement data is sent to the smartphone and displayed through the user interface.

[1684] Step 6:

[1685] The server provides personalized information based on the tourist's past behavior history and interests. The input is the tourist's behavior history data and interest data, and the output is customized information. Specifically, the server analyzes the behavior history and interest data, and selects and provides relevant information.

[1686] Step 7:

[1687] The user checks the provided advertisements and information and takes action as necessary. The input is the advertisement or information displayed on the smartphone, and the output is the user's behavior. Specific actions include the user clicking on an advertisement or visiting a tourist spot or store based on the provided information.

[1688] Example 3

[1689] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1690] When tourists visit tourist spots, they face the challenge of being unable to grasp information such as crowd levels, waiting times, and opening hours in real time. Furthermore, there is a lack of ways for them to share ratings and reviews of tourist spots and restaurants with other tourists, making it difficult to plan their trips efficiently. Furthermore, because information is not provided in response to tourists' emotions, it is not possible to provide the optimal tourist experience for each individual tourist.

[1691] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1692] In this invention, the server includes means for collecting and providing information on tourist attraction congestion, waiting times, and opening hours, means for sharing ratings and reviews of tourist attractions and restaurants, and means for recognizing tourist emotions and providing information on tourist attractions and restaurants accordingly. This allows tourists to grasp information on tourist attractions in real time and refer to the ratings and reviews of other tourists. It also makes it possible to provide information according to tourist emotions, thereby providing each tourist with the optimal sightseeing experience.

[1693] "Crowding status of tourist spots" is information indicating the number and density of visitors at tourist spots.

[1694] "Waiting time" refers to the time required to receive service at tourist spots, restaurants, etc.

[1695] "Opening hours" refers to the time when tourist attractions and facilities begin operating.

[1696] "Ratings" are numbers and comments that express visitors' satisfaction and opinions about tourist attractions and restaurants.

[1697] "Reviews" are detailed opinions and impressions written by visitors about tourist attractions and restaurants.

[1698] "Emotion recognition" means analyzing the emotional state of tourists from their facial expressions, voices, etc.

[1699] "Information on tourist attractions and restaurants" is detailed data and recommendations on tourist attractions and restaurants.

[1700] The "schedule planning means" is a function that proposes a schedule for tourists to enjoy sightseeing efficiently.

[1701] "Language and Japanese culture guide means" is a function that provides tourists with information about Japanese language and culture.

[1702] The "local festival and event information means" is a function that provides information about festivals and events held in a specific area.

[1703] "Recommended restaurants and food guide" is a function that provides tourists with information about recommended restaurants and food.

[1704] The "shopping guide means" is a function that provides tourists with information about recommended shopping spots and products.

[1705] "Emergency contact and safety information means" is a function that provides tourists with information to contact in an emergency and safety information.

[1706] "Tourist information feedback means" is a function that allows tourists to post ratings and reviews of tourist spots and restaurants they have visited.

[1707] "Weather information means" is a function that provides tourists with the current weather and forecast.

[1708] "Means of communication between tourists" refers to a function that allows tourists to share information and exchange opinions with other tourists.

[1709] This invention is a system for improving convenience for tourists, providing information on the congestion status, waiting times, and opening hours of tourist attractions, sharing ratings and reviews of tourist attractions and restaurants, and providing information based on tourist sentiment. A specific embodiment of this system is described below.

[1710] Hardware and software used

[1711] The server collects information on tourist attractions' congestion levels, waiting times, and opening hours and stores it in a database. This information is obtained from the tourist attraction's management system and real-time sensors. The server also stores ratings and reviews of tourist attractions and restaurants, making them available for other users to view. It also analyzes tourists' emotions using emotion recognition software (e.g., a general emotion recognition API).

[1712] The device (tourist's smartphone) connects to the server through a dedicated application and requests information about tourist spots. The device captures the tourist's facial expressions and voice through a camera and microphone and sends them to emotion recognition software.

[1713] Through the app, users (tourists) can check information such as the congestion status, waiting times, and opening hours of tourist spots, and can post ratings and reviews of the tourist spots and restaurants they visit. Users can also receive information about tourist spots and restaurants that reflect their own feelings.

[1714] Specific examples

[1715] 1. A user opens the app and sends a request to check the "Tokyo Tower congestion status."

[1716] 2. The server calculates the congestion situation based on real-time sensor information and sends it to the terminal.

[1717] 3. The user checks the information displayed in the app, saying "Tokyo Tower is currently crowded."

[1718] 4. The user opens the app and smiles at the camera.

[1719] 5. The device sends the smiling image to emotion recognition software, which analyzes the emotion of "enjoyment."

[1720] 6. The server selects information about amusement parks and theme parks based on the emotion of "fun" and sends it to the terminal.

[1721] 7. The user checks the information displayed in the app as "Recommended Amusement Parks: Theme Parks."

[1722] Prompt Sentence Examples

[1723] "How can I check the congestion status of tourist attractions in real time?"

[1724] "Please explain how the system works, which uses an emotion engine to suggest tourist spots based on tourists' emotions."

[1725] This system allows tourists to grasp information about tourist spots in real time and refer to the ratings and reviews of other tourists. It also makes it possible to provide information according to the tourists' feelings, thereby providing the optimal sightseeing experience for each individual tourist. The flow of the identification process in the third embodiment will be described with reference to FIG. 21.

[1726] Step 1:

[1727] A user opens the app and requests information about a tourist attraction.

[1728] Input: A user submits a request in the app to check the crowd status of a tourist spot (e.g., Tokyo Tower).

[1729] Specific operation: The user enters "Tokyo Tower" in the app's search bar and presses the search button.

[1730] Output: The request is sent to the server.

[1731] Step 2:

[1732] The server collects information on the congestion status, waiting times, and opening hours of tourist attractions.

[1733] Input: The request received by the server.

[1734] Specific operation: The server obtains real-time sensor information and data from the tourist attraction management system.

[1735] Data processing: Analyze the acquired data and calculate congestion levels, waiting times, and opening times.

[1736] Output: Sends the analysis results to the terminal.

[1737] Step 3:

[1738] The terminal displays the information received from the server to the user.

[1739] Input: Information on congestion status, waiting time, and opening hours sent from the server.

[1740] Specific operation: The data received by the device is displayed on the app screen.

[1741] Output: The user confirms information such as "Tokyo Tower is currently crowded."

[1742] Step 4:

[1743] Users post ratings and reviews of tourist attractions and restaurants.

[1744] Input: Ratings and reviews of attractions and restaurants visited by the user.

[1745] What happens: A user uses the app's rating and review feature to enter a comment or star rating.

[1746] Output: Ratings and reviews are sent to the server.

[1747] Step 5:

[1748] The server stores the received ratings and reviews in a database, making them available for other users to view.

[1749] Input: Ratings and reviews submitted by users.

[1750] What happens: The server stores the ratings and reviews in a database.

[1751] Output: Other users can view your ratings and reviews.

[1752] Step 6:

[1753] The user opens the app and shows their face to the camera.

[1754] Input: User's facial expression data.

[1755] Specific action: The user captures their facial expression using the app's camera function.

[1756] Output: The captured facial expression data is saved on the device.

[1757] Step 7:

[1758] The device transmits the captured facial expression data to emotion recognition software.

[1759] Input: Captured facial expression data.

[1760] Specific operation: The device sends facial expression data to emotion recognition software.

[1761] Data processing: Emotion recognition software analyzes facial expression data and recognizes emotions.

[1762] Output: The analysis results are sent to the server.

[1763] Step 8:

[1764] The server selects information about tourist attractions and restaurants based on the analysis results and sends it to the device.

[1765] Input: Analysis results sent from emotion recognition software.

[1766] Specific operation: The server selects information on relevant tourist attractions and restaurants based on the analysis results.

[1767] Output: The selected information is sent to the terminal.

[1768] Step 9:

[1769] The terminal displays the information received from the server to the user.

[1770] Input: Information about tourist attractions and restaurants sent from the server.

[1771] Specific operation: The data received by the device is displayed on the app screen.

[1772] Output: The user checks information such as "Recommended amusement parks: Theme parks."

[1773] (Application example 3)

[1774] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1775] Conventional tourism support systems make it difficult for tourists to obtain real-time information on tourist spots' congestion levels, waiting times, opening hours, and other factors, making it difficult to plan efficient sightseeing trips. Furthermore, communication between tourists was limited, and information provided was not tailored to their emotions, which could result in a decline in the quality of the tourist experience. Furthermore, there was a lack of ways to share ratings and reviews of tourist spots and restaurants, making it difficult to obtain information that would be useful to other tourists. There is a need to solve these issues and improve tourist convenience and satisfaction.

[1776] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1777] In this invention, the server includes a means for providing recommended sightseeing spots and itineraries, a language and Japanese culture guide, a means for providing local festival and event information, a means for providing recommended shops and food guides, a shopping guide, a means for contacting tourists in case of an emergency and providing safety information, a means for providing feedback on sightseeing information, a means for weather information, a means for communication between tourists, a means for providing information on the congestion status, waiting times, and opening hours of sightseeing spots, a means for sharing ratings and reviews of sightseeing spots and restaurants, and a means for recognizing tourists' emotions using an emotion engine and providing communication in response to the emotions. This allows tourists to obtain the information they need in real time and make efficient sightseeing plans. Furthermore, providing information in response to emotions can improve the quality of the sightseeing experience.

[1778] "Recommended tourist spots" refer to tourist destinations and famous places that are considered to be worth visiting for tourists.

[1779] "Schedule planning means" refers to the function of creating and providing schedules that allow tourists to enjoy sightseeing efficiently.

[1780] "Language and Japanese culture guide means" refers to the function of providing tourists with information about the Japanese language and Japanese culture.

[1781] "Local festival and event information means" refers to the function of providing tourists with information about festivals and events held in the area they are visiting.

[1782] "Recommended restaurants and food guide" refers to a function that provides tourists with information about restaurants and food that are considered worth visiting.

[1783] "Shopping guide means" refers to the function of providing tourists with information about shopping spots and products that are considered worth visiting.

[1784] "Emergency communication and safety information means" refers to functions that provide tourists with means to contact others in an emergency and safety information.

[1785] "Tourism information feedback means" refers to a function that allows tourists to share their evaluations and opinions about the tourist spots and facilities they visit.

[1786] "Weather information means" refers to the function of providing tourists with weather forecasts and meteorological information for the destinations they visit.

[1787] "Means of communication between tourists" refers to functions that allow tourists to exchange information and communicate with other tourists.

[1788] "Means of providing information on the congestion situation, waiting times, and opening hours of tourist spots" refers to the function of providing tourists with information on the congestion situation, waiting times, and opening hours of tourist spots they visit.

[1789] "Means for sharing ratings and reviews of tourist spots and restaurants" refers to a function that allows tourists to share ratings and reviews of tourist spots and restaurants they have visited with other tourists.

[1790] "Means of recognizing tourists' emotions using an emotion engine and providing communication accordingly" refers to the function of recognizing tourists' emotions and providing information and communication according to those emotions.

[1791] To implement this invention, it is necessary to build a system that provides applications for tourists. This system includes a server and user terminals (smartphones, tablets, etc.). The specific configuration and operation of the system are described below.

[1792] System Configuration

[1793] 1. Server:

[1794] Database: Stores tourist attractions, restaurants, event information, user ratings and reviews, weather information, etc.

[1795] Emotion engine: Includes an AI model to recognize user emotions and provide information accordingly.

[1796] API: An interface for receiving requests from user devices and providing the necessary data.

[1797] 2. User Device:

[1798] Application: Provides an interface for users to obtain tourist information, post ratings and reviews, and communicate with other tourists.

[1799] Camera and microphone: Used by the emotion engine to analyze the user's facial expressions and tone of voice.

[1800] Operation explanation

[1801] 1. Providing tourist information:

[1802] The user opens the application and requests information about attractions.

[1803] The server retrieves information about the relevant tourist spot (such as congestion status, waiting time, opening hours, etc.) from the database and sends it to the user's terminal.

[1804] Users can check tourist spot information in real time through the application.

[1805] 2. Share your ratings and reviews:

[1806] Users enter ratings and reviews of tourist spots and restaurants they have visited into the application.

[1807] The server stores these ratings and reviews in a database that can be accessed by other users.

[1808] Other users can use these ratings and reviews to plan their trips.

[1809] 3. Information provided by emotion engine:

[1810] While the user is using the application, the emotion engine analyzes the user's facial expressions and tone of voice via the camera and microphone.

[1811] The emotion engine recognizes the user's emotions and provides information on tourist spots and restaurants accordingly.

[1812] For example, if the user indicates an emotion of enjoyment, the emotion engine provides tourist attractions and event information related to enjoyment.

[1813] Specific examples

[1814] Check tourist attractions' crowds:

[1815] When a user types into the application, "Tell me how crowded it is at Tokyo Tower," the server retrieves the real-time congestion information from the database and provides it to the user.

[1816] Using the Emotion Engine:

[1817] When the camera detects a user smiling while using the application, the emotion engine recognizes the emotion of "fun" and displays the message, "Looking for tourist spots related to fun?"

[1818] Prompt Sentence Examples

[1819] "Tell me how crowded it is at Tokyo Tower."

[1820] "Tell me a restaurant you recommend."

[1821] "Tell me about a tourist spot that suits my mood right now."

[1822] In this way, tourists can obtain the information they need in real time, enabling them to plan their trips efficiently. In addition, providing information tailored to their emotions can improve the quality of their tourist experience.

[1823] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1824] Step 1:

[1825] A user launches the application and requests information about tourist attractions.

[1826] Input: The user types into the application, "Tell me how crowded Tokyo Tower is."

[1827] Output: The application sends a request to the server.

[1828] Specific operation: The user opens the application on their smartphone, enters "Tell me how crowded it is at Tokyo Tower" in the text box, and presses the send button.

[1829] Step 2:

[1830] The server receives the request and retrieves the information about the relevant tourist spot from the database.

[1831] Input: The server receives a request from the user.

[1832] Output: Obtain information on the congestion status, waiting time, and opening hours of "Tokyo Tower" from the database.

[1833] What happens: The server parses the request and executes a database query to retrieve the latest crowd levels, wait times, and opening hours for Tokyo Tower.

[1834] Step 3:

[1835] The server transmits the acquired information to the user terminal.

[1836] Input: Information about "Tokyo Tower" retrieved by the server from the database.

[1837] Output: Sends information to the user's terminal.

[1838] Specific operation: The server converts the acquired information into JSON format and sends it to the user device as an HTTP response.

[1839] Step 4:

[1840] The user terminal displays the information received from the server.

[1841] Input: Information on Tokyo Tower's congestion status, waiting time, and opening hours sent from the server.

[1842] Output: Display information to the user.

[1843] Specific operation: The application analyzes the received JSON data and displays on the screen, "The current congestion situation at Tokyo Tower is XX, the waiting time is XX minutes, and the opening hours are XX."

[1844] Step 5:

[1845] Users enter ratings and reviews of tourist spots and restaurants they have visited into the application.

[1846] Input: A user enters a rating or review into the application.

[1847] Output: The application sends the rating and review to the server.

[1848] Specific operation: The user enters ratings and reviews of tourist spots and restaurants they have visited in the text boxes and presses the submit button.

[1849] Step 6:

[1850] The server stores the ratings and reviews in a database.

[1851] Input: User-submitted ratings and reviews.

[1852] Output: Store the ratings and reviews in a database.

[1853] Specific behavior: The server executes an INSERT query to store the received ratings and reviews in the database.

[1854] Step 7:

[1855] The emotion engine recognizes the user's emotions and provides information accordingly.

[1856] Input: The user's facial expression and tone of voice.

[1857] Output: Information on tourist attractions and events according to emotions.

[1858] Specific behavior: When the user is using the application, the emotion engine analyzes the user's facial expressions and tone of voice through the camera and microphone, and if the user shows an emotion of enjoyment, it displays the message "Looking for tourist attractions related to enjoyment."

[1859] Step 8:

[1860] The user checks the information provided by the emotion engine and makes a sightseeing plan.

[1861] Input: Attraction and event information provided by the sentiment engine.

[1862] Output: The user makes a sightseeing plan.

[1863] Specific behavior: The user checks the information provided by the emotion engine, selects the tourist spots and events they want to visit, and plans their itinerary.

[1864] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1865] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1866] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are listed.

[1867] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1868] [Third embodiment]

[1869] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1870] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1871] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1872] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1873] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1874] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1875] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1876] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1877] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1878] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1879] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1880] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1881] "Example 1"

[1882] One aspect of the present invention is a system that creates prepaid SIM cards for overseas tourists and provides apps for users of those SIM cards. This system includes recommended sightseeing spots, itinerary planning, language and Japanese culture guides, local festival and event information, recommended shops and food guides, shopping guides, emergency contact and safety information, tourist information feedback, weather information, and communication between tourists. Specifically, tourists can obtain information about tourist spots and restaurants near their current location through the app. Real-time information on tourist spot congestion and weather is also provided. Furthermore, in emergencies, safety information is provided through the app, allowing tourists to take appropriate action quickly.

[1883] "Example 2"

[1884] Another aspect of the present invention is a system that can generate profits by providing services to tourists. Specifically, businesses such as tourist spots, restaurants, and shopping malls can post advertisements through the app. This allows businesses to effectively advertise to tourists, and tourists can obtain information that matches their interests.

[1885] "Example 3"

[1886] Furthermore, as an embodiment of the present invention, there is a system with functions to improve convenience for tourists. Specifically, tourists can obtain information such as the congestion status, waiting times, and opening hours of tourist spots through the app. In addition, ratings and reviews of tourist spots and restaurants can be shared, which can be helpful to other tourists. This allows tourists to enjoy sightseeing more efficiently.

[1887] The processing flow of each embodiment will be described below.

[1888] "Example 1"

[1889] Step 1: Tourists download the app and insert a prepaid SIM card.

[1890] Step 2: Tourists open the app and search for information on tourist attractions and restaurants near their current location.

[1891] Step 3: Real-time information about tourist attractions' congestion status and weather is displayed.

[1892] Step 4: In case of an emergency, safety information will be provided through the app and tourists will be able to take appropriate action promptly.

[1893] "Example 2"

[1894] Step 1: Tourist attractions, restaurants, shopping malls, and other businesses apply to advertise with the app administrator.

[1895] Step 2: The app administrator places the ad in the app.

[1896] Step 3: Tourists view advertisements through the app and use the business's services.

[1897] "Example 3"

[1898] Step 1: Tourists open the app and search for information such as tourist attraction congestion status, waiting times, and opening hours.

[1899] Step 2: Share your ratings and reviews of attractions and restaurants.

[1900] Step 3: Plan your trip by referring to the ratings and reviews of other tourists.

[1901] Example 1

[1902] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1903] Conventional tourist information systems have difficulty providing comprehensive information that tourists need, and language barriers and cultural differences have been particularly problematic for tourists from overseas. Furthermore, the provision of safety information in emergencies was insufficient, making it difficult for tourists to take appropriate action quickly. Furthermore, there was a lack of systems that provided real-time weather information and information on the congestion status of tourist spots, resulting in low convenience for tourists.

[1904] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1905] In this invention, the server includes a means for acquiring current location information, a means for providing information on tourist spots around the current location, a means for providing congestion status at tourist spots, a means for providing real-time weather information, and a means for notifying safety information in emergencies. This allows tourists to comprehensively receive the information they need, overcome language barriers and cultural differences, and take appropriate action quickly in emergencies. Furthermore, providing information on the congestion status of tourist spots and real-time weather information significantly improves convenience for tourists.

[1906] A "prepaid SIM for overseas tourists" is a communication card that tourists from overseas purchase in advance for use within Japan.

[1907] An "app" is a software program that runs on a mobile device such as a smartphone or tablet.

[1908] The "means for providing recommended tourist spots" is a function that suggests tourist spots that tourists should visit.

[1909] The "schedule planning means" is a function that provides information and tools for tourists to efficiently plan their travel itineraries.

[1910] "Language support measures" are translation and interpretation functions that make it easier for tourists to understand the local language.

[1911] "Cultural guide means" is a function that provides tourists with information about the culture and customs of the place they are visiting.

[1912] The "means for providing information on local festivals and events" is a function that provides tourists with information on festivals and events held in the destinations they visit.

[1913] "Recommended restaurants and food guide" is a function that introduces recommended restaurants and dishes to tourists at their destinations.

[1914] The "shopping guide means" is a function that provides tourists with information about shopping at the destination they are visiting.

[1915] "Emergency contact and safety information provision means" refers to functions that provide tourists with means to quickly contact each other in the event of an emergency and provide safety information.

[1916] "Tourist information feedback means" is a function that allows tourists to provide their opinions and evaluations of the tourist spots and services they visit.

[1917] The "weather information providing means" is a function that provides tourists with weather information about the destination.

[1918] "Means of communication between tourists" refers to a function that allows tourists to share information and communicate with each other.

[1919] "Means for obtaining current location information" is a function that obtains the tourist's current location using technology such as GPS.

[1920] The "means for providing information on tourist spots around the current location" is a function that provides information on tourist spots around the tourist's current location.

[1921] The "means for providing information on congestion status at tourist spots" is a function that provides tourists with real-time information on congestion status at tourist spots they are visiting.

[1922] The "real-time weather information providing means" is a function that provides tourists with real-time weather information about the destination.

[1923] "Emergency safety information notification means" is a function that quickly notifies tourists of safety information in emergencies such as earthquakes and typhoons.

[1924] This invention is a system that creates prepaid SIM cards for overseas tourists and provides apps for those who use those SIM cards. The system aims to comprehensively provide tourists with the information they need and improve the convenience and safety of their travels.

[1925] Hardware and software used

[1926] server

[1927] The server collects and provides information using databases, external APIs, and communication protocols. Specifically, it uses the following hardware and software:

[1928] Database management systems: MySQL, PostgreSQL, etc.

[1929] External API: Google Maps API, OpenWeatherMap API, Japan Meteorological Agency API, etc.

[1930] Communication protocol: HTTPS

[1931] Terminal

[1932] The device is a user's smartphone or tablet, and communicates with the server using GPS and an internet connection. Specifically, the device uses the following hardware and software:

[1933] GPS module: Built-in GPS function of the device

[1934] Internet connection: Wi-Fi, 4G / 5G

[1935] Application: iOS app, Android app

[1936] Program processing

[1937] Server Processing

[1938] The server stores information about tourist attractions and restaurants in a database and provides appropriate information in response to user requests. Specifically, the server performs the following processes:

[1939] Information on tourist spot congestion and weather conditions is collected in real time and updated in the database.

[1940] Collects emergency safety information and notifies users.

[1941] Terminal handling

[1942] The device retrieves information from the server through the app and displays it to the user. Specifically, the device performs the following processes:

[1943] The system uses GPS to obtain your current location and displays information about nearby tourist attractions and restaurants.

[1944] Displays tourist spot congestion status and weather information in real time.

[1945] In case of an emergency, safety information is received from the server and notified to the user.

[1946] User operations

[1947] Through the app, users can:

[1948] Search for information on tourist attractions and restaurants near your current location.

[1949] Get information to plan your schedule.

[1950] In the event of an emergency, check safety information through the app and take appropriate action.

[1951] Specific examples

[1952] For example, if a user is visiting Tokyo for sightseeing, they can open the app and search for tourist spots near their current location. The app will display tourist spots such as Sensoji Temple and Tokyo Tower based on information obtained from the server. It also displays real-time information on the congestion status of tourist spots and weather information. Furthermore, in the event of an emergency, such as an earthquake or typhoon, safety information will be sent through the app.

[1953] Prompt Sentence Examples

[1954] "Generate prompts that allow a user visiting Tokyo to search for information on tourist attractions and restaurants near their current location, and check crowd and weather information in real time."

[1955] In this way, the system provides tourists with comprehensive information and supports a comfortable and safe journey.

[1956] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1957] Step 1:

[1958] The user launches the app.

[1959] A user launches an app by tapping it on the smartphone's home screen. When the app launches, the initial screen is displayed. The input is the user's operation, and the output is the initial screen of the app.

[1960] Step 2:

[1961] The device obtains your current location.

[1962] The device uses the GPS function to obtain the user's current location. Specifically, the device's location information service is enabled to obtain latitude and longitude data. The input is location information from the GPS, and the output is latitude and longitude data.

[1963] Step 3:

[1964] The device sends the current location information to the server.

[1965] The device sends the acquired location information to the server. The HTTPS protocol is used for transmission to ensure secure communication. The input is latitude and longitude data, and the output is a notification to the server that transmission is complete.

[1966] Step 4:

[1967] The server searches for information about tourist attractions and restaurants near the current location.

[1968] The server accesses the database and searches for information on tourist attractions and restaurants around the current location. Search results include the spot name, address, business hours, ratings, etc. The input is latitude and longitude data, and the output is information on tourist attractions and restaurants.

[1969] Step 5:

[1970] The server collects information on tourist spot congestion and weather.

[1971] The server uses external APIs to collect real-time information about tourist spot congestion and weather. For example, it uses the Google Maps API or OpenWeatherMap API. The input is the tourist spot ID and location information, and the output is congestion and weather information.

[1972] Step 6:

[1973] The server sends the collected information to the terminal.

[1974] The server sends the collected information about tourist spots and restaurants, their congestion status, and weather information to the device. Data is sent in JSON format. The input is information about tourist spots and restaurants, their congestion status, and weather information, and the output is a notification to the device that transmission has been completed.

[1975] Step 7:

[1976] The terminal displays the received information to the user.

[1977] The device analyzes the received information and displays it to the user. Specifically, it displays a list of tourist attractions and restaurants on the screen, and indicates congestion status and weather information using icons and text. The input is JSON data received from the server, and the output is the information displayed to the user.

[1978] Step 8:

[1979] The user checks out detailed information about attractions and restaurants.

[1980] Users can tap on attractions or restaurants of their choice from the displayed list to view detailed information, including photos, reviews, and access information. The input is the user's tap action, and the output is the display of detailed information.

[1981] Step 9:

[1982] In an emergency, the server collects safety information and sends it to the terminal.

[1983] In the event of an emergency, the server collects safety information such as earthquakes and typhoons and sends it to the terminal. The collection is done using APIs from the Japan Meteorological Agency and the Disaster Prevention Information Center. The input is emergency trigger information, and the output is safety information.

[1984] Step 10:

[1985] The terminal notifies the user of safety information.

[1986] The device notifies the user of the received safety information. The push notification function is used for notifications, and highly urgent information is immediately conveyed to the user. The input is the safety information received from the server, and the output is the notification to the user.

[1987] (Application example 1)

[1988] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1989] Conventional tourist applications only provide basic information such as tourist information and cultural guides, and do not provide enough information on shopping at physical stores, local events, or safety information. This makes it difficult for tourists to smoothly shop, participate in events, and take safety measures at local stores. In addition, the lack of real-time information on crowding and sales makes it less convenient for tourists.

[1990] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1991] In this invention, the server includes a means for providing store information around the current location, a means for providing store congestion status, a means for providing sale information, a means for providing safety information, and a means for providing local event information, which allows tourists to obtain store information, congestion status, sale information, safety information, and event information in real time.

[1992] A "prepaid SIM for overseas tourists" is a communication card that tourists from overseas purchase in advance for use in Japan.

[1993] "Recommended tourist spots" is information about tourist destinations and famous places that are recommended for tourists to visit.

[1994] The "schedule planning means" is a support function for tourists to efficiently plan their travel itineraries.

[1995] "Language and Japanese culture guide means" is a function that provides information to help tourists learn about Japanese language and culture.

[1996] The "local festival and event information means" is a function that provides information on festivals and events held in areas visited by tourists.

[1997] "Recommended restaurants and food guide" is a function that provides information on restaurants and food that are recommended for tourists to visit.

[1998] "Shopping guide means" is a function that provides information to help tourists enjoy shopping.

[1999] "Emergency contact and safety information means" is a function that provides tourists with means to contact others in an emergency and information on safety.

[2000] "Tourism information feedback means" is a function that allows tourists to provide feedback about the places they have visited and their experiences.

[2001] "Weather information means" is a function that provides weather information for the area that tourists visit.

[2002] "Means of communication between tourists" refers to a function that allows tourists to share information and communicate with each other.

[2003] The "means for providing information about stores around the current location" is a function that provides information about stores around the tourist's current location.

[2004] The "means for providing information on store congestion status" is a function that provides real-time information on the congestion status of stores that tou...

Claims

1. A system for creating a communication module for tourists and providing information for the tourists who use the communication module, A means for collecting information about sightseeing spots, including congestion status, waiting times, and opening times; A means for recognizing the emotion of the tourist and providing the tourist spot information according to the recognized emotion of the tourist; A means of communication between the tourists; A means for sharing an evaluation of the tourist spot by the communication means; A system including:

2. The providing means provides at least one of cultural information, event information, surrounding store information, and safety information. The system of claim 1 .

3. a schedule planning providing means for providing a plan for the tourist to efficiently visit the tourist spots; The system of claim 1 .

Images