System

Abstract

A system is provided.SOLUTION: This system includes a means for allowing a user to acquire a present position, a means for transmitting the acquired present position data to a travel information providing server, a means for allowing the travel information providing server to retrieve sightseeing information based on the position data, and to transmit the sightseeing information to a user terminal, and a means for allowing the user terminal to provide the received sightseeing information by voice.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional tourist information systems make it difficult for users to obtain detailed information about their current location in a timely manner, and lack a means to easily provide information about the history and background of tourist spots. Furthermore, they lack efficient algorithms for quickly processing large amounts of data, making it difficult to provide information to users without delay. The present invention aims to provide a system that solves these problems. [Means for solving the problem]

[0005] The present invention solves the above problems by the following means. The present invention includes a means for a user to acquire their current location and a means for transmitting the acquired current location data to a travel information providing server. The travel information providing server also includes a means for searching for tourist information based on the location data and transmitting the tourist information to the user terminal. The present invention also includes a means for providing the tourist information received by the user terminal by voice, allowing the user to acquire the tourist information in real time. The travel information providing server uses a parallel data processing algorithm to achieve efficient information search and processing. The present invention also includes a means for classifying the tourist information received by the user terminal and outputting the classified information individually by voice, making it possible to provide the user with more detailed and easy-to-understand information.

[0006] A "user terminal" is a device that can be directly operated by a user, and is a device that acquires the current location, displays tourist information, and outputs audio.

[0007] "Current location" refers to the geographic coordinate information of the user's current location, and is expressed as latitude and longitude.

[0008] The "travel information server" is a server system that searches for tourist information based on current location data sent from a user terminal and sends the information to the user terminal.

[0009] "Tourist information" refers to detailed information about tourist attractions, such as history, background, architecture, reviews, and access information.

[0010] A "parallel data processing algorithm" is an algorithm that divides data into multiple small segments and processes each segment simultaneously, thereby reducing the overall processing time.

[0011] "Voice output" is a function that uses voice synthesis technology to provide text information received by a user terminal to the user as voice.

[0012] "Classified information" refers to data on received tourist information organized into categories based on purpose and content. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0014] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0015] First, the terms used in the following description will be explained.

[0016] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0017] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0018] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0019] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0021] [First embodiment]

[0022] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0023] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0026] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0029] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0033] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0034] The present invention relates to an interactive tourist information providing system that enables users to obtain tourist information in a timely manner and enjoy their travels more. Specific embodiments of the system will be described below.

[0035] System Overview

[0036] This system consists of a user terminal, a travel information server, and a data processing algorithm for linking these. The user terminal is a device such as a smartphone or tablet, and acquires the current location, receives tourist information, and outputs it as audio. The travel information server receives the location data sent from the user terminal, searches for and processes tourist information based on the location information, and sends it to the user terminal.

[0037] Algorithms and Data Processing

[0038] To improve the efficiency of data processing, the travel information server uses a parallel processing algorithm, which divides data into multiple small segments and processes each segment simultaneously, thereby reducing the overall processing time.

[0039] Specific examples

[0040] Below is a specific example where the user is at Kinkakuji Temple in Kyoto.

[0041] 1. Obtaining current location

[0042] The user enables location services on the device, and the device obtains latitude 35.0394 and longitude 135.7292. This location information is saved internally as "current location."

[0043] 2. Data transmission

[0044] The device sends its current location to a travel information server, which then searches its database based on this location information to obtain tourist information related to Kinkakuji Temple.

[0045] 3. Data Parallelism

[0046] The server processes the tourist information it acquires using a parallel processing algorithm. The data is divided into small segments, such as architectural information, historical background, and reviews, and each segment is processed simultaneously.

[0047] 4. Data reintegration and transmission

[0048] The server reassembles the processed data and sends it to the user's terminal, which receives it and decodes it internally.

[0049] 5. Audio Output

[0050] The device analyzes the received data and uses a speech synthesis engine to provide information to the user. For example, it tells the user by voice, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The entire three-story building is covered in gold leaf..."

[0051] System Operation

[0052] User terminal

[0053] Obtaining location information: When the user launches the app and enables location services, the device obtains its current location.

[0054] Sending data: Send the acquired current location to the server.

[0055] Receiving and analyzing data: Receive and analyze the tourist information sent from the server.

[0056] Voice output: The analyzed tourist information is provided to the user using a voice synthesis engine.

[0057] Travel information server

[0058] Receiving data: Receive current location data from the user terminal.

[0059] Data search and retrieval: Search the database based on the received location information and retrieve the relevant tourist information.

[0060] Data processing using parallel processing algorithms: Data is divided into multiple segments and processed simultaneously.

[0061] Data reintegration and transmission: The processed data is reintegrated and transmitted to the user terminal.

[0062] In this way, the system provides users with fast and detailed tourist information, enhancing their travel experience.

[0063] The processing flow will be explained below.

[0064] Step 1:

[0065] A user launches a tourist guide application on their device and enables location services. The user device uses the GPS sensor to obtain the latitude and longitude of their current location (e.g., latitude 35.0394, longitude 135.7292).

[0066] Step 2:

[0067] The device temporarily stores the current location data it acquires internally and then sends this data to the API endpoint of the travel information provider server. The data to be sent is in a request format that includes latitude and longitude (e.g., GET / api / v1 / places?lat=35.0394&lng=135.7292).

[0068] Step 3:

[0069] Based on the location data received, the server searches the database for the relevant tourist spot and related information. The server identifies the relevant area from the location information and retrieves related data (e.g., architectural information, historical background, reviews, etc. of Kinkaku-ji Temple).

[0070] Step 4:

[0071] The server efficiently processes the tourist information it acquires using a parallel processing algorithm. Specifically, the data is divided into small segments, such as architectural information, historical background, and reviews, and processed simultaneously by multiple processors.

[0072] Step 5:

[0073] The server reintegrates the processed results of each segment to generate the final tourist information data, which is encoded in JSON format or similar and sent to the user's device.

[0074] Step 6:

[0075] The device decodes the tourist information data received from the server and analyzes it internally. It classifies the data (e.g., architectural information, historical background, reviews) and generates data for voice output using a speech synthesis engine.

[0076] Step 7:

[0077] The device uses a speech synthesis engine to provide the analyzed tourist information to the user by voice, generating a speech output such as "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The three-story building is entirely covered in gold leaf..."

[0078] Step 8:

[0079] The user can enjoy sightseeing while listening to the audio guide. During this process, they can move to another tourist spot as needed and repeat from step 1.

[0080] Example 1

[0081] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0082] Conventional tourist information systems face the challenge of providing users with the information they require quickly and efficiently. Furthermore, the accuracy and speed of location information acquisition and voice information provision are insufficient, making it difficult to improve the user experience. Furthermore, inefficient information search and processing slows the overall system response time. To address these issues, a system is needed that can streamline the processes of data acquisition, processing, and transmission, and provide information quickly and accurately.

[0083] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0084] In this invention, the server includes: a means for the information providing server to efficiently search and process information using a parallel data processing algorithm; a means for the information providing server to input the received data as a search query into an internal database and acquire multiple related information segments; and a means for the information providing server to reintegrate the processed information and transmit it to the user terminal. This improves the accuracy and speed of data acquisition, enabling efficient information processing and transmission, and making it possible to provide information to users with high accuracy and speed.

[0085] A "user terminal" is a device used by a user, and refers to a mobile information terminal such as a smartphone or tablet.

[0086] "Current location" refers to the latitude and longitude information acquired by the user terminal.

[0087] "Information providing server" refers to a central server for searching and processing relevant information based on location information received from a user terminal and sending it to the user terminal.

[0088] "Location data" refers to information about the latitude and longitude of the current location acquired by the user terminal.

[0089] "Database" refers to a data collection system in which various information is systematically stored and managed within an information providing server.

[0090] A "parallel processing algorithm" refers to a calculation method that improves efficiency by dividing data processing into multiple small units (segments) and processing them simultaneously.

[0091] "Speech synthesis engine" refers to software and hardware systems for converting text data into speech.

[0092] "Search query" refers to search criteria or commands used to retrieve specific information from a database.

[0093] "Information segment" refers to data divided into multiple small units that make up information.

[0094] "Reintegration" refers to the process of combining multiple parallel-processed information segments into a single coherent data set.

[0095] "GPS Sensor" refers to a sensor built into a device that uses the Earth's satellite system to obtain location information.

[0096] "Analysis" refers to the process of understanding received data and transforming it into a form that can be used as a tangible output.

[0097] These definitions clarify each component and process of the present invention.

[0098] The present invention relates to an interactive tourist information providing system that enables users to obtain tourist information in a timely manner and to enjoy their travels more. Detailed embodiments for carrying out the present invention will be specifically described below.

[0099] System Overview

[0100] This system consists of a user terminal, an information server, and a data processing algorithm for linking these. The user terminal is a mobile information terminal such as a smartphone or tablet, and acquires the current location, receives information, and outputs voice. The information server receives location data sent from the user terminal, searches for and processes related information based on that location information, and sends it to the user terminal.

[0101] Hardware and software used

[0102] User device: A mobile information terminal such as a smartphone or tablet.

[0103] GPS sensor: A sensor built into the device for obtaining location information.

[0104] Information provider server: A server with high-performance processing capabilities.

[0105] Speech synthesis engine: Software that provides speech synthesis functionality, such as the Google® Text-to-Speech API.

[0106] Parallel processing algorithms: Algorithms for large-scale data processing such as Apache (registered trademark) Hadoop.

[0107] Data processing and calculation

[0108] 1. Obtaining and sending location information:

[0109] The user's device uses the GPS sensor to obtain the latitude and longitude of the current location, which is then stored in the app as location data.

[0110] The acquired location data is sent to the information provider server using the HTTPS protocol.

[0111] 2. Receiving and retrieving data:

[0112] The server receives the location data and searches its internal database based on the data, and a search query is generated based on the received location data to retrieve relevant information segments.

[0113] 3. Data Parallelism:

[0114] The acquired information segments are efficiently processed using a parallel processing algorithm: the information is divided into smaller segments such as architectural information, historical background, reviews, etc., and processed simultaneously.

[0115] 4. Data recombination and transmission:

[0116] The parallel processed information segments are recombined and transmitted to the user terminal as a single unified data set.

[0117] 5. Data analysis and audio output:

[0118] The user device analyzes the received data and activates a speech synthesis engine based on the analysis results, providing the user with information in the form of voice.

[0119] Specific examples

[0120] For example, a specific example will be given where the user is at Kinkakuji Temple in Kyoto.

[0121] 1. The user launches the app and enables location services. The device obtains latitude 35.0394 and longitude 135.7292 and saves it as the "current location."

[0122] 2. Send your current location to the information server. The server then searches the database based on this location information to retrieve information related to Kinkaku-ji Temple (architectural information, historical background, reviews, etc.).

[0123] 3. The server processes the acquired information using a parallel processing algorithm, which improves the processing speed.

[0124] 4. The processed information is reassembled and sent to the user terminal.

[0125] 5. The user terminal analyzes the received data and uses a speech synthesis engine to provide the information to the user aloud.

[0126] Example: "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The entire three-story building is covered in gold leaf..."

[0127] Prompt Sentence Examples

[0128] "Please tell me about the design of a system that provides tourist information about a location when a user inputs their current location."

[0129] "Please explain in detail how a system that provides audio tourist information based on a user's location when the user is at Kinkakuji Temple in Kyoto works."

[0130] In this way, the system provides users with fast and detailed tourist information, enhancing their travel experience.

[0131] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0132] Step 1:

[0133] The user launches the app and enables location services.

[0134] Input: A user launches a tourist information app on their smartphone or tablet. The user enables location services.

[0135] Data processing or data calculation: The device activates the GPS sensor.

[0136] Output: Location services are enabled and the device starts obtaining the current location. Specifically, the message "Please enable location services" is displayed in the app, and the user taps the "Allow" button.

[0137] Step 2:

[0138] The terminal acquires the current location and transmits it to the information providing server.

[0139] Input: Latitude and longitude of current location obtained by GPS sensor (e.g., latitude 35.0394, longitude 135.7292).

[0140] Data processing or data calculation: The acquired location information is saved on the device as the "current location." The location information is sent to the information provider server using the HTTPS protocol.

[0141] Output: Current location data is sent to the information server. Specifically, location information is obtained from the GPS sensor and temporarily displayed on the app screen. This information is automatically sent to the server, and a message indicating successful transmission is displayed.

[0142] Step 3:

[0143] The server receives the location data and searches a database to retrieve relevant information.

[0144] Input: Current location data sent from the user device.

[0145] Data processing or data calculation: Searching an internal database based on the received location data. A search query is generated based on the location data to retrieve relevant information (e.g., architectural information, historical background, reviews, etc.).

[0146] Output: The information related to the location is retrieved. Specifically, the server records the received location information in a log file and generates a search query to query the database.

[0147] Step 4:

[0148] The server processes the information using a parallel processing algorithm.

[0149] Input: Relevant information retrieved from the database.

[0150] Data processing or data calculation: Divide the acquired information into smaller segments (e.g., architectural information, historical background, reviews) and process each segment simultaneously using parallel processing algorithms.

[0151] Output: Parallelized information segments. Specifically, the information is split into several JSON objects, and each JSON object is processed simultaneously to reduce processing time.

[0152] Step 5:

[0153] The server reassembles the processed information and transmits it to the user terminal.

[0154] Input: Each information segment processed in parallel.

[0155] Data processing or data calculation: Reintegrate each parallel processed segment and send it to the user terminal as a single unified data set. HTTPS protocol is used.

[0156] Output: The reintegrated information is sent to the user terminal. Specifically, the integrated data is encoded and sent to the terminal.

[0157] Step 6:

[0158] The device analyzes the data it receives and uses a speech synthesis engine to output the information aloud.

[0159] Input: Aggregated data sent from the server.

[0160] Data processing or data calculation: The received data is analyzed within the terminal and the speech synthesis engine is activated.

[0161] Output: Based on the analysis results, information is provided to the user via voice. Specifically, the device decodes the received information, and the speech synthesis engine provides the information via voice, such as "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple..."

[0162] (Application example 1)

[0163] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0164] Conventional tourist information systems are primarily used during actual travel, and tourist information systems in virtual spaces have not been widely adopted. This makes it difficult for users in remote locations to interactively obtain real-time information about tourist spots in virtual spaces. Furthermore, when users use virtual reality headsets to obtain local information, the information provided is not based on their current location and direction, making it difficult to provide an effective tourist experience.

[0165] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0166] In this invention, the server includes means for acquiring the user's current location, means for transmitting the acquired current location data to an information providing server, means for the information providing server to search for tourist information based on the location data and transmit the tourist information to the user terminal, means for providing the tourist information received by the user terminal by voice, means for acquiring the current location and direction within the virtual space using a virtual reality headset, and means for providing the tourist information based on the current location and direction within the virtual space. This allows the user to acquire tourist information in real time even within the virtual space, enabling a realistic tourist experience even from a remote location.

[0167] "User" refers to an individual who obtains tourist information using the tourist information providing system.

[0168] "Current location" refers to the geographic location information of the user obtained by the user terminal or virtual reality headset.

[0169] The term "information providing server" refers to a server device that searches for tourist information based on the location data transmitted from the user terminal and transmits the relevant information to the user terminal.

[0170] "Tourist information" refers to data including historical background, architectural information, reviews, and other information related to tourist destinations.

[0171] "User terminal" refers to a portable information processing device such as a smartphone or tablet.

[0172] "Means for providing by voice" refers to means for transmitting tourist information received by a user terminal to a user as voice data using a voice synthesis engine.

[0173] A "virtual reality headset" refers to a display device that a user wears on their head to immerse themselves in a virtual space.

[0174] A "parallel processing algorithm" refers to an algorithm that improves processing speed by processing large amounts of data simultaneously in multiple processing units.

[0175] "Location data" refers to data including latitude and longitude information indicating the user's current location.

[0176] "Direction" refers to information acquired by the virtual reality headset that indicates the user's line of sight and body orientation.

[0177] The present invention relates to a system that allows users to obtain real-time tourist information in a virtual space using a virtual reality headset. The system is composed of a user terminal, a virtual reality headset, an information providing server, and a program for linking these devices.

[0178] System Overview

[0179] The system includes the following major components:

[0180] 1. User terminal: An information processing device such as a smartphone or tablet that acquires the current location, receives tourist information, and outputs audio.

[0181] 2. Virtual reality headset (HMD): A user wears it to move around in a virtual space and obtain position and orientation information.

[0182] 3. Information server: Searches for tourist information based on the location data sent from the user terminal, processes it, and sends it to the user terminal.

[0183] 4. Data Processing Algorithms: Parallel processing algorithms are used to process data efficiently.

[0184] 5. Speech synthesis engine: Provides tourist information to users by voice.

[0185] Program processing

[0186] Hardware and Software Configuration

[0187] Obtaining current location: The GPS and direction sensors built into the virtual reality headset are used to obtain the user's geographical location and gaze direction. The hardware used includes the GPS module and gyro sensor built into the HMD. The software used includes the HMD's API.

[0188] Data transmission: The acquired current location data is sent to the information provider server. The software used includes the requests library for sending HTTP requests.

[0189] Parallel data processing: On the information server side, the acquired tourist information data is efficiently processed using a parallel processing algorithm. This uses a threading library.

[0190] Providing information by voice: The user terminal receives tourist information sent from the information server and provides the information to the user by voice using a speech synthesis engine. The speech synthesis engine uses the text_to_speech library.

[0191] Specific examples

[0192] When a user wears a virtual reality headset and is at a virtual tourist spot, the HMD obtains its current location at latitude 35.0394 and longitude 135.7292. This location information is sent to a server, which then searches for tourist information related to Kinkaku-ji Temple. The obtained tourist information is efficiently divided and processed using parallel processing, and then reintegrated and sent to the user's device. Finally, the user's device communicates this information to the user using a speech synthesis engine.

[0193] Prompt Sentence Examples

[0194] In text format, it should look like this:

[0195] Your current virtual location is at latitude 35.0394 and longitude 135.7292. Please provide detailed tourist information based on this location.

[0196] With the above configuration, the present invention realizes a system that can obtain tourist information in real time even within a virtual space, allowing users to experience tourist spots with a sense of realism even from a remote location.

[0197] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0198] Step 1:

[0199] The user terminal acquires the user's current position and gaze direction using a virtual reality headset.

[0200] Input: Data from the GPS module and gyro sensor of the virtual reality headset.

[0201] Output: Latitude, longitude, line of sight direction.

[0202] How it works: The sensors in the virtual reality headset detect the user's current location (latitude, longitude) and gaze direction in real time and store this data internally.

[0203] Step 2:

[0204] The user terminal transmits the acquired current location data to the information providing server.

[0205] Input: Current location data (latitude, longitude).

[0206] Output: HTTP request to the information provider server.

[0207] Specific operation: The user terminal sends the current location data stored internally to the information providing server as an HTTP request.

[0208] Step 3:

[0209] The information providing server searches for tourist information based on the received location data.

[0210] Input: Current location data (latitude, longitude).

[0211] Output: Tourist information data.

[0212] Specific operation: The information providing server searches the database based on the received location data and obtains the relevant tourist information (historical background, architectural information, reviews, etc.).

[0213] Step 4:

[0214] The information providing server processes tourist information data using a parallel processing algorithm.

[0215] Input: Tourist information data.

[0216] Output: Segmented tourist information.

[0217] Specific operation: Tourist information data is divided into small segments such as architectural information, historical background, reviews, etc., and each segment is processed simultaneously using a parallel processing algorithm (threading library).

[0218] Step 5:

[0219] The information providing server reintegrates the processed tourist information and transmits it to the user terminal.

[0220] Input: Tourist information for each processed segment.

[0221] Output: Reintegrated tourist information data.

[0222] Specific operation: The tourist information for each segment processed in parallel is reintegrated and sent to the user's terminal as an HTTP response.

[0223] Step 6:

[0224] The tourist information received by the user terminal is analyzed and provided to the user in audio form using a speech synthesis engine.

[0225] Input: Reintegrated tourist information data.

[0226] Output: Audio data.

[0227] Specific operation: The user device receives and analyzes the reintegrated tourist information data, and then uses the text_to_speech library to provide the information to the user via voice.

[0228] Step 7:

[0229] The user moves to the next point in the virtual space, and the HMD again acquires the current position and gaze direction.

[0230] Input: New current location data (latitude, longitude) and line of sight direction.

[0231] Output: Updated position and orientation information.

[0232] How it works: When the user moves to the next tourist spot in the virtual space, the virtual reality headset again obtains the new current position and gaze direction in real time and stores the updated data internally.

[0233] By repeating these steps, users can obtain real-time tourist information while moving around the virtual space and obtain detailed information via voice.

[0234] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0235] The present invention relates to a system that recognizes a user's emotions and personalizes tourist information based on those emotions. The system is composed of a user terminal, a travel information server, an emotion engine, and a data processing algorithm for linking these components.

[0236] System Overview

[0237] The main components of this system are as follows:

[0238] 1. User terminal: A device that is directly operated by the user, such as a smartphone or tablet. It acquires the current location, receives tourist information, analyzes emotions, and outputs voice.

[0239] 2. Travel information server: A server system that searches for and processes tourist information based on location data sent from the user's terminal and sends it to the user's terminal.

[0240] 3. Emotion engine: It has the ability to recognize users' emotions in real time and adjust the tourist information provided based on that data.

[0241] Algorithms and Data Processing

[0242] The travel information server uses a parallel processing algorithm to improve data processing efficiency. This algorithm divides data into multiple small segments and processes each segment simultaneously, shortening the overall processing time. In addition, an emotion engine collects and analyzes user emotion data and provides personalized tourism information based on that data.

[0243] Specific examples

[0244] Below is a specific example where the user is at Kinkakuji Temple in Kyoto.

[0245] 1. Obtaining current location

[0246] The user enables location services on the device, and the device obtains latitude 35.0394 and longitude 135.7292. This location information is saved internally as "current location."

[0247] 2. Data transmission

[0248] The device sends its current location to a travel information server, which searches its database based on this location information to obtain tourist information related to Kinkakuji Temple.

[0249] 3. Data Parallelism

[0250] The server efficiently processes the tourist information it acquires using a parallel processing algorithm. The data is divided into small segments, such as architectural information, historical background, and reviews, and processed simultaneously by multiple processors.

[0251] 4. Collecting Emotional Data

[0252] The emotion engine on the user device recognizes and analyzes the user's emotions based on their facial expressions, tone of voice, operation logs, etc. Emotional data is collected in real time and stored internally.

[0253] 5. Coordination of tourist information

[0254] The server personalizes the tourist information it provides based on the user's emotional data. For example, if the user looks happy, it will provide more detailed historical information and information that includes entertainment elements.

[0255] 6. Data reintegration and transmission

[0256] The server reassembles the processed data and sends it to the user's terminal, which receives it and decodes it internally.

[0257] 7. Audio Output

[0258] The device analyzes the received data and uses a speech synthesis engine to provide information to the user. For example, it tells the user by voice, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The entire three-story building is covered in gold leaf..."

[0259] 8. Emotional Feedback

[0260] The emotion engine detects the user's reactions (for example, smiles or surprised expressions) and reflects them in the next information provided, enabling the system to provide optimal tourist information to the user.

[0261] System Operation

[0262] User terminal

[0263] Obtaining location information: When the user launches the app and enables location services, the device obtains its current location.

[0264] Sending data: Send the acquired current location to the server.

[0265] Emotion data collection and analysis: The emotion engine collects and analyzes user emotions in real time.

[0266] Receiving tourist information and outputting it as audio: Receives personalized tourist information sent from the server, analyzes it, and outputs it as audio.

[0267] Travel information server

[0268] Receiving data: Receive current location data from the user terminal.

[0269] Data search and retrieval: Search the database based on the received location information and retrieve the relevant tourist information.

[0270] Data processing using parallel processing algorithms: Data is divided into multiple segments and processed simultaneously.

[0271] Information tailoring based on emotional data: Analyze emotional data and personalize tourism information based on it.

[0272] Data reintegration and transmission: The processed data is reintegrated and transmitted to the user terminal.

[0273] In this way, the system optimizes tourist information based on user sentiment and improves the travel experience.

[0274] The processing flow will be explained below.

[0275] Step 1:

[0276] A user launches a tourist guide application on their device and enables location services. The user device uses the GPS sensor to obtain the latitude and longitude of their current location (e.g., latitude 35.0394, longitude 135.7292).

[0277] Step 2:

[0278] The device temporarily stores the current location data it acquires internally and then sends this data to the API endpoint of the travel information provider server. The data to be sent is in a request format that includes latitude and longitude (e.g., GET / api / v1 / places?lat=35.0394&lng=135.7292).

[0279] Step 3:

[0280] Based on the location data received, the server searches the database for the relevant tourist spot and related information. The server identifies the relevant area from the location information and retrieves related data (e.g., architectural information, historical background, reviews, etc. of Kinkaku-ji Temple).

[0281] Step 4:

[0282] The server efficiently processes the tourist information it acquires using a parallel processing algorithm. Specifically, the data is divided into small segments, such as architectural information, historical background, and reviews, and processed simultaneously by multiple processors.

[0283] Step 5:

[0284] The server reintegrates the processed results of each segment to generate the final tourist information data, which is encoded in JSON format or similar and sent to the user's device.

[0285] Step 6:

[0286] The user device decodes the tourist information data received from the server and analyzes it internally. It classifies the data (e.g., architectural information, historical background, reviews), and also generates and prepares data for the emotion engine.

[0287] Step 7:

[0288] The emotion engine on the user device recognizes and analyzes the user's emotions in real time based on the user's facial expressions, tone of voice, operation logs, etc. Emotional data is stored and analyzed internally.

[0289] Step 8:

[0290] The emotion engine analyzes the emotional data and adjusts the tourist information provided. For example, if the user looks happy, it will prioritize information with a stronger entertainment element.

[0291] Step 9:

[0292] The user device uses a speech synthesis engine to provide the adjusted tourist information by voice. For example, it may say to the user, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The entire three-story building is covered in gold leaf..."

[0293] Step 10:

[0294] While the user enjoys sightseeing while listening to the audio guide, the emotion engine continuously detects the user's reactions (e.g., smiles or surprised expressions) and reflects them in the information provided from the next time onwards.

[0295] Step 11:

[0296] If the user moves to another tourist spot, the process is repeated from step 1. This allows the user to always receive personalized and up-to-date tourist information.

[0297] Example 2

[0298] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0299] Conventional tourist information systems only provide tourist information based on the user's current location, and have the problem of lacking personalization according to the user's emotions and interests. As a result, users' travel experiences are uniform, and information provision that is optimized for each individual user is not provided.

[0300] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0301] In this invention, the server includes means for acquiring the user's current location, means for transmitting the acquired current location data to a travel information providing server, means for the travel information providing server to search for tourist information based on the location data and transmit the tourist information to the user terminal, means for the user terminal to provide the tourist information received by voice, means for collecting and analyzing user emotion data, and means for personalizing the tourist information based on the emotion data, thereby making it possible to provide personalized tourist information that takes into account the user's real-time emotions.

[0302] A "user" is a person who uses the system to obtain tourist information and experience travel.

[0303] "Current location" is geographical location information acquired by the user's terminal, and is expressed as latitude and longitude.

[0304] The "travel information server" is a server system that searches for tourist information based on the location data sent from the user terminal, processes it, and sends it to the user terminal.

[0305] A "user terminal" is a device such as a smartphone or tablet operated by a user, which acquires and transmits the user's current location, receives tourist information, and collects and analyzes emotional data.

[0306] "Tourist information" is detailed information about tourist spots that the travel information server searches for based on location data and provides to the user terminal.

[0307] A "speech synthesis engine" is a program that generates speech from text and provides information to users in an easy-to-listen format.

[0308] "Emotion data" is data that indicates the user's emotional state, collected from the user's facial expression, tone of voice, operation log, and the like.

[0309] "Personalization" means optimizing the content and delivery method of information according to the characteristics and emotions of each individual user.

[0310] A "parallel processing algorithm" is an algorithm that improves the efficiency of data processing by processing multiple small data segments simultaneously.

[0311] The present invention relates to a system that recognizes a user's emotions and personalizes tourist information based on those emotions. The system is composed of a user terminal, a travel information server, an emotion engine, and a data processing algorithm for linking these elements.

[0312] System Configuration

[0313] The system consists of the following main components:

[0314] 1. User terminal: A device that is directly operated by the user, such as a smartphone or tablet. This includes functions to obtain current location, receive tourist information, collect emotion data, and output voice. Specific hardware used includes a GPS module, camera, microphone, and touchscreen.

[0315] 2. Travel Information Server: A server system that searches and processes tourist information based on location data sent from the user's device and sends it to the user's device. It uses a parallel processing algorithm to efficiently search and process data.

[0316] 3. Emotion engine: Collects and analyzes emotional data in real time from users' facial expressions, tone of voice, operation logs, etc. Based on this emotional data, the tourist information provided is personalized.

[0317] Data Processing

[0318] To improve the efficiency of data processing, the travel information server uses a parallel processing algorithm, which divides the data into multiple small segments and processes each segment simultaneously, thereby reducing the overall processing time.

[0319] Furthermore, the emotion engine collects and analyzes the user's emotional data and adjusts the tourist information provided based on that data, thereby providing the most appropriate tourist information for the user.

[0320] Specific examples of operation procedures

[0321] Below is a specific example where the user is at Kinkakuji Temple in Kyoto.

[0322] 1. Obtaining current location: The user launches the app and enables location services. The device obtains latitude 35.0394 and longitude 135.7292 and stores this internally as the current location.

[0323] 2. Data transmission: The device transmits its current location to the travel information server. The server searches its database based on this location information and retrieves tourist information related to Kinkakuji Temple.

[0324] 3. Parallel data processing: The server efficiently processes the tourist information acquired using parallel processing algorithms. The data is divided into small segments such as architectural information, historical background, and reviews, and processed simultaneously by multiple processors.

[0325] 4. Emotion data collection: The emotion engine on the user device recognizes and analyzes the user's emotions based on their facial expressions, tone of voice, operation logs, etc. Emotion data is collected in real time and stored internally.

[0326] 5. Tailoring tourist information: The server personalizes tourist information based on emotional data. For example, if the user looks happy, the server will provide more detailed historical information and information that includes entertainment elements.

[0327] 6. Data reassembly and transmission: The server reassembly processes the data and transmits it to the user's terminal, which receives the data and decodes it internally.

[0328] 7. Voice output: The device analyzes the data received and uses a voice synthesis engine to provide information to the user. For example, it tells the user by voice, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The three-story building is covered entirely in gold leaf..."

[0329] Prompt Sentence Examples

[0330] Below are some examples of prompts to input to the generative AI model.

[0331] "Please explain in detail the system overview and operation flow for the system that allows users to obtain tourist information based on their current location."

[0332] This system provides personalized tourist information based on the user's emotions in real time, enabling a travel experience optimized for each individual user, unlike conventional tourist guide systems.

[0333] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0334] Step 1:

[0335] Obtain location information on the user device.

[0336] Input: User launches the app and enables location services.

[0337] Action: The device uses GPS to obtain the user's current location, which is expressed in latitude and longitude format.

[0338] Output: Current location data is obtained: latitude 35.0394, longitude 135.7292.

[0339] Specific operation: The smartphone's GPS module is activated and the acquired latitude and longitude data is stored in the internal memory.

[0340] Step 2:

[0341] The location information is sent from the user terminal to the server.

[0342] Input: Current location data obtained (latitude 35.0394, longitude 135.7292).

[0343] Processing: The device creates an HTTP request and sends the acquired current location data to the travel information server.

[0344] Output: The server receives the current location data.

[0345] Specific operation: The app automatically creates an HTTP request and sends it to the server via the communication module.

[0346] Step 3:

[0347] The server performs a data search based on the received location information.

[0348] Input: Current location data received by the server.

[0349] Processing: The server forms a database query to search for tourist information for the location (e.g., Kinkaku-ji Temple).

[0350] Output: Tourist information about Kinkaku-ji Temple is obtained, including architectural information, historical background, visitor reviews, etc.

[0351] Specific operation: The database server processes the query, extracts the relevant tourist information, and sends it to the main server.

[0352] Step 4:

[0353] The server processes tourist information efficiently using parallel processing.

[0354] Input: Tourist information retrieved from the database.

[0355] Processing: The acquired tourist information is divided into multiple segments (architectural information, historical background, reviews, etc.) and processed simultaneously using a parallel processing algorithm.

[0356] Output: Tourist information data with each segment processed is obtained.

[0357] Specific operation: Multiple processors within the server synchronize and process data in parallel, achieving improved processing speed.

[0358] Step 5:

[0359] The server reintegrates the processed tourist information and transmits it to the user terminal.

[0360] Input: Data for each segment obtained by parallel processing.

[0361] Processing: Reassemble the data from each segment into a single data packet and send it to the user terminal as an HTTP response.

[0362] Output: The user terminal receives the integrated tourist information data.

[0363] Specific operation: The server forms a data packet and sends it to the user terminal via the communication module.

[0364] Step 6:

[0365] Emotional data is collected and analyzed on the user's device.

[0366] Input: The user views the tourist information they have received.

[0367] Processing: The emotion engine collects the user's facial expressions, tone of voice, and operation logs, and analyzes the emotion data in real time.

[0368] Output: Data indicating the user's emotional state is stored internally.

[0369] What it does: The camera and microphone are activated to detect the user's facial expressions and voice, which are then analyzed by an emotion analysis algorithm.

[0370] Step 7:

[0371] The server personalizes tourist information based on emotion data.

[0372] Input: Emotion data sent from the user device.

[0373] Processing: Analyze the emotion data and re-adjust the tourist information according to the user's interests and emotions. For example, if a user is enjoying themselves, provide them with detailed historical information or information that includes entertainment elements.

[0374] Output: Personalized tourist information data is obtained.

[0375] Specific operation: The server reintegrates the re-adjusted tourist information and forms it into a data packet.

[0376] Step 8:

[0377] The server transmits the reintegrated data to the user terminal.

[0378] Input: Personalized tourist information data.

[0379] Processing: The reintegrated tourist information data is sent to the user terminal as an HTTP response.

[0380] Output: The user terminal receives the re-adjusted tourist information data.

[0381] Specific operation: The server forms a data packet and sends it to the user terminal via the communication module.

[0382] Step 9:

[0383] Tourist information is output aloud on the user terminal.

[0384] Input: Tourist information data received from the server.

[0385] Processing: The device analyzes the tourist information received and outputs it aloud using a speech synthesis engine.

[0386] Output: The user receives tourist information by voice.

[0387] Specific operation: The device's speaker will be activated and will read out, for example, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple..."

[0388] This processing flow realizes a system that provides optimal tourist information based on the user's current location and emotions.

[0389] (Application example 2)

[0390] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0391] Conventional tourist information systems can provide tourist information based on a user's current location, but they cannot provide information that takes the user's emotions into account, making it difficult to provide information that is optimized for each individual. Furthermore, since users' moods and interests change from time to time while traveling, there is a demand for information that reflects their trends in real time. The present invention aims to solve these problems and enable the provision of personalized tourist information that reflects the user's emotions.

[0392] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring the user's current location, means for transmitting the acquired current location data to the travel information providing server, means for the travel information providing server to search for tourist information based on the location data and transmit the tourist information to the user terminal, means for the user terminal to provide the received tourist information by voice, and means for the user terminal to recognize emotions from image data and personalize the tourist information based on the emotion data. This makes it possible to provide real-time, personalized tourist information that reflects the user's emotions.

[0393] The "means by which the user obtains the current location" refers to a function for obtaining the user's current location data using the GPS function or location information service of the user's terminal.

[0394] The "means for transmitting the acquired current location data to the travel information server" is a function for transmitting the current location data acquired by the user terminal to the travel information server via the network.

[0395] "Means for the travel information providing server to search for tourist information based on location data and transmit the tourist information to the user terminal" refers to a function for the travel information providing server to search for relevant tourist information based on the location data received and transmit the information to the user terminal.

[0396] The "means for providing tourist information received by the user terminal by voice" is a function that analyzes tourist information received by the user terminal and provides the information to the user by voice using voice synthesis technology.

[0397] "Means for a user terminal to recognize emotions from image data and personalize tourist information based on the emotional data" refers to a function in which a user terminal analyzes image data taken with a camera or the like, recognizes the user's emotions, and then individually optimizes tourist information based on that emotional data.

[0398] A "parallel data processing algorithm" is an algorithm that divides data into multiple small segments and processes them simultaneously in parallel to improve processing efficiency.

[0399] The system that realizes this application example has the following configuration: It consists of a user terminal, a travel information server, and an emotion engine, all of which work in conjunction with each other. A detailed embodiment of this system is described below.

[0400] User terminal

[0401] A user terminal refers to a mobile information terminal such as a smartphone or tablet, and includes the following hardware and software:

[0402] GPS sensor: Used to obtain current location.

[0403] Camera: Used to capture image data, thereby capturing the user's facial expressions.

[0404] Location Services: Software for managing acquired location data.

[0405] Emotion Recognition Software: Analyze user emotions using the Facial Recognition API.

[0406] Network communication module: Used to transmit location data and emotion data to the travel information providing server.

[0407] Speech synthesis engine: Used to provide received tourist information to the user by voice.

[0408] Travel information server

[0409] The travel information server is a cloud-based server designed to efficiently process large amounts of data. This server uses the following hardware and software:

[0410] Database system: stores tourist information.

[0411] Parallel processing algorithm: Used to efficiently search and process tourism information, this algorithm divides the data into multiple segments and processes them simultaneously.

[0412] Network communication module: Manages data received from user terminals and transmits necessary tourist information to the user terminals.

[0413] Emotion Engine

[0414] The emotion engine is a software module that recognizes users' emotions in real time and personalizes tourist information based on that data.

[0415] Facial Recognition API: Analyzes image data and recognizes user emotions.

[0416] Data analysis module: Optimizes tourist information based on recognized emotion data.

[0417] Example of system operation

[0418] 1. Obtaining location information: When the user launches the app and enables location services, the GPS sensor on the user's device obtains the current location.

[0419] 2. Data transmission: The acquired current location data is transmitted to the travel information server. This is handled by the network communication module.

[0420] 3. Obtaining tourist information: The travel information server searches the database based on the location data and obtains the relevant tourist information. This is efficiently processed using a parallel processing algorithm.

[0421] 4. Emotion data collection: The camera on the user's device captures the user's facial expressions, and emotion recognition software analyzes the emotions.

[0422] 5. Personalized tourist information: The emotion engine personalizes tourist information based on the emotional data acquired.

[0423] 6. Providing information: Optimized tourist information is sent to the user's terminal and provided audibly using a speech synthesis engine.

[0424] Prompt Sentence Examples

[0425] When a user looks at a product using their smartphone camera, if emotions like "surprise" or "excitement" are detected, recommend the best product for the user based on that emotion, and also show information about nearby stores where the product is available.

[0426] The above configuration makes it possible to provide real-time, personalized tourist information that reflects the user's emotions, thereby improving the quality of the travel experience.

[0427] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0428] Step 1:

[0429] A user launches an app and enables location services, which allows the GPS sensor on the user's device to obtain current location data. The input is the user's action and the activation of location services, and the output is the current location data.

[0430] Step 2:

[0431] The acquired current location data is sent to the travel information server. The user terminal uses a network communication module to send the location data to the server. The input is the current location data, and the output is receiving the location data on the server side.

[0432] Step 3:

[0433] The server searches the database based on the received location data and retrieves the relevant tourist information. It uses a parallel processing algorithm to efficiently search and process the data. The input is location data, and the output is tourist information data.

[0434] Step 4:

[0435] A user captures image data using a camera. The camera on the user's device acquires the image and sends it to emotion recognition software. The input is image data, and the output is emotion data.

[0436] Step 5:

[0437] Emotion recognition software analyzes image data and recognizes the user's emotions. This is processed by the Facial Recognition API on the user's device. The input is image data, and the output is recognized emotion data.

[0438] Step 6:

[0439] The user terminal sends emotional data to a travel information server. The server then personalizes tourist information based on the received emotional data. The input is emotional data, and the output is personalized tourist information.

[0440] Step 7:

[0441] The server retransmits the personalized tourist information to the user terminal. The input is the personalized tourist information, and the output is the tourist information sent to the received user terminal.

[0442] Step 8:

[0443] The user terminal analyzes the tourist information received and uses a speech synthesis engine to provide the information to the user by voice. The input is personalized tourist information, and the output is voice information.

[0444] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0445] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0446] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0447] [Second embodiment]

[0448] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0449] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0450] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0451] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0452] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0453] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0454] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0455] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0456] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0457] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0458] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0459] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0460] The present invention relates to an interactive tourist information providing system that enables users to obtain tourist information in a timely manner and enjoy their travels more. Specific embodiments of the system will be described below.

[0461] System Overview

[0462] This system consists of a user terminal, a travel information server, and a data processing algorithm for linking these. The user terminal is a device such as a smartphone or tablet, and acquires the current location, receives tourist information, and outputs it as audio. The travel information server receives the location data sent from the user terminal, searches for and processes tourist information based on the location information, and sends it to the user terminal.

[0463] Algorithms and Data Processing

[0464] To improve the efficiency of data processing, the travel information server uses a parallel processing algorithm, which divides data into multiple small segments and processes each segment simultaneously, thereby reducing the overall processing time.

[0465] Specific examples

[0466] Below is a specific example where the user is at Kinkakuji Temple in Kyoto.

[0467] 1. Obtaining current location

[0468] The user enables location services on the device, and the device obtains latitude 35.0394 and longitude 135.7292. This location information is saved internally as "current location."

[0469] 2. Data transmission

[0470] The device sends its current location to a travel information server, which then searches its database based on this location information to obtain tourist information related to Kinkakuji Temple.

[0471] 3. Data Parallelism

[0472] The server processes the tourist information it acquires using a parallel processing algorithm. The data is divided into small segments, such as architectural information, historical background, and reviews, and each segment is processed simultaneously.

[0473] 4. Data reintegration and transmission

[0474] The server reassembles the processed data and sends it to the user's terminal, which receives it and decodes it internally.

[0475] 5. Audio Output

[0476] The device analyzes the received data and uses a speech synthesis engine to provide information to the user. For example, it tells the user by voice, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The entire three-story building is covered in gold leaf..."

[0477] System Operation

[0478] User terminal

[0479] Obtaining location information: When the user launches the app and enables location services, the device obtains its current location.

[0480] Sending data: Send the acquired current location to the server.

[0481] Receiving and analyzing data: Receive and analyze the tourist information sent from the server.

[0482] Voice output: The analyzed tourist information is provided to the user using a voice synthesis engine.

[0483] Travel information server

[0484] Receiving data: Receive current location data from the user terminal.

[0485] Data search and retrieval: Search the database based on the received location information and retrieve the relevant tourist information.

[0486] Data processing using parallel processing algorithms: Data is divided into multiple segments and processed simultaneously.

[0487] Data reintegration and transmission: The processed data is reintegrated and transmitted to the user terminal.

[0488] In this way, the system provides users with fast and detailed tourist information, enhancing their travel experience.

[0489] The processing flow will be explained below.

[0490] Step 1:

[0491] A user launches a tourist guide application on their device and enables location services. The user device uses the GPS sensor to obtain the latitude and longitude of their current location (e.g., latitude 35.0394, longitude 135.7292).

[0492] Step 2:

[0493] The device temporarily stores the current location data it acquires internally and then sends this data to the API endpoint of the travel information provider server. The data to be sent is in a request format that includes latitude and longitude (e.g., GET / api / v1 / places?lat=35.0394&lng=135.7292).

[0494] Step 3:

[0495] Based on the location data received, the server searches the database for the relevant tourist spot and related information. The server identifies the relevant area from the location information and retrieves related data (e.g., architectural information, historical background, reviews, etc. of Kinkaku-ji Temple).

[0496] Step 4:

[0497] The server efficiently processes the tourist information it acquires using a parallel processing algorithm. Specifically, the data is divided into small segments, such as architectural information, historical background, and reviews, and processed simultaneously by multiple processors.

[0498] Step 5:

[0499] The server reintegrates the processed results of each segment to generate the final tourist information data, which is encoded in JSON format or similar and sent to the user's device.

[0500] Step 6:

[0501] The device decodes the tourist information data received from the server and analyzes it internally. It classifies the data (e.g., architectural information, historical background, reviews) and generates data for voice output using a speech synthesis engine.

[0502] Step 7:

[0503] The device uses a speech synthesis engine to provide the analyzed tourist information to the user by voice, generating a speech output such as "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The three-story building is entirely covered in gold leaf..."

[0504] Step 8:

[0505] The user can enjoy sightseeing while listening to the audio guide. During this process, they can move to another tourist spot as needed and repeat from step 1.

[0506] Example 1

[0507] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0508] Conventional tourist information systems face the challenge of providing users with the information they require quickly and efficiently. Furthermore, the accuracy and speed of location information acquisition and voice information provision are insufficient, making it difficult to improve the user experience. Furthermore, inefficient information search and processing slows the overall system response time. To address these issues, a system is needed that can streamline the processes of data acquisition, processing, and transmission, and provide information quickly and accurately.

[0509] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0510] In this invention, the server includes: a means for the information providing server to efficiently search and process information using a parallel data processing algorithm; a means for the information providing server to input the received data as a search query into an internal database and acquire multiple related information segments; and a means for the information providing server to reintegrate the processed information and transmit it to the user terminal. This improves the accuracy and speed of data acquisition, enabling efficient information processing and transmission, and making it possible to provide information to users with high accuracy and speed.

[0511] A "user terminal" is a device used by a user, and refers to a mobile information terminal such as a smartphone or tablet.

[0512] "Current location" refers to the latitude and longitude information acquired by the user terminal.

[0513] "Information providing server" refers to a central server for searching and processing relevant information based on location information received from a user terminal and sending it to the user terminal.

[0514] "Location data" refers to information about the latitude and longitude of the current location acquired by the user terminal.

[0515] "Database" refers to a data collection system in which various information is systematically stored and managed within an information providing server.

[0516] A "parallel processing algorithm" refers to a calculation method that improves efficiency by dividing data processing into multiple small units (segments) and processing them simultaneously.

[0517] "Speech synthesis engine" refers to software and hardware systems for converting text data into speech.

[0518] "Search query" refers to search criteria or commands used to retrieve specific information from a database.

[0519] "Information segment" refers to data divided into multiple small units that make up information.

[0520] "Reintegration" refers to the process of combining multiple parallel-processed information segments into a single coherent data set.

[0521] "GPS Sensor" refers to a sensor built into a device that uses the Earth's satellite system to obtain location information.

[0522] "Analysis" refers to the process of understanding received data and transforming it into a form that can be used as a tangible output.

[0523] These definitions clarify each component and process of the present invention.

[0524] The present invention relates to an interactive tourist information providing system that enables users to obtain tourist information in a timely manner and to enjoy their travels more. Detailed embodiments for carrying out the present invention will be specifically described below.

[0525] System Overview

[0526] This system consists of a user terminal, an information server, and a data processing algorithm for linking these. The user terminal is a mobile information terminal such as a smartphone or tablet, and acquires the current location, receives information, and outputs voice. The information server receives location data sent from the user terminal, searches for and processes related information based on that location information, and sends it to the user terminal.

[0527] Hardware and software used

[0528] User device: A mobile information terminal such as a smartphone or tablet.

[0529] GPS sensor: A sensor built into the device for obtaining location information.

[0530] Information provider server: A server with high-performance processing capabilities.

[0531] Speech synthesis engine: Software that provides speech synthesis functionality, such as the Google Text-to-Speech API.

[0532] Parallel processing algorithms: Algorithms for large-scale data processing such as Apache Hadoop.

[0533] Data processing and calculation

[0534] 1. Obtaining and sending location information:

[0535] The user's device uses the GPS sensor to obtain the latitude and longitude of the current location, which is then stored in the app as location data.

[0536] The acquired location data is sent to the information provider server using the HTTPS protocol.

[0537] 2. Receiving and retrieving data:

[0538] The server receives the location data and searches its internal database based on the data, and a search query is generated based on the received location data to retrieve relevant information segments.

[0539] 3. Data Parallelism:

[0540] The acquired information segments are efficiently processed using a parallel processing algorithm: the information is divided into smaller segments such as architectural information, historical background, reviews, etc., and processed simultaneously.

[0541] 4. Data recombination and transmission:

[0542] The parallel processed information segments are recombined and transmitted to the user terminal as a single unified data set.

[0543] 5. Data analysis and audio output:

[0544] The user device analyzes the received data and activates a speech synthesis engine based on the analysis results, providing the user with information in the form of voice.

[0545] Specific examples

[0546] For example, a specific example will be given where the user is at Kinkakuji Temple in Kyoto.

[0547] 1. The user launches the app and enables location services. The device obtains latitude 35.0394 and longitude 135.7292 and saves it as the "current location."

[0548] 2. Send your current location to the information server. The server then searches the database based on this location information to retrieve information related to Kinkaku-ji Temple (architectural information, historical background, reviews, etc.).

[0549] 3. The server processes the acquired information using a parallel processing algorithm, which improves the processing speed.

[0550] 4. The processed information is reassembled and sent to the user terminal.

[0551] 5. The user terminal analyzes the received data and uses a speech synthesis engine to provide the information to the user aloud.

[0552] Example: "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The entire three-story building is covered in gold leaf..."

[0553] Prompt Sentence Examples

[0554] "Please tell me about the design of a system that provides tourist information about a location when a user inputs their current location."

[0555] "Please explain in detail how a system that provides audio tourist information based on a user's location when the user is at Kinkakuji Temple in Kyoto works."

[0556] In this way, the system provides users with fast and detailed tourist information, enhancing their travel experience.

[0557] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0558] Step 1:

[0559] The user launches the app and enables location services.

[0560] Input: A user launches a tourist information app on their smartphone or tablet. The user enables location services.

[0561] Data processing or data calculation: The device activates the GPS sensor.

[0562] Output: Location services are enabled and the device starts obtaining the current location. Specifically, the message "Please enable location services" is displayed in the app, and the user taps the "Allow" button.

[0563] Step 2:

[0564] The terminal acquires the current location and transmits it to the information providing server.

[0565] Input: Latitude and longitude of current location obtained by GPS sensor (e.g., latitude 35.0394, longitude 135.7292).

[0566] Data processing or data calculation: The acquired location information is saved on the device as the "current location." The location information is sent to the information provider server using the HTTPS protocol.

[0567] Output: Current location data is sent to the information server. Specifically, location information is obtained from the GPS sensor and temporarily displayed on the app screen. This information is automatically sent to the server, and a message indicating successful transmission is displayed.

[0568] Step 3:

[0569] The server receives the location data and searches a database to retrieve relevant information.

[0570] Input: Current location data sent from the user device.

[0571] Data processing or data calculation: Searching an internal database based on the received location data. A search query is generated based on the location data to retrieve relevant information (e.g., architectural information, historical background, reviews, etc.).

[0572] Output: The information related to the location is retrieved. Specifically, the server records the received location information in a log file and generates a search query to query the database.

[0573] Step 4:

[0574] The server processes the information using a parallel processing algorithm.

[0575] Input: Relevant information retrieved from the database.

[0576] Data processing or data calculation: Divide the acquired information into smaller segments (e.g., architectural information, historical background, reviews) and process each segment simultaneously using parallel processing algorithms.

[0577] Output: Parallelized information segments. Specifically, the information is split into several JSON objects, and each JSON object is processed simultaneously to reduce processing time.

[0578] Step 5:

[0579] The server reassembles the processed information and transmits it to the user terminal.

[0580] Input: Each information segment processed in parallel.

[0581] Data processing or data calculation: Reintegrate each parallel processed segment and send it to the user terminal as a single unified data set. HTTPS protocol is used.

[0582] Output: The reintegrated information is sent to the user terminal. Specifically, the integrated data is encoded and sent to the terminal.

[0583] Step 6:

[0584] The device analyzes the data it receives and uses a speech synthesis engine to output the information aloud.

[0585] Input: Aggregated data sent from the server.

[0586] Data processing or data calculation: The received data is analyzed within the terminal and the speech synthesis engine is activated.

[0587] Output: Based on the analysis results, information is provided to the user via voice. Specifically, the device decodes the received information, and the speech synthesis engine provides the information via voice, such as "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple..."

[0588] (Application example 1)

[0589] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0590] Conventional tourist information systems are primarily used during actual travel, and tourist information systems in virtual spaces have not been widely adopted. This makes it difficult for users in remote locations to interactively obtain real-time information about tourist spots in virtual spaces. Furthermore, when users use virtual reality headsets to obtain local information, the information provided is not based on their current location and direction, making it difficult to provide an effective tourist experience.

[0591] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0592] In this invention, the server includes means for acquiring the user's current location, means for transmitting the acquired current location data to an information providing server, means for the information providing server to search for tourist information based on the location data and transmit the tourist information to the user terminal, means for providing the tourist information received by the user terminal by voice, means for acquiring the current location and direction within the virtual space using a virtual reality headset, and means for providing the tourist information based on the current location and direction within the virtual space. This allows the user to acquire tourist information in real time even within the virtual space, enabling a realistic tourist experience even from a remote location.

[0593] "User" refers to an individual who obtains tourist information using the tourist information providing system.

[0594] "Current location" refers to the geographic location information of the user obtained by the user terminal or virtual reality headset.

[0595] The term "information providing server" refers to a server device that searches for tourist information based on the location data transmitted from the user terminal and transmits the relevant information to the user terminal.

[0596] "Tourist information" refers to data including historical background, architectural information, reviews, and other information related to tourist destinations.

[0597] "User terminal" refers to a portable information processing device such as a smartphone or tablet.

[0598] "Means for providing by voice" refers to means for transmitting tourist information received by a user terminal to a user as voice data using a voice synthesis engine.

[0599] A "virtual reality headset" refers to a display device that a user wears on their head to immerse themselves in a virtual space.

[0600] A "parallel processing algorithm" refers to an algorithm that improves processing speed by processing large amounts of data simultaneously in multiple processing units.

[0601] "Location data" refers to data including latitude and longitude information indicating the user's current location.

[0602] "Direction" refers to information acquired by the virtual reality headset that indicates the user's line of sight and body orientation.

[0603] The present invention relates to a system that allows users to obtain real-time tourist information in a virtual space using a virtual reality headset. The system is composed of a user terminal, a virtual reality headset, an information providing server, and a program for linking these devices.

[0604] System Overview

[0605] The system includes the following major components:

[0606] 1. User terminal: An information processing device such as a smartphone or tablet that acquires the current location, receives tourist information, and outputs audio.

[0607] 2. Virtual reality headset (HMD): A user wears it to move around in a virtual space and obtain position and orientation information.

[0608] 3. Information server: Searches for tourist information based on the location data sent from the user terminal, processes it, and sends it to the user terminal.

[0609] 4. Data Processing Algorithms: Parallel processing algorithms are used to process data efficiently.

[0610] 5. Speech synthesis engine: Provides tourist information to users by voice.

[0611] Program processing

[0612] Hardware and Software Configuration

[0613] Obtaining current location: The GPS and direction sensors built into the virtual reality headset are used to obtain the user's geographical location and gaze direction. The hardware used includes the GPS module and gyro sensor built into the HMD. The software used includes the HMD's API.

[0614] Data transmission: The acquired current location data is sent to the information provider server. The software used includes the requests library for sending HTTP requests.

[0615] Parallel data processing: On the information server side, the acquired tourist information data is efficiently processed using a parallel processing algorithm. This uses a threading library.

[0616] Providing information by voice: The user terminal receives tourist information sent from the information server and provides the information to the user by voice using a speech synthesis engine. The speech synthesis engine uses the text_to_speech library.

[0617] Specific examples

[0618] When a user wears a virtual reality headset and is at a virtual tourist spot, the HMD obtains its current location at latitude 35.0394 and longitude 135.7292. This location information is sent to a server, which then searches for tourist information related to Kinkaku-ji Temple. The obtained tourist information is efficiently divided and processed using parallel processing, and then reintegrated and sent to the user's device. Finally, the user's device communicates this information to the user using a speech synthesis engine.

[0619] Prompt Sentence Examples

[0620] In text format, it should look like this:

[0621] Your current virtual location is at latitude 35.0394 and longitude 135.7292. Please provide detailed tourist information based on this location.

[0622] With the above configuration, the present invention realizes a system that can obtain tourist information in real time even within a virtual space, allowing users to experience tourist spots with a sense of realism even from a remote location.

[0623] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0624] Step 1:

[0625] The user terminal acquires the user's current position and gaze direction using a virtual reality headset.

[0626] Input: Data from the GPS module and gyro sensor of the virtual reality headset.

[0627] Output: Latitude, longitude, line of sight direction.

[0628] How it works: The sensors in the virtual reality headset detect the user's current location (latitude, longitude) and gaze direction in real time and store this data internally.

[0629] Step 2:

[0630] The user terminal transmits the acquired current location data to the information providing server.

[0631] Input: Current location data (latitude, longitude).

[0632] Output: HTTP request to the information provider server.

[0633] Specific operation: The user terminal sends the current location data stored internally to the information providing server as an HTTP request.

[0634] Step 3:

[0635] The information providing server searches for tourist information based on the received location data.

[0636] Input: Current location data (latitude, longitude).

[0637] Output: Tourist information data.

[0638] Specific operation: The information providing server searches the database based on the received location data and obtains the relevant tourist information (historical background, architectural information, reviews, etc.).

[0639] Step 4:

[0640] The information providing server processes tourist information data using a parallel processing algorithm.

[0641] Input: Tourist information data.

[0642] Output: Segmented tourist information.

[0643] Specific operation: Tourist information data is divided into small segments such as architectural information, historical background, reviews, etc., and each segment is processed simultaneously using a parallel processing algorithm (threading library).

[0644] Step 5:

[0645] The information providing server reintegrates the processed tourist information and transmits it to the user terminal.

[0646] Input: Tourist information for each processed segment.

[0647] Output: Reintegrated tourist information data.

[0648] Specific operation: The tourist information for each segment processed in parallel is reintegrated and sent to the user's terminal as an HTTP response.

[0649] Step 6:

[0650] The tourist information received by the user terminal is analyzed and provided to the user in audio form using a speech synthesis engine.

[0651] Input: Reintegrated tourist information data.

[0652] Output: Audio data.

[0653] Specific operation: The user device receives and analyzes the reintegrated tourist information data, and then uses the text_to_speech library to provide the information to the user via voice.

[0654] Step 7:

[0655] The user moves to the next point in the virtual space, and the HMD again acquires the current position and gaze direction.

[0656] Input: New current location data (latitude, longitude) and line of sight direction.

[0657] Output: Updated position and orientation information.

[0658] How it works: When the user moves to the next tourist spot in the virtual space, the virtual reality headset again obtains the new current position and gaze direction in real time and stores the updated data internally.

[0659] By repeating these steps, users can obtain real-time tourist information while moving around the virtual space and obtain detailed information via voice.

[0660] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0661] The present invention relates to a system that recognizes a user's emotions and personalizes tourist information based on those emotions. The system is composed of a user terminal, a travel information server, an emotion engine, and a data processing algorithm for linking these components.

[0662] System Overview

[0663] The main components of this system are as follows:

[0664] 1. User terminal: A device that is directly operated by the user, such as a smartphone or tablet. It acquires the current location, receives tourist information, analyzes emotions, and outputs voice.

[0665] 2. Travel information server: A server system that searches for and processes tourist information based on location data sent from the user's terminal and sends it to the user's terminal.

[0666] 3. Emotion engine: It has the ability to recognize users' emotions in real time and adjust the tourist information provided based on that data.

[0667] Algorithms and Data Processing

[0668] The travel information server uses a parallel processing algorithm to improve data processing efficiency. This algorithm divides data into multiple small segments and processes each segment simultaneously, shortening the overall processing time. In addition, an emotion engine collects and analyzes user emotion data and provides personalized tourism information based on that data.

[0669] Specific examples

[0670] Below is a specific example where the user is at Kinkakuji Temple in Kyoto.

[0671] 1. Obtaining current location

[0672] The user enables location services on the device, and the device obtains latitude 35.0394 and longitude 135.7292. This location information is saved internally as "current location."

[0673] 2. Data transmission

[0674] The device sends its current location to a travel information server, which searches its database based on this location information to obtain tourist information related to Kinkakuji Temple.

[0675] 3. Data Parallelism

[0676] The server efficiently processes the tourist information it acquires using a parallel processing algorithm. The data is divided into small segments, such as architectural information, historical background, and reviews, and processed simultaneously by multiple processors.

[0677] 4. Collecting Emotional Data

[0678] The emotion engine on the user device recognizes and analyzes the user's emotions based on their facial expressions, tone of voice, operation logs, etc. Emotional data is collected in real time and stored internally.

[0679] 5. Coordination of tourist information

[0680] The server personalizes the tourist information it provides based on the user's emotional data. For example, if the user looks happy, it will provide more detailed historical information and information that includes entertainment elements.

[0681] 6. Data reintegration and transmission

[0682] The server reassembles the processed data and sends it to the user's terminal, which receives it and decodes it internally.

[0683] 7. Audio Output

[0684] The device analyzes the received data and uses a speech synthesis engine to provide information to the user. For example, it tells the user by voice, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The entire three-story building is covered in gold leaf..."

[0685] 8. Emotional Feedback

[0686] The emotion engine detects the user's reactions (for example, smiles or surprised expressions) and reflects them in the next information provided, enabling the system to provide optimal tourist information to the user.

[0687] System Operation

[0688] User terminal

[0689] Obtaining location information: When the user launches the app and enables location services, the device obtains its current location.

[0690] Sending data: Send the acquired current location to the server.

[0691] Emotion data collection and analysis: The emotion engine collects and analyzes user emotions in real time.

[0692] Receiving tourist information and outputting it as audio: Receives personalized tourist information sent from the server, analyzes it, and outputs it as audio.

[0693] Travel information server

[0694] Receiving data: Receive current location data from the user terminal.

[0695] Data search and retrieval: Search the database based on the received location information and retrieve the relevant tourist information.

[0696] Data processing using parallel processing algorithms: Data is divided into multiple segments and processed simultaneously.

[0697] Information tailoring based on emotional data: Analyze emotional data and personalize tourism information based on it.

[0698] Data reintegration and transmission: The processed data is reintegrated and transmitted to the user terminal.

[0699] In this way, the system optimizes tourist information based on user sentiment and improves the travel experience.

[0700] The processing flow will be explained below.

[0701] Step 1:

[0702] A user launches a tourist guide application on their device and enables location services. The user device uses the GPS sensor to obtain the latitude and longitude of their current location (e.g., latitude 35.0394, longitude 135.7292).

[0703] Step 2:

[0704] The device temporarily stores the current location data it acquires internally and then sends this data to the API endpoint of the travel information provider server. The data to be sent is in a request format that includes latitude and longitude (e.g., GET / api / v1 / places?lat=35.0394&lng=135.7292).

[0705] Step 3:

[0706] Based on the location data received, the server searches the database for the relevant tourist spot and related information. The server identifies the relevant area from the location information and retrieves related data (e.g., architectural information, historical background, reviews, etc. of Kinkaku-ji Temple).

[0707] Step 4:

[0708] The server efficiently processes the tourist information it acquires using a parallel processing algorithm. Specifically, the data is divided into small segments, such as architectural information, historical background, and reviews, and processed simultaneously by multiple processors.

[0709] Step 5:

[0710] The server reintegrates the processed results of each segment to generate the final tourist information data, which is encoded in JSON format or similar and sent to the user's device.

[0711] Step 6:

[0712] The user device decodes the tourist information data received from the server and analyzes it internally. It classifies the data (e.g., architectural information, historical background, reviews), and also generates and prepares data for the emotion engine.

[0713] Step 7:

[0714] The emotion engine on the user device recognizes and analyzes the user's emotions in real time based on the user's facial expressions, tone of voice, operation logs, etc. Emotional data is stored and analyzed internally.

[0715] Step 8:

[0716] The emotion engine analyzes the emotional data and adjusts the tourist information provided. For example, if the user looks happy, it will prioritize information with a stronger entertainment element.

[0717] Step 9:

[0718] The user device uses a speech synthesis engine to provide the adjusted tourist information by voice. For example, it may say to the user, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The entire three-story building is covered in gold leaf..."

[0719] Step 10:

[0720] While the user enjoys sightseeing while listening to the audio guide, the emotion engine continuously detects the user's reactions (e.g., smiles or surprised expressions) and reflects them in the information provided from the next time onwards.

[0721] Step 11:

[0722] If the user moves to another tourist spot, the process is repeated from step 1. This allows the user to always receive personalized and up-to-date tourist information.

[0723] Example 2

[0724] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0725] Conventional tourist information systems only provide tourist information based on the user's current location, and have the problem of lacking personalization according to the user's emotions and interests. As a result, users' travel experiences are uniform, and information provision that is optimized for each individual user is not provided.

[0726] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0727] In this invention, the server includes means for acquiring the user's current location, means for transmitting the acquired current location data to a travel information providing server, means for the travel information providing server to search for tourist information based on the location data and transmit the tourist information to the user terminal, means for the user terminal to provide the tourist information received by voice, means for collecting and analyzing user emotion data, and means for personalizing the tourist information based on the emotion data, thereby making it possible to provide personalized tourist information that takes into account the user's real-time emotions.

[0728] A "user" is a person who uses the system to obtain tourist information and experience travel.

[0729] "Current location" is geographical location information acquired by the user's terminal, and is expressed as latitude and longitude.

[0730] The "travel information server" is a server system that searches for tourist information based on the location data sent from the user terminal, processes it, and sends it to the user terminal.

[0731] A "user terminal" is a device such as a smartphone or tablet operated by a user, which acquires and transmits the user's current location, receives tourist information, and collects and analyzes emotional data.

[0732] "Tourist information" is detailed information about tourist spots that the travel information server searches for based on location data and provides to the user terminal.

[0733] A "speech synthesis engine" is a program that generates speech from text and provides information to users in an easy-to-listen format.

[0734] "Emotion data" is data that indicates the user's emotional state, collected from the user's facial expression, tone of voice, operation log, and the like.

[0735] "Personalization" means optimizing the content and delivery method of information according to the characteristics and emotions of each individual user.

[0736] A "parallel processing algorithm" is an algorithm that improves the efficiency of data processing by processing multiple small data segments simultaneously.

[0737] The present invention relates to a system that recognizes a user's emotions and personalizes tourist information based on those emotions. The system is composed of a user terminal, a travel information server, an emotion engine, and a data processing algorithm for linking these elements.

[0738] System Configuration

[0739] The system consists of the following main components:

[0740] 1. User terminal: A device that is directly operated by the user, such as a smartphone or tablet. This includes functions to obtain current location, receive tourist information, collect emotion data, and output voice. Specific hardware used includes a GPS module, camera, microphone, and touchscreen.

[0741] 2. Travel Information Server: A server system that searches and processes tourist information based on location data sent from the user's device and sends it to the user's device. It uses a parallel processing algorithm to efficiently search and process data.

[0742] 3. Emotion engine: Collects and analyzes emotional data in real time from users' facial expressions, tone of voice, operation logs, etc. Based on this emotional data, the tourist information provided is personalized.

[0743] Data Processing

[0744] To improve the efficiency of data processing, the travel information server uses a parallel processing algorithm, which divides the data into multiple small segments and processes each segment simultaneously, thereby reducing the overall processing time.

[0745] Furthermore, the emotion engine collects and analyzes the user's emotional data and adjusts the tourist information provided based on that data, thereby providing the most appropriate tourist information for the user.

[0746] Specific examples of operation procedures

[0747] Below is a specific example where the user is at Kinkakuji Temple in Kyoto.

[0748] 1. Obtaining current location: The user launches the app and enables location services. The device obtains latitude 35.0394 and longitude 135.7292 and stores this internally as the current location.

[0749] 2. Data transmission: The device transmits its current location to the travel information server. The server searches its database based on this location information and retrieves tourist information related to Kinkakuji Temple.

[0750] 3. Parallel data processing: The server efficiently processes the tourist information acquired using parallel processing algorithms. The data is divided into small segments such as architectural information, historical background, and reviews, and processed simultaneously by multiple processors.

[0751] 4. Emotion data collection: The emotion engine on the user device recognizes and analyzes the user's emotions based on their facial expressions, tone of voice, operation logs, etc. Emotion data is collected in real time and stored internally.

[0752] 5. Tailoring tourist information: The server personalizes tourist information based on emotional data. For example, if the user looks happy, the server will provide more detailed historical information and information that includes entertainment elements.

[0753] 6. Data reassembly and transmission: The server reassembly processes the data and transmits it to the user's terminal, which receives the data and decodes it internally.

[0754] 7. Voice output: The device analyzes the data received and uses a voice synthesis engine to provide information to the user. For example, it tells the user by voice, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The three-story building is covered entirely in gold leaf..."

[0755] Prompt Sentence Examples

[0756] Below are some examples of prompts to input to the generative AI model.

[0757] "Please explain in detail the system overview and operation flow for the system that allows users to obtain tourist information based on their current location."

[0758] This system provides personalized tourist information based on the user's emotions in real time, enabling a travel experience optimized for each individual user, unlike conventional tourist guide systems.

[0759] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0760] Step 1:

[0761] Obtain location information on the user device.

[0762] Input: User launches the app and enables location services.

[0763] Action: The device uses GPS to obtain the user's current location, which is expressed in latitude and longitude format.

[0764] Output: Current location data is obtained: latitude 35.0394, longitude 135.7292.

[0765] Specific operation: The smartphone's GPS module is activated and the acquired latitude and longitude data is stored in the internal memory.

[0766] Step 2:

[0767] The location information is sent from the user terminal to the server.

[0768] Input: Current location data obtained (latitude 35.0394, longitude 135.7292).

[0769] Processing: The device creates an HTTP request and sends the acquired current location data to the travel information server.

[0770] Output: The server receives the current location data.

[0771] Specific operation: The app automatically creates an HTTP request and sends it to the server via the communication module.

[0772] Step 3:

[0773] The server performs a data search based on the received location information.

[0774] Input: Current location data received by the server.

[0775] Processing: The server forms a database query to search for tourist information for the location (e.g., Kinkaku-ji Temple).

[0776] Output: Tourist information about Kinkaku-ji Temple is obtained, including architectural information, historical background, visitor reviews, etc.

[0777] Specific operation: The database server processes the query, extracts the relevant tourist information, and sends it to the main server.

[0778] Step 4:

[0779] The server processes tourist information efficiently using parallel processing.

[0780] Input: Tourist information retrieved from the database.

[0781] Processing: The acquired tourist information is divided into multiple segments (architectural information, historical background, reviews, etc.) and processed simultaneously using a parallel processing algorithm.

[0782] Output: Tourist information data with each segment processed is obtained.

[0783] Specific operation: Multiple processors within the server synchronize and process data in parallel, achieving improved processing speed.

[0784] Step 5:

[0785] The server reintegrates the processed tourist information and transmits it to the user terminal.

[0786] Input: Data for each segment obtained by parallel processing.

[0787] Processing: Reassemble the data from each segment into a single data packet and send it to the user terminal as an HTTP response.

[0788] Output: The user terminal receives the integrated tourist information data.

[0789] Specific operation: The server forms a data packet and sends it to the user terminal via the communication module.

[0790] Step 6:

[0791] Emotional data is collected and analyzed on the user's device.

[0792] Input: The user views the tourist information they have received.

[0793] Processing: The emotion engine collects the user's facial expressions, tone of voice, and operation logs, and analyzes the emotion data in real time.

[0794] Output: Data indicating the user's emotional state is stored internally.

[0795] What it does: The camera and microphone are activated to detect the user's facial expressions and voice, which are then analyzed by an emotion analysis algorithm.

[0796] Step 7:

[0797] The server personalizes tourist information based on emotion data.

[0798] Input: Emotion data sent from the user device.

[0799] Processing: Analyze the emotion data and re-adjust the tourist information according to the user's interests and emotions. For example, if a user is enjoying themselves, provide them with detailed historical information or information that includes entertainment elements.

[0800] Output: Personalized tourist information data is obtained.

[0801] Specific operation: The server reintegrates the re-adjusted tourist information and forms it into a data packet.

[0802] Step 8:

[0803] The server transmits the reintegrated data to the user terminal.

[0804] Input: Personalized tourist information data.

[0805] Processing: The reintegrated tourist information data is sent to the user terminal as an HTTP response.

[0806] Output: The user terminal receives the re-adjusted tourist information data.

[0807] Specific operation: The server forms a data packet and sends it to the user terminal via the communication module.

[0808] Step 9:

[0809] Tourist information is output aloud on the user terminal.

[0810] Input: Tourist information data received from the server.

[0811] Processing: The device analyzes the tourist information received and outputs it aloud using a speech synthesis engine.

[0812] Output: The user receives tourist information by voice.

[0813] Specific operation: The device's speaker will be activated and will read out, for example, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple..."

[0814] This processing flow realizes a system that provides optimal tourist information based on the user's current location and emotions.

[0815] (Application example 2)

[0816] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0817] Conventional tourist information systems can provide tourist information based on a user's current location, but they cannot provide information that takes the user's emotions into account, making it difficult to provide information that is optimized for each individual. Furthermore, since users' moods and interests change from time to time while traveling, there is a demand for information that reflects their trends in real time. The present invention aims to solve these problems and enable the provision of personalized tourist information that reflects the user's emotions.

[0818] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring the user's current location, means for transmitting the acquired current location data to the travel information providing server, means for the travel information providing server to search for tourist information based on the location data and transmit the tourist information to the user terminal, means for the user terminal to provide the received tourist information by voice, and means for the user terminal to recognize emotions from image data and personalize the tourist information based on the emotion data. This makes it possible to provide real-time, personalized tourist information that reflects the user's emotions.

[0819] The "means by which the user obtains the current location" refers to a function for obtaining the user's current location data using the GPS function or location information service of the user's terminal.

[0820] The "means for transmitting the acquired current location data to the travel information server" is a function for transmitting the current location data acquired by the user terminal to the travel information server via the network.

[0821] "Means for the travel information providing server to search for tourist information based on location data and transmit the tourist information to the user terminal" refers to a function for the travel information providing server to search for relevant tourist information based on the location data received and transmit the information to the user terminal.

[0822] The "means for providing tourist information received by the user terminal by voice" is a function that analyzes tourist information received by the user terminal and provides the information to the user by voice using voice synthesis technology.

[0823] "Means for a user terminal to recognize emotions from image data and personalize tourist information based on the emotional data" refers to a function in which a user terminal analyzes image data taken with a camera or the like, recognizes the user's emotions, and then individually optimizes tourist information based on that emotional data.

[0824] A "parallel data processing algorithm" is an algorithm that divides data into multiple small segments and processes them simultaneously in parallel to improve processing efficiency.

[0825] The system that realizes this application example has the following configuration: It consists of a user terminal, a travel information server, and an emotion engine, all of which work in conjunction with each other. A detailed embodiment of this system is described below.

[0826] User terminal

[0827] A user terminal refers to a mobile information terminal such as a smartphone or tablet, and includes the following hardware and software:

[0828] GPS sensor: Used to obtain current location.

[0829] Camera: Used to capture image data, thereby capturing the user's facial expressions.

[0830] Location Services: Software for managing acquired location data.

[0831] Emotion Recognition Software: Analyze user emotions using the Facial Recognition API.

[0832] Network communication module: Used to transmit location data and emotion data to the travel information providing server.

[0833] Speech synthesis engine: Used to provide received tourist information to the user by voice.

[0834] Travel information server

[0835] The travel information server is a cloud-based server designed to efficiently process large amounts of data. This server uses the following hardware and software:

[0836] Database system: stores tourist information.

[0837] Parallel processing algorithm: Used to efficiently search and process tourism information, this algorithm divides the data into multiple segments and processes them simultaneously.

[0838] Network communication module: Manages data received from user terminals and transmits necessary tourist information to the user terminals.

[0839] Emotion Engine

[0840] The emotion engine is a software module that recognizes users' emotions in real time and personalizes tourist information based on that data.

[0841] Facial Recognition API: Analyzes image data and recognizes user emotions.

[0842] Data analysis module: Optimizes tourist information based on recognized emotion data.

[0843] Example of system operation

[0844] 1. Obtaining location information: When the user launches the app and enables location services, the GPS sensor on the user's device obtains the current location.

[0845] 2. Data transmission: The acquired current location data is transmitted to the travel information server. This is handled by the network communication module.

[0846] 3. Obtaining tourist information: The travel information server searches the database based on the location data and obtains the relevant tourist information. This is efficiently processed using a parallel processing algorithm.

[0847] 4. Emotion data collection: The camera on the user's device captures the user's facial expressions, and emotion recognition software analyzes the emotions.

[0848] 5. Personalized tourist information: The emotion engine personalizes tourist information based on the emotional data acquired.

[0849] 6. Providing information: Optimized tourist information is sent to the user's terminal and provided audibly using a speech synthesis engine.

[0850] Prompt Sentence Examples

[0851] When a user looks at a product using their smartphone camera, if emotions like "surprise" or "excitement" are detected, recommend the best product for the user based on that emotion, and also show information about nearby stores where the product is available.

[0852] The above configuration makes it possible to provide real-time, personalized tourist information that reflects the user's emotions, thereby improving the quality of the travel experience.

[0853] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0854] Step 1:

[0855] A user launches an app and enables location services, which allows the GPS sensor on the user's device to obtain current location data. The input is the user's action and the activation of location services, and the output is the current location data.

[0856] Step 2:

[0857] The acquired current location data is sent to the travel information server. The user terminal uses a network communication module to send the location data to the server. The input is the current location data, and the output is receiving the location data on the server side.

[0858] Step 3:

[0859] The server searches the database based on the received location data and retrieves the relevant tourist information. It uses a parallel processing algorithm to efficiently search and process the data. The input is location data, and the output is tourist information data.

[0860] Step 4:

[0861] A user captures image data using a camera. The camera on the user's device acquires the image and sends it to emotion recognition software. The input is image data, and the output is emotion data.

[0862] Step 5:

[0863] Emotion recognition software analyzes image data and recognizes the user's emotions. This is processed by the Facial Recognition API on the user's device. The input is image data, and the output is recognized emotion data.

[0864] Step 6:

[0865] The user terminal sends emotional data to a travel information server. The server then personalizes tourist information based on the received emotional data. The input is emotional data, and the output is personalized tourist information.

[0866] Step 7:

[0867] The server retransmits the personalized tourist information to the user terminal. The input is the personalized tourist information, and the output is the tourist information sent to the received user terminal.

[0868] Step 8:

[0869] The user terminal analyzes the tourist information received and uses a speech synthesis engine to provide the information to the user by voice. The input is personalized tourist information, and the output is voice information.

[0870] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0871] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0872] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0873] [Third embodiment]

[0874] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0875] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0876] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0877] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0878] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0879] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0880] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0881] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0882] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0883] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0884] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0885] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0886] The present invention relates to an interactive tourist information providing system that enables users to obtain tourist information in a timely manner and enjoy their travels more. Specific embodiments of the system will be described below.

[0887] System Overview

[0888] This system consists of a user terminal, a travel information server, and a data processing algorithm for linking these. The user terminal is a device such as a smartphone or tablet, and acquires the current location, receives tourist information, and outputs it as audio. The travel information server receives the location data sent from the user terminal, searches for and processes tourist information based on the location information, and sends it to the user terminal.

[0889] Algorithms and Data Processing

[0890] To improve the efficiency of data processing, the travel information server uses a parallel processing algorithm, which divides data into multiple small segments and processes each segment simultaneously, thereby reducing the overall processing time.

[0891] Specific examples

[0892] Below is a specific example where the user is at Kinkakuji Temple in Kyoto.

[0893] 1. Obtaining current location

[0894] The user enables location services on the device, and the device obtains latitude 35.0394 and longitude 135.7292. This location information is stored internally as "current location."

[0895] 2. Data transmission

[0896] The device sends its current location to a travel information server, which then searches its database based on this location information to obtain tourist information related to Kinkakuji Temple.

[0897] 3. Data Parallelism

[0898] The server processes the tourist information it acquires using a parallel processing algorithm. The data is divided into small segments, such as architectural information, historical background, and reviews, and each segment is processed simultaneously.

[0899] 4. Data reintegration and transmission

[0900] The server reassembles the processed data and sends it to the user's terminal, which receives it and decodes it internally.

[0901] 5. Audio Output

[0902] The device analyzes the received data and uses a speech synthesis engine to provide information to the user. For example, it tells the user by voice, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The entire three-story building is covered in gold leaf..."

[0903] System Operation

[0904] User terminal

[0905] Obtaining location information: When the user launches the app and enables location services, the device obtains its current location.

[0906] Sending data: Send the acquired current location to the server.

[0907] Receiving and analyzing data: Receive and analyze the tourist information sent from the server.

[0908] Voice output: The analyzed tourist information is provided to the user using a voice synthesis engine.

[0909] Travel information server

[0910] Receiving data: Receive current location data from the user terminal.

[0911] Data search and retrieval: Search the database based on the received location information and retrieve the relevant tourist information.

[0912] Data processing using parallel processing algorithms: Data is divided into multiple segments and processed simultaneously.

[0913] Data reintegration and transmission: The processed data is reintegrated and transmitted to the user terminal.

[0914] In this way, the system provides users with fast and detailed tourist information, enhancing their travel experience.

[0915] The processing flow will be explained below.

[0916] Step 1:

[0917] A user launches a tourist guide application on their device and enables location services. The user device uses the GPS sensor to obtain the latitude and longitude of their current location (e.g., latitude 35.0394, longitude 135.7292).

[0918] Step 2:

[0919] The device temporarily stores the current location data it acquires internally and then sends this data to the API endpoint of the travel information provider server. The data to be sent is in a request format that includes latitude and longitude (e.g., GET / api / v1 / places?lat=35.0394&lng=135.7292).

[0920] Step 3:

[0921] Based on the location data received, the server searches the database for the relevant tourist spot and related information. The server identifies the relevant area from the location information and retrieves related data (e.g., architectural information, historical background, reviews, etc. of Kinkaku-ji Temple).

[0922] Step 4:

[0923] The server efficiently processes the tourist information it acquires using a parallel processing algorithm. Specifically, the data is divided into small segments, such as architectural information, historical background, and reviews, and processed simultaneously by multiple processors.

[0924] Step 5:

[0925] The server reintegrates the processed results of each segment to generate the final tourist information data, which is encoded in JSON format or similar and sent to the user's device.

[0926] Step 6:

[0927] The device decodes the tourist information data received from the server and analyzes it internally. It classifies the data (e.g., architectural information, historical background, reviews) and generates data for voice output using a speech synthesis engine.

[0928] Step 7:

[0929] The device uses a speech synthesis engine to provide the analyzed tourist information to the user by voice, generating a speech output such as "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The three-story building is entirely covered in gold leaf..."

[0930] Step 8:

[0931] The user can enjoy sightseeing while listening to the audio guide. During this process, they can move to another tourist spot as needed and repeat from step 1.

[0932] Example 1

[0933] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0934] Conventional tourist information systems face the challenge of providing users with the information they require quickly and efficiently. Furthermore, the accuracy and speed of location information acquisition and voice information provision are insufficient, making it difficult to improve the user experience. Furthermore, inefficient information search and processing slows the overall system response time. To address these issues, a system is needed that can streamline the processes of data acquisition, processing, and transmission, and provide information quickly and accurately.

[0935] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0936] In this invention, the server includes: a means for the information providing server to efficiently search and process information using a parallel data processing algorithm; a means for the information providing server to input the received data as a search query into an internal database and acquire multiple related information segments; and a means for the information providing server to reintegrate the processed information and transmit it to the user terminal. This improves the accuracy and speed of data acquisition, enabling efficient information processing and transmission, and making it possible to provide information to users with high accuracy and speed.

[0937] A "user terminal" is a device used by a user, and refers to a mobile information terminal such as a smartphone or tablet.

[0938] "Current location" refers to the latitude and longitude information acquired by the user terminal.

[0939] "Information providing server" refers to a central server for searching and processing relevant information based on location information received from a user terminal and sending it to the user terminal.

[0940] "Location data" refers to information about the latitude and longitude of the current location acquired by the user terminal.

[0941] "Database" refers to a data collection system in which various information is systematically stored and managed within an information providing server.

[0942] A "parallel processing algorithm" refers to a calculation method that improves efficiency by dividing data processing into multiple small units (segments) and processing them simultaneously.

[0943] "Speech synthesis engine" refers to software and hardware systems for converting text data into speech.

[0944] "Search query" refers to search criteria or commands used to retrieve specific information from a database.

[0945] "Information segment" refers to data divided into multiple small units that make up information.

[0946] "Reintegration" refers to the process of combining multiple parallel-processed information segments into a single coherent data set.

[0947] "GPS Sensor" refers to a sensor built into a device that uses the Earth's satellite system to obtain location information.

[0948] "Analysis" refers to the process of understanding received data and transforming it into a form that can be used as a tangible output.

[0949] These definitions clarify each component and process of the present invention.

[0950] The present invention relates to an interactive tourist information providing system that enables users to obtain tourist information in a timely manner and to enjoy their travels more. Detailed embodiments for carrying out the present invention will be specifically described below.

[0951] System Overview

[0952] This system consists of a user terminal, an information server, and a data processing algorithm for linking these. The user terminal is a mobile information terminal such as a smartphone or tablet, and acquires the current location, receives information, and outputs voice. The information server receives location data sent from the user terminal, searches for and processes related information based on that location information, and sends it to the user terminal.

[0953] Hardware and software used

[0954] User device: A mobile information terminal such as a smartphone or tablet.

[0955] GPS sensor: A sensor built into the device for obtaining location information.

[0956] Information provider server: A server with high-performance processing capabilities.

[0957] Speech synthesis engine: Software that provides speech synthesis functionality, such as the Google Text-to-Speech API.

[0958] Parallel processing algorithms: Algorithms for large-scale data processing such as Apache Hadoop.

[0959] Data processing and calculation

[0960] 1. Obtaining and sending location information:

[0961] The user's device uses the GPS sensor to obtain the latitude and longitude of the current location, which is then stored in the app as location data.

[0962] The acquired location data is sent to the information provider server using the HTTPS protocol.

[0963] 2. Receiving and retrieving data:

[0964] The server receives the location data and searches its internal database based on the data, and a search query is generated based on the received location data to retrieve relevant information segments.

[0965] 3. Data Parallelism:

[0966] The acquired information segments are efficiently processed using a parallel processing algorithm: the information is divided into smaller segments such as architectural information, historical background, reviews, etc., and processed simultaneously.

[0967] 4. Data recombination and transmission:

[0968] The parallel processed information segments are recombined and transmitted to the user terminal as a single unified data set.

[0969] 5. Data analysis and audio output:

[0970] The user device analyzes the received data and activates a speech synthesis engine based on the analysis results, providing the user with information in the form of voice.

[0971] Specific examples

[0972] For example, a specific example will be given where the user is at Kinkakuji Temple in Kyoto.

[0973] 1. The user launches the app and enables location services. The device obtains latitude 35.0394 and longitude 135.7292 and saves it as the "current location."

[0974] 2. Send your current location to the information server. The server then searches the database based on this location information to retrieve information related to Kinkaku-ji Temple (architectural information, historical background, reviews, etc.).

[0975] 3. The server processes the acquired information using a parallel processing algorithm, which improves the processing speed.

[0976] 4. The processed information is reassembled and sent to the user terminal.

[0977] 5. The user terminal analyzes the received data and uses a speech synthesis engine to provide the information to the user aloud.

[0978] Example: "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The entire three-story building is covered in gold leaf..."

[0979] Prompt Sentence Examples

[0980] "Please tell me about the design of a system that provides tourist information about a location when a user inputs their current location."

[0981] "Please explain in detail how a system that provides audio tourist information based on a user's location when the user is at Kinkakuji Temple in Kyoto works."

[0982] In this way, the system provides users with fast and detailed tourist information, enhancing their travel experience.

[0983] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0984] Step 1:

[0985] The user launches the app and enables location services.

[0986] Input: A user launches a tourist information app on their smartphone or tablet. The user enables location services.

[0987] Data processing or data calculation: The device activates the GPS sensor.

[0988] Output: Location services are enabled and the device starts obtaining the current location. Specifically, the app displays a message saying "Please enable location services" and the user taps the "Allow" button.

[0989] Step 2:

[0990] The terminal acquires the current location and transmits it to the information providing server.

[0991] Input: Latitude and longitude of current location obtained by GPS sensor (e.g., latitude 35.0394, longitude 135.7292).

[0992] Data processing or data calculation: The acquired location information is saved on the device as the "current location." The location information is sent to the information provider server using the HTTPS protocol.

[0993] Output: Current location data is sent to the information server. Specifically, location information is obtained from the GPS sensor and temporarily displayed on the app screen. This information is automatically sent to the server, and a message indicating successful transmission is displayed.

[0994] Step 3:

[0995] The server receives the location data and searches a database to retrieve relevant information.

[0996] Input: Current location data sent from the user device.

[0997] Data processing or data calculation: Searching an internal database based on the received location data. A search query is generated based on the location data to retrieve relevant information (e.g., architectural information, historical background, reviews, etc.).

[0998] Output: The information related to the corresponding location is retrieved. Specifically, the server records the received location information in a log file, and generates a search query to query the database.

[0999] Step 4:

[1000] The server processes the information using a parallel processing algorithm.

[1001] Input: Relevant information retrieved from the database.

[1002] Data processing or data calculation: Divide the acquired information into smaller segments (e.g., architectural information, historical background, reviews) and process each segment simultaneously using parallel processing algorithms.

[1003] Output: Parallelized information segments. Specifically, the information is split into several JSON objects, and each JSON object is processed simultaneously to reduce processing time.

[1004] Step 5:

[1005] The server reassembles the processed information and transmits it to the user terminal.

[1006] Input: Each information segment processed in parallel.

[1007] Data processing or data calculation: Reintegrate each parallel processed segment and send it to the user terminal as a single unified data set. HTTPS protocol is used.

[1008] Output: The reintegrated information is sent to the user terminal. Specifically, the integrated data is encoded and sent to the terminal.

[1009] Step 6:

[1010] The device analyzes the data it receives and uses a speech synthesis engine to output the information aloud.

[1011] Input: Aggregated data sent from the server.

[1012] Data processing or data calculation: The received data is analyzed within the terminal and the speech synthesis engine is activated.

[1013] Output: Based on the analysis results, information is provided to the user via voice. Specifically, the device decodes the received information, and the speech synthesis engine provides the information via voice, such as "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple..."

[1014] (Application example 1)

[1015] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1016] Conventional tourist information systems are primarily used during actual travel, and tourist information systems in virtual spaces have not been widely adopted. This makes it difficult for users in remote locations to interactively obtain real-time information about tourist spots in virtual spaces. Furthermore, when users use virtual reality headsets to obtain local information, the information provided is not based on their current location and direction, making it difficult to provide an effective tourist experience.

[1017] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1018] In this invention, the server includes means for acquiring the user's current location, means for transmitting the acquired current location data to an information providing server, means for the information providing server to search for tourist information based on the location data and transmit the tourist information to the user terminal, means for providing the tourist information received by the user terminal by voice, means for acquiring the current location and direction within the virtual space using a virtual reality headset, and means for providing the tourist information based on the current location and direction within the virtual space. This allows the user to acquire tourist information in real time even within the virtual space, enabling a realistic tourist experience even from a remote location.

[1019] "User" refers to an individual who obtains tourist information using the tourist information providing system.

[1020] "Current location" refers to the geographic location information of the user obtained by the user terminal or virtual reality headset.

[1021] The term "information providing server" refers to a server device that searches for tourist information based on the location data transmitted from the user terminal and transmits the relevant information to the user terminal.

[1022] "Tourist information" refers to data including historical background, architectural information, reviews, and other information related to tourist destinations.

[1023] "User terminal" refers to a portable information processing device such as a smartphone or tablet.

[1024] "Means for providing by voice" refers to means for transmitting tourist information received by a user terminal to a user as voice data using a voice synthesis engine.

[1025] A "virtual reality headset" refers to a display device that a user wears on their head to immerse themselves in a virtual space.

[1026] A "parallel processing algorithm" refers to an algorithm that improves processing speed by processing large amounts of data simultaneously in multiple processing units.

[1027] "Location data" refers to data including latitude and longitude information indicating the user's current location.

[1028] "Direction" refers to information acquired by the virtual reality headset that indicates the user's line of sight and body orientation.

[1029] The present invention relates to a system that allows users to obtain real-time tourist information in a virtual space using a virtual reality headset. The system is composed of a user terminal, a virtual reality headset, an information providing server, and a program for linking these devices.

[1030] System Overview

[1031] The system includes the following major components:

[1032] 1. User terminal: An information processing device such as a smartphone or tablet that acquires the current location, receives tourist information, and outputs audio.

[1033] 2. Virtual reality headset (HMD): A user wears it to move around in a virtual space and obtain position and orientation information.

[1034] 3. Information server: Searches for tourist information based on the location data sent from the user terminal, processes it, and sends it to the user terminal.

[1035] 4. Data Processing Algorithms: Parallel processing algorithms are used to process data efficiently.

[1036] 5. Speech synthesis engine: Provides tourist information to users by voice.

[1037] Program processing

[1038] Hardware and Software Configuration

[1039] Obtaining current location: The GPS and direction sensors built into the virtual reality headset are used to obtain the user's geographical location and gaze direction. The hardware used includes the GPS module and gyro sensor built into the HMD. The software used includes the HMD's API.

[1040] Data transmission: The acquired current location data is sent to the information provider server. The software used includes the requests library for sending HTTP requests.

[1041] Parallel data processing: On the information server side, the acquired tourist information data is efficiently processed using a parallel processing algorithm. This uses a threading library.

[1042] Providing information by voice: The user terminal receives tourist information sent from the information server and provides the information to the user by voice using a speech synthesis engine. The speech synthesis engine uses the text_to_speech library.

[1043] Specific examples

[1044] When a user wears a virtual reality headset and is at a virtual tourist spot, the HMD obtains its current location at latitude 35.0394 and longitude 135.7292. This location information is sent to a server, which then searches for tourist information related to Kinkaku-ji Temple. The obtained tourist information is efficiently divided and processed using parallel processing, and then reintegrated and sent to the user's device. Finally, the user's device communicates this information to the user using a speech synthesis engine.

[1045] Prompt Sentence Examples

[1046] In text format, it should look like this:

[1047] Your current virtual location is at latitude 35.0394 and longitude 135.7292. Please provide detailed tourist information based on this location.

[1048] With the above configuration, the present invention realizes a system that can obtain tourist information in real time even within a virtual space, allowing users to experience tourist spots with a sense of realism even from a remote location.

[1049] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1050] Step 1:

[1051] The user terminal acquires the user's current position and gaze direction using a virtual reality headset.

[1052] Input: Data from the GPS module and gyro sensor of the virtual reality headset.

[1053] Output: Latitude, longitude, line of sight direction.

[1054] How it works: The sensors in the virtual reality headset detect the user's current location (latitude, longitude) and gaze direction in real time and store this data internally.

[1055] Step 2:

[1056] The user terminal transmits the acquired current location data to the information providing server.

[1057] Input: Current location data (latitude, longitude).

[1058] Output: HTTP request to the information provider server.

[1059] Specific operation: The user terminal sends the current location data stored internally to the information providing server as an HTTP request.

[1060] Step 3:

[1061] The information providing server searches for tourist information based on the received location data.

[1062] Input: Current location data (latitude, longitude).

[1063] Output: Tourist information data.

[1064] Specific operation: The information providing server searches the database based on the received location data and obtains the relevant tourist information (historical background, architectural information, reviews, etc.).

[1065] Step 4:

[1066] The information providing server processes tourist information data using a parallel processing algorithm.

[1067] Input: Tourist information data.

[1068] Output: Segmented tourist information.

[1069] Specific operation: Tourist information data is divided into small segments such as architectural information, historical background, reviews, etc., and each segment is processed simultaneously using a parallel processing algorithm (threading library).

[1070] Step 5:

[1071] The information providing server reintegrates the processed tourist information and transmits it to the user terminal.

[1072] Input: Tourist information for each processed segment.

[1073] Output: Reintegrated tourist information data.

[1074] Specific operation: The tourist information for each segment processed in parallel is reintegrated and sent to the user's terminal as an HTTP response.

[1075] Step 6:

[1076] The tourist information received by the user terminal is analyzed and provided to the user in audio form using a speech synthesis engine.

[1077] Input: Reintegrated tourist information data.

[1078] Output: Audio data.

[1079] Specific operation: The user device receives and analyzes the reintegrated tourist information data, and then uses the text_to_speech library to provide the information to the user via voice.

[1080] Step 7:

[1081] The user moves to the next point in the virtual space, and the HMD again acquires the current position and gaze direction.

[1082] Input: New current location data (latitude, longitude) and line of sight direction.

[1083] Output: Updated position and orientation information.

[1084] How it works: When the user moves to the next tourist spot in the virtual space, the virtual reality headset again obtains the new current position and gaze direction in real time and stores the updated data internally.

[1085] By repeating these steps, users can obtain real-time tourist information while moving around the virtual space and obtain detailed information via voice.

[1086] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1087] The present invention relates to a system that recognizes a user's emotions and personalizes tourist information based on those emotions. The system is composed of a user terminal, a travel information server, an emotion engine, and a data processing algorithm for linking these components.

[1088] System Overview

[1089] The main components of this system are as follows:

[1090] 1. User terminal: A device that is directly operated by the user, such as a smartphone or tablet. It acquires the current location, receives tourist information, analyzes emotions, and outputs voice.

[1091] 2. Travel information server: A server system that searches for and processes tourist information based on location data sent from the user's terminal and sends it to the user's terminal.

[1092] 3. Emotion engine: It has the ability to recognize users' emotions in real time and adjust the tourist information provided based on that data.

[1093] Algorithms and Data Processing

[1094] The travel information server uses a parallel processing algorithm to improve data processing efficiency. This algorithm divides data into multiple small segments and processes each segment simultaneously, shortening the overall processing time. In addition, an emotion engine collects and analyzes user emotion data and provides personalized tourism information based on that data.

[1095] Specific examples

[1096] Below is a specific example where the user is at Kinkakuji Temple in Kyoto.

[1097] 1. Obtaining current location

[1098] The user enables location services on the device, and the device obtains latitude 35.0394 and longitude 135.7292. This location information is saved internally as "current location."

[1099] 2. Data transmission

[1100] The device sends its current location to a travel information server, which searches its database based on this location information to obtain tourist information related to Kinkakuji Temple.

[1101] 3. Data Parallelism

[1102] The server efficiently processes the tourist information it acquires using a parallel processing algorithm. The data is divided into small segments, such as architectural information, historical background, and reviews, and processed simultaneously by multiple processors.

[1103] 4. Collecting Emotional Data

[1104] The emotion engine on the user device recognizes and analyzes the user's emotions based on their facial expressions, tone of voice, operation logs, etc. Emotional data is collected in real time and stored internally.

[1105] 5. Coordination of tourist information

[1106] The server personalizes the tourist information it provides based on the user's emotional data. For example, if the user looks happy, it will provide more detailed historical information and information that includes entertainment elements.

[1107] 6. Data reintegration and transmission

[1108] The server reassembles the processed data and sends it to the user's terminal, which receives it and decodes it internally.

[1109] 7. Audio Output

[1110] The device analyzes the received data and uses a speech synthesis engine to provide information to the user. For example, it tells the user by voice, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The entire three-story building is covered in gold leaf..."

[1111] 8. Emotional Feedback

[1112] The emotion engine detects the user's reactions (for example, smiles or surprised expressions) and reflects them in the next information provided, enabling the system to provide optimal tourist information to the user.

[1113] System Operation

[1114] User terminal

[1115] Obtaining location information: When the user launches the app and enables location services, the device obtains its current location.

[1116] Sending data: Send the acquired current location to the server.

[1117] Emotion data collection and analysis: The emotion engine collects and analyzes user emotions in real time.

[1118] Receiving tourist information and outputting it as audio: Receives personalized tourist information sent from the server, analyzes it, and outputs it as audio.

[1119] Travel information server

[1120] Receiving data: Receive current location data from the user terminal.

[1121] Data search and retrieval: Search the database based on the received location information and retrieve the relevant tourist information.

[1122] Data processing using parallel processing algorithms: Data is divided into multiple segments and processed simultaneously.

[1123] Information tailoring based on emotional data: Analyze emotional data and personalize tourism information based on it.

[1124] Data reintegration and transmission: The processed data is reintegrated and transmitted to the user terminal.

[1125] In this way, the system optimizes tourist information based on user sentiment and improves the travel experience.

[1126] The processing flow will be explained below.

[1127] Step 1:

[1128] A user launches a tourist guide application on their device and enables location services. The user device uses the GPS sensor to obtain the latitude and longitude of their current location (e.g., latitude 35.0394, longitude 135.7292).

[1129] Step 2:

[1130] The device temporarily stores the current location data it acquires internally and then sends this data to the API endpoint of the travel information provider server. The data to be sent is in a request format that includes latitude and longitude (e.g., GET / api / v1 / places?lat=35.0394&lng=135.7292).

[1131] Step 3:

[1132] Based on the location data received, the server searches the database for the relevant tourist spot and related information. The server identifies the relevant area from the location information and retrieves related data (e.g., architectural information, historical background, reviews, etc. of Kinkaku-ji Temple).

[1133] Step 4:

[1134] The server efficiently processes the tourist information it acquires using a parallel processing algorithm. Specifically, the data is divided into small segments, such as architectural information, historical background, and reviews, and processed simultaneously by multiple processors.

[1135] Step 5:

[1136] The server reintegrates the processed results of each segment to generate the final tourist information data, which is encoded in JSON format or similar and sent to the user's device.

[1137] Step 6:

[1138] The user device decodes the tourist information data received from the server and analyzes it internally. It classifies the data (e.g., architectural information, historical background, reviews), and also generates and prepares data for the emotion engine.

[1139] Step 7:

[1140] The emotion engine on the user device recognizes and analyzes the user's emotions in real time based on the user's facial expressions, tone of voice, operation logs, etc. Emotional data is stored and analyzed internally.

[1141] Step 8:

[1142] The emotion engine analyzes the emotional data and adjusts the tourist information provided. For example, if the user looks happy, it will prioritize information with a stronger entertainment element.

[1143] Step 9:

[1144] The user device uses a speech synthesis engine to provide the adjusted tourist information by voice. For example, it may say to the user, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The entire three-story building is covered in gold leaf..."

[1145] Step 10:

[1146] While the user enjoys sightseeing while listening to the audio guide, the emotion engine continuously detects the user's reactions (e.g., smiles or surprised expressions) and reflects them in the information provided from the next time onwards.

[1147] Step 11:

[1148] If the user moves to another tourist spot, the process is repeated from step 1. This allows the user to always receive personalized and up-to-date tourist information.

[1149] Example 2

[1150] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1151] Conventional tourist information systems only provide tourist information based on the user's current location, and have the problem of lacking personalization according to the user's emotions and interests. As a result, users' travel experiences are uniform, and information provision that is optimized for each individual user is not provided.

[1152] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1153] In this invention, the server includes means for acquiring the user's current location, means for transmitting the acquired current location data to a travel information providing server, means for the travel information providing server to search for tourist information based on the location data and transmit the tourist information to the user terminal, means for the user terminal to provide the tourist information received by voice, means for collecting and analyzing user emotion data, and means for personalizing the tourist information based on the emotion data, thereby making it possible to provide personalized tourist information that takes into account the user's real-time emotions.

[1154] A "user" is a person who uses the system to obtain tourist information and experience travel.

[1155] "Current location" is geographical location information acquired by the user's terminal, and is expressed as latitude and longitude.

[1156] The "travel information server" is a server system that searches for tourist information based on the location data sent from the user terminal, processes it, and sends it to the user terminal.

[1157] A "user terminal" is a device such as a smartphone or tablet operated by a user, which acquires and transmits the user's current location, receives tourist information, and collects and analyzes emotional data.

[1158] "Tourist information" is detailed information about tourist spots that the travel information server searches for based on location data and provides to the user terminal.

[1159] A "speech synthesis engine" is a program that generates speech from text and provides information to users in an easy-to-listen format.

[1160] "Emotion data" is data that indicates the user's emotional state, collected from the user's facial expression, tone of voice, operation log, and the like.

[1161] "Personalization" means optimizing the content and delivery method of information according to the characteristics and emotions of each individual user.

[1162] A "parallel processing algorithm" is an algorithm that improves the efficiency of data processing by processing multiple small data segments simultaneously.

[1163] The present invention relates to a system that recognizes a user's emotions and personalizes tourist information based on those emotions. The system is composed of a user terminal, a travel information server, an emotion engine, and a data processing algorithm for linking these elements.

[1164] System Configuration

[1165] The system consists of the following main components:

[1166] 1. User terminal: A device that is directly operated by the user, such as a smartphone or tablet. This includes functions to obtain current location, receive tourist information, collect emotion data, and output voice. Specific hardware used includes a GPS module, camera, microphone, and touchscreen.

[1167] 2. Travel Information Server: A server system that searches and processes tourist information based on location data sent from the user's device and sends it to the user's device. It uses a parallel processing algorithm to efficiently search and process data.

[1168] 3. Emotion engine: Collects and analyzes emotional data in real time from users' facial expressions, tone of voice, operation logs, etc. Based on this emotional data, the tourist information provided is personalized.

[1169] Data Processing

[1170] To improve the efficiency of data processing, the travel information server uses a parallel processing algorithm, which divides the data into multiple small segments and processes each segment simultaneously, thereby reducing the overall processing time.

[1171] Furthermore, the emotion engine collects and analyzes the user's emotional data and adjusts the tourist information provided based on that data, thereby providing the most appropriate tourist information for the user.

[1172] Specific examples of operation procedures

[1173] Below is a specific example where the user is at Kinkakuji Temple in Kyoto.

[1174] 1. Obtaining current location: The user launches the app and enables location services. The device obtains latitude 35.0394 and longitude 135.7292 and stores this internally as the current location.

[1175] 2. Data transmission: The device transmits its current location to the travel information server. The server searches its database based on this location information and retrieves tourist information related to Kinkakuji Temple.

[1176] 3. Parallel data processing: The server efficiently processes the tourist information acquired using parallel processing algorithms. The data is divided into small segments such as architectural information, historical background, and reviews, and processed simultaneously by multiple processors.

[1177] 4. Emotion data collection: The emotion engine on the user device recognizes and analyzes the user's emotions based on their facial expressions, tone of voice, operation logs, etc. Emotion data is collected in real time and stored internally.

[1178] 5. Tailoring tourist information: The server personalizes tourist information based on emotional data. For example, if the user looks happy, the server will provide more detailed historical information and information that includes entertainment elements.

[1179] 6. Data reassembly and transmission: The server reassembly processes the data and transmits it to the user's terminal, which receives the data and decodes it internally.

[1180] 7. Voice output: The device analyzes the data received and uses a voice synthesis engine to provide information to the user. For example, it tells the user by voice, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The three-story building is covered entirely in gold leaf..."

[1181] Prompt Sentence Examples

[1182] Below are some examples of prompts to input to the generative AI model.

[1183] "Please explain in detail the system overview and operation flow for the system that allows users to obtain tourist information based on their current location."

[1184] This system provides personalized tourist information based on the user's emotions in real time, enabling a travel experience optimized for each individual user, unlike conventional tourist guide systems.

[1185] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1186] Step 1:

[1187] Obtain location information on the user device.

[1188] Input: User launches the app and enables location services.

[1189] Action: The device uses GPS to obtain the user's current location, which is expressed in latitude and longitude format.

[1190] Output: Current location data is obtained: latitude 35.0394, longitude 135.7292.

[1191] Specific operation: The smartphone's GPS module is activated and the acquired latitude and longitude data is stored in the internal memory.

[1192] Step 2:

[1193] The location information is sent from the user terminal to the server.

[1194] Input: Current location data obtained (latitude 35.0394, longitude 135.7292).

[1195] Processing: The device creates an HTTP request and sends the acquired current location data to the travel information server.

[1196] Output: The server receives the current location data.

[1197] Specific operation: The app automatically creates an HTTP request and sends it to the server via the communication module.

[1198] Step 3:

[1199] The server performs a data search based on the received location information.

[1200] Input: Current location data received by the server.

[1201] Processing: The server forms a database query to search for tourist information for the location (e.g., Kinkaku-ji Temple).

[1202] Output: Tourist information about Kinkaku-ji Temple is obtained, including architectural information, historical background, visitor reviews, etc.

[1203] Specific operation: The database server processes the query, extracts the relevant tourist information, and sends it to the main server.

[1204] Step 4:

[1205] The server processes tourist information efficiently using parallel processing.

[1206] Input: Tourist information retrieved from the database.

[1207] Processing: The acquired tourist information is divided into multiple segments (architectural information, historical background, reviews, etc.) and processed simultaneously using a parallel processing algorithm.

[1208] Output: Tourist information data with each segment processed is obtained.

[1209] Specific operation: Multiple processors within the server synchronize and process data in parallel, achieving improved processing speed.

[1210] Step 5:

[1211] The server reintegrates the processed tourist information and transmits it to the user terminal.

[1212] Input: Data for each segment obtained by parallel processing.

[1213] Processing: Reassemble the data from each segment into a single data packet and send it to the user terminal as an HTTP response.

[1214] Output: The user terminal receives the integrated tourist information data.

[1215] Specific operation: The server forms a data packet and sends it to the user terminal via the communication module.

[1216] Step 6:

[1217] Emotional data is collected and analyzed on the user's device.

[1218] Input: The user views the tourist information they have received.

[1219] Processing: The emotion engine collects the user's facial expressions, tone of voice, and operation logs, and analyzes the emotion data in real time.

[1220] Output: Data indicating the user's emotional state is stored internally.

[1221] What it does: The camera and microphone are activated to detect the user's facial expressions and voice, which are then analyzed by an emotion analysis algorithm.

[1222] Step 7:

[1223] The server personalizes tourist information based on emotion data.

[1224] Input: Emotion data sent from the user device.

[1225] Processing: Analyze the emotion data and re-adjust the tourist information according to the user's interests and emotions. For example, if a user is enjoying themselves, provide them with detailed historical information or information that includes entertainment elements.

[1226] Output: Personalized tourist information data is obtained.

[1227] Specific operation: The server reintegrates the re-adjusted tourist information and forms it into a data packet.

[1228] Step 8:

[1229] The server transmits the reintegrated data to the user terminal.

[1230] Input: Personalized tourist information data.

[1231] Processing: The reintegrated tourist information data is sent to the user terminal as an HTTP response.

[1232] Output: The user terminal receives the re-adjusted tourist information data.

[1233] Specific operation: The server forms a data packet and sends it to the user terminal via the communication module.

[1234] Step 9:

[1235] Tourist information is output aloud on the user terminal.

[1236] Input: Tourist information data received from the server.

[1237] Processing: The device analyzes the tourist information received and outputs it aloud using a speech synthesis engine.

[1238] Output: The user receives tourist information by voice.

[1239] Specific operation: The device's speaker will be activated and will read out, for example, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple..."

[1240] This processing flow realizes a system that provides optimal tourist information based on the user's current location and emotions.

[1241] (Application example 2)

[1242] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1243] Conventional tourist information systems can provide tourist information based on a user's current location, but they cannot provide information that takes the user's emotions into account, making it difficult to provide information that is optimized for each individual. Furthermore, since users' moods and interests change from time to time while traveling, there is a demand for information that reflects their trends in real time. The present invention aims to solve these problems and enable the provision of personalized tourist information that reflects the user's emotions.

[1244] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring the user's current location, means for transmitting the acquired current location data to the travel information providing server, means for the travel information providing server to search for tourist information based on the location data and transmit the tourist information to the user terminal, means for the user terminal to provide the received tourist information by voice, and means for the user terminal to recognize emotions from image data and personalize the tourist information based on the emotion data. This makes it possible to provide real-time, personalized tourist information that reflects the user's emotions.

[1245] The "means by which the user obtains the current location" refers to a function for obtaining the user's current location data using the GPS function or location information service of the user's terminal.

[1246] The "means for transmitting the acquired current location data to the travel information server" is a function for transmitting the current location data acquired by the user terminal to the travel information server via the network.

[1247] "Means for the travel information providing server to search for tourist information based on location data and transmit the tourist information to the user terminal" refers to a function for the travel information providing server to search for relevant tourist information based on the location data received and transmit the information to the user terminal.

[1248] The "means for providing tourist information received by the user terminal by voice" is a function that analyzes tourist information received by the user terminal and provides the information to the user by voice using voice synthesis technology.

[1249] "Means for a user terminal to recognize emotions from image data and personalize tourist information based on the emotional data" refers to a function in which a user terminal analyzes image data taken with a camera or the like, recognizes the user's emotions, and then individually optimizes tourist information based on that emotional data.

[1250] A "parallel data processing algorithm" is an algorithm that divides data into multiple small segments and processes them simultaneously in parallel to improve processing efficiency.

[1251] The system that realizes this application example has the following configuration: It consists of a user terminal, a travel information server, and an emotion engine, all of which work in conjunction with each other. A detailed embodiment of this system is described below.

[1252] User terminal

[1253] A user terminal refers to a mobile information terminal such as a smartphone or tablet, and includes the following hardware and software:

[1254] GPS sensor: Used to obtain current location.

[1255] Camera: Used to capture image data, thereby capturing the user's facial expressions.

[1256] Location Services: Software for managing acquired location data.

[1257] Emotion Recognition Software: Analyze user emotions using the Facial Recognition API.

[1258] Network communication module: Used to transmit location data and emotion data to the travel information providing server.

[1259] Speech synthesis engine: Used to provide received tourist information to the user by voice.

[1260] Travel information server

[1261] The travel information server is a cloud-based server designed to efficiently process large amounts of data. This server uses the following hardware and software:

[1262] Database system: stores tourist information.

[1263] Parallel processing algorithm: Used to efficiently search and process tourism information, this algorithm divides the data into multiple segments and processes them simultaneously.

[1264] Network communication module: Manages data received from user terminals and transmits necessary tourist information to the user terminals.

[1265] Emotion Engine

[1266] The emotion engine is a software module that recognizes users' emotions in real time and personalizes tourist information based on that data.

[1267] Facial Recognition API: Analyzes image data and recognizes user emotions.

[1268] Data analysis module: Optimizes tourist information based on recognized emotion data.

[1269] Example of system operation

[1270] 1. Obtaining location information: When the user launches the app and enables location services, the GPS sensor on the user's device obtains the current location.

[1271] 2. Data transmission: The acquired current location data is transmitted to the travel information server. This is handled by the network communication module.

[1272] 3. Obtaining tourist information: The travel information server searches the database based on the location data and obtains the relevant tourist information. This is efficiently processed using a parallel processing algorithm.

[1273] 4. Emotion data collection: The camera on the user's device captures the user's facial expressions, and emotion recognition software analyzes the emotions.

[1274] 5. Personalized tourist information: The emotion engine personalizes tourist information based on the emotional data acquired.

[1275] 6. Providing information: Optimized tourist information is sent to the user's terminal and provided audibly using a speech synthesis engine.

[1276] Prompt Sentence Examples

[1277] When a user looks at a product using their smartphone camera, if emotions like "surprise" or "excitement" are detected, recommend the best product for the user based on that emotion, and also show information about nearby stores where the product is available.

[1278] The above configuration makes it possible to provide real-time, personalized tourist information that reflects the user's emotions, thereby improving the quality of the travel experience.

[1279] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1280] Step 1:

[1281] A user launches an app and enables location services, which allows the GPS sensor on the user's device to obtain current location data. The input is the user's action and the activation of location services, and the output is the current location data.

[1282] Step 2:

[1283] The acquired current location data is sent to the travel information server. The user terminal uses a network communication module to send the location data to the server. The input is the current location data, and the output is receiving the location data on the server side.

[1284] Step 3:

[1285] The server searches the database based on the received location data and retrieves the relevant tourist information. It uses a parallel processing algorithm to efficiently search and process the data. The input is location data, and the output is tourist information data.

[1286] Step 4:

[1287] A user captures image data using a camera. The camera on the user's device acquires the image and sends it to emotion recognition software. The input is image data, and the output is emotion data.

[1288] Step 5:

[1289] Emotion recognition software analyzes image data and recognizes the user's emotions. This is processed by the Facial Recognition API on the user's device. The input is image data, and the output is recognized emotion data.

[1290] Step 6:

[1291] The user terminal sends emotional data to a travel information server. The server then personalizes tourist information based on the received emotional data. The input is emotional data, and the output is personalized tourist information.

[1292] Step 7:

[1293] The server retransmits the personalized tourist information to the user terminal. The input is the personalized tourist information, and the output is the tourist information sent to the received user terminal.

[1294] Step 8:

[1295] The user terminal analyzes the tourist information received and uses a speech synthesis engine to provide the information to the user by voice. The input is personalized tourist information, and the output is voice information.

[1296] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1297] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1298] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1299] [Fourth embodiment]

[1300] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1301] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1302] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1303] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1304] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1305] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1306] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1307] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1308] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1309] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1310] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1311] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1312] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1313] The present invention relates to an interactive tourist information providing system that enables users to obtain tourist information in a timely manner and enjoy their travels more. Specific embodiments of the system will be described below.

[1314] System Overview

[1315] This system consists of a user terminal, a travel information server, and a data processing algorithm for linking these. The user terminal is a device such as a smartphone or tablet, and acquires the current location, receives tourist information, and outputs it as audio. The travel information server receives the location data sent from the user terminal, searches for and processes tourist information based on the location information, and sends it to the user terminal.

[1316] Algorithms and Data Processing

[1317] To improve the efficiency of data processing, the travel information server uses a parallel processing algorithm, which divides data into multiple small segments and processes each segment simultaneously, thereby reducing the overall processing time.

[1318] Specific examples

[1319] Below is a specific example where the user is at Kinkakuji Temple in Kyoto.

[1320] 1. Obtaining current location

[1321] The user enables location services on the device, and the device obtains latitude 35.0394 and longitude 135.7292. This location information is stored internally as "current location."

[1322] 2. Data transmission

[1323] The device sends its current location to a travel information server, which then searches its database based on this location information to obtain tourist information related to Kinkakuji Temple.

[1324] 3. Data Parallelism

[1325] The server processes the tourist information it acquires using a parallel processing algorithm. The data is divided into small segments, such as architectural information, historical background, and reviews, and each segment is processed simultaneously.

[1326] 4. Data reintegration and transmission

[1327] The server reassembles the processed data and sends it to the user's terminal, which receives it and decodes it internally.

[1328] 5. Audio Output

[1329] The device analyzes the received data and uses a speech synthesis engine to provide information to the user. For example, it tells the user by voice, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The entire three-story building is covered in gold leaf..."

[1330] System Operation

[1331] User terminal

[1332] Obtaining location information: When the user launches the app and enables location services, the device obtains its current location.

[1333] Sending data: Send the acquired current location to the server.

[1334] Receiving and analyzing data: Receive and analyze the tourist information sent from the server.

[1335] Voice output: The analyzed tourist information is provided to the user using a voice synthesis engine.

[1336] Travel information server

[1337] Receiving data: Receive current location data from the user terminal.

[1338] Data search and retrieval: Search the database based on the received location information and retrieve the relevant tourist information.

[1339] Data processing using parallel processing algorithms: Data is divided into multiple segments and processed simultaneously.

[1340] Data reintegration and transmission: The processed data is reintegrated and transmitted to the user terminal.

[1341] In this way, the system provides users with fast and detailed tourist information, enhancing their travel experience.

[1342] The processing flow will be explained below.

[1343] Step 1:

[1344] A user launches a tourist guide application on their device and enables location services. The user device uses the GPS sensor to obtain the latitude and longitude of their current location (e.g., latitude 35.0394, longitude 135.7292).

[1345] Step 2:

[1346] The device temporarily stores the current location data it acquires internally and then sends this data to the API endpoint of the travel information provider server. The data to be sent is in a request format that includes latitude and longitude (e.g., GET / api / v1 / places?lat=35.0394&lng=135.7292).

[1347] Step 3:

[1348] Based on the location data received, the server searches the database for the relevant tourist spot and related information. The server identifies the relevant area from the location information and retrieves related data (e.g., architectural information, historical background, reviews, etc. of Kinkaku-ji Temple).

[1349] Step 4:

[1350] The server efficiently processes the tourist information it acquires using a parallel processing algorithm. Specifically, the data is divided into small segments, such as architectural information, historical background, and reviews, and processed simultaneously by multiple processors.

[1351] Step 5:

[1352] The server reintegrates the processed results of each segment to generate the final tourist information data, which is encoded in JSON format or similar and sent to the user's device.

[1353] Step 6:

[1354] The device decodes the tourist information data received from the server and analyzes it internally. It classifies the data (e.g., architectural information, historical background, reviews) and generates data for voice output using a speech synthesis engine.

[1355] Step 7:

[1356] The device uses a speech synthesis engine to provide the analyzed tourist information to the user by voice, generating a speech output such as "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The three-story building is entirely covered in gold leaf..."

[1357] Step 8:

[1358] The user can enjoy sightseeing while listening to the audio guide. During this process, they can move to another tourist spot as needed and repeat from step 1.

[1359] Example 1

[1360] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1361] Conventional tourist information systems face the challenge of providing users with the information they require quickly and efficiently. Furthermore, the accuracy and speed of location information acquisition and voice information provision are insufficient, making it difficult to improve the user experience. Furthermore, inefficient information search and processing slows the overall system response time. To address these issues, a system is needed that can streamline the processes of data acquisition, processing, and transmission, and provide information quickly and accurately.

[1362] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1363] In this invention, the server includes: a means for the information providing server to efficiently search and process information using a parallel data processing algorithm; a means for the information providing server to input the received data as a search query into an internal database and acquire multiple related information segments; and a means for the information providing server to reintegrate the processed information and transmit it to the user terminal. This improves the accuracy and speed of data acquisition, enabling efficient information processing and transmission, and making it possible to provide information to users with high accuracy and speed.

[1364] A "user terminal" is a device used by a user, and refers to a mobile information terminal such as a smartphone or tablet.

[1365] "Current location" refers to the latitude and longitude information acquired by the user terminal.

[1366] "Information providing server" refers to a central server for searching and processing relevant information based on location information received from a user terminal and sending it to the user terminal.

[1367] "Location data" refers to information about the latitude and longitude of the current location acquired by the user terminal.

[1368] "Database" refers to a data collection system in which various information is systematically stored and managed within an information providing server.

[1369] A "parallel processing algorithm" refers to a calculation method that improves efficiency by dividing data processing into multiple small units (segments) and processing them simultaneously.

[1370] "Speech synthesis engine" refers to software and hardware systems for converting text data into speech.

[1371] "Search query" refers to search criteria or commands used to retrieve specific information from a database.

[1372] "Information segment" refers to data divided into multiple small units that make up information.

[1373] "Reintegration" refers to the process of combining multiple parallel-processed information segments into a single coherent data set.

[1374] "GPS Sensor" refers to a sensor built into a device that uses the Earth's satellite system to obtain location information.

[1375] "Analysis" refers to the process of understanding received data and transforming it into a form that can be used as a tangible output.

[1376] These definitions clarify each component and process of the present invention.

[1377] The present invention relates to an interactive tourist information providing system that enables users to obtain tourist information in a timely manner and to enjoy their travels more. Detailed embodiments for carrying out the present invention will be specifically described below.

[1378] System Overview

[1379] This system consists of a user terminal, an information server, and a data processing algorithm for linking these. The user terminal is a mobile information terminal such as a smartphone or tablet, and acquires the current location, receives information, and outputs voice. The information server receives location data sent from the user terminal, searches for and processes related information based on that location information, and sends it to the user terminal.

[1380] Hardware and software used

[1381] User device: A mobile information terminal such as a smartphone or tablet.

[1382] GPS sensor: A sensor built into the device for obtaining location information.

[1383] Information provider server: A server with high-performance processing capabilities.

[1384] Speech synthesis engine: Software that provides speech synthesis functionality, such as the Google Text-to-Speech API.

[1385] Parallel processing algorithms: Algorithms for large-scale data processing such as Apache Hadoop.

[1386] Data processing and calculation

[1387] 1. Obtaining and sending location information:

[1388] The user's device uses the GPS sensor to obtain the latitude and longitude of the current location, which is then stored in the app as location data.

[1389] The acquired location data is sent to the information provider server using the HTTPS protocol.

[1390] 2. Receiving and retrieving data:

[1391] The server receives the location data and searches its internal database based on the data, and a search query is generated based on the received location data to retrieve relevant information segments.

[1392] 3. Data Parallelism:

[1393] The acquired information segments are efficiently processed using parallel processing algorithms: the information is divided into smaller segments such as architectural information, historical background, reviews, etc., and processed simultaneously.

[1394] 4. Data recombination and transmission:

[1395] The parallel processed information segments are recombined and transmitted to the user terminal as a single unified data set.

[1396] 5. Data analysis and audio output:

[1397] The user device analyzes the received data and activates a speech synthesis engine based on the analysis results, providing the user with information in the form of voice.

[1398] Specific examples

[1399] For example, a specific example will be given where the user is at Kinkakuji Temple in Kyoto.

[1400] 1. The user launches the app and enables location services. The device obtains latitude 35.0394 and longitude 135.7292 and saves it as the "current location."

[1401] 2. Send your current location to the information server. The server then searches the database based on this location information to obtain information related to Kinkaku-ji Temple (architectural information, historical background, reviews, etc.).

[1402] 3. The server processes the acquired information using a parallel processing algorithm, which improves the processing speed.

[1403] 4. The processed information is reassembled and sent to the user terminal.

[1404] 5. The user terminal analyzes the received data and uses a speech synthesis engine to provide the information to the user aloud.

[1405] Example: "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The entire three-story building is covered in gold leaf..."

[1406] Prompt Sentence Examples

[1407] "Please tell me about the design of a system that provides tourist information about a location when a user inputs their current location."

[1408] "Please explain in detail how a system that provides audio tourist information based on a user's location when the user is at Kinkakuji Temple in Kyoto works."

[1409] In this way, the system provides users with fast and detailed tourist information, enhancing their travel experience.

[1410] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1411] Step 1:

[1412] The user launches the app and enables location services.

[1413] Input: A user launches a tourist information app on their smartphone or tablet. The user enables location services.

[1414] Data processing or data calculation: The device activates the GPS sensor.

[1415] Output: Location services are enabled and the device starts obtaining the current location. Specifically, the app displays a message saying "Please enable location services" and the user taps the "Allow" button.

[1416] Step 2:

[1417] The terminal acquires the current location and transmits it to the information providing server.

[1418] Input: Latitude and longitude of current location obtained by GPS sensor (e.g., latitude 35.0394, longitude 135.7292).

[1419] Data processing or data calculation: The acquired location information is saved on the device as the "current location." The location information is sent to the information provider server using the HTTPS protocol.

[1420] Output: Current location data is sent to the information server. Specifically, location information is obtained from the GPS sensor and temporarily displayed on the app screen. This information is automatically sent to the server, and a message indicating successful transmission is displayed.

[1421] Step 3:

[1422] The server receives the location data and searches a database to retrieve relevant information.

[1423] Input: Current location data sent from the user device.

[1424] Data processing or data calculation: Searching an internal database based on the received location data. A search query is generated based on the location data to retrieve relevant information (e.g., architectural information, historical background, reviews, etc.).

[1425] Output: The information related to the corresponding location is retrieved. Specifically, the server records the received location information in a log file, and generates a search query to query the database.

[1426] Step 4:

[1427] The server processes the information using a parallel processing algorithm.

[1428] Input: Relevant information retrieved from the database.

[1429] Data processing or data calculation: Divide the acquired information into smaller segments (e.g., architectural information, historical background, reviews) and process each segment simultaneously using parallel processing algorithms.

[1430] Output: Parallelized information segments. Specifically, the information is split into several JSON objects, and each JSON object is processed simultaneously to reduce processing time.

[1431] Step 5:

[1432] The server reassembles the processed information and transmits it to the user terminal.

[1433] Input: Each information segment processed in parallel.

[1434] Data processing or data calculation: Reintegrate each parallel processed segment and send it to the user terminal as a single unified data set. HTTPS protocol is used.

[1435] Output: The reintegrated information is sent to the user terminal. Specifically, the integrated data is encoded and sent to the terminal.

[1436] Step 6:

[1437] The device analyzes the data it receives and uses a speech synthesis engine to output the information aloud.

[1438] Input: Aggregated data sent from the server.

[1439] Data processing or data calculation: The received data is analyzed within the terminal and the speech synthesis engine is activated.

[1440] Output: Based on the analysis results, information is provided to the user via voice. Specifically, the device decodes the received information, and the speech synthesis engine provides the information via voice, such as "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple..."

[1441] (Application example 1)

[1442] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1443] Conventional tourist information systems are primarily used during actual travel, and tourist information systems in virtual spaces have not been widely adopted. This makes it difficult for users in remote locations to interactively obtain real-time information about tourist spots in virtual spaces. Furthermore, when users use virtual reality headsets to obtain local information, the information provided is not based on their current location and direction, making it difficult to provide an effective tourist experience.

[1444] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1445] In this invention, the server includes means for acquiring the user's current location, means for transmitting the acquired current location data to an information providing server, means for the information providing server to search for tourist information based on the location data and transmit the tourist information to the user terminal, means for providing the tourist information received by the user terminal by voice, means for acquiring the current location and direction within the virtual space using a virtual reality headset, and means for providing the tourist information based on the current location and direction within the virtual space. This allows the user to acquire tourist information in real time even within the virtual space, enabling a realistic tourist experience even from a remote location.

[1446] "User" refers to an individual who obtains tourist information using the tourist information providing system.

[1447] "Current location" refers to the geographic location information of the user obtained by the user terminal or virtual reality headset.

[1448] The term "information providing server" refers to a server device that searches for tourist information based on the location data transmitted from the user terminal and transmits the relevant information to the user terminal.

[1449] "Tourist information" refers to data including historical background, architectural information, reviews, and other information related to tourist destinations.

[1450] "User terminal" refers to a portable information processing device such as a smartphone or tablet.

[1451] "Means for providing by voice" refers to means for transmitting tourist information received by a user terminal to a user as voice data using a voice synthesis engine.

[1452] A "virtual reality headset" refers to a display device that a user wears on their head to immerse themselves in a virtual space.

[1453] A "parallel processing algorithm" refers to an algorithm that improves processing speed by processing large amounts of data simultaneously in multiple processing units.

[1454] "Location data" refers to data including latitude and longitude information indicating the user's current location.

[1455] "Direction" refers to information acquired by the virtual reality headset that indicates the user's line of sight and body orientation.

[1456] The present invention relates to a system that allows users to obtain real-time tourist information in a virtual space using a virtual reality headset. The system is composed of a user terminal, a virtual reality headset, an information providing server, and a program for linking these devices.

[1457] System Overview

[1458] The system includes the following major components:

[1459] 1. User terminal: An information processing device such as a smartphone or tablet that acquires the current location, receives tourist information, and outputs audio.

[1460] 2. Virtual reality headset (HMD): A user wears it to move around in a virtual space and obtain position and orientation information.

[1461] 3. Information server: Searches for tourist information based on the location data sent from the user terminal, processes it, and sends it to the user terminal.

[1462] 4. Data Processing Algorithms: Parallel processing algorithms are used to process data efficiently.

[1463] 5. Speech synthesis engine: Provides tourist information to users by voice.

[1464] Program processing

[1465] Hardware and Software Configuration

[1466] Obtaining current location: The GPS and direction sensors built into the virtual reality headset are used to obtain the user's geographical location and gaze direction. The hardware used includes the GPS module and gyro sensor built into the HMD. The software used includes the HMD's API.

[1467] Data transmission: The acquired current location data is sent to the information provider server. The software used includes the requests library for sending HTTP requests.

[1468] Parallel data processing: On the information server side, the acquired tourist information data is efficiently processed using a parallel processing algorithm. This uses a threading library.

[1469] Providing information by voice: The user terminal receives tourist information sent from the information server and provides the information to the user by voice using a speech synthesis engine. The text_to_speech library is used for the speech synthesis engine.

[1470] Specific examples

[1471] When a user wears a virtual reality headset and is at a virtual tourist spot, the HMD obtains its current location at latitude 35.0394 and longitude 135.7292. This location information is sent to a server, which then searches for tourist information related to Kinkaku-ji Temple. The obtained tourist information is efficiently divided and processed using parallel processing, and then reintegrated and sent to the user's device. Finally, the user's device communicates this information to the user using a speech synthesis engine.

[1472] Prompt Sentence Examples

[1473] In text format, it should look like this:

[1474] Your current virtual location is at latitude 35.0394 and longitude 135.7292. Please provide detailed tourist information based on this location.

[1475] With the above configuration, the present invention realizes a system that can obtain tourist information in real time even within a virtual space, allowing users to experience tourist spots with a sense of realism even from a remote location.

[1476] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1477] Step 1:

[1478] The user terminal acquires the user's current position and gaze direction using a virtual reality headset.

[1479] Input: Data from the GPS module and gyro sensor of the virtual reality headset.

[1480] Output: Latitude, longitude, line of sight direction.

[1481] How it works: The sensors in the virtual reality headset detect the user's current location (latitude, longitude) and gaze direction in real time and store this data internally.

[1482] Step 2:

[1483] The user terminal transmits the acquired current location data to the information providing server.

[1484] Input: Current location data (latitude, longitude).

[1485] Output: HTTP request to the information provider server.

[1486] Specific operation: The user terminal sends the current location data stored internally to the information providing server as an HTTP request.

[1487] Step 3:

[1488] The information providing server searches for tourist information based on the received location data.

[1489] Input: Current location data (latitude, longitude).

[1490] Output: Tourist information data.

[1491] Specific operation: The information providing server searches the database based on the received location data and obtains the relevant tourist information (historical background, architectural information, reviews, etc.).

[1492] Step 4:

[1493] The information providing server processes tourist information data using a parallel processing algorithm.

[1494] Input: Tourist information data.

[1495] Output: Segmented tourist information.

[1496] Specific operation: Tourist information data is divided into small segments such as architectural information, historical background, reviews, etc., and each segment is processed simultaneously using a parallel processing algorithm (threading library).

[1497] Step 5:

[1498] The information providing server reintegrates the processed tourist information and transmits it to the user terminal.

[1499] Input: Tourist information for each processed segment.

[1500] Output: Reintegrated tourist information data.

[1501] Specific operation: The tourist information for each segment processed in parallel is reintegrated and sent to the user's terminal as an HTTP response.

[1502] Step 6:

[1503] The tourist information received by the user terminal is analyzed and provided to the user in audio form using a speech synthesis engine.

[1504] Input: Reintegrated tourist information data.

[1505] Output: Audio data.

[1506] Specific operation: The user device receives and analyzes the reintegrated tourist information data, and then uses the text_to_speech library to provide the information to the user via voice.

[1507] Step 7:

[1508] The user moves to the next point in the virtual space, and the HMD again acquires the current position and gaze direction.

[1509] Input: New current location data (latitude, longitude) and line of sight direction.

[1510] Output: Updated position and orientation information.

[1511] How it works: When the user moves to the next tourist spot in the virtual space, the virtual reality headset again obtains the new current position and gaze direction in real time and stores the updated data internally.

[1512] By repeating these steps, users can obtain real-time tourist information and get detailed information via voice while moving around the virtual space.

[1513] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1514] The present invention relates to a system that recognizes a user's emotions and personalizes tourist information based on those emotions. The system is composed of a user terminal, a travel information server, an emotion engine, and a data processing algorithm for linking these components.

[1515] System Overview

[1516] The main components of this system are as follows:

[1517] 1. User terminal: A device that is directly operated by the user, such as a smartphone or tablet. It acquires the current location, receives tourist information, analyzes emotions, and outputs voice.

[1518] 2. Travel information server: A server system that searches for and processes tourist information based on location data sent from the user's terminal and sends it to the user's terminal.

[1519] 3. Emotion engine: It has the ability to recognize users' emotions in real time and adjust the tourist information provided based on that data.

[1520] Algorithms and Data Processing

[1521] The travel information server uses a parallel processing algorithm to improve data processing efficiency. This algorithm divides data into multiple small segments and processes each segment simultaneously, shortening the overall processing time. In addition, an emotion engine collects and analyzes user emotion data and provides personalized tourism information based on that data.

[1522] Specific examples

[1523] Below is a specific example where the user is at Kinkakuji Temple in Kyoto.

[1524] 1. Obtaining current location

[1525] The user enables location services on the device, and the device obtains latitude 35.0394 and longitude 135.7292. This location information is stored internally as "current location."

[1526] 2. Data transmission

[1527] The device sends its current location to a travel information server, which searches its database based on this location information to obtain tourist information related to Kinkakuji Temple.

[1528] 3. Data Parallelism

[1529] The server efficiently processes the tourist information it acquires using a parallel processing algorithm. The data is divided into small segments, such as architectural information, historical background, and reviews, and processed simultaneously by multiple processors.

[1530] 4. Collecting Emotional Data

[1531] The emotion engine on the user device recognizes and analyzes the user's emotions based on their facial expressions, tone of voice, operation logs, etc. Emotional data is collected in real time and stored internally.

[1532] 5. Coordination of tourist information

[1533] The server personalizes the tourist information it provides based on the user's emotional data. For example, if the user looks happy, it will provide more detailed historical information and information that includes entertainment elements.

[1534] 6. Data reintegration and transmission

[1535] The server reassembles the processed data and sends it to the user's terminal, which receives it and decodes it internally.

[1536] 7. Audio Output

[1537] The device analyzes the received data and uses a speech synthesis engine to provide information to the user. For example, it tells the user by voice, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The entire three-story building is covered in gold leaf..."

[1538] 8. Emotional Feedback

[1539] The emotion engine detects the user's reactions (for example, smiles or surprised expressions) and reflects them in the next information provided, enabling the system to provide optimal tourist information to the user.

[1540] System Operation

[1541] User terminal

[1542] Obtaining location information: When the user launches the app and enables location services, the device obtains its current location.

[1543] Sending data: Send the acquired current location to the server.

[1544] Emotion data collection and analysis: The emotion engine collects and analyzes user emotions in real time.

[1545] Receiving tourist information and outputting it as audio: Receives personalized tourist information sent from the server, analyzes it, and outputs it as audio.

[1546] Travel information server

[1547] Receiving data: Receive current location data from the user terminal.

[1548] Data search and retrieval: Search the database based on the received location information and retrieve the relevant tourist information.

[1549] Data processing using parallel processing algorithms: Data is divided into multiple segments and processed simultaneously.

[1550] Information tailoring based on emotional data: Analyze emotional data and personalize tourism information based on it.

[1551] Data reintegration and transmission: The processed data is reintegrated and transmitted to the user terminal.

[1552] In this way, the system optimizes tourist information based on user sentiment and improves the travel experience.

[1553] The processing flow will be explained below.

[1554] Step 1:

[1555] A user launches a tourist guide application on their device and enables location services. The user device uses the GPS sensor to obtain the latitude and longitude of their current location (e.g., latitude 35.0394, longitude 135.7292).

[1556] Step 2:

[1557] The device temporarily stores the current location data it acquires internally and then sends this data to the API endpoint of the travel information provider server. The data to be sent is in a request format that includes latitude and longitude (e.g., GET / api / v1 / places?lat=35.0394&lng=135.7292).

[1558] Step 3:

[1559] Based on the location data received, the server searches the database for the relevant tourist spot and related information. The server identifies the relevant area from the location information and retrieves related data (e.g., architectural information, historical background, reviews, etc. of Kinkaku-ji Temple).

[1560] Step 4:

[1561] The server efficiently processes the tourist information it acquires using a parallel processing algorithm. Specifically, the data is divided into small segments, such as architectural information, historical background, and reviews, and processed simultaneously by multiple processors.

[1562] Step 5:

[1563] The server reintegrates the processed results of each segment to generate the final tourist information data, which is encoded in JSON format or similar and sent to the user's device.

[1564] Step 6:

[1565] The user device decodes the tourist information data received from the server and analyzes it internally. It classifies the data (e.g., architectural information, historical background, reviews), and also generates and prepares data for the emotion engine.

[1566] Step 7:

[1567] The emotion engine on the user device recognizes and analyzes the user's emotions in real time based on the user's facial expressions, tone of voice, operation logs, etc. Emotional data is stored and analyzed internally.

[1568] Step 8:

[1569] The emotion engine analyzes the emotional data and adjusts the tourist information provided. For example, if the user looks happy, it will prioritize information with a stronger entertainment element.

[1570] Step 9:

[1571] The user device uses a speech synthesis engine to provide the adjusted tourist information by voice. For example, it may say to the user, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The entire three-story building is covered in gold leaf..."

[1572] Step 10:

[1573] While the user enjoys sightseeing while listening to the audio guide, the emotion engine continuously detects the user's reactions (e.g., smiles or surprised expressions) and reflects them in the information provided from the next time onwards.

[1574] Step 11:

[1575] If the user moves to another tourist spot, the process is repeated from step 1. This allows the user to always receive personalized and up-to-date tourist information.

[1576] Example 2

[1577] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1578] Conventional tourist information systems only provide tourist information based on the user's current location, and have the problem of lacking personalization according to the user's emotions and interests. As a result, users' travel experiences are uniform, and information provision that is optimized for each individual user is not provided.

[1579] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1580] In this invention, the server includes means for acquiring the user's current location, means for transmitting the acquired current location data to a travel information providing server, means for the travel information providing server to search for tourist information based on the location data and transmit the tourist information to the user terminal, means for the user terminal to provide the tourist information received by voice, means for collecting and analyzing user emotion data, and means for personalizing the tourist information based on the emotion data, thereby making it possible to provide personalized tourist information that takes into account the user's real-time emotions.

[1581] A "user" is a person who uses the system to obtain tourist information and experience travel.

[1582] "Current location" is geographical location information acquired by the user's terminal, and is expressed as latitude and longitude.

[1583] The "travel information server" is a server system that searches for tourist information based on the location data sent from the user terminal, processes it, and sends it to the user terminal.

[1584] A "user terminal" is a device such as a smartphone or tablet operated by a user, which acquires and transmits the user's current location, receives tourist information, and collects and analyzes emotional data.

[1585] "Tourist information" is detailed information about tourist spots that the travel information server searches for based on location data and provides to the user terminal.

[1586] A "speech synthesis engine" is a program that generates speech from text and provides information to users in an easy-to-listen format.

[1587] "Emotion data" is data that indicates the user's emotional state, collected from the user's facial expression, tone of voice, operation log, and the like.

[1588] "Personalization" means optimizing the content and delivery method of information according to the characteristics and emotions of each individual user.

[1589] A "parallel processing algorithm" is an algorithm that improves the efficiency of data processing by processing multiple small data segments simultaneously.

[1590] The present invention relates to a system that recognizes a user's emotions and personalizes tourist information based on those emotions. The system is composed of a user terminal, a travel information server, an emotion engine, and a data processing algorithm for linking these elements.

[1591] System Configuration

[1592] The system consists of the following main components:

[1593] 1. User terminal: A device that is directly operated by the user, such as a smartphone or tablet. This includes functions to obtain current location, receive tourist information, collect emotion data, and output voice. Specific hardware used includes a GPS module, camera, microphone, and touchscreen.

[1594] 2. Travel Information Server: A server system that searches and processes tourist information based on location data sent from the user's device and sends it to the user's device. It uses a parallel processing algorithm to efficiently search and process data.

[1595] 3. Emotion engine: Collects and analyzes emotional data in real time from users' facial expressions, tone of voice, operation logs, etc. Based on this emotional data, the tourist information provided is personalized.

[1596] Data Processing

[1597] To improve the efficiency of data processing, the travel information server uses a parallel processing algorithm, which divides the data into multiple small segments and processes each segment simultaneously, thereby reducing the overall processing time.

[1598] Furthermore, the emotion engine collects and analyzes the user's emotional data and adjusts the tourist information provided based on that data, thereby providing the most appropriate tourist information for the user.

[1599] Specific examples of operation procedures

[1600] Below is a specific example where the user is at Kinkakuji Temple in Kyoto.

[1601] 1. Obtaining current location: The user launches the app and enables location services. The device obtains latitude 35.0394 and longitude 135.7292 and stores this internally as the current location.

[1602] 2. Data transmission: The device transmits its current location to the travel information server. The server searches its database based on this location information and retrieves tourist information related to Kinkakuji Temple.

[1603] 3. Parallel data processing: The server efficiently processes the tourist information acquired using parallel processing algorithms. The data is divided into small segments such as architectural information, historical background, and reviews, and processed simultaneously by multiple processors.

[1604] 4. Emotion data collection: The emotion engine on the user device recognizes and analyzes the user's emotions based on facial expressions, tone of voice, operation logs, etc. Emotion data is collected in real time and stored internally.

[1605] 5. Tailoring tourist information: The server personalizes tourist information based on emotional data. For example, if the user looks happy, the server will provide more detailed historical information and information that includes entertainment elements.

[1606] 6. Data reassembly and transmission: The server reassembly processes the data and transmits it to the user's terminal, which receives the data and decodes it internally.

[1607] 7. Voice output: The device analyzes the data received and uses a voice synthesis engine to provide information to the user. For example, it tells the user by voice, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple. The entire three-story building is covered in gold leaf..."

[1608] Prompt Sentence Examples

[1609] Below are some examples of prompts to input to the generative AI model.

[1610] "Please explain in detail the system overview and operation flow for the system that allows users to obtain tourist information based on their current location."

[1611] This system provides personalized tourist information based on the user's emotions in real time, enabling a travel experience optimized for each individual user, unlike conventional tourist guide systems.

[1612] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1613] Step 1:

[1614] Obtain location information on the user device.

[1615] Input: User launches the app and enables location services.

[1616] Action: The device uses GPS to obtain the user's current location, which is expressed in latitude and longitude format.

[1617] Output: Current location data is obtained: latitude 35.0394, longitude 135.7292.

[1618] Specific operation: The smartphone's GPS module is activated and the acquired latitude and longitude data is stored in the internal memory.

[1619] Step 2:

[1620] The location information is sent from the user terminal to the server.

[1621] Input: Current location data obtained (latitude 35.0394, longitude 135.7292).

[1622] Processing: The device creates an HTTP request and sends the acquired current location data to the travel information server.

[1623] Output: The server receives the current location data.

[1624] Specific operation: The app automatically creates an HTTP request and sends it to the server via the communication module.

[1625] Step 3:

[1626] The server performs a data search based on the received location information.

[1627] Input: Current location data received by the server.

[1628] Processing: The server forms a database query to search for tourist information for the location (e.g., Kinkaku-ji Temple).

[1629] Output: Get tourist information about Kinkaku-ji Temple, including architectural details, historical background, visitor reviews, etc.

[1630] Specific operation: The database server processes the query, extracts the relevant tourist information, and sends it to the main server.

[1631] Step 4:

[1632] The server efficiently processes tourist information using parallel processing.

[1633] Input: Tourist information retrieved from the database.

[1634] Processing: The acquired tourist information is divided into multiple segments (architectural information, historical background, reviews, etc.) and processed simultaneously using a parallel processing algorithm.

[1635] Output: Tourist information data with each segment processed is obtained.

[1636] Specific operation: Multiple processors within the server synchronize and process data in parallel, achieving improved processing speed.

[1637] Step 5:

[1638] The server reintegrates the processed tourist information and transmits it to the user terminal.

[1639] Input: Data for each segment obtained by parallel processing.

[1640] Processing: Reassemble the data from each segment into a single data packet and send it to the user terminal as an HTTP response.

[1641] Output: The user terminal receives the integrated tourist information data.

[1642] Specific operation: The server forms a data packet and sends it to the user terminal via the communication module.

[1643] Step 6:

[1644] Emotional data is collected and analyzed on the user's device.

[1645] Input: The user views the tourist information they have received.

[1646] Processing: The emotion engine collects the user's facial expressions, tone of voice, and operation logs, and analyzes the emotion data in real time.

[1647] Output: Data indicating the user's emotional state is stored internally.

[1648] What it does: The camera and microphone are activated to detect the user's facial expressions and voice, which are then analyzed by an emotion analysis algorithm.

[1649] Step 7:

[1650] The server personalizes tourist information based on emotion data.

[1651] Input: Emotion data sent from the user device.

[1652] Processing: Analyze the emotion data and re-adjust the tourist information according to the user's interests and emotions. For example, if a user is enjoying themselves, provide them with detailed historical information or information that includes entertainment elements.

[1653] Output: Personalized tourist information data is obtained.

[1654] Specific operation: The server reintegrates the re-adjusted tourist information and forms it into a data packet.

[1655] Step 8:

[1656] The server transmits the reintegrated data to the user terminal.

[1657] Input: Personalized tourist information data.

[1658] Processing: The reintegrated tourist information data is sent to the user terminal as an HTTP response.

[1659] Output: The user terminal receives the re-adjusted tourist information data.

[1660] Specific operation: The server forms a data packet and sends it to the user terminal via the communication module.

[1661] Step 9:

[1662] Tourist information is output aloud on the user terminal.

[1663] Input: Tourist information data received from the server.

[1664] Processing: The device analyzes the tourist information received and outputs it aloud using a speech synthesis engine.

[1665] Output: The user receives tourist information by voice.

[1666] Specific operation: The device's speaker will be activated and will read out, for example, "This is Kinkaku-ji Temple. Its official name is Rokuon-ji Temple..."

[1667] This processing flow realizes a system that provides optimal tourist information based on the user's current location and emotions.

[1668] (Application example 2)

[1669] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1670] Conventional tourist information systems can provide tourist information based on a user's current location, but they cannot provide information that takes the user's emotions into account, making it difficult to provide information that is optimized for each individual. Furthermore, since users' moods and interests change from time to time while traveling, there is a demand for information that reflects their trends in real time. The present invention aims to solve these problems and enable the provision of personalized tourist information that reflects the user's emotions.

[1671] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring the user's current location, means for transmitting the acquired current location data to the travel information providing server, means for the travel information providing server to search for tourist information based on the location data and transmit the tourist information to the user terminal, means for the user terminal to provide the received tourist information by voice, and means for the user terminal to recognize emotions from image data and personalize the tourist information based on the emotion data. This makes it possible to provide real-time, personalized tourist information that reflects the user's emotions.

[1672] The "means by which the user obtains the current location" refers to a function for obtaining the user's current location data using the GPS function or location information service of the user's terminal.

[1673] The "means for transmitting the acquired current location data to the travel information server" is a function for transmitting the current location data acquired by the user terminal to the travel information server via the network.

[1674] "Means for the travel information providing server to search for tourist information based on location data and transmit the tourist information to the user terminal" refers to a function for the travel information providing server to search for relevant tourist information based on the location data received and transmit the information to the user terminal.

[1675] The "means for providing tourist information received by the user terminal by voice" is a function that analyzes tourist information received by the user terminal and provides the information to the user by voice using voice synthesis technology.

[1676] "Means for a user terminal to recognize emotions from image data and personalize tourist information based on the emotional data" refers to a function in which a user terminal analyzes image data taken with a camera or the like, recognizes the user's emotions, and then individually optimizes tourist information based on that emotional data.

[1677] A "parallel data processing algorithm" is an algorithm that divides data into multiple small segments and processes them simultaneously in parallel to improve processing efficiency.

[1678] The system that realizes this application example has the following configuration: It consists of a user terminal, a travel information server, and an emotion engine, all of which work in conjunction with each other. A detailed embodiment of this system is described below.

[1679] User terminal

[1680] A user terminal refers to a mobile information terminal such as a smartphone or tablet, and includes the following hardware and software:

[1681] GPS sensor: Used to obtain current location.

[1682] Camera: Used to capture image data, thereby capturing the user's facial expressions.

[1683] Location Services: Software for managing acquired location data.

[1684] Emotion Recognition Software: Analyze user emotions using the Facial Recognition API.

[1685] Network communication module: Used to transmit location data and emotion data to the travel information providing server.

[1686] Speech synthesis engine: Used to provide received tourist information to the user by voice.

[1687] Travel information server

[1688] The travel information server is a cloud-based server designed to efficiently process large amounts of data. This server uses the following hardware and software:

[1689] Database system: stores tourist information.

[1690] Parallel processing algorithm: Used to efficiently search and process tourism information, this algorithm divides the data into multiple segments and processes them simultaneously.

[1691] Network communication module: Manages data received from user terminals and transmits necessary tourist information to the user terminals.

[1692] Emotion Engine

[1693] The emotion engine is a software module that recognizes users' emotions in real time and personalizes tourist information based on that data.

[1694] Facial Recognition API: Analyzes image data and recognizes user emotions.

[1695] Data analysis module: Optimizes tourist information based on recognized emotion data.

[1696] Example of system operation

[1697] 1. Obtaining location information: When the user launches the app and enables location services, the GPS sensor on the user's device obtains the current location.

[1698] 2. Data transmission: The acquired current location data is transmitted to the travel information server. This is handled by the network communication module.

[1699] 3. Obtaining tourist information: The travel information server searches the database based on the location data and obtains the relevant tourist information. This is efficiently processed using a parallel processing algorithm.

[1700] 4. Emotion data collection: The camera on the user's device captures the user's facial expressions, and emotion recognition software analyzes the emotions.

[1701] 5. Personalized tourist information: The emotion engine personalizes tourist information based on the emotional data acquired.

[1702] 6. Providing information: Optimized tourist information is sent to the user's terminal and provided audibly using a speech synthesis engine.

[1703] Prompt Sentence Examples

[1704] When a user looks at a product using their smartphone camera, if emotions like "surprise" or "excitement" are detected, recommend the best product for the user based on that emotion, and also show information about nearby stores where the product is available.

[1705] The above configuration makes it possible to provide real-time, personalized tourist information that reflects the user's emotions, thereby improving the quality of the travel experience.

[1706] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1707] Step 1:

[1708] A user launches an app and enables location services, which allows the GPS sensor on the user's device to obtain current location data. The input is the user's action and the activation of location services, and the output is the current location data.

[1709] Step 2:

[1710] The acquired current location data is sent to the travel information server. The user terminal uses a network communication module to send the location data to the server. The input is the current location data, and the output is receiving the location data on the server side.

[1711] Step 3:

[1712] The server searches the database based on the received location data and retrieves the relevant tourist information. It uses a parallel processing algorithm to efficiently search and process the data. The input is location data, and the output is tourist information data.

[1713] Step 4:

[1714] A user captures image data using a camera. The camera on the user's device acquires the image and sends it to emotion recognition software. The input is image data, and the output is emotion data.

[1715] Step 5:

[1716] Emotion recognition software analyzes image data and recognizes the user's emotions. This is processed by the Facial Recognition API on the user's device. The input is image data, and the output is recognized emotion data.

[1717] Step 6:

[1718] The user terminal sends emotional data to a travel information server. The server then personalizes tourist information based on the received emotional data. The input is emotional data, and the output is personalized tourist information.

[1719] Step 7:

[1720] The server retransmits the personalized tourist information to the user terminal. The input is the personalized tourist information, and the output is the tourist information sent to the received user terminal.

[1721] Step 8:

[1722] The user terminal analyzes the tourist information received and uses a speech synthesis engine to provide the information to the user by voice. The input is personalized tourist information, and the output is voice information.

[1723] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1724] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1725] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1726] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1727] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1728] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1729] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1730] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1731] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1732] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1733] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1734] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1735] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1736] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1737] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1738] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1739] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1740] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1741] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1742] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1743] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1744] The following is further disclosed regarding the above embodiment.

[1745] (Claim 1)

[1746] A means for a user to obtain a current location;

[1747] means for transmitting the acquired current location data to a travel information providing server;

[1748] a means for the travel information providing server to search for tourist information based on the location data and transmit the tourist information to a user terminal;

[1749] means for providing the tourist information received by the user terminal by voice;

[1750] A system including:

[1751] (Claim 2)

[1752] The travel information providing server comprises means for efficiently searching and processing tourist information using a parallel data processing algorithm;

[1753] 10. The system of claim 1.

[1754] (Claim 3)

[1755] a means for classifying tourist information received by the user terminal and outputting the classified information individually by voice;

[1756] 10. The system of claim 1.

[1757] "Example 1"

[1758] (Claim 1)

[1759] A means for a user to obtain a current location;

[1760] means for transmitting the acquired current location data to an information providing server;

[1761] a means for the information providing server to search for information based on the location data and transmit the information to the user terminal;

[1762] means for providing the received information by voice at the user terminal;

[1763] A system including:

[1764] (Claim 2)

[1765] The information providing server is provided with a means for efficiently searching and processing information using a parallel data processing algorithm;

[1766] 10. The system of claim 1.

[1767] (Claim 3)

[1768] The user terminal comprises means for classifying the received information and outputting the classified information individually by voice.

[1769] 10. The system of claim 1.

[1770] (Claim 4)

[1771] The information providing server includes a means for inputting the received data into an internal database as a search query to obtain a plurality of related information segments;

[1772] 10. The system of claim 1.

[1773] (Claim 5)

[1774] The user terminal has a means for obtaining accurate latitude and longitude information using a GPS sensor;

[1775] 10. The system of claim 1.

[1776] (Claim 6)

[1777] The user terminal comprises means for analyzing the information and activating a speech synthesis engine based on the analysis result;

[1778] 10. The system of claim 1.

[1779] (Claim 7)

[1780] The information providing server includes a means for reintegrating the processed information and transmitting the information to the user terminal.

[1781] 10. The system of claim 1.

[1782] "Application Example 1"

[1783] (Claim 1)

[1784] A means for a user to obtain a current location;

[1785] means for transmitting the acquired current location data to an information providing server;

[1786] a means for the information providing server to search for tourist information based on the location data and transmit the tourist information to the user terminal;

[1787] means for providing the tourist information received by the user terminal by voice;

[1788] means for obtaining a current position and orientation within a virtual space using a virtual reality headset;

[1789] means for providing tourist information based on a current position and direction within the virtual space;

[1790] A system including:

[1791] (Claim 2)

[1792] The information providing server is provided with a means for efficiently searching and processing tourist information using a parallel data processing algorithm;

[1793] 10. The system of claim 1.

[1794] (Claim 3)

[1795] a means for classifying tourist information received by the user terminal and outputting the classified information individually by voice;

[1796] 10. The system of claim 1.

[1797] "Example 2: Combining Emotion Engines"

[1798] (Claim 1)

[1799] A means for a user to obtain a current location;

[1800] means for transmitting the acquired current location data to a travel information providing server;

[1801] a means for the travel information providing server to search for tourist information based on the location data and transmit the tourist information to a user terminal;

[1802] means for providing the tourist information received by the user terminal by voice;

[1803] means for collecting and analyzing user emotion data;

[1804] A means for personalizing tourist information based on emotion data;

[1805] A system including:

[1806] (Claim 2)

[1807] The travel information providing server comprises means for efficiently searching and processing tourist information using a parallel data processing algorithm;

[1808] 10. The system of claim 1.

[1809] (Claim 3)

[1810] a means for classifying tourist information received by the user terminal and outputting the classified information individually by voice;

[1811] 10. The system of claim 1.

[1812] "Application example 2 when combining emotion engines"

[1813] (Claim 1)

[1814] A means for a user to obtain a current location;

[1815] means for transmitting the acquired current location data to a travel information providing server;

[1816] a means for the travel information providing server to search for tourist information based on the location data and transmit the tourist information to a user terminal;

[1817] means for providing the tourist information received by the user terminal by voice;

[1818] a means for recognizing emotions from image data in a user terminal and personalizing tourist information based on the emotion data;

[1819] A system including:

[1820] (Claim 2)

[1821] The travel information providing server comprises means for efficiently searching and processing tourist information using a parallel data processing algorithm;

[1822] 10. The system of claim 1.

[1823] (Claim 3)

[1824] a means for classifying tourist information received by the user terminal and outputting the classified information individually by voice;

[1825] 10. The system of claim 1. [Explanation of symbols]

[1826] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for a user to obtain a current location; means for transmitting the acquired current location data to a travel information providing server; a means for the travel information providing server to search for tourist information based on the location data and transmit the tourist information to a user terminal; means for providing the tourist information received by the user terminal by voice; A system including:

2. The travel information providing server comprises means for efficiently searching and processing tourist information using a parallel data processing algorithm; The system of claim 1 .

3. a means for classifying tourist information received by the user terminal and outputting the classified information individually by voice; The system of claim 1 .

Images