System

Abstract

A system is provided.SOLUTION: Means for acquiring position information of a user, means for acquiring heart rate information of the user, means for transmitting the acquired position information and heart rate information to a server, means for receiving the transmitted position information and heart rate information, means for acquiring map information in the vicinity of a current location from a map service on the basis of the received position information, A system includes a means for selecting appropriate music from a music distribution service, a means for acquiring the latest disaster prevention information corresponding to an area, a means for integrating the acquired map information, music and disaster prevention information and generating personalized information to be provided to a user, a means for transmitting the generated personalized information to a terminal, and a means of the terminal.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Current music streaming services struggle to provide real-time information based on the user's situation, and simply playing a playlist does not fully meet user needs. Furthermore, systems for providing timely disaster prevention information or localized information (e.g., store coupons) are lacking. There is a growing need for highly personalized information systems that users can use with peace of mind while running or walking. [Means for solving the problem]

[0005] To solve this problem, the present invention configures a system from the following perspectives: First, a GPS sensor is used as a means for acquiring user location information. Next, a means for acquiring the user's heart rate information is provided and this information is periodically transmitted to a server. The server receives the transmitted location information and heart rate information, and obtains map information for the area around the current location from a map service based on the location information. It also selects appropriate music from a music distribution service based on the heart rate information and obtains the latest disaster prevention information for the area. This information is integrated to generate personalized information to provide to the user and transmitted to the terminal. This enables the user to receive music, map information, disaster prevention information, and area-specific information tailored to their situation in real time.

[0006] "User" refers to an individual who uses this system and provides location and heart rate information.

[0007] "Location information" refers to data that indicates a user's current geographic location.

[0008] "Heartbeat information" refers to biometric data such as the user's heart rate and heartbeat rhythm.

[0009] "Terminal" refers to a device that is carried or worn by a user and has sensors and communication capabilities.

[0010] "Server" refers to a central system that receives, analyzes, and consolidates information.

[0011] "GPS Sensor" means a Global Positioning System (GPS) sensor device for determining a specific location on the Earth.

[0012] "Heart rate sensor" refers to a biometric sensor device for measuring a user's heart rate.

[0013] "Map Service" means an online service that provides geographic information.

[0014] "Music distribution service" refers to an online service that distributes music via the Internet.

[0015] "Disaster prevention information" refers to information related to emergencies such as natural disasters.

[0016] "Personalized information" refers to information that is customized to a user's individual circumstances and preferences.

[0017] "Tempo" refers to the speed or rhythmic pace of music.

[0018] "Coupon information" refers to information that offers discounts or special offers for specific services or products. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10]1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0020] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0021] First, the terms used in the following description will be explained.

[0022] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0023] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0024] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0025] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0026] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0027] [First embodiment]

[0028] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0029] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0030] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0031] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0032] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0033] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0034] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0035] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0036] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0037] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0038] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0039] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0040] MODE FOR CARRYING OUT THE INVENTION

[0041] The present invention is a system that provides personalized information in real time based on a user's location information and heart rate information. This system basically consists of three elements: a server, a terminal, and a user. The roles and specific functions of each element are explained below.

[0042] User

[0043] Users are individuals who use this system and provide location and heart rate information. Users wear wearable devices (e.g., smart watches, earphones, audio glasses, etc.) through which they acquire, send, and receive information.

[0044] Terminal

[0045] The device acquires location information and heart rate information from the user and transmits it to the server. The main processes performed by the device are described below.

[0046] 1. Location information acquisition:

[0047] The device uses the built-in GPS sensor to obtain the user's current location.

[0048] The acquired location information is updated periodically.

[0049] 2. Obtaining heart rate information:

[0050] The device uses a built-in heart rate sensor to measure the user's heart rate.

[0051] The measured heart rate information is also updated periodically.

[0052] 3. Transmission of Information:

[0053] The periodically acquired location information and heart rate information are packaged into packets and sent to the server.

[0054] server

[0055] The server receives and analyzes the information sent from the terminal and integrates various data to provide the necessary information to the user. The main processes performed by the server are described below.

[0056] 1. Receiving Information:

[0057] The server receives the location information and heart rate information transmitted from the terminal.

[0058] 2. Getting map information:

[0059] The server calls the map service API based on the received location information and obtains map information for the area around the current location.

[0060] 3. Music Selection:

[0061] The server analyzes the heart rate based on the received heart rate information and retrieves appropriate music from the music distribution service API.

[0062] For example, if your heart rate is high, choose upbeat music, and if your heart rate is low, choose relaxation music.

[0063] 4. Obtaining disaster prevention information:

[0064] The server obtains disaster prevention information corresponding to the region based on the location information from the disaster prevention information service API.

[0065] 5. Generating personalized information:

[0066] The acquired map information, music, disaster prevention information, and other personalized information (e.g., store coupons) are integrated as needed to generate optimal personalized information.

[0067] 6. Sending Personalized Information:

[0068] The server transmits the generated personalized information to the terminal again.

[0069] Specific examples

[0070] For users running

[0071] The user wears the smartwatch while running.

[0072] The device acquires the user's current location using a GPS sensor and measures the user's heart rate using a heart rate sensor. For example, suppose the heart rate is 160 BPM.

[0073] The terminal transmits the acquired location information and heart rate information to the server.

[0074] The server calls the map service API based on the location information and obtains map information within the park.

[0075] Next, since the heart rate is high, up-tempo music is retrieved from the music distribution service API. In addition, a disaster prevention information service API is called to check the necessary disaster prevention information.

[0076] Finally, this information is integrated to generate personalized information, including information about the user's current location, selected music, necessary disaster prevention information, etc.

[0077] The server sends the generated personalized information to the user's device, which analyzes it and sends notifications to the smartwatch or plays music through earphones.

[0078] This system allows users to listen to appropriate music in real time while running, while also receiving necessary map and disaster prevention information, making everyday activities safer and more comfortable.

[0079] The processing flow will be explained below.

[0080] Step 1:

[0081] The user puts on the wearable device and starts the system. The device completes the initial setup and activates the GPS sensor and heart rate sensor.

[0082] Step 2:

[0083] The device uses the GPS sensor to obtain the user's current location. This location information is obtained periodically (e.g., every 5 seconds).

[0084] Step 3:

[0085] The device uses a heart rate sensor to measure the user's heart rate, and heart rate information is also collected periodically (e.g., every 5 seconds).

[0086] Step 4:

[0087] The terminal assembles the acquired location information and heart rate information into a packet and transmits it to the server.

[0088] Step 5:

[0089] The server receives the location information and heart rate information transmitted from the terminal.

[0090] Step 6:

[0091] Based on the location information received by the server, the map service API is called to obtain map information around the current location.

[0092] Step 7:

[0093] The server analyzes the received heart rate information and calls the music distribution service API to select music according to the user's heart rate.

[0094] For example: If your heart rate is high (e.g., 160 BPM), choose an up-tempo song.

[0095] Step 8:

[0096] Based on the location information, the server obtains the latest disaster prevention information corresponding to the region from the disaster prevention information service API.

[0097] Step 9:

[0098] The server integrates map information, selected music, and disaster prevention information to generate optimal personalized information.

[0099] Step 10:

[0100] The server transmits the generated personalized information to the terminal.

[0101] Step 11:

[0102] The terminal analyzes the personalized information received from the server.

[0103] Step 12:

[0104] Based on the analyzed information, the device provides information to the user in an appropriate manner.

[0105] Example: Play selected music through earphones and notify the smartwatch of current location and disaster prevention information.

[0106] This process flow allows users to receive the information they need in real time. The system aims to improve the user experience by providing the most appropriate information tailored to the user's current situation.

[0107] Example 1

[0108] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0109] Conventional personalized information provision systems have not been able to fully utilize the user's location information and heart rate information, making it difficult to provide personalized information in real time. In addition, since music selection and disaster prevention information provision are not centralized, users are unable to receive the information they need in a timely manner, resulting in issues of low safety and convenience.

[0110] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0111] In this invention, the server includes means for acquiring user location information, means for acquiring user heart rate information, means for transmitting the acquired location information and heart rate information to a central processing unit, means for receiving the transmitted location information and heart rate information, means for acquiring map information of the vicinity of the current location from a map information providing service based on the received location information, means for selecting appropriate music from a music distribution service based on the received heart rate information, means for acquiring the latest disaster prevention information corresponding to the area, means for integrating the acquired map information, music, and disaster prevention information to generate personalized information to be provided to the user, means for transmitting the generated personalized information to the terminal, and means for notifying the user of the personalized information received by the terminal. This makes it possible to utilize the user's location information and heart rate information in real time, centrally manage necessary map information, music, and disaster prevention information, and immediately provide them to the user.

[0112] A "user" is an individual who uses the system and provides location and heart rate information.

[0113] "Location information" is data indicating the user's current geographical latitude and longitude.

[0114] "Heart rate information" is data indicating the user's current heart rate.

[0115] The "central processing unit" is a device that has the function of receiving and processing the location information and heart rate information transmitted from the terminal.

[0116] A "terminal" is a device worn by a user that has the function of acquiring location information and heart rate information and transmitting this information to a central processing unit.

[0117] A "map information service" is an online service that provides map information around the current location based on location information.

[0118] A "music distribution service" is an online service that selects and provides appropriate music based on heart rate information.

[0119] "Disaster prevention information" refers to information including the latest disaster information and evacuation advisories for a specific area.

[0120] "Personalized information" is individually tailored information that is generated to provide to a user by integrating acquired map information, music, and disaster prevention information.

[0121] "Notification" is the act of presenting information to a user through a terminal.

[0122] The present invention is a system that provides personalized information in real time based on a user's location information and heart rate information. This system basically consists of three elements: a server, a terminal, and a user. The roles and specific functions of each element are explained below.

[0123] User

[0124] Users are individuals who use this system and provide location and heart rate information. Users wear wearable devices (e.g., smart watches, earphones, audio glasses, etc.) through which they acquire, send, and receive information.

[0125] Terminal

[0126] The device acquires location information and heart rate information from the user and transmits it to the server. Specifically, it performs the following processes.

[0127] 1. Obtaining location information

[0128] The device uses the built-in GPS sensor to obtain the user's current location, which allows for detailed and accurate location information.

[0129] The device periodically updates this location information to keep it up to date.

[0130] 2. Obtaining heart rate information

[0131] The device measures the user's heart rate using a built-in heart rate sensor, which is often an optical sensor or an electrocardiogram sensor.

[0132] The device will periodically update your heart rate information to keep your health information up to date.

[0133] 3. Transmission of Information

[0134] The acquired location information and heart rate information are packaged into packets and sent to the server using HTTP POST requests or WebSocket communication.

[0135] server

[0136] The server receives the information sent from the device, performs the necessary data analysis, and generates personalized information based on the acquired data. The main processes performed by the server are described below.

[0137] 1. Receipt of information

[0138] The server receives the location information and heart rate information sent from the device using an HTTP server or WebSocket server.

[0139] 2. Obtaining map information

[0140] The server then calls a map information service API based on the received location information to obtain map information for the area around the current location. Typically, Google Maps API is used.

[0141] 3. Music selection

[0142] The server analyzes the heart rate based on the received heart rate information and retrieves appropriate music from a music streaming service API. If the heart rate is high, an up-tempo song is selected, and if it is low, a relaxing song is selected. Spotify API and Apple Music API are commonly used.

[0143] 4. Obtaining disaster prevention information

[0144] Based on the received location information, the server obtains disaster prevention information for that area from a disaster prevention information service API, such as the Japan Meteorological Agency API.

[0145] 5. Generating personalized information

[0146] The server integrates the acquired map information, music, disaster prevention information, etc. to generate personalized information to provide to users. This process is implemented using server-side languages ​​such as Python and Node.js.

[0147] 6. Sending personalized information

[0148] The server transmits the generated personalized information to the terminal again.

[0149] Specific examples

[0150] For users running

[0151] The user wears the smartwatch while running.

[0152] The device acquires the user's current location using a GPS sensor, records it as latitude 35.658581 and longitude 139.745433, and measures the heart rate as 160 BPM using a heart rate sensor.

[0153] The terminal transmits the acquired location information and heart rate information to the server.

[0154] The server calls the map information service API based on the location information and obtains map information within the park.

[0155] The server retrieves up-tempo songs from the music distribution service API because the heart rate is 160 BPM. It also calls the disaster prevention information service API to retrieve disaster prevention information around the park.

[0156] The server integrates this information to generate personalized information, including park maps, music selections, and disaster prevention information.

[0157] The server sends the generated personalized information to the device, which receives it and displays map information on the smartwatch, plays music through earphones, and notifies users of disaster prevention information.

[0158] Prompt Sentence Examples

[0159] Specific examples of prompts are as follows:

[0160] "You are currently in a park. Your heart rate is 160 BPM. Please play some upbeat music and get information about nearby disasters."

[0161] This system allows users to listen to appropriate music in real time while running, while also receiving necessary map and disaster prevention information, making everyday activities safer and more comfortable.

[0162] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0163] Step 1:

[0164] Input: A wearable device worn by the user.

[0165] Action: A user puts on a wearable device such as a smartwatch or earphones.

[0166] Output: None.

[0167] Step 2:

[0168] Input: The worn wearable device.

[0169] Operation: The device periodically obtains the user's current location (latitude and longitude) using the built-in GPS sensor.

[0170] Specifically, the navigator.geolocation.getCurrentPosition method is called to obtain location information.

[0171] Output: The location information obtained (e.g., latitude 35.658581, longitude 139.745433).

[0172] Step 3:

[0173] Input: The worn wearable device.

[0174] How it works: The device periodically measures the user's heart rate using the built-in heart rate sensor.

[0175] Specifically, the smartwatch collects data from the heart rate sensor and calculates the heart rate.

[0176] Output: Acquired heart rate information (e.g. 160 BPM).

[0177] Step 4:

[0178] Input: Acquired location and heart rate information.

[0179] Operation: The device collects location and heart rate information and sends it to the server using an HTTP POST request.

[0180] Specifically, data is constructed in JSON format and sent to the " / data" endpoint via an HTTP POST request.

[0181] Output: Location and heart rate information sent to the server.

[0182] POST / data HTTP / 1.1

[0183] Host: example.com

[0184] Content-Type: application / json

[0185] {

[0186] "location": {"latitude": 35.658581, "longitude": 139.745433},

[0187] "heartRate": 160

[0188] }

[0189] Step 5:

[0190] Input: Location and heart rate information received by the server.

[0191] Operation: The server receives the location information and heart rate information sent from the device and performs data analysis.

[0192] Specifically, the server endpoint / data receives the request and parses the JSON-formatted data.

[0193] Output: Analyzed location and heart rate information.

[0194] Step 6:

[0195] Input: Parsed location information.

[0196] Operation: The server calls the map information service API based on the analyzed location information and obtains map information for the area around the current location.

[0197] Specifically, send the following API request:

[0198] GET https: / / maps.googleapis.com / maps / api / geocode / json?latlng=35.658581,139.745433&key=YOUR_API_KEY

[0199] Output: The retrieved map information.

[0200] Step 7:

[0201] Input: Parsed heart rate information.

[0202] Operation: The server calls the music distribution service API based on the analyzed heart rate information and obtains the appropriate music.

[0203] If your heart rate is high, choose up-tempo music, and if it's low, choose relaxation music.

[0204] Specifically, send the following API request:

[0205] GET https: / / api.spotify.com / v1 / recommendations?seed_genres=upbeat&target_tempo=160&key=YOUR_API_KEY

[0206] Output: The retrieved music information.

[0207] Step 8:

[0208] Input: Parsed location information.

[0209] Operation: The server calls the disaster prevention information service API based on the analyzed location information and obtains the latest disaster prevention information for the area.

[0210] Specifically, send the following API request:

[0211] GET https: / / www.jma.go.jp / bosai / forecast / data / overview_forecast / 130000.json

[0212] Output: Obtained disaster prevention information.

[0213] Step 9:

[0214] Input: Obtained map information, music information, and disaster prevention information.

[0215] Operation: The server aggregates these and generates personalized information to provide to the user.

[0216] Specifically, data is integrated using server-side languages ​​such as Python and Node.js to generate personalized information in JSON format.

[0217] Output: The generated personalized information.

[0218] {

[0219] "mapInfo": { ...},

[0220] "musicInfo": { ...},

[0221] "disasterInfo": { ...}

[0222] }

[0223] Step 10:

[0224] Input: Generated personalization information.

[0225] Operation: The server sends the generated personalized information to the device via an HTTP response or a push notification.

[0226] Specifically, it is returned as an HTTP response or sent using a push notification service.

[0227] Output: Personalized information sent to your device.

[0228] Step 11:

[0229] Input: Personalization information received by the device.

[0230] Operation: The terminal receives and analyzes the personalized information sent from the server.

[0231] Specifically, it parses HTTP responses and push notification data.

[0232] Output: Parsed personalization information.

[0233] Step 12:

[0234] Input: Parsed personalization information.

[0235] Operation: The device displays the received map information on the screen of the smartwatch or smartphone.

[0236] Specifically, the acquired map data is rendered using Google Maps SDK or similar.

[0237] Output: The displayed map information.

[0238] Step 13:

[0239] Input: Parsed personalization information.

[0240] Operation: The device plays the received music information through the earphones.

[0241] Specifically, the music is streamed using the acquired music URL.

[0242] Output: Played music.

[0243] Step 14:

[0244] Input: Parsed personalization information.

[0245] Operation: The device displays the received disaster prevention information using the smartwatch's notification function.

[0246] Specifically, we will utilize the function that displays notifications on smartwatches.

[0247] Output: Disaster prevention information notified.

[0248] (Application example 1)

[0249] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0250] Conventional personalized information provision systems have struggled to efficiently utilize a user's location information and heart rate information to provide optimal content to the user in real time. Furthermore, these systems rely on limited information sources, making it difficult to address diverse user needs. The present invention aims to solve these problems by providing a system that provides appropriate music, podcasts, disaster prevention information, and other content in real time based on a user's heart rate and location information.

[0251] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0252] In this invention, the server includes means for acquiring user location information, means for acquiring user heart rate information, means for acquiring map information around the current location from a map service based on the received location information, means for selecting appropriate music or podcasts from a content distribution service based on the received heart rate information, and means for acquiring the latest disaster prevention information corresponding to the area, thereby enabling the user to receive optimal music, podcasts, disaster prevention information, etc. in real time according to their current location and heart rate.

[0253] text

[0254] A "user" is an individual who uses the system and provides location information and heart rate information.

[0255] "Location information" is data that indicates the user's current geographical location.

[0256] "Heart rate information" is data indicating the user's heart rate, and represents the user's health condition and activity level.

[0257] The "server" is a system component that receives and analyzes location information and heart rate information, and generates and provides various personalized information.

[0258] A "map service" is an external service that provides geographical information and map data based on location information.

[0259] A "music streaming service" is a third-party service that provides music tracks in streaming or download format.

[0260] A "content distribution service" is an external service that provides multimedia content such as music and podcasts.

[0261] "Disaster prevention information" is data that provides information on local disaster risks and emergency response measures.

[0262] "Personalized information" is information generated specifically for a user by integrating acquired map information, music, podcasts, and disaster prevention information.

[0263] A "terminal" is a device that acquires the user's location information and heart rate information and transmits this information to a server.

[0264] A "satellite positioning system sensor" is a device that receives satellite signals and measures location information.

[0265] "Tempo-controlled music" refers to music that is selected based on heart rate and has a rhythm that is appropriate for the user's current activity level.

[0266] A "podcast" is audio content provided over the Internet and includes a variety of genres, including education, news, and entertainment.

[0267] text

[0268] The present invention is a system that provides personalized information in real time based on a user's location information and heart rate information. This system is composed of three elements: a user, a terminal, and a server.

[0269] 1. Users

[0270] A user is an individual who uses this system and provides location information and heart rate information. Specifically, the user wears a wearable device such as a smartwatch or fitness tracker, and acquires and transmits location information and heart rate information through the device.

[0271] 2. Terminal

[0272] The device is responsible for acquiring location information and heart rate information from the user and transmitting it to the server. Specific processing includes the following:

[0273] Location information acquisition: The device uses the built-in satellite positioning system sensor to acquire the user's current location.

[0274] Obtaining heart rate information: The device uses the built-in heart rate sensor to measure the user's heart rate.

[0275] Sending information: The acquired location information and heart rate information are sent to the server periodically.

[0276] 3. Server

[0277] The server receives and analyzes the information sent from the device and integrates various data to provide the user with the necessary information.

[0278] Receiving information: The server receives the location information and heart rate information sent from the device.

[0279] Obtaining map information: Calls the map service API based on the received location information and obtains map information around the current location.

[0280] Content selection: Based on the received heart rate information, the heart rate is analyzed and appropriate music or podcasts are retrieved from the content distribution service API. For example, if the heart rate is high, upbeat music is selected, and if it is low, a relaxing podcast is selected.

[0281] Obtaining disaster prevention information: Obtain the latest disaster prevention information for the area based on location information from the disaster prevention information service API.

[0282] Generation of personalized information: The acquired map information, music, podcasts, and disaster prevention information are integrated to generate personalized information to be provided to the user.

[0283] Sending information: Send the generated personalized information back to your device.

[0284] Specific examples

[0285] For example, if a user is running, the device will use a satellite positioning system sensor to obtain the user's location information and a heart rate sensor to measure the user's heart rate. Suppose the user's heart rate is 150 BPM. This information is sent to a server, which then calls a map service API to obtain map information for the current location. Based on the high heart rate, the server retrieves upbeat music from a content distribution service API. It also obtains the latest local disaster prevention information and combines this information to generate personalized information. Finally, this information is sent to the user's device, allowing the user to receive appropriate music and disaster prevention information in real time.

[0286] Prompt Sentence Examples

[0287] "If a user's heart rate is 150 BPM, can you recommend some upbeat music that's good for running? Also, give me the latest news in their area?"

[0288] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0289] text

[0290] Step 1:

[0291] Obtain the user's location information and heart rate information. The device uses the built-in satellite positioning system sensor to obtain the user's current location and the heart rate sensor to measure the heart rate. The input is the user's location information and heart rate information, and the output is a data packet sent to the server.

[0292] Step 2:

[0293] The server receives the location and heart rate information sent from the device. This is the initial stage of data processing and analysis. The input is the data packet sent from the device, and the output is processable data stored in the server.

[0294] Step 3:

[0295] The server calls the map service API based on the received location information and obtains map information for the area around the current location. The input is the location information and the output is the obtained map information. Specifically, the server sends an API request and receives map information as a response.

[0296] Step 4:

[0297] The server analyzes the received heart rate information and selects appropriate content (music or podcast). At this time, it calls the content distribution service API based on the heart rate to obtain the appropriate track. The input is the heart rate information, and the output is the selected music or podcast. Specifically, if the heart rate is high, it queries for up-tempo music, and if the heart rate is low, it queries for relaxation podcasts.

[0298] Step 5:

[0299] The server obtains the latest disaster prevention information for the region based on the location information from the disaster prevention information service API. The input is location information and the output is disaster prevention information. Specifically, the server sends an API request to obtain disaster prevention information for the region and receives the disaster prevention information as a response.

[0300] Step 6:

[0301] The server integrates the acquired map information, music, podcasts, and disaster prevention information to generate personalized information to provide to users. The input is the various acquired data, and the output is the integrated personalized information. Specifically, the server integrates each data to generate personalized information in JSON format.

[0302] Step 7:

[0303] The server transmits the generated personalized information to the terminal. The input is the generated personalized information, and the output is a data packet transmitted to the terminal. Specifically, the server transmits data to the terminal and provides the information to the user in real time.

[0304] Step 8:

[0305] The device receives personalized information sent from the server and notifies the user. The input is the data packet sent from the server, and the output is the presentation of information to the user. Specific operations include displaying a notification on the smartwatch display and playing music or podcasts through the earphones.

[0306] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0307] MODE FOR CARRYING OUT THE INVENTION

[0308] This invention is a system that provides personalized content in real time based on a user's location information, heart rate information, and emotional state. This system consists of three elements: a server, a terminal, and a user. It also includes an emotion engine for recognizing the user's emotions. Below, we will explain the role and specific functions of each element, as well as the operation of the entire system.

[0309] User

[0310] Users are individuals who use this system and provide location information, heart rate information, and emotional information. Users wear wearable devices (e.g., smart watches, earphones, audio glasses, etc.) through which they acquire, send, and receive information.

[0311] Terminal

[0312] The device acquires location information, heart rate information, and emotion information from the user and transmits it to the server. The main functions of the device are described in detail below.

[0313] 1. Location information acquisition:

[0314] The device uses the built-in GPS sensor to obtain the user's current location.

[0315] Location information is updated periodically (e.g., every 5 seconds).

[0316] 2. Obtaining heart rate information:

[0317] The device uses a built-in heart rate sensor to measure the user's heart rate.

[0318] Heart rate information is also updated periodically (e.g., every 5 seconds).

[0319] 3. Acquiring emotional information:

[0320] Using the camera and microphone installed on the device, the user's facial expressions and tone of voice are analyzed, and the emotion engine recognizes the user's emotions.

[0321] 4. Transmission of Information:

[0322] The periodically acquired location information, heart rate information, and emotion information are packaged into packets and sent to a server.

[0323] server

[0324] The server receives and analyzes the information sent from the terminal and integrates various data to provide the necessary information to the user. Below, we will explain in detail the main functions and processes performed by the server.

[0325] 1. Receiving Information:

[0326] The server receives the location information, heart rate information, and emotion information transmitted from the terminal.

[0327] 2. Getting map information:

[0328] The server calls the map service API based on the received location information and obtains map information for the area around the current location.

[0329] 3. Music Selection:

[0330] The server analyzes the received heart rate information and retrieves music corresponding to the user's heart rate from the music distribution service API.

[0331] For example, if your heart rate is high (e.g., 160 BPM), choose an up-tempo song.

[0332] Emotional information is also taken into consideration to select songs that suit the user's emotional state.

[0333] For example, if the emotional state is "relaxed," select relaxation music.

[0334] 4. Obtaining disaster prevention information:

[0335] Based on the location information, the server obtains the latest disaster prevention information corresponding to the region from the disaster prevention information service API.

[0336] 5. Generating personalized information:

[0337] The system integrates the acquired map information, selected music, disaster prevention information, and the user's emotional information to generate optimal personalized information.

[0338] 6. Sending Personalized Information:

[0339] The server transmits the generated personalized information to the terminal.

[0340] Specific examples

[0341] For users running

[0342] The user wears a smartwatch and earphones while running.

[0343] The device acquires the user's current location using a GPS sensor and measures their heart rate using a heart rate sensor. For example, suppose the heart rate is 160 BPM. The device's camera and microphone are used by the emotion engine to recognize the user's emotional state as "excited."

[0344] The terminal transmits this information to the server.

[0345] The server calls the map service API based on the location information and obtains map information within the park.

[0346] Next, since the heart rate is high, up-tempo music is retrieved from a music distribution service API. Also, since the emotional state is "excited," songs that will maintain tension are selected.

[0347] In addition, the disaster prevention information service API is called to check the necessary disaster prevention information.

[0348] Finally, this information is integrated to generate personalized information, including information about the user's current location, music selection, necessary disaster prevention information, and information based on their emotional state.

[0349] The server sends the generated personalized information to the user's device, which analyzes it, notifies the smartwatch, and plays music through the earphones.

[0350] The system allows users to receive appropriate music, map information, and disaster prevention information in real time while running, and can provide a more personalized experience by taking into account the user's emotional state.

[0351] The processing flow will be explained below.

[0352] Step 1:

[0353] A user puts on a wearable device and launches an application. The device activates the GPS sensor and heart rate sensor.

[0354] Step 2:

[0355] The device obtains the user's current location using the GPS sensor. This location information is updated periodically (e.g., every 5 seconds).

[0356] Step 3:

[0357] The device measures the user's heart rate using a heart rate sensor, and the heart rate information is updated periodically (e.g., every 5 seconds).

[0358] Step 4:

[0359] The device's built-in camera periodically captures the user's facial expressions, and the microphone collects the user's tone of voice, which is then used by the emotion engine to analyze the user's emotional state.

[0360] Step 5:

[0361] The terminal assembles the acquired location information, heart rate information, and emotion information into packets and transmits them to the server.

[0362] Step 6:

[0363] The server receives the location information, heart rate information, and emotion information transmitted from the terminal.

[0364] Step 7:

[0365] Based on the location information received by the server, the map service API is called to obtain map information around the current location.

[0366] Step 8:

[0367] The server analyzes the received heart rate information and retrieves music corresponding to the user's heart rate from the music distribution service API. For example, if the heart rate is 160 BPM, an up-tempo song will be selected.

[0368] Step 9:

[0369] The server uses an emotion engine to analyze the user's emotional state and selects appropriate music based on the results. For example, if the emotional state is "relaxed," it selects relaxation music.

[0370] Step 10:

[0371] Based on the location information, the server obtains the latest disaster prevention information corresponding to the region from the disaster prevention information service API.

[0372] Step 11:

[0373] The server integrates the acquired map information, selected music, disaster prevention information, and emotional information to generate optimal personalized information.

[0374] Step 12:

[0375] The server transmits the generated personalized information to the terminal.

[0376] Step 13:

[0377] The terminal analyzes the personalized information received from the server.

[0378] Step 14:

[0379] Based on the analyzed information, the device provides information to the user in an appropriate way. For example, selected music is played through earphones, and the smartwatch notifies the user of their current location, disaster prevention information, and emotional advice.

[0380] This detailed processing step allows users to efficiently receive the most appropriate information in real time. The system aims to improve the user experience by providing the most appropriate information tailored to the user's current situation and emotional state.

[0381] Example 2

[0382] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0383] Currently, there are systems that provide personalized information based on the user's location and heart rate information, but adding emotional information to these systems would enable more accurate personalization.However, such systems do not currently exist, and the provision of appropriate information according to the user's emotional state is insufficient, making it a challenge to improve user satisfaction.

[0384] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0385] In this invention, the server includes means for acquiring user location information, means for acquiring user heart rate information, means for acquiring user emotion information, means for transmitting the acquired location information, heart rate information, and emotion information to the server, means for receiving the transmitted location information, heart rate information, and emotion information, means for acquiring map information of the vicinity of the current location from a map service based on the received location information, means for selecting appropriate music from a music distribution service based on the received heart rate information and emotion information, means for acquiring the latest disaster prevention information corresponding to the area, means for integrating the acquired map information, music, disaster prevention information, and emotion information to generate personalized information to be provided to the user, means for transmitting the generated personalized information to the terminal, and terminal means. This enables the provision of highly accurate personalized information based on more multifaceted information including the user's emotional state.

[0386] "User location information" refers to coordinate information of the location where the user is currently located.

[0387] "User's heart rate information" refers to data obtained by measuring the user's heart rate.

[0388] "User emotional information" refers to data that expresses the user's emotional state, and is obtained by analyzing facial expressions, tone of voice, etc.

[0389] A "server" is a computer system that receives and analyzes data sent from a terminal, consolidates the necessary information, and sends it to the terminal.

[0390] "Terminal" refers to a device worn or used by a user that acquires location information, heart rate information, and emotional information and transmits it to a server.

[0391] A "GPS sensor" is a sensor that receives signals from satellites and determines the current location on Earth.

[0392] "Map Service" refers to a service that provides geographic information through a specific API.

[0393] "Music distribution service" refers to a service that provides music data through a specific API.

[0394] "Disaster prevention information" refers to information relating to emergencies such as natural disasters, and is provided according to the region.

[0395] "Personalized information" refers to information specific to a user that is generated by integrating the user's individual location information, heart rate information, emotional information, etc.

[0396] An "emotion engine" refers to software or hardware that analyzes a user's facial expressions and tone of voice to recognize their emotional state.

[0397] This invention is a system that provides personalized content in real time based on a user's location information, heart rate information, and emotional state. This system consists of three elements: a server, a terminal, and a user. It also includes an emotion engine for recognizing the user's emotions. Below, we will explain the role and specific functions of each element, as well as the operation of the entire system.

[0398] User

[0399] A user is an individual who uses this system and provides location information, heart rate information, and emotional information. The user wears a wearable device (e.g., a smartwatch, earphones, etc.) through which information is acquired, sent, and received. The user begins using this system by wearing the smartwatch on their wrist and the earphones in their ears.

[0400] Terminal

[0401] The device acquires location information, heart rate information, and emotion information from the user and transmits it to the server. The main functions of the device are described in detail below.

[0402] 1. Location information acquisition:

[0403] The device uses the built-in GPS sensor to obtain the user's current location, which is updated periodically (e.g., every 5 seconds).

[0404] 2. Obtaining heart rate information:

[0405] The device uses a built-in heart rate sensor to measure the user's heart rate, and the heart rate information is updated periodically (e.g., every 5 seconds).

[0406] 3. Acquiring emotional information:

[0407] Using the camera and microphone installed on the device, the user's facial expressions and tone of voice are analyzed, and the emotion engine recognizes the user's emotions.

[0408] 4. Transmission of Information:

[0409] The periodically acquired location information, heart rate information, and emotion information are packaged into packets and sent to a server.

[0410] server

[0411] The server receives and analyzes the information sent from the terminal and integrates various data to provide the necessary information to the user. Below, we will explain in detail the main functions and processes performed by the server.

[0412] 1. Receiving Information:

[0413] The server receives the location information, heart rate information, and emotion information transmitted from the terminal.

[0414] 2. Getting map information:

[0415] The server calls the map service API based on the received location information and obtains map information for the area around the current location.

[0416] 3. Music Selection:

[0417] The server analyzes the received heart rate information and retrieves music from the music distribution service API that corresponds to the user's heart rate and emotional state.

[0418] For example, if your heart rate is high (e.g., 160 BPM), choose an up-tempo song. If your emotional state is "excited," choose an energetic song.

[0419] 4. Obtaining disaster prevention information:

[0420] Based on the location information, the server obtains the latest disaster prevention information corresponding to the region from the disaster prevention information service API.

[0421] 5. Generating personalized information:

[0422] The system integrates the acquired map information, selected music, disaster prevention information, and the user's emotional information to generate optimal personalized information.

[0423] 6. Sending Personalized Information:

[0424] The server transmits the generated personalized information to the terminal.

[0425] Specific examples

[0426] For users running

[0427] Suppose a user is wearing a smartwatch and earphones while running. The smartwatch periodically obtains the user's current location using a GPS sensor and measures their heart rate using a heart rate sensor. For example, if the user's heart rate is 160 BPM, the device sends this information to the server. At the same time, the emotion engine uses the device's built-in camera and microphone to recognize the user's emotional state as "excited."

[0428] The server first calls a map service API based on the location information to obtain map information for the park where the user is running. Next, because the heart rate is high, it retrieves up-tempo music from a music distribution service API, and because the emotional state is "excited," it selects energetic music. It also calls a disaster prevention information service API to check disaster prevention information related to the user's current location.

[0429] The server combines this data (map information, music information, disaster prevention information) to generate personalized information optimal for the user and transmits it to the device. The device then plays the delivered music through earphones and displays the necessary information on the smartwatch screen.

[0430] Prompt Sentence Examples

[0431] "Please explain the specific steps of a system that provides real-time personalized music and map information when a user's heart rate is high and their emotional state is 'excited' while running."

[0432] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0433] Step 1: The user puts on the wearable device

[0434] The user puts on a smartwatch, earphones, or other wearable device, which then prepares the device to acquire the user's location, heart rate, and emotional information. The input for this step is the user, and the output is the wearable device.

[0435] Step 2: The device acquires location information

[0436] The device uses the built-in GPS sensor to obtain the user's current location. For example, if the user is in a park, the device obtains the location coordinates. The input is the signal from the GPS sensor, and the output is the location coordinate data (e.g., latitude 35.6895 degrees, longitude 139.6917 degrees). The location information is updated periodically (e.g., every 5 seconds).

[0437] Step 3: Your device acquires heart rate information

[0438] The device measures the user's heart rate using a built-in heart rate sensor. For example, the heart rate is measured at 160 BPM. The input is data from the heart rate sensor, and the output is heart rate data. The heart rate information is also updated periodically (for example, every 5 seconds).

[0439] Step 4: The device acquires emotion information

[0440] The device uses a camera and microphone to analyze the user's facial expressions and tone of voice. The emotion engine processes the results of this analysis and recognizes the user's emotional state as "excitement." The input is sensor data from the camera and microphone, and the output is emotional information.

[0441] Step 5: The device sends the information to the server

[0442] The device collects location information, heart rate information, and emotion information and compiles them into packets, which are then sent to the server. The input is location information, heart rate information, and emotion information, and the output is the data sent to the server. The transmission is performed periodically.

[0443] Step 6: The server receives the information

[0444] The server receives location information, heart rate information, and emotion information sent from the device. The input is the data sent from the device, and the output is the data stored on the server.

[0445] Step 7: The server retrieves the map information

[0446] The server calls the map service API based on the received location information to obtain map information around the current location. The input is location data, and the output is map information data (e.g., obtain geographic information using the Google Maps API).

[0447] Step 8: The server selects the music

[0448] The server analyzes the received heart rate and emotional information and retrieves music from a music distribution service API that corresponds to the user's heart rate and emotional state. For example, if a user's heart rate is 160 BPM and they are in an "excited" state, it selects an up-tempo, energetic song. The input is heart rate and emotional information data, and the output is the selected music data (e.g., retrieving songs using the Spotify API).

[0449] Step 9: The server acquires disaster prevention information

[0450] The server retrieves the latest disaster prevention information for the region from the disaster prevention information service API based on the location information. The input is location information data, and the output is disaster prevention information data (e.g., using the disaster prevention information service API to retrieve the latest information for the region).

[0451] Step 10: Server generates personalized information

[0452] The server integrates the acquired map information, selected music, disaster prevention information, and emotional information to generate optimal personalized information. The input is map information, music data, disaster prevention information, and emotional information, and the output is the integrated personalized information.

[0453] Step 11: The server sends the personalized information to the device.

[0454] The server sends the generated personalized information to the terminal. The input is the personalized information data, and the output is the data sent to the terminal.

[0455] Step 12: The device analyzes the information and notifies the user.

[0456] The device analyzes the received personalized information and notifies the user of appropriate information. Specifically, map information and disaster prevention information are displayed on the smartwatch's notification screen, and selected music is played through the earphones. The input is personalized information data, and the output is the form of information provided to the user (screen display and music playback).

[0457] (Application example 2)

[0458] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0459] In modern society, the proliferation of information and the diversification of individual user needs have led to a growing need for personalized content tailored to users' real-time situations. Real-time information delivery systems based on biometric data, such as location information and heart rate, can contribute to improving user experience. However, current systems are unable to effectively integrate these data and provide personalized content that also responds to the user's emotional state. Therefore, there is a need for a system that can provide personalized information in real time based on the user's location information, heart rate information, and emotional state.

[0460] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring user location information, means for acquiring user heart rate information, means for acquiring the user's emotional state, means for transmitting the received location information, heart rate information, and emotional information to the server, means for acquiring map information near the current location from a map service based on the received location information, means for selecting appropriate music from a music distribution service based on the received heart rate information, means for generating personalized content based on the emotional state, means for acquiring the latest disaster prevention information corresponding to the region, means for generating personalized information to provide to the user by integrating the acquired map information, music, disaster prevention information, and emotional information, means for transmitting the generated personalized information to the terminal, and terminal means. This makes it possible to provide personalized information that integrates appropriate map information, music, and disaster prevention information in real time based on the user's real-time biometric data and emotional state.

[0461] "Location information" is geographical coordinate information that indicates the user's current location.

[0462] "Heartbeat information" is biological data such as heart rate and heartbeat rhythm obtained from the user's heartbeat.

[0463] "Emotional state" is information indicating the user's emotions, and refers to psychological states such as stress, relaxation, and excitement.

[0464] "Personalized information" refers to content and service information that is individually customized based on the user's location information, heart rate information, and emotional state.

[0465] "Map information" is data that indicates the topography, roads, facilities, etc. within a geographical space.

[0466] A "music distribution service" is a service that distributes music over the Internet.

[0467] "Disaster prevention information" refers to the latest information on disasters such as earthquakes, fires, and typhoons.

[0468] "Server" means a central processing unit that receives, analyzes, and processes information sent by users.

[0469] A "terminal" is a device that a user carries or wears, including a smartphone or smartwatch.

[0470] This invention is a system that acquires a user's location information, heart rate information, and emotional state in real time and provides personalized content. This system is mainly composed of three elements: a server, a terminal, and a user. Below, we will explain in detail the operation of each element and the entire system.

[0471] User

[0472] The user is a person who uses this system and provides location information, heart rate information, and emotional information. The user wears a wearable device such as a smartwatch, earphones, or smart glasses, and the information is collected and sent to the server.

[0473] Terminal

[0474] The terminal acquires information from the user and transmits it to the server. Its main functions are as follows:

[0475] 1. Location information acquisition:

[0476] The device uses the built-in GPS sensor to obtain the user's current location, which is updated periodically.

[0477] 2. Obtaining heart rate information:

[0478] The device uses a built-in heart rate sensor to measure the user's heart rate, and this information is also updated periodically.

[0479] 3. Acquiring emotional information:

[0480] Using the camera and microphone installed on the device, the emotion engine analyzes the user's facial expressions and tone of voice to recognize the user's emotions.

[0481] 4. Transmission of Information:

[0482] The processed data is sent to the server.

[0483] server

[0484] The server receives the information sent from the terminal and analyzes and processes it. The main processes are as follows:

[0485] 1. Receiving Information:

[0486] The location information, heart rate information, and emotion information transmitted from the terminal are received.

[0487] 2. Getting map information:

[0488] Based on the received location information, the map service API is called to obtain map information around the current location.

[0489] 3. Music Selection:

[0490] Based on heart rate information, the system selects appropriate music from a music streaming service API. For example, if the heart rate is high, it selects up-tempo music. It also takes into account emotional information to select music that matches the user's emotional state.

[0491] 4. Emotion-based content generation:

[0492] Based on emotional information, it generates content such as videos and podcasts that are optimal for the user's emotional state.

[0493] 5. Obtaining disaster prevention information:

[0494] The latest disaster prevention information is obtained from the disaster prevention information service API based on location information.

[0495] 6. Generating personalized information:

[0496] The acquired map information, selected music, disaster prevention information, and emotional information are integrated to generate personalized information to be provided to the user.

[0497] 7. Transmission of Information:

[0498] The final generated personalized information is transmitted to the terminal.

[0499] Specific examples

[0500] For users running

[0501] The user wears a smartwatch and earphones while running. The device acquires the user's current location information obtained by the GPS sensor and the heart rate measured by the heart rate sensor (e.g., 160 BPM). The emotion engine also recognizes the user's emotional state as "excitement." This information is periodically sent to the server.

[0502] The server calls a map service API based on the received location information to obtain map information for the park. Next, because the heart rate information is high, it retrieves up-tempo songs from a music distribution service API and selects music suitable for maintaining excitement based on the emotional state. It also calls a disaster prevention information service API to check necessary disaster prevention information.

[0503] This information is then integrated to generate personalized information, which is then sent back to the user's device. The user can then check this information on their smartwatch, and the selected music will play from the earphones.

[0504] Example prompt for a generative AI model:

[0505] "A user is feeling stressed while walking through a city. Their heart rate is 120 BPM. What content would you recommend?"

[0506] This system allows users to enjoy content that is best suited to their situation in real time.

[0507] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0508] Step 1:

[0509] Users acquire information by wearing a wearable device

[0510] Specific behavior:

[0511] Users wear wearable devices such as smartwatches, earphones, and smart glasses. The user's current location is acquired using a GPS sensor, and heart rate information is measured using a heart rate sensor. In addition, the device's built-in camera and microphone are used to analyze the user's facial expressions and tone of voice to obtain emotional information.

[0512] input:

[0513] User location information, heart rate information, emotional state

[0514] output:

[0515] Acquired location information, heart rate information, and emotional information

[0516] Step 2:

[0517] The device sends the acquired information to the server.

[0518] Specific behavior:

[0519] The device periodically collects location information, heart rate information, and emotion information, and then compiles them into packets and sends them to a server via the Internet.

[0520] input:

[0521] Acquired location information, heart rate information, and emotional information

[0522] output:

[0523] Location information, heart rate information, and emotional information sent to the server

[0524] Step 3:

[0525] The server analyzes the information it receives

[0526] Specific behavior:

[0527] The server receives location information, heart rate information, and emotion information sent from the device, analyzes the received data, and identifies and organizes each piece of information.

[0528] input:

[0529] Transmitted location information, heart rate information, and emotional information

[0530] output:

[0531] Organized location, heart rate, and emotional information

[0532] Step 4:

[0533] The server obtains map information

[0534] Specific behavior:

[0535] The server then calls the map service API based on the received location information to obtain map information for the area around the user's current location. The obtained map information provides detailed geographic data about the user's current location.

[0536] input:

[0537] Organized location information

[0538] output:

[0539] Obtained map information

[0540] Step 5:

[0541] The server selects the music

[0542] Specific behavior:

[0543] The server analyzes the received heart rate information, retrieves music corresponding to the user's heart rate from a music distribution service API, and selects music appropriate for the user's emotional state, taking into account the emotional information.

[0544] input:

[0545] Organized heart rate and emotional information

[0546] output:

[0547] Selected music

[0548] Step 6:

[0549] The server acquires disaster prevention information

[0550] Specific behavior:

[0551] The server retrieves the latest disaster prevention information for the area based on the location information from the disaster prevention information service API, which provides information such as disaster risks near the user's current location.

[0552] input:

[0553] Organized location information

[0554] output:

[0555] Acquired disaster prevention information

[0556] Step 7:

[0557] The server generates the personalized information.

[0558] Specific behavior:

[0559] The server integrates the acquired map information, selected music, disaster prevention information, and emotion information to generate personalized information to be provided to the user.

[0560] input:

[0561] Map information, selected music, disaster prevention information, emotional information

[0562] output:

[0563] Generated personalized information

[0564] Step 8:

[0565] The server sends the generated personalized information to the device.

[0566] Specific behavior:

[0567] The server transmits the generated personalized information to the terminal, where it is analyzed and appropriately notified or played back.

[0568] input:

[0569] Generated personalized information

[0570] output:

[0571] Personalized information sent by the server

[0572] Step 9:

[0573] The device provides personalized information to the user

[0574] Specific behavior:

[0575] The device analyzes the received personalized information and provides it to the user via the smartwatch or earphones, such as displaying a notification on the smartwatch and playing selected music through the earphones.

[0576] input:

[0577] Personalized Information Received

[0578] output:

[0579] Personalized information provided to users

[0580] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0581] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0582] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0583] [Second embodiment]

[0584] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0585] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0586] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0587] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0588] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0589] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0590] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0591] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0592] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0593] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0594] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0595] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0596] MODE FOR CARRYING OUT THE INVENTION

[0597] The present invention is a system that provides personalized information in real time based on a user's location information and heart rate information. This system basically consists of three elements: a server, a terminal, and a user. The roles and specific functions of each element are explained below.

[0598] User

[0599] Users are individuals who use this system and provide location and heart rate information. Users wear wearable devices (e.g., smart watches, earphones, audio glasses, etc.) through which they acquire, send, and receive information.

[0600] Terminal

[0601] The device acquires location information and heart rate information from the user and transmits it to the server. The main processes performed by the device are described below.

[0602] 1. Location information acquisition:

[0603] The device uses the built-in GPS sensor to obtain the user's current location.

[0604] The acquired location information is updated periodically.

[0605] 2. Obtaining heart rate information:

[0606] The device uses a built-in heart rate sensor to measure the user's heart rate.

[0607] The measured heart rate information is also updated periodically.

[0608] 3. Transmission of Information:

[0609] The periodically acquired location information and heart rate information are packaged into packets and sent to the server.

[0610] server

[0611] The server receives and analyzes the information sent from the terminal and integrates various data to provide the necessary information to the user. The main processes performed by the server are described below.

[0612] 1. Receiving Information:

[0613] The server receives the location information and heart rate information transmitted from the terminal.

[0614] 2. Getting map information:

[0615] The server calls the map service API based on the received location information and obtains map information for the area around the current location.

[0616] 3. Music Selection:

[0617] The server analyzes the heart rate based on the received heart rate information and retrieves appropriate music from the music distribution service API.

[0618] For example, if your heart rate is high, choose upbeat music, and if your heart rate is low, choose relaxation music.

[0619] 4. Obtaining disaster prevention information:

[0620] The server obtains disaster prevention information corresponding to the region based on the location information from the disaster prevention information service API.

[0621] 5. Generating personalized information:

[0622] The acquired map information, music, disaster prevention information, and other personalized information (e.g., store coupons) are integrated as needed to generate optimal personalized information.

[0623] 6. Sending Personalized Information:

[0624] The server transmits the generated personalized information to the terminal again.

[0625] Specific examples

[0626] For users running

[0627] The user wears the smartwatch while running.

[0628] The device acquires the user's current location using a GPS sensor and measures the user's heart rate using a heart rate sensor. For example, suppose the heart rate is 160 BPM.

[0629] The terminal transmits the acquired location information and heart rate information to the server.

[0630] The server calls the map service API based on the location information and obtains map information within the park.

[0631] Next, since the heart rate is high, up-tempo music is retrieved from the music distribution service API. In addition, a disaster prevention information service API is called to check the necessary disaster prevention information.

[0632] Finally, this information is integrated to generate personalized information, including information about the user's current location, selected music, necessary disaster prevention information, etc.

[0633] The server sends the generated personalized information to the user's device, which analyzes it and sends notifications to the smartwatch or plays music through earphones.

[0634] This system allows users to listen to appropriate music in real time while running, while also receiving necessary map and disaster prevention information, making everyday activities safer and more comfortable.

[0635] The processing flow will be explained below.

[0636] Step 1:

[0637] The user puts on the wearable device and starts the system. The device completes the initial setup and activates the GPS sensor and heart rate sensor.

[0638] Step 2:

[0639] The device uses the GPS sensor to obtain the user's current location. This location information is obtained periodically (e.g., every 5 seconds).

[0640] Step 3:

[0641] The device uses a heart rate sensor to measure the user's heart rate, and heart rate information is also collected periodically (e.g., every 5 seconds).

[0642] Step 4:

[0643] The terminal assembles the acquired location information and heart rate information into a packet and transmits it to the server.

[0644] Step 5:

[0645] The server receives the location information and heart rate information transmitted from the terminal.

[0646] Step 6:

[0647] Based on the location information received by the server, the map service API is called to obtain map information around the current location.

[0648] Step 7:

[0649] The server analyzes the received heart rate information and calls the music distribution service API to select music according to the user's heart rate.

[0650] For example: If your heart rate is high (e.g., 160 BPM), choose an up-tempo song.

[0651] Step 8:

[0652] Based on the location information, the server obtains the latest disaster prevention information corresponding to the region from the disaster prevention information service API.

[0653] Step 9:

[0654] The server integrates map information, selected music, and disaster prevention information to generate optimal personalized information.

[0655] Step 10:

[0656] The server transmits the generated personalized information to the terminal.

[0657] Step 11:

[0658] The terminal analyzes the personalized information received from the server.

[0659] Step 12:

[0660] Based on the analyzed information, the device provides information to the user in an appropriate manner.

[0661] Example: Play selected music through earphones and notify the smartwatch of current location and disaster prevention information.

[0662] This process flow allows users to receive the information they need in real time. The system aims to improve the user experience by providing the most appropriate information tailored to the user's current situation.

[0663] Example 1

[0664] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0665] Conventional personalized information provision systems have not been able to fully utilize the user's location information and heart rate information, making it difficult to provide personalized information in real time. In addition, since music selection and disaster prevention information provision are not centralized, users are unable to receive the information they need in a timely manner, resulting in issues of low safety and convenience.

[0666] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0667] In this invention, the server includes means for acquiring user location information, means for acquiring user heart rate information, means for transmitting the acquired location information and heart rate information to a central processing unit, means for receiving the transmitted location information and heart rate information, means for acquiring map information of the vicinity of the current location from a map information providing service based on the received location information, means for selecting appropriate music from a music distribution service based on the received heart rate information, means for acquiring the latest disaster prevention information corresponding to the area, means for integrating the acquired map information, music, and disaster prevention information to generate personalized information to be provided to the user, means for transmitting the generated personalized information to the terminal, and means for notifying the user of the personalized information received by the terminal. This makes it possible to utilize the user's location information and heart rate information in real time, centrally manage necessary map information, music, and disaster prevention information, and immediately provide them to the user.

[0668] A "user" is an individual who uses the system and provides location and heart rate information.

[0669] "Location information" is data indicating the user's current geographical latitude and longitude.

[0670] "Heart rate information" is data indicating the user's current heart rate.

[0671] The "central processing unit" is a device that has the function of receiving and processing the location information and heart rate information transmitted from the terminal.

[0672] A "terminal" is a device worn by a user that has the function of acquiring location information and heart rate information and transmitting this information to a central processing unit.

[0673] A "map information service" is an online service that provides map information around the current location based on location information.

[0674] A "music distribution service" is an online service that selects and provides appropriate music based on heart rate information.

[0675] "Disaster prevention information" refers to information including the latest disaster information and evacuation advisories for a specific area.

[0676] "Personalized information" is individually tailored information that is generated to provide to a user by integrating acquired map information, music, and disaster prevention information.

[0677] "Notification" is the act of presenting information to a user through a terminal.

[0678] The present invention is a system that provides personalized information in real time based on a user's location information and heart rate information. This system basically consists of three elements: a server, a terminal, and a user. The roles and specific functions of each element are explained below.

[0679] User

[0680] Users are individuals who use this system and provide location and heart rate information. Users wear wearable devices (e.g., smart watches, earphones, audio glasses, etc.) through which they acquire, send, and receive information.

[0681] Terminal

[0682] The device acquires location information and heart rate information from the user and transmits it to the server. Specifically, it performs the following processes.

[0683] 1. Obtaining location information

[0684] The device uses the built-in GPS sensor to obtain the user's current location, which allows for detailed and accurate location information.

[0685] The device periodically updates this location information to keep it up to date.

[0686] 2. Obtaining heart rate information

[0687] The device measures the user's heart rate using a built-in heart rate sensor, which is often an optical sensor or an electrocardiogram sensor.

[0688] The device will periodically update your heart rate information to keep your health information up to date.

[0689] 3. Transmission of Information

[0690] The acquired location information and heart rate information are packaged into packets and sent to the server using HTTP POST requests or WebSocket communication.

[0691] server

[0692] The server receives the information sent from the device, performs the necessary data analysis, and generates personalized information based on the acquired data. The main processes performed by the server are described below.

[0693] 1. Receipt of information

[0694] The server receives the location information and heart rate information sent from the device using an HTTP server or WebSocket server.

[0695] 2. Obtaining map information

[0696] The server then calls a map information service API based on the received location information to obtain map information for the area around the current location. Typically, Google Maps API is used.

[0697] 3. Music selection

[0698] The server analyzes the heart rate based on the received heart rate information and retrieves appropriate music from a music streaming service API. If the heart rate is high, an up-tempo song is selected, and if it is low, a relaxing song is selected. Spotify API and Apple Music API are commonly used.

[0699] 4. Obtaining disaster prevention information

[0700] Based on the received location information, the server obtains disaster prevention information for that area from a disaster prevention information service API, such as the Japan Meteorological Agency API.

[0701] 5. Generating personalized information

[0702] The server integrates the acquired map information, music, disaster prevention information, etc. to generate personalized information to provide to users. This process is implemented using server-side languages ​​such as Python and Node.js.

[0703] 6. Sending personalized information

[0704] The server transmits the generated personalized information to the terminal again.

[0705] Specific examples

[0706] For users running

[0707] The user wears the smartwatch while running.

[0708] The device acquires the user's current location using a GPS sensor, records it as latitude 35.658581 and longitude 139.745433, and measures the heart rate as 160 BPM using a heart rate sensor.

[0709] The terminal transmits the acquired location information and heart rate information to the server.

[0710] The server calls the map information service API based on the location information and obtains map information within the park.

[0711] The server retrieves up-tempo songs from the music distribution service API because the heart rate is 160 BPM. It also calls the disaster prevention information service API to retrieve disaster prevention information around the park.

[0712] The server integrates this information to generate personalized information, including park maps, music selections, and disaster prevention information.

[0713] The server sends the generated personalized information to the device, which receives it and displays map information on the smartwatch, plays music through earphones, and notifies users of disaster prevention information.

[0714] Prompt Sentence Examples

[0715] Specific examples of prompts are as follows:

[0716] "You are currently in a park. Your heart rate is 160 BPM. Please play some upbeat music and get information about nearby disasters."

[0717] This system allows users to listen to appropriate music in real time while running, while also receiving necessary map and disaster prevention information, making everyday activities safer and more comfortable.

[0718] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0719] Step 1:

[0720] Input: A wearable device worn by the user.

[0721] Action: A user puts on a wearable device such as a smartwatch or earphones.

[0722] Output: None.

[0723] Step 2:

[0724] Input: The worn wearable device.

[0725] Operation: The device periodically obtains the user's current location (latitude and longitude) using the built-in GPS sensor.

[0726] Specifically, the navigator.geolocation.getCurrentPosition method is called to obtain location information.

[0727] Output: The location information obtained (e.g., latitude 35.658581, longitude 139.745433).

[0728] Step 3:

[0729] Input: The worn wearable device.

[0730] How it works: The device periodically measures the user's heart rate using the built-in heart rate sensor.

[0731] Specifically, the smartwatch collects data from the heart rate sensor and calculates the heart rate.

[0732] Output: Acquired heart rate information (e.g. 160 BPM).

[0733] Step 4:

[0734] Input: Acquired location and heart rate information.

[0735] Operation: The device collects location and heart rate information and sends it to the server using an HTTP POST request.

[0736] Specifically, data is constructed in JSON format and sent to the " / data" endpoint via an HTTP POST request.

[0737] Output: Location and heart rate information sent to the server.

[0738] POST / data HTTP / 1.1

[0739] Host: example.com

[0740] Content-Type: application / json

[0741] {

[0742] "location": {"latitude": 35.658581, "longitude": 139.745433},

[0743] "heartRate": 160

[0744] }

[0745] Step 5:

[0746] Input: Location and heart rate information received by the server.

[0747] Operation: The server receives the location information and heart rate information sent from the device and performs data analysis.

[0748] Specifically, the server endpoint / data receives the request and parses the JSON-formatted data.

[0749] Output: Analyzed location and heart rate information.

[0750] Step 6:

[0751] Input: Parsed location information.

[0752] Operation: The server calls the map information service API based on the analyzed location information and obtains map information for the area around the current location.

[0753] Specifically, send the following API request:

[0754] GET https: / / maps.googleapis.com / maps / api / geocode / json?latlng=35.658581,139.745433&key=YOUR_API_KEY

[0755] Output: The retrieved map information.

[0756] Step 7:

[0757] Input: Parsed heart rate information.

[0758] Operation: The server calls the music distribution service API based on the analyzed heart rate information and obtains the appropriate music.

[0759] If your heart rate is high, choose up-tempo music, and if it's low, choose relaxation music.

[0760] Specifically, send the following API request:

[0761] GET https: / / api.spotify.com / v1 / recommendations?seed_genres=upbeat&target_tempo=160&key=YOUR_API_KEY

[0762] Output: The retrieved music information.

[0763] Step 8:

[0764] Input: Parsed location information.

[0765] Operation: The server calls the disaster prevention information service API based on the analyzed location information and obtains the latest disaster prevention information for the area.

[0766] Specifically, send the following API request:

[0767] GET https: / / www.jma.go.jp / bosai / forecast / data / overview_forecast / 130000.json

[0768] Output: Obtained disaster prevention information.

[0769] Step 9:

[0770] Input: Obtained map information, music information, and disaster prevention information.

[0771] Operation: The server aggregates these and generates personalized information to provide to the user.

[0772] Specifically, data is integrated using server-side languages ​​such as Python and Node.js to generate personalized information in JSON format.

[0773] Output: The generated personalized information.

[0774] {

[0775] "mapInfo": { ...},

[0776] "musicInfo": { ...},

[0777] "disasterInfo": { ...}

[0778] }

[0779] Step 10:

[0780] Input: Generated personalization information.

[0781] Operation: The server sends the generated personalized information to the device via an HTTP response or a push notification.

[0782] Specifically, it is returned as an HTTP response or sent using a push notification service.

[0783] Output: Personalized information sent to your device.

[0784] Step 11:

[0785] Input: Personalization information received by the device.

[0786] Operation: The terminal receives and analyzes the personalized information sent from the server.

[0787] Specifically, it parses HTTP responses and push notification data.

[0788] Output: Parsed personalization information.

[0789] Step 12:

[0790] Input: Parsed personalization information.

[0791] Operation: The device displays the received map information on the screen of the smartwatch or smartphone.

[0792] Specifically, the acquired map data is rendered using Google Maps SDK or similar.

[0793] Output: The displayed map information.

[0794] Step 13:

[0795] Input: Parsed personalization information.

[0796] Operation: The device plays the received music information through the earphones.

[0797] Specifically, the music is streamed using the acquired music URL.

[0798] Output: Played music.

[0799] Step 14:

[0800] Input: Parsed personalization information.

[0801] Operation: The device displays the received disaster prevention information using the smartwatch's notification function.

[0802] Specifically, we will utilize the function that displays notifications on smartwatches.

[0803] Output: Disaster prevention information notified.

[0804] (Application example 1)

[0805] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0806] Conventional personalized information provision systems have struggled to efficiently utilize a user's location information and heart rate information to provide optimal content to the user in real time. Furthermore, these systems rely on limited information sources, making it difficult to address diverse user needs. The present invention aims to solve these problems by providing a system that provides appropriate music, podcasts, disaster prevention information, and other content in real time based on a user's heart rate and location information.

[0807] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0808] In this invention, the server includes means for acquiring user location information, means for acquiring user heart rate information, means for acquiring map information around the current location from a map service based on the received location information, means for selecting appropriate music or podcasts from a content distribution service based on the received heart rate information, and means for acquiring the latest disaster prevention information corresponding to the area, thereby enabling the user to receive optimal music, podcasts, disaster prevention information, etc. in real time according to their current location and heart rate.

[0809] text

[0810] A "user" is an individual who uses the system and provides location information and heart rate information.

[0811] "Location information" is data that indicates the user's current geographical location.

[0812] "Heart rate information" is data indicating the user's heart rate, and represents the user's health condition and activity level.

[0813] The "server" is a system component that receives and analyzes location information and heart rate information, and generates and provides various personalized information.

[0814] A "map service" is an external service that provides geographical information and map data based on location information.

[0815] A "music streaming service" is a third-party service that provides music tracks in streaming or download format.

[0816] A "content distribution service" is an external service that provides multimedia content such as music and podcasts.

[0817] "Disaster prevention information" is data that provides information on local disaster risks and emergency response measures.

[0818] "Personalized information" is information generated specifically for a user by integrating acquired map information, music, podcasts, and disaster prevention information.

[0819] A "terminal" is a device that acquires the user's location information and heart rate information and transmits this information to a server.

[0820] A "satellite positioning system sensor" is a device that receives satellite signals and measures location information.

[0821] "Tempo-controlled music" refers to music that is selected based on heart rate and has a rhythm that is appropriate for the user's current activity level.

[0822] A "podcast" is audio content provided over the Internet and includes a variety of genres, including education, news, and entertainment.

[0823] text

[0824] The present invention is a system that provides personalized information in real time based on a user's location information and heart rate information. This system is composed of three elements: a user, a terminal, and a server.

[0825] 1. Users

[0826] A user is an individual who uses this system and provides location information and heart rate information. Specifically, the user wears a wearable device such as a smartwatch or fitness tracker, and acquires and transmits location information and heart rate information through the device.

[0827] 2. Terminal

[0828] The device is responsible for acquiring location information and heart rate information from the user and transmitting it to the server. Specific processing includes the following:

[0829] Location information acquisition: The device uses the built-in satellite positioning system sensor to acquire the user's current location.

[0830] Obtaining heart rate information: The device uses the built-in heart rate sensor to measure the user's heart rate.

[0831] Sending information: The acquired location information and heart rate information are sent to the server periodically.

[0832] 3. Server

[0833] The server receives and analyzes the information sent from the device and integrates various data to provide the user with the necessary information.

[0834] Receiving information: The server receives the location information and heart rate information sent from the device.

[0835] Obtaining map information: Calls the map service API based on the received location information and obtains map information around the current location.

[0836] Content selection: Based on the received heart rate information, the heart rate is analyzed and appropriate music or podcasts are retrieved from the content distribution service API. For example, if the heart rate is high, upbeat music is selected, and if it is low, a relaxing podcast is selected.

[0837] Obtaining disaster prevention information: Obtain the latest disaster prevention information for the area based on location information from the disaster prevention information service API.

[0838] Generation of personalized information: The acquired map information, music, podcasts, and disaster prevention information are integrated to generate personalized information to be provided to the user.

[0839] Sending information: Send the generated personalized information back to your device.

[0840] Specific examples

[0841] For example, if a user is running, the device will use a satellite positioning system sensor to obtain the user's location information and a heart rate sensor to measure the user's heart rate. Suppose the user's heart rate is 150 BPM. This information is sent to a server, which then calls a map service API to obtain map information for the current location. Based on the high heart rate, the server retrieves upbeat music from a content distribution service API. It also obtains the latest local disaster prevention information and combines this information to generate personalized information. Finally, this information is sent to the user's device, allowing the user to receive appropriate music and disaster prevention information in real time.

[0842] Prompt Sentence Examples

[0843] "If a user's heart rate is 150 BPM, can you recommend some upbeat music that's good for running? Also, give me the latest news in their area?"

[0844] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0845] text

[0846] Step 1:

[0847] Obtain the user's location information and heart rate information. The device uses the built-in satellite positioning system sensor to obtain the user's current location and the heart rate sensor to measure the heart rate. The input is the user's location information and heart rate information, and the output is a data packet sent to the server.

[0848] Step 2:

[0849] The server receives the location and heart rate information sent from the device. This is the initial stage of data processing and analysis. The input is the data packet sent from the device, and the output is processable data stored in the server.

[0850] Step 3:

[0851] The server calls the map service API based on the received location information and obtains map information for the area around the current location. The input is the location information and the output is the obtained map information. Specifically, the server sends an API request and receives map information as a response.

[0852] Step 4:

[0853] The server analyzes the received heart rate information and selects appropriate content (music or podcast). At this time, it calls the content distribution service API based on the heart rate to obtain the appropriate track. The input is the heart rate information, and the output is the selected music or podcast. Specifically, if the heart rate is high, it queries for up-tempo music, and if the heart rate is low, it queries for relaxation podcasts.

[0854] Step 5:

[0855] The server obtains the latest disaster prevention information for the region based on the location information from the disaster prevention information service API. The input is location information and the output is disaster prevention information. Specifically, the server sends an API request to obtain disaster prevention information for the region and receives the disaster prevention information as a response.

[0856] Step 6:

[0857] The server integrates the acquired map information, music, podcasts, and disaster prevention information to generate personalized information to provide to users. The input is the various acquired data, and the output is the integrated personalized information. Specifically, the server integrates each data to generate personalized information in JSON format.

[0858] Step 7:

[0859] The server transmits the generated personalized information to the terminal. The input is the generated personalized information, and the output is a data packet transmitted to the terminal. Specifically, the server transmits data to the terminal and provides the information to the user in real time.

[0860] Step 8:

[0861] The device receives personalized information sent from the server and notifies the user. The input is the data packet sent from the server, and the output is the presentation of information to the user. Specific operations include displaying a notification on the smartwatch display and playing music or podcasts through the earphones.

[0862] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0863] MODE FOR CARRYING OUT THE INVENTION

[0864] This invention is a system that provides personalized content in real time based on a user's location information, heart rate information, and emotional state. This system consists of three elements: a server, a terminal, and a user. It also includes an emotion engine for recognizing the user's emotions. Below, we will explain the role and specific functions of each element, as well as the operation of the entire system.

[0865] User

[0866] Users are individuals who use this system and provide location information, heart rate information, and emotional information. Users wear wearable devices (e.g., smart watches, earphones, audio glasses, etc.) through which they acquire, send, and receive information.

[0867] Terminal

[0868] The device acquires location information, heart rate information, and emotion information from the user and transmits it to the server. The main functions of the device are described in detail below.

[0869] 1. Location information acquisition:

[0870] The device uses the built-in GPS sensor to obtain the user's current location.

[0871] Location information is updated periodically (e.g., every 5 seconds).

[0872] 2. Obtaining heart rate information:

[0873] The device uses a built-in heart rate sensor to measure the user's heart rate.

[0874] Heart rate information is also updated periodically (e.g., every 5 seconds).

[0875] 3. Acquiring emotional information:

[0876] Using the camera and microphone installed on the device, the user's facial expressions and tone of voice are analyzed, and the emotion engine recognizes the user's emotions.

[0877] 4. Transmission of Information:

[0878] The periodically acquired location information, heart rate information, and emotion information are packaged into packets and sent to a server.

[0879] server

[0880] The server receives and analyzes the information sent from the terminal and integrates various data to provide the necessary information to the user. Below, we will explain in detail the main functions and processes performed by the server.

[0881] 1. Receiving Information:

[0882] The server receives the location information, heart rate information, and emotion information transmitted from the terminal.

[0883] 2. Getting map information:

[0884] The server calls the map service API based on the received location information and obtains map information for the area around the current location.

[0885] 3. Music Selection:

[0886] The server analyzes the received heart rate information and retrieves music corresponding to the user's heart rate from the music distribution service API.

[0887] For example, if your heart rate is high (e.g., 160 BPM), choose an up-tempo song.

[0888] Emotional information is also taken into consideration to select songs that suit the user's emotional state.

[0889] For example, if the emotional state is "relaxed," select relaxation music.

[0890] 4. Obtaining disaster prevention information:

[0891] Based on the location information, the server obtains the latest disaster prevention information corresponding to the region from the disaster prevention information service API.

[0892] 5. Generating personalized information:

[0893] The system integrates the acquired map information, selected music, disaster prevention information, and the user's emotional information to generate optimal personalized information.

[0894] 6. Sending Personalized Information:

[0895] The server transmits the generated personalized information to the terminal.

[0896] Specific examples

[0897] For users running

[0898] The user wears a smartwatch and earphones while running.

[0899] The device acquires the user's current location using a GPS sensor and measures their heart rate using a heart rate sensor. For example, suppose the heart rate is 160 BPM. The device's camera and microphone are used by the emotion engine to recognize the user's emotional state as "excited."

[0900] The terminal transmits this information to the server.

[0901] The server calls the map service API based on the location information and obtains map information within the park.

[0902] Next, since the heart rate is high, up-tempo music is retrieved from a music distribution service API. Also, since the emotional state is "excited," songs that will maintain tension are selected.

[0903] In addition, the disaster prevention information service API is called to check the necessary disaster prevention information.

[0904] Finally, this information is integrated to generate personalized information, including information about the user's current location, music selection, necessary disaster prevention information, and information based on their emotional state.

[0905] The server sends the generated personalized information to the user's device, which analyzes it, notifies the smartwatch, and plays music through the earphones.

[0906] The system allows users to receive appropriate music, map information, and disaster prevention information in real time while running, and can provide a more personalized experience by taking into account the user's emotional state.

[0907] The processing flow will be explained below.

[0908] Step 1:

[0909] A user puts on a wearable device and launches an application. The device activates the GPS sensor and heart rate sensor.

[0910] Step 2:

[0911] The device obtains the user's current location using the GPS sensor. This location information is updated periodically (e.g., every 5 seconds).

[0912] Step 3:

[0913] The device measures the user's heart rate using a heart rate sensor, and the heart rate information is updated periodically (e.g., every 5 seconds).

[0914] Step 4:

[0915] The device's built-in camera periodically captures the user's facial expressions, and the microphone collects the user's tone of voice, which is then used by the emotion engine to analyze the user's emotional state.

[0916] Step 5:

[0917] The terminal assembles the acquired location information, heart rate information, and emotion information into packets and transmits them to the server.

[0918] Step 6:

[0919] The server receives the location information, heart rate information, and emotion information transmitted from the terminal.

[0920] Step 7:

[0921] Based on the location information received by the server, the map service API is called to obtain map information around the current location.

[0922] Step 8:

[0923] The server analyzes the received heart rate information and retrieves music corresponding to the user's heart rate from the music distribution service API. For example, if the heart rate is 160 BPM, an up-tempo song will be selected.

[0924] Step 9:

[0925] The server uses an emotion engine to analyze the user's emotional state and selects appropriate music based on the results. For example, if the emotional state is "relaxed," it selects relaxation music.

[0926] Step 10:

[0927] Based on the location information, the server obtains the latest disaster prevention information corresponding to the region from the disaster prevention information service API.

[0928] Step 11:

[0929] The server integrates the acquired map information, selected music, disaster prevention information, and emotional information to generate optimal personalized information.

[0930] Step 12:

[0931] The server transmits the generated personalized information to the terminal.

[0932] Step 13:

[0933] The terminal analyzes the personalized information received from the server.

[0934] Step 14:

[0935] Based on the analyzed information, the device provides information to the user in an appropriate way. For example, selected music is played through earphones, and the smartwatch notifies the user of their current location, disaster prevention information, and emotional advice.

[0936] This detailed processing step allows users to efficiently receive the most appropriate information in real time. The system aims to improve the user experience by providing the most appropriate information tailored to the user's current situation and emotional state.

[0937] Example 2

[0938] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0939] Currently, there are systems that provide personalized information based on the user's location and heart rate information, but adding emotional information to these systems would enable more accurate personalization.However, such systems do not currently exist, and the provision of appropriate information according to the user's emotional state is insufficient, making it a challenge to improve user satisfaction.

[0940] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0941] In this invention, the server includes means for acquiring user location information, means for acquiring user heart rate information, means for acquiring user emotion information, means for transmitting the acquired location information, heart rate information, and emotion information to the server, means for receiving the transmitted location information, heart rate information, and emotion information, means for acquiring map information of the vicinity of the current location from a map service based on the received location information, means for selecting appropriate music from a music distribution service based on the received heart rate information and emotion information, means for acquiring the latest disaster prevention information corresponding to the area, means for integrating the acquired map information, music, disaster prevention information, and emotion information to generate personalized information to be provided to the user, means for transmitting the generated personalized information to the terminal, and terminal means. This enables the provision of highly accurate personalized information based on more multifaceted information including the user's emotional state.

[0942] "User location information" refers to coordinate information of the location where the user is currently located.

[0943] "User's heart rate information" refers to data obtained by measuring the user's heart rate.

[0944] "User emotional information" refers to data that expresses the user's emotional state, and is obtained by analyzing facial expressions, tone of voice, etc.

[0945] A "server" is a computer system that receives and analyzes data sent from a terminal, consolidates the necessary information, and sends it to the terminal.

[0946] "Terminal" refers to a device worn or used by a user that acquires location information, heart rate information, and emotional information and transmits it to a server.

[0947] A "GPS sensor" is a sensor that receives signals from satellites and determines the current location on Earth.

[0948] "Map Service" refers to a service that provides geographic information through a specific API.

[0949] "Music distribution service" refers to a service that provides music data through a specific API.

[0950] "Disaster prevention information" refers to information relating to emergencies such as natural disasters, and is provided according to the region.

[0951] "Personalized information" refers to information specific to a user that is generated by integrating the user's individual location information, heart rate information, emotional information, etc.

[0952] An "emotion engine" refers to software or hardware that analyzes a user's facial expressions and tone of voice to recognize their emotional state.

[0953] This invention is a system that provides personalized content in real time based on a user's location information, heart rate information, and emotional state. This system consists of three elements: a server, a terminal, and a user. It also includes an emotion engine for recognizing the user's emotions. Below, we will explain the role and specific functions of each element, as well as the operation of the entire system.

[0954] User

[0955] A user is an individual who uses this system and provides location information, heart rate information, and emotional information. The user wears a wearable device (e.g., a smartwatch, earphones, etc.) through which information is acquired, sent, and received. The user begins using this system by wearing the smartwatch on their wrist and the earphones in their ears.

[0956] Terminal

[0957] The device acquires location information, heart rate information, and emotion information from the user and transmits it to the server. The main functions of the device are described in detail below.

[0958] 1. Location information acquisition:

[0959] The device uses the built-in GPS sensor to obtain the user's current location, which is updated periodically (e.g., every 5 seconds).

[0960] 2. Obtaining heart rate information:

[0961] The device uses a built-in heart rate sensor to measure the user's heart rate, and the heart rate information is updated periodically (e.g., every 5 seconds).

[0962] 3. Acquiring emotional information:

[0963] Using the camera and microphone installed on the device, the user's facial expressions and tone of voice are analyzed, and the emotion engine recognizes the user's emotions.

[0964] 4. Transmission of Information:

[0965] The periodically acquired location information, heart rate information, and emotion information are packaged into packets and sent to a server.

[0966] server

[0967] The server receives and analyzes the information sent from the terminal and integrates various data to provide the necessary information to the user. Below, we will explain in detail the main functions and processes performed by the server.

[0968] 1. Receiving Information:

[0969] The server receives the location information, heart rate information, and emotion information transmitted from the terminal.

[0970] 2. Getting map information:

[0971] The server calls the map service API based on the received location information and obtains map information for the area around the current location.

[0972] 3. Music Selection:

[0973] The server analyzes the received heart rate information and retrieves music from the music distribution service API that corresponds to the user's heart rate and emotional state.

[0974] For example, if your heart rate is high (e.g., 160 BPM), choose an up-tempo song. If your emotional state is "excited," choose an energetic song.

[0975] 4. Obtaining disaster prevention information:

[0976] Based on the location information, the server obtains the latest disaster prevention information corresponding to the region from the disaster prevention information service API.

[0977] 5. Generating personalized information:

[0978] The system integrates the acquired map information, selected music, disaster prevention information, and the user's emotional information to generate optimal personalized information.

[0979] 6. Sending Personalized Information:

[0980] The server transmits the generated personalized information to the terminal.

[0981] Specific examples

[0982] For users running

[0983] Suppose a user is wearing a smartwatch and earphones while running. The smartwatch periodically obtains the user's current location using a GPS sensor and measures their heart rate using a heart rate sensor. For example, if the user's heart rate is 160 BPM, the device sends this information to the server. At the same time, the emotion engine uses the device's built-in camera and microphone to recognize the user's emotional state as "excited."

[0984] The server first calls a map service API based on the location information to obtain map information for the park where the user is running. Next, because the heart rate is high, it retrieves up-tempo music from a music distribution service API, and because the emotional state is "excited," it selects energetic music. It also calls a disaster prevention information service API to check disaster prevention information related to the user's current location.

[0985] The server combines this data (map information, music information, disaster prevention information) to generate personalized information optimal for the user and transmits it to the device. The device then plays the delivered music through earphones and displays the necessary information on the smartwatch screen.

[0986] Prompt Sentence Examples

[0987] "Please explain the specific steps of a system that provides real-time personalized music and map information when a user's heart rate is high and their emotional state is 'excited' while running."

[0988] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0989] Step 1: The user puts on the wearable device

[0990] The user puts on a smartwatch, earphones, or other wearable device, which then prepares the device to acquire the user's location, heart rate, and emotional information. The input for this step is the user, and the output is the wearable device.

[0991] Step 2: The device acquires location information

[0992] The device uses the built-in GPS sensor to obtain the user's current location. For example, if the user is in a park, the device obtains the location coordinates. The input is the signal from the GPS sensor, and the output is the location coordinate data (e.g., latitude 35.6895 degrees, longitude 139.6917 degrees). The location information is updated periodically (e.g., every 5 seconds).

[0993] Step 3: Your device acquires heart rate information

[0994] The device measures the user's heart rate using a built-in heart rate sensor. For example, the heart rate is measured at 160 BPM. The input is data from the heart rate sensor, and the output is heart rate data. The heart rate information is also updated periodically (for example, every 5 seconds).

[0995] Step 4: The device acquires emotion information

[0996] The device uses a camera and microphone to analyze the user's facial expressions and tone of voice. The emotion engine processes the results of this analysis and recognizes the user's emotional state as "excitement." The input is sensor data from the camera and microphone, and the output is emotional information.

[0997] Step 5: The device sends the information to the server

[0998] The device collects location information, heart rate information, and emotion information and compiles them into packets, which are then sent to the server. The input is location information, heart rate information, and emotion information, and the output is the data sent to the server. The transmission is performed periodically.

[0999] Step 6: The server receives the information

[1000] The server receives location information, heart rate information, and emotion information sent from the device. The input is the data sent from the device, and the output is the data stored on the server.

[1001] Step 7: The server retrieves the map information

[1002] The server calls the map service API based on the received location information to obtain map information around the current location. The input is location data, and the output is map information data (e.g., obtain geographic information using the Google Maps API).

[1003] Step 8: The server selects the music

[1004] The server analyzes the received heart rate and emotional information and retrieves music from a music distribution service API that corresponds to the user's heart rate and emotional state. For example, if a user's heart rate is 160 BPM and they are in an "excited" state, it selects an up-tempo, energetic song. The input is heart rate and emotional information data, and the output is the selected music data (e.g., retrieving songs using the Spotify API).

[1005] Step 9: The server acquires disaster prevention information

[1006] The server retrieves the latest disaster prevention information for the region from the disaster prevention information service API based on the location information. The input is location information data, and the output is disaster prevention information data (e.g., using the disaster prevention information service API to retrieve the latest information for the region).

[1007] Step 10: Server generates personalized information

[1008] The server integrates the acquired map information, selected music, disaster prevention information, and emotional information to generate optimal personalized information. The input is map information, music data, disaster prevention information, and emotional information, and the output is the integrated personalized information.

[1009] Step 11: The server sends the personalized information to the device.

[1010] The server sends the generated personalized information to the terminal. The input is the personalized information data, and the output is the data sent to the terminal.

[1011] Step 12: The device analyzes the information and notifies the user.

[1012] The device analyzes the received personalized information and notifies the user of appropriate information. Specifically, map information and disaster prevention information are displayed on the smartwatch's notification screen, and selected music is played through the earphones. The input is personalized information data, and the output is the form of information provided to the user (screen display and music playback).

[1013] (Application example 2)

[1014] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1015] In modern society, the proliferation of information and the diversification of individual user needs have led to a growing need for personalized content tailored to users' real-time situations. Real-time information delivery systems based on biometric data, such as location information and heart rate, can contribute to improving user experience. However, current systems are unable to effectively integrate these data and provide personalized content that also responds to the user's emotional state. Therefore, there is a need for a system that can provide personalized information in real time based on the user's location information, heart rate information, and emotional state.

[1016] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring user location information, means for acquiring user heart rate information, means for acquiring the user's emotional state, means for transmitting the received location information, heart rate information, and emotional information to the server, means for acquiring map information near the current location from a map service based on the received location information, means for selecting appropriate music from a music distribution service based on the received heart rate information, means for generating personalized content based on the emotional state, means for acquiring the latest disaster prevention information corresponding to the region, means for generating personalized information to provide to the user by integrating the acquired map information, music, disaster prevention information, and emotional information, means for transmitting the generated personalized information to the terminal, and terminal means. This makes it possible to provide personalized information that integrates appropriate map information, music, and disaster prevention information in real time based on the user's real-time biometric data and emotional state.

[1017] "Location information" is geographical coordinate information that indicates the user's current location.

[1018] "Heartbeat information" is biological data such as heart rate and heartbeat rhythm obtained from the user's heartbeat.

[1019] "Emotional state" is information indicating the user's emotions, and refers to psychological states such as stress, relaxation, and excitement.

[1020] "Personalized information" refers to content and service information that is individually customized based on the user's location information, heart rate information, and emotional state.

[1021] "Map information" is data that indicates the topography, roads, facilities, etc. within a geographical space.

[1022] A "music distribution service" is a service that distributes music over the Internet.

[1023] "Disaster prevention information" refers to the latest information on disasters such as earthquakes, fires, and typhoons.

[1024] "Server" means a central processing unit that receives, analyzes, and processes information sent by users.

[1025] A "terminal" is a device that a user carries or wears, including a smartphone or smartwatch.

[1026] This invention is a system that acquires a user's location information, heart rate information, and emotional state in real time and provides personalized content. This system is mainly composed of three elements: a server, a terminal, and a user. Below, we will explain in detail the operation of each element and the entire system.

[1027] User

[1028] The user is a person who uses this system and provides location information, heart rate information, and emotional information. The user wears a wearable device such as a smartwatch, earphones, or smart glasses, and the information is collected and sent to the server.

[1029] Terminal

[1030] The terminal acquires information from the user and transmits it to the server. Its main functions are as follows:

[1031] 1. Location information acquisition:

[1032] The device uses the built-in GPS sensor to obtain the user's current location, which is updated periodically.

[1033] 2. Obtaining heart rate information:

[1034] The device uses a built-in heart rate sensor to measure the user's heart rate, and this information is also updated periodically.

[1035] 3. Acquiring emotional information:

[1036] Using the camera and microphone installed on the device, the emotion engine analyzes the user's facial expressions and tone of voice to recognize the user's emotions.

[1037] 4. Transmission of Information:

[1038] The processed data is sent to the server.

[1039] server

[1040] The server receives the information sent from the terminal and analyzes and processes it. The main processes are as follows:

[1041] 1. Receiving Information:

[1042] The location information, heart rate information, and emotion information transmitted from the terminal are received.

[1043] 2. Getting map information:

[1044] Based on the received location information, the map service API is called to obtain map information around the current location.

[1045] 3. Music Selection:

[1046] Based on heart rate information, the system selects appropriate music from a music streaming service API. For example, if the heart rate is high, it selects up-tempo music. It also takes into account emotional information to select music that matches the user's emotional state.

[1047] 4. Emotion-based content generation:

[1048] Based on emotional information, it generates content such as videos and podcasts that are optimal for the user's emotional state.

[1049] 5. Obtaining disaster prevention information:

[1050] The latest disaster prevention information is obtained from the disaster prevention information service API based on location information.

[1051] 6. Generating personalized information:

[1052] The acquired map information, selected music, disaster prevention information, and emotional information are integrated to generate personalized information to be provided to the user.

[1053] 7. Transmission of Information:

[1054] The final generated personalized information is transmitted to the terminal.

[1055] Specific examples

[1056] For users running

[1057] The user wears a smartwatch and earphones while running. The device acquires the user's current location information obtained by the GPS sensor and the heart rate measured by the heart rate sensor (e.g., 160 BPM). The emotion engine also recognizes the user's emotional state as "excitement." This information is periodically sent to the server.

[1058] The server calls a map service API based on the received location information to obtain map information for the park. Next, because the heart rate information is high, it retrieves up-tempo songs from a music distribution service API and selects music suitable for maintaining excitement based on the emotional state. It also calls a disaster prevention information service API to check necessary disaster prevention information.

[1059] This information is then integrated to generate personalized information, which is then sent back to the user's device. The user can then check this information on their smartwatch, and the selected music will play from the earphones.

[1060] Example prompt for a generative AI model:

[1061] "A user is feeling stressed while walking through a city. Their heart rate is 120 BPM. What content would you recommend?"

[1062] This system allows users to enjoy content that is best suited to their situation in real time.

[1063] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1064] Step 1:

[1065] Users acquire information by wearing a wearable device

[1066] Specific behavior:

[1067] Users wear wearable devices such as smartwatches, earphones, and smart glasses. The user's current location is acquired using a GPS sensor, and heart rate information is measured using a heart rate sensor. In addition, the device's built-in camera and microphone are used to analyze the user's facial expressions and tone of voice to obtain emotional information.

[1068] input:

[1069] User location information, heart rate information, emotional state

[1070] output:

[1071] Acquired location information, heart rate information, and emotional information

[1072] Step 2:

[1073] The device sends the acquired information to the server.

[1074] Specific behavior:

[1075] The device periodically collects location information, heart rate information, and emotion information, and then compiles them into packets and sends them to a server via the Internet.

[1076] input:

[1077] Acquired location information, heart rate information, and emotional information

[1078] output:

[1079] Location information, heart rate information, and emotional information sent to the server

[1080] Step 3:

[1081] The server analyzes the information it receives

[1082] Specific behavior:

[1083] The server receives location information, heart rate information, and emotion information sent from the device, analyzes the received data, and identifies and organizes each piece of information.

[1084] input:

[1085] Transmitted location information, heart rate information, and emotional information

[1086] output:

[1087] Organized location, heart rate, and emotional information

[1088] Step 4:

[1089] The server obtains map information

[1090] Specific behavior:

[1091] The server then calls the map service API based on the received location information to obtain map information for the area around the user's current location. The obtained map information provides detailed geographic data about the user's current location.

[1092] input:

[1093] Organized location information

[1094] output:

[1095] Obtained map information

[1096] Step 5:

[1097] The server selects the music

[1098] Specific behavior:

[1099] The server analyzes the received heart rate information, retrieves music corresponding to the user's heart rate from a music distribution service API, and selects music appropriate for the user's emotional state, taking into account the emotional information.

[1100] input:

[1101] Organized heart rate and emotional information

[1102] output:

[1103] Selected music

[1104] Step 6:

[1105] The server acquires disaster prevention information

[1106] Specific behavior:

[1107] The server retrieves the latest disaster prevention information for the area based on the location information from the disaster prevention information service API, which provides information such as disaster risks near the user's current location.

[1108] input:

[1109] Organized location information

[1110] output:

[1111] Acquired disaster prevention information

[1112] Step 7:

[1113] The server generates the personalized information.

[1114] Specific behavior:

[1115] The server integrates the acquired map information, selected music, disaster prevention information, and emotion information to generate personalized information to be provided to the user.

[1116] input:

[1117] Map information, selected music, disaster prevention information, emotional information

[1118] output:

[1119] Generated personalized information

[1120] Step 8:

[1121] The server sends the generated personalized information to the device.

[1122] Specific behavior:

[1123] The server transmits the generated personalized information to the terminal, where it is analyzed and appropriately notified or played back.

[1124] input:

[1125] Generated personalized information

[1126] output:

[1127] Personalized information sent by the server

[1128] Step 9:

[1129] The device provides personalized information to the user

[1130] Specific behavior:

[1131] The device analyzes the received personalized information and provides it to the user via the smartwatch or earphones, such as displaying a notification on the smartwatch and playing selected music through the earphones.

[1132] input:

[1133] Personalized Information Received

[1134] output:

[1135] Personalized information provided to users

[1136] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1137] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1138] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1139] [Third embodiment]

[1140] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1141] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1142] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1143] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1144] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1145] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1146] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1147] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1148] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1149] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1150] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1151] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1152] MODE FOR CARRYING OUT THE INVENTION

[1153] The present invention is a system that provides personalized information in real time based on a user's location information and heart rate information. This system basically consists of three elements: a server, a terminal, and a user. The roles and specific functions of each element are explained below.

[1154] User

[1155] Users are individuals who use this system and provide location and heart rate information. Users wear wearable devices (e.g., smart watches, earphones, audio glasses, etc.) through which they acquire, send, and receive information.

[1156] Terminal

[1157] The device acquires location information and heart rate information from the user and transmits it to the server. The main processes performed by the device are described below.

[1158] 1. Location information acquisition:

[1159] The device uses the built-in GPS sensor to obtain the user's current location.

[1160] The acquired location information is updated periodically.

[1161] 2. Obtaining heart rate information:

[1162] The device uses a built-in heart rate sensor to measure the user's heart rate.

[1163] The measured heart rate information is also updated periodically.

[1164] 3. Transmission of Information:

[1165] The periodically acquired location information and heart rate information are packaged into packets and sent to the server.

[1166] server

[1167] The server receives and analyzes the information sent from the terminal and integrates various data to provide the necessary information to the user. The main processes performed by the server are described below.

[1168] 1. Receiving Information:

[1169] The server receives the location information and heart rate information transmitted from the terminal.

[1170] 2. Getting map information:

[1171] The server calls the map service API based on the received location information and obtains map information for the area around the current location.

[1172] 3. Music Selection:

[1173] The server analyzes the heart rate based on the received heart rate information and retrieves appropriate music from the music distribution service API.

[1174] For example, if your heart rate is high, choose upbeat music, and if your heart rate is low, choose relaxation music.

[1175] 4. Obtaining disaster prevention information:

[1176] The server obtains disaster prevention information corresponding to the region based on the location information from the disaster prevention information service API.

[1177] 5. Generating personalized information:

[1178] The acquired map information, music, disaster prevention information, and other personalized information (e.g., store coupons) are integrated as needed to generate optimal personalized information.

[1179] 6. Sending Personalized Information:

[1180] The server transmits the generated personalized information to the terminal again.

[1181] Specific examples

[1182] For users running

[1183] The user wears the smartwatch while running.

[1184] The device acquires the user's current location using a GPS sensor and measures the user's heart rate using a heart rate sensor. For example, suppose the heart rate is 160 BPM.

[1185] The terminal transmits the acquired location information and heart rate information to the server.

[1186] The server calls the map service API based on the location information and obtains map information within the park.

[1187] Next, since the heart rate is high, up-tempo music is retrieved from the music distribution service API. In addition, a disaster prevention information service API is called to check the necessary disaster prevention information.

[1188] Finally, this information is integrated to generate personalized information, including information about the user's current location, selected music, necessary disaster prevention information, etc.

[1189] The server sends the generated personalized information to the user's device, which analyzes it and sends notifications to the smartwatch or plays music through earphones.

[1190] This system allows users to listen to appropriate music in real time while running, while also receiving necessary map and disaster prevention information, making everyday activities safer and more comfortable.

[1191] The processing flow will be explained below.

[1192] Step 1:

[1193] The user puts on the wearable device and starts the system. The device completes the initial setup and activates the GPS sensor and heart rate sensor.

[1194] Step 2:

[1195] The device uses the GPS sensor to obtain the user's current location. This location information is obtained periodically (e.g., every 5 seconds).

[1196] Step 3:

[1197] The device uses a heart rate sensor to measure the user's heart rate, and heart rate information is also collected periodically (e.g., every 5 seconds).

[1198] Step 4:

[1199] The terminal assembles the acquired location information and heart rate information into a packet and transmits it to the server.

[1200] Step 5:

[1201] The server receives the location information and heart rate information transmitted from the terminal.

[1202] Step 6:

[1203] Based on the location information received by the server, the map service API is called to obtain map information around the current location.

[1204] Step 7:

[1205] The server analyzes the received heart rate information and calls the music distribution service API to select music according to the user's heart rate.

[1206] For example: If your heart rate is high (e.g., 160 BPM), choose an up-tempo song.

[1207] Step 8:

[1208] Based on the location information, the server obtains the latest disaster prevention information corresponding to the region from the disaster prevention information service API.

[1209] Step 9:

[1210] The server integrates map information, selected music, and disaster prevention information to generate optimal personalized information.

[1211] Step 10:

[1212] The server transmits the generated personalized information to the terminal.

[1213] Step 11:

[1214] The terminal analyzes the personalized information received from the server.

[1215] Step 12:

[1216] Based on the analyzed information, the device provides information to the user in an appropriate manner.

[1217] Example: Play selected music through earphones and notify the smartwatch of current location and disaster prevention information.

[1218] This process flow allows users to receive the information they need in real time. The system aims to improve the user experience by providing the most appropriate information tailored to the user's current situation.

[1219] Example 1

[1220] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1221] Conventional personalized information provision systems have not been able to fully utilize the user's location information and heart rate information, making it difficult to provide personalized information in real time. In addition, since music selection and disaster prevention information provision are not centralized, users are unable to receive the information they need in a timely manner, resulting in issues of low safety and convenience.

[1222] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1223] In this invention, the server includes means for acquiring user location information, means for acquiring user heart rate information, means for transmitting the acquired location information and heart rate information to a central processing unit, means for receiving the transmitted location information and heart rate information, means for acquiring map information of the vicinity of the current location from a map information providing service based on the received location information, means for selecting appropriate music from a music distribution service based on the received heart rate information, means for acquiring the latest disaster prevention information corresponding to the area, means for integrating the acquired map information, music, and disaster prevention information to generate personalized information to be provided to the user, means for transmitting the generated personalized information to the terminal, and means for notifying the user of the personalized information received by the terminal. This makes it possible to utilize the user's location information and heart rate information in real time, centrally manage necessary map information, music, and disaster prevention information, and immediately provide them to the user.

[1224] A "user" is an individual who uses the system and provides location and heart rate information.

[1225] "Location information" is data indicating the user's current geographical latitude and longitude.

[1226] "Heart rate information" is data indicating the user's current heart rate.

[1227] The "central processing unit" is a device that has the function of receiving and processing the location information and heart rate information transmitted from the terminal.

[1228] A "terminal" is a device worn by a user that has the function of acquiring location information and heart rate information and transmitting this information to a central processing unit.

[1229] A "map information service" is an online service that provides map information around the current location based on location information.

[1230] A "music distribution service" is an online service that selects and provides appropriate music based on heart rate information.

[1231] "Disaster prevention information" refers to information including the latest disaster information and evacuation advisories for a specific area.

[1232] "Personalized information" is individually tailored information that is generated to provide to a user by integrating acquired map information, music, and disaster prevention information.

[1233] "Notification" is the act of presenting information to a user through a terminal.

[1234] The present invention is a system that provides personalized information in real time based on a user's location information and heart rate information. This system basically consists of three elements: a server, a terminal, and a user. The roles and specific functions of each element are explained below.

[1235] User

[1236] Users are individuals who use this system and provide location and heart rate information. Users wear wearable devices (e.g., smart watches, earphones, audio glasses, etc.) through which they acquire, send, and receive information.

[1237] Terminal

[1238] The device acquires location information and heart rate information from the user and transmits it to the server. Specifically, it performs the following processes.

[1239] 1. Obtaining location information

[1240] The device uses the built-in GPS sensor to obtain the user's current location, which allows for detailed and accurate location information.

[1241] The device periodically updates this location information to keep it up to date.

[1242] 2. Obtaining heart rate information

[1243] The device measures the user's heart rate using a built-in heart rate sensor, which is often an optical sensor or an electrocardiogram sensor.

[1244] The device will periodically update your heart rate information to keep your health information up to date.

[1245] 3. Transmission of Information

[1246] The acquired location information and heart rate information are packaged into packets and sent to the server using HTTP POST requests or WebSocket communication.

[1247] server

[1248] The server receives the information sent from the device, performs the necessary data analysis, and generates personalized information based on the acquired data. The main processes performed by the server are described below.

[1249] 1. Receipt of information

[1250] The server receives the location information and heart rate information sent from the device using an HTTP server or WebSocket server.

[1251] 2. Obtaining map information

[1252] The server then calls a map information service API based on the received location information to obtain map information for the area around the current location. Typically, Google Maps API is used.

[1253] 3. Music selection

[1254] The server analyzes the heart rate based on the received heart rate information and retrieves appropriate music from a music streaming service API. If the heart rate is high, an up-tempo song is selected, and if it is low, a relaxing song is selected. Spotify API and Apple Music API are commonly used.

[1255] 4. Obtaining disaster prevention information

[1256] Based on the received location information, the server obtains disaster prevention information for that area from a disaster prevention information service API, such as the Japan Meteorological Agency API.

[1257] 5. Generating personalized information

[1258] The server integrates the acquired map information, music, disaster prevention information, etc. to generate personalized information to provide to users. This process is implemented using server-side languages ​​such as Python and Node.js.

[1259] 6. Sending personalized information

[1260] The server transmits the generated personalized information to the terminal again.

[1261] Specific examples

[1262] For users running

[1263] The user wears the smartwatch while running.

[1264] The device acquires the user's current location using a GPS sensor, records it as latitude 35.658581 and longitude 139.745433, and measures the heart rate as 160 BPM using a heart rate sensor.

[1265] The terminal transmits the acquired location information and heart rate information to the server.

[1266] The server calls the map information service API based on the location information and obtains map information within the park.

[1267] The server retrieves up-tempo songs from the music distribution service API because the heart rate is 160 BPM. It also calls the disaster prevention information service API to retrieve disaster prevention information around the park.

[1268] The server integrates this information to generate personalized information, including park maps, music selections, and disaster prevention information.

[1269] The server sends the generated personalized information to the device, which receives it and displays map information on the smartwatch, plays music through earphones, and notifies users of disaster prevention information.

[1270] Prompt Sentence Examples

[1271] Specific examples of prompts are as follows:

[1272] "You are currently in a park. Your heart rate is 160 BPM. Please play some upbeat music and get information about nearby disasters."

[1273] This system allows users to listen to appropriate music in real time while running, while also receiving necessary map and disaster prevention information, making everyday activities safer and more comfortable.

[1274] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1275] Step 1:

[1276] Input: A wearable device worn by the user.

[1277] Action: A user puts on a wearable device such as a smartwatch or earphones.

[1278] Output: None.

[1279] Step 2:

[1280] Input: The worn wearable device.

[1281] Operation: The device periodically obtains the user's current location (latitude and longitude) using the built-in GPS sensor.

[1282] Specifically, the navigator.geolocation.getCurrentPosition method is called to obtain location information.

[1283] Output: The location information obtained (e.g., latitude 35.658581, longitude 139.745433).

[1284] Step 3:

[1285] Input: The worn wearable device.

[1286] How it works: The device periodically measures the user's heart rate using the built-in heart rate sensor.

[1287] Specifically, the smartwatch collects data from the heart rate sensor and calculates the heart rate.

[1288] Output: Acquired heart rate information (e.g. 160 BPM).

[1289] Step 4:

[1290] Input: Acquired location and heart rate information.

[1291] Operation: The device collects location and heart rate information and sends it to the server using an HTTP POST request.

[1292] Specifically, data is constructed in JSON format and sent to the " / data" endpoint via an HTTP POST request.

[1293] Output: Location and heart rate information sent to the server.

[1294] POST / data HTTP / 1.1

[1295] Host: example.com

[1296] Content-Type: application / json

[1297] {

[1298] "location": {"latitude": 35.658581, "longitude": 139.745433},

[1299] "heartRate": 160

[1300] }

[1301] Step 5:

[1302] Input: Location and heart rate information received by the server.

[1303] Operation: The server receives the location information and heart rate information sent from the device and performs data analysis.

[1304] Specifically, the server endpoint / data receives the request and parses the JSON-formatted data.

[1305] Output: Analyzed location and heart rate information.

[1306] Step 6:

[1307] Input: Parsed location information.

[1308] Operation: The server calls the map information service API based on the analyzed location information and obtains map information for the area around the current location.

[1309] Specifically, send the following API request:

[1310] GET https: / / maps.googleapis.com / maps / api / geocode / json?latlng=35.658581,139.745433&key=YOUR_API_KEY

[1311] Output: The retrieved map information.

[1312] Step 7:

[1313] Input: Parsed heart rate information.

[1314] Operation: The server calls the music distribution service API based on the analyzed heart rate information and obtains the appropriate music.

[1315] If your heart rate is high, choose up-tempo music, and if it's low, choose relaxation music.

[1316] Specifically, send the following API request:

[1317] GET https: / / api.spotify.com / v1 / recommendations?seed_genres=upbeat&target_tempo=160&key=YOUR_API_KEY

[1318] Output: The retrieved music information.

[1319] Step 8:

[1320] Input: Parsed location information.

[1321] Operation: The server calls the disaster prevention information service API based on the analyzed location information and obtains the latest disaster prevention information for the area.

[1322] Specifically, send the following API request:

[1323] GET https: / / www.jma.go.jp / bosai / forecast / data / overview_forecast / 130000.json

[1324] Output: Obtained disaster prevention information.

[1325] Step 9:

[1326] Input: Obtained map information, music information, and disaster prevention information.

[1327] Operation: The server aggregates these and generates personalized information to provide to the user.

[1328] Specifically, data is integrated using server-side languages ​​such as Python and Node.js to generate personalized information in JSON format.

[1329] Output: The generated personalized information.

[1330] {

[1331] "mapInfo": { ...},

[1332] "musicInfo": { ...},

[1333] "disasterInfo": { ...}

[1334] }

[1335] Step 10:

[1336] Input: Generated personalization information.

[1337] Operation: The server sends the generated personalized information to the device via an HTTP response or a push notification.

[1338] Specifically, it is returned as an HTTP response or sent using a push notification service.

[1339] Output: Personalized information sent to your device.

[1340] Step 11:

[1341] Input: Personalization information received by the device.

[1342] Operation: The terminal receives and analyzes the personalized information sent from the server.

[1343] Specifically, it parses HTTP responses and push notification data.

[1344] Output: Parsed personalization information.

[1345] Step 12:

[1346] Input: Parsed personalization information.

[1347] Operation: The device displays the received map information on the screen of the smartwatch or smartphone.

[1348] Specifically, the acquired map data is rendered using Google Maps SDK or similar.

[1349] Output: The displayed map information.

[1350] Step 13:

[1351] Input: Parsed personalization information.

[1352] Operation: The device plays the received music information through the earphones.

[1353] Specifically, the music is streamed using the acquired music URL.

[1354] Output: Played music.

[1355] Step 14:

[1356] Input: Parsed personalization information.

[1357] Operation: The device displays the received disaster prevention information using the smartwatch's notification function.

[1358] Specifically, we will utilize the function that displays notifications on smartwatches.

[1359] Output: Disaster prevention information notified.

[1360] (Application example 1)

[1361] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1362] Conventional personalized information provision systems have struggled to efficiently utilize a user's location information and heart rate information to provide optimal content to the user in real time. Furthermore, these systems rely on limited information sources, making it difficult to address diverse user needs. The present invention aims to solve these problems by providing a system that provides appropriate music, podcasts, disaster prevention information, and other content in real time based on a user's heart rate and location information.

[1363] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1364] In this invention, the server includes means for acquiring user location information, means for acquiring user heart rate information, means for acquiring map information around the current location from a map service based on the received location information, means for selecting appropriate music or podcasts from a content distribution service based on the received heart rate information, and means for acquiring the latest disaster prevention information corresponding to the area, thereby enabling the user to receive optimal music, podcasts, disaster prevention information, etc. in real time according to their current location and heart rate.

[1365] text

[1366] A "user" is an individual who uses the system and provides location information and heart rate information.

[1367] "Location information" is data that indicates the user's current geographical location.

[1368] "Heart rate information" is data indicating the user's heart rate, and represents the user's health condition and activity level.

[1369] The "server" is a system component that receives and analyzes location information and heart rate information, and generates and provides various personalized information.

[1370] A "map service" is an external service that provides geographical information and map data based on location information.

[1371] A "music streaming service" is a third-party service that provides music tracks in streaming or download format.

[1372] A "content distribution service" is an external service that provides multimedia content such as music and podcasts.

[1373] "Disaster prevention information" is data that provides information on local disaster risks and emergency response measures.

[1374] "Personalized information" is information generated specifically for a user by integrating acquired map information, music, podcasts, and disaster prevention information.

[1375] A "terminal" is a device that acquires the user's location information and heart rate information and transmits this information to a server.

[1376] A "satellite positioning system sensor" is a device that receives satellite signals and measures location information.

[1377] "Tempo-controlled music" refers to music that is selected based on heart rate and has a rhythm that is appropriate for the user's current activity level.

[1378] A "podcast" is audio content provided over the Internet and includes a variety of genres, including education, news, and entertainment.

[1379] text

[1380] The present invention is a system that provides personalized information in real time based on a user's location information and heart rate information. This system is composed of three elements: a user, a terminal, and a server.

[1381] 1. Users

[1382] A user is an individual who uses this system and provides location information and heart rate information. Specifically, the user wears a wearable device such as a smartwatch or fitness tracker, and acquires and transmits location information and heart rate information through the device.

[1383] 2. Terminal

[1384] The device is responsible for acquiring location information and heart rate information from the user and transmitting it to the server. Specific processing includes the following:

[1385] Location information acquisition: The device uses the built-in satellite positioning system sensor to acquire the user's current location.

[1386] Obtaining heart rate information: The device uses the built-in heart rate sensor to measure the user's heart rate.

[1387] Sending information: The acquired location information and heart rate information are sent to the server periodically.

[1388] 3. Server

[1389] The server receives and analyzes the information sent from the device and integrates various data to provide the user with the necessary information.

[1390] Receiving information: The server receives the location information and heart rate information sent from the device.

[1391] Obtaining map information: Calls the map service API based on the received location information and obtains map information around the current location.

[1392] Content selection: Based on the received heart rate information, the heart rate is analyzed and appropriate music or podcasts are retrieved from the content distribution service API. For example, if the heart rate is high, upbeat music is selected, and if it is low, a relaxing podcast is selected.

[1393] Obtaining disaster prevention information: Obtain the latest disaster prevention information for the area based on location information from the disaster prevention information service API.

[1394] Generation of personalized information: The acquired map information, music, podcasts, and disaster prevention information are integrated to generate personalized information to be provided to the user.

[1395] Sending information: Send the generated personalized information back to your device.

[1396] Specific examples

[1397] For example, if a user is running, the device will use a satellite positioning system sensor to obtain the user's location information and a heart rate sensor to measure the user's heart rate. Suppose the user's heart rate is 150 BPM. This information is sent to a server, which then calls a map service API to obtain map information for the current location. Based on the high heart rate, the server retrieves upbeat music from a content distribution service API. It also obtains the latest local disaster prevention information and combines this information to generate personalized information. Finally, this information is sent to the user's device, allowing the user to receive appropriate music and disaster prevention information in real time.

[1398] Prompt Sentence Examples

[1399] "If a user's heart rate is 150 BPM, can you recommend some upbeat music that's good for running? Also, give me the latest news in their area?"

[1400] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1401] text

[1402] Step 1:

[1403] Obtain the user's location information and heart rate information. The device uses the built-in satellite positioning system sensor to obtain the user's current location and the heart rate sensor to measure the heart rate. The input is the user's location information and heart rate information, and the output is a data packet sent to the server.

[1404] Step 2:

[1405] The server receives the location and heart rate information sent from the device. This is the initial stage of data processing and analysis. The input is the data packet sent from the device, and the output is processable data stored in the server.

[1406] Step 3:

[1407] The server calls the map service API based on the received location information and obtains map information for the area around the current location. The input is the location information and the output is the obtained map information. Specifically, the server sends an API request and receives map information as a response.

[1408] Step 4:

[1409] The server analyzes the received heart rate information and selects appropriate content (music or podcast). At this time, it calls the content distribution service API based on the heart rate to obtain the appropriate track. The input is the heart rate information, and the output is the selected music or podcast. Specifically, if the heart rate is high, it queries for up-tempo music, and if the heart rate is low, it queries for relaxation podcasts.

[1410] Step 5:

[1411] The server obtains the latest disaster prevention information for the region based on the location information from the disaster prevention information service API. The input is location information and the output is disaster prevention information. Specifically, the server sends an API request to obtain disaster prevention information for the region and receives the disaster prevention information as a response.

[1412] Step 6:

[1413] The server integrates the acquired map information, music, podcasts, and disaster prevention information to generate personalized information to provide to users. The input is the various acquired data, and the output is the integrated personalized information. Specifically, the server integrates each data to generate personalized information in JSON format.

[1414] Step 7:

[1415] The server transmits the generated personalized information to the terminal. The input is the generated personalized information, and the output is a data packet transmitted to the terminal. Specifically, the server transmits data to the terminal and provides the information to the user in real time.

[1416] Step 8:

[1417] The device receives personalized information sent from the server and notifies the user. The input is the data packet sent from the server, and the output is the presentation of information to the user. Specific operations include displaying a notification on the smartwatch display and playing music or podcasts through the earphones.

[1418] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1419] MODE FOR CARRYING OUT THE INVENTION

[1420] This invention is a system that provides personalized content in real time based on a user's location information, heart rate information, and emotional state. This system consists of three elements: a server, a terminal, and a user. It also includes an emotion engine for recognizing the user's emotions. Below, we will explain the role and specific functions of each element, as well as the operation of the entire system.

[1421] User

[1422] Users are individuals who use this system and provide location information, heart rate information, and emotional information. Users wear wearable devices (e.g., smart watches, earphones, audio glasses, etc.) through which they acquire, send, and receive information.

[1423] Terminal

[1424] The device acquires location information, heart rate information, and emotion information from the user and transmits it to the server. The main functions of the device are described in detail below.

[1425] 1. Location information acquisition:

[1426] The device uses the built-in GPS sensor to obtain the user's current location.

[1427] Location information is updated periodically (e.g., every 5 seconds).

[1428] 2. Obtaining heart rate information:

[1429] The device uses a built-in heart rate sensor to measure the user's heart rate.

[1430] Heart rate information is also updated periodically (e.g., every 5 seconds).

[1431] 3. Acquiring emotional information:

[1432] Using the camera and microphone installed on the device, the user's facial expressions and tone of voice are analyzed, and the emotion engine recognizes the user's emotions.

[1433] 4. Transmission of Information:

[1434] The periodically acquired location information, heart rate information, and emotion information are packaged into packets and sent to a server.

[1435] server

[1436] The server receives and analyzes the information sent from the terminal and integrates various data to provide the necessary information to the user. Below, we will explain in detail the main functions and processes performed by the server.

[1437] 1. Receiving Information:

[1438] The server receives the location information, heart rate information, and emotion information transmitted from the terminal.

[1439] 2. Getting map information:

[1440] The server calls the map service API based on the received location information and obtains map information for the area around the current location.

[1441] 3. Music Selection:

[1442] The server analyzes the received heart rate information and retrieves music corresponding to the user's heart rate from the music distribution service API.

[1443] For example, if your heart rate is high (e.g., 160 BPM), choose an up-tempo song.

[1444] Emotional information is also taken into consideration to select songs that suit the user's emotional state.

[1445] For example, if the emotional state is "relaxed," select relaxation music.

[1446] 4. Obtaining disaster prevention information:

[1447] Based on the location information, the server obtains the latest disaster prevention information corresponding to the region from the disaster prevention information service API.

[1448] 5. Generating personalized information:

[1449] The system integrates the acquired map information, selected music, disaster prevention information, and the user's emotional information to generate optimal personalized information.

[1450] 6. Sending Personalized Information:

[1451] The server transmits the generated personalized information to the terminal.

[1452] Specific examples

[1453] For users running

[1454] The user wears a smartwatch and earphones while running.

[1455] The device acquires the user's current location using a GPS sensor and measures their heart rate using a heart rate sensor. For example, suppose the heart rate is 160 BPM. The device's camera and microphone are used by the emotion engine to recognize the user's emotional state as "excited."

[1456] The terminal transmits this information to the server.

[1457] The server calls the map service API based on the location information and obtains map information within the park.

[1458] Next, since the heart rate is high, up-tempo music is retrieved from a music distribution service API. Also, since the emotional state is "excited," songs that will maintain tension are selected.

[1459] In addition, the disaster prevention information service API is called to check the necessary disaster prevention information.

[1460] Finally, this information is integrated to generate personalized information, including information about the user's current location, music selection, necessary disaster prevention information, and information based on their emotional state.

[1461] The server sends the generated personalized information to the user's device, which analyzes it, notifies the smartwatch, and plays music through the earphones.

[1462] The system allows users to receive appropriate music, map information, and disaster prevention information in real time while running, and can provide a more personalized experience by taking into account the user's emotional state.

[1463] The processing flow will be explained below.

[1464] Step 1:

[1465] A user puts on a wearable device and launches an application. The device activates the GPS sensor and heart rate sensor.

[1466] Step 2:

[1467] The device obtains the user's current location using the GPS sensor. This location information is updated periodically (e.g., every 5 seconds).

[1468] Step 3:

[1469] The device measures the user's heart rate using a heart rate sensor, and the heart rate information is updated periodically (e.g., every 5 seconds).

[1470] Step 4:

[1471] The device's built-in camera periodically captures the user's facial expressions, and the microphone collects the user's tone of voice, which is then used by the emotion engine to analyze the user's emotional state.

[1472] Step 5:

[1473] The terminal assembles the acquired location information, heart rate information, and emotion information into packets and transmits them to the server.

[1474] Step 6:

[1475] The server receives the location information, heart rate information, and emotion information transmitted from the terminal.

[1476] Step 7:

[1477] Based on the location information received by the server, the map service API is called to obtain map information around the current location.

[1478] Step 8:

[1479] The server analyzes the received heart rate information and retrieves music corresponding to the user's heart rate from the music distribution service API. For example, if the heart rate is 160 BPM, an up-tempo song will be selected.

[1480] Step 9:

[1481] The server uses an emotion engine to analyze the user's emotional state and selects appropriate music based on the results. For example, if the emotional state is "relaxed," it selects relaxation music.

[1482] Step 10:

[1483] Based on the location information, the server obtains the latest disaster prevention information corresponding to the region from the disaster prevention information service API.

[1484] Step 11:

[1485] The server integrates the acquired map information, selected music, disaster prevention information, and emotional information to generate optimal personalized information.

[1486] Step 12:

[1487] The server transmits the generated personalized information to the terminal.

[1488] Step 13:

[1489] The terminal analyzes the personalized information received from the server.

[1490] Step 14:

[1491] Based on the analyzed information, the device provides information to the user in an appropriate way. For example, selected music is played through earphones, and the smartwatch notifies the user of their current location, disaster prevention information, and emotional advice.

[1492] This detailed processing step allows users to efficiently receive the most appropriate information in real time. The system aims to improve the user experience by providing the most appropriate information tailored to the user's current situation and emotional state.

[1493] Example 2

[1494] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1495] Currently, there are systems that provide personalized information based on the user's location and heart rate information, but adding emotional information to these systems would enable more accurate personalization.However, such systems do not currently exist, and the provision of appropriate information according to the user's emotional state is insufficient, making it a challenge to improve user satisfaction.

[1496] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1497] In this invention, the server includes means for acquiring user location information, means for acquiring user heart rate information, means for acquiring user emotion information, means for transmitting the acquired location information, heart rate information, and emotion information to the server, means for receiving the transmitted location information, heart rate information, and emotion information, means for acquiring map information of the vicinity of the current location from a map service based on the received location information, means for selecting appropriate music from a music distribution service based on the received heart rate information and emotion information, means for acquiring the latest disaster prevention information corresponding to the area, means for integrating the acquired map information, music, disaster prevention information, and emotion information to generate personalized information to be provided to the user, means for transmitting the generated personalized information to the terminal, and terminal means. This enables the provision of highly accurate personalized information based on more multifaceted information including the user's emotional state.

[1498] "User location information" refers to coordinate information of the location where the user is currently located.

[1499] "User's heart rate information" refers to data obtained by measuring the user's heart rate.

[1500] "User emotional information" refers to data that expresses the user's emotional state, and is obtained by analyzing facial expressions, tone of voice, etc.

[1501] A "server" is a computer system that receives and analyzes data sent from a terminal, consolidates the necessary information, and sends it to the terminal.

[1502] "Terminal" refers to a device worn or used by a user that acquires location information, heart rate information, and emotional information and transmits it to a server.

[1503] A "GPS sensor" is a sensor that receives signals from satellites and determines the current location on Earth.

[1504] "Map Service" refers to a service that provides geographic information through a specific API.

[1505] "Music distribution service" refers to a service that provides music data through a specific API.

[1506] "Disaster prevention information" refers to information relating to emergencies such as natural disasters, and is provided according to the region.

[1507] "Personalized information" refers to information specific to a user that is generated by integrating the user's individual location information, heart rate information, emotional information, etc.

[1508] An "emotion engine" refers to software or hardware that analyzes a user's facial expressions and tone of voice to recognize their emotional state.

[1509] This invention is a system that provides personalized content in real time based on a user's location information, heart rate information, and emotional state. This system consists of three elements: a server, a terminal, and a user. It also includes an emotion engine for recognizing the user's emotions. Below, we will explain the role and specific functions of each element, as well as the operation of the entire system.

[1510] User

[1511] A user is an individual who uses this system and provides location information, heart rate information, and emotional information. The user wears a wearable device (e.g., a smartwatch, earphones, etc.) through which information is acquired, sent, and received. The user begins using this system by wearing the smartwatch on their wrist and the earphones in their ears.

[1512] Terminal

[1513] The device acquires location information, heart rate information, and emotion information from the user and transmits it to the server. The main functions of the device are described in detail below.

[1514] 1. Location information acquisition:

[1515] The device uses the built-in GPS sensor to obtain the user's current location, which is updated periodically (e.g., every 5 seconds).

[1516] 2. Obtaining heart rate information:

[1517] The device uses a built-in heart rate sensor to measure the user's heart rate, and the heart rate information is updated periodically (e.g., every 5 seconds).

[1518] 3. Acquiring emotional information:

[1519] Using the camera and microphone installed on the device, the user's facial expressions and tone of voice are analyzed, and the emotion engine recognizes the user's emotions.

[1520] 4. Transmission of Information:

[1521] The periodically acquired location information, heart rate information, and emotion information are packaged into packets and sent to a server.

[1522] server

[1523] The server receives and analyzes the information sent from the terminal and integrates various data to provide the necessary information to the user. Below, we will explain in detail the main functions and processes performed by the server.

[1524] 1. Receiving Information:

[1525] The server receives the location information, heart rate information, and emotion information transmitted from the terminal.

[1526] 2. Getting map information:

[1527] The server calls the map service API based on the received location information and obtains map information for the area around the current location.

[1528] 3. Music Selection:

[1529] The server analyzes the received heart rate information and retrieves music from the music distribution service API that corresponds to the user's heart rate and emotional state.

[1530] For example, if your heart rate is high (e.g., 160 BPM), choose an up-tempo song. If your emotional state is "excited," choose an energetic song.

[1531] 4. Obtaining disaster prevention information:

[1532] Based on the location information, the server obtains the latest disaster prevention information corresponding to the region from the disaster prevention information service API.

[1533] 5. Generating personalized information:

[1534] The system integrates the acquired map information, selected music, disaster prevention information, and the user's emotional information to generate optimal personalized information.

[1535] 6. Sending Personalized Information:

[1536] The server transmits the generated personalized information to the terminal.

[1537] Specific examples

[1538] For users running

[1539] Suppose a user is wearing a smartwatch and earphones while running. The smartwatch periodically obtains the user's current location using a GPS sensor and measures their heart rate using a heart rate sensor. For example, if the user's heart rate is 160 BPM, the device sends this information to the server. At the same time, the emotion engine uses the device's built-in camera and microphone to recognize the user's emotional state as "excited."

[1540] The server first calls a map service API based on the location information to obtain map information for the park where the user is running. Next, because the heart rate is high, it retrieves up-tempo music from a music distribution service API, and because the emotional state is "excited," it selects energetic music. It also calls a disaster prevention information service API to check disaster prevention information related to the user's current location.

[1541] The server combines this data (map information, music information, disaster prevention information) to generate personalized information optimal for the user and transmits it to the device. The device then plays the delivered music through earphones and displays the necessary information on the smartwatch screen.

[1542] Prompt Sentence Examples

[1543] "Please explain the specific steps of a system that provides real-time personalized music and map information when a user's heart rate is high and their emotional state is 'excited' while running."

[1544] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1545] Step 1: The user puts on the wearable device

[1546] The user puts on a smartwatch, earphones, or other wearable device, which then prepares the device to acquire the user's location, heart rate, and emotional information. The input for this step is the user, and the output is the wearable device.

[1547] Step 2: The device acquires location information

[1548] The device uses the built-in GPS sensor to obtain the user's current location. For example, if the user is in a park, the device obtains the location coordinates. The input is the signal from the GPS sensor, and the output is the location coordinate data (e.g., latitude 35.6895 degrees, longitude 139.6917 degrees). The location information is updated periodically (e.g., every 5 seconds).

[1549] Step 3: Your device acquires heart rate information

[1550] The device measures the user's heart rate using a built-in heart rate sensor. For example, the heart rate is measured at 160 BPM. The input is data from the heart rate sensor, and the output is heart rate data. The heart rate information is also updated periodically (for example, every 5 seconds).

[1551] Step 4: The device acquires emotion information

[1552] The device uses a camera and microphone to analyze the user's facial expressions and tone of voice. The emotion engine processes the results of this analysis and recognizes the user's emotional state as "excitement." The input is sensor data from the camera and microphone, and the output is emotional information.

[1553] Step 5: The device sends the information to the server

[1554] The device collects location information, heart rate information, and emotion information and compiles them into packets, which are then sent to the server. The input is location information, heart rate information, and emotion information, and the output is the data sent to the server. The transmission is performed periodically.

[1555] Step 6: The server receives the information

[1556] The server receives location information, heart rate information, and emotion information sent from the device. The input is the data sent from the device, and the output is the data stored on the server.

[1557] Step 7: The server retrieves the map information

[1558] The server calls the map service API based on the received location information to obtain map information around the current location. The input is location data, and the output is map information data (e.g., obtain geographic information using the Google Maps API).

[1559] Step 8: The server selects the music

[1560] The server analyzes the received heart rate and emotional information and retrieves music from a music distribution service API that corresponds to the user's heart rate and emotional state. For example, if a user's heart rate is 160 BPM and they are in an "excited" state, it selects an up-tempo, energetic song. The input is heart rate and emotional information data, and the output is the selected music data (e.g., retrieving songs using the Spotify API).

[1561] Step 9: The server acquires disaster prevention information

[1562] The server retrieves the latest disaster prevention information for the region from the disaster prevention information service API based on the location information. The input is location information data, and the output is disaster prevention information data (e.g., using the disaster prevention information service API to retrieve the latest information for the region).

[1563] Step 10: Server generates personalized information

[1564] The server integrates the acquired map information, selected music, disaster prevention information, and emotional information to generate optimal personalized information. The input is map information, music data, disaster prevention information, and emotional information, and the output is the integrated personalized information.

[1565] Step 11: The server sends the personalized information to the device.

[1566] The server sends the generated personalized information to the terminal. The input is the personalized information data, and the output is the data sent to the terminal.

[1567] Step 12: The device analyzes the information and notifies the user.

[1568] The device analyzes the received personalized information and notifies the user of appropriate information. Specifically, map information and disaster prevention information are displayed on the smartwatch's notification screen, and selected music is played through the earphones. The input is personalized information data, and the output is the form of information provided to the user (screen display and music playback).

[1569] (Application example 2)

[1570] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1571] In modern society, the proliferation of information and the diversification of individual user needs have led to a growing need for personalized content tailored to users' real-time situations. Real-time information delivery systems based on biometric data, such as location information and heart rate, can contribute to improving user experience. However, current systems are unable to effectively integrate these data and provide personalized content that also responds to the user's emotional state. Therefore, there is a need for a system that can provide personalized information in real time based on the user's location information, heart rate information, and emotional state.

[1572] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring user location information, means for acquiring user heart rate information, means for acquiring the user's emotional state, means for transmitting the received location information, heart rate information, and emotional information to the server, means for acquiring map information near the current location from a map service based on the received location information, means for selecting appropriate music from a music distribution service based on the received heart rate information, means for generating personalized content based on the emotional state, means for acquiring the latest disaster prevention information corresponding to the region, means for generating personalized information to provide to the user by integrating the acquired map information, music, disaster prevention information, and emotional information, means for transmitting the generated personalized information to the terminal, and terminal means. This makes it possible to provide personalized information that integrates appropriate map information, music, and disaster prevention information in real time based on the user's real-time biometric data and emotional state.

[1573] "Location information" is geographical coordinate information that indicates the user's current location.

[1574] "Heartbeat information" is biological data such as heart rate and heartbeat rhythm obtained from the user's heartbeat.

[1575] "Emotional state" is information indicating the user's emotions, and refers to psychological states such as stress, relaxation, and excitement.

[1576] "Personalized information" refers to content and service information that is individually customized based on the user's location information, heart rate information, and emotional state.

[1577] "Map information" is data that indicates the topography, roads, facilities, etc. within a geographical space.

[1578] A "music distribution service" is a service that distributes music over the Internet.

[1579] "Disaster prevention information" refers to the latest information on disasters such as earthquakes, fires, and typhoons.

[1580] "Server" means a central processing unit that receives, analyzes, and processes information sent by users.

[1581] A "terminal" is a device that a user carries or wears, including a smartphone or smartwatch.

[1582] This invention is a system that acquires a user's location information, heart rate information, and emotional state in real time and provides personalized content. This system is mainly composed of three elements: a server, a terminal, and a user. Below, we will explain in detail the operation of each element and the entire system.

[1583] User

[1584] The user is a person who uses this system and provides location information, heart rate information, and emotional information. The user wears a wearable device such as a smartwatch, earphones, or smart glasses, and the information is collected and sent to the server.

[1585] Terminal

[1586] The terminal acquires information from the user and transmits it to the server. Its main functions are as follows:

[1587] 1. Location information acquisition:

[1588] The device uses the built-in GPS sensor to obtain the user's current location, which is updated periodically.

[1589] 2. Obtaining heart rate information:

[1590] The device uses a built-in heart rate sensor to measure the user's heart rate, and this information is also updated periodically.

[1591] 3. Acquiring emotional information:

[1592] Using the camera and microphone installed on the device, the emotion engine analyzes the user's facial expressions and tone of voice to recognize the user's emotions.

[1593] 4. Transmission of Information:

[1594] The processed data is sent to the server.

[1595] server

[1596] The server receives the information sent from the terminal and analyzes and processes it. The main processes are as follows:

[1597] 1. Receiving Information:

[1598] The location information, heart rate information, and emotion information transmitted from the terminal are received.

[1599] 2. Getting map information:

[1600] Based on the received location information, the map service API is called to obtain map information around the current location.

[1601] 3. Music Selection:

[1602] Based on heart rate information, the system selects appropriate music from a music streaming service API. For example, if the heart rate is high, it selects up-tempo music. It also takes into account emotional information to select music that matches the user's emotional state.

[1603] 4. Emotion-based content generation:

[1604] Based on emotional information, it generates content such as videos and podcasts that are optimal for the user's emotional state.

[1605] 5. Obtaining disaster prevention information:

[1606] The latest disaster prevention information is obtained from the disaster prevention information service API based on location information.

[1607] 6. Generating personalized information:

[1608] The acquired map information, selected music, disaster prevention information, and emotional information are integrated to generate personalized information to be provided to the user.

[1609] 7. Transmission of Information:

[1610] The final generated personalized information is transmitted to the terminal.

[1611] Specific examples

[1612] For users running

[1613] The user wears a smartwatch and earphones while running. The device acquires the user's current location information obtained by the GPS sensor and the heart rate measured by the heart rate sensor (e.g., 160 BPM). The emotion engine also recognizes the user's emotional state as "excitement." This information is periodically sent to the server.

[1614] The server calls a map service API based on the received location information to obtain map information for the park. Next, because the heart rate information is high, it retrieves up-tempo songs from a music distribution service API and selects music suitable for maintaining excitement based on the emotional state. It also calls a disaster prevention information service API to check necessary disaster prevention information.

[1615] This information is then integrated to generate personalized information, which is then sent back to the user's device. The user can then check this information on their smartwatch, and the selected music will play from the earphones.

[1616] Example prompt for a generative AI model:

[1617] "A user is feeling stressed while walking through a city. Their heart rate is 120 BPM. What content would you recommend?"

[1618] This system allows users to enjoy content that is best suited to their situation in real time.

[1619] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1620] Step 1:

[1621] Users acquire information by wearing a wearable device

[1622] Specific behavior:

[1623] Users wear wearable devices such as smartwatches, earphones, and smart glasses. The user's current location is acquired using a GPS sensor, and heart rate information is measured using a heart rate sensor. In addition, the device's built-in camera and microphone are used to analyze the user's facial expressions and tone of voice to obtain emotional information.

[1624] input:

[1625] User location information, heart rate information, emotional state

[1626] output:

[1627] Acquired location information, heart rate information, and emotional information

[1628] Step 2:

[1629] The device sends the acquired information to the server.

[1630] Specific behavior:

[1631] The device periodically collects location information, heart rate information, and emotion information, and then compiles them into packets and sends them to a server via the Internet.

[1632] input:

[1633] Acquired location information, heart rate information, and emotional information

[1634] output:

[1635] Location information, heart rate information, and emotional information sent to the server

[1636] Step 3:

[1637] The server analyzes the information it receives

[1638] Specific behavior:

[1639] The server receives location information, heart rate information, and emotion information sent from the device, analyzes the received data, and identifies and organizes each piece of information.

[1640] input:

[1641] Transmitted location information, heart rate information, and emotional information

[1642] output:

[1643] Organized location, heart rate, and emotional information

[1644] Step 4:

[1645] The server obtains map information

[1646] Specific behavior:

[1647] The server then calls the map service API based on the received location information to obtain map information for the area around the user's current location. The obtained map information provides detailed geographic data about the user's current location.

[1648] input:

[1649] Organized location information

[1650] output:

[1651] Obtained map information

[1652] Step 5:

[1653] The server selects the music

[1654] Specific behavior:

[1655] The server analyzes the received heart rate information, retrieves music corresponding to the user's heart rate from a music distribution service API, and selects music appropriate for the user's emotional state, taking into account the emotional information.

[1656] input:

[1657] Organized heart rate and emotional information

[1658] output:

[1659] Selected music

[1660] Step 6:

[1661] The server acquires disaster prevention information

[1662] Specific behavior:

[1663] The server retrieves the latest disaster prevention information for the area based on the location information from the disaster prevention information service API, which provides information such as disaster risks near the user's current location.

[1664] input:

[1665] Organized location information

[1666] output:

[1667] Acquired disaster prevention information

[1668] Step 7:

[1669] The server generates the personalized information.

[1670] Specific behavior:

[1671] The server integrates the acquired map information, selected music, disaster prevention information, and emotion information to generate personalized information to be provided to the user.

[1672] input:

[1673] Map information, selected music, disaster prevention information, emotional information

[1674] output:

[1675] Generated personalized information

[1676] Step 8:

[1677] The server sends the generated personalized information to the device.

[1678] Specific behavior:

[1679] The server transmits the generated personalized information to the terminal, where it is analyzed and appropriately notified or played back.

[1680] input:

[1681] Generated personalized information

[1682] output:

[1683] Personalized information sent by the server

[1684] Step 9:

[1685] The device provides personalized information to the user

[1686] Specific behavior:

[1687] The device analyzes the received personalized information and provides it to the user via the smartwatch or earphones, such as displaying a notification on the smartwatch and playing selected music through the earphones.

[1688] input:

[1689] Personalized Information Received

[1690] output:

[1691] Personalized information provided to users

[1692] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1693] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1694] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1695] [Fourth embodiment]

[1696] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1697] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1698] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1699] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1700] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1701] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1702] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1703] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1704] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1705] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1706] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1707] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1708] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1709] MODE FOR CARRYING OUT THE INVENTION

[1710] The present invention is a system that provides personalized information in real time based on a user's location information and heart rate information. This system basically consists of three elements: a server, a terminal, and a user. The roles and specific functions of each element are explained below.

[1711] User

[1712] Users are individuals who use this system and provide location and heart rate information. Users wear wearable devices (e.g., smart watches, earphones, audio glasses, etc.) through which they acquire, send, and receive information.

[1713] Terminal

[1714] The device acquires location information and heart rate information from the user and transmits it to the server. The main processes performed by the device are described below.

[1715] 1. Location information acquisition:

[1716] The device uses the built-in GPS sensor to obtain the user's current location.

[1717] The acquired location information is updated periodically.

[1718] 2. Obtaining heart rate information:

[1719] The device uses a built-in heart rate sensor to measure the user's heart rate.

[1720] The measured heart rate information is also updated periodically.

[1721] 3. Transmission of Information:

[1722] The periodically acquired location information and heart rate information are packaged into packets and sent to the server.

[1723] server

[1724] The server receives and analyzes the information sent from the terminal and integrates various data to provide the necessary information to the user. The main processes performed by the server are described below.

[1725] 1. Receiving Information:

[1726] The server receives the location information and heart rate information transmitted from the terminal.

[1727] 2. Getting map information:

[1728] The server calls the map service API based on the received location information and obtains map information for the area around the current location.

[1729] 3. Music Selection:

[1730] The server analyzes the heart rate based on the received heart rate information and retrieves appropriate music from the music distribution service API.

[1731] For example, if your heart rate is high, choose upbeat music, and if your heart rate is low, choose relaxation music.

[1732] 4. Obtaining disaster prevention information:

[1733] The server obtains disaster prevention information corresponding to the region based on the location information from the disaster prevention information service API.

[1734] 5. Generating personalized information:

[1735] The acquired map information, music, disaster prevention information, and other personalized information (e.g., store coupons) are integrated as needed to generate optimal personalized information.

[1736] 6. Sending Personalized Information:

[1737] The server transmits the generated personalized information to the terminal again.

[1738] Specific examples

[1739] For users running

[1740] The user wears the smartwatch while running.

[1741] The device acquires the user's current location using a GPS sensor and measures the user's heart rate using a heart rate sensor. For example, suppose the heart rate is 160 BPM.

[1742] The terminal transmits the acquired location information and heart rate information to the server.

[1743] The server calls the map service API based on the location information and obtains map information within the park.

[1744] Next, since the heart rate is high, up-tempo music is retrieved from the music distribution service API. In addition, a disaster prevention information service API is called to check the necessary disaster prevention information.

[1745] Finally, this information is integrated to generate personalized information, including information about the user's current location, selected music, necessary disaster prevention information, etc.

[1746] The server sends the generated personalized information to the user's device, which analyzes it and sends notifications to the smartwatch or plays music through earphones.

[1747] This system allows users to listen to appropriate music in real time while running, while also receiving necessary map and disaster prevention information, making everyday activities safer and more comfortable.

[1748] The processing flow will be explained below.

[1749] Step 1:

[1750] The user puts on the wearable device and starts the system. The device completes the initial setup and activates the GPS sensor and heart rate sensor.

[1751] Step 2:

[1752] The device uses the GPS sensor to obtain the user's current location. This location information is obtained periodically (e.g., every 5 seconds).

[1753] Step 3:

[1754] The device uses a heart rate sensor to measure the user's heart rate, and heart rate information is also collected periodically (e.g., every 5 seconds).

[1755] Step 4:

[1756] The terminal assembles the acquired location information and heart rate information into a packet and transmits it to the server.

[1757] Step 5:

[1758] The server receives the location information and heart rate information transmitted from the terminal.

[1759] Step 6:

[1760] Based on the location information received by the server, the map service API is called to obtain map information around the current location.

[1761] Step 7:

[1762] The server analyzes the received heart rate information and calls the music distribution service API to select music according to the user's heart rate.

[1763] For example: If your heart rate is high (e.g., 160 BPM), choose an up-tempo song.

[1764] Step 8:

[1765] Based on the location information, the server obtains the latest disaster prevention information corresponding to the region from the disaster prevention information service API.

[1766] Step 9:

[1767] The server integrates map information, selected music, and disaster prevention information to generate optimal personalized information.

[1768] Step 10:

[1769] The server transmits the generated personalized information to the terminal.

[1770] Step 11:

[1771] The terminal analyzes the personalized information received from the server.

[1772] Step 12:

[1773] Based on the analyzed information, the device provides information to the user in an appropriate manner.

[1774] Example: Play selected music through earphones and notify the smartwatch of current location and disaster prevention information.

[1775] This process flow allows users to receive the information they need in real time. The system aims to improve the user experience by providing the most appropriate information tailored to the user's current situation.

[1776] Example 1

[1777] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1778] Conventional personalized information provision systems have not been able to fully utilize the user's location information and heart rate information, making it difficult to provide personalized information in real time. In addition, since music selection and disaster prevention information provision are not centralized, users are unable to receive the information they need in a timely manner, resulting in issues of low safety and convenience.

[1779] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1780] In this invention, the server includes means for acquiring user location information, means for acquiring user heart rate information, means for transmitting the acquired location information and heart rate information to a central processing unit, means for receiving the transmitted location information and heart rate information, means for acquiring map information of the vicinity of the current location from a map information providing service based on the received location information, means for selecting appropriate music from a music distribution service based on the received heart rate information, means for acquiring the latest disaster prevention information corresponding to the area, means for integrating the acquired map information, music, and disaster prevention information to generate personalized information to be provided to the user, means for transmitting the generated personalized information to the terminal, and means for notifying the user of the personalized information received by the terminal. This makes it possible to utilize the user's location information and heart rate information in real time, centrally manage necessary map information, music, and disaster prevention information, and immediately provide them to the user.

[1781] A "user" is an individual who uses the system and provides location and heart rate information.

[1782] "Location information" is data indicating the user's current geographical latitude and longitude.

[1783] "Heart rate information" is data indicating the user's current heart rate.

[1784] The "central processing unit" is a device that has the function of receiving and processing the location information and heart rate information transmitted from the terminal.

[1785] A "terminal" is a device worn by a user that has the function of acquiring location information and heart rate information and transmitting this information to a central processing unit.

[1786] A "map information service" is an online service that provides map information around the current location based on location information.

[1787] A "music distribution service" is an online service that selects and provides appropriate music based on heart rate information.

[1788] "Disaster prevention information" refers to information including the latest disaster information and evacuation advisories for a specific area.

[1789] "Personalized information" is individually tailored information that is generated to provide to a user by integrating acquired map information, music, and disaster prevention information.

[1790] "Notification" is the act of presenting information to a user through a terminal.

[1791] The present invention is a system that provides personalized information in real time based on a user's location information and heart rate information. This system basically consists of three elements: a server, a terminal, and a user. The roles and specific functions of each element are explained below.

[1792] User

[1793] Users are individuals who use this system and provide location and heart rate information. Users wear wearable devices (e.g., smart watches, earphones, audio glasses, etc.) through which they acquire, send, and receive information.

[1794] Terminal

[1795] The device acquires location information and heart rate information from the user and transmits it to the server. Specifically, it performs the following processes.

[1796] 1. Obtaining location information

[1797] The device uses the built-in GPS sensor to obtain the user's current location, which allows for detailed and accurate location information.

[1798] The device periodically updates this location information to keep it up to date.

[1799] 2. Obtaining heart rate information

[1800] The device measures the user's heart rate using a built-in heart rate sensor, which is often an optical sensor or an electrocardiogram sensor.

[1801] The device will periodically update your heart rate information to keep your health information up to date.

[1802] 3. Transmission of Information

[1803] The acquired location information and heart rate information are packaged into packets and sent to the server using HTTP POST requests or WebSocket communication.

[1804] server

[1805] The server receives the information sent from the device, performs the necessary data analysis, and generates personalized information based on the acquired data. The main processes performed by the server are described below.

[1806] 1. Receipt of information

[1807] The server receives the location information and heart rate information sent from the device using an HTTP server or WebSocket server.

[1808] 2. Obtaining map information

[1809] The server then calls a map information service API based on the received location information to obtain map information for the area around the current location. Typically, Google Maps API is used.

[1810] 3. Music selection

[1811] The server analyzes the heart rate based on the received heart rate information and retrieves appropriate music from a music streaming service API. If the heart rate is high, an up-tempo song is selected, and if it is low, a relaxing song is selected. Spotify API and Apple Music API are commonly used.

[1812] 4. Obtaining disaster prevention information

[1813] Based on the received location information, the server obtains disaster prevention information for that area from a disaster prevention information service API, such as the Japan Meteorological Agency API.

[1814] 5. Generating personalized information

[1815] The server integrates the acquired map information, music, disaster prevention information, etc. to generate personalized information to provide to users. This process is implemented using server-side languages ​​such as Python and Node.js.

[1816] 6. Sending personalized information

[1817] The server transmits the generated personalized information to the terminal again.

[1818] Specific examples

[1819] For users running

[1820] The user wears the smartwatch while running.

[1821] The device acquires the user's current location using a GPS sensor, records it as latitude 35.658581 and longitude 139.745433, and measures the heart rate as 160 BPM using a heart rate sensor.

[1822] The terminal transmits the acquired location information and heart rate information to the server.

[1823] The server calls the map information service API based on the location information and obtains map information within the park.

[1824] The server retrieves up-tempo songs from the music distribution service API because the heart rate is 160 BPM. It also calls the disaster prevention information service API to retrieve disaster prevention information around the park.

[1825] The server integrates this information to generate personalized information, including park maps, music selections, and disaster prevention information.

[1826] The server sends the generated personalized information to the device, which receives it and displays map information on the smartwatch, plays music through earphones, and notifies users of disaster prevention information.

[1827] Prompt Sentence Examples

[1828] Specific examples of prompts are as follows:

[1829] "You are currently in a park. Your heart rate is 160 BPM. Please play some upbeat music and get information about nearby disasters."

[1830] This system allows users to listen to appropriate music in real time while running, while also receiving necessary map and disaster prevention information, making everyday activities safer and more comfortable.

[1831] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1832] Step 1:

[1833] Input: A wearable device worn by the user.

[1834] Action: A user puts on a wearable device such as a smartwatch or earphones.

[1835] Output: None.

[1836] Step 2:

[1837] Input: The worn wearable device.

[1838] Operation: The device periodically obtains the user's current location (latitude and longitude) using the built-in GPS sensor.

[1839] Specifically, the navigator.geolocation.getCurrentPosition method is called to obtain location information.

[1840] Output: The location information obtained (e.g., latitude 35.658581, longitude 139.745433).

[1841] Step 3:

[1842] Input: The worn wearable device.

[1843] How it works: The device periodically measures the user's heart rate using the built-in heart rate sensor.

[1844] Specifically, the smartwatch collects data from the heart rate sensor and calculates the heart rate.

[1845] Output: Acquired heart rate information (e.g. 160 BPM).

[1846] Step 4:

[1847] Input: Acquired location and heart rate information.

[1848] Operation: The device collects location and heart rate information and sends it to the server using an HTTP POST request.

[1849] Specifically, data is constructed in JSON format and sent to the " / data" endpoint via an HTTP POST request.

[1850] Output: Location and heart rate information sent to the server.

[1851] POST / data HTTP / 1.1

[1852] Host: example.com

[1853] Content-Type: application / json

[1854] {

[1855] "location": {"latitude": 35.658581, "longitude": 139.745433},

[1856] "heartRate": 160

[1857] }

[1858] Step 5:

[1859] Input: Location and heart rate information received by the server.

[1860] Operation: The server receives the location information and heart rate information sent from the device and performs data analysis.

[1861] Specifically, the server endpoint / data receives the request and parses the JSON-formatted data.

[1862] Output: Analyzed location and heart rate information.

[1863] Step 6:

[1864] Input: Parsed location information.

[1865] Operation: The server calls the map information service API based on the analyzed location information and obtains map information for the area around the current location.

[1866] Specifically, send the following API request:

[1867] GET https: / / maps.googleapis.com / maps / api / geocode / json?latlng=35.658581,139.745433&key=YOUR_API_KEY

[1868] Output: The retrieved map information.

[1869] Step 7:

[1870] Input: Parsed heart rate information.

[1871] Operation: The server calls the music distribution service API based on the analyzed heart rate information and obtains the appropriate music.

[1872] If your heart rate is high, choose up-tempo music, and if it's low, choose relaxation music.

[1873] Specifically, send the following API request:

[1874] GET https: / / api.spotify.com / v1 / recommendations?seed_genres=upbeat&target_tempo=160&key=YOUR_API_KEY

[1875] Output: The retrieved music information.

[1876] Step 8:

[1877] Input: Parsed location information.

[1878] Operation: The server calls the disaster prevention information service API based on the analyzed location information and obtains the latest disaster prevention information for the area.

[1879] Specifically, send the following API request:

[1880] GET https: / / www.jma.go.jp / bosai / forecast / data / overview_forecast / 130000.json

[1881] Output: Obtained disaster prevention information.

[1882] Step 9:

[1883] Input: Obtained map information, music information, and disaster prevention information.

[1884] Operation: The server aggregates these and generates personalized information to provide to the user.

[1885] Specifically, data is integrated using server-side languages ​​such as Python and Node.js to generate personalized information in JSON format.

[1886] Output: The generated personalized information.

[1887] {

[1888] "mapInfo": { ...},

[1889] "musicInfo": { ...},

[1890] "disasterInfo": { ...}

[1891] }

[1892] Step 10:

[1893] Input: Generated personalization information.

[1894] Operation: The server sends the generated personalized information to the device via an HTTP response or a push notification.

[1895] Specifically, it is returned as an HTTP response or sent using a push notification service.

[1896] Output: Personalized information sent to your device.

[1897] Step 11:

[1898] Input: Personalization information received by the device.

[1899] Operation: The terminal receives and analyzes the personalized information sent from the server.

[1900] Specifically, it parses HTTP responses and push notification data.

[1901] Output: Parsed personalization information.

[1902] Step 12:

[1903] Input: Parsed personalization information.

[1904] Operation: The device displays the received map information on the screen of the smartwatch or smartphone.

[1905] Specifically, the acquired map data is rendered using Google Maps SDK or similar.

[1906] Output: The displayed map information.

[1907] Step 13:

[1908] Input: Parsed personalization information.

[1909] Operation: The device plays the received music information through the earphones.

[1910] Specifically, the music is streamed using the acquired music URL.

[1911] Output: Played music.

[1912] Step 14:

[1913] Input: Parsed personalization information.

[1914] Operation: The device displays the received disaster prevention information using the smartwatch's notification function.

[1915] Specifically, we will utilize the function that displays notifications on smartwatches.

[1916] Output: Disaster prevention information notified.

[1917] (Application example 1)

[1918] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1919] Conventional personalized information provision systems have struggled to efficiently utilize a user's location information and heart rate information to provide optimal content to the user in real time. Furthermore, these systems rely on limited information sources, making it difficult to address diverse user needs. The present invention aims to solve these problems by providing a system that provides appropriate music, podcasts, disaster prevention information, and other content in real time based on a user's heart rate and location information.

[1920] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1921] In this invention, the server includes means for acquiring user location information, means for acquiring user heart rate information, means for acquiring map information around the current location from a map service based on the received location information, means for selecting appropriate music or podcasts from a content distribution service based on the received heart rate information, and means for acquiring the latest disaster prevention information corresponding to the area, thereby enabling the user to receive optimal music, podcasts, disaster prevention information, etc. in real time according to their current location and heart rate.

[1922] text

[1923] A "user" is an individual who uses the system and provides location information and heart rate information.

[1924] "Location information" is data that indicates the user's current geographical location.

[1925] "Heart rate information" is data indicating the user's heart rate, and represents the user's health condition and activity level.

[1926] The "server" is a system component that receives and analyzes location information and heart rate information, and generates and provides various personalized information.

[1927] A "map service" is an external service that provides geographical information and map data based on location information.

[1928] A "music streaming service" is a third-party service that provides music tracks in streaming or download format.

[1929] A "content distribution service" is an external service that provides multimedia content such as music and podcasts.

[1930] "Disaster prevention information" is data that provides information on local disaster risks and emergency response measures.

[1931] "Personalized information" is information generated specifically for a user by integrating acquired map information, music, podcasts, and disaster prevention information.

[1932] A "terminal" is a device that acquires the user's location information and heart rate information and transmits this information to a server.

[1933] A "satellite positioning system sensor" is a device that receives satellite signals and measures location information.

[1934] "Tempo-controlled music" refers to music that is selected based on heart rate and has a rhythm that is appropriate for the user's current activity level.

[1935] A "podcast" is audio content provided over the Internet and includes a variety of genres, including education, news, and entertainment.

[1936] text

[1937] The present invention is a system that provides personalized information in real time based on a user's location information and heart rate information. This system is composed of three elements: a user, a terminal, and a server.

[1938] 1. Users

[1939] A user is an individual who uses this system and provides location information and heart rate information. Specifically, the user wears a wearable device such as a smartwatch or fitness tracker, and acquires and transmits location information and heart rate information through the device.

[1940] 2. Terminal

[1941] The device is responsible for acquiring location information and heart rate information from the user and transmitting it to the server. Specific processing includes the following:

[1942] Location information acquisition: The device uses the built-in satellite positioning system sensor to acquire the user's current location.

[1943] Obtaining heart rate information: The device uses the built-in heart rate sensor to measure the user's heart rate.

[1944] Sending information: The acquired location information and heart rate information are sent to the server periodically.

[1945] 3. Server

[1946] The server receives and analyzes the information sent from the device and integrates various data to provide the user with the necessary information.

[1947] Receiving information: The server receives the location information and heart rate information sent from the device.

[1948] Obtaining map information: Calls the map service API based on the received location information and obtains map information around the current location.

[1949] Content selection: Based on the received heart rate information, the heart rate is analyzed and appropriate music or podcasts are retrieved from the content distribution service API. For example, if the heart rate is high, upbeat music is selected, and if it is low, a relaxing podcast is selected.

[1950] Obtaining disaster prevention information: Obtain the latest disaster prevention information for the area based on location information from the disaster prevention information service API.

[1951] Generation of personalized information: The acquired map information, music, podcasts, and disaster prevention information are integrated to generate personalized information to be provided to the user.

[1952] Sending information: Send the generated personalized information back to your device.

[1953] Specific examples

[1954] For example, if a user is running, the device will use a satellite positioning system sensor to obtain the user's location information and a heart rate sensor to measure the user's heart rate. Suppose the user's heart rate is 150 BPM. This information is sent to a server, which then calls a map service API to obtain map information for the current location. Based on the high heart rate, the server retrieves upbeat music from a content distribution service API. It also obtains the latest local disaster prevention information and combines this information to generate personalized information. Finally, this information is sent to the user's device, allowing the user to receive appropriate music and disaster prevention information in real time.

[1955] Prompt Sentence Examples

[1956] "If a user's heart rate is 150 BPM, can you recommend some upbeat music that's good for running? Also, give me the latest news in their area?"

[1957] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1958] text

[1959] Step 1:

[1960] Obtain the user's location information and heart rate information. The device uses the built-in satellite positioning system sensor to obtain the user's current location and the heart rate sensor to measure the heart rate. The input is the user's location information and heart rate information, and the output is a data packet sent to the server.

[1961] Step 2:

[1962] The server receives the location and heart rate information sent from the device. This is the initial stage of data processing and analysis. The input is the data packet sent from the device, and the output is processable data stored in the server.

[1963] Step 3:

[1964] The server calls the map service API based on the received location information and obtains map information for the area around the current location. The input is the location information and the output is the obtained map information. Specifically, the server sends an API request and receives map information as a response.

[1965] Step 4:

[1966] The server analyzes the received heart rate information and selects appropriate content (music or podcast). At this time, it calls the content distribution service API based on the heart rate to obtain the appropriate track. The input is the heart rate information, and the output is the selected music or podcast. Specifically, if the heart rate is high, it queries for up-tempo music, and if the heart rate is low, it queries for relaxation podcasts.

[1967] Step 5:

[1968] The server obtains the latest disaster prevention information for the region based on the location information from the disaster prevention information service API. The input is location information and the output is disaster prevention information. Specifically, the server sends an API request to obtain disaster prevention information for the region and receives the disaster prevention information as a response.

[1969] Step 6:

[1970] The server integrates the acquired map information, music, podcasts, and disaster prevention information to generate personalized information to provide to users. The input is the various acquired data, and the output is the integrated personalized information. Specifically, the server integrates each data to generate personalized information in JSON format.

[1971] Step 7:

[1972] The server transmits the generated personalized information to the terminal. The input is the generated personalized information, and the output is a data packet transmitted to the terminal. Specifically, the server transmits data to the terminal and provides the information to the user in real time.

[1973] Step 8:

[1974] The device receives personalized information sent from the server and notifies the user. The input is the data packet sent from the server, and the output is the presentation of information to the user. Specific operations include displaying a notification on the smartwatch display and playing music or podcasts through the earphones.

[1975] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1976] MODE FOR CARRYING OUT THE INVENTION

[1977] This invention is a system that provides personalized content in real time based on a user's location information, heart rate information, and emotional state. This system consists of three elements: a server, a terminal, and a user. It also includes an emotion engine for recognizing the user's emotions. Below, we will explain the role and specific functions of each element, as well as the operation of the entire system.

[1978] User

[1979] Users are individuals who use this system and provide location information, heart rate information, and emotional information. Users wear wearable devices (e.g., smart watches, earphones, audio glasses, etc.) through which they acquire, send, and receive information.

[1980] Terminal

[1981] The device acquires location information, heart rate information, and emotion information from the user and transmits it to the server. The main functions of the device are described in detail below.

[1982] 1. Location information acquisition:

[1983] The device uses the built-in GPS sensor to obtain the user's current location.

[1984] Location information is updated periodically (e.g., every 5 seconds).

[1985] 2. Obtaining heart rate information:

[1986] The device uses a built-in heart rate sensor to measure the user's heart rate.

[1987] Heart rate information is also updated periodically (e.g., every 5 seconds).

[1988] 3. Acquiring emotional information:

[1989] Using the camera and microphone installed on the device, the user's facial expressions and tone of voice are analyzed, and the emotion engine recognizes the user's emotions.

[1990] 4. Transmission of Information:

[1991] The periodically acquired location information, heart rate information, and emotion information are packaged into packets and sent to a server.

[1992] server

[1993] The server receives and analyzes the information sent from the terminal and integrates various data to provide the necessary information to the user. Below, we will explain in detail the main functions and processes performed by the server.

[1994] 1. Receiving Information:

[1995] The server receives the location information, heart rate information, and emotion information transmitted from the terminal.

[1996] 2. Getting map information:

[1997] The server calls the map service API based on the received location information and obtains map information for the area around the current location.

[1998] 3. Music Selection:

[1999] The server analyzes the received heart rate information and retrieves music corresponding to the user's heart rate from the music distribution service API.

[2000] For example, if your heart rate is high (e.g., 160 BPM), choose an up-tempo song.

[2001] Emotional information is also taken into consideration to select songs that suit the user's emotional state.

[2002] For example, if the emotional state is "relaxed," select relaxation music.

[2003] 4. Obtaining disaster prevention information:

[2004] Based on the location information, the server obtains the latest disaster prevention information corresponding to the region from the disaster prevention information service API.

[2005] 5. Generating personalized information:

[2006] The system integrates the acquired map information, selected music, disaster prevention information, and the user's emotional information to generate optimal personalized information.

[2007] 6. Sending Personalized Information:

[2008] The server transmits the generated personalized information to the terminal.

[2009] Specific examples

[2010] For users running

[2011] The user wears a smartwatch and earphones while running.

[2012] The device acquires the user's current location using a GPS sensor and measures their heart rate using a heart rate sensor. For example, suppose the heart rate is 160 BPM. The device's camera and microphone are used by the emotion engine to recognize the user's emotional state as "excited."

[2013] The terminal transmits this information to the server.

[2014] The server calls the map service API based on the location information and obtains map information within the park.

[2015] Next, since the heart rate is high, up-tempo music is retrieved from a music distribution service API. Also, since the emotional state is "excited," songs that will maintain tension are selected.

[2016] In addition, the disaster prevention information service API is called to check the necessary disaster prevention information.

[2017] Finally, this information is integrated to generate personalized information, including information about the user's current location, music selection, necessary disaster prevention information, and information based on their emotional state.

[2018] The server sends the generated personalized information to the user's device, which analyzes it, notifies the smartwatch, and plays music through the earphones.

[2019] The system allows users to receive appropriate music, map information, and disaster prevention information in real time while running, and can provide a more personalized experience by taking into account the user's emotional state.

[2020] The processing flow will be explained below.

[2021] Step 1:

[2022] A user puts on a wearable device and launches an application. The device activates the GPS sensor and heart rate sensor.

[2023] Step 2:

[2024] The device obtains the user's current location using the GPS sensor. This location information is updated periodically (e.g., every 5 seconds).

[2025] Step 3:

[2026] The device measures the user's heart rate using a heart rate sensor, and the heart rate information is updated periodically (e.g., every 5 seconds).

[2027] Step 4:

[2028] The device's built-in camera periodically captures the user's facial expressions, and the microphone collects the user's tone of voice, which is then used by the emotion engine to analyze the user's emotional state.

[2029] Step 5:

[2030] The terminal assembles the acquired location information, heart rate information, and emotion information into packets and transmits them to the server.

[2031] Step 6:

[2032] The server receives the location information, heart rate information, and emotion information transmitted from the terminal.

[2033] Step 7:

[2034] Based on the location information received by the server, the map service API is called to obtain map information around the current location.

[2035] Step 8:

[2036] The server analyzes the received heart rate information and retrieves music corresponding to the user's heart rate from the music distribution service API. For example, if the heart rate is 160 BPM, an up-tempo song will be selected.

[2037] Step 9:

[2038] The server uses an emotion engine to analyze the user's emotional state and selects appropriate music based on the results. For example, if the emotional state is "relaxed," it selects relaxation music.

[2039] Step 10:

[2040] Based on the location information, the server obtains the latest disaster prevention information corresponding to the region from the disaster prevention information service API.

[2041] Step 11:

[2042] The server integrates the acquired map information, selected music, disaster prevention information, and emotional information to generate optimal personalized information.

[2043] Step 12:

[2044] The server transmits the generated personalized information to the terminal.

[2045] Step 13:

[2046] The terminal analyzes the personalized information received from the server.

[2047] Step 14:

[2048] Based on the analyzed information, the device provides information to the user in an appropriate way. For example, selected music is played through earphones, and the smartwatch notifies the user of their current location, disaster prevention information, and emotional advice.

[2049] This detailed processing step allows users to efficiently receive the most appropriate information in real time. The system aims to improve the user experience by providing the most appropriate information tailored to the user's current situation and emotional state.

[2050] Example 2

[2051] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2052] Currently, there are systems that provide personalized information based on the user's location and heart rate information, but adding emotional information to these systems would enable more accurate personalization.However, such systems do not currently exist, and the provision of appropriate information according to the user's emotional state is insufficient, making it a challenge to improve user satisfaction.

[2053] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2054] In this invention, the server includes means for acquiring user location information, means for acquiring user heart rate information, means for acquiring user emotion information, means for transmitting the acquired location information, heart rate information, and emotion information to the server, means for receiving the transmitted location information, heart rate information, and emotion information, means for acquiring map information of the vicinity of the current location from a map service based on the received location information, means for selecting appropriate music from a music distribution service based on the received heart rate information and emotion information, means for acquiring the latest disaster prevention information corresponding to the area, means for integrating the acquired map information, music, disaster prevention information, and emotion information to generate personalized information to be provided to the user, means for transmitting the generated personalized information to the terminal, and terminal means. This enables the provision of highly accurate personalized information based on more multifaceted information including the user's emotional state.

[2055] "User location information" refers to coordinate information of the location where the user is currently located.

[2056] "User's heart rate information" refers to data obtained by measuring the user's heart rate.

[2057] "User emotional information" refers to data that expresses the user's emotional state, and is obtained by analyzing facial expressions, tone of voice, etc.

[2058] A "server" is a computer system that receives and analyzes data sent from a terminal, consolidates the necessary information, and sends it to the terminal.

[2059] "Terminal" refers to a device worn or used by a user that acquires location information, heart rate information, and emotional information and transmits it to a server.

[2060] A "GPS sensor" is a sensor that receives signals from satellites and determines the current location on Earth.

[2061] "Map Service" refers to a service that provides geographic information through a specific API.

[2062] "Music distribution service" refers to a service that provides music data through a specific API.

[2063] "Disaster prevention information" refers to information relating to emergencies such as natural disasters, and is provided according to the region.

[2064] "Personalized information" refers to information specific to a user that is generated by integrating the user's individual location information, heart rate information, emotional information, etc.

[2065] An "emotion engine" refers to software or hardware that analyzes a user's facial expressions and tone of voice to recognize their emotional state.

[2066] This invention is a system that provides personalized content in real time based on a user's location information, heart rate information, and emotional state. This system consists of three elements: a server, a terminal, and a user. It also includes an emotion engine for recognizing the user's emotions. Below, we will explain the role and specific functions of each element, as well as the operation of the entire system.

[2067] User

[2068] A user is an individual who uses this system and provides location information, heart rate information, and emotional information. The user wears a wearable device (e.g., a smartwatch, earphones, etc.) through which information is acquired, sent, and received. The user begins using this system by wearing the smartwatch on their wrist and the earphones in their ears.

[2069] Terminal

[2070] The device acquires location information, heart rate information, and emotion information from the user and transmits it to the server. The main functions of the device are described in detail below.

[2071] 1. Location information acquisition:

[2072] The device uses the built-in GPS sensor to obtain the user's current location, which is updated periodically (e.g., every 5 seconds).

[2073] 2. Obtaining heart rate information:

[2074] The device uses a built-in heart rate sensor to measure the user's heart rate, and the heart rate information is updated periodically (e.g., every 5 seconds).

[2075] 3. Acquiring emotional information:

[2076] Using the camera and microphone installed on the device, the user's facial expressions and tone of voice are analyzed, and the emotion engine recognizes the user's emotions.

[2077] 4. Transmission of Information:

[2078] The periodically acquired location information, heart rate information, and emotion information are packaged into packets and sent to a server.

[2079] server

[2080] The server receives and analyzes the information sent from the terminal and integrates various data to provide the necessary information to the user. Below, we will explain in detail the main functions and processes performed by the server.

[2081] 1. Receiving Information:

[2082] The server receives the location information, heart rate information, and emotion information transmitted from the terminal.

[2083] 2. Getting map information:

[2084] The server calls the map service API based on the received location information and obtains map information for the area around the current location.

[2085] 3. Music Selection:

[2086] The server analyzes the received heart rate information and retrieves music from the music distribution service API that corresponds to the user's heart rate and emotional state.

[2087] For example, if your heart rate is high (e.g., 160 BPM), choose an up-tempo song. If your emotional state is "excited," choose an energetic song.

[2088] 4. Obtaining disaster prevention information:

[2089] Based on the location information, the server obtains the latest disaster prevention information corresponding to the region from the disaster prevention information service API.

[2090] 5. Generating personalized information:

[2091] The system integrates the acquired map information, selected music, disaster prevention information, and the user's emotional information to generate optimal personalized information.

[2092] 6. Sending Personalized Information:

[2093] The server transmits the generated personalized information to the terminal.

[2094] Specific examples

[2095] For users running

[2096] Suppose a user is wearing a smartwatch and earphones while running. The smartwatch periodically obtains the user's current location using a GPS sensor and measures their heart rate using a heart rate sensor. For example, if the user's heart rate is 160 BPM, the device sends this information to the server. At the same time, the emotion engine uses the device's built-in camera and microphone to recognize the user's emotional state as "excited."

[2097] The server first calls a map service API based on the location information to obtain map information for the park where the user is running. Next, because the heart rate is high, it retrieves up-tempo music from a music distribution service API, and because the emotional state is "excited," it selects energetic music. It also calls a disaster prevention information service API to check disaster prevention information related to the user's current location.

[2098] The server combines this data (map information, music information, disaster prevention information) to generate personalized information optimal for the user and transmits it to the device. The device then plays the delivered music through earphones and displays the necessary information on the smartwatch screen.

[2099] Prompt Sentence Examples

[2100] "Please explain the specific steps of a system that provides real-time personalized music and map information when a user's heart rate is high and their emotional state is 'excited' while running."

[2101] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2102] Step 1: The user puts on the wearable device

[2103] The user puts on a smartwatch, earphones, or other wearable device, which then prepares the device to acquire the user's location, heart rate, and emotional information. The input for this step is the user, and the output is the wearable device.

[2104] Step 2: The device acquires location information

[2105] The device uses the built-in GPS sensor to obtain the user's current location. For example, if the user is in a park, the device obtains the location coordinates. The input is the signal from the GPS sensor, and the output is the location coordinate data (e.g., latitude 35.6895 degrees, longitude 139.6917 degrees). The location information is updated periodically (e.g., every 5 seconds).

[2106] Step 3: Your device acquires heart rate information

[2107] The device measures the user's heart rate using a built-in heart rate sensor. For example, the heart rate is measured at 160 BPM. The input is data from the heart rate sensor, and the output is heart rate data. The heart rate information is also updated periodically (for example, every 5 seconds).

[2108] Step 4: The device acquires emotion information

[2109] The device uses a camera and microphone to analyze the user's facial expressions and tone of voice. The emotion engine processes the results of this analysis and recognizes the user's emotional state as "excitement." The input is sensor data from the camera and microphone, and the output is emotional information.

[2110] Step 5: The device sends the information to the server

[2111] The device collects location information, heart rate information, and emotion information and compiles them into packets, which are then sent to the server. The input is location information, heart rate information, and emotion information, and the output is the data sent to the server. The transmission is performed periodically.

[2112] Step 6: The server receives the information

[2113] The server receives location information, heart rate information, and emotion information sent from the device. The input is the data sent from the device, and the output is the data stored on the server.

[2114] Step 7: The server retrieves the map information

[2115] The server calls the map service API based on the received location information to obtain map information around the current location. The input is location data, and the output is map information data (e.g., obtain geographic information using the Google Maps API).

[2116] Step 8: The server selects the music

[2117] The server analyzes the received heart rate and emotional information and retrieves music from a music distribution service API that corresponds to the user's heart rate and emotional state. For example, if a user's heart rate is 160 BPM and they are in an "excited" state, it selects an up-tempo, energetic song. The input is heart rate and emotional information data, and the output is the selected music data (e.g., retrieving songs using the Spotify API).

[2118] Step 9: The server acquires disaster prevention information

[2119] The server retrieves the latest disaster prevention information for the region from the disaster prevention information service API based on the location information. The input is location information data, and the output is disaster prevention information data (e.g., using the disaster prevention information service API to retrieve the latest information for the region).

[2120] Step 10: Server generates personalized information

[2121] The server integrates the acquired map information, selected music, disaster prevention information, and emotional information to generate optimal personalized information. The input is map information, music data, disaster prevention information, and emotional information, and the output is the integrated personalized information.

[2122] Step 11: The server sends the personalized information to the device.

[2123] The server sends the generated personalized information to the terminal. The input is the personalized information data, and the output is the data sent to the terminal.

[2124] Step 12: The device analyzes the information and notifies the user.

[2125] The device analyzes the received personalized information and notifies the user of appropriate information. Specifically, map information and disaster prevention information are displayed on the smartwatch's notification screen, and selected music is played through the earphones. The input is personalized information data, and the output is the form of information provided to the user (screen display and music playback).

[2126] (Application example 2)

[2127] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2128] In modern society, the proliferation of information and the diversification of individual user needs have led to a growing need for personalized content tailored to users' real-time situations. Real-time information delivery systems based on biometric data, such as location information and heart rate, can contribute to improving user experience. However, current systems are unable to effectively integrate these data and provide personalized content that also responds to the user's emotional state. Therefore, there is a need for a system that can provide personalized information in real time based on the user's location information, heart rate information, and emotional state.

[2129] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for acquiring user location information, means for acquiring user heart rate information, means for acquiring the user's emotional state, means for transmitting the received location information, heart rate information, and emotional information to the server, means for acquiring map information near the current location from a map service based on the received location information, means for selecting appropriate music from a music distribution service based on the received heart rate information, means for generating personalized content based on the emotional state, means for acquiring the latest disaster prevention information corresponding to the region, means for generating personalized information to provide to the user by integrating the acquired map information, music, disaster prevention information, and emotional information, means for transmitting the generated personalized information to the terminal, and terminal means. This makes it possible to provide personalized information that integrates appropriate map information, music, and disaster prevention information in real time based on the user's real-time biometric data and emotional state.

[2130] "Location information" is geographical coordinate information that indicates the user's current location.

[2131] "Heartbeat information" is biological data such as heart rate and heartbeat rhythm obtained from the user's heartbeat.

[2132] "Emotional state" is information indicating the user's emotions, and refers to psychological states such as stress, relaxation, and excitement.

[2133] "Personalized information" refers to content and service information that is individually customized based on the user's location information, heart rate information, and emotional state.

[2134] "Map information" is data that indicates the topography, roads, facilities, etc. within a geographical space.

[2135] A "music distribution service" is a service that distributes music over the Internet.

[2136] "Disaster prevention information" refers to the latest information on disasters such as earthquakes, fires, and typhoons.

[2137] "Server" means a central processing unit that receives, analyzes, and processes information sent by users.

[2138] A "terminal" is a device that a user carries or wears, including a smartphone or smartwatch.

[2139] This invention is a system that acquires a user's location information, heart rate information, and emotional state in real time and provides personalized content. This system is mainly composed of three elements: a server, a terminal, and a user. Below, we will explain in detail the operation of each element and the entire system.

[2140] User

[2141] The user is a person who uses this system and provides location information, heart rate information, and emotional information. The user wears a wearable device such as a smartwatch, earphones, or smart glasses, and the information is collected and sent to the server.

[2142] Terminal

[2143] The terminal acquires information from the user and transmits it to the server. Its main functions are as follows:

[2144] 1. Location information acquisition:

[2145] The device uses the built-in GPS sensor to obtain the user's current location, which is updated periodically.

[2146] 2. Obtaining heart rate information:

[2147] The device uses a built-in heart rate sensor to measure the user's heart rate, and this information is also updated periodically.

[2148] 3. Acquiring emotional information:

[2149] Using the camera and microphone installed on the device, the emotion engine analyzes the user's facial expressions and tone of voice to recognize the user's emotions.

[2150] 4. Transmission of Information:

[2151] The processed data is sent to the server.

[2152] server

[2153] The server receives the information sent from the terminal and analyzes and processes it. The main processes are as follows:

[2154] 1. Receiving Information:

[2155] The location information, heart rate information, and emotion information transmitted from the terminal are received.

[2156] 2. Getting map information:

[2157] Based on the received location information, the map service API is called to obtain map information around the current location.

[2158] 3. Music Selection:

[2159] Based on heart rate information, the system selects appropriate music from a music streaming service API. For example, if the heart rate is high, it selects up-tempo music. It also takes into account emotional information to select music that matches the user's emotional state.

[2160] 4. Emotion-based content generation:

[2161] Based on emotional information, it generates content such as videos and podcasts that are optimal for the user's emotional state.

[2162] 5. Obtaining disaster prevention information:

[2163] The latest disaster prevention information is obtained from the disaster prevention information service API based on location information.

[2164] 6. Generating personalized information:

[2165] The acquired map information, selected music, disaster prevention information, and emotional information are integrated to generate personalized information to be provided to the user.

[2166] 7. Transmission of Information:

[2167] The final generated personalized information is transmitted to the terminal.

[2168] Specific examples

[2169] For users running

[2170] The user wears a smartwatch and earphones while running. The device acquires the user's current location information obtained by the GPS sensor and the heart rate measured by the heart rate sensor (e.g., 160 BPM). The emotion engine also recognizes the user's emotional state as "excitement." This information is periodically sent to the server.

[2171] The server calls a map service API based on the received location information to obtain map information for the park. Next, because the heart rate information is high, it retrieves up-tempo songs from a music distribution service API and selects music suitable for maintaining excitement based on the emotional state. It also calls a disaster prevention information service API to check necessary disaster prevention information.

[2172] This information is then integrated to generate personalized information, which is then sent back to the user's device. The user can then check this information on their smartwatch, and the selected music will play from the earphones.

[2173] Example prompt for a generative AI model:

[2174] "A user is feeling stressed while walking through a city. Their heart rate is 120 BPM. What content would you recommend?"

[2175] This system allows users to enjoy content that is best suited to their situation in real time.

[2176] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2177] Step 1:

[2178] Users acquire information by wearing a wearable device

[2179] Specific behavior:

[2180] Users wear wearable devices such as smartwatches, earphones, and smart glasses. The user's current location is acquired using a GPS sensor, and heart rate information is measured using a heart rate sensor. In addition, the device's built-in camera and microphone are used to analyze the user's facial expressions and tone of voice to obtain emotional information.

[2181] input:

[2182] User location information, heart rate information, emotional state

[2183] output:

[2184] Acquired location information, heart rate information, and emotional information

[2185] Step 2:

[2186] The device sends the acquired information to the server.

[2187] Specific behavior:

[2188] The device periodically collects location information, heart rate information, and emotion information, and then compiles them into packets and sends them to a server via the Internet.

[2189] input:

[2190] Acquired location information, heart rate information, and emotional information

[2191] output:

[2192] Location information, heart rate information, and emotional information sent to the server

[2193] Step 3:

[2194] The server analyzes the information it receives

[2195] Specific behavior:

[2196] The server receives location information, heart rate information, and emotion information sent from the device, analyzes the received data, and identifies ...

Claims

1. A means for acquiring user location information; means for acquiring heart rate information of a user; means for transmitting the acquired location information and heart rate information to a server; means for receiving the transmitted location information and heart rate information; means for acquiring map information of the vicinity of the current location from a map service based on the received location information; a means for selecting appropriate music from a music distribution service based on the received heart rate information; A means of obtaining the latest disaster prevention information for the area; means for integrating the acquired map information, music, and disaster prevention information to generate personalized information to be provided to a user; means for transmitting the generated personalized information to the terminal; A system including a terminal means.

2. 2. The system according to claim 1, wherein the means for acquiring the user's location information is performed using a GPS sensor.

3. 10. The system of claim 1, further comprising means for selecting tempo-controlled music based on the user's heart rate.

Images