System

Abstract

To provide a system capable of maintaining the health of an aged person and reducing the burden of caring for the aged person.SOLUTION: A system comprising: biological sensor means for measuring a vital sign; communication means for transmitting measured vital sign data to a communication terminal of a user; communication terminal means for relaying the vital sign data to a server; analysis means for analyzing the vital sign data in real time in the server; generation means for generating an individual health assistance menu based on a result of the analysis; and transmission means for transmitting the health assistance menu to the communication terminal.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] This invention relates to a system for real-time monitoring and analysis of the vital signs of elderly people, in particular, in order to solve the health management problems in an aging society. Specifically, the objective is to maintain the health of elderly people and reduce the burden of caregiving by measuring their vital signs, analyzing the data, creating a health assistance menu, and notifying abnormal values ​​as necessary. [Means for solving the problem]

[0005] To solve the above problems, the present invention provides the following: a system equipped with a biosensor for measuring vital signs, a communication unit for transmitting the measured vital sign data to a user's communication terminal, and a communication terminal for relaying the vital sign data to a server; an analysis unit for analyzing the vital sign data in real time on the server, a generation unit for generating an individual health assist menu based on the analysis results, and a transmission unit for transmitting the generated health assist menu to the communication terminal; a notification unit for presenting the health assist menu and an abnormal value notification to the user from the communication terminal, and an alert unit for sending the abnormal value notification to a relative or a medical institution.

[0006] "Vital signs" is a general term for basic physiological data related to life, such as body temperature, heart rate, blood pressure, and respiratory rate.

[0007] "Biosensor means" refers to sensors and related technology used to measure vital signs.

[0008] "Communication means" refers to the functions and technologies for transmitting measured vital sign data to the user's communication terminal.

[0009] "Communication terminal means" refers to a user's communication terminal and its related technology that receives vital sign data and relays it to the server.

[0010] "Analysis means" refers to a server and related technologies for analyzing collected vital sign data in real time.

[0011] The "generation means" refers to the technology or function for generating an individual health assistance menu based on the analyzed data.

[0012] The "transmission means" refers to a function or technique for transmitting the generated health assistance menu to the communication terminal.

[0013] The "notification means" refers to a function or technology for presenting a health assistance menu and abnormal value notification to a user from a communication terminal.

[0014] "Alert means" refers to a function or technology for sending a notification to relatives or a medical institution when an abnormal value is detected. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] The present invention relates to an AI-powered smart earphone system that supports health management for the elderly. The system includes a biosensor for measuring vital signs, a communication unit, an analysis unit, a generation unit, a transmission unit, a notification unit, and an alert unit.

[0037] System Configuration

[0038] The monitoring AI smart earphone system consists of an earphone device worn by the user, the user's communication device (such as a smartphone or tablet), and a cloud server.

[0039] The earphone device is equipped with biometric sensors that measure the user's temperature, heart rate, blood pressure, and respiratory rate.

[0040] The communication terminal receives vital sign data transmitted via Bluetooth from the earphone device and relays the data to a cloud server.

[0041] The cloud server analyzes the received data in real time and generates a health assistance menu for each user.

[0042] Program processing

[0043] The operation of the system will be explained by dividing it into processing steps.

[0044] Vital sign measurement and data transmission

[0045] Terminal (earphone device): The earphones have built-in biosensors that periodically measure the user's body temperature, heart rate, blood pressure, and respiratory rate. The measured data is then sent via Bluetooth to the user's communication terminal.

[0046] Receiving and storing data

[0047] Communication terminal (smartphone): Received vital sign data is temporarily stored in local storage, and the data is also sent to a cloud server via the Internet.

[0048] Data analysis

[0049] Server: The cloud server receives data from the communication device and stores it in a database. Using a generative AI model, the received vital sign data is analyzed in real time to detect abnormal values ​​and evaluate health status.

[0050] Health assistance menu generation

[0051] Server: Based on the analysis results, the server generates an optimal health assistance menu for each user. The menu includes diet, exercise, sleep, and brain training, and is customized according to the user's health condition.

[0052] Assist menu and sending notifications

[0053] Server: After generating the optimal health assistance menu for the user, the server sends it to the user's communication device. If an abnormal value is detected, the server also sends an alert to pre-registered relatives and medical institutions.

[0054] User notification and assistance

[0055] Communication device (smartphone): The received health assistance menu is notified to the user as a voice guide. If an abnormal value is detected, it also notifies relatives and medical institutions.

[0056] Specific examples

[0057] As a specific example, consider a situation where user C is wearing AI-enabled smart earphones.

[0058] Vital sign measurement and data transmission

[0059] Terminal (earphone device): The earphone measures C's body temperature, heart rate, blood pressure, and respiratory rate. The data is sent to C's smartphone via Bluetooth.

[0060] Receiving and storing data

[0061] Communication terminal (smartphone): The smartphone receives the data and stores it in local storage. At the same time, it sends the data to the cloud server.

[0062] Data analysis

[0063] Server: The cloud server receives the data and begins analysis. The analysis reveals that Mr. C's heart rate is higher than normal.

[0064] Health assistance menu generation

[0065] Server: The generative AI generates a health assistance menu based on abnormal heart rate, such as relaxation exercises and low-salt meals.

[0066] Assist menu and sending notifications

[0067] Server: Sends the generated menu to Mr. C's smartphone. Also sends an alert to his son if his heart rate is abnormal.

[0068] User notification and assistance

[0069] Communication device (smartphone): The smartphone sends a voice guide to Mr. C about the menu he received. An alert is also sent to his son.

[0070] The above is a specific embodiment of the AI ​​smart earphone system for monitoring elderly people according to the present invention. This system enables more effective health management for elderly people, early detection of abnormalities, and prompt response.

[0071] The processing flow will be explained below.

[0072] Step 1:

[0073] Terminal (earphone device): The biosensor built into the earphone measures the user's body temperature, heart rate, blood pressure, and respiratory rate. The sensor is set to automatically measure at regular intervals.

[0074] Step 2:

[0075] Terminal (earphone device): The measured vital sign data is sent to the user's communication terminal (smartphone) via Bluetooth. The data is encrypted during transmission to prevent data leakage.

[0076] Step 3:

[0077] User's communication device (smartphone): The received vital sign data is stored in the smartphone's local storage. At the same time, the data is sent from the smartphone to a cloud server via the Internet. The data is also encrypted during transmission.

[0078] Step 4:

[0079] Server: The cloud server receives vital sign data sent from the user's communication device. The received data is stored in a database and analyzed in real time.

[0080] Step 5:

[0081] Server: Analyzes the received data using a generative AI model. The analysis checks the data for anomalies and assesses the user's health status. For example, a higher-than-normal heart rate or sudden fluctuations in blood pressure can be detected.

[0082] Step 6:

[0083] Server: Based on the analysis results, a personalized health assistance menu is generated for each user. The generated menu includes specific suggestions for diet, exercise, sleep, and brain training. For example, if a person's heart rate is high, relaxation exercises will be suggested, and if blood pressure is high, a low-salt meal menu will be presented.

[0084] Step 7:

[0085] Server: Sends the generated health assistance menu to the user's communication device (smartphone). At the same time, if abnormal values ​​are detected in the vital signs, an alert is sent to pre-registered relatives or medical institutions.

[0086] Step 8:

[0087] User's communication device (smartphone): The received health assistance menu is notified to the user via voice guidance and a visual interface. The voice guidance provides easy-to-understand explanations of the specific health assistance content. In addition, if an abnormal value is detected, an alert is sent to relatives and medical institutions.

[0088] Step 9:

[0089] User: Follow the instructions on the smartphone to begin implementing the health assistance menu, such as performing relaxation exercises, eating the recommended diet, and creating an appropriate sleeping environment.

[0090] The above is the specific program processing of the monitoring AI smart earphone system, which will monitor the health status of elderly people in real time and enable optimal health management.

[0091] Example 1

[0092] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0093] While appropriate measurement and analysis of vital signs is important for the health management of elderly people, there is currently a lack of systems that can do this efficiently and in real time. Furthermore, while early detection of abnormal values ​​and appropriate responses are required, conventional systems have difficulty in providing prompt notifications and generating individually customized health assistance menus. The purpose of this invention is to solve these problems and provide a system for more effective health management of elderly people.

[0094] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0095] In this invention, the server includes a biosensor for measuring vital signs, a communication device for transmitting the measured vital sign data to the user's communication device, a communication device for relaying the vital sign data to the server, an analysis device for analyzing the vital sign data in real time at the server, a generation device for generating a personalized health assist menu based on the analysis results, a transmission device for transmitting the health assist menu to the communication device, a notification device for presenting the health assist menu and an abnormal value notification to the user from the communication device, an alert device for sending the abnormal value notification to a relative or a medical institution, a storage device for temporarily storing the vital sign data in local storage upon receiving the data, a transmission device for transmitting the data via Bluetooth or the Internet, a notification device for notifying a relative or a medical institution using an alert generated when an abnormal value is detected, and a generation device for generating a health assist menu using a generative AI model. This enables real-time monitoring of the health of elderly people, enabling early detection and prompt response to abnormalities. Furthermore, providing a personalized health assist menu can be expected to improve the subject's health.

[0096] "Vital signs" are physiological indicators used to assess health status and generally include temperature, heart rate, blood pressure, and respiratory rate.

[0097] "Biosensor means" refers to devices or components used to measure a user's vital signs, and typically includes a thermometer, heart rate sensor, blood pressure monitor, respiratory sensor, etc.

[0098] "Communication means" refers to the technology and devices for transmitting measured vital sign data to the user's communication terminal, and includes wireless communication technologies such as Bluetooth and Wi-Fi.

[0099] The "communication terminal means" is a device used by a user, such as a smartphone or tablet, that receives vital sign data and relays it to a server via the Internet.

[0100] "Analysis means" refers to the technology and algorithms for analyzing vital sign data received by the server in real time, including the generative AI model.

[0101] "Generation means" refers to the technology and process for generating an individual health assistance menu based on the analysis results, and includes suggestions for diet, exercise, sleep, and brain training.

[0102] The "transmission means" refers to the technology and device for transmitting the generated health assistance menu to the user's communication terminal, and includes the Internet and wireless communication technology.

[0103] "Notification means" refers to the technology and process for presenting the health assistance menu and abnormal value notifications to the user from the user's communication terminal, and includes voice guidance and push notifications, etc.

[0104] "Alert Method" means the technology and process for sending abnormal value notifications to relatives or healthcare providers, including SMS, email, or app notifications.

[0105] "Storage means" refers to the technology and devices for temporarily storing vital sign data in local storage when it is received, and includes databases and file systems within the smartphone.

[0106] "Generative AI model" refers to the artificial intelligence algorithm used to analyze vital sign data and generate health assistance menus.

[0107] "Bluetooth" is a type of short-range wireless communication technology used to transmit vital sign data from an earphone device to a user's communication terminal.

[0108] "Internet" is a global network for transmitting data to remote servers and is used for cloud transmission of vital signs data.

[0109] The "health assistance menu" is a personalized proposal generated based on the user's health status, and includes specific action plans for diet, exercise, sleep, and brain training.

[0110] This invention relates to an AI-powered smart earphone system for managing the health of elderly people. This system uses biosensors, communication terminals, and a cloud server to monitor users' health information in real time, detect abnormalities early, and take appropriate measures.

[0111] System Configuration

[0112] The monitoring AI smart earphone system includes the following components:

[0113] Earbud device: Equipped with biometric sensors, it measures the user's temperature, heart rate, blood pressure, and respiratory rate.

[0114] Communication terminal: A smartphone or tablet that receives vital sign data transmitted via Bluetooth from the earphone device and relays the data to a cloud server.

[0115] Cloud server: Analyzes the received data in real time and generates a health assistance menu for each user.

[0116] Hardware and Software Configuration

[0117] earphone device

[0118] The earphone device is equipped with multiple biosensors, including a thermometer, heart rate sensor, blood pressure monitor, and respiratory sensor, and is also equipped with a Bluetooth module that transmits the measured data to a communication terminal.

[0119] communication terminal

[0120] The communication terminals used are smartphones, tablets, etc. These terminals have the function of receiving data from the earphone device via Bluetooth and temporarily storing it in their internal local storage. They also have a transmission function, which sends the data to a cloud server via the Internet.

[0121] Cloud Server

[0122] The cloud server is equipped with an analysis system that includes a database and a generative AI model. The received vital sign data is stored in the server's database and analyzed in real time. Based on the analysis results, a health assistance menu customized for each user is generated.

[0123] Specific examples

[0124] User C's scenario

[0125] When user C is wearing the monitoring AI smart earphones, the following specific actions will occur:

[0126] 1. Earphone device: The earphone measures C's body temperature, heart rate, blood pressure, and respiratory rate and transmits the data to C's smartphone via Bluetooth.

[0127] 2. Communication terminal: The smartphone receives the data, stores it in local storage, and simultaneously transmits the data to the cloud server.

[0128] 3. Cloud server: The cloud server receives the data and begins analysis using the generative AI model. For example, if Mr. C’s heart rate is higher than normal, it will be determined to be abnormal.

[0129] 4. Generating a health assistance menu: Based on the analysis results, a health assistance menu such as relaxation exercises and low-salt meals is generated.

[0130] 5. Notifications and alerts: The generated menu is sent to Mr. C's smartphone and notified as an audio guide. At the same time, if an abnormal value is detected, an alert is sent to Mr. C's relatives and medical institutions.

[0131] Prompt Sentence Examples

[0132] "I would like to develop an AI system to support the health management of elderly people. I would like to measure vital signs using an earphone device and analyze the data in the cloud. Specifically, what kind of prompts would be appropriate?"

[0133] This system will enable efficient health management for users, enabling early detection and response of abnormalities. Furthermore, by providing individually customized health assistance menus, it is expected that users' health conditions will improve.

[0134] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0135] Step 1: Measuring vital signs with biosensors

[0136] Terminal (earphone device): The biosensors built into the earphones measure the user's body temperature, heart rate, blood pressure, and respiratory rate. Specifically, a temperature sensor is used for body temperature, a photoelectric pulse sensor for heart rate, a pressure sensor for blood pressure, and an acceleration sensor for respiratory rate. The measured data (body temperature: 36.5°C, heart rate: 75 bpm, blood pressure: 120 / 80 mmHg, respiratory rate: 18 breaths / min) is sent to the next step via Bluetooth communication.

[0137] Input: User's vital signs (temperature, heart rate, blood pressure, respiratory rate)

[0138] Output: Measured vital signs data

[0139] Step 2: Sending data

[0140] Terminal (earphone device): The measured vital sign data is sent to the user's communication terminal via Bluetooth. Specifically, the earphone device turns on Bluetooth and sends a data packet to the paired communication terminal.

[0141] Input: Measured vital signs data

[0142] Output: Data sent via Bluetooth communication

[0143] Step 3: Receiving and saving data (communication terminal)

[0144] Communication terminal (smartphone): The data sent from the earphone device is received using a Bluetooth receiving module and temporarily stored in the smartphone's local storage. Specifically, the received data is structured in JSON format and written to a database such as SQLite. For example, "Body temperature: 36.5°C, heart rate: 75 bpm, blood pressure: 120 / 80 mmHg, respiratory rate: 18 breaths / min" is stored.

[0145] Input: Vital signs data sent via Bluetooth communication

[0146] Output: Data saved in local storage

[0147] Step 4: Send data to the cloud

[0148] Communication terminal (smartphone): Sends temporarily stored vital sign data to a cloud server via the Internet. Specifically, it generates an HTTP request and uses a REST API to send the data to the cloud server's endpoint. The data is encrypted using SSL / TLS.

[0149] Input: Data stored in local storage

[0150] Output: Data sent to the cloud server

[0151] Step 5: Receiving data on the cloud server for analysis

[0152] Server: The cloud server receives the data sent from the communication device and stores it in an internal database. Specifically, it analyzes the received JSON format data and inserts it into the database. For example, it stores "body temperature: 36.5°C, heart rate: 75 bpm, blood pressure: 120 / 80 mmHg, respiratory rate: 18 breaths / min."

[0153] Input: Data sent to the cloud server

[0154] Output: Data stored in the database

[0155] Step 6: Data analysis using analytical algorithms

[0156] Server: Analyzes received vital sign data in real time using a generative AI model. Specifically, it retrieves data from the database, detects abnormal values, and evaluates health status. For example, it applies logic that determines an abnormality when the heart rate is 90 bpm or higher.

[0157] Input: Data stored in a database

[0158] Output: Analysis results (e.g. high heart rate)

[0159] Step 7: Create a Health Assist Menu

[0160] Server: Generates a health assistance menu based on the analysis results. The generation AI creates suggestions such as "dietary advice," "exercise plans," "tips for improving sleep quality," and "brain training" based on the user's health condition. For example, if the heart rate is high, it suggests "one minute of relaxing breathing exercises."

[0161] Input: Analysis results

[0162] Output: Health Assist Menu

[0163] Step 8: Assist Menu and Sending Alerts

[0164] Server: Sends the generated health assistance menu to the user's communication device, and if an abnormal value is detected, sends an alert message to relatives or medical institutions. Specifically, it generates an HTTP request and sends it to the communication device and the device to which the alert is sent.

[0165] Input: Health Assist Menu, Abnormal Value Detection

[0166] Output: Menu sent to user's communication device, notification sent as alert

[0167] Step 9: Inform and assist users

[0168] Communication device (smartphone): The received health assistance menu is notified to the user as a voice guide. If an abnormal value is detected, an alert is sent to relatives and medical institutions as well. Specifically, the smartphone's voice synthesis function is used to notify the user through the earphone device, saying, "Try relaxing breathing exercises." In addition, SMS and app notifications are used to notify relatives that "your heart rate is high."

[0169] Input: Health Assist Menu, Alert

[0170] Output: Audio instructions to user, notification to relatives

[0171] At each processing step of this system, the user, device, and server work together to effectively manage and assist the health of elderly people. By providing individual health assistance menus based on the analysis results, it is expected that health conditions will improve.

[0172] (Application example 1)

[0173] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0174] Health management for the elderly is an important social issue, and there is a need for early detection of abnormalities in elderly people living independently and rapid response. However, conventional health management systems have problems in that it is difficult to generate assistance menus appropriate for individual health conditions, and they are unable to notify or respond quickly in emergencies. Furthermore, because it is necessary to provide accurate and prompt information not only to the elderly themselves but also to their relatives and medical institutions, a system with advanced analytical functions is required.

[0175] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0176] In this invention, the server includes an analysis means for analyzing vital sign data in real time, a generation means for generating an individual health support menu based on the analysis results using a generative AI model, and a transmission means for individually customizing and transmitting the health support menu using prompt text. This makes it possible to monitor the health status of elderly people in real time, detect abnormalities early, and provide individually customized health support menus. In addition, since relatives and medical institutions can be quickly notified in the event of an abnormality, a system can be realized that effectively supports emergency response.

[0177] "Vital signs" are basic physiological indicators related to maintaining human life, such as body temperature, heart rate, blood pressure, and respiratory rate.

[0178] A "biosensor" is a device that is attached to the human body to measure vital signs.

[0179] "Communication means" is a function for transmitting measured vital sign data to a personal communication device.

[0180] A "communications terminal" is a device for relaying vital signs data to a central system.

[0181] The "central system" is a system such as a server that receives and analyzes vital sign data and generates a health support menu.

[0182] The "analysis means" is a function for analyzing vital sign data in real time.

[0183] The "generation means" is a function for generating an individual health support menu based on the analysis results.

[0184] The "transmission means" is a function for transmitting the generated health support menu to an individual's communication device.

[0185] "Notification means" is a function for providing individuals with health support menus and abnormal value notifications.

[0186] "Alert means" is a function for sending emergency notifications to relatives and medical institutions when abnormal values ​​are detected.

[0187] A "generative AI model" is an artificial intelligence model that uses generated algorithms to analyze data and generate a health support menu.

[0188] A "prompt sentence" is an instruction sentence input to a generative AI model and is used during analysis and menu generation.

[0189] This invention relates to an AI-powered smart earphone system that supports the health management of elderly people. This system combines a biosensor, a communication terminal, an analysis unit, a generation unit, a transmission unit, a notification unit, an alert unit, a generation AI model, and a prompt sentence.

[0190] The system consists of an earphone device worn by the user, the user's communication terminal (e.g., a smartphone), and a cloud server.

[0191] The earphone device is equipped with built-in biosensors that can measure vital signs such as body temperature, heart rate, blood pressure, and respiratory rate, and transmits this data via Bluetooth to the user's communication device.

[0192] The communication device (such as a smartphone) temporarily stores the vital sign data received from the earphone device via Bluetooth in local storage, and then transmits the data to a cloud server via the Internet.

[0193] The cloud server analyzes vital sign data in real time using a generative AI model. Based on the analysis results, a personalized health support menu is generated, including diet, exercise, sleep, and mental training. The generated menu is customized for each user using prompts.

[0194] As a concrete example, when user C is wearing the AI ​​monitoring smart earphones, the earphone device measures C's body temperature, heart rate, blood pressure, and respiratory rate, and sends the data to C's smartphone via Bluetooth. The smartphone then sends the data to a cloud server, where the generative AI model begins analysis.

[0195] For example, the generative AI model performs an analysis based on the prompt, "If the heart rate is 85 or higher, it is determined to be a risk and a health support menu will be generated." As a result, advice such as relaxation exercises and a low-salt diet is generated and sent to User C's smartphone. Additionally, if an abnormal value is detected, an emergency notification is sent to pre-registered relatives and medical institutions.

[0196] This makes it possible to monitor the health status of elderly people in real time, detect abnormalities early, and provide a system that can take appropriate action quickly.

[0197] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0198] Step 1:

[0199] The biosensor built into the earphone device measures the user's vital signs (body temperature, heart rate, blood pressure, respiratory rate). The measurement data is converted into digital signals and sent to the user's communication device via Bluetooth. The input is sensor data, and the output is data sent to the communication device.

[0200] Step 2:

[0201] The terminal (communication device) receives vital sign data from the earphone device via Bluetooth and temporarily stores it in local storage. The stored data is then sent to a cloud server via the Internet. The input is a Bluetooth signal, and the output is data sent to the cloud server.

[0202] Step 3:

[0203] The server receives vital sign data sent from the communication device and stores it in a database. Based on the stored data, it analyzes the data in real time using a generative AI model. The input is the received vital sign data, and the output is the analysis results.

[0204] Step 4:

[0205] The server uses a generative AI model to generate an individual health support menu based on the analysis results. A menu customized for each user is generated using a prompt. For example, based on the prompt "If the heart rate is 85 or higher, determine that there is a risk and generate a health support menu." The input is the analysis results, and the output is a customized health support menu.

[0206] Step 5:

[0207] The server transmits the generated health support menu to the user's communication device, where the input is the generated health support menu and the output is the transmission of the menu.

[0208] Step 6:

[0209] The terminal (communication device) receives a health support menu and notifies the user as a voice guide. If an abnormal value is detected, an alert notification is sent to pre-registered relatives and medical institutions. The input is the received support menu and abnormal value notification, and the output is a notification to the user, relatives, and medical institutions.

[0210] Through these steps, the system can monitor the elderly person's vital signs in real time, provide appropriate health support menus, and quickly notify in the event of an abnormality.

[0211] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0212] This invention relates to an AI-powered smart earphone system that supports the health management of elderly people. The system includes a biosensor for measuring vital signs, a communication unit, an analysis unit, a generation unit, a transmission unit, a notification unit, an alert unit, and an emotion engine that recognizes the user's emotions.

[0213] System Configuration

[0214] The monitoring AI smart earphone system consists of an earphone device worn by the user, the user's communication device (such as a smartphone or tablet), a cloud server, and an emotion engine.

[0215] Earphone device: Equipped with biosensors, it measures the user's temperature, heart rate, blood pressure, and respiratory rate.

[0216] Communication terminal: Receives vital sign data sent via Bluetooth from the earphone device and relays the data to a cloud server.

[0217] Cloud server: Analyzes the received data in real time and generates a health assistance menu for each user.

[0218] Emotion engine: Recognizes the user's emotional state by analyzing voice and facial expression data.

[0219] Program processing

[0220] The operation of the system will be explained by dividing it into processing steps.

[0221] Vital sign measurement and data transmission

[0222] Terminal (earphone device): The earphones have built-in biosensors that periodically measure the user's body temperature, heart rate, blood pressure, and respiratory rate. The measured data is then sent via Bluetooth to the user's communication terminal.

[0223] Receiving and storing data

[0224] Communication terminal (smartphone): Received vital sign data is stored in the smartphone's local storage, and the data is also sent from the smartphone to a cloud server via the Internet.

[0225] Data analysis

[0226] Server: The cloud server receives data from the communication device and stores it in a database. Using a generative AI model, the received vital sign data is analyzed in real time to detect abnormal values ​​and evaluate health status.

[0227] Recognition of emotional states

[0228] Server: The emotion engine analyzes the user's voice and facial expression data to recognize their emotional state. For example, it determines whether the user is feeling stressed or tired from the voice data.

[0229] Health assistance menu generation

[0230] Server: Generates an optimal health assistance menu for each user based on the analysis results and the emotional state determined by the emotion engine. The menu includes diet, exercise, sleep, and brain training. Based on the emotional state, if the user is feeling stressed, relaxation exercises and music will be suggested, and if the user is feeling tired, a menu that prioritizes rest will be generated.

[0231] Assist menu and sending notifications

[0232] Server: Sends the generated health assistance menu to the user's communication device (smartphone). If abnormalities are detected in the user's vital signs or emotional state, it sends alerts to pre-registered relatives and medical institutions.

[0233] User notification and assistance

[0234] Communication device (smartphone): The received health assistance menu is notified to the user via voice guidance and a visual interface. The voice guidance provides easy-to-understand explanations of the specific health assistance content. In addition, if an abnormality is detected, an alert is sent to relatives and medical institutions.

[0235] Specific examples

[0236] As a specific example, consider a situation where user D is wearing AI-enabled smart earphones.

[0237] Vital sign measurement and data transmission

[0238] Terminal (earphone device): The earphone measures D's body temperature, heart rate, blood pressure, and respiratory rate. The data is sent to D's smartphone via Bluetooth.

[0239] Receiving and storing data

[0240] Communication terminal (smartphone): The smartphone receives the data and stores it in local storage. At the same time, it sends the data to the cloud server.

[0241] Data analysis

[0242] Server: The cloud server receives the data and begins analysis. The analysis reveals that Mr. D's blood pressure is higher than normal.

[0243] Recognition of emotional states

[0244] Server: The emotion engine recognizes Mr. D's stress level from his voice and facial expressions.

[0245] Health assistance menu generation

[0246] Server: Generates a health assistance menu including relaxation exercises and music based on abnormal heart rate and stress levels.

[0247] Assist menu and sending notifications

[0248] Server: Sends the generated menu to Mr. D's smartphone. It also sends alerts to his relatives about his stress level and abnormal blood pressure.

[0249] User notification and assistance

[0250] Communication device (smartphone): The smartphone receives the menu and notifies Mr. D of it as an audio guide. Alerts are also sent to his relatives.

[0251] The above is a specific embodiment of the AI-powered smart earphone system of the present invention. This system monitors the health status of elderly people in real time, enabling optimal health management. Furthermore, the introduction of an emotion engine realizes comprehensive health assistance that also takes into account the user's mental health.

[0252] The processing flow will be explained below.

[0253] Step 1:

[0254] Terminal (earphone device): The biosensor built into the earphone measures the user's body temperature, heart rate, blood pressure, and respiratory rate. The sensor is set to automatically measure at regular intervals.

[0255] Step 2:

[0256] Terminal (earphone device): The measured vital sign data is sent to the user's communication terminal (smartphone) via Bluetooth. The data is encrypted during transmission to prevent data leakage.

[0257] Step 3:

[0258] User's communication device (smartphone): The received vital sign data is stored in the smartphone's local storage. The data is also sent from the smartphone to a cloud server via the Internet. The data is also encrypted during transmission.

[0259] Step 4:

[0260] Server: The cloud server receives vital sign data sent from the user's communication device. The received data is stored in a database and analyzed in real time.

[0261] Step 5:

[0262] Server: Analyzes the received vital signs data in real time using a generative AI model. The analysis checks for abnormalities in the data and evaluates the user's health status. For example, a high heart rate or sudden fluctuations in blood pressure can be detected.

[0263] Step 6:

[0264] Server: The emotion engine analyzes the user's voice and facial expression data to recognize their emotional state. For example, it can detect stress or fatigue from the tone of their voice and the content of their words.

[0265] Step 7:

[0266] Server: Generates the optimal health assistance menu for each user based on the analysis results and the emotional state of the user as determined by the emotion engine. For example, it suggests relaxation exercises for a user feeling stressed, and creates a menu that prioritizes rest for a user feeling fatigued.

[0267] Step 8:

[0268] Server: Sends the generated health assistance menu to the user's communication device. If abnormal values ​​or emotional state problems are detected, an alert is sent to pre-registered relatives or medical institutions.

[0269] Step 9:

[0270] User's communication device (smartphone): The health assistance menu is notified to the user through voice guidance and a visual interface. The notification includes specific health assistance content (e.g., relaxation exercises, recommended meals, rest methods, etc.).

[0271] Step 10:

[0272] User: Follows the instructions on the smartphone to carry out the health assistance menu, such as performing relaxation exercises, eating recommended meals, and creating an appropriate sleeping environment.

[0273] The above is the specific program processing of the AI ​​smart earphone monitoring system that combines an emotion engine. This system comprehensively manages the user's health, enabling early detection of abnormalities and rapid response. Furthermore, the introduction of the emotion engine realizes optimal health assistance that also takes the user's mental health into consideration.

[0274] Example 2

[0275] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0276] Health management for the elderly requires real-time monitoring of their health status and prompt notification when abnormalities are detected. Health management also requires a comprehensive approach that considers not only the user's physical data but also their emotional state. However, conventional systems have difficulty in managing health while taking emotional state into account, and have been unable to provide real-time notifications or take appropriate measures when abnormalities are detected.

[0277] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0278] In this invention, the server includes an analysis means including an emotion engine, a generation means for generating a health assistance menu based on the analysis results and the emotional state using a generative AI model, and an alert means for sending an abnormal value notification to a relative or a medical institution. This enables comprehensive analysis of the user's physical data and emotional state, enabling appropriate health management in real time and prompt alert notification.

[0279] "Vital signs" are basic physiological indicators of the human body, such as body temperature, heart rate, blood pressure, and respiratory rate.

[0280] A "biosensor means" is a sensor device used to measure a user's vital signs.

[0281] "Communication means" refers to a means for transmitting measured vital sign data to other terminals or systems.

[0282] The "communication terminal means" is a means for relaying data to the cloud computing system using a user's communication terminal.

[0283] The "analysis means" is a means for analyzing vital sign data received by the cloud computing system in real time.

[0284] A "generative AI model" is a model that uses artificial intelligence technology to analyze vital sign data and emotional data and recognize abnormal values ​​and emotional states.

[0285] An "emotion engine" is a technology that analyzes a user's voice and facial expression data to recognize their emotional state.

[0286] The "generation means" is a means for generating an individual health assistance menu based on the analysis results and the emotional state.

[0287] The "transmission means" is a means for transmitting the generated health assistance menu to the user's communication terminal.

[0288] The "notification means" is a means for presenting the health assistance menu and abnormal value notification to the user.

[0289] The "alert means" is a means for sending an abnormal value notification to a relative or a medical institution.

[0290] A "health assist menu" is a set of individually customized instructions and advice provided to improve and maintain the user's health.

[0291] This invention relates to an AI-powered smart earphone system for supporting elderly health management. The system includes a biosensor for measuring vital signs, a communication unit, an analysis unit, a generation unit, a transmission unit, a notification unit, an alert unit, and an emotion engine for recognizing the user's emotions.

[0292] System Configuration

[0293] The monitoring AI smart earphone system consists of an earphone device worn by the user, the user's communication device (such as a smartphone or tablet), a cloud computing system, and an emotion engine.

[0294] Earphone device: Equipped with biosensors, it measures the user's temperature, heart rate, blood pressure, and respiratory rate.

[0295] Communication terminal: Receives vital sign data transmitted via Bluetooth from the earphone device and relays the data to the cloud computing system.

[0296] Cloud computing system: Analyzes the received data and generates a health assistance menu for each user using a generative AI model.

[0297] Emotion engine: Recognizes the user's emotional state by analyzing voice and facial expression data.

[0298] Vital sign measurement and data transmission

[0299] Terminal (earphone device): The earphones have built-in biosensors that periodically measure the user's body temperature, heart rate, blood pressure, and respiratory rate. The measured data is then sent via Bluetooth to the user's communication terminal.

[0300] Receiving and storing data

[0301] Communication terminal (smartphone): The received vital sign data is stored in the smartphone's local storage, and the data is also sent from the smartphone to a cloud computing system via the Internet.

[0302] Data analysis

[0303] Server (cloud computing system): The cloud server receives data from the communication device and stores it in a database. Using a generative AI model, the received vital sign data is analyzed in real time to detect abnormal values ​​and evaluate health status.

[0304] Recognition of emotional states

[0305] Server: The emotion engine analyzes the user's voice and facial expression data to recognize their emotional state. For example, it determines whether the user is feeling stressed or tired from the voice data.

[0306] Health assistance menu generation

[0307] Server: Generates an optimal health assistance menu for each user based on the analysis results and the emotional state of the emotion engine. The menu includes diet, exercise, sleep, and brain training. Based on the emotional state, if the user is feeling stressed, relaxation exercises and music will be suggested. If the user is feeling tired, a menu that prioritizes rest will be generated.

[0308] Assist menu and sending notifications

[0309] Server: Sends the generated health assistance menu to the user's communication device (smartphone). If abnormalities are detected in the user's vital signs or emotional state, it sends alerts to pre-registered relatives and medical institutions.

[0310] User notification and assistance

[0311] Communication device (smartphone): The received health assistance menu is notified to the user via voice guidance and a visual interface. The voice guidance provides easy-to-understand explanations of the specific health assistance content. In addition, if an abnormality is detected, an alert is sent to relatives and medical institutions.

[0312] Specific examples

[0313] As a specific example, consider a situation where a user is wearing AI-enabled smart earphones.

[0314] Vital sign measurement and data transmission

[0315] Terminal (earphone device): The earphone measures the user's temperature, heart rate, blood pressure, and respiratory rate. The data is sent to the user's smartphone via Bluetooth.

[0316] Receiving and storing data

[0317] Communication terminal (smartphone): The smartphone receives the data and stores it in local storage, while simultaneously transmitting the data to the cloud computing system.

[0318] Data analysis

[0319] Server: The cloud server receives the data and begins analysis, which reveals that the user's blood pressure is higher than normal.

[0320] Recognition of emotional states

[0321] Server: The emotion engine recognizes the user's stress level from their voice and facial expressions.

[0322] Health assistance menu generation

[0323] Server: Generates a health assistance menu including relaxation exercises and music based on abnormal heart rate and stress levels.

[0324] Assist menu and sending notifications

[0325] Server: Sends the generated menu to the user's smartphone, and also sends alerts to relatives about stress levels and abnormal blood pressure.

[0326] User notification and assistance

[0327] Communication device (smartphone): The smartphone receives the menu and notifies the user as a voice guide. Alerts are also sent to relatives.

[0328] The above is a specific embodiment of the AI-powered smart earphone system of the present invention. This system monitors the health status of elderly people in real time, enabling optimal health management. Furthermore, the introduction of an emotion engine realizes comprehensive health assistance that also takes into account the user's mental health.

[0329] Example prompts for generative AI models

[0330] "Write a program that analyzes the user's biometric data (body temperature, heart rate, blood pressure, respiratory rate) and voice data, detects abnormal values, recognizes emotional state, and generates an optimal health assistance menu."

[0331] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0332] Step 1:

[0333] User: The user puts on the earbud device. The earbuds use built-in biometric sensors to measure the user's temperature, heart rate, blood pressure, and respiratory rate.

[0334] Input: User's vital signs (temperature, heart rate, blood pressure, respiratory rate)

[0335] Output: Measured vital signs data

[0336] Specific behavior:

[0337] The earphone device measures body temperature (36.5 degrees), heart rate (72), blood pressure (130 / 80), and respiratory rate (15).

[0338] Step 2:

[0339] Terminal (earphone device): Measured vital sign data is sent to the user's communication terminal (smartphone) via Bluetooth.

[0340] Input: Measured vital signs data

[0341] Output: Vital signs data transmitted via Bluetooth

[0342] Specific behavior:

[0343] The earphone device sends the measurement data to a smartphone via Bluetooth.

[0344] Step 3:

[0345] Communication terminal (smartphone): Stores the received vital sign data in local storage and transmits the data to a cloud computing system via the Internet.

[0346] Input: Vital signs data received via Bluetooth

[0347] Output: Data stored in local storage and data sent to the cloud

[0348] Specific behavior:

[0349] The smartphone stores the data received from the earphones and sends it to a cloud server.

[0350] Step 4:

[0351] Server (cloud computing system): Receives vital sign data sent from the communication device and stores it in a database. It analyzes the data in real time using a generative AI model to detect abnormal values.

[0352] Input: Vital signs data sent to the cloud

[0353] Output: Data stored in the database and analysis results (presence or absence of outliers)

[0354] Specific behavior:

[0355] The cloud server receives the data, stores it in a database, and detects that the blood pressure is higher than normal (150 / 90).

[0356] Step 5:

[0357] Server: The emotion engine analyzes the user's voice and facial expression data to recognize their emotional state.

[0358] Input: User voice or facial expression data

[0359] Output: Perceived emotional state (e.g., stress state)

[0360] Specific behavior:

[0361] The server analyzes the voice saying "I'm a little busy" and recognizes that Mr. D is in a stressful state.

[0362] Step 6:

[0363] Server: Generates the optimal health assistance menu for each user based on the analysis results and emotional state.

[0364] Input: Analysis results and emotional state

[0365] Output: Health Assist Menu

[0366] Specific behavior:

[0367] Based on abnormal heart rate and stress levels, a health assistance menu including relaxation exercises and relaxation music is generated.

[0368] Step 7:

[0369] Server: Sends the generated health assistance menu and abnormality notifications to the user's communication device. If an abnormality is detected, it also sends an alert to relatives and medical institutions.

[0370] Input: Health Assist menu and abnormal data

[0371] Output: Sending to communication terminal and sending alerts

[0372] Specific behavior:

[0373] The server sends a menu of relaxation exercises to the smartphone and sends alerts about stress and high blood pressure to relatives.

[0374] Step 8:

[0375] Communication device (smartphone): The received health assistance menu is notified to the user via voice guidance and a visual interface. If an abnormality is detected, an alert is sent to relatives and medical institutions.

[0376] Input: Health Assist Menu and Alert Notifications

[0377] Output: User notification and alert to relatives or medical facility

[0378] Specific behavior:

[0379] The smartphone will start playing relaxation music and will also play a voice prompt saying, "Please do some relaxation exercises." At the same time, an alert will be sent to relatives.

[0380] (Application example 2)

[0381] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0382] In modern society, managing the health status of elderly people in real time and providing optimal health assistance is an important issue. Conventional health management systems simply measure vital signs and are unable to provide comprehensive health assistance based on the user's emotional state or stress level. Furthermore, although the dietary habits of elderly people have a significant impact on their health, there has been a lack of systems that provide optimal meal plans and allow easy ordering of meals. This makes it difficult for elderly people to manage their health in their daily lives.

[0383] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0384] In this invention, the server includes a biosensor means for measuring vital signs, a communication means for transmitting the measured vital sign data to the user's communication terminal, a communication terminal means for relaying the vital sign data to the server, an analysis means for analyzing the vital sign data in real time at the server, a generation means for generating an individual health assist menu based on the results of the analysis, a transmission means for transmitting the health assist menu to the communication terminal, a notification means for presenting the health assist menu and an abnormal value notification to the user from the communication terminal, an alert means for transmitting the abnormal value notification to a relative or a medical institution, and an ordering means for ordering meals from an affiliated meal service based on the proposed health assist menu. This makes it possible to monitor the health status of an elderly person in real time, provide comprehensive health assistance, and propose optimal meal plans and easily order meals.

[0385] definition statement

[0386] "Vital signs" are indicators that show the basic life activities of a living organism, and refer to data such as body temperature, heart rate, blood pressure, and respiratory rate.

[0387] "Biosensor means" refers to an apparatus or device for measuring vital signs, and has a high-performance sensor built in.

[0388] "Communication means" refers to the device or protocol for transmitting measurement data to the user's communication terminal.

[0389] The "communication terminal means" refers to a terminal having a communication function for relaying the vital sign data to a server.

[0390] "Analysis means" refers to software or algorithms for analyzing received vital sign data in real time.

[0391] "Generation means" refers to software or functions for generating an individual health assistance menu based on the analysis results.

[0392] The "transmission means" refers to a function or device for transmitting the generated health assistance menu to the user's communication terminal.

[0393] "Notification means" refers to an interface or mechanism for presenting the health assistance menu and abnormal value notifications to the user.

[0394] "Alert measures" refers to systems and protocols for notifying relatives and medical institutions when abnormal values ​​are detected.

[0395] "Ordering Method" refers to the functionality and protocols for ordering meals from affiliated meal delivery services based on the proposed Health Assist Menu.

[0396] MODE FOR CARRYING OUT THE INVENTION

[0397] This invention is an AI-powered smart earphone system that supports the health management of the elderly by measuring vital signs, analyzing data, generating and notifying health assistance menus, and ordering meals from affiliated meal delivery services. This system uses the following means.

[0398] System Configuration

[0399] earphone device

[0400] The earphone device is equipped with built-in biosensors that periodically measure the elderly person's vital signs, such as temperature, heart rate, blood pressure, and respiratory rate, and this data is sent via Bluetooth to the user's smartphone.

[0401] communication means

[0402] The communication means includes a function for the user's smartphone to receive vital sign data transmitted from the earphone device, which is then transmitted from the smartphone to a cloud server via the internet.

[0403] Analysis means

[0404] The received vital sign data is analyzed in real time on a cloud server, where a generative AI model is used to detect abnormalities in the data and perform a comprehensive assessment of the patient's health, such as detecting abnormalities in heart rate or blood pressure.

[0405] generation means

[0406] Based on the analysis results, the cloud server generates an optimal health assistance menu for each user, including diet, exercise, sleep, and brain training, and also suggests relaxation exercises and music based on the user's emotional state.

[0407] Transmission method

[0408] The generated health assistance menu is sent from the cloud server to the user's smartphone.

[0409] Notification and alert methods

[0410] The smartphone will then present the received health assistance menu and abnormal value notifications to the user, and if an abnormal value is detected, an alert will be sent to pre-registered relatives and medical institutions.

[0411] Ordering Method

[0412] Based on the proposed health assistance menu, the user's smartphone will access the partner meal delivery service and order the appropriate meal, allowing seniors to receive the optimal meal without any hassle.

[0413] Specific use cases

[0414] For example, consider a situation where user D is wearing AI-powered smart earphones. The earphones measure body temperature, heart rate, blood pressure, and respiratory rate, and send this data to D's smartphone via Bluetooth. The smartphone transfers the data to a cloud server, where the generative AI model analyzes it. As a result of the analysis, it is determined that D's blood pressure is higher than normal, and the emotion engine recognizes this as a state of stress.

[0415] Based on this information, the cloud server generates a health assistance menu that includes relaxation exercises and music, and sends it to Mr. D's smartphone. It also orders meals that will help reduce stress from an affiliated meal delivery service.

[0416] Prompt Sentence Examples

[0417] Examples of prompts sent to the generative AI model include:

[0418] "Temperature: 36.7 degrees"

[0419] "Heart rate: 78 BPM"

[0420] "Blood pressure: 125 / 82 mmHg"

[0421] "Respiration rate: 15 RPM"

[0422] "Emotional state: Stress"

[0423] In this way, the present invention realizes a system that comprehensively monitors the health status of elderly people and provides optimal health assistance and meal orders.

[0424] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0425] System processing steps

[0426] Step 1: Measuring vital signs and sending data

[0427] The user wears the AI-powered smart earphones, and the biosensors periodically measure body temperature, heart rate, blood pressure, and respiratory rate, and the vital signs data is sent to the user's smartphone via Bluetooth.

[0428] Input: User's vital signs (temperature, heart rate, blood pressure, respiratory rate)

[0429] Output: Vital signs data sent to a smartphone

[0430] How it works: The earphone device collects data using temperature sensors, heart rate sensors, blood pressure sensors, and respiration sensors, and then transmits the data to a smartphone via Bluetooth.

[0431] Step 2: Receiving data and sending it to the cloud server

[0432] The terminal (smartphone) receives vital sign data from the earphone device and stores it in local storage. At the same time, the data is sent to a cloud server via the Internet.

[0433] Input: Vital signs data obtained from earphone device

[0434] Output: Vital signs data sent to the cloud server

[0435] Specific operation: The smartphone temporarily stores the data received via Bluetooth in local storage, and then transmits the data to a cloud server via the Internet using the HTTP protocol.

[0436] Step 3: Analyze the data

[0437] The server analyzes vital sign data sent to the cloud server in real time, using generative AI models to detect outliers and assess health status.

[0438] Input: Vital signs data sent to the cloud server

[0439] Output: Outliers and health assessment results

[0440] How it works: The cloud server uses generative AI models to analyze vital sign data, detect abnormalities (e.g., high blood pressure, low heart rate) and assess overall health.

[0441] Step 4: Create a Health Assist Menu

[0442] Based on the analysis results and the user's emotional state, the server generates a personalized health assistance menu, which includes diet, exercise, sleep, and brain training.

[0443] Input: Analysis results and emotional state data

[0444] Output: Health Assist Menu

[0445] Specific operation: Based on the analysis results (e.g., high blood pressure, stress level), the generative AI generates a health assistance menu (e.g., relaxation music, low-salt meal plan, light exercise).

[0446] Step 5: Send Health Assist Menu

[0447] The server sends the generated health assistance menu to the user's smartphone.

[0448] Enter: Health Assist Menu

[0449] Output: Health assist menu sent to smartphone

[0450] Specific operation: The server uses the HTTP protocol to send the generated health assistance menu to the user's smartphone.

[0451] Step 6: Health Assist Menu and Abnormal Value Notification

[0452] The device (smartphone) receives the health assistance menu and notifies the user of abnormal values, and also sends alerts to relatives and medical institutions.

[0453] Input: Sent Health Assist Menu and Abnormal Value Notification

[0454] Output: Present to user and alert relatives and medical institutions

[0455] Specific actions: The smartphone uses voice guidance or a visual interface to provide the user with specific health assistance content, and if abnormal values ​​are detected, alerts are sent via email or SMS to pre-registered relatives or medical institutions.

[0456] Step 7: Order your food

[0457] The device (smartphone) orders meals from affiliated meal delivery services based on the proposed health assistance menu.

[0458] Enter: Health Assist Menu

[0459] Output: Order data for a food service

[0460] Specific operation: The smartphone uses the API of a partner food delivery service to order meals based on the health-assist menu. For example, if a low-sodium meal plan is suggested, the smartphone will order from a restaurant that offers that menu.

[0461] Through the above steps, the present invention comprehensively manages the user's health condition and provides optimal health assistance and meals.

[0462] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0463] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0464] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0465] [Second embodiment]

[0466] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0467] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0468] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0469] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0470] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0471] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0472] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0473] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0474] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0475] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0476] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0477] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0478] The present invention relates to an AI-powered smart earphone system that supports health management for the elderly. The system includes a biosensor for measuring vital signs, a communication unit, an analysis unit, a generation unit, a transmission unit, a notification unit, and an alert unit.

[0479] System Configuration

[0480] The monitoring AI smart earphone system consists of an earphone device worn by the user, the user's communication device (such as a smartphone or tablet), and a cloud server.

[0481] The earphone device is equipped with biometric sensors that measure the user's temperature, heart rate, blood pressure, and respiratory rate.

[0482] The communication terminal receives vital sign data transmitted via Bluetooth from the earphone device and relays the data to a cloud server.

[0483] The cloud server analyzes the received data in real time and generates a health assistance menu for each user.

[0484] Program processing

[0485] The operation of the system will be explained by dividing it into processing steps.

[0486] Vital sign measurement and data transmission

[0487] Terminal (earphone device): The earphones have built-in biosensors that periodically measure the user's body temperature, heart rate, blood pressure, and respiratory rate. The measured data is then sent via Bluetooth to the user's communication terminal.

[0488] Receiving and storing data

[0489] Communication terminal (smartphone): Received vital sign data is temporarily stored in local storage, and the data is also sent to a cloud server via the Internet.

[0490] Data analysis

[0491] Server: The cloud server receives data from the communication device and stores it in a database. Using a generative AI model, the received vital sign data is analyzed in real time to detect abnormal values ​​and evaluate health status.

[0492] Health assistance menu generation

[0493] Server: Based on the analysis results, the server generates an optimal health assistance menu for each user. The menu includes diet, exercise, sleep, and brain training, and is customized according to the user's health condition.

[0494] Assist menu and sending notifications

[0495] Server: After generating the optimal health assistance menu for the user, the server sends it to the user's communication device. If an abnormal value is detected, the server also sends an alert to pre-registered relatives and medical institutions.

[0496] User notification and assistance

[0497] Communication device (smartphone): The received health assistance menu is notified to the user as a voice guide. If an abnormal value is detected, it also notifies relatives and medical institutions.

[0498] Specific examples

[0499] As a specific example, consider a situation where user C is wearing AI-enabled smart earphones.

[0500] Vital sign measurement and data transmission

[0501] Terminal (earphone device): The earphone measures C's body temperature, heart rate, blood pressure, and respiratory rate. The data is sent to C's smartphone via Bluetooth.

[0502] Receiving and storing data

[0503] Communication terminal (smartphone): The smartphone receives the data and stores it in local storage. At the same time, it sends the data to the cloud server.

[0504] Data analysis

[0505] Server: The cloud server receives the data and begins analysis. The analysis reveals that Mr. C's heart rate is higher than normal.

[0506] Health assistance menu generation

[0507] Server: The generative AI generates a health assistance menu based on abnormal heart rate, such as relaxation exercises and low-salt meals.

[0508] Assist menu and sending notifications

[0509] Server: Sends the generated menu to Mr. C's smartphone. Also sends an alert to his son if his heart rate is abnormal.

[0510] User notification and assistance

[0511] Communication device (smartphone): The smartphone sends a voice guide to Mr. C about the menu he received. An alert is also sent to his son.

[0512] The above is a specific embodiment of the AI ​​smart earphone system for monitoring elderly people according to the present invention. This system enables more effective health management for elderly people, early detection of abnormalities, and prompt response.

[0513] The processing flow will be explained below.

[0514] Step 1:

[0515] Terminal (earphone device): The biosensor built into the earphone measures the user's body temperature, heart rate, blood pressure, and respiratory rate. The sensor is set to automatically measure at regular intervals.

[0516] Step 2:

[0517] Terminal (earphone device): The measured vital sign data is sent to the user's communication terminal (smartphone) via Bluetooth. The data is encrypted during transmission to prevent data leakage.

[0518] Step 3:

[0519] User's communication device (smartphone): The received vital sign data is stored in the smartphone's local storage. At the same time, the data is sent from the smartphone to a cloud server via the Internet. The data is also encrypted during transmission.

[0520] Step 4:

[0521] Server: The cloud server receives vital sign data sent from the user's communication device. The received data is stored in a database and analyzed in real time.

[0522] Step 5:

[0523] Server: Analyzes the received data using a generative AI model. The analysis checks the data for anomalies and assesses the user's health status. For example, a higher-than-normal heart rate or sudden fluctuations in blood pressure can be detected.

[0524] Step 6:

[0525] Server: Based on the analysis results, a personalized health assistance menu is generated for each user. The generated menu includes specific suggestions for diet, exercise, sleep, and brain training. For example, if a person's heart rate is high, relaxation exercises will be suggested, and if blood pressure is high, a low-salt meal menu will be presented.

[0526] Step 7:

[0527] Server: Sends the generated health assistance menu to the user's communication device (smartphone). At the same time, if abnormal values ​​are detected in the vital signs, an alert is sent to pre-registered relatives or medical institutions.

[0528] Step 8:

[0529] User's communication device (smartphone): The received health assistance menu is notified to the user via voice guidance and a visual interface. The voice guidance provides easy-to-understand explanations of the specific health assistance content. In addition, if an abnormal value is detected, an alert is sent to relatives and medical institutions.

[0530] Step 9:

[0531] User: Follow the instructions on the smartphone to begin implementing the health assistance menu, such as performing relaxation exercises, eating the recommended diet, and creating an appropriate sleeping environment.

[0532] The above is the specific program processing of the monitoring AI smart earphone system, which will monitor the health status of elderly people in real time and enable optimal health management.

[0533] Example 1

[0534] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0535] While appropriate measurement and analysis of vital signs is important for the health management of elderly people, there is currently a lack of systems that can do this efficiently and in real time. Furthermore, while early detection of abnormal values ​​and appropriate responses are required, conventional systems have difficulty in providing prompt notifications and generating individually customized health assistance menus. The purpose of this invention is to solve these problems and provide a system for more effective health management of elderly people.

[0536] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0537] In this invention, the server includes a biosensor for measuring vital signs, a communication device for transmitting the measured vital sign data to the user's communication device, a communication device for relaying the vital sign data to the server, an analysis device for analyzing the vital sign data in real time at the server, a generation device for generating a personalized health assist menu based on the analysis results, a transmission device for transmitting the health assist menu to the communication device, a notification device for presenting the health assist menu and an abnormal value notification to the user from the communication device, an alert device for sending the abnormal value notification to a relative or a medical institution, a storage device for temporarily storing the vital sign data in local storage upon receiving the data, a transmission device for transmitting the data via Bluetooth or the Internet, a notification device for notifying a relative or a medical institution using an alert generated when an abnormal value is detected, and a generation device for generating a health assist menu using a generative AI model. This enables real-time monitoring of the health of elderly people, enabling early detection and prompt response to abnormalities. Furthermore, providing a personalized health assist menu can be expected to improve the subject's health.

[0538] "Vital signs" are physiological indicators used to assess health status and generally include temperature, heart rate, blood pressure, and respiratory rate.

[0539] "Biosensor means" refers to devices or components used to measure a user's vital signs, and typically includes a thermometer, heart rate sensor, blood pressure monitor, respiratory sensor, etc.

[0540] "Communication means" refers to the technology and devices for transmitting measured vital sign data to the user's communication terminal, and includes wireless communication technologies such as Bluetooth and Wi-Fi.

[0541] The "communication terminal means" is a device used by a user, such as a smartphone or tablet, that receives vital sign data and relays it to a server via the Internet.

[0542] "Analysis means" refers to the technology and algorithms for analyzing vital sign data received by the server in real time, including the generative AI model.

[0543] "Generation means" refers to the technology and process for generating an individual health assistance menu based on the analysis results, and includes suggestions for diet, exercise, sleep, and brain training.

[0544] The "transmission means" refers to the technology and device for transmitting the generated health assistance menu to the user's communication terminal, and includes the Internet and wireless communication technology.

[0545] "Notification means" refers to the technology and process for presenting the health assistance menu and abnormal value notifications to the user from the user's communication terminal, and includes voice guidance and push notifications, etc.

[0546] "Alert Method" means the technology and process for sending abnormal value notifications to relatives or healthcare providers, including SMS, email, or app notifications.

[0547] "Storage means" refers to the technology and devices for temporarily storing vital sign data in local storage when it is received, and includes databases and file systems within the smartphone.

[0548] "Generative AI model" refers to the artificial intelligence algorithm used to analyze vital sign data and generate health assistance menus.

[0549] "Bluetooth" is a type of short-range wireless communication technology used to transmit vital sign data from an earphone device to a user's communication terminal.

[0550] "Internet" is a global network for transmitting data to remote servers and is used for cloud transmission of vital signs data.

[0551] The "health assistance menu" is a personalized proposal generated based on the user's health status, and includes specific action plans for diet, exercise, sleep, and brain training.

[0552] This invention relates to an AI-powered smart earphone system for managing the health of elderly people. This system uses biosensors, communication terminals, and a cloud server to monitor users' health information in real time, detect abnormalities early, and take appropriate measures.

[0553] System Configuration

[0554] The monitoring AI smart earphone system includes the following components:

[0555] Earbud device: Equipped with biometric sensors, it measures the user's temperature, heart rate, blood pressure, and respiratory rate.

[0556] Communication terminal: A smartphone or tablet that receives vital sign data transmitted via Bluetooth from the earphone device and relays the data to a cloud server.

[0557] Cloud server: Analyzes the received data in real time and generates a health assistance menu for each user.

[0558] Hardware and Software Configuration

[0559] earphone device

[0560] The earphone device is equipped with multiple biosensors, including a thermometer, heart rate sensor, blood pressure monitor, and respiratory sensor, and is also equipped with a Bluetooth module that transmits the measured data to a communication terminal.

[0561] communication terminal

[0562] The communication terminals used are smartphones, tablets, etc. These terminals have the function of receiving data from the earphone device via Bluetooth and temporarily storing it in their internal local storage. They also have a transmission function, which sends the data to a cloud server via the Internet.

[0563] Cloud Server

[0564] The cloud server is equipped with an analysis system that includes a database and a generative AI model. The received vital sign data is stored in the server's database and analyzed in real time. Based on the analysis results, a health assistance menu customized for each user is generated.

[0565] Specific examples

[0566] User C's scenario

[0567] When user C is wearing the monitoring AI smart earphones, the following specific actions will occur:

[0568] 1. Earphone device: The earphone measures C's body temperature, heart rate, blood pressure, and respiratory rate and transmits the data to C's smartphone via Bluetooth.

[0569] 2. Communication terminal: The smartphone receives the data, stores it in local storage, and simultaneously transmits the data to the cloud server.

[0570] 3. Cloud server: The cloud server receives the data and begins analysis using the generative AI model. For example, if Mr. C’s heart rate is higher than normal, it will be determined to be abnormal.

[0571] 4. Generating a health assistance menu: Based on the analysis results, a health assistance menu such as relaxation exercises and low-salt meals is generated.

[0572] 5. Notifications and alerts: The generated menu is sent to Mr. C's smartphone and notified as an audio guide. At the same time, if an abnormal value is detected, an alert is sent to Mr. C's relatives and medical institutions.

[0573] Prompt Sentence Examples

[0574] "I would like to develop an AI system to support the health management of elderly people. I would like to measure vital signs using an earphone device and analyze the data in the cloud. Specifically, what kind of prompts would be appropriate?"

[0575] This system will enable efficient health management for users, enabling early detection and response of abnormalities. Furthermore, by providing individually customized health assistance menus, it is expected that users' health conditions will improve.

[0576] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0577] Step 1: Measuring vital signs with biosensors

[0578] Terminal (earphone device): The biosensors built into the earphones measure the user's body temperature, heart rate, blood pressure, and respiratory rate. Specifically, a temperature sensor is used for body temperature, a photoelectric pulse sensor for heart rate, a pressure sensor for blood pressure, and an acceleration sensor for respiratory rate. The measured data (body temperature: 36.5°C, heart rate: 75 bpm, blood pressure: 120 / 80 mmHg, respiratory rate: 18 breaths / min) is sent to the next step via Bluetooth communication.

[0579] Input: User's vital signs (temperature, heart rate, blood pressure, respiratory rate)

[0580] Output: Measured vital signs data

[0581] Step 2: Sending data

[0582] Terminal (earphone device): The measured vital sign data is sent to the user's communication terminal via Bluetooth. Specifically, the earphone device turns on Bluetooth and sends a data packet to the paired communication terminal.

[0583] Input: Measured vital signs data

[0584] Output: Data sent via Bluetooth communication

[0585] Step 3: Receiving and saving data (communication terminal)

[0586] Communication terminal (smartphone): The data sent from the earphone device is received using a Bluetooth receiving module and temporarily stored in the smartphone's local storage. Specifically, the received data is structured in JSON format and written to a database such as SQLite. For example, "Body temperature: 36.5°C, heart rate: 75 bpm, blood pressure: 120 / 80 mmHg, respiratory rate: 18 breaths / min" is stored.

[0587] Input: Vital signs data sent via Bluetooth communication

[0588] Output: Data saved in local storage

[0589] Step 4: Send data to the cloud

[0590] Communication terminal (smartphone): Sends temporarily stored vital sign data to a cloud server via the Internet. Specifically, it generates an HTTP request and uses a REST API to send the data to the cloud server's endpoint. The data is encrypted using SSL / TLS.

[0591] Input: Data stored in local storage

[0592] Output: Data sent to the cloud server

[0593] Step 5: Receiving data on the cloud server for analysis

[0594] Server: The cloud server receives the data sent from the communication device and stores it in an internal database. Specifically, it analyzes the received JSON format data and inserts it into the database. For example, it stores "body temperature: 36.5°C, heart rate: 75 bpm, blood pressure: 120 / 80 mmHg, respiratory rate: 18 breaths / min."

[0595] Input: Data sent to the cloud server

[0596] Output: Data stored in the database

[0597] Step 6: Data analysis using analytical algorithms

[0598] Server: Analyzes received vital sign data in real time using a generative AI model. Specifically, it retrieves data from the database, detects abnormal values, and evaluates health status. For example, it applies logic that determines an abnormality when the heart rate is 90 bpm or higher.

[0599] Input: Data stored in a database

[0600] Output: Analysis results (e.g. high heart rate)

[0601] Step 7: Create a Health Assist Menu

[0602] Server: Generates a health assistance menu based on the analysis results. The generation AI creates suggestions such as "dietary advice," "exercise plans," "tips for improving sleep quality," and "brain training" based on the user's health condition. For example, if the heart rate is high, it suggests "one minute of relaxing breathing exercises."

[0603] Input: Analysis results

[0604] Output: Health Assist Menu

[0605] Step 8: Assist Menu and Sending Alerts

[0606] Server: Sends the generated health assistance menu to the user's communication device, and if an abnormal value is detected, sends an alert message to relatives or medical institutions. Specifically, it generates an HTTP request and sends it to the communication device and the device to which the alert is sent.

[0607] Input: Health Assist Menu, Abnormal Value Detection

[0608] Output: Menu sent to user's communication device, notification sent as alert

[0609] Step 9: Inform and assist users

[0610] Communication device (smartphone): The received health assistance menu is notified to the user as a voice guide. If an abnormal value is detected, an alert is sent to relatives and medical institutions as well. Specifically, the smartphone's voice synthesis function is used to notify the user through the earphone device, saying, "Try relaxing breathing exercises." In addition, SMS and app notifications are used to notify relatives that "your heart rate is high."

[0611] Input: Health Assist Menu, Alert

[0612] Output: Audio instructions to user, notification to relatives

[0613] At each processing step of this system, the user, device, and server work together to effectively manage and assist the health of elderly people. By providing individual health assistance menus based on the analysis results, it is expected that health conditions will improve.

[0614] (Application example 1)

[0615] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0616] Health management for the elderly is an important social issue, and there is a need for early detection of abnormalities in elderly people living independently and rapid response. However, conventional health management systems have problems in that it is difficult to generate assistance menus appropriate for individual health conditions, and they are unable to notify or respond quickly in emergencies. Furthermore, because it is necessary to provide accurate and prompt information not only to the elderly themselves but also to their relatives and medical institutions, a system with advanced analytical functions is required.

[0617] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0618] In this invention, the server includes an analysis means for analyzing vital sign data in real time, a generation means for generating an individual health support menu based on the analysis results using a generative AI model, and a transmission means for individually customizing and transmitting the health support menu using prompt text. This makes it possible to monitor the health status of elderly people in real time, detect abnormalities early, and provide individually customized health support menus. In addition, since relatives and medical institutions can be quickly notified in the event of an abnormality, a system can be realized that effectively supports emergency response.

[0619] "Vital signs" are basic physiological indicators related to maintaining human life, such as body temperature, heart rate, blood pressure, and respiratory rate.

[0620] A "biosensor" is a device that is attached to the human body to measure vital signs.

[0621] "Communication means" is a function for transmitting measured vital sign data to a personal communication device.

[0622] A "communications terminal" is a device for relaying vital signs data to a central system.

[0623] The "central system" is a system such as a server that receives and analyzes vital sign data and generates a health support menu.

[0624] The "analysis means" is a function for analyzing vital sign data in real time.

[0625] The "generation means" is a function for generating an individual health support menu based on the analysis results.

[0626] The "transmission means" is a function for transmitting the generated health support menu to an individual's communication device.

[0627] "Notification means" is a function for providing individuals with health support menus and abnormal value notifications.

[0628] "Alert means" is a function for sending emergency notifications to relatives and medical institutions when abnormal values ​​are detected.

[0629] A "generative AI model" is an artificial intelligence model that uses generated algorithms to analyze data and generate a health support menu.

[0630] A "prompt sentence" is an instruction sentence input to a generative AI model and is used during analysis and menu generation.

[0631] This invention relates to an AI-powered smart earphone system that supports the health management of elderly people. This system combines a biosensor, a communication terminal, an analysis unit, a generation unit, a transmission unit, a notification unit, an alert unit, a generation AI model, and a prompt sentence.

[0632] The system consists of an earphone device worn by the user, the user's communication terminal (e.g., a smartphone), and a cloud server.

[0633] The earphone device is equipped with built-in biosensors that can measure vital signs such as body temperature, heart rate, blood pressure, and respiratory rate, and transmits this data via Bluetooth to the user's communication device.

[0634] The communication device (such as a smartphone) temporarily stores the vital sign data received from the earphone device via Bluetooth in local storage, and then transmits the data to a cloud server via the Internet.

[0635] The cloud server analyzes vital sign data in real time using a generative AI model. Based on the analysis results, a personalized health support menu is generated, including diet, exercise, sleep, and mental training. The generated menu is customized for each user using prompts.

[0636] As a concrete example, when user C is wearing the AI ​​monitoring smart earphones, the earphone device measures C's body temperature, heart rate, blood pressure, and respiratory rate, and sends the data to C's smartphone via Bluetooth. The smartphone then sends the data to a cloud server, where the generative AI model begins analysis.

[0637] For example, the generative AI model performs an analysis based on the prompt, "If the heart rate is 85 or higher, it is determined to be a risk and a health support menu will be generated." As a result, advice such as relaxation exercises and a low-salt diet is generated and sent to User C's smartphone. Additionally, if an abnormal value is detected, an emergency notification is sent to pre-registered relatives and medical institutions.

[0638] This makes it possible to monitor the health status of elderly people in real time, detect abnormalities early, and provide a system that can take appropriate action quickly.

[0639] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0640] Step 1:

[0641] The biosensor built into the earphone device measures the user's vital signs (body temperature, heart rate, blood pressure, respiratory rate). The measurement data is converted into digital signals and sent to the user's communication device via Bluetooth. The input is sensor data, and the output is data sent to the communication device.

[0642] Step 2:

[0643] The terminal (communication device) receives vital sign data from the earphone device via Bluetooth and temporarily stores it in local storage. The stored data is then sent to a cloud server via the Internet. The input is a Bluetooth signal, and the output is data sent to the cloud server.

[0644] Step 3:

[0645] The server receives vital sign data sent from the communication device and stores it in a database. Based on the stored data, it analyzes the data in real time using a generative AI model. The input is the received vital sign data, and the output is the analysis results.

[0646] Step 4:

[0647] The server uses a generative AI model to generate an individual health support menu based on the analysis results. A menu customized for each user is generated using a prompt. For example, based on the prompt "If the heart rate is 85 or higher, determine that there is a risk and generate a health support menu." The input is the analysis results, and the output is a customized health support menu.

[0648] Step 5:

[0649] The server transmits the generated health support menu to the user's communication device, where the input is the generated health support menu and the output is the transmission of the menu.

[0650] Step 6:

[0651] The terminal (communication device) receives a health support menu and notifies the user as a voice guide. If an abnormal value is detected, an alert notification is sent to pre-registered relatives and medical institutions. The input is the received support menu and abnormal value notification, and the output is a notification to the user, relatives, and medical institutions.

[0652] Through these steps, the system can monitor the elderly person's vital signs in real time, provide appropriate health support menus, and quickly notify in the event of an abnormality.

[0653] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0654] This invention relates to an AI-powered smart earphone system that supports the health management of elderly people. The system includes a biosensor for measuring vital signs, a communication unit, an analysis unit, a generation unit, a transmission unit, a notification unit, an alert unit, and an emotion engine that recognizes the user's emotions.

[0655] System Configuration

[0656] The monitoring AI smart earphone system consists of an earphone device worn by the user, the user's communication device (such as a smartphone or tablet), a cloud server, and an emotion engine.

[0657] Earphone device: Equipped with biosensors, it measures the user's temperature, heart rate, blood pressure, and respiratory rate.

[0658] Communication terminal: Receives vital sign data sent via Bluetooth from the earphone device and relays the data to a cloud server.

[0659] Cloud server: Analyzes the received data in real time and generates a health assistance menu for each user.

[0660] Emotion engine: Recognizes the user's emotional state by analyzing voice and facial expression data.

[0661] Program processing

[0662] The operation of the system will be explained by dividing it into processing steps.

[0663] Vital sign measurement and data transmission

[0664] Terminal (earphone device): The earphones have built-in biosensors that periodically measure the user's body temperature, heart rate, blood pressure, and respiratory rate. The measured data is then sent via Bluetooth to the user's communication terminal.

[0665] Receiving and storing data

[0666] Communication terminal (smartphone): Received vital sign data is stored in the smartphone's local storage, and the data is also sent from the smartphone to a cloud server via the Internet.

[0667] Data analysis

[0668] Server: The cloud server receives data from the communication device and stores it in a database. Using a generative AI model, the received vital sign data is analyzed in real time to detect abnormal values ​​and evaluate health status.

[0669] Recognition of emotional states

[0670] Server: The emotion engine analyzes the user's voice and facial expression data to recognize their emotional state. For example, it determines whether the user is feeling stressed or tired from the voice data.

[0671] Health assistance menu generation

[0672] Server: Generates an optimal health assistance menu for each user based on the analysis results and the emotional state determined by the emotion engine. The menu includes diet, exercise, sleep, and brain training. Based on the emotional state, if the user is feeling stressed, relaxation exercises and music will be suggested, and if the user is feeling tired, a menu that prioritizes rest will be generated.

[0673] Assist menu and sending notifications

[0674] Server: Sends the generated health assistance menu to the user's communication device (smartphone). If abnormalities are detected in the user's vital signs or emotional state, it sends alerts to pre-registered relatives and medical institutions.

[0675] User notification and assistance

[0676] Communication device (smartphone): The received health assistance menu is notified to the user via voice guidance and a visual interface. The voice guidance provides easy-to-understand explanations of the specific health assistance content. In addition, if an abnormality is detected, an alert is sent to relatives and medical institutions.

[0677] Specific examples

[0678] As a specific example, consider a situation where user D is wearing AI-enabled smart earphones.

[0679] Vital sign measurement and data transmission

[0680] Terminal (earphone device): The earphone measures D's body temperature, heart rate, blood pressure, and respiratory rate. The data is sent to D's smartphone via Bluetooth.

[0681] Receiving and storing data

[0682] Communication terminal (smartphone): The smartphone receives the data and stores it in local storage. At the same time, it sends the data to the cloud server.

[0683] Data analysis

[0684] Server: The cloud server receives the data and begins analysis. The analysis reveals that Mr. D's blood pressure is higher than normal.

[0685] Recognition of emotional states

[0686] Server: The emotion engine recognizes Mr. D's stress level from his voice and facial expressions.

[0687] Health assistance menu generation

[0688] Server: Generates a health assistance menu including relaxation exercises and music based on abnormal heart rate and stress levels.

[0689] Assist menu and sending notifications

[0690] Server: Sends the generated menu to Mr. D's smartphone. It also sends alerts to his relatives about his stress level and abnormal blood pressure.

[0691] User notification and assistance

[0692] Communication device (smartphone): The smartphone receives the menu and notifies Mr. D of it as an audio guide. Alerts are also sent to his relatives.

[0693] The above is a specific embodiment of the AI-powered smart earphone system of the present invention. This system monitors the health status of elderly people in real time, enabling optimal health management. Furthermore, the introduction of an emotion engine realizes comprehensive health assistance that also takes into account the user's mental health.

[0694] The processing flow will be explained below.

[0695] Step 1:

[0696] Terminal (earphone device): The biosensor built into the earphone measures the user's body temperature, heart rate, blood pressure, and respiratory rate. The sensor is set to automatically measure at regular intervals.

[0697] Step 2:

[0698] Terminal (earphone device): The measured vital sign data is sent to the user's communication terminal (smartphone) via Bluetooth. The data is encrypted during transmission to prevent data leakage.

[0699] Step 3:

[0700] User's communication device (smartphone): The received vital sign data is stored in the smartphone's local storage. The data is also sent from the smartphone to a cloud server via the Internet. The data is also encrypted during transmission.

[0701] Step 4:

[0702] Server: The cloud server receives vital sign data sent from the user's communication device. The received data is stored in a database and analyzed in real time.

[0703] Step 5:

[0704] Server: Analyzes the received vital signs data in real time using a generative AI model. The analysis checks for abnormalities in the data and evaluates the user's health status. For example, a high heart rate or sudden fluctuations in blood pressure can be detected.

[0705] Step 6:

[0706] Server: The emotion engine analyzes the user's voice and facial expression data to recognize their emotional state. For example, it can detect stress or fatigue from the tone of their voice and the content of their words.

[0707] Step 7:

[0708] Server: Generates the optimal health assistance menu for each user based on the analysis results and the emotional state of the user as determined by the emotion engine. For example, it suggests relaxation exercises for a user feeling stressed, and creates a menu that prioritizes rest for a user feeling fatigued.

[0709] Step 8:

[0710] Server: Sends the generated health assistance menu to the user's communication device. If abnormal values ​​or emotional state problems are detected, an alert is sent to pre-registered relatives or medical institutions.

[0711] Step 9:

[0712] User's communication device (smartphone): The health assistance menu is notified to the user through voice guidance and a visual interface. The notification includes specific health assistance content (e.g., relaxation exercises, recommended meals, rest methods, etc.).

[0713] Step 10:

[0714] User: Follows the instructions on the smartphone to carry out the health assistance menu, such as performing relaxation exercises, eating recommended meals, and creating an appropriate sleeping environment.

[0715] The above is the specific program processing of the AI ​​smart earphone monitoring system that combines an emotion engine. This system comprehensively manages the user's health, enabling early detection of abnormalities and rapid response. Furthermore, the introduction of the emotion engine realizes optimal health assistance that also takes the user's mental health into consideration.

[0716] Example 2

[0717] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0718] Health management for the elderly requires real-time monitoring of their health status and prompt notification when abnormalities are detected. Health management also requires a comprehensive approach that considers not only the user's physical data but also their emotional state. However, conventional systems have difficulty in managing health while taking emotional state into account, and have been unable to provide real-time notifications or take appropriate measures when abnormalities are detected.

[0719] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0720] In this invention, the server includes an analysis means including an emotion engine, a generation means for generating a health assistance menu based on the analysis results and the emotional state using a generative AI model, and an alert means for sending an abnormal value notification to a relative or a medical institution. This enables comprehensive analysis of the user's physical data and emotional state, enabling appropriate health management in real time and prompt alert notification.

[0721] "Vital signs" are basic physiological indicators of the human body, such as body temperature, heart rate, blood pressure, and respiratory rate.

[0722] A "biosensor means" is a sensor device used to measure a user's vital signs.

[0723] "Communication means" refers to a means for transmitting measured vital sign data to other terminals or systems.

[0724] The "communication terminal means" is a means for relaying data to the cloud computing system using a user's communication terminal.

[0725] The "analysis means" is a means for analyzing vital sign data received by the cloud computing system in real time.

[0726] A "generative AI model" is a model that uses artificial intelligence technology to analyze vital sign data and emotional data and recognize abnormal values ​​and emotional states.

[0727] An "emotion engine" is a technology that analyzes a user's voice and facial expression data to recognize their emotional state.

[0728] The "generation means" is a means for generating an individual health assistance menu based on the analysis results and the emotional state.

[0729] The "transmission means" is a means for transmitting the generated health assistance menu to the user's communication terminal.

[0730] The "notification means" is a means for presenting the health assistance menu and abnormal value notification to the user.

[0731] The "alert means" is a means for sending an abnormal value notification to a relative or a medical institution.

[0732] A "health assist menu" is a set of individually customized instructions and advice provided to improve and maintain the user's health.

[0733] This invention relates to an AI-powered smart earphone system for supporting elderly health management. The system includes a biosensor for measuring vital signs, a communication unit, an analysis unit, a generation unit, a transmission unit, a notification unit, an alert unit, and an emotion engine for recognizing the user's emotions.

[0734] System Configuration

[0735] The monitoring AI smart earphone system consists of an earphone device worn by the user, the user's communication device (such as a smartphone or tablet), a cloud computing system, and an emotion engine.

[0736] Earphone device: Equipped with biosensors, it measures the user's temperature, heart rate, blood pressure, and respiratory rate.

[0737] Communication terminal: Receives vital sign data transmitted via Bluetooth from the earphone device and relays the data to the cloud computing system.

[0738] Cloud computing system: Analyzes the received data and generates a health assistance menu for each user using a generative AI model.

[0739] Emotion engine: Recognizes the user's emotional state by analyzing voice and facial expression data.

[0740] Vital sign measurement and data transmission

[0741] Terminal (earphone device): The earphones have built-in biosensors that periodically measure the user's body temperature, heart rate, blood pressure, and respiratory rate. The measured data is then sent via Bluetooth to the user's communication terminal.

[0742] Receiving and storing data

[0743] Communication terminal (smartphone): The received vital sign data is stored in the smartphone's local storage, and the data is also sent from the smartphone to a cloud computing system via the Internet.

[0744] Data analysis

[0745] Server (cloud computing system): The cloud server receives data from the communication device and stores it in a database. Using a generative AI model, the received vital sign data is analyzed in real time to detect abnormal values ​​and evaluate health status.

[0746] Recognition of emotional states

[0747] Server: The emotion engine analyzes the user's voice and facial expression data to recognize their emotional state. For example, it determines whether the user is feeling stressed or tired from the voice data.

[0748] Health assistance menu generation

[0749] Server: Generates an optimal health assistance menu for each user based on the analysis results and the emotional state of the emotion engine. The menu includes diet, exercise, sleep, and brain training. Based on the emotional state, if the user is feeling stressed, relaxation exercises and music will be suggested. If the user is feeling tired, a menu that prioritizes rest will be generated.

[0750] Assist menu and sending notifications

[0751] Server: Sends the generated health assistance menu to the user's communication device (smartphone). If abnormalities are detected in the user's vital signs or emotional state, it sends alerts to pre-registered relatives and medical institutions.

[0752] User notification and assistance

[0753] Communication device (smartphone): The received health assistance menu is notified to the user via voice guidance and a visual interface. The voice guidance provides easy-to-understand explanations of the specific health assistance content. In addition, if an abnormality is detected, an alert is sent to relatives and medical institutions.

[0754] Specific examples

[0755] As a specific example, consider a situation where a user is wearing AI-enabled smart earphones.

[0756] Vital sign measurement and data transmission

[0757] Terminal (earphone device): The earphone measures the user's temperature, heart rate, blood pressure, and respiratory rate. The data is sent to the user's smartphone via Bluetooth.

[0758] Receiving and storing data

[0759] Communication terminal (smartphone): The smartphone receives the data and stores it in local storage, while simultaneously transmitting the data to the cloud computing system.

[0760] Data analysis

[0761] Server: The cloud server receives the data and begins analysis, which reveals that the user's blood pressure is higher than normal.

[0762] Recognition of emotional states

[0763] Server: The emotion engine recognizes the user's stress level from their voice and facial expressions.

[0764] Health assistance menu generation

[0765] Server: Generates a health assistance menu including relaxation exercises and music based on abnormal heart rate and stress levels.

[0766] Assist menu and sending notifications

[0767] Server: Sends the generated menu to the user's smartphone, and also sends alerts to relatives about stress levels and abnormal blood pressure.

[0768] User notification and assistance

[0769] Communication device (smartphone): The smartphone receives the menu and notifies the user as a voice guide. Alerts are also sent to relatives.

[0770] The above is a specific embodiment of the AI-powered smart earphone system of the present invention. This system monitors the health status of elderly people in real time, enabling optimal health management. Furthermore, the introduction of an emotion engine realizes comprehensive health assistance that also takes into account the user's mental health.

[0771] Example prompts for generative AI models

[0772] "Write a program that analyzes the user's biometric data (body temperature, heart rate, blood pressure, respiratory rate) and voice data, detects abnormal values, recognizes emotional state, and generates an optimal health assistance menu."

[0773] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0774] Step 1:

[0775] User: The user puts on the earbud device. The earbuds use built-in biometric sensors to measure the user's temperature, heart rate, blood pressure, and respiratory rate.

[0776] Input: User's vital signs (temperature, heart rate, blood pressure, respiratory rate)

[0777] Output: Measured vital signs data

[0778] Specific behavior:

[0779] The earphone device measures body temperature (36.5 degrees), heart rate (72), blood pressure (130 / 80), and respiratory rate (15).

[0780] Step 2:

[0781] Terminal (earphone device): Measured vital sign data is sent to the user's communication terminal (smartphone) via Bluetooth.

[0782] Input: Measured vital signs data

[0783] Output: Vital signs data transmitted via Bluetooth

[0784] Specific behavior:

[0785] The earphone device sends the measurement data to a smartphone via Bluetooth.

[0786] Step 3:

[0787] Communication terminal (smartphone): Stores the received vital sign data in local storage and transmits the data to a cloud computing system via the Internet.

[0788] Input: Vital signs data received via Bluetooth

[0789] Output: Data stored in local storage and data sent to the cloud

[0790] Specific behavior:

[0791] The smartphone stores the data received from the earphones and sends it to a cloud server.

[0792] Step 4:

[0793] Server (cloud computing system): Receives vital sign data sent from the communication device and stores it in a database. It analyzes the data in real time using a generative AI model to detect abnormal values.

[0794] Input: Vital signs data sent to the cloud

[0795] Output: Data stored in the database and analysis results (presence or absence of outliers)

[0796] Specific behavior:

[0797] The cloud server receives the data, stores it in a database, and detects that the blood pressure is higher than normal (150 / 90).

[0798] Step 5:

[0799] Server: The emotion engine analyzes the user's voice and facial expression data to recognize their emotional state.

[0800] Input: User voice or facial expression data

[0801] Output: Perceived emotional state (e.g., stress state)

[0802] Specific behavior:

[0803] The server analyzes the voice saying "I'm a little busy" and recognizes that Mr. D is in a stressful state.

[0804] Step 6:

[0805] Server: Generates the optimal health assistance menu for each user based on the analysis results and emotional state.

[0806] Input: Analysis results and emotional state

[0807] Output: Health Assist Menu

[0808] Specific behavior:

[0809] Based on abnormal heart rate and stress levels, a health assistance menu including relaxation exercises and relaxation music is generated.

[0810] Step 7:

[0811] Server: Sends the generated health assistance menu and abnormality notifications to the user's communication device. If an abnormality is detected, it also sends an alert to relatives and medical institutions.

[0812] Input: Health Assist menu and abnormal data

[0813] Output: Sending to communication terminal and sending alerts

[0814] Specific behavior:

[0815] The server sends a menu of relaxation exercises to the smartphone and sends alerts about stress and high blood pressure to relatives.

[0816] Step 8:

[0817] Communication device (smartphone): The received health assistance menu is notified to the user via voice guidance and a visual interface. If an abnormality is detected, an alert is sent to relatives and medical institutions.

[0818] Input: Health Assist Menu and Alert Notifications

[0819] Output: User notification and alert to relatives or medical facility

[0820] Specific behavior:

[0821] The smartphone will start playing relaxation music and will also play a voice prompt saying, "Please do some relaxation exercises." At the same time, an alert will be sent to relatives.

[0822] (Application example 2)

[0823] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0824] In modern society, managing the health status of elderly people in real time and providing optimal health assistance is an important issue. Conventional health management systems simply measure vital signs and are unable to provide comprehensive health assistance based on the user's emotional state or stress level. Furthermore, although the dietary habits of elderly people have a significant impact on their health, there has been a lack of systems that provide optimal meal plans and allow easy ordering of meals. This makes it difficult for elderly people to manage their health in their daily lives.

[0825] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0826] In this invention, the server includes a biosensor means for measuring vital signs, a communication means for transmitting the measured vital sign data to the user's communication terminal, a communication terminal means for relaying the vital sign data to the server, an analysis means for analyzing the vital sign data in real time at the server, a generation means for generating an individual health assist menu based on the results of the analysis, a transmission means for transmitting the health assist menu to the communication terminal, a notification means for presenting the health assist menu and an abnormal value notification to the user from the communication terminal, an alert means for transmitting the abnormal value notification to a relative or a medical institution, and an ordering means for ordering meals from an affiliated meal service based on the proposed health assist menu. This makes it possible to monitor the health status of an elderly person in real time, provide comprehensive health assistance, and propose optimal meal plans and easily order meals.

[0827] definition statement

[0828] "Vital signs" are indicators that show the basic life activities of a living organism, and refer to data such as body temperature, heart rate, blood pressure, and respiratory rate.

[0829] "Biosensor means" refers to an apparatus or device for measuring vital signs, and has a high-performance sensor built in.

[0830] "Communication means" refers to the device or protocol for transmitting measurement data to the user's communication terminal.

[0831] The "communication terminal means" refers to a terminal having a communication function for relaying the vital sign data to a server.

[0832] "Analysis means" refers to software or algorithms for analyzing received vital sign data in real time.

[0833] "Generation means" refers to software or functions for generating an individual health assistance menu based on the analysis results.

[0834] The "transmission means" refers to a function or device for transmitting the generated health assistance menu to the user's communication terminal.

[0835] "Notification means" refers to an interface or mechanism for presenting the health assistance menu and abnormal value notifications to the user.

[0836] "Alert measures" refers to systems and protocols for notifying relatives and medical institutions when abnormal values ​​are detected.

[0837] "Ordering Method" refers to the functionality and protocols for ordering meals from affiliated meal delivery services based on the proposed Health Assist Menu.

[0838] MODE FOR CARRYING OUT THE INVENTION

[0839] This invention is an AI-powered smart earphone system that supports the health management of the elderly by measuring vital signs, analyzing data, generating and notifying health assistance menus, and ordering meals from affiliated meal delivery services. This system uses the following means.

[0840] System Configuration

[0841] earphone device

[0842] The earphone device is equipped with built-in biosensors that periodically measure the elderly person's vital signs, such as temperature, heart rate, blood pressure, and respiratory rate, and this data is sent via Bluetooth to the user's smartphone.

[0843] communication means

[0844] The communication means includes a function for the user's smartphone to receive vital sign data transmitted from the earphone device, which is then transmitted from the smartphone to a cloud server via the internet.

[0845] Analysis means

[0846] The received vital sign data is analyzed in real time on a cloud server, where a generative AI model is used to detect abnormalities in the data and perform a comprehensive assessment of the patient's health, such as detecting abnormalities in heart rate or blood pressure.

[0847] generation means

[0848] Based on the analysis results, the cloud server generates an optimal health assistance menu for each user, including diet, exercise, sleep, and brain training, and also suggests relaxation exercises and music based on the user's emotional state.

[0849] Transmission method

[0850] The generated health assistance menu is sent from the cloud server to the user's smartphone.

[0851] Notification and alert methods

[0852] The smartphone will then present the received health assistance menu and abnormal value notifications to the user, and if an abnormal value is detected, an alert will be sent to pre-registered relatives and medical institutions.

[0853] Ordering Method

[0854] Based on the proposed health assistance menu, the user's smartphone will access the partner meal delivery service and order the appropriate meal, allowing seniors to receive the optimal meal without any hassle.

[0855] Specific use cases

[0856] For example, consider a situation where user D is wearing AI-powered smart earphones. The earphones measure body temperature, heart rate, blood pressure, and respiratory rate, and send this data to D's smartphone via Bluetooth. The smartphone transfers the data to a cloud server, where the generative AI model analyzes it. As a result of the analysis, it is determined that D's blood pressure is higher than normal, and the emotion engine recognizes this as a state of stress.

[0857] Based on this information, the cloud server generates a health assistance menu that includes relaxation exercises and music, and sends it to Mr. D's smartphone. It also orders meals that will help reduce stress from an affiliated meal delivery service.

[0858] Prompt Sentence Examples

[0859] Examples of prompts sent to the generative AI model include:

[0860] "Temperature: 36.7 degrees"

[0861] "Heart rate: 78 BPM"

[0862] "Blood pressure: 125 / 82 mmHg"

[0863] "Respiration rate: 15 RPM"

[0864] "Emotional state: Stress"

[0865] In this way, the present invention realizes a system that comprehensively monitors the health status of elderly people and provides optimal health assistance and meal orders.

[0866] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0867] System processing steps

[0868] Step 1: Measuring vital signs and sending data

[0869] The user wears the AI-powered smart earphones, and the biosensors periodically measure body temperature, heart rate, blood pressure, and respiratory rate, and the vital signs data is sent to the user's smartphone via Bluetooth.

[0870] Input: User's vital signs (temperature, heart rate, blood pressure, respiratory rate)

[0871] Output: Vital signs data sent to a smartphone

[0872] How it works: The earphone device collects data using temperature sensors, heart rate sensors, blood pressure sensors, and respiration sensors, and then transmits the data to a smartphone via Bluetooth.

[0873] Step 2: Receiving data and sending it to the cloud server

[0874] The terminal (smartphone) receives vital sign data from the earphone device and stores it in local storage. At the same time, the data is sent to a cloud server via the Internet.

[0875] Input: Vital signs data obtained from earphone device

[0876] Output: Vital signs data sent to the cloud server

[0877] Specific operation: The smartphone temporarily stores the data received via Bluetooth in local storage, and then transmits the data to a cloud server via the Internet using the HTTP protocol.

[0878] Step 3: Analyze the data

[0879] The server analyzes vital sign data sent to the cloud server in real time, using generative AI models to detect outliers and assess health status.

[0880] Input: Vital signs data sent to the cloud server

[0881] Output: Outliers and health assessment results

[0882] How it works: The cloud server uses generative AI models to analyze vital sign data, detect abnormalities (e.g., high blood pressure, low heart rate) and assess overall health.

[0883] Step 4: Create a Health Assist Menu

[0884] Based on the analysis results and the user's emotional state, the server generates a personalized health assistance menu, which includes diet, exercise, sleep, and brain training.

[0885] Input: Analysis results and emotional state data

[0886] Output: Health Assist Menu

[0887] Specific operation: Based on the analysis results (e.g., high blood pressure, stress level), the generative AI generates a health assistance menu (e.g., relaxation music, low-salt meal plan, light exercise).

[0888] Step 5: Send Health Assist Menu

[0889] The server sends the generated health assistance menu to the user's smartphone.

[0890] Enter: Health Assist Menu

[0891] Output: Health assist menu sent to smartphone

[0892] Specific operation: The server uses the HTTP protocol to send the generated health assistance menu to the user's smartphone.

[0893] Step 6: Health Assist Menu and Abnormal Value Notification

[0894] The device (smartphone) receives the health assistance menu and notifies the user of abnormal values, and also sends alerts to relatives and medical institutions.

[0895] Input: Sent Health Assist Menu and Abnormal Value Notification

[0896] Output: Present to user and alert relatives and medical institutions

[0897] Specific actions: The smartphone uses voice guidance or a visual interface to provide the user with specific health assistance content, and if abnormal values ​​are detected, alerts are sent via email or SMS to pre-registered relatives or medical institutions.

[0898] Step 7: Order your food

[0899] The device (smartphone) orders meals from affiliated meal delivery services based on the proposed health assistance menu.

[0900] Enter: Health Assist Menu

[0901] Output: Order data for a food service

[0902] Specific operation: The smartphone uses the API of a partner food delivery service to order meals based on the health-assist menu. For example, if a low-sodium meal plan is suggested, the smartphone will order from a restaurant that offers that menu.

[0903] Through the above steps, the present invention comprehensively manages the user's health condition and provides optimal health assistance and meals.

[0904] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0905] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0906] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0907] [Third embodiment]

[0908] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0909] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0910] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0911] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0912] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0913] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0914] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0915] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0916] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0917] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0918] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0919] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0920] The present invention relates to an AI-powered smart earphone system that supports health management for the elderly. The system includes a biosensor for measuring vital signs, a communication unit, an analysis unit, a generation unit, a transmission unit, a notification unit, and an alert unit.

[0921] System Configuration

[0922] The monitoring AI smart earphone system consists of an earphone device worn by the user, the user's communication device (such as a smartphone or tablet), and a cloud server.

[0923] The earphone device is equipped with biometric sensors that measure the user's temperature, heart rate, blood pressure, and respiratory rate.

[0924] The communication terminal receives vital sign data transmitted via Bluetooth from the earphone device and relays the data to a cloud server.

[0925] The cloud server analyzes the received data in real time and generates a health assistance menu for each user.

[0926] Program processing

[0927] The operation of the system will be explained by dividing it into processing steps.

[0928] Vital sign measurement and data transmission

[0929] Terminal (earphone device): The earphones have built-in biosensors that periodically measure the user's body temperature, heart rate, blood pressure, and respiratory rate. The measured data is then sent via Bluetooth to the user's communication terminal.

[0930] Receiving and storing data

[0931] Communication terminal (smartphone): Received vital sign data is temporarily stored in local storage, and the data is also sent to a cloud server via the Internet.

[0932] Data analysis

[0933] Server: The cloud server receives data from the communication device and stores it in a database. Using a generative AI model, the received vital sign data is analyzed in real time to detect abnormal values ​​and evaluate health status.

[0934] Health assistance menu generation

[0935] Server: Based on the analysis results, the server generates an optimal health assistance menu for each user. The menu includes diet, exercise, sleep, and brain training, and is customized according to the user's health condition.

[0936] Assist menu and sending notifications

[0937] Server: After generating the optimal health assistance menu for the user, the server sends it to the user's communication device. If an abnormal value is detected, the server also sends an alert to pre-registered relatives and medical institutions.

[0938] User notification and assistance

[0939] Communication device (smartphone): The received health assistance menu is notified to the user as a voice guide. If an abnormal value is detected, it also notifies relatives and medical institutions.

[0940] Specific examples

[0941] As a specific example, consider a situation where user C is wearing AI-enabled smart earphones.

[0942] Vital sign measurement and data transmission

[0943] Terminal (earphone device): The earphone measures C's body temperature, heart rate, blood pressure, and respiratory rate. The data is sent to C's smartphone via Bluetooth.

[0944] Receiving and storing data

[0945] Communication terminal (smartphone): The smartphone receives the data and stores it in local storage. At the same time, it sends the data to the cloud server.

[0946] Data analysis

[0947] Server: The cloud server receives the data and begins analysis. The analysis reveals that Mr. C's heart rate is higher than normal.

[0948] Health assistance menu generation

[0949] Server: The generative AI generates a health assistance menu based on abnormal heart rate, such as relaxation exercises and low-salt meals.

[0950] Assist menu and sending notifications

[0951] Server: Sends the generated menu to Mr. C's smartphone. Also sends an alert to his son if his heart rate is abnormal.

[0952] User notification and assistance

[0953] Communication device (smartphone): The smartphone sends a voice guide to Mr. C about the menu he received. An alert is also sent to his son.

[0954] The above is a specific embodiment of the AI ​​smart earphone system for monitoring elderly people according to the present invention. This system enables more effective health management for elderly people, early detection of abnormalities, and prompt response.

[0955] The processing flow will be explained below.

[0956] Step 1:

[0957] Terminal (earphone device): The biosensor built into the earphone measures the user's body temperature, heart rate, blood pressure, and respiratory rate. The sensor is set to automatically measure at regular intervals.

[0958] Step 2:

[0959] Terminal (earphone device): The measured vital sign data is sent to the user's communication terminal (smartphone) via Bluetooth. The data is encrypted during transmission to prevent data leakage.

[0960] Step 3:

[0961] User's communication device (smartphone): The received vital sign data is stored in the smartphone's local storage. At the same time, the data is sent from the smartphone to a cloud server via the Internet. The data is also encrypted during transmission.

[0962] Step 4:

[0963] Server: The cloud server receives vital sign data sent from the user's communication device. The received data is stored in a database and analyzed in real time.

[0964] Step 5:

[0965] Server: Analyzes the received data using a generative AI model. The analysis checks the data for anomalies and assesses the user's health status. For example, a higher-than-normal heart rate or sudden fluctuations in blood pressure can be detected.

[0966] Step 6:

[0967] Server: Based on the analysis results, a personalized health assistance menu is generated for each user. The generated menu includes specific suggestions for diet, exercise, sleep, and brain training. For example, if a person's heart rate is high, relaxation exercises will be suggested, and if blood pressure is high, a low-salt meal menu will be presented.

[0968] Step 7:

[0969] Server: Sends the generated health assistance menu to the user's communication device (smartphone). At the same time, if abnormal values ​​are detected in the vital signs, an alert is sent to pre-registered relatives or medical institutions.

[0970] Step 8:

[0971] User's communication device (smartphone): The received health assistance menu is notified to the user via voice guidance and a visual interface. The voice guidance provides easy-to-understand explanations of the specific health assistance content. In addition, if an abnormal value is detected, an alert is sent to relatives and medical institutions.

[0972] Step 9:

[0973] User: Follow the instructions on the smartphone to begin implementing the health assistance menu, such as performing relaxation exercises, eating the recommended diet, and creating an appropriate sleeping environment.

[0974] The above is the specific program processing of the monitoring AI smart earphone system, which will monitor the health status of elderly people in real time and enable optimal health management.

[0975] Example 1

[0976] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0977] While appropriate measurement and analysis of vital signs is important for the health management of elderly people, there is currently a lack of systems that can do this efficiently and in real time. Furthermore, while early detection of abnormal values ​​and appropriate responses are required, conventional systems have difficulty in providing prompt notifications and generating individually customized health assistance menus. The purpose of this invention is to solve these problems and provide a system for more effective health management of elderly people.

[0978] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0979] In this invention, the server includes a biosensor for measuring vital signs, a communication device for transmitting the measured vital sign data to the user's communication device, a communication device for relaying the vital sign data to the server, an analysis device for analyzing the vital sign data in real time at the server, a generation device for generating a personalized health assist menu based on the analysis results, a transmission device for transmitting the health assist menu to the communication device, a notification device for presenting the health assist menu and an abnormal value notification to the user from the communication device, an alert device for sending the abnormal value notification to a relative or a medical institution, a storage device for temporarily storing the vital sign data in local storage upon receiving the data, a transmission device for transmitting the data via Bluetooth or the Internet, a notification device for notifying a relative or a medical institution using an alert generated when an abnormal value is detected, and a generation device for generating a health assist menu using a generative AI model. This enables real-time monitoring of the health of elderly people, enabling early detection and prompt response to abnormalities. Furthermore, providing a personalized health assist menu can be expected to improve the subject's health.

[0980] "Vital signs" are physiological indicators used to assess health status and generally include temperature, heart rate, blood pressure, and respiratory rate.

[0981] "Biosensor means" refers to devices or components used to measure a user's vital signs, and typically includes a thermometer, heart rate sensor, blood pressure monitor, respiratory sensor, etc.

[0982] "Communication means" refers to the technology and devices for transmitting measured vital sign data to the user's communication terminal, and includes wireless communication technologies such as Bluetooth and Wi-Fi.

[0983] The "communication terminal means" is a device used by a user, such as a smartphone or tablet, that receives vital sign data and relays it to a server via the Internet.

[0984] "Analysis means" refers to the technology and algorithms for analyzing vital sign data received by the server in real time, including the generative AI model.

[0985] "Generation means" refers to the technology and process for generating an individual health assistance menu based on the analysis results, and includes suggestions for diet, exercise, sleep, and brain training.

[0986] The "transmission means" refers to the technology and device for transmitting the generated health assistance menu to the user's communication terminal, and includes the Internet and wireless communication technology.

[0987] "Notification means" refers to the technology and process for presenting the health assistance menu and abnormal value notifications to the user from the user's communication terminal, and includes voice guidance and push notifications, etc.

[0988] "Alert Method" means the technology and process for sending abnormal value notifications to relatives or healthcare providers, including SMS, email, or app notifications.

[0989] "Storage means" refers to the technology and devices for temporarily storing vital sign data in local storage when it is received, and includes databases and file systems within the smartphone.

[0990] "Generative AI model" refers to the artificial intelligence algorithm used to analyze vital sign data and generate health assistance menus.

[0991] "Bluetooth" is a type of short-range wireless communication technology used to transmit vital sign data from an earphone device to a user's communication terminal.

[0992] "Internet" is a global network for transmitting data to remote servers and is used for cloud transmission of vital signs data.

[0993] The "health assistance menu" is a personalized proposal generated based on the user's health status, and includes specific action plans for diet, exercise, sleep, and brain training.

[0994] This invention relates to an AI-powered smart earphone system for managing the health of elderly people. This system uses biosensors, communication terminals, and a cloud server to monitor users' health information in real time, detect abnormalities early, and take appropriate measures.

[0995] System Configuration

[0996] The monitoring AI smart earphone system includes the following components:

[0997] Earbud device: Equipped with biometric sensors, it measures the user's temperature, heart rate, blood pressure, and respiratory rate.

[0998] Communication terminal: A smartphone or tablet that receives vital sign data transmitted via Bluetooth from the earphone device and relays the data to a cloud server.

[0999] Cloud server: Analyzes the received data in real time and generates a health assistance menu for each user.

[1000] Hardware and Software Configuration

[1001] earphone device

[1002] The earphone device is equipped with multiple biosensors, including a thermometer, heart rate sensor, blood pressure monitor, and respiratory sensor, and is also equipped with a Bluetooth module that transmits the measured data to a communication terminal.

[1003] communication terminal

[1004] The communication terminals used are smartphones, tablets, etc. These terminals have the function of receiving data from the earphone device via Bluetooth and temporarily storing it in their internal local storage. They also have a transmission function, which sends the data to a cloud server via the Internet.

[1005] Cloud Server

[1006] The cloud server is equipped with an analysis system that includes a database and a generative AI model. The received vital sign data is stored in the server's database and analyzed in real time. Based on the analysis results, a health assistance menu customized for each user is generated.

[1007] Specific examples

[1008] User C's scenario

[1009] When user C is wearing the monitoring AI smart earphones, the following specific actions will occur:

[1010] 1. Earphone device: The earphone measures C's body temperature, heart rate, blood pressure, and respiratory rate and transmits the data to C's smartphone via Bluetooth.

[1011] 2. Communication terminal: The smartphone receives the data, stores it in local storage, and simultaneously transmits the data to the cloud server.

[1012] 3. Cloud server: The cloud server receives the data and begins analysis using the generative AI model. For example, if Mr. C’s heart rate is higher than normal, it will be determined to be abnormal.

[1013] 4. Generating a health assistance menu: Based on the analysis results, a health assistance menu such as relaxation exercises and low-salt meals is generated.

[1014] 5. Notifications and alerts: The generated menu is sent to Mr. C's smartphone and notified as an audio guide. At the same time, if an abnormal value is detected, an alert is sent to Mr. C's relatives and medical institutions.

[1015] Prompt Sentence Examples

[1016] "I would like to develop an AI system to support the health management of elderly people. I would like to measure vital signs using an earphone device and analyze the data in the cloud. Specifically, what kind of prompts would be appropriate?"

[1017] This system will enable efficient health management for users, enabling early detection and response of abnormalities. Furthermore, by providing individually customized health assistance menus, it is expected that users' health conditions will improve.

[1018] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1019] Step 1: Measuring vital signs with biosensors

[1020] Terminal (earphone device): The biosensors built into the earphones measure the user's body temperature, heart rate, blood pressure, and respiratory rate. Specifically, a temperature sensor is used for body temperature, a photoelectric pulse sensor for heart rate, a pressure sensor for blood pressure, and an acceleration sensor for respiratory rate. The measured data (body temperature: 36.5°C, heart rate: 75 bpm, blood pressure: 120 / 80 mmHg, respiratory rate: 18 breaths / min) is sent to the next step via Bluetooth communication.

[1021] Input: User's vital signs (temperature, heart rate, blood pressure, respiratory rate)

[1022] Output: Measured vital signs data

[1023] Step 2: Sending data

[1024] Terminal (earphone device): The measured vital sign data is sent to the user's communication terminal via Bluetooth. Specifically, the earphone device turns on Bluetooth and sends a data packet to the paired communication terminal.

[1025] Input: Measured vital signs data

[1026] Output: Data sent via Bluetooth communication

[1027] Step 3: Receiving and saving data (communication terminal)

[1028] Communication terminal (smartphone): The data sent from the earphone device is received using a Bluetooth receiving module and temporarily stored in the smartphone's local storage. Specifically, the received data is structured in JSON format and written to a database such as SQLite. For example, "Body temperature: 36.5°C, heart rate: 75 bpm, blood pressure: 120 / 80 mmHg, respiratory rate: 18 breaths / min" is stored.

[1029] Input: Vital signs data sent via Bluetooth communication

[1030] Output: Data saved in local storage

[1031] Step 4: Send data to the cloud

[1032] Communication terminal (smartphone): Sends temporarily stored vital sign data to a cloud server via the Internet. Specifically, it generates an HTTP request and uses a REST API to send the data to the cloud server's endpoint. The data is encrypted using SSL / TLS.

[1033] Input: Data stored in local storage

[1034] Output: Data sent to the cloud server

[1035] Step 5: Receiving data on the cloud server for analysis

[1036] Server: The cloud server receives the data sent from the communication device and stores it in an internal database. Specifically, it analyzes the received JSON format data and inserts it into the database. For example, it stores "body temperature: 36.5°C, heart rate: 75 bpm, blood pressure: 120 / 80 mmHg, respiratory rate: 18 breaths / min."

[1037] Input: Data sent to the cloud server

[1038] Output: Data stored in the database

[1039] Step 6: Data analysis using analytical algorithms

[1040] Server: Analyzes received vital sign data in real time using a generative AI model. Specifically, it retrieves data from the database, detects abnormal values, and evaluates health status. For example, it applies logic that determines an abnormality when the heart rate is 90 bpm or higher.

[1041] Input: Data stored in a database

[1042] Output: Analysis results (e.g. high heart rate)

[1043] Step 7: Create a Health Assist Menu

[1044] Server: Generates a health assistance menu based on the analysis results. The generation AI creates suggestions such as "dietary advice," "exercise plans," "tips for improving sleep quality," and "brain training" based on the user's health condition. For example, if the heart rate is high, it suggests "one minute of relaxing breathing exercises."

[1045] Input: Analysis results

[1046] Output: Health Assist Menu

[1047] Step 8: Assist Menu and Sending Alerts

[1048] Server: Sends the generated health assistance menu to the user's communication device, and if an abnormal value is detected, sends an alert message to relatives or medical institutions. Specifically, it generates an HTTP request and sends it to the communication device and the device to which the alert is sent.

[1049] Input: Health Assist Menu, Abnormal Value Detection

[1050] Output: Menu sent to user's communication device, notification sent as alert

[1051] Step 9: Inform and assist users

[1052] Communication device (smartphone): The received health assistance menu is notified to the user as a voice guide. If an abnormal value is detected, an alert is sent to relatives and medical institutions as well. Specifically, the smartphone's voice synthesis function is used to notify the user through the earphone device, saying, "Try relaxing breathing exercises." In addition, SMS and app notifications are used to notify relatives that "your heart rate is high."

[1053] Input: Health Assist Menu, Alert

[1054] Output: Audio instructions to user, notification to relatives

[1055] At each processing step of this system, the user, device, and server work together to effectively manage and assist the health of elderly people. By providing individual health assistance menus based on the analysis results, it is expected that health conditions will improve.

[1056] (Application example 1)

[1057] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1058] Health management for the elderly is an important social issue, and there is a need for early detection of abnormalities in elderly people living independently and rapid response. However, conventional health management systems have problems in that it is difficult to generate assistance menus appropriate for individual health conditions, and they are unable to notify or respond quickly in emergencies. Furthermore, because it is necessary to provide accurate and prompt information not only to the elderly themselves but also to their relatives and medical institutions, a system with advanced analytical functions is required.

[1059] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1060] In this invention, the server includes an analysis means for analyzing vital sign data in real time, a generation means for generating an individual health support menu based on the analysis results using a generative AI model, and a transmission means for individually customizing and transmitting the health support menu using prompt text. This makes it possible to monitor the health status of elderly people in real time, detect abnormalities early, and provide individually customized health support menus. In addition, since relatives and medical institutions can be quickly notified in the event of an abnormality, a system can be realized that effectively supports emergency response.

[1061] "Vital signs" are basic physiological indicators related to maintaining human life, such as body temperature, heart rate, blood pressure, and respiratory rate.

[1062] A "biosensor" is a device that is attached to the human body to measure vital signs.

[1063] "Communication means" is a function for transmitting measured vital sign data to a personal communication device.

[1064] A "communications terminal" is a device for relaying vital signs data to a central system.

[1065] The "central system" is a system such as a server that receives and analyzes vital sign data and generates a health support menu.

[1066] The "analysis means" is a function for analyzing vital sign data in real time.

[1067] The "generation means" is a function for generating an individual health support menu based on the analysis results.

[1068] The "transmission means" is a function for transmitting the generated health support menu to an individual's communication device.

[1069] "Notification means" is a function for providing individuals with health support menus and abnormal value notifications.

[1070] "Alert means" is a function for sending emergency notifications to relatives and medical institutions when abnormal values ​​are detected.

[1071] A "generative AI model" is an artificial intelligence model that uses generated algorithms to analyze data and generate a health support menu.

[1072] A "prompt sentence" is an instruction sentence input to a generative AI model and is used during analysis and menu generation.

[1073] This invention relates to an AI-powered smart earphone system that supports the health management of elderly people. This system combines a biosensor, a communication terminal, an analysis unit, a generation unit, a transmission unit, a notification unit, an alert unit, a generation AI model, and a prompt sentence.

[1074] The system consists of an earphone device worn by the user, the user's communication terminal (e.g., a smartphone), and a cloud server.

[1075] The earphone device is equipped with built-in biosensors that can measure vital signs such as body temperature, heart rate, blood pressure, and respiratory rate, and transmits this data via Bluetooth to the user's communication device.

[1076] The communication device (such as a smartphone) temporarily stores the vital sign data received from the earphone device via Bluetooth in local storage, and then transmits the data to a cloud server via the Internet.

[1077] The cloud server analyzes vital sign data in real time using a generative AI model. Based on the analysis results, a personalized health support menu is generated, including diet, exercise, sleep, and mental training. The generated menu is customized for each user using prompts.

[1078] As a concrete example, when user C is wearing the AI ​​monitoring smart earphones, the earphone device measures C's body temperature, heart rate, blood pressure, and respiratory rate, and sends the data to C's smartphone via Bluetooth. The smartphone then sends the data to a cloud server, where the generative AI model begins analysis.

[1079] For example, the generative AI model performs an analysis based on the prompt, "If the heart rate is 85 or higher, it is determined to be a risk and a health support menu will be generated." As a result, advice such as relaxation exercises and a low-salt diet is generated and sent to User C's smartphone. Additionally, if an abnormal value is detected, an emergency notification is sent to pre-registered relatives and medical institutions.

[1080] This makes it possible to monitor the health status of elderly people in real time, detect abnormalities early, and provide a system that can take appropriate action quickly.

[1081] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1082] Step 1:

[1083] The biosensor built into the earphone device measures the user's vital signs (body temperature, heart rate, blood pressure, respiratory rate). The measurement data is converted into digital signals and sent to the user's communication device via Bluetooth. The input is sensor data, and the output is data sent to the communication device.

[1084] Step 2:

[1085] The terminal (communication device) receives vital sign data from the earphone device via Bluetooth and temporarily stores it in local storage. The stored data is then sent to a cloud server via the Internet. The input is a Bluetooth signal, and the output is data sent to the cloud server.

[1086] Step 3:

[1087] The server receives vital sign data sent from the communication device and stores it in a database. Based on the stored data, it analyzes the data in real time using a generative AI model. The input is the received vital sign data, and the output is the analysis results.

[1088] Step 4:

[1089] The server uses a generative AI model to generate an individual health support menu based on the analysis results. A menu customized for each user is generated using a prompt. For example, based on the prompt "If the heart rate is 85 or higher, determine that there is a risk and generate a health support menu." The input is the analysis results, and the output is a customized health support menu.

[1090] Step 5:

[1091] The server transmits the generated health support menu to the user's communication device, where the input is the generated health support menu and the output is the transmission of the menu.

[1092] Step 6:

[1093] The terminal (communication device) receives a health support menu and notifies the user as a voice guide. If an abnormal value is detected, an alert notification is sent to pre-registered relatives and medical institutions. The input is the received support menu and abnormal value notification, and the output is a notification to the user, relatives, and medical institutions.

[1094] Through these steps, the system can monitor the elderly person's vital signs in real time, provide appropriate health support menus, and quickly notify in the event of an abnormality.

[1095] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1096] This invention relates to an AI-powered smart earphone system that supports the health management of elderly people. The system includes a biosensor for measuring vital signs, a communication unit, an analysis unit, a generation unit, a transmission unit, a notification unit, an alert unit, and an emotion engine that recognizes the user's emotions.

[1097] System Configuration

[1098] The monitoring AI smart earphone system consists of an earphone device worn by the user, the user's communication device (such as a smartphone or tablet), a cloud server, and an emotion engine.

[1099] Earphone device: Equipped with biosensors, it measures the user's temperature, heart rate, blood pressure, and respiratory rate.

[1100] Communication terminal: Receives vital sign data sent via Bluetooth from the earphone device and relays the data to a cloud server.

[1101] Cloud server: Analyzes the received data in real time and generates a health assistance menu for each user.

[1102] Emotion engine: Recognizes the user's emotional state by analyzing voice and facial expression data.

[1103] Program processing

[1104] The operation of the system will be explained by dividing it into processing steps.

[1105] Vital sign measurement and data transmission

[1106] Terminal (earphone device): The earphones have built-in biosensors that periodically measure the user's body temperature, heart rate, blood pressure, and respiratory rate. The measured data is then sent via Bluetooth to the user's communication terminal.

[1107] Receiving and storing data

[1108] Communication terminal (smartphone): Received vital sign data is stored in the smartphone's local storage, and the data is also sent from the smartphone to a cloud server via the Internet.

[1109] Data analysis

[1110] Server: The cloud server receives data from the communication device and stores it in a database. Using a generative AI model, the received vital sign data is analyzed in real time to detect abnormal values ​​and evaluate health status.

[1111] Recognition of emotional states

[1112] Server: The emotion engine analyzes the user's voice and facial expression data to recognize their emotional state. For example, it determines whether the user is feeling stressed or tired from the voice data.

[1113] Health assistance menu generation

[1114] Server: Generates an optimal health assistance menu for each user based on the analysis results and the emotional state determined by the emotion engine. The menu includes diet, exercise, sleep, and brain training. Based on the emotional state, if the user is feeling stressed, relaxation exercises and music will be suggested, and if the user is feeling tired, a menu that prioritizes rest will be generated.

[1115] Assist menu and sending notifications

[1116] Server: Sends the generated health assistance menu to the user's communication device (smartphone). If abnormalities are detected in the user's vital signs or emotional state, it sends alerts to pre-registered relatives and medical institutions.

[1117] User notification and assistance

[1118] Communication device (smartphone): The received health assistance menu is notified to the user via voice guidance and a visual interface. The voice guidance provides easy-to-understand explanations of the specific health assistance content. In addition, if an abnormality is detected, an alert is sent to relatives and medical institutions.

[1119] Specific examples

[1120] As a specific example, consider a situation where user D is wearing AI-enabled smart earphones.

[1121] Vital sign measurement and data transmission

[1122] Terminal (earphone device): The earphone measures D's body temperature, heart rate, blood pressure, and respiratory rate. The data is sent to D's smartphone via Bluetooth.

[1123] Receiving and storing data

[1124] Communication terminal (smartphone): The smartphone receives the data and stores it in local storage. At the same time, it sends the data to the cloud server.

[1125] Data analysis

[1126] Server: The cloud server receives the data and begins analysis. The analysis reveals that Mr. D's blood pressure is higher than normal.

[1127] Recognition of emotional states

[1128] Server: The emotion engine recognizes Mr. D's stress level from his voice and facial expressions.

[1129] Health assistance menu generation

[1130] Server: Generates a health assistance menu including relaxation exercises and music based on abnormal heart rate and stress levels.

[1131] Assist menu and sending notifications

[1132] Server: Sends the generated menu to Mr. D's smartphone. It also sends alerts to his relatives about his stress level and abnormal blood pressure.

[1133] User notification and assistance

[1134] Communication device (smartphone): The smartphone receives the menu and notifies Mr. D of it as an audio guide. Alerts are also sent to his relatives.

[1135] The above is a specific embodiment of the AI-powered smart earphone system of the present invention. This system monitors the health status of elderly people in real time, enabling optimal health management. Furthermore, the introduction of an emotion engine realizes comprehensive health assistance that also takes into account the user's mental health.

[1136] The processing flow will be explained below.

[1137] Step 1:

[1138] Terminal (earphone device): The biosensor built into the earphone measures the user's body temperature, heart rate, blood pressure, and respiratory rate. The sensor is set to automatically measure at regular intervals.

[1139] Step 2:

[1140] Terminal (earphone device): The measured vital sign data is sent to the user's communication terminal (smartphone) via Bluetooth. The data is encrypted during transmission to prevent data leakage.

[1141] Step 3:

[1142] User's communication device (smartphone): The received vital sign data is stored in the smartphone's local storage. The data is also sent from the smartphone to a cloud server via the Internet. The data is also encrypted during transmission.

[1143] Step 4:

[1144] Server: The cloud server receives vital sign data sent from the user's communication device. The received data is stored in a database and analyzed in real time.

[1145] Step 5:

[1146] Server: Analyzes the received vital signs data in real time using a generative AI model. The analysis checks for abnormalities in the data and evaluates the user's health status. For example, a high heart rate or sudden fluctuations in blood pressure can be detected.

[1147] Step 6:

[1148] Server: The emotion engine analyzes the user's voice and facial expression data to recognize their emotional state. For example, it can detect stress or fatigue from the tone of their voice and the content of their words.

[1149] Step 7:

[1150] Server: Generates the optimal health assistance menu for each user based on the analysis results and the emotional state of the user as determined by the emotion engine. For example, it suggests relaxation exercises for a user feeling stressed, and creates a menu that prioritizes rest for a user feeling fatigued.

[1151] Step 8:

[1152] Server: Sends the generated health assistance menu to the user's communication device. If abnormal values ​​or emotional state problems are detected, an alert is sent to pre-registered relatives or medical institutions.

[1153] Step 9:

[1154] User's communication device (smartphone): The health assistance menu is notified to the user through voice guidance and a visual interface. The notification includes specific health assistance content (e.g., relaxation exercises, recommended meals, rest methods, etc.).

[1155] Step 10:

[1156] User: Follows the instructions on the smartphone to carry out the health assistance menu, such as performing relaxation exercises, eating recommended meals, and creating an appropriate sleeping environment.

[1157] The above is the specific program processing of the AI ​​smart earphone monitoring system that combines an emotion engine. This system comprehensively manages the user's health, enabling early detection of abnormalities and rapid response. Furthermore, the introduction of the emotion engine realizes optimal health assistance that also takes the user's mental health into consideration.

[1158] Example 2

[1159] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1160] Health management for the elderly requires real-time monitoring of their health status and prompt notification when abnormalities are detected. Health management also requires a comprehensive approach that considers not only the user's physical data but also their emotional state. However, conventional systems have difficulty in managing health while taking emotional state into account, and have been unable to provide real-time notifications or take appropriate measures when abnormalities are detected.

[1161] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1162] In this invention, the server includes an analysis means including an emotion engine, a generation means for generating a health assistance menu based on the analysis results and the emotional state using a generative AI model, and an alert means for sending an abnormal value notification to a relative or a medical institution. This enables comprehensive analysis of the user's physical data and emotional state, enabling appropriate health management in real time and prompt alert notification.

[1163] "Vital signs" are basic physiological indicators of the human body, such as body temperature, heart rate, blood pressure, and respiratory rate.

[1164] A "biosensor means" is a sensor device used to measure a user's vital signs.

[1165] "Communication means" refers to a means for transmitting measured vital sign data to other terminals or systems.

[1166] The "communication terminal means" is a means for relaying data to the cloud computing system using a user's communication terminal.

[1167] The "analysis means" is a means for analyzing vital sign data received by the cloud computing system in real time.

[1168] A "generative AI model" is a model that uses artificial intelligence technology to analyze vital sign data and emotional data and recognize abnormal values ​​and emotional states.

[1169] An "emotion engine" is a technology that analyzes a user's voice and facial expression data to recognize their emotional state.

[1170] The "generation means" is a means for generating an individual health assistance menu based on the analysis results and the emotional state.

[1171] The "transmission means" is a means for transmitting the generated health assistance menu to the user's communication terminal.

[1172] The "notification means" is a means for presenting the health assistance menu and abnormal value notification to the user.

[1173] The "alert means" is a means for sending an abnormal value notification to a relative or a medical institution.

[1174] A "health assist menu" is a set of individually customized instructions and advice provided to improve and maintain the user's health.

[1175] This invention relates to an AI-powered smart earphone system for supporting elderly health management. The system includes a biosensor for measuring vital signs, a communication unit, an analysis unit, a generation unit, a transmission unit, a notification unit, an alert unit, and an emotion engine for recognizing the user's emotions.

[1176] System Configuration

[1177] The monitoring AI smart earphone system consists of an earphone device worn by the user, the user's communication device (such as a smartphone or tablet), a cloud computing system, and an emotion engine.

[1178] Earphone device: Equipped with biosensors, it measures the user's temperature, heart rate, blood pressure, and respiratory rate.

[1179] Communication terminal: Receives vital sign data transmitted via Bluetooth from the earphone device and relays the data to the cloud computing system.

[1180] Cloud computing system: Analyzes the received data and generates a health assistance menu for each user using a generative AI model.

[1181] Emotion engine: Recognizes the user's emotional state by analyzing voice and facial expression data.

[1182] Vital sign measurement and data transmission

[1183] Terminal (earphone device): The earphones have built-in biosensors that periodically measure the user's body temperature, heart rate, blood pressure, and respiratory rate. The measured data is then sent via Bluetooth to the user's communication terminal.

[1184] Receiving and storing data

[1185] Communication terminal (smartphone): The received vital sign data is stored in the smartphone's local storage, and the data is also sent from the smartphone to a cloud computing system via the Internet.

[1186] Data analysis

[1187] Server (cloud computing system): The cloud server receives data from the communication device and stores it in a database. Using a generative AI model, the received vital sign data is analyzed in real time to detect abnormal values ​​and evaluate health status.

[1188] Recognition of emotional states

[1189] Server: The emotion engine analyzes the user's voice and facial expression data to recognize their emotional state. For example, it determines whether the user is feeling stressed or tired from the voice data.

[1190] Health assistance menu generation

[1191] Server: Generates an optimal health assistance menu for each user based on the analysis results and the emotional state of the emotion engine. The menu includes diet, exercise, sleep, and brain training. Based on the emotional state, if the user is feeling stressed, relaxation exercises and music will be suggested. If the user is feeling tired, a menu that prioritizes rest will be generated.

[1192] Assist menu and sending notifications

[1193] Server: Sends the generated health assistance menu to the user's communication device (smartphone). If abnormalities are detected in the user's vital signs or emotional state, it sends alerts to pre-registered relatives and medical institutions.

[1194] User notification and assistance

[1195] Communication device (smartphone): The received health assistance menu is notified to the user via voice guidance and a visual interface. The voice guidance provides easy-to-understand explanations of the specific health assistance content. In addition, if an abnormality is detected, an alert is sent to relatives and medical institutions.

[1196] Specific examples

[1197] As a specific example, consider a situation where a user is wearing AI-enabled smart earphones.

[1198] Vital sign measurement and data transmission

[1199] Terminal (earphone device): The earphone measures the user's temperature, heart rate, blood pressure, and respiratory rate. The data is sent to the user's smartphone via Bluetooth.

[1200] Receiving and storing data

[1201] Communication terminal (smartphone): The smartphone receives the data and stores it in local storage, while simultaneously transmitting the data to the cloud computing system.

[1202] Data analysis

[1203] Server: The cloud server receives the data and begins analysis, which reveals that the user's blood pressure is higher than normal.

[1204] Recognition of emotional states

[1205] Server: The emotion engine recognizes the user's stress level from their voice and facial expressions.

[1206] Health assistance menu generation

[1207] Server: Generates a health assistance menu including relaxation exercises and music based on abnormal heart rate and stress levels.

[1208] Assist menu and sending notifications

[1209] Server: Sends the generated menu to the user's smartphone, and also sends alerts to relatives about stress levels and abnormal blood pressure.

[1210] User notification and assistance

[1211] Communication device (smartphone): The smartphone receives the menu and notifies the user as a voice guide. Alerts are also sent to relatives.

[1212] The above is a specific embodiment of the AI-powered smart earphone system of the present invention. This system monitors the health status of elderly people in real time, enabling optimal health management. Furthermore, the introduction of an emotion engine realizes comprehensive health assistance that also takes into account the user's mental health.

[1213] Example prompts for generative AI models

[1214] "Write a program that analyzes the user's biometric data (body temperature, heart rate, blood pressure, respiratory rate) and voice data, detects abnormal values, recognizes emotional state, and generates an optimal health assistance menu."

[1215] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1216] Step 1:

[1217] User: The user puts on the earbud device. The earbuds use built-in biometric sensors to measure the user's temperature, heart rate, blood pressure, and respiratory rate.

[1218] Input: User's vital signs (temperature, heart rate, blood pressure, respiratory rate)

[1219] Output: Measured vital signs data

[1220] Specific behavior:

[1221] The earphone device measures body temperature (36.5 degrees), heart rate (72), blood pressure (130 / 80), and respiratory rate (15).

[1222] Step 2:

[1223] Terminal (earphone device): Measured vital sign data is sent to the user's communication terminal (smartphone) via Bluetooth.

[1224] Input: Measured vital signs data

[1225] Output: Vital signs data transmitted via Bluetooth

[1226] Specific behavior:

[1227] The earphone device sends the measurement data to a smartphone via Bluetooth.

[1228] Step 3:

[1229] Communication terminal (smartphone): Stores the received vital sign data in local storage and transmits the data to a cloud computing system via the Internet.

[1230] Input: Vital signs data received via Bluetooth

[1231] Output: Data stored in local storage and data sent to the cloud

[1232] Specific behavior:

[1233] The smartphone stores the data received from the earphones and sends it to a cloud server.

[1234] Step 4:

[1235] Server (cloud computing system): Receives vital sign data sent from the communication device and stores it in a database. It analyzes the data in real time using a generative AI model to detect abnormal values.

[1236] Input: Vital signs data sent to the cloud

[1237] Output: Data stored in the database and analysis results (presence or absence of outliers)

[1238] Specific behavior:

[1239] The cloud server receives the data, stores it in a database, and detects that the blood pressure is higher than normal (150 / 90).

[1240] Step 5:

[1241] Server: The emotion engine analyzes the user's voice and facial expression data to recognize their emotional state.

[1242] Input: User voice or facial expression data

[1243] Output: Perceived emotional state (e.g., stress state)

[1244] Specific behavior:

[1245] The server analyzes the voice saying "I'm a little busy" and recognizes that Mr. D is in a stressful state.

[1246] Step 6:

[1247] Server: Generates the optimal health assistance menu for each user based on the analysis results and emotional state.

[1248] Input: Analysis results and emotional state

[1249] Output: Health Assist Menu

[1250] Specific behavior:

[1251] Based on abnormal heart rate and stress levels, a health assistance menu including relaxation exercises and relaxation music is generated.

[1252] Step 7:

[1253] Server: Sends the generated health assistance menu and abnormality notifications to the user's communication device. If an abnormality is detected, it also sends an alert to relatives and medical institutions.

[1254] Input: Health Assist menu and abnormal data

[1255] Output: Sending to communication terminal and sending alerts

[1256] Specific behavior:

[1257] The server sends a menu of relaxation exercises to the smartphone and sends alerts about stress and high blood pressure to relatives.

[1258] Step 8:

[1259] Communication device (smartphone): The received health assistance menu is notified to the user via voice guidance and a visual interface. If an abnormality is detected, an alert is sent to relatives and medical institutions.

[1260] Input: Health Assist Menu and Alert Notifications

[1261] Output: User notification and alert to relatives or medical facility

[1262] Specific behavior:

[1263] The smartphone will start playing relaxation music and will also play a voice prompt saying, "Please do some relaxation exercises." At the same time, an alert will be sent to relatives.

[1264] (Application example 2)

[1265] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1266] In modern society, managing the health status of elderly people in real time and providing optimal health assistance is an important issue. Conventional health management systems simply measure vital signs and are unable to provide comprehensive health assistance based on the user's emotional state or stress level. Furthermore, although the dietary habits of elderly people have a significant impact on their health, there has been a lack of systems that provide optimal meal plans and allow easy ordering of meals. This makes it difficult for elderly people to manage their health in their daily lives.

[1267] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1268] In this invention, the server includes a biosensor means for measuring vital signs, a communication means for transmitting the measured vital sign data to the user's communication terminal, a communication terminal means for relaying the vital sign data to the server, an analysis means for analyzing the vital sign data in real time at the server, a generation means for generating an individual health assist menu based on the results of the analysis, a transmission means for transmitting the health assist menu to the communication terminal, a notification means for presenting the health assist menu and an abnormal value notification to the user from the communication terminal, an alert means for transmitting the abnormal value notification to a relative or a medical institution, and an ordering means for ordering meals from an affiliated meal service based on the proposed health assist menu. This makes it possible to monitor the health status of an elderly person in real time, provide comprehensive health assistance, and propose optimal meal plans and easily order meals.

[1269] definition statement

[1270] "Vital signs" are indicators that show the basic life activities of a living organism, and refer to data such as body temperature, heart rate, blood pressure, and respiratory rate.

[1271] "Biosensor means" refers to an apparatus or device for measuring vital signs, and has a high-performance sensor built in.

[1272] "Communication means" refers to the device or protocol for transmitting measurement data to the user's communication terminal.

[1273] The "communication terminal means" refers to a terminal having a communication function for relaying the vital sign data to a server.

[1274] "Analysis means" refers to software or algorithms for analyzing received vital sign data in real time.

[1275] "Generation means" refers to software or functions for generating an individual health assistance menu based on the analysis results.

[1276] The "transmission means" refers to a function or device for transmitting the generated health assistance menu to the user's communication terminal.

[1277] "Notification means" refers to an interface or mechanism for presenting the health assistance menu and abnormal value notifications to the user.

[1278] "Alert measures" refers to systems and protocols for notifying relatives and medical institutions when abnormal values ​​are detected.

[1279] "Ordering Method" refers to the functionality and protocols for ordering meals from affiliated meal delivery services based on the proposed Health Assist Menu.

[1280] MODE FOR CARRYING OUT THE INVENTION

[1281] This invention is an AI-powered smart earphone system that supports the health management of the elderly by measuring vital signs, analyzing data, generating and notifying health assistance menus, and ordering meals from affiliated meal delivery services. This system uses the following means.

[1282] System Configuration

[1283] earphone device

[1284] The earphone device is equipped with built-in biosensors that periodically measure the elderly person's vital signs, such as temperature, heart rate, blood pressure, and respiratory rate, and this data is sent via Bluetooth to the user's smartphone.

[1285] communication means

[1286] The communication means includes a function for the user's smartphone to receive vital sign data transmitted from the earphone device, which is then transmitted from the smartphone to a cloud server via the internet.

[1287] Analysis means

[1288] The received vital sign data is analyzed in real time on a cloud server, where a generative AI model is used to detect abnormalities in the data and perform a comprehensive assessment of the patient's health, such as detecting abnormalities in heart rate or blood pressure.

[1289] generation means

[1290] Based on the analysis results, the cloud server generates an optimal health assistance menu for each user, including diet, exercise, sleep, and brain training, and also suggests relaxation exercises and music based on the user's emotional state.

[1291] Transmission method

[1292] The generated health assistance menu is sent from the cloud server to the user's smartphone.

[1293] Notification and alert methods

[1294] The smartphone will then present the received health assistance menu and abnormal value notifications to the user, and if an abnormal value is detected, an alert will be sent to pre-registered relatives and medical institutions.

[1295] Ordering Method

[1296] Based on the proposed health assistance menu, the user's smartphone will access the partner meal delivery service and order the appropriate meal, allowing seniors to receive the optimal meal without any hassle.

[1297] Specific use cases

[1298] For example, consider a situation where user D is wearing AI-powered smart earphones. The earphones measure body temperature, heart rate, blood pressure, and respiratory rate, and send this data to D's smartphone via Bluetooth. The smartphone transfers the data to a cloud server, where the generative AI model analyzes it. As a result of the analysis, it is determined that D's blood pressure is higher than normal, and the emotion engine recognizes this as a state of stress.

[1299] Based on this information, the cloud server generates a health assistance menu that includes relaxation exercises and music, and sends it to Mr. D's smartphone. It also orders meals that will help reduce stress from an affiliated meal delivery service.

[1300] Prompt Sentence Examples

[1301] Examples of prompts sent to the generative AI model include:

[1302] "Temperature: 36.7 degrees"

[1303] "Heart rate: 78 BPM"

[1304] "Blood pressure: 125 / 82 mmHg"

[1305] "Respiration rate: 15 RPM"

[1306] "Emotional state: Stress"

[1307] In this way, the present invention realizes a system that comprehensively monitors the health status of elderly people and provides optimal health assistance and meal orders.

[1308] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1309] System processing steps

[1310] Step 1: Measuring vital signs and sending data

[1311] The user wears the AI-powered smart earphones, and the biosensors periodically measure body temperature, heart rate, blood pressure, and respiratory rate, and the vital signs data is sent to the user's smartphone via Bluetooth.

[1312] Input: User's vital signs (temperature, heart rate, blood pressure, respiratory rate)

[1313] Output: Vital signs data sent to a smartphone

[1314] How it works: The earphone device collects data using temperature sensors, heart rate sensors, blood pressure sensors, and respiration sensors, and then transmits the data to a smartphone via Bluetooth.

[1315] Step 2: Receiving data and sending it to the cloud server

[1316] The terminal (smartphone) receives vital sign data from the earphone device and stores it in local storage. At the same time, the data is sent to a cloud server via the Internet.

[1317] Input: Vital signs data obtained from earphone device

[1318] Output: Vital signs data sent to the cloud server

[1319] Specific operation: The smartphone temporarily stores the data received via Bluetooth in local storage, and then transmits the data to a cloud server via the Internet using the HTTP protocol.

[1320] Step 3: Analyze the data

[1321] The server analyzes vital sign data sent to the cloud server in real time, using generative AI models to detect outliers and assess health status.

[1322] Input: Vital signs data sent to the cloud server

[1323] Output: Outliers and health assessment results

[1324] How it works: The cloud server uses generative AI models to analyze vital sign data, detect abnormalities (e.g., high blood pressure, low heart rate) and assess overall health.

[1325] Step 4: Create a Health Assist Menu

[1326] Based on the analysis results and the user's emotional state, the server generates a personalized health assistance menu, which includes diet, exercise, sleep, and brain training.

[1327] Input: Analysis results and emotional state data

[1328] Output: Health Assist Menu

[1329] Specific operation: Based on the analysis results (e.g., high blood pressure, stress level), the generative AI generates a health assistance menu (e.g., relaxation music, low-salt meal plan, light exercise).

[1330] Step 5: Send Health Assist Menu

[1331] The server sends the generated health assistance menu to the user's smartphone.

[1332] Enter: Health Assist Menu

[1333] Output: Health assist menu sent to smartphone

[1334] Specific operation: The server uses the HTTP protocol to send the generated health assistance menu to the user's smartphone.

[1335] Step 6: Health Assist Menu and Abnormal Value Notification

[1336] The device (smartphone) receives the health assistance menu and notifies the user of abnormal values, and also sends alerts to relatives and medical institutions.

[1337] Input: Sent Health Assist Menu and Abnormal Value Notification

[1338] Output: Present to user and alert relatives and medical institutions

[1339] Specific actions: The smartphone uses voice guidance or a visual interface to provide the user with specific health assistance content, and if abnormal values ​​are detected, alerts are sent via email or SMS to pre-registered relatives or medical institutions.

[1340] Step 7: Order your food

[1341] The device (smartphone) orders meals from affiliated meal delivery services based on the proposed health assistance menu.

[1342] Enter: Health Assist Menu

[1343] Output: Order data for a food service

[1344] Specific operation: The smartphone uses the API of a partner food delivery service to order meals based on the health-assist menu. For example, if a low-sodium meal plan is suggested, the smartphone will order from a restaurant that offers that menu.

[1345] Through the above steps, the present invention comprehensively manages the user's health condition and provides optimal health assistance and meals.

[1346] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1347] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1348] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1349] [Fourth embodiment]

[1350] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1351] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1352] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1353] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1354] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1355] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1356] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1357] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1358] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1359] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1360] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1361] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1362] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1363] The present invention relates to an AI-powered smart earphone system that supports health management for the elderly. The system includes a biosensor for measuring vital signs, a communication unit, an analysis unit, a generation unit, a transmission unit, a notification unit, and an alert unit.

[1364] System Configuration

[1365] The monitoring AI smart earphone system consists of an earphone device worn by the user, the user's communication device (such as a smartphone or tablet), and a cloud server.

[1366] The earphone device is equipped with biometric sensors that measure the user's temperature, heart rate, blood pressure, and respiratory rate.

[1367] The communication terminal receives vital sign data transmitted via Bluetooth from the earphone device and relays the data to a cloud server.

[1368] The cloud server analyzes the received data in real time and generates a health assistance menu for each user.

[1369] Program processing

[1370] The operation of the system will be explained by dividing it into processing steps.

[1371] Vital sign measurement and data transmission

[1372] Terminal (earphone device): The earphones have built-in biosensors that periodically measure the user's body temperature, heart rate, blood pressure, and respiratory rate. The measured data is then sent via Bluetooth to the user's communication terminal.

[1373] Receiving and storing data

[1374] Communication terminal (smartphone): Received vital sign data is temporarily stored in local storage, and the data is also sent to a cloud server via the Internet.

[1375] Data analysis

[1376] Server: The cloud server receives data from the communication device and stores it in a database. Using a generative AI model, the received vital sign data is analyzed in real time to detect abnormal values ​​and evaluate health status.

[1377] Health assistance menu generation

[1378] Server: Based on the analysis results, the server generates an optimal health assistance menu for each user. The menu includes diet, exercise, sleep, and brain training, and is customized according to the user's health condition.

[1379] Assist menu and sending notifications

[1380] Server: After generating the optimal health assistance menu for the user, the server sends it to the user's communication device. If an abnormal value is detected, the server also sends an alert to pre-registered relatives and medical institutions.

[1381] User notification and assistance

[1382] Communication device (smartphone): The received health assistance menu is notified to the user as a voice guide. If an abnormal value is detected, it also notifies relatives and medical institutions.

[1383] Specific examples

[1384] As a specific example, consider a situation where user C is wearing AI-enabled smart earphones.

[1385] Vital sign measurement and data transmission

[1386] Terminal (earphone device): The earphone measures C's body temperature, heart rate, blood pressure, and respiratory rate. The data is sent to C's smartphone via Bluetooth.

[1387] Receiving and storing data

[1388] Communication terminal (smartphone): The smartphone receives the data and stores it in local storage. At the same time, it sends the data to the cloud server.

[1389] Data analysis

[1390] Server: The cloud server receives the data and begins analysis. The analysis reveals that Mr. C's heart rate is higher than normal.

[1391] Health assistance menu generation

[1392] Server: The generative AI generates a health assistance menu based on abnormal heart rate, such as relaxation exercises and low-salt meals.

[1393] Assist menu and sending notifications

[1394] Server: Sends the generated menu to Mr. C's smartphone. Also sends an alert to his son if his heart rate is abnormal.

[1395] User notification and assistance

[1396] Communication device (smartphone): The smartphone sends a voice guide to Mr. C about the menu he received. An alert is also sent to his son.

[1397] The above is a specific embodiment of the AI ​​smart earphone system for monitoring elderly people according to the present invention. This system enables more effective health management for elderly people, early detection of abnormalities, and prompt response.

[1398] The processing flow will be explained below.

[1399] Step 1:

[1400] Terminal (earphone device): The biosensor built into the earphone measures the user's body temperature, heart rate, blood pressure, and respiratory rate. The sensor is set to automatically measure at regular intervals.

[1401] Step 2:

[1402] Terminal (earphone device): The measured vital sign data is sent to the user's communication terminal (smartphone) via Bluetooth. The data is encrypted during transmission to prevent data leakage.

[1403] Step 3:

[1404] User's communication device (smartphone): The received vital sign data is stored in the smartphone's local storage. At the same time, the data is sent from the smartphone to a cloud server via the Internet. The data is also encrypted during transmission.

[1405] Step 4:

[1406] Server: The cloud server receives vital sign data sent from the user's communication device. The received data is stored in a database and analyzed in real time.

[1407] Step 5:

[1408] Server: Analyzes the received data using a generative AI model. The analysis checks the data for anomalies and assesses the user's health status. For example, a higher-than-normal heart rate or sudden fluctuations in blood pressure can be detected.

[1409] Step 6:

[1410] Server: Based on the analysis results, a personalized health assistance menu is generated for each user. The generated menu includes specific suggestions for diet, exercise, sleep, and brain training. For example, if a person's heart rate is high, relaxation exercises will be suggested, and if blood pressure is high, a low-salt meal menu will be presented.

[1411] Step 7:

[1412] Server: Sends the generated health assistance menu to the user's communication device (smartphone). At the same time, if abnormal values ​​are detected in the vital signs, an alert is sent to pre-registered relatives or medical institutions.

[1413] Step 8:

[1414] User's communication device (smartphone): The received health assistance menu is notified to the user via voice guidance and a visual interface. The voice guidance provides easy-to-understand explanations of the specific health assistance content. In addition, if an abnormal value is detected, an alert is sent to relatives and medical institutions.

[1415] Step 9:

[1416] User: Follow the instructions on the smartphone to begin implementing the health assistance menu, such as performing relaxation exercises, eating the recommended diet, and creating an appropriate sleeping environment.

[1417] The above is the specific program processing of the monitoring AI smart earphone system, which will monitor the health status of elderly people in real time and enable optimal health management.

[1418] Example 1

[1419] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1420] While appropriate measurement and analysis of vital signs is important for the health management of elderly people, there is currently a lack of systems that can do this efficiently and in real time. Furthermore, while early detection of abnormal values ​​and appropriate responses are required, conventional systems have difficulty in providing prompt notifications and generating individually customized health assistance menus. The purpose of this invention is to solve these problems and provide a system for more effective health management of elderly people.

[1421] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1422] In this invention, the server includes a biosensor for measuring vital signs, a communication device for transmitting the measured vital sign data to the user's communication device, a communication device for relaying the vital sign data to the server, an analysis device for analyzing the vital sign data in real time at the server, a generation device for generating a personalized health assist menu based on the analysis results, a transmission device for transmitting the health assist menu to the communication device, a notification device for presenting the health assist menu and an abnormal value notification to the user from the communication device, an alert device for sending the abnormal value notification to a relative or a medical institution, a storage device for temporarily storing the vital sign data in local storage upon receiving the data, a transmission device for transmitting the data via Bluetooth or the Internet, a notification device for notifying a relative or a medical institution using an alert generated when an abnormal value is detected, and a generation device for generating a health assist menu using a generative AI model. This enables real-time monitoring of the health of elderly people, enabling early detection and prompt response to abnormalities. Furthermore, providing a personalized health assist menu can be expected to improve the subject's health.

[1423] "Vital signs" are physiological indicators used to assess health status and generally include temperature, heart rate, blood pressure, and respiratory rate.

[1424] "Biosensor means" refers to devices or components used to measure a user's vital signs, and typically includes a thermometer, heart rate sensor, blood pressure monitor, respiratory sensor, etc.

[1425] "Communication means" refers to the technology and devices for transmitting measured vital sign data to the user's communication terminal, and includes wireless communication technologies such as Bluetooth and Wi-Fi.

[1426] The "communication terminal means" is a device used by a user, such as a smartphone or tablet, that receives vital sign data and relays it to a server via the Internet.

[1427] "Analysis means" refers to the technology and algorithms for analyzing vital sign data received by the server in real time, including the generative AI model.

[1428] "Generation means" refers to the technology and process for generating an individual health assistance menu based on the analysis results, and includes suggestions for diet, exercise, sleep, and brain training.

[1429] The "transmission means" refers to the technology and device for transmitting the generated health assistance menu to the user's communication terminal, and includes the Internet and wireless communication technology.

[1430] "Notification means" refers to the technology and process for presenting the health assistance menu and abnormal value notifications to the user from the user's communication terminal, and includes voice guidance and push notifications, etc.

[1431] "Alert Method" means the technology and process for sending abnormal value notifications to relatives or healthcare providers, including SMS, email, or app notifications.

[1432] "Storage means" refers to the technology and devices for temporarily storing vital sign data in local storage when it is received, and includes databases and file systems within the smartphone.

[1433] "Generative AI model" refers to the artificial intelligence algorithm used to analyze vital sign data and generate health assistance menus.

[1434] "Bluetooth" is a type of short-range wireless communication technology used to transmit vital sign data from an earphone device to a user's communication terminal.

[1435] "Internet" is a global network for transmitting data to remote servers and is used for cloud transmission of vital signs data.

[1436] The "health assistance menu" is a personalized proposal generated based on the user's health status, and includes specific action plans for diet, exercise, sleep, and brain training.

[1437] This invention relates to an AI-powered smart earphone system for managing the health of elderly people. This system uses biosensors, communication terminals, and a cloud server to monitor users' health information in real time, detect abnormalities early, and take appropriate measures.

[1438] System Configuration

[1439] The monitoring AI smart earphone system includes the following components:

[1440] Earbud device: Equipped with biometric sensors, it measures the user's temperature, heart rate, blood pressure, and respiratory rate.

[1441] Communication terminal: A smartphone or tablet that receives vital sign data transmitted via Bluetooth from the earphone device and relays the data to a cloud server.

[1442] Cloud server: Analyzes the received data in real time and generates a health assistance menu for each user.

[1443] Hardware and Software Configuration

[1444] earphone device

[1445] The earphone device is equipped with multiple biosensors, including a thermometer, heart rate sensor, blood pressure monitor, and respiratory sensor, and is also equipped with a Bluetooth module that transmits the measured data to a communication terminal.

[1446] communication terminal

[1447] The communication terminals used are smartphones, tablets, etc. These terminals have the function of receiving data from the earphone device via Bluetooth and temporarily storing it in their internal local storage. They also have a transmission function, which sends the data to a cloud server via the Internet.

[1448] Cloud Server

[1449] The cloud server is equipped with an analysis system that includes a database and a generative AI model. The received vital sign data is stored in the server's database and analyzed in real time. Based on the analysis results, a health assistance menu customized for each user is generated.

[1450] Specific examples

[1451] User C's scenario

[1452] When user C is wearing the monitoring AI smart earphones, the following specific actions will occur:

[1453] 1. Earphone device: The earphone measures C's body temperature, heart rate, blood pressure, and respiratory rate and transmits the data to C's smartphone via Bluetooth.

[1454] 2. Communication terminal: The smartphone receives the data, stores it in local storage, and simultaneously transmits the data to the cloud server.

[1455] 3. Cloud server: The cloud server receives the data and begins analysis using the generative AI model. For example, if Mr. C’s heart rate is higher than normal, it will be determined to be abnormal.

[1456] 4. Generating a health assistance menu: Based on the analysis results, a health assistance menu such as relaxation exercises and low-salt meals is generated.

[1457] 5. Notifications and alerts: The generated menu is sent to Mr. C's smartphone and notified as an audio guide. At the same time, if an abnormal value is detected, an alert is sent to Mr. C's relatives and medical institutions.

[1458] Prompt Sentence Examples

[1459] "I would like to develop an AI system to support the health management of elderly people. I would like to measure vital signs using an earphone device and analyze the data in the cloud. Specifically, what kind of prompts would be appropriate?"

[1460] This system will enable efficient health management for users, enabling early detection and response of abnormalities. Furthermore, by providing individually customized health assistance menus, it is expected that users' health conditions will improve.

[1461] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1462] Step 1: Measuring vital signs with biosensors

[1463] Terminal (earphone device): The biosensors built into the earphones measure the user's body temperature, heart rate, blood pressure, and respiratory rate. Specifically, a temperature sensor is used for body temperature, a photoelectric pulse sensor for heart rate, a pressure sensor for blood pressure, and an acceleration sensor for respiratory rate. The measured data (body temperature: 36.5°C, heart rate: 75 bpm, blood pressure: 120 / 80 mmHg, respiratory rate: 18 breaths / min) is sent to the next step via Bluetooth communication.

[1464] Input: User's vital signs (temperature, heart rate, blood pressure, respiratory rate)

[1465] Output: Measured vital signs data

[1466] Step 2: Sending data

[1467] Terminal (earphone device): The measured vital sign data is sent to the user's communication terminal via Bluetooth. Specifically, the earphone device turns on Bluetooth and sends a data packet to the paired communication terminal.

[1468] Input: Measured vital signs data

[1469] Output: Data sent via Bluetooth communication

[1470] Step 3: Receiving and saving data (communication terminal)

[1471] Communication terminal (smartphone): The data sent from the earphone device is received using a Bluetooth receiving module and temporarily stored in the smartphone's local storage. Specifically, the received data is structured in JSON format and written to a database such as SQLite. For example, "Body temperature: 36.5°C, heart rate: 75 bpm, blood pressure: 120 / 80 mmHg, respiratory rate: 18 breaths / min" is stored.

[1472] Input: Vital signs data sent via Bluetooth communication

[1473] Output: Data saved in local storage

[1474] Step 4: Send data to the cloud

[1475] Communication terminal (smartphone): Sends temporarily stored vital sign data to a cloud server via the Internet. Specifically, it generates an HTTP request and uses a REST API to send the data to the cloud server's endpoint. The data is encrypted using SSL / TLS.

[1476] Input: Data stored in local storage

[1477] Output: Data sent to the cloud server

[1478] Step 5: Receiving data on the cloud server for analysis

[1479] Server: The cloud server receives the data sent from the communication device and stores it in an internal database. Specifically, it analyzes the received JSON format data and inserts it into the database. For example, it stores "body temperature: 36.5°C, heart rate: 75 bpm, blood pressure: 120 / 80 mmHg, respiratory rate: 18 breaths / min."

[1480] Input: Data sent to the cloud server

[1481] Output: Data stored in the database

[1482] Step 6: Data analysis using analytical algorithms

[1483] Server: Analyzes received vital sign data in real time using a generative AI model. Specifically, it retrieves data from the database, detects abnormal values, and evaluates health status. For example, it applies logic that determines an abnormality when the heart rate is 90 bpm or higher.

[1484] Input: Data stored in a database

[1485] Output: Analysis results (e.g. high heart rate)

[1486] Step 7: Create a Health Assist Menu

[1487] Server: Generates a health assistance menu based on the analysis results. The generation AI creates suggestions such as "dietary advice," "exercise plans," "tips for improving sleep quality," and "brain training" based on the user's health condition. For example, if the heart rate is high, it suggests "one minute of relaxing breathing exercises."

[1488] Input: Analysis results

[1489] Output: Health Assist Menu

[1490] Step 8: Assist Menu and Sending Alerts

[1491] Server: Sends the generated health assistance menu to the user's communication device, and if an abnormal value is detected, sends an alert message to relatives or medical institutions. Specifically, it generates an HTTP request and sends it to the communication device and the device to which the alert is sent.

[1492] Input: Health Assist Menu, Abnormal Value Detection

[1493] Output: Menu sent to user's communication device, notification sent as alert

[1494] Step 9: Inform and assist users

[1495] Communication device (smartphone): The received health assistance menu is notified to the user as a voice guide. If an abnormal value is detected, an alert is sent to relatives and medical institutions as well. Specifically, the smartphone's voice synthesis function is used to notify the user through the earphone device, saying, "Try relaxing breathing exercises." In addition, SMS and app notifications are used to notify relatives that "your heart rate is high."

[1496] Input: Health Assist Menu, Alert

[1497] Output: Audio instructions to user, notification to relatives

[1498] At each processing step of this system, the user, device, and server work together to effectively manage and assist the health of elderly people. By providing individual health assistance menus based on the analysis results, it is expected that health conditions will improve.

[1499] (Application example 1)

[1500] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1501] Health management for the elderly is an important social issue, and there is a need for early detection of abnormalities in elderly people living independently and rapid response. However, conventional health management systems have problems in that it is difficult to generate assistance menus appropriate for individual health conditions, and they are unable to notify or respond quickly in emergencies. Furthermore, because it is necessary to provide accurate and prompt information not only to the elderly themselves but also to their relatives and medical institutions, a system with advanced analytical functions is required.

[1502] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1503] In this invention, the server includes an analysis means for analyzing vital sign data in real time, a generation means for generating an individual health support menu based on the analysis results using a generative AI model, and a transmission means for individually customizing and transmitting the health support menu using prompt text. This makes it possible to monitor the health status of elderly people in real time, detect abnormalities early, and provide individually customized health support menus. In addition, since relatives and medical institutions can be quickly notified in the event of an abnormality, a system can be realized that effectively supports emergency response.

[1504] "Vital signs" are basic physiological indicators related to maintaining human life, such as body temperature, heart rate, blood pressure, and respiratory rate.

[1505] A "biosensor" is a device that is attached to the human body to measure vital signs.

[1506] "Communication means" is a function for transmitting measured vital sign data to a personal communication device.

[1507] A "communications terminal" is a device for relaying vital signs data to a central system.

[1508] The "central system" is a system such as a server that receives and analyzes vital sign data and generates a health support menu.

[1509] The "analysis means" is a function for analyzing vital sign data in real time.

[1510] The "generation means" is a function for generating an individual health support menu based on the analysis results.

[1511] The "transmission means" is a function for transmitting the generated health support menu to an individual's communication device.

[1512] "Notification means" is a function for providing individuals with health support menus and abnormal value notifications.

[1513] "Alert means" is a function for sending emergency notifications to relatives and medical institutions when abnormal values ​​are detected.

[1514] A "generative AI model" is an artificial intelligence model that uses generated algorithms to analyze data and generate a health support menu.

[1515] A "prompt sentence" is an instruction sentence input to a generative AI model and is used during analysis and menu generation.

[1516] This invention relates to an AI-powered smart earphone system that supports the health management of elderly people. This system combines a biosensor, a communication terminal, an analysis unit, a generation unit, a transmission unit, a notification unit, an alert unit, a generation AI model, and a prompt sentence.

[1517] The system consists of an earphone device worn by the user, the user's communication terminal (e.g., a smartphone), and a cloud server.

[1518] The earphone device is equipped with built-in biosensors that can measure vital signs such as body temperature, heart rate, blood pressure, and respiratory rate, and transmits this data via Bluetooth to the user's communication device.

[1519] The communication device (such as a smartphone) temporarily stores the vital sign data received from the earphone device via Bluetooth in local storage, and then transmits the data to a cloud server via the Internet.

[1520] The cloud server analyzes vital sign data in real time using a generative AI model. Based on the analysis results, a personalized health support menu is generated, including diet, exercise, sleep, and mental training. The generated menu is customized for each user using prompts.

[1521] As a concrete example, when user C is wearing the AI ​​monitoring smart earphones, the earphone device measures C's body temperature, heart rate, blood pressure, and respiratory rate, and sends the data to C's smartphone via Bluetooth. The smartphone then sends the data to a cloud server, where the generative AI model begins analysis.

[1522] For example, the generative AI model performs an analysis based on the prompt, "If the heart rate is 85 or higher, it is determined to be a risk and a health support menu will be generated." As a result, advice such as relaxation exercises and a low-salt diet is generated and sent to User C's smartphone. Additionally, if an abnormal value is detected, an emergency notification is sent to pre-registered relatives and medical institutions.

[1523] This makes it possible to monitor the health status of elderly people in real time, detect abnormalities early, and provide a system that can take appropriate action quickly.

[1524] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1525] Step 1:

[1526] The biosensor built into the earphone device measures the user's vital signs (body temperature, heart rate, blood pressure, respiratory rate). The measurement data is converted into digital signals and sent to the user's communication device via Bluetooth. The input is sensor data, and the output is data sent to the communication device.

[1527] Step 2:

[1528] The terminal (communication device) receives vital sign data from the earphone device via Bluetooth and temporarily stores it in local storage. The stored data is then sent to a cloud server via the Internet. The input is a Bluetooth signal, and the output is data sent to the cloud server.

[1529] Step 3:

[1530] The server receives vital sign data sent from the communication device and stores it in a database. Based on the stored data, it analyzes the data in real time using a generative AI model. The input is the received vital sign data, and the output is the analysis results.

[1531] Step 4:

[1532] The server uses a generative AI model to generate an individual health support menu based on the analysis results. A menu customized for each user is generated using a prompt. For example, based on the prompt "If the heart rate is 85 or higher, determine that there is a risk and generate a health support menu." The input is the analysis results, and the output is a customized health support menu.

[1533] Step 5:

[1534] The server transmits the generated health support menu to the user's communication device, where the input is the generated health support menu and the output is the transmission of the menu.

[1535] Step 6:

[1536] The terminal (communication device) receives a health support menu and notifies the user as a voice guide. If an abnormal value is detected, an alert notification is sent to pre-registered relatives and medical institutions. The input is the received support menu and abnormal value notification, and the output is a notification to the user, relatives, and medical institutions.

[1537] Through these steps, the system can monitor the elderly person's vital signs in real time, provide appropriate health support menus, and quickly notify in the event of an abnormality.

[1538] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1539] This invention relates to an AI-powered smart earphone system that supports the health management of elderly people. The system includes a biosensor for measuring vital signs, a communication unit, an analysis unit, a generation unit, a transmission unit, a notification unit, an alert unit, and an emotion engine that recognizes the user's emotions.

[1540] System Configuration

[1541] The monitoring AI smart earphone system consists of an earphone device worn by the user, the user's communication device (such as a smartphone or tablet), a cloud server, and an emotion engine.

[1542] Earphone device: Equipped with biosensors, it measures the user's temperature, heart rate, blood pressure, and respiratory rate.

[1543] Communication terminal: Receives vital sign data sent via Bluetooth from the earphone device and relays the data to a cloud server.

[1544] Cloud server: Analyzes the received data in real time and generates a health assistance menu for each user.

[1545] Emotion engine: Recognizes the user's emotional state by analyzing voice and facial expression data.

[1546] Program processing

[1547] The operation of the system will be explained by dividing it into processing steps.

[1548] Vital sign measurement and data transmission

[1549] Terminal (earphone device): The earphones have built-in biosensors that periodically measure the user's body temperature, heart rate, blood pressure, and respiratory rate. The measured data is then sent via Bluetooth to the user's communication terminal.

[1550] Receiving and storing data

[1551] Communication terminal (smartphone): Received vital sign data is stored in the smartphone's local storage, and the data is also sent from the smartphone to a cloud server via the Internet.

[1552] Data analysis

[1553] Server: The cloud server receives data from the communication device and stores it in a database. Using a generative AI model, the received vital sign data is analyzed in real time to detect abnormal values ​​and evaluate health status.

[1554] Recognition of emotional states

[1555] Server: The emotion engine analyzes the user's voice and facial expression data to recognize their emotional state. For example, it determines whether the user is feeling stressed or tired from the voice data.

[1556] Health assistance menu generation

[1557] Server: Generates an optimal health assistance menu for each user based on the analysis results and the emotional state determined by the emotion engine. The menu includes diet, exercise, sleep, and brain training. Based on the emotional state, if the user is feeling stressed, relaxation exercises and music will be suggested, and if the user is feeling tired, a menu that prioritizes rest will be generated.

[1558] Assist menu and sending notifications

[1559] Server: Sends the generated health assistance menu to the user's communication device (smartphone). If abnormalities are detected in the user's vital signs or emotional state, it sends alerts to pre-registered relatives and medical institutions.

[1560] User notification and assistance

[1561] Communication device (smartphone): The received health assistance menu is notified to the user via voice guidance and a visual interface. The voice guidance provides easy-to-understand explanations of the specific health assistance content. In addition, if an abnormality is detected, an alert is sent to relatives and medical institutions.

[1562] Specific examples

[1563] As a specific example, consider a situation where user D is wearing AI-enabled smart earphones.

[1564] Vital sign measurement and data transmission

[1565] Terminal (earphone device): The earphone measures D's body temperature, heart rate, blood pressure, and respiratory rate. The data is sent to D's smartphone via Bluetooth.

[1566] Receiving and storing data

[1567] Communication terminal (smartphone): The smartphone receives the data and stores it in local storage. At the same time, it sends the data to the cloud server.

[1568] Data analysis

[1569] Server: The cloud server receives the data and begins analysis. The analysis reveals that Mr. D's blood pressure is higher than normal.

[1570] Recognition of emotional states

[1571] Server: The emotion engine recognizes Mr. D's stress level from his voice and facial expressions.

[1572] Health assistance menu generation

[1573] Server: Generates a health assistance menu including relaxation exercises and music based on abnormal heart rate and stress levels.

[1574] Assist menu and sending notifications

[1575] Server: Sends the generated menu to Mr. D's smartphone. It also sends alerts to his relatives about his stress level and abnormal blood pressure.

[1576] User notification and assistance

[1577] Communication device (smartphone): The smartphone receives the menu and notifies Mr. D of it as an audio guide. Alerts are also sent to his relatives.

[1578] The above is a specific embodiment of the AI-powered smart earphone system of the present invention. This system monitors the health status of elderly people in real time, enabling optimal health management. Furthermore, the introduction of an emotion engine realizes comprehensive health assistance that also takes into account the user's mental health.

[1579] The processing flow will be explained below.

[1580] Step 1:

[1581] Terminal (earphone device): The biosensor built into the earphone measures the user's body temperature, heart rate, blood pressure, and respiratory rate. The sensor is set to automatically measure at regular intervals.

[1582] Step 2:

[1583] Terminal (earphone device): The measured vital sign data is sent to the user's communication terminal (smartphone) via Bluetooth. The data is encrypted during transmission to prevent data leakage.

[1584] Step 3:

[1585] User's communication device (smartphone): The received vital sign data is stored in the smartphone's local storage. The data is also sent from the smartphone to a cloud server via the Internet. The data is also encrypted during transmission.

[1586] Step 4:

[1587] Server: The cloud server receives vital sign data sent from the user's communication device. The received data is stored in a database and analyzed in real time.

[1588] Step 5:

[1589] Server: Analyzes the received vital signs data in real time using a generative AI model. The analysis checks for abnormalities in the data and evaluates the user's health status. For example, a high heart rate or sudden fluctuations in blood pressure can be detected.

[1590] Step 6:

[1591] Server: The emotion engine analyzes the user's voice and facial expression data to recognize their emotional state. For example, it can detect stress or fatigue from the tone of their voice and the content of their words.

[1592] Step 7:

[1593] Server: Generates the optimal health assistance menu for each user based on the analysis results and the emotional state of the user as determined by the emotion engine. For example, it suggests relaxation exercises for a user feeling stressed, and creates a menu that prioritizes rest for a user feeling fatigued.

[1594] Step 8:

[1595] Server: Sends the generated health assistance menu to the user's communication device. If abnormal values ​​or emotional state problems are detected, an alert is sent to pre-registered relatives or medical institutions.

[1596] Step 9:

[1597] User's communication device (smartphone): The health assistance menu is notified to the user through voice guidance and a visual interface. The notification includes specific health assistance content (e.g., relaxation exercises, recommended meals, rest methods, etc.).

[1598] Step 10:

[1599] User: Follows the instructions on the smartphone to carry out the health assistance menu, such as performing relaxation exercises, eating recommended meals, and creating an appropriate sleeping environment.

[1600] The above is the specific program processing of the AI ​​smart earphone monitoring system that combines an emotion engine. This system comprehensively manages the user's health, enabling early detection of abnormalities and rapid response. Furthermore, the introduction of the emotion engine realizes optimal health assistance that also takes the user's mental health into consideration.

[1601] Example 2

[1602] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1603] Health management for the elderly requires real-time monitoring of their health status and prompt notification when abnormalities are detected. Health management also requires a comprehensive approach that considers not only the user's physical data but also their emotional state. However, conventional systems have difficulty in managing health while taking emotional state into account, and have been unable to provide real-time notifications or take appropriate measures when abnormalities are detected.

[1604] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1605] In this invention, the server includes an analysis means including an emotion engine, a generation means for generating a health assistance menu based on the analysis results and the emotional state using a generative AI model, and an alert means for sending an abnormal value notification to a relative or a medical institution. This enables comprehensive analysis of the user's physical data and emotional state, enabling appropriate health management in real time and prompt alert notification.

[1606] "Vital signs" are basic physiological indicators of the human body, such as body temperature, heart rate, blood pressure, and respiratory rate.

[1607] A "biosensor means" is a sensor device used to measure a user's vital signs.

[1608] "Communication means" refers to a means for transmitting measured vital sign data to other terminals or systems.

[1609] The "communication terminal means" is a means for relaying data to the cloud computing system using a user's communication terminal.

[1610] The "analysis means" is a means for analyzing vital sign data received by the cloud computing system in real time.

[1611] A "generative AI model" is a model that uses artificial intelligence technology to analyze vital sign data and emotional data and recognize abnormal values ​​and emotional states.

[1612] An "emotion engine" is a technology that analyzes a user's voice and facial expression data to recognize their emotional state.

[1613] The "generation means" is a means for generating an individual health assistance menu based on the analysis results and the emotional state.

[1614] The "transmission means" is a means for transmitting the generated health assistance menu to the user's communication terminal.

[1615] The "notification means" is a means for presenting the health assistance menu and abnormal value notification to the user.

[1616] The "alert means" is a means for sending an abnormal value notification to a relative or a medical institution.

[1617] A "health assist menu" is a set of individually customized instructions and advice provided to improve and maintain the user's health.

[1618] This invention relates to an AI-powered smart earphone system for supporting elderly health management. The system includes a biosensor for measuring vital signs, a communication unit, an analysis unit, a generation unit, a transmission unit, a notification unit, an alert unit, and an emotion engine for recognizing the user's emotions.

[1619] System Configuration

[1620] The monitoring AI smart earphone system consists of an earphone device worn by the user, the user's communication device (such as a smartphone or tablet), a cloud computing system, and an emotion engine.

[1621] Earphone device: Equipped with biosensors, it measures the user's temperature, heart rate, blood pressure, and respiratory rate.

[1622] Communication terminal: Receives vital sign data transmitted via Bluetooth from the earphone device and relays the data to the cloud computing system.

[1623] Cloud computing system: Analyzes the received data and generates a health assistance menu for each user using a generative AI model.

[1624] Emotion engine: Recognizes the user's emotional state by analyzing voice and facial expression data.

[1625] Vital sign measurement and data transmission

[1626] Terminal (earphone device): The earphones have built-in biosensors that periodically measure the user's body temperature, heart rate, blood pressure, and respiratory rate. The measured data is then sent via Bluetooth to the user's communication terminal.

[1627] Receiving and storing data

[1628] Communication terminal (smartphone): The received vital sign data is stored in the smartphone's local storage, and the data is also sent from the smartphone to a cloud computing system via the Internet.

[1629] Data analysis

[1630] Server (cloud computing system): The cloud server receives data from the communication device and stores it in a database. Using a generative AI model, the received vital sign data is analyzed in real time to detect abnormal values ​​and evaluate health status.

[1631] Recognition of emotional states

[1632] Server: The emotion engine analyzes the user's voice and facial expression data to recognize their emotional state. For example, it determines whether the user is feeling stressed or tired from the voice data.

[1633] Health assistance menu generation

[1634] Server: Generates an optimal health assistance menu for each user based on the analysis results and the emotional state of the emotion engine. The menu includes diet, exercise, sleep, and brain training. Based on the emotional state, if the user is feeling stressed, relaxation exercises and music will be suggested. If the user is feeling tired, a menu that prioritizes rest will be generated.

[1635] Assist menu and sending notifications

[1636] Server: Sends the generated health assistance menu to the user's communication device (smartphone). If abnormalities are detected in the user's vital signs or emotional state, it sends alerts to pre-registered relatives and medical institutions.

[1637] User notification and assistance

[1638] Communication device (smartphone): The received health assistance menu is notified to the user via voice guidance and a visual interface. The voice guidance provides easy-to-understand explanations of the specific health assistance content. In addition, if an abnormality is detected, an alert is sent to relatives and medical institutions.

[1639] Specific examples

[1640] As a specific example, consider a situation where a user is wearing AI-enabled smart earphones.

[1641] Vital sign measurement and data transmission

[1642] Terminal (earphone device): The earphone measures the user's temperature, heart rate, blood pressure, and respiratory rate. The data is sent to the user's smartphone via Bluetooth.

[1643] Receiving and storing data

[1644] Communication terminal (smartphone): The smartphone receives the data and stores it in local storage, while simultaneously transmitting the data to the cloud computing system.

[1645] Data analysis

[1646] Server: The cloud server receives the data and begins analysis, which reveals that the user's blood pressure is higher than normal.

[1647] Recognition of emotional states

[1648] Server: The emotion engine recognizes the user's stress level from their voice and facial expressions.

[1649] Health assistance menu generation

[1650] Server: Generates a health assistance menu including relaxation exercises and music based on abnormal heart rate and stress levels.

[1651] Assist menu and sending notifications

[1652] Server: Sends the generated menu to the user's smartphone, and also sends alerts to relatives about stress levels and abnormal blood pressure.

[1653] User notification and assistance

[1654] Communication device (smartphone): The smartphone receives the menu and notifies the user as a voice guide. Alerts are also sent to relatives.

[1655] The above is a specific embodiment of the AI-powered smart earphone system of the present invention. This system monitors the health status of elderly people in real time, enabling optimal health management. Furthermore, the introduction of an emotion engine realizes comprehensive health assistance that also takes into account the user's mental health.

[1656] Example prompts for generative AI models

[1657] "Write a program that analyzes the user's biometric data (body temperature, heart rate, blood pressure, respiratory rate) and voice data, detects abnormal values, recognizes emotional state, and generates an optimal health assistance menu."

[1658] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1659] Step 1:

[1660] User: The user puts on the earbud device. The earbuds use built-in biometric sensors to measure the user's temperature, heart rate, blood pressure, and respiratory rate.

[1661] Input: User's vital signs (temperature, heart rate, blood pressure, respiratory rate)

[1662] Output: Measured vital signs data

[1663] Specific behavior:

[1664] The earphone device measures body temperature (36.5 degrees), heart rate (72), blood pressure (130 / 80), and respiratory rate (15).

[1665] Step 2:

[1666] Terminal (earphone device): Measured vital sign data is sent to the user's communication terminal (smartphone) via Bluetooth.

[1667] Input: Measured vital signs data

[1668] Output: Vital signs data transmitted via Bluetooth

[1669] Specific behavior:

[1670] The earphone device sends the measurement data to a smartphone via Bluetooth.

[1671] Step 3:

[1672] Communication terminal (smartphone): Stores the received vital sign data in local storage and transmits the data to a cloud computing system via the Internet.

[1673] Input: Vital signs data received via Bluetooth

[1674] Output: Data stored in local storage and data sent to the cloud

[1675] Specific behavior:

[1676] The smartphone stores the data received from the earphones and sends it to a cloud server.

[1677] Step 4:

[1678] Server (cloud computing system): Receives vital sign data sent from the communication device and stores it in a database. It analyzes the data in real time using a generative AI model to detect abnormal values.

[1679] Input: Vital signs data sent to the cloud

[1680] Output: Data stored in the database and analysis results (presence or absence of outliers)

[1681] Specific behavior:

[1682] The cloud server receives the data, stores it in a database, and detects that the blood pressure is higher than normal (150 / 90).

[1683] Step 5:

[1684] Server: The emotion engine analyzes the user's voice and facial expression data to recognize their emotional state.

[1685] Input: User voice or facial expression data

[1686] Output: Perceived emotional state (e.g., stress state)

[1687] Specific behavior:

[1688] The server analyzes the voice saying "I'm a little busy" and recognizes that Mr. D is in a stressful state.

[1689] Step 6:

[1690] Server: Generates the optimal health assistance menu for each user based on the analysis results and emotional state.

[1691] Input: Analysis results and emotional state

[1692] Output: Health Assist Menu

[1693] Specific behavior:

[1694] Based on abnormal heart rate and stress levels, a health assistance menu including relaxation exercises and relaxation music is generated.

[1695] Step 7:

[1696] Server: Sends the generated health assistance menu and abnormality notifications to the user's communication device. If an abnormality is detected, it also sends an alert to relatives and medical institutions.

[1697] Input: Health Assist menu and abnormal data

[1698] Output: Sending to communication terminal and sending alerts

[1699] Specific behavior:

[1700] The server sends a menu of relaxation exercises to the smartphone and sends alerts about stress and high blood pressure to relatives.

[1701] Step 8:

[1702] Communication device (smartphone): The received health assistance menu is notified to the user via voice guidance and a visual interface. If an abnormality is detected, an alert is sent to relatives and medical institutions.

[1703] Input: Health Assist Menu and Alert Notifications

[1704] Output: User notification and alert to relatives or medical facility

[1705] Specific behavior:

[1706] The smartphone will start playing relaxation music and will also play a voice prompt saying, "Please do some relaxation exercises." At the same time, an alert will be sent to relatives.

[1707] (Application example 2)

[1708] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1709] In modern society, managing the health status of elderly people in real time and providing optimal health assistance is an important issue. Conventional health management systems simply measure vital signs and are unable to provide comprehensive health assistance based on the user's emotional state or stress level. Furthermore, although the dietary habits of elderly people have a significant impact on their health, there has been a lack of systems that provide optimal meal plans and allow easy ordering of meals. This makes it difficult for elderly people to manage their health in their daily lives.

[1710] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1711] In this invention, the server includes a biosensor means for measuring vital signs, a communication means for transmitting the measured vital sign data to the user's communication terminal, a communication terminal means for relaying the vital sign data to the server, an analysis means for analyzing the vital sign data in real time at the server, a generation means for generating an individual health assist menu based on the results of the analysis, a transmission means for transmitting the health assist menu to the communication terminal, a notification means for presenting the health assist menu and an abnormal value notification to the user from the communication terminal, an alert means for transmitting the abnormal value notification to a relative or a medical institution, and an ordering means for ordering meals from an affiliated meal service based on the proposed health assist menu. This makes it possible to monitor the health status of an elderly person in real time, provide comprehensive health assistance, and propose optimal meal plans and easily order meals.

[1712] definition statement

[1713] "Vital signs" are indicators that show the basic life activities of a living organism, and refer to data such as body temperature, heart rate, blood pressure, and respiratory rate.

[1714] "Biosensor means" refers to an apparatus or device for measuring vital signs, and has a high-performance sensor built in.

[1715] "Communication means" refers to the device or protocol for transmitting measurement data to the user's communication terminal.

[1716] The "communication terminal means" refers to a terminal having a communication function for relaying the vital sign data to a server.

[1717] "Analysis means" refers to software or algorithms for analyzing received vital sign data in real time.

[1718] "Generation means" refers to software or functions for generating an individual health assistance menu based on the analysis results.

[1719] The "transmission means" refers to a function or device for transmitting the generated health assistance menu to the user's communication terminal.

[1720] "Notification means" refers to an interface or mechanism for presenting the health assistance menu and abnormal value notifications to the user.

[1721] "Alert measures" refers to systems and protocols for notifying relatives and medical institutions when abnormal values ​​are detected.

[1722] "Ordering Method" refers to the functionality and protocols for ordering meals from affiliated meal delivery services based on the proposed Health Assist Menu.

[1723] MODE FOR CARRYING OUT THE INVENTION

[1724] This invention is an AI-powered smart earphone system that supports the health management of the elderly by measuring vital signs, analyzing data, generating and notifying health assistance menus, and ordering meals from affiliated meal delivery services. This system uses the following means.

[1725] System Configuration

[1726] earphone device

[1727] The earphone device is equipped with built-in biosensors that periodically measure the elderly person's vital signs, such as temperature, heart rate, blood pressure, and respiratory rate, and this data is sent via Bluetooth to the user's smartphone.

[1728] communication means

[1729] The communication means includes a function for the user's smartphone to receive vital sign data transmitted from the earphone device, which is then transmitted from the smartphone to a cloud server via the internet.

[1730] Analysis means

[1731] The received vital sign data is analyzed in real time on a cloud server, where a generative AI model is used to detect abnormalities in the data and perform a comprehensive assessment of the patient's health, such as detecting abnormalities in heart rate or blood pressure.

[1732] generation means

[1733] Based on the analysis results, the cloud server generates an optimal health assistance menu for each user, including diet, exercise, sleep, and brain training, and also suggests relaxation exercises and music based on the user's emotional state.

[1734] Transmission method

[1735] The generated health assistance menu is sent from the cloud server to the user's smartphone.

[1736] Notification and alert methods

[1737] The smartphone will then present the received health assistance menu and abnormal value notifications to the user, and if an abnormal value is detected, an alert will be sent to pre-registered relatives and medical institutions.

[1738] Ordering Method

[1739] Based on the proposed health assistance menu, the user's smartphone will access the partner meal delivery service and order the appropriate meal, allowing seniors to receive the optimal meal without any hassle.

[1740] Specific use cases

[1741] For example, consider a situation where user D is wearing AI-powered smart earphones. The earphones measure body temperature, heart rate, blood pressure, and respiratory rate, and send this data to D's smartphone via Bluetooth. The smartphone transfers the data to a cloud server, where the generative AI model analyzes it. As a result of the analysis, it is determined that D's blood pressure is higher than normal, and the emotion engine recognizes this as a state of stress.

[1742] Based on this information, the cloud server generates a health assistance menu that includes relaxation exercises and music, and sends it to Mr. D's smartphone. It also orders meals that will help reduce stress from an affiliated meal delivery service.

[1743] Prompt Sentence Examples

[1744] Examples of prompts sent to the generative AI model include:

[1745] "Temperature: 36.7 degrees"

[1746] "Heart rate: 78 BPM"

[1747] "Blood pressure: 125 / 82 mmHg"

[1748] "Respiration rate: 15 RPM"

[1749] "Emotional state: Stress"

[1750] In this way, the present invention realizes a system that comprehensively monitors the health status of elderly people and provides optimal health assistance and meal orders.

[1751] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1752] System processing steps

[1753] Step 1: Measuring vital signs and sending data

[1754] The user wears the AI-powered smart earphones, and the biosensors periodically measure body temperature, heart rate, blood pressure, and respiratory rate, and the vital signs data is sent to the user's smartphone via Bluetooth.

[1755] Input: User's vital signs (temperature, heart rate, blood pressure, respiratory rate)

[1756] Output: Vital signs data sent to a smartphone

[1757] How it works: The earphone device collects data using temperature sensors, heart rate sensors, blood pressure sensors, and respiration sensors, and then transmits the data to a smartphone via Bluetooth.

[1758] Step 2: Receiving data and sending it to the cloud server

[1759] The terminal (smartphone) receives vital sign data from the earphone device and stores it in local storage. At the same time, the data is sent to a cloud server via the Internet.

[1760] Input: Vital signs data obtained from earphone device

[1761] Output: Vital signs data sent to the cloud server

[1762] Specific operation: The smartphone temporarily stores the data received via Bluetooth in local storage, and then transmits the data to a cloud server via the Internet using the HTTP protocol.

[1763] Step 3: Analyze the data

[1764] The server analyzes vital sign data sent to the cloud server in real time, using generative AI models to detect outliers and assess health status.

[1765] Input: Vital signs data sent to the cloud server

[1766] Output: Outliers and health assessment results

[1767] How it works: The cloud server uses generative AI models to analyze vital sign data, detect abnormalities (e.g., high blood pressure, low heart rate) and assess overall health.

[1768] Step 4: Create a Health Assist Menu

[1769] Based on the analysis results and the user's emotional state, the server generates a personalized health assistance menu, which includes diet, exercise, sleep, and brain training.

[1770] Input: Analysis results and emotional state data

[1771] Output: Health Assist Menu

[1772] Specific operation: Based on the analysis results (e.g., high blood pressure, stress level), the generative AI generates a health assistance menu (e.g., relaxation music, low-salt meal plan, light exercise).

[1773] Step 5: Send Health Assist Menu

[1774] The server sends the generated health assistance menu to the user's smartphone.

[1775] Enter: Health Assist Menu

[1776] Output: Health assist menu sent to smartphone

[1777] Specific operation: The server uses the HTTP protocol to send the generated health assistance menu to the user's smartphone.

[1778] Step 6: Health Assist Menu and Abnormal Value Notification

[1779] The device (smartphone) receives the health assistance menu and notifies the user of abnormal values, and also sends alerts to relatives and medical institutions.

[1780] Input: Sent Health Assist Menu and Abnormal Value Notification

[1781] Output: Present to user and alert relatives and medical institutions

[1782] Specific actions: The smartphone uses voice guidance or a visual interface to provide the user with specific health assistance content, and if abnormal values ​​are detected, alerts are sent via email or SMS to pre-registered relatives or medical institutions.

[1783] Step 7: Order your food

[1784] The device (smartphone) orders meals from affiliated meal delivery services based on the proposed health assistance menu.

[1785] Enter: Health Assist Menu

[1786] Output: Order data for a food service

[1787] Specific operation: The smartphone uses the API of a partner food delivery service to order meals based on the health-assist menu. For example, if a low-sodium meal plan is suggested, the smartphone will order from a restaurant that offers that menu.

[1788] Through the above steps, the present invention comprehensively manages the user's health condition and provides optimal health assistance and meals.

[1789] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1790] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1791] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1792] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1793] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1794] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1795] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1796] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1797] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1798] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1799] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1800] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1801] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1802] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1803] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1804] The hardware resource for executing a specific process can be any of the following types of processors: A processor, for example, is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1805] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1806] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1807] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1808] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1809] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1810] The following is further disclosed regarding the above embodiment.

[1811] (Claim 1)

[1812] a biosensor means for measuring vital signs;

[1813] a communication means for transmitting the measured vital sign data to a communication terminal of the user;

[1814] a communication terminal means for relaying the vital sign data to a server;

[1815] an analysis means for analyzing the vital sign data in real time in the server;

[1816] a generation means for generating an individual health assistance menu based on the results of the analysis;

[1817] a transmitting means for transmitting the health assistance menu to the communication terminal;

[1818] a notification means for presenting the health assistance menu and the abnormal value notification to the user from the communication terminal;

[1819] an alert means for sending an abnormal value notification to a relative or a medical institution;

[1820] A system including:

[1821] (Claim 2)

[1822] 10. The system of claim 1, wherein said biosensor means measures body temperature, heart rate, blood pressure, and respiratory rate.

[1823] (Claim 3)

[1824] The system of claim 1, wherein the analysis means analyzes vital sign data using a generation AI, and the health assistance menu generated by the generation means includes menus for diet, exercise, sleep, and brain training.

[1825] "Example 1"

[1826] (Claim 1)

[1827] a biosensor means for measuring vital signs;

[1828] a communication means for transmitting the measured vital sign data to a communication terminal of the user;

[1829] a communication terminal means for relaying the vital sign data to a server;

[1830] an analysis means for analyzing the vital sign data in real time in the server;

[1831] a generation means for generating an individual health assistance menu based on the results of the analysis;

[1832] a transmitting means for transmitting the health assistance menu to the communication terminal;

[1833] a notification means for presenting the health assistance menu and the abnormal value notification to the user from the communication terminal;

[1834] an alert means for sending an abnormal value notification to a relative or a medical institution;

[1835] a storage means for temporarily storing the vital sign data in a local storage when the vital sign data is received;

[1836] a transmitting means for transmitting data via Bluetooth or the Internet;

[1837] a notification means for notifying relatives and medical institutions using an alert generated when an abnormal value is detected;

[1838] A generation means for generating a health assistance menu using a generative AI model;

[1839] A system including:

[1840] (Claim 2)

[1841] 10. The system of claim 1, wherein said biosensor means measures body temperature, heart rate, blood pressure, and respiratory rate.

[1842] (Claim 3)

[1843] 2. The system of claim 1, wherein the analysis means analyzes vital sign data using a generative AI model, and the health assistance menu generated by the generation means includes menus for diet, exercise, sleep, and brain training.

[1844] "Application Example 1"

[1845] (Claim 1)

[1846] a biosensor means for measuring vital signs;

[1847] a communication means for transmitting the measured vital sign data to a personal communication device;

[1848] a communication terminal means for relaying said vital sign data to a central system;

[1849] an analysis means for analyzing the vital sign data in real time at the central system;

[1850] a generation means for generating an individual health support menu based on the results of the analysis;

[1851] a transmitting means for transmitting the health support menu to the communication device;

[1852] a notification means for presenting the health support menu and the abnormal value notification to the individual from the communication device;

[1853] an alert means for sending an abnormal value notification to a relative or a medical institution;

[1854] A means for analyzing vital sign data using a generative AI model and generating a personalized health support menu using prompt sentences;

[1855] A system including:

[1856] (Claim 2)

[1857] 10. The system of claim 1, wherein said biosensor means measures body temperature, heart rate, blood pressure, and respiratory rate...

Claims

1. a biosensor means for measuring vital signs; a communication means for transmitting the measured vital sign data to a communication terminal of the user; a communication terminal means for relaying the vital sign data to a server; an analysis means for analyzing the vital sign data in real time in the server; a generation means for generating an individual health assistance menu based on the results of the analysis; a transmitting means for transmitting the health assistance menu to the communication terminal; a notification means for presenting the health assistance menu and the abnormal value notification to the user from the communication terminal; an alert means for sending an abnormal value notification to a relative or a medical institution; A system including:

2. 2. The system of claim 1, wherein said biosensor means measures body temperature, heart rate, blood pressure, and respiratory rate.

3. The system of claim 1, wherein the analysis means analyzes vital sign data using a generation AI, and the health assistance menu generated by the generation means includes menus for diet, exercise, sleep, and brain training.

Images