Method and system for caring for mental state by using ballistocardiogram measured through piezoelectric element

The wearable device with a piezoelectric element and AI models processes air pressure data to independently assess and manage stress, addressing noise and connectivity issues in existing technologies by enabling self-controlled deep pressure for effective stress relief.

WO2024258050A1PCT designated stage expired Publication Date: 2024-12-19DOLBOMDREAM CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/005760
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-06-16
Filing Date
2024-04-29
Publication Date
2024-12-19

AI Technical Summary

Technical Problem

Existing methods for determining and managing a user's psychological state or stress using wearable biometric sensors face challenges with noise in biometric information and require a stable communication connection with an external server to control air injection for stress relief, which can be unreliable in varying environments.

Method used

A wearable device equipped with a piezoelectric element and AI models that processes air pressure data to determine the user's psychological state independently, reducing noise and enabling self-controlled air injection for deep pressure stimulation without relying on external server communication.

Benefits of technology

The solution provides precise determination of psychological state and stress levels with reduced noise in biometric data, allowing for effective self-controlled deep pressure application to alleviate anxiety or stress, regardless of communication connectivity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024005760_19122024_PF_FP_ABST
    Figure KR2024005760_19122024_PF_FP_ABST
Patent Text Reader

Abstract

According to an embodiment, a system for caring for a user's mental state on the basis of biometric information of the user may comprise a wearable device and an external server. The wearable device may comprise: an air tube; an air inlet which is provided at one end of the air tube and through which air is injected into or discharged out of the air tube; a drive unit which injects air into or discharges air out of the air tube through the air inlet; a silicone tube which is disposed within a housing of the drive unit, extends from the drive unit, and is connected to the air inlet; a sensor module which is disposed within the silicone tube and includes a piezoelectric element for sensing pressure; a first communication unit; a first artificial intelligence model unit; and a first processor which is disposed within the silicone tube and is operatively connected to the drive unit, the sensor module, and the first artificial intelligence model unit.
Need to check novelty before this filing date? Find Prior Art

Description

Method and system for managing psychological state using ballistic cardiogram measured through piezoelectric element

[0001] The present disclosure relates to a method and system for caring for a user's psychological state by injecting air into an inflatable garment to compress the user's core based on information about a ballistic heart rate measured through a piezoelectric element provided in the inflatable garment.

[0002] As the importance of managing and stabilizing a person's psychological state or stress has increased in recent years, the need for methods and devices to relieve anxiety and stress has emerged.

[0003] In this regard, as a method and technology for judging or estimating a user's psychological state or stress, a wearable device equipped with a biometric sensor designed to obtain biometric information acquires the user's biometric information, and a method and technology for judging or estimating the user's psychological state based on the obtained biometric information of the user have been proposed.

[0004] To assess or estimate a user's psychological state or stress, biometric data is required. To accurately assess a user's psychological state or stress, noise in the biometric data, which serves as the basis for assessing the user's psychological state or stress, must be minimized. In other words, a method is needed to acquire the user's biometric data in real time while minimizing noise.

[0005] In addition, as a method for collecting a user's biometric information in real time without the user being confined to a specific space and caring for the user's psychological state based on the collected biometric information, a wearable device equipped with a biometric sensor for collecting biometric information and an air tube for caring for the user's psychological state has been proposed. That is, the user's biometric information is collected in real time while wearing the wearable device without being confined to a specific space, and the user's psychological state can be cared for by injecting air into the air tube based on the collected biometric information.

[0006] However, in order to control the injection of air into the air tube using the biometric information collected through the biometric sensor equipped in the wearable device, the biometric information must be transmitted to an external server, the external server must determine whether to inject air into the air tube based on the biometric information, and the wearable device must receive control data including the judgment result of the external server received from the external server. In other words, in order to control the wearable device, control data received from an external server is required, and this requires a communication connection between the wearable device and the external server.

[0007] However, depending on the physical environment in which the user wearing the wearable device is located, the communication status between the wearable device and the external server may be unstable, and in an environment where a communication connection is not established, a problem may occur in which the wearable device cannot be controlled.

[0008] Accordingly, there is a growing need for a method of controlling a wearable device using a system built into the wearable device itself, regardless of the wearable device's communication connection with an external server.

[0009] According to one embodiment, a system for caring for a user's psychological state based on the user's biometric information may include a wearable device and an external server. The wearable device may include an air tube, an air inlet provided at one end of the air tube to inject or exhaust air into or out of the air tube, a driving unit for injecting or exhausting air into or out of the air tube through the air inlet, a silicone tube disposed inside a housing of the driving unit and extending from the driving unit and connected to the air inlet, a sensor module located inside the silicone tube and having a piezoelectric element for detecting pressure, a first communication unit, a first artificial intelligence model unit, and a first processor located inside the silicone tube and operatively connected to the driving unit, the sensor module, and the first artificial intelligence model unit. The external server may include a second communication unit, a second artificial intelligence model unit, and a second processor operatively connected to the second communication unit and the second artificial intelligence model unit. The first processor obtains air pressure data representing the air pressure inside the air tube through the piezoelectric element of the sensor module, determines whether a network connection is established so that the wearable device and the external server can perform data communication, and if the wearable device and the external server are determined to be in a state where the network connection is established, the air pressure data can be transmitted to the external server through the first communication unit.The second processor may receive the air pressure data from the wearable device through the second communication unit, input the air pressure data into a first artificial intelligence model and a second artificial intelligence model included in the second artificial intelligence model unit, train the first artificial intelligence model to extract filtered data from the air pressure data, thereby updating the first artificial intelligence model, train the second artificial intelligence model to determine the state of the user, thereby updating the second artificial intelligence model, and when the wearable device and the external server determine that the network connection is established, transmit the updated first artificial intelligence model and the updated second artificial intelligence model to the wearable device through the second communication unit. The first processor may receive the updated first artificial intelligence model and the updated second artificial intelligence model from the external server through the first communication unit, and determine the state of the user based on a value obtained by processing the air pressure data with the updated first artificial intelligence model and the updated second artificial intelligence model.

[0010] According to one embodiment of the present disclosure, biometric information for determining a user's psychological state or stress can be acquired based on air pressure data acquired through a piezoelectric element located inside a silicone tube and provided in a driving unit of a wearable device, thereby reducing noise compared to biometric information acquired through a conventional biometric sensor.

[0011] Accordingly, through a wearable device including a sensor module having a piezoelectric element inside a silicone tube, the user's biometric information can be acquired with significantly reduced noise, and the user's psychological state and stress can be more precisely judged and estimated through the biometric information, and based on this, the wearable device can be controlled to provide deep pressure to the user, thereby effectively reducing the user's anxiety or stress.

[0012] In addition, various effects may be provided directly or indirectly through the present disclosure.

[0013] FIG. 1 illustrates a system for caring for a user's psychological state using a wearable device according to one embodiment.

[0014] FIG. 2 illustrates a wearable device having a sensor module for measuring cardiogram according to one embodiment.

[0015] FIG. 3 illustrates an internal configuration diagram of a sensor module for measuring heart rate according to one embodiment.

[0016] FIG. 4 illustrates a block diagram of a sensor module for measuring heart rate according to one embodiment.

[0017] FIG. 5 illustrates a conceptual diagram of a technology for obtaining a user's biometric information using a sensor module provided in a wearable device according to one embodiment.

[0018] FIG. 6 illustrates a conceptual diagram of a technology for obtaining and processing raw data by a sensor module according to one embodiment.

[0019] FIG. 7a illustrates a graph for explaining Fourier transform during a preprocessing process of raw data acquired by a sensor module according to one embodiment.

[0020] FIG. 7b illustrates a graph for explaining wavelet transformation during the preprocessing process of raw data acquired by a sensor module according to one embodiment.

[0021] Figure 8a illustrates a template matching flowchart of a first artificial intelligence model according to one embodiment.

[0022] FIG. 8b illustrates a graph illustrating an example of using template matching of a first artificial intelligence model according to one embodiment.

[0023] FIG. 9 is a diagram illustrating the overall operation flow of a system including a wearable device and a server according to one embodiment.

[0024] FIG. 10 illustrates a flowchart of a method for a wearable device to care for a psychological state using biometric information according to one embodiment.

[0025] FIG. 11 illustrates a flowchart of operations between a wearable device and a server for caring for a psychological state using biometric information according to one embodiment.

[0026] FIG. 12 illustrates a flowchart of operations between a wearable device and a server for updating an artificial intelligence model according to an embodiment of the present invention.

[0027] In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0028] Hereinafter, various embodiments of the present invention will be described with reference to the attached drawings. However, this is not intended to limit the present invention to specific embodiments, and it should be understood that the present invention encompasses various modifications, equivalents, and / or alternatives of the embodiments.

[0029] Below, with reference to the attached drawings, embodiments of the present invention are described in detail so that those skilled in the art can easily implement the invention. However, the present invention can be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts irrelevant to the description are omitted for clarity of description, and similar parts are designated with similar reference numerals throughout the specification.

[0030] Throughout the specification, when a part is said to "include" a component, this does not exclude other components, but rather implies the inclusion of other components, unless otherwise specifically stated. Furthermore, terms such as "part," "unit," and "module" used in the specification mean a unit that processes at least one function or operation, which may be implemented using hardware, software, or a combination of hardware and software.

[0031] Throughout the specification, when a part is said to be "connected" to another part, this includes not only the case where it is "directly connected" but also the case where it is "electrically connected" with another element in between. Furthermore, when a part is said to "include" a component, this should be understood to mean that, unless specifically stated to the contrary, it may include other components rather than excluding them, and does not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0032] FIG. 1 illustrates a system for caring for a user's psychological state using a wearable device (101) according to one embodiment.

[0033] Referring to FIG. 1, a system for managing a user's psychological state may include a wearable device (101), a network (102), and a server (103). However, the system is not limited to the components illustrated in FIG. 1, and some components may be omitted or added. For example, the system may further include a user terminal (e.g., a smartphone).

[0034] According to one embodiment, the wearable device (101) may be referred to as an air-injected garment including an air tube (e.g., the air tube (110) of FIG. 2), an air inlet (e.g., the air inlet (204) of FIG. 2), and a driving unit to provide deep touch pressure (DTP) to a user wearing the wearable device (101). For example, the wearable device (101) may refer to an air-injected garment designed to provide deep touch pressure to a user wearing the wearable device (101) so as to relieve psychological anxiety and reduce stress by the user feeling psychologically anxious or under high stress when the user wears the wearable device (101). Here, deep touch pressure refers to pressure that stimulates the parasympathetic nerve by applying appropriate pressure to the user's body, thereby allowing the user to feel as if someone is hugging him / her, thereby relieving anxiety or reducing stress and providing a sense of psychological stability. The above users may include individuals who require psychological stability or who seek relief from stress (e.g., children or individuals with developmental disabilities). However, the above users are not limited to the examples described above, and may include infants, toddlers, children, adolescents, people with disabilities, or the elderly.

[0035] According to one embodiment, the driving unit may function as an air pump, and may inject air into the air tube (e.g., the air tube (110) of FIG. 2) through the air inlet (e.g., the air inlet (204) of FIG. 2) or extract air from the air tube. For example, when it is determined that a user wearing the wearable device (101) feels anxious or stressed, the driving unit may inject air into the air tube through the air inlet. After air is injected into the air tube, when it is determined that the user's anxiety or stress has been relieved, the driving unit may extract air from the air tube. The criterion for determining that the user feels anxious or stressed may be determined based on the user's biometric information acquired through a sensor module (e.g., the sensor module (201)) provided in the wearable device (101). For example, if a value included in the biometric information exceeds a set value and / or a set range, the wearable device (101) may determine that the user is anxious or stressed.

[0036] According to one embodiment, the wearable device (101) may include a communication module capable of performing data communication with an external electronic device. For example, the wearable device (101) may perform data communication with a server (103) via a network (102). The network (102) may refer to wireless communication and may include a mobile hotspot and / or Wi-Fi.

[0037] According to one embodiment, the wearable device (101) may transmit biometric information (e.g., ballistic cardiogram information, heart rate variability information, or respiration information) acquired using a sensor module (e.g., sensor module (201) of FIG. 2) provided in the wearable device (101) to a server (103) via a network (102). The wearable device (101) may receive an artificial intelligence model updated by the server (103) from the server (103).

[0038] According to one embodiment, the server (103) can perform data communication with the wearable device (101) and drive an artificial intelligence model to produce data values ​​for controlling the driving unit of the wearable device (101). For example, the server (103) can train an artificial intelligence model using learning data and obtain output data by inputting input data into the artificial intelligence model.

[0039] According to one embodiment, when data communication is established with the wearable device (101), the server (103) can receive the user's biometric information from the wearable device (101). When data communication is established with the wearable device (101), the server (103) can transmit an updated artificial intelligence model to the wearable device (101).

[0040] According to one embodiment, although not shown in FIG. 1, the wearable device (101) can perform data communication with a user terminal (e.g., a smart phone) via a network (102). For example, the wearable device (101) can transmit biometric information acquired through a sensor module (e.g., a sensor module (201) of FIG. 2) provided in the wearable device (101) to the user terminal. The user terminal can transmit command data for controlling the wearable device (101) to the wearable device (101) via the network (102).

[0041] FIG. 2 illustrates a wearable device (101) having a sensor module (201) for measuring heart rate according to one embodiment.

[0042] Referring to FIG. 2, a wearable device (101) may include a sensor module (201) having a piezoelectric element capable of measuring a ballistocardiogram (BCG), an air tube (110) including a first adhesive portion (110-1) of a first type and a second adhesive portion (110-2) of a second type, an air inlet (204), and a driving portion (not shown).

[0043] According to one embodiment, although not illustrated in FIG. 2, the wearable device (101) is not limited to a sensor module having a piezoelectric element capable of measuring cardiograms, and may further include a biosensor capable of measuring various bio-information. For example, the biosensor may include a biosensor measuring electrodermal activity (EDA), a biosensor measuring photoplethysmography (PPG), a biosensor measuring blood volume pulse (BVP), or a biosensor measuring heat (or body temperature).

[0044] According to one embodiment, the wearable device (101) is described below assuming a vest-shaped garment equipped with an air tube (110). However, the form of the wearable device (101) is not limited to a vest-shaped garment, and may include a garment form capable of applying deep pressure to the user. According to one embodiment, the wearable device (101) may include a front portion that contacts the user's chest area and a rear portion that contacts the user's back area when worn by the user.

[0045] According to one embodiment, the wearable device (101) may include a first adhesive portion (110-1) of a first shape and a second adhesive portion (110-2) of a second shape so that the air injected through the driving portion can evenly pressurize the entire chest and back of the user wearing the wearable device (101). The first adhesive portion (110-1) of the first shape may be formed by bonding in a circular or dot shape, and the second adhesive portion (110-2) of the second shape may be formed by bonding in a line of a predetermined length. According to one embodiment, the air tube (110) provided in the wearable device (101) may form a passage through which the injected air passes by alternately arranging the first adhesive portion (110-1) and the second adhesive portion (110-2). According to one embodiment, the first adhesive portion (110-1) and the second adhesive portion (110-2) may be alternately arranged to form a single adhesive line. A plurality of adhesive lines may be arranged in a horizontal direction parallel to each other across the front and rear of the wearable device (101). The second adhesive portion (110-2) may be formed straight or in a curved shape having a certain curvature.

[0046] According to one embodiment, the sensor module (201) may include a piezoelectric element inside a housing and may include a silicone tube (202) that seals the piezoelectric element. For example, the piezoelectric element or the PCB may be placed inside the silicone tube (202) so as to seal the entire PCB (Printed Circuit Board) (or BCB signal board) on which the piezoelectric element is placed.

[0047] According to one embodiment, the air tube (110) provided in the wearable device (101) may be configured in a sealed form except for the air inlet (204) through which air is injected or extracted. The end of the silicone tube (202) extended from the sensor module (201) may be connected (203) to the air inlet (204) of the wearable device (101). The silicone tube (202) extended from the sensor module (201) may be configured in a sealed form except for the end connected to the air inlet (204). That is, by connecting (203) the end of the silicone tube (202) extended from the sensor module (201) to the air inlet (204) provided in the wearable device (101), the pressure of the air sealed inside the air tube (110) and the silicone tube (202) may be applied to the piezoelectric element. The piezoelectric element can detect changes in air pressure of the wearable device (101) according to the heartbeat and / or breathing of the user wearing the wearable device (101). The processor of the wearable device (101) (e.g., the processor (401) of FIG. 4) can obtain ballistic cardiogram data using data (e.g., air pressure change data) detected through the piezoelectric element.

[0048] FIG. 3 illustrates an internal configuration diagram of a sensor module (201) for measuring a heart rate according to one embodiment.

[0049] Referring to FIG. 3, the sensor module (201) may include a piezoelectric element, and a silicone tube (202) may be arranged to seal (302) (or seal) the piezoelectric element. The wearable device (101) may be arranged with an air tube (110) that forms a sealed (303) (or seal) space so that air can be injected throughout the entire front and rear portions. The air tube (110) may include a first type of air adhesive portion (110-1) and a second type of air adhesive portion (110-2).

[0050] According to one embodiment, when the silicone tube (202) of the sensor module (201) and the air inlet (204) of the wearable device (101) are connected, the piezoelectric element of the sensor module (201) can detect changes in air pressure inside the air tube (101) according to the heartbeat and / or breathing of a user wearing the wearable device (101).

[0051] According to one embodiment, a processor of a sensor module (201) (e.g., processor (401) of FIG. 4) may amplify and filter a micro output voltage of a piezoelectric element using an amplifier (e.g., BCG Analog Front End (AFE) 403)) to generate an analog voltage so that the processor can perform an analog-digital converter (ADC).

[0052] FIG. 4 illustrates a block diagram of a sensor module (201) for measuring heart rate according to one embodiment.

[0053] Referring to FIG. 4, the sensor module (201) may include a processor (401), a piezoelectric element (402), a BCG AFE (403), an RGB (404), a data storage unit (405), a communication unit (406), a motion sensor (407), an artificial intelligence model unit (408), a data processing unit (409), a noise removal unit (410), and a battery (410). However, the sensor module (201) is not limited to the components illustrated in FIG. 4, and some components may be omitted or added. For example, the sensor module (201) may omit the RGB (404). As another example, the sensor module (201) may further include a pressure detection sensor capable of detecting air pressure of an air tube (110) of a wearable device (101). The artificial intelligence model unit (408) may include a first artificial intelligence model (408-1) and a second artificial intelligence model (408-2). The first artificial intelligence model (408-1) may refer to an artificial intelligence model used to process (or preprocess) air pressure data or biosignals acquired through a piezoelectric element (402). The second artificial intelligence model (408-2) may refer to an artificial intelligence model used to classify a user's symptoms through data (e.g., HRV data) processed from data (e.g., BCG data) output through the first artificial intelligence model (408-1).

[0054] According to one embodiment, although not shown in FIG. 4, the sensor module (201) may be operatively and / or electrically connected to a driving unit designed to inject or extract air into or from an air tube (110) of the wearable device (101). For example, the sensor module (201) may be disposed inside a housing of the driving unit.

[0055] In one embodiment, although not shown in FIG. 4, the battery (411) may be operatively and / or electrically connected to the driving unit. For example, the battery (411) may supply power to the driving unit. The battery (411) may be a separate component from the sensor module (201) and may supply power to both the sensor module (201) and the driving unit.

[0056] According to one embodiment, although not shown in FIG. 4, the sensor module (201) may be positioned inside the silicone tube, and the sensor module (20!) positioned inside the silicone tube may be placed inside the housing of the driving unit.

[0057] According to one embodiment, the processor (401) may be a dedicated processor for controlling a specific system, and may refer to a microcontroller (Micro Controller Unit, MCU). The processor (401) may be operatively and / or electrically connected to a piezoelectric element (402), a BCG AFE (403), an RGB (404), a data storage unit (405), a communication unit (406), a motion sensor (407), an artificial intelligence model unit (408), a data processing unit (409), a noise removal unit (410), and a battery (410). The processor (401) can analyze and process various data obtained from the piezoelectric element (402), BCG AFE (403), RGB (404), data storage unit (405), communication unit (406), motion sensor (407), artificial intelligence model unit (408), data processing unit (409), noise removal unit (410), and battery (410), and can control the corresponding devices according to the results of the analysis and processing.

[0058] According to one embodiment, the processor (401) can obtain air pressure data within the air tube (110) of the wearable device (101) through the piezoelectric element (402).

[0059] According to one embodiment, the circuit may be one that amplifies and filters the micro output voltage of the piezoelectric element (402) through the BCG AFE (403) to generate an analog voltage so that the processor (401) can perform an analog-digital converter (ADC).

[0060] According to one embodiment, RGB (404) may be a three-color LED indicating the operating status of the processor (401).

[0061] According to one embodiment, the data storage unit (405) may be a circuit that stores air pressure data acquired through the piezoelectric element (402) and output data output through the artificial intelligence model unit (408).

[0062] According to one embodiment, the communication unit (406) may support data communication with an external device (e.g., a server (103)). For example, a wearable device (101) may transmit a biosignal to the server (103) via the communication unit (406).

[0063] According to one embodiment, the motion sensor (407) may be a sensor that obtains movement data of a user wearing the wearable device (101). For example, the motion sensor (407) may include a three-axis motion sensor, an acceleration sensor, a geomagnetic sensor, and / or a gyro sensor.

[0064] According to one embodiment, the motion sensor (407) can perform I2C communication with the processor (401). The motion sensor (407) can provide user movement data acquired through the motion sensor (407) to the processor (401) through I2C communication.

[0065] According to one embodiment, the artificial intelligence model unit (408) may include a first artificial intelligence model (408-1) and a second artificial intelligence model (408-2). The first artificial intelligence model (408-1) may refer to an artificial intelligence model used to process (or preprocess) air pressure data or biosignals (e.g., BCG signals) acquired through the piezoelectric element (402). That is, the first artificial intelligence model (408-1) may refer to an artificial intelligence model that performs a raw data filter to extract filtered data (filtered signals) from raw data processed (e.g., Fourier transform and wavelet transform) using a template matching technique. The first artificial intelligence model (408-1) may be referred to as a similar signal matching model as an artificial intelligence model that utilizes a template matching technique. The above raw data may refer to air pressure data obtained through a piezoelectric element (402) or data that has been preprocessed through a data processing unit (409). The above preprocessing may refer to Fourier transform and wavelet transform.

[0066] According to one embodiment, the first artificial intelligence model (408-1) may be trained to output filtered data when raw data is input by utilizing a normal BCG data set (or a normal biometric data set). The normal BCG data set or the normal biometric data set may be data that serves as a basis for template data. The first artificial intelligence model (408-1) may be trained to output the filtered data differently for each user. The normal biometric data set may include at least one of a normal heart rate data set, a normal heart rate variability data set, a normal respiration rate data set, a normal skin conductance data set, a normal photoplethysmography data set, a normal pulse data set, or a normal body temperature data set.

[0067] According to one embodiment, the first artificial intelligence model (408-1) may mean an artificial intelligence model that uses as input data at least one of air pressure data acquired through a piezoelectric element (402) or data obtained by preprocessing the air pressure data through a data processing unit (409), and a normal BCG data set (or a normal biological data set) as output data.

[0068] According to one embodiment, the second artificial intelligence model (408-2) may refer to an artificial intelligence model used to classify a user's symptoms through data (e.g., heart rate variability (HRV) data) processed from data (e.g., ballistic cardiogram (BCG) data) output by the first artificial intelligence model.

[0069] According to one embodiment, the second artificial intelligence model (408-2) can be trained to output the type of symptom when data (e.g., heart rate variability (HRV) data) processed from data (e.g., BCG data) output by the first artificial intelligence model is input by utilizing heart rate variability data according to symptoms.

[0070] In one embodiment, the symptoms may include stress-related symptoms, breathing-related symptoms, pain-related symptoms, depression-related symptoms, or heart disease-related symptoms.

[0071] In one embodiment, the stress-related symptoms may reduce heart rate variability. For example, anxiety, tension, irritability, and physical tension can cause irregular heartbeats and reduced heart rate variability. The second AI model (408-2) can be trained using heart rate variability data that shows reduced heart rate variability and irregular heartbeats in response to stress-related symptoms.

[0072] In one embodiment, the respiratory symptoms, such as changes in breathing patterns, airway obstruction, asthma, and dyspnea, may reduce heart rate variability. The second artificial intelligence model (408-2) may be trained using heart rate variability data with reduced heart rate variability according to respiratory symptoms.

[0073] In one embodiment, the pain-related symptoms, such as chronic pain, neuralgia, and myalgia, can cause irregular heartbeats and reduced heart rate variability. The second artificial intelligence model (408-2) can be trained using heart rate variability data that shows reduced heart rate variability and irregular heartbeats in response to pain-related symptoms.

[0074] In one embodiment, the above depression-related symptoms, such as depression, lethargy, fatigue, and gloomy mood, may be associated with decreased heart rate variability. The second artificial intelligence model (408-2) may be trained using heart rate variability data in which heart rate variability is decreased according to depression-related symptoms.

[0075] According to one embodiment, the heart disease-related symptoms, such as heart failure, arrhythmia, and myocardial infarction, which affect heart health, can reduce the variability of heart rate variability. The second artificial intelligence model (408-2) can be trained using heart rate variability data with reduced variability in heart rate variability according to heart disease-related symptoms.

[0076] According to one embodiment, the data processing unit (409) may be a circuit that processes sensing data (e.g., BCG raw data) acquired through a sensor (e.g., a piezoelectric element (402) of a sensor module (201)) into input data to be input into an artificial intelligence model (e.g., a first artificial intelligence model (408-1)). For example, the data processing unit (409) may perform a preprocessing operation to process air pressure data representing air pressure in an air tube (110) of a wearable device (101) acquired through a piezoelectric element (402) into input data to be input into the first artificial intelligence model unit (408-1) of the artificial intelligence model unit (408). The preprocessing process may mean a Fourier transform and a wavelet transform. The data processing unit (409) can primarily apply Fourier transform to the air pressure data obtained through the piezoelectric element (402) and secondarily apply wavelet transform to it.

[0077] According to one embodiment, the noise removal unit (410) can remove noise included in sensing data detected through the piezoelectric element (402) based on movement data acquired from a motion sensor (407) (e.g., a 3-axis motion sensor, an acceleration sensor, a geomagnetic sensor, and / or a gyro sensor). For example, the noise removal unit (410) can remove noise data included in the sensing data by superimposing signals of the x, y, and z axes measured from an acceleration sensor on sensing data (e.g., air pressure data) measured through the piezoelectric element (402) and removing the amplified signals.

[0078] According to one embodiment, the battery (411) may supply power to operate the sensor module (201). The battery (411) may be capable of being charged by wires and / or wirelessly. When the battery (411) is in a charged state, the communication unit (406) may be activated. For example, the processor (401) may activate the communication unit (406) in response to identifying that the battery (411) is in a charged state to perform data communication with an external device (e.g., server (103)). That is, the processor (401) may transmit sensing data to the server (103) through the communication unit (406) when the battery (411) is in a charged state. The above sensing data may include sensing data (e.g., air pressure data) detected through a piezoelectric element (402) or data processed through a data processing unit (409) (e.g., data subjected to preprocessing including Fourier transform and wavelet transform and data input to and output from the preprocessing and the first artificial intelligence model (408-1)).

[0079] FIG. 5 illustrates a conceptual diagram of a technology for obtaining a user's biometric information using a sensor module (201) provided in a wearable device (101) according to one embodiment.

[0080] FIG. 5 (a) shows a wearable device (101) equipped with a sensor (e.g., a sensor module (201)) for obtaining biometric information of a user in real time when the user wears the device, FIG. 5 (b) shows the appearance of contraction or expansion of blood vessels according to the biometric state (e.g., heartbeat state or breathing state) of the user when the user wears the wearable device (101), and FIG. 5 (c) can show a graph showing biometric information of a user wearing the wearable device (101) obtained in real time through a sensor of the wearable device (101).

[0081] According to one embodiment, when a user wearing a wearable device (101) exhales or his / her heart contracts (501), the user's blood vessels may remain in their original state or become dilated. When a user wearing a wearable device (101) inhales or his / her heart contracts (502), the user's blood vessels may become contracted compared to their original state.

[0082] According to one embodiment, the wearable device (101) can obtain the user's biometric information through the sensor module (201). The wearable device (101) can obtain raw data (511) representing the user's biometric information through the sensor module (201). The wearable device (101) can process the raw data through the data processing unit (409) to generate ballistic cardiogram (BCG) data (512) and respiration data (513). For example, the wearable device (101) can apply Fourier transform and wavelet transform to the raw data through the data processing unit (409). The wearable device (101) can input the transformed data obtained by applying the Fourier transform and wavelet transform to the first artificial intelligence model (408-1) and output filtered data. The above filtered data may include ballistic data (612) or respiratory data (613).

[0083] In one embodiment, the Fourier transform may refer to a process of separating frequencies corresponding to the heart rhythm and breathing rhythm from raw data measured through the piezoelectric element (402).

[0084] According to one embodiment, wavelet transform may mean a process of creating various bands from low frequency to high frequency by increasing or decreasing the length of a signal in the time axis direction and a process of calculating a correlation coefficient with raw data by changing the time scale of a wavelet function modeled according to a specific rule.

[0085] FIG. 6 illustrates a conceptual diagram of a technology for obtaining and processing raw data by a sensor module (201) according to one embodiment.

[0086] Referring to FIG. 6, the wearable device (101) obtains BCG raw data through a sensor module (201) equipped in the wearable device (101) (FIG. 6 (a)), preprocesses the BCG raw data (FIG. 6 (b)), and then goes through a series of data processing processes (FIG. 6 (c) and (d)), thereby obtaining data (e.g., heart rate variability data) that serves as the basis for judgment in order to detect an abnormal state of the user.

[0087] Referring to (a) of FIG. 6, the wearable device (101) can obtain raw data through the piezoelectric element (402) in the sensor module (201) provided in the wearable device (101). The raw data may refer to pressure data, and more specifically, may refer to air pressure data indicating the air pressure inside a silicone tube surrounding the piezoelectric element (402).

[0088] According to one embodiment, the piezoelectric element (402) can be understood as an element that measures pressure, and the piezoelectric element (402) located inside the silicone tube can detect the pressure that air inside the silicone tube presses on the piezoelectric element (402). The silicone tube can be connected to the air tube (110) of the wearable device (101), and when connected, the entire inside of the silicone tube and the air tube (110) can be formed as a single, sealed space. That is, when a user breathes or a heart beats while wearing the wearable device (101), the user's body (e.g., chest or back) can pressurize or depressurize the air tube (110), thereby changing the air pressure of the air tube (110). A change in air pressure inside the air tube (110) can change the air pressure inside the silicone tube forming a sealed space, and the piezoelectric element (402) can detect a change in air pressure inside the silicone tube, thereby substantially detecting a change in air pressure inside the air tube (110).

[0089] Referring to (b) of FIG. 6, the wearable device (101) can pre-process the raw data through the data processing unit (402). Here, referring to (b1) and (b2) of FIG. 6, the pre-processing may include a process called Fourier transform, wavelet transform, and similar signal matching.

[0090] In one embodiment, the Fourier transform may refer to a process of separating frequencies corresponding to biological rhythms (e.g., heart rhythm or breathing rhythm) from the raw data (e.g., pressure data, air pressure data).

[0091] According to one embodiment, the wavelet transform may mean a process of creating various bands from low frequencies to high frequencies by adjusting the length of a signal by increasing or decreasing it in the time axis direction, and a process of calculating and converting a correlation coefficient with raw data while changing the time scale of a wavelet function modeled according to a specific rule.

[0092] Referring to (b2) of FIG. 6, the similar signal matching operation may refer to an operation in which the wearable device (101) processes data by utilizing the first artificial intelligence model (408-1). The wearable device (101) may utilize the first artificial intelligence model (408-1) of the artificial intelligence model unit (408) to convert data (e.g., second transformed data) that has undergone Fourier transformation and wavelet transformation into filtered data (e.g., biometric data).

[0093] Referring to (c) of FIG. 6, the wearable device (101) can output filtered data by applying a template matching technique to the raw data using the first artificial intelligence model (408-1). The filtered data may include at least one of ballistic cardiogram data or respiratory data.

[0094] Referring to (d) of FIG. 6, the wearable device (101) can extract heart rate variability data from the ballistic cardiogram data through the data processing unit (409).

[0095] FIG. 7a illustrates a graph for explaining Fourier transform during a preprocessing process of raw data acquired by a sensor module (201) according to one embodiment, and FIG. 7b illustrates a graph for explaining wavelet transform during a preprocessing process of raw data acquired by a sensor module according to one embodiment.

[0096] Referring to FIG. 7A, Fourier transform may refer to a process of separating a frequency corresponding to a biological rhythm (e.g., heart rhythm and respiratory rhythm) from raw data (e.g., pressure data, air pressure data) acquired through a piezoelectric element (402). For example, the wearable device (101) may generate first transformed data by separating a frequency corresponding to a heart rhythm or respiratory rhythm from the raw data through the data processing unit (409). The frequency corresponding to the heart rhythm or respiratory rhythm may correspond to one of a plurality of frequency spectra included in the raw data. The wearable device (101) may generate first transformed data by applying the Fourier transform to the raw data through the data processing unit (409).

[0097] Referring to FIG. 7b, wavelet transform may mean a process of creating various bands from low frequency to high frequency by adjusting the length of a signal (701) in the time axis direction by increasing or decreasing it, and a process of calculating and converting a correlation coefficient with raw data while changing the time scale of a wavelet function modeled according to a specific rule. For example, a wearable device (101) may apply wavelet transform to a signal (701) (e.g., raw data), thereby converting the frequency of the signal (701) in the entire time axis range into a wavelet signal (702) in a specific frequency band (711).

[0098] FIG. 8a illustrates a template matching flowchart of a first artificial intelligence model (408-1) according to an embodiment, and FIG. 8b illustrates a graph showing an example of using template matching of the first artificial intelligence model (408-1) according to an embodiment.

[0099] Referring to FIG. 8a, the wearable device (101) can output data (808) to which the raw data filter is applied (e.g., filtered cardiogram data or filtered respiratory data) by applying a template matching technique to raw data (801) using the first artificial intelligence model (408-1).

[0100] According to one embodiment, the wearable device (101) can obtain raw data (801) (or raw signal) through the sensor module (201) (or piezoelectric element (402)). The wearable device (101) can transmit the raw data (801) to the server (103).

[0101] According to one embodiment, the server (103) may receive raw data (801) from the wearable device (101). The server (103) may extract features (805) from the raw data (801). Based on the extracted features from the raw data (801), the server (103) may perform vector quantization (806). Based on the vector quantization, the server (103) may generate a template (807). The template refers to template data used by the wearable device (101) to utilize the template matching technique of the first artificial intelligence model (408-1), and data input to the first artificial intelligence model (408-1) may be filtered based on the template data. The template may vary depending on the user's personal information (e.g., age, gender, height, weight, degree of disability, etc.) and biometric information. The server (103) can transmit the generated template (or template data) to the wearable device (101).

[0102] According to one embodiment, the wearable device (101) can extract features (802) from raw data (801) and perform vector quantization (803). The wearable device (101) can output filtered data (808) by applying the first artificial intelligence model (408-1) to the vector quantized data using a template (or template data) received from the server (103). The filtered data (808) may be data with reduced noise compared to the raw data (801). For example, referring to FIG. 8B, the wearable device (101) can output a filtered signal (812) by using a template matching technique on an input signal (811), and the filtered signal (812) may be a signal with reduced noise compared to the input signal (811).

[0103] FIG. 9 is a diagram illustrating the overall operation flow of a system including a wearable device (101) and a server (103) according to one embodiment.

[0104] Referring to FIG. 9, when a network connection (920) is established between a wearable device (101) and a server (103), the wearable device (101) can transmit data (e.g., raw data, converted data, filtered data, biometric data) acquired by the wearable device (101) to the server (103), and by receiving an artificial intelligence model updated by the server (103) from the server (103), the wearable device (101) can be controlled by utilizing the updated model.

[0105] In step 901, the wearable device (101) can be worn by a user, and the silicone tube inside the driving part of the wearable device (101) can be connected to the air tube (110), so that the air tube (110) and the entire inside of the silicone tube can be formed into a single sealed space.

[0106] In step 902, in the state of step 901, the wearable device (101) can obtain raw data through the sensor module (201).

[0107] In step 903, the wearable device (101) can extract features from the raw data. The process of extracting the features may refer to a preprocessing process for inputting and processing the raw data into an artificial intelligence model.

[0108] In step 904, the wearable device (101) may vector quantize the raw data. The vector quantization process may refer to a preprocessing process for inputting and processing the raw data into an artificial intelligence model.

[0109] In step 905, the wearable device (101) can perform template matching on the raw data preprocessed data (e.g., second conversion data) based on the template (or template data) provided from the server (103), thereby outputting filtered data.

[0110] In step 907, the wearable device (101) can store the output data in the data storage unit (405) of the wearable device (101). Although not shown in FIG. 9, the wearable device (101) can store not only the filtered data, but also at least one of raw data, first converted data, second converted data, or filtered data in the data storage unit (405).

[0111] In step 908, the wearable device (101) can transmit data (e.g., raw data, first converted data, second converted data, or filtered data) stored in the data storage unit (405) to the server (103) only when the wearable device (101) and the server (103) are connected to a network (920). The server (103) can store the data received from the wearable device (101) in a database.

[0112] In step 909, the server (103) may perform preprocessing on the data to train an artificial intelligence model. The preprocessing may be substantially identical to the operations performed in steps 903 and 904. For example, the server (103) may extract features from the data stored in a database and perform vector quantization.

[0113] In step 910, the server (103) may perform active learning on an artificial intelligence model running within the server (103) using the data on which the preprocessing has been performed. The artificial intelligence model may be substantially identical to the first artificial intelligence model (408-1) and the second artificial intelligence model (408-2) running on the wearable device (101), and the learning and running methods may also be substantially identical.

[0114] In one embodiment, active learning is a method in which an artificial intelligence model directly selects learning data and proactively expands learning data during the learning process, thereby reducing data labeling costs and enabling the construction of effective artificial intelligence models even with a small amount of labeled data.

[0115] In step 911, the server (103) can learn an artificial intelligence model running on the server (103) using active learning.

[0116] In step 912, the server (103) can retrieve an artificial intelligence model learned based on data received from the wearable device (101).

[0117] In step 915, the server (103) can transmit the learned artificial intelligence model to the wearable device (101) only when the server (103) and the wearable device (101) are connected to a network (920). Accordingly, the wearable device (101) can operate the wearable device (101) using the updated artificial intelligence model received from the server (103). The operation means that, based on the biometric information acquired through the sensor module (201) of the wearable device (101), the psychological state or stress level of the user wearing the wearable device (101) is determined, and based on the determined psychological state or stress level, air is injected into the air tube (110) to provide deep pressure to the user. Here, the method of injecting air into the air tube (110) may vary based on the determined psychological state or stress level.

[0118] FIG. 10 illustrates a flowchart of a method for a wearable device (101) to care for a psychological state using biometric information according to one embodiment.

[0119] The operations of the wearable device (101) described below may be performed in different order or simultaneously.

[0120] In operation 1001, the wearable device (101) can obtain biometric information of a user wearing the wearable device (101) in real time through the sensor module (201). For example, the wearable device (101) can detect air pressure within an air tube (110) of the wearable device (101) through the piezoelectric element (402) of the sensor module (201), thereby obtaining air pressure data. The air pressure may vary depending on the user's heartbeat or breathing state.

[0121] According to one embodiment, the wearable device (101) can process the air pressure data into biometric data through the data processing unit (409) and the artificial intelligence model unit (408). The air pressure data can be understood as raw data or ballistic cardiogram data. The wearable device (101) can process the raw data through the data processing unit (409). For example, the wearable device (101) can generate transformed data by first applying Fourier transform to the raw data and second applying wavelet transform to the raw data through the data processing unit (409). Data obtained by applying the Fourier transform to the raw data may be first transformed data, and data obtained by applying the wavelet transform to the first transformed data may be second transformed data.

[0122] According to one embodiment, the wearable device (101) can obtain ballistic cardiogram data and respiratory data by applying puree transformation and wavelet transformation to the raw data. The ballistic cardiogram data and the respiratory data may refer to the second transformed data.

[0123] According to one embodiment, the wearable device (101) may perform a Fourier transform by separating a first frequency corresponding to a heart rhythm to obtain ballistic cardiogram data (or second transformed data) from the raw data. The wearable device (101) may perform a wavelet transform using a wavelet function modeled according to a heart rhythm on the first transformed data obtained by performing the Fourier transform.

[0124] According to one embodiment, the wearable device (101) may perform a Fourier transform by separating a second frequency corresponding to a breathing rhythm to obtain breathing data (or second transformed data) from the raw data. The wearable device (101) may perform a wavelet transform using a wavelet function modeled according to the breathing rhythm on the second transformed data obtained by performing the Fourier transform.

[0125] According to one embodiment, the wearable device (101) inputs the second transformed data to which the Fourier transform and wavelet transform are applied into the first artificial intelligence model (408-1) of the artificial intelligence model unit (408), and based on the output data, acquires biometric data in real time. The biometric data is data to which the template matching technique of the first artificial intelligence model is applied, and may be referred to as data to which a raw data filter is applied. The biometric data may include ballistic cardiogram data or respiratory data to which the raw data filter is applied.

[0126] In operation 1002, the wearable device (101) can detect an abnormal condition of a user wearing the wearable device (101) based on biometric data acquired in real time (e.g., ballistic cardiogram data or respiration data) or data processed from the biometric data (e.g., heart rate data or heart rate variability data). For example, the wearable device (101) can detect an abnormal condition of the user based on whether a numerical value of the biometric data exceeds a specified range.

[0127] According to one embodiment, the wearable device (101) can detect an abnormal state of the user based on whether the heart rate data exceeds a specified range. The specified range may be a first value or a second value, and the specified range may mean a normal heart rate range by age. For example, since the normal average heart rate for adults aged 20 or older is approximately 70 to 75 beats per minute, the first value may be 70 beats per minute, and the second value may be 75 beats per minute. However, the present invention is not limited to the above-described values. If the heart rate data exceeds the specified range, the wearable device (101) may determine that the user is feeling anxious or stressed.

[0128] According to one embodiment, the wearable device (101) can detect an abnormal state of the user based on whether the heart rate variability data exceeds a specified range. The specified range may be a third value or a fourth value, and the specified range may refer to a normal heart rate variability range by age. For example, when the psychological state is stable or the stress level is low, the heart rate variability may be high, in which case the difference value between the third value and the fourth value, which is a specified range, may be a first difference value. When the psychological state is unstable or the stress level is high, the heart rate variability may be low, in which case the difference value between the third value and the fourth value, which is a specified range, may be a second difference value. The first difference value may be greater than the second difference value. When the heart rate variability data exceeds a specified range, the wearable device (101) may determine that the user is feeling anxious or stressed.

[0129] According to one embodiment, the wearable device (101) can detect an abnormal state of the user based on whether the breathing data exceeds a specified range. The specified range may be a fifth value or a sixth value, and the specified range may refer to a normal breathing rate range. The fifth value may be 12 breaths per minute, and the sixth value may be 20 breaths per minute. If the breathing data exceeds the specified range, the wearable device (101) can determine that the user is feeling anxious or stressed.

[0130] In operation 1003, when the wearable device (101) detects that the user is feeling anxious or stressed, i.e., is in an abnormal state, the wearable device (101) can automatically control the driving unit to inject air into the air tube (110) of the wearable device (101). The wearable device (101) can transmit at least one of status information indicating that the user is in an abnormal state or information related to controlling the driving unit to an external device (e.g., a server (103) or a user terminal).

[0131] According to one embodiment, the wearable device (101) can determine at least one of the type of the user's psychological state, the level of stress, or the type of symptom based on the user's biometric information.

[0132] According to one embodiment, the types of psychological states may include anger, sadness, joy, comfort, anxiety, etc. The levels of stress may be divided into intervals and categorized into predetermined stages. For example, the levels of stress may be categorized from Level 1 to Level 5, and it may be understood that stress increases from Level 1 to Level 5. The types of symptoms may include stress-related symptoms, respiratory symptoms, pain-related symptoms, depression-related symptoms, and heart disease-related symptoms.

[0133] According to one embodiment, the wearable device (101) may select an air injection method corresponding to the type of the user's psychological state, the level of stress, and the type of symptom determined above. The air injection method may include at least one of air injection strength, air injection speed, maintenance time after air injection, or air compression area. The wearable device (101) may control the driving unit of the wearable device (101) to inject air into the air tube (110) based on the selected air injection method. For example, when the user's psychological state is determined to be anxious, the wearable device (101) may inject air into the air tube (110) at a first pressure and a first speed, and maintain the air injection state for a first duration. For another example, if the user's psychological state is determined to be angry, the wearable device (101) may inject air into the air tube (110) at a second pressure greater than the first pressure and at a second speed faster than the first speed, and maintain the air injection state for a second duration longer than the first duration. The air injection method is not limited to the above example.

[0134] In operation 1004, the wearable device (101) can detect that the user's psychological state is stable based on the user's biometric information acquired in real time. For example, the wearable device (101) can determine that the user's psychological state is stable if the numerical value of the user's biometric data falls within a specified range. For example, the wearable device (101) can determine that the user's psychological state is stable if at least one of the ballistic cardiogram data, heart rate data, heart rate variability data, or respiration data falls within a specified range.

[0135] According to one embodiment, when the wearable device (101) determines that the user's psychological state is stable, the wearable device (101) may control the driving unit of the wearable device (101) to extract air from the air tube (110). The wearable device (101) may transmit at least one of state information indicating that the user's psychological state is stable or information related to controlling the driving unit to an external device (e.g., a server (103) or a user terminal).

[0136] FIG. 11 illustrates a flowchart of operations between a wearable device (101) and a server (103) for caring for a psychological state using biometric information according to one embodiment.

[0137] The operations of the wearable device (101) and the server (103) described below may be performed in different order or simultaneously.

[0138] In operation 1101, the wearable device (101) can acquire biometric data through a sensor (e.g., a sensor module (201)) provided in the wearable device (101). The biometric data may include at least one of ballistic cardiogram data, heart rate data, heart rate variability data, respiration data, skin conductance data, photoplethysmography data, pulse data, or thermal data. The biometric data may refer to data processed from raw data (or pressure data or air pressure data) detected through a piezoelectric element (402) of the sensor module (201) of the wearable device (101).

[0139] According to one embodiment, the wearable device (101) can obtain air pressure data (or pressure data or raw data) representing the air pressure within the air tube (110) of the wearable device (101) through the piezoelectric element (402) of the sensor module (201). The wearable device (101) can obtain biometric data by processing and handling the air pressure data through the data processing unit (409) and the artificial intelligence model unit (408).

[0140] In operation 1102, the wearable device (101) may store the biometric data in the data storage unit (405). The wearable device (101) may perform an operation of removing noise included in the biometric data through the noise removing unit (410). According to one embodiment, the wearable device (101) may remove noise included in the sensing data (e.g., pressure data, air pressure data) detected through the piezoelectric element (402) through the noise removing unit (410). For example, the wearable device (101) may remove noise in the sensing data by overlapping the sensing data with movement data detected through the motion sensor (407) and removing an amplified signal. The movement data may include x, y, and z-axis data of an acceleration sensor.

[0141] In operation 1103, the wearable device (101) may transmit the biometric data to the server (103) via the communication unit (406). Although not illustrated in FIG. 11, the wearable device (101) may transmit not only the biometric data, but also at least one of raw data, preprocessed data of the raw data (e.g., first converted data, second converted data), and filtered data processed using the first artificial intelligence model to the server (103). The raw data may refer to pressure data or air pressure data. In order for the wearable device (101) to transmit the biometric data to the server (103) via the communication unit (406), it may be assumed that the sensor module (201) or the driving unit of the wearable device (101) is in a charged state. For example, only when the sensor module (201) or driving unit of the wearable device (101) is in a charged state, the wearable device (101) can perform data communication with the server (103) through the communication unit (406).

[0142] According to one embodiment, the wearable device (101) may transmit the user's personal information (e.g., age, gender, height, weight, degree of disability, etc.) to the server (103) through the communication unit (406).

[0143] In operation 1104, the server (103) can store biometric data and personal information received from the wearable device (101) in a database. The server (103) can receive biometric data and personal information from the wearable device (101) only when it is connected to the wearable device (101) via wireless communication.

[0144] In operation 1105, the server (103) may train an artificial intelligence model using the received biometric data and personal information. The artificial intelligence model may be substantially identical to an artificial intelligence model (e.g., a first artificial intelligence model (408-1) and a second artificial intelligence model (408-2)) operated in the wearable device (101).

[0145] According to one embodiment, the server (103) may learn and operate a third artificial intelligence model that performs a raw data filter to extract filtered data from raw data processed (e.g., Fourier transform and wavelet transform) using a template matching technique. The third artificial intelligence model may be learned and operated in substantially the same manner as the first artificial intelligence model (408-1). The third artificial intelligence model may be referred to as a signal matching model as an artificial intelligence model that utilizes a template matching technique. For example, the third artificial intelligence model may be learned to output filtered data when raw data is input using a normal BCG data set (or a normal biometric data set).

[0146] According to one embodiment, the server (103) may extract features from raw data received from a wearable device (101), and then perform vector quantization to generate a template (or template data) for utilizing a template matching technique.

[0147] According to one embodiment, the server (103) may learn and operate a fourth artificial intelligence model that uses the user's personal information and biometric information to determine the user's psychological state, stress level, and type of symptom. The fourth artificial intelligence model may be learned and operated in substantially the same manner as the second artificial intelligence model (408-2). The fourth artificial intelligence model may be referred to as a personalized learning model as an artificial intelligence model used to classify the user's symptoms. For example, the fourth artificial intelligence model may be trained to output the type of symptom when inputting data (e.g., heart rate variability data, respiration data) processed from data (e.g., ballistic cardiogram data) output from the third artificial intelligence model.

[0148] In operation 1106, the server (103) can transmit the generated template (or template data) to the wearable device (101). The server (103) can update the learned artificial intelligence model (e.g., the third artificial intelligence model and the fourth artificial intelligence model) using the data (e.g., raw data, biometric data, etc.) received from the wearable device (101), and transmit the updated artificial intelligence model to the wearable device (101).

[0149] In operation 1107, operation 1107 may be substantially the same as operation 1002. The wearable device (101) may detect an abnormal state of the user by utilizing the updated artificial intelligence model received from the server (103). The wearable device (101) inputs preprocessed raw data (e.g., second transformed data) into the updated first artificial intelligence model (408-1), outputs filtered data, processes the filtered data, inputs it into the updated second artificial intelligence model (408-2), and determines whether the user's state is abnormal based on the output value.

[0150] In operation 1108, operation 1108 may be substantially the same as operation 1003. In response to detecting that the user's condition is abnormal, the wearable device (101) may automatically inject air into the air tube (110) and transmit the user's current condition to an external device (e.g., a server (103) or a user terminal).

[0151] In operation 1109, operation 1109 may be substantially identical to the stable state detection operation of operation 1004. The wearable device (101) may determine that the user's state is stable when the numerical value of the biometric information falls within a specified range.

[0152] In operation 1110, operation 1110 may be substantially the same as the air extraction and current state transmission operation of operation 1004. When the wearable device (101) determines that the user's state is stable, it extracts air from the air tube (110) and transmits at least one of information indicating that the user's state is stable or information indicating that the driving unit is controlled to extract air from the air tube (110) to an external device (e.g., a server (103) or a user terminal).

[0153] FIG. 12 illustrates a flowchart of operations between a wearable device (101) and a server (103) for updating an artificial intelligence model according to one embodiment.

[0154] The operations of the wearable device (101) and the server (103) described below may be performed in different order or simultaneously.

[0155] In operation 1201, the wearable device (101) can charge the sensor module (201). Charging the sensor module (201) may include charging a driving unit operatively connected to the sensor module (201).

[0156] In operation 1202, only when the wearable device (101) detects that the sensor module (201) (or the driving unit) is in a charging state, the wearable device (101) can activate the communication unit (406). That is, the wearable device (101) can deactivate the communication unit (406) until the sensor module (201) (or the driving unit) is in a charging state. In a state where the communication unit (406) is deactivated, the wearable device (101) can perform data communication between circuits within the wearable device (101) through serial communication. The serial communication method may include UART, SPI, and I2C.

[0157] In operation 1203, operation 1203 may be substantially the same as operation 1103 of FIG. 11. The wearable device (101) may transmit biometric data acquired based on raw data acquired through the sensor module (201) to the server (103) through the communication unit (406).

[0158] In operation 1204, the server (103) can store biometric data received from the wearable device (101) in a database.

[0159] In operation 1205, the server (103) can learn an artificial intelligence model operated in the server (103) based on the biometric data stored in the database, thereby updating the artificial intelligence model. The artificial intelligence model may be substantially identical to the first artificial intelligence model (408-1) and the second artificial intelligence model (408-2) operated in the wearable device (101), and may be an artificial intelligence model learned through active learning.

[0160] In operation 1206, the server (103) may transmit the updated artificial intelligence model to the wearable device (101).

[0161] In operation 1207, the wearable device (101) can control the wearable device (101) using an updated artificial intelligence model received from the server (103) while the wearable device (101) is connected to the server (103) via a network.

[0162] According to one embodiment, when a network connection between a wearable device (101) and a server (103) is maintained, the wearable device (101) may transmit data (e.g., raw data, biometric data, etc.) collected by the wearable device (101) in real time, or transmit data (e.g., raw data, biometric data, etc.) collected by the wearable device (101) to the server (103) at specified time intervals.

[0163] According to one embodiment, when the network connection between the wearable device (101) and the server (103) is maintained, the wearable device (101) can receive the artificial intelligence model updated by the server (103) from the server (103) in real time or at specified time intervals.

[0164] According to one embodiment, a system for caring for a user's psychological state based on the user's biometric information may include a wearable device and an external server. The wearable device may include an air tube, an air inlet provided at one end of the air tube to inject or exhaust air into or out of the air tube, a driving unit for injecting or exhausting air into or out of the air tube through the air inlet, a silicone tube disposed inside a housing of the driving unit and extending from the driving unit and connected to the air inlet, a sensor module located inside the silicone tube and having a piezoelectric element for detecting pressure, a first communication unit, a first artificial intelligence model unit, and a first processor located inside the silicone tube and operatively connected to the driving unit, the sensor module, and the first artificial intelligence model unit. The external server may include a second communication unit, a second artificial intelligence model unit, and a second processor operatively connected to the second communication unit and the second artificial intelligence model unit. The first processor obtains air pressure data representing the air pressure inside the air tube through the piezoelectric element of the sensor module, determines whether a network connection is established so that the wearable device and the external server can perform data communication, and if the wearable device and the external server are determined to be in a state where the network connection is established, the air pressure data can be transmitted to the external server through the first communication unit.The second processor may receive the air pressure data from the wearable device through the second communication unit, input the air pressure data into a first artificial intelligence model and a second artificial intelligence model included in the second artificial intelligence model unit, train the first artificial intelligence model to extract filtered data from the air pressure data, thereby updating the first artificial intelligence model, train the second artificial intelligence model to determine the state of the user, thereby updating the second artificial intelligence model, and when the wearable device and the external server determine that the network connection is established, transmit the updated first artificial intelligence model and the updated second artificial intelligence model to the wearable device through the second communication unit. The first processor may receive the updated first artificial intelligence model and the updated second artificial intelligence model from the external server through the first communication unit, and determine the state of the user based on a value obtained by processing the air pressure data with the updated first artificial intelligence model and the updated second artificial intelligence model.

[0165] According to one embodiment, the wearable device may further include a data processing unit that processes data acquired through the piezoelectric element. The first processor may sequentially apply a Fourier transform to the air pressure data and a wavelet transform to the data obtained by performing the Fourier transform through the data processing unit, thereby generating converted data, and when the wearable device and the external server are determined to be in a state of established network connection, the converted data may be transmitted to the external server through the first communication unit.

[0166] According to one embodiment, the first processor may apply a first Fourier transform to the air pressure data through the data processing unit, wherein the first Fourier transform may be a transform that separates a first frequency corresponding to a heart rhythm from the air pressure data. The data processing unit may apply a second Fourier transform to the air pressure data, wherein the second Fourier transform may be a transform that separates a second frequency corresponding to a respiratory rhythm from the air pressure data. Based on the first Fourier transform and the second Fourier transform, the user's ballistic cardiogram data and respiratory data may be acquired from the air pressure data.

[0167] According to one embodiment, a first wavelet transform is performed on air pressure data to which the first Fourier transform is applied through the data processing unit using a first wavelet function modeled according to a heart rhythm, a second wavelet transform is performed on air pressure data to which the second Fourier transform is applied through the data processing unit using a second wavelet function modeled according to a respiratory rhythm, and based on the first wavelet transform and the second wavelet transform, the transformed data is generated from the air pressure data, and the transformed data may include ballistic cardiogram data and respiratory data of the user.

[0168] According to one embodiment, the first artificial intelligence model unit may include a third artificial intelligence model trained to extract filtered data from the transformed data on which the first wavelet transform and the second wavelet transform are performed using a template matching technique. The first processor may update the third artificial intelligence model based on the updated first artificial intelligence model received through the first communication unit when the wearable device and the external server are determined to be in a state of established network connection.

[0169] According to one embodiment, the artificial intelligence model unit may include a fourth artificial intelligence model trained to determine the user's status based on the converted data. The first processor may update the fourth artificial intelligence model based on the updated second artificial intelligence model received through the first communication unit when the wearable device and the external server are determined to have established a network connection.

[0170] According to one embodiment, the first processor may determine that the first communication unit is activated and the wearable device and the external server establish the network connection when at least one of the sensor module or the driving unit changes to a charging state.

[0171] According to one embodiment, the wearable device may further include a motion sensor. The first processor may obtain movement data of the user through the motion sensor and, based on the movement data, remove noise from the air pressure data.

Claims

1. In a system for caring for the psychological state of a user based on the user's biometric information, The above system includes a wearable device and an external server, The above wearable device: air-tube; An air inlet provided at one end of the air tube so that air can be injected into or extracted from the air tube; A driving unit that injects or extracts air into the air tube through the air inlet; A silicone tube disposed inside the housing of the driving unit and extending from the driving unit and connected to the air inlet; A sensor module located inside the above silicone tube and having a piezoelectric element that detects pressure; 1st Communications Department; 1st Artificial Intelligence Model Department; A first processor located inside the silicon tube and operatively connected to the driving unit, the sensor module, and the first artificial intelligence model unit; The above external server is: 2nd Communications Department; 2nd Artificial Intelligence Model Department; A second processor operatively connected to the second communication unit and the second artificial intelligence model unit; The above first processor: Obtaining air pressure data representing the air pressure inside the air tube through the piezoelectric element of the sensor module, Determine whether a network connection is established so that the wearable device and the external server can perform data communication, When the wearable device and the external server are determined to have established a network connection, the air pressure data is transmitted to the external server through the first communication unit, The second processor: Through the second communication unit, the air pressure data is received from the wearable device, By inputting the air pressure data into the first artificial intelligence model and the second artificial intelligence model included in the second artificial intelligence model section, the first artificial intelligence model learns to extract filtered data from the air pressure data, thereby updating the first artificial intelligence model, and the second artificial intelligence model learns to determine the user's status, thereby updating the second artificial intelligence model. If the wearable device and the external server are determined to have established a network connection, the updated first artificial intelligence model and the updated second artificial intelligence model are transmitted to the wearable device through the second communication unit, The above first processor: Through the first communication unit, the updated first artificial intelligence model and the updated second artificial intelligence model are received from the external server, A system that determines the user's status based on values ​​obtained by processing the air pressure data with the updated first artificial intelligence model and the updated second artificial intelligence model.

2. In claim 1, The wearable device further includes a data processing unit that processes data obtained through the piezoelectric element; The above first processor: By sequentially applying Fourier transformation to the air pressure data and wavelet transformation to the data obtained by performing the Fourier transformation through the data processing unit, transformed data is generated. A system that transmits the conversion data to the external server through the first communication unit when the wearable device and the external server are determined to have established a network connection.

3. In claim 2, The above first processor: Applying a first Fourier transform to the air pressure data through the data processing unit, wherein the first Fourier transform is a transform that separates a first frequency corresponding to a heart rhythm from the air pressure data. Applying a second Fourier transform to the air pressure data through the data processing unit, wherein the second Fourier transform is a transform that separates a second frequency corresponding to a breathing rhythm from the air pressure data. A system for obtaining the user's ballistic cardiogram data and respiration data from the air pressure data based on the first Fourier transform and the second Fourier transform.

4. In claim 3, The above first processor: The first wavelet transform is performed on the air pressure data to which the first Fourier transform has been applied through the above data processing unit, using the first wavelet function modeled according to the heart rhythm, The second wavelet transform is performed on the air pressure data to which the second Fourier transform has been applied through the data processing unit using the second wavelet function modeled according to the breathing rhythm. Based on the first wavelet transform and the second wavelet transform, the transformed data is generated from the air pressure data, The above conversion data includes the user's ballistic cardiogram data and respiratory data, the system.

5. In claim 4, The first artificial intelligence model section includes a third artificial intelligence model trained to extract filtered data from the transformed data that has undergone the first wavelet transformation and the second wavelet transformation using a template matching technique, The above first processor: A system that updates the third artificial intelligence model based on the updated first artificial intelligence model received through the first communication unit when the wearable device and the external server are determined to have established a network connection.

6. In claim 4, The first artificial intelligence model unit includes a fourth artificial intelligence model learned to determine the user's status based on the conversion data, The above first processor: A system that updates the fourth artificial intelligence model based on the updated second artificial intelligence model received through the first communication unit when the wearable device and the external server are determined to have established a network connection.

7. In claim 1, The above first processor: A system in which, when at least one of the sensor module or the driving unit changes to a charging state, the first communication unit is activated and the wearable device and the external server are determined to have established the network connection.

8. In claim 1, The wearable device further comprises a motion sensor, The above first processor: Obtaining the user's movement data through the above motion sensor, A system for removing noise from the air pressure data based on the above movement data.

Citation Information

Patent Citations

  • Biological information detection system, program, and biological information detection method

    JP2022185752A

  • System and method for rehabilitation exercise of the hands

    KR101541082B1

  • A bio-information determination apparatus and method of a target using an impulse radar

    KR101738822B1

  • Method of caring psychological condigion based on biological information and apparatus therefor

    KR102421379B1

  • Method and system for caring psychological state using ballistics measured through piezoelectric elements

    KR102594112B1