Mental healthcare device having electrode contact structure
The mental healthcare device with an adjustable electrode adhesion structure and combined EEG/PPG sensors addresses noise and integration issues, providing accurate and comprehensive mental health assessment for improved user experience and tailored programs.
Patent Information
- Application Number
- PCT/KR2024/006008
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-04
- Filing Date
- 2024-05-03
- Publication Date
- 2024-11-07
AI Technical Summary
Current mental healthcare devices face challenges in accurately diagnosing mental health conditions due to noise interference from electrode adhesion and movement, and they lack integration of EEG and PPG data for comprehensive mental health assessment.
A mental healthcare device with an adjustable electrode adhesion structure that combines EEG and PPG sensors, featuring a band for secure fit and noise detection, allowing simultaneous measurement and correction of mental indices using composite data.
This approach enhances accuracy by minimizing noise and integrating EEG and PPG data for precise mental indicator derivation, improving user experience and satisfaction with tailored programs based on long-term mental state analysis.
Smart Images

Figure KR2024006008_07112024_PF_FP_ABST
Abstract
Description
Mental healthcare device with electrode contact structure
[0001] The present invention relates to a mental healthcare device including EEG and PPG sensors. More specifically, the present invention relates to a mental healthcare device having a structure for more accurately sensing bio-data including a user's brain waves.
[0002] Rapid social change and rapid economic growth have led to a growing number of people experiencing mental health issues such as depression, stress, and dementia. In response, extensive research is being conducted on ways to accurately diagnose and assess mental health using specific electronic devices.
[0003] To this end, a device that measures brain waves was invented, and a technology was disclosed that uses the device to determine the mental health level of the user, thereby providing objective results on the user's mental health and specific content for the development of the user's mental health.
[0004] However, according to the conventional technology as described above and the technologies introduced so far, only the mental health condition is diagnosed using bio-signal data or only the questionnaire test data, and the mental health of the user cannot be diagnosed by organically integrating the bio-signal data and questionnaire test data.
[0005] In addition, there were limitations in providing comprehensive mental healthcare services by only measuring the user's brain waves and then providing programs or content utilizing the brain waves, and obtaining the user's bio-data other than brain waves through the measuring device.
[0006] Accordingly, there is an emerging need for a mental healthcare device that can accurately measure a user's brain waves in order to provide a brainwave-based customized program.
[0007] Meanwhile, brain waves, which are generally measured by electrodes attached to the subject's scalp included in the brain wave measuring device, are mainly waves with a frequency of 0.5 to 40 Hz or less, and are physical values that reflect the human state of consciousness.
[0008] The above brain waves can be divided into several types according to their frequency. When classifying brain wave signals by frequency, brain waves with a frequency of 0.5 to 4 Hz are delta (δ) waves, which mainly appear in normal sleep states or in newborns, and brain waves with a frequency of 8 Hz, theta (θ) waves, which typically appear in emotionally unstable states or in adolescents with learning disabilities who are distracted by their surroundings.
[0009] On the other hand, alpha (α) waves with a frequency of 8-13 Hz are clearly visible when one is mentally stable, has one's eyes closed, and is concentrating, and lastly, beta (β) waves with a frequency of 14 Hz or higher are visible during mental activity or when one is in a state of tension.
[0010] Among the brainwave signals described above, brainwaves in the alpha (α) wave region are known to be psychologically stable and increase concentration, so research is actively being conducted to increase the appearance rate of alpha waves, and in particular, research on neurofeedback training using alpha waves and devices supporting this theory have been actively developed in various fields.
[0011] However, conventional brain wave measurement devices have a problem in that they cannot remove noise caused by the sensor's close contact, the subject's movement, the sensor's operation, etc., and thus, they use brain waves containing noise to determine the subject's mental indicators, resulting in low accuracy.
[0012] In addition, there is no disclosure at all regarding a technology for extracting a single integrated mental index by simultaneously using the acquired first bio-data and second bio-data, rather than extracting separate mental indicators from each of the first bio-data and second bio-data acquired through an EEG measuring device.
[0013] In addition, since only sensing data on the subject's current state obtained through the brainwave measuring device is provided, and prediction data for future events are not provided, there is an urgent need for an invention to solve this problem.
[0014] The present invention has been devised to solve the problems of the prior art as described above, and its purpose is to provide a mental healthcare device having an electrode contact structure.
[0015] In addition, the present invention seeks to provide a mental healthcare device having an electrode contact structure combined with a length-adjustable band.
[0016] In addition, the present invention seeks to provide a mental healthcare device having an electrode contact structure that simultaneously measures and acquires EEG data and PPG data.
[0017] In addition, the present invention seeks to provide a mental healthcare device having an electrode contact structure in which the EEG electrode has a structure for contact with the user's body.
[0018] In addition, the present invention aims to provide a method and system for deriving a mental index based on composite data of EEG and PPG that simultaneously acquires EEG and PPG data based on a mental healthcare device mounted on the user's head.
[0019] In addition, the present invention seeks to provide a method and system for deriving a mental index based on composite data of EEG and PPG, which corrects a basic mental index based on PPG data.
[0020] In addition, the present invention seeks to provide a method and system for deriving mental indices based on composite data of EEG and PPG, which derives multiple mental indices from only one composite data.
[0021] In addition, the present invention aims to provide a method and system for deriving a mental index based on composite data of EEG and PPG that identifies a long-term user sensing data change trend for one mental index.
[0022] However, the technical problems to be solved by the present invention and embodiments of the present invention are not limited to the technical problems described above, and other technical problems may exist.
[0023] A mental healthcare device having an electrode contact structure according to an embodiment of the present invention comprises: a first body part including an EEG sensor part and a PPG sensor part; a second body part connected to the first body part and having a first band hole formed at an end opposite to the end connected to the first body part; a third body part connected to the first body part and having a second band hole formed at an end opposite to the end connected to the first body part; a housing including a processor that controls the EEG sensor part and the PPG sensor part; and a band connected to the first and second band holes and having an adjustable length.
[0024] In addition, the curvature of the first body part is formed to be greater than the curvatures of the second body part and the third body part, and the housing has an oval structure with one side open, with the long axis being in the normal direction from the PPG sensor part and the short axis being in the left and right directions.
[0025] In addition, the PPG sensor unit is positioned at the inner center of the first body unit, and the brainwave sensor unit includes a first EEG electrode positioned to the left of the PPG sensor unit and a second EEG electrode positioned to the right.
[0026] In addition, the first EEG electrode and the second EEG electrode protrude inwardly from the inner body surface of the first body part by a predetermined length and are connected to a substrate included in the housing by a spring.
[0027] In addition, the first EEG electrode and the second EEG electrode have a structure in which the first EEG electrode and the second EEG electrode are pressed toward the substrate included inside the housing of the first body part by the elasticity of the spring when worn by the user, and the surfaces of the first EEG electrode and the second EEG electrode are in close contact with the body of the user.
[0028] Additionally, the surfaces of the first EEG electrode and the second EEG electrode are formed in a convex structure opposite to the inner body curvature of the first body portion.
[0029] In addition, the PPG sensor unit includes a light emitting unit that outputs light, a glass unit for passing reflected light output from the light emitting unit, and a light receiving unit that senses the reflected light.
[0030] Additionally, the glass portion is positioned at a position corresponding to the center of the user's forehead when worn by the user.
[0031] In addition, the second body part and the third body part are structured so that when the band is tightened according to length adjustment, the first base electrode disposed in the second body part and the second base electrode disposed in the third body part are rotated inward by a predetermined angle so as to be in close contact with the user's head.
[0032] In addition, the mental healthcare device having the electrode contact structure further includes a noise detection sensor located inside the housing and connected to the brainwave sensor unit and the PPG sensor unit, and the processor stops measuring EEG data sensed by the brainwave sensor unit and PPG data sensed by the PPG sensor unit when noise is detected in a spring connected to the first and second EEG electrodes based on the noise detection sensor.
[0033] A mental healthcare device having an electrode contact structure according to an embodiment of the present invention is combined with a band whose length can be adjusted, thereby improving aesthetics and wearing convenience by adjusting the band to fit the size of the user's head.
[0034] In addition, a mental healthcare device having an electrode contact structure according to an embodiment of the present invention has the effect of reducing the error rate due to changes in the measurement environment by simultaneously measuring and acquiring EEG data and PPG data.
[0035] In addition, a mental healthcare device having an electrode contact structure according to an embodiment of the present invention has the effect of minimizing the occurrence of noise due to movement of the electrode while increasing the accuracy of EEG data by having a structure for the EEG electrode to be in close contact with the user's body.
[0036] Meanwhile, the method and system for deriving mental indicators based on composite data of EEG and PPG according to an embodiment of the present invention is based on a mental healthcare device mounted on the user's head, thereby simultaneously obtaining EEG data and PPG data with a single device without separately wearing a device for measuring brain waves (EEG) and a device for measuring pulse waves (PPG), and has the effect of greatly increasing physical and procedural efficiency by simplifying separate data transmission and reception procedures.
[0037] In addition, the method and system for deriving a mental index based on composite data of EEG and PPG according to an embodiment of the present invention corrects the basic mental index based on PPG data, thereby calculating the mental index not only with EEG data but also comprehensively considering PPG data, thereby improving the accuracy of the user's mental index.
[0038] In addition, the method and system for deriving mental indicators based on composite data of EEG and PPG according to an embodiment of the present invention has the effect of improving the utility of using a mental healthcare device and user satisfaction by deriving multiple mental indicators using only one composite data.
[0039] In addition, the method and system for deriving a mental index based on composite data of EEG and PPG according to an embodiment of the present invention have the effect of providing a program that immediately stabilizes the mental state of a user by identifying a long-term trend of changes in the user's sensing data for one mental index, and further, more accurately identifying the mental state of the user by considering the long-term mental changes of the user, and providing a more effective program in which feedback is applied to further improve the identified mental state of the user.
[0040] However, the effects that can be obtained from the present invention are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood from the description below.
[0041] Figure 1 is a conceptual diagram of a mental healthcare service provision system according to an embodiment of the present invention.
[0042] Figure 2 is an internal block diagram of a device according to an embodiment of the present invention.
[0043] Fig. 3 is a perspective view showing the structure and shape of a device according to an embodiment of the present invention.
[0044] Fig. 4 is a cross-sectional view illustrating the EEG electrode structure of the brainwave sensor unit according to an embodiment of the present invention.
[0045] FIG. 5 is an example for explaining a device and band combined according to an embodiment of the present invention.
[0046] FIG. 6 is an example for explaining a band coupled to a device according to an embodiment of the present invention.
[0047] Fig. 7 is a conceptual diagram of a PPG sensor unit according to an embodiment of the present invention.
[0048] Fig. 8 is a cross-sectional view for explaining the structure of a PPG sensor unit according to an embodiment of the present invention.
[0049] FIG. 9 is an example for explaining the corresponding positions of the third and fourth EEG electrodes included in a device according to another embodiment of the present invention.
[0050] Figure 10 is an internal block diagram of a user terminal according to an embodiment of the present invention.
[0051] FIG. 11 is a flowchart illustrating a method for deriving a mental index based on composite data of EEG and PPG according to an embodiment of the present invention.
[0052] FIG. 12 is a flowchart illustrating a method for providing service feedback based on accumulated composite data according to an embodiment of the present invention.
[0053] FIG. 13 is an example of a drawing for explaining mental data according to an embodiment of the present invention.
[0054] FIG. 14 is an example of a drawing for explaining n-th composite data measured over time in an embodiment of the present invention.
[0055] Figure 15 is an example of visual content that accumulates mental indicators according to an embodiment of the present invention.
[0056] The present invention is capable of various modifications and embodiments. Therefore, specific embodiments are illustrated in the drawings and described in detail in the detailed description. The effects and features of the present invention, as well as the methods for achieving them, will become clear with reference to the embodiments described in detail below together with the drawings. However, the present invention is not limited to the embodiments disclosed below and can be implemented in various forms. In the following embodiments, terms such as first, second, etc. are not used in a limiting sense but are used for the purpose of distinguishing one component from another. Furthermore, the singular expression includes plural expressions unless the context clearly indicates otherwise. Furthermore, terms such as "include" or "have" indicate the presence of a feature or component described in the specification, and do not preemptively exclude the possibility that one or more other features or components may be added. Furthermore, in the drawings, the sizes of components may be exaggerated or reduced for convenience of explanation. For example, the size and thickness of each component shown in the drawings are arbitrarily shown for convenience of explanation, and thus the present invention is not necessarily limited to what is shown.
[0057] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings. When describing with reference to the drawings, identical or corresponding components are given the same reference numerals and redundant descriptions thereof will be omitted.
[0058]
[0059] Figure 1 is a conceptual diagram of a mental healthcare service provision system according to an embodiment of the present invention.
[0060] Referring to FIG. 1, a mental healthcare service providing system (hereinafter, “service providing system”) according to an embodiment of the present invention can provide a mental healthcare service (hereinafter, “mental healthcare service”) that derives mental indicators based on composite data of EEG and PPG.
[0061] Here, the mental indicator according to the embodiment may be an indicator representing the user's mental state. Specifically, in the embodiment, the mental indicator may be expressed in dimensions such as attention, brain activity, stress, mood, condition, and cognition, or may be information determining whether the user is suffering from depression, ADHD, or the like.
[0062] In an embodiment, the service providing system can provide a predetermined user-customized mental healthcare content and / or program to the mental healthcare device (100) and / or user terminal (200) by deriving a mental index from the user's sensing data measured based on the mental healthcare device (100).
[0063] In an embodiment, a service providing system implementing the above mental healthcare service may be connected through a mental healthcare device (100), a user terminal (200), a service providing server (300), and a network (10: Network).
[0064] Here, the network (10) according to the embodiment means a connection structure that enables information exchange between each node, such as the mental healthcare device (100), the user terminal (200), and / or the service providing server (300), and examples of such a network (10) include, but are not limited to, a 3GPP (3rd Generation Partnership Project) network, an LTE (Long Term Evolution) network, a WIMAX (World Interoperability for Microwave Access) network, the Internet, a LAN (Local Area Network), a Wireless LAN (Wireless Local Area Network), a WAN (Wide Area Network), a PAN (Personal Area Network), a Bluetooth network, a satellite broadcasting network, an analog broadcasting network, a DMB (Digital Multimedia Broadcasting) network, etc.
[0065] Hereinafter, the mental healthcare device (100), user terminal (200), and service provision server (300) that implement the service provision system will be described in detail with reference to the attached drawings.
[0066]
[0067] -Mental Health Care Device (100: Mental Health Care Device)
[0068] A mental healthcare device (100) according to an embodiment of the present invention may be an electronic device that can be linked with a user-customized content provision application (hereinafter, “application”) that provides a user-customized content provision service installed on a user terminal, and that simultaneously measures predetermined brain waves and PPG linked to the user's mental state.
[0069] In detail, from a hardware perspective, the mental healthcare device (100) may be a wired and / or wireless brainwave measuring device, which may be distinguished by the presence or absence of a wire connecting to an external terminal. Furthermore, it may be an electronic device including a scalp electrode, a sphenoidal electrode, and / or a nasophryngeal electrode, which may be distinguished by the characteristics of the electrode.
[0070] In the embodiment of the present invention, the mental healthcare device (100) (hereinafter, device (100)) that is linked to provide a user-tailored content provision service will be described as a wireless brainwave measuring device including a scalp electrode for convenience of explanation, but any device that is linked to a user terminal and can measure the user's brainwaves by being worn on the user's head can be implemented.
[0071] A device (100) according to an embodiment of the present invention may include an EEG sensor unit (150) and a PPG sensor unit (160) including at least one electrode within a housing.
[0072] Figure 2 is an internal block diagram of a device according to an embodiment of the present invention.
[0073] Referring to FIG. 2, from a functional perspective, the device (100) may include a memory (110), a processor (120), a communication processor (130), an interface module (140), an EEG sensor unit (150), a PPG sensor unit (160), and / or an input / output system (170). These components may be configured to be included within the housing of the device (100).
[0074] The memory (110) can store one or more of various data and commands for providing a user-customized content provision service environment.
[0075] The processor (120) may include at least one processor capable of executing commands of an application stored in the memory (110) to perform various tasks for creating a user-customized content provision service environment.
[0076] In an embodiment, the processor (120) can control the overall operation of the components to provide a user-customized content provision service.
[0077] This processor (120) may be a microcontroller (MCU) suitable for the device (100), and may execute commands and data stored in the memory (110) and control each component mounted on the device (100).
[0078] In addition, the processor (120) can communicate with each component internally via a system bus and can include one or more predetermined bus structures including a local bus.
[0079] Additionally, the processor (120) may be implemented by including at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, and other electrical units for performing functions.
[0080] The communication processor (130) may include one or more devices for communicating with external devices. The communication processor (130) may communicate via a wireless network.
[0081] In detail, the communication processor (130) can communicate with a terminal that stores a content source for implementing a user-customized content provision service environment.
[0082] In an embodiment, the communication processor (130) can transmit and receive various data related to a user-customized content provision service to and from another terminal and / or an external server.
[0083] This communication processor (130) can wirelessly transmit and receive data with at least one of a base station, an external terminal, and an arbitrary server on a mobile communication network constructed through a communication device capable of performing technical standards or communication methods for mobile communication (e.g., LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), 5G NR (New Radio), WIFI, BLE) or short-range communication methods.
[0084] In an embodiment, the communication processor (130) may be a BLE chip. This communication processor (130) may receive a signal for controlling the device (100) from a predetermined terminal.
[0085] The interface module (140) can communicatively connect the device (100) to one or more other devices. In detail, the interface module (140) can include wired and / or wireless communication devices compatible with one or more different communication protocols.
[0086] Through this interface module (140), the device (100) can be connected to multiple input / output devices.
[0087] For example, the interface module (140) can be connected to an audio output device such as a headset port or speaker to output audio.
[0088] As an example, the audio output device is described as being connected via an interface module (140), but an embodiment in which it is installed inside the device (100) may also be included.
[0089] Such an interface module (140) may be configured to include at least one of a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, an audio I / O (Input / Output) port, a video I / O (Input / Output) port, an earphone port, a power amplifier, an RF circuit, a transceiver, and other communication circuits.
[0090] In an embodiment, the interface module (140) may be implemented as an outlet for connecting a predetermined charging terminal.
[0091] The brainwave sensor unit (150) is a sensor that measures brainwaves (Electroencephalography, EEG) coming from the human brain. It can measure the potential difference between electrodes by attaching or contacting electrodes to the outside of the skull, i.e., the forehead, on the user's head.
[0092] In detail, the brainwave sensor unit (150) may include a sensing electrode, a reference electrode, and a ground electrode.
[0093] In an embodiment, the sensing electrode of the brainwave sensor unit (150) may be placed on the device (100) at a location corresponding to a predetermined measurement location on the user's head.
[0094] Additionally, the reference electrode and the ground electrode may be placed in the device (100) within a distance capable of transmitting and receiving a predetermined signal from the sensing electrode.
[0095] In detail, in the embodiment, the reference electrode and ground electrode of the brainwave sensor unit (160) can be connected to the sensing electrode based on a flexible substrate inside the housing (H) of the device (100).
[0096] This brainwave sensor unit (150) may include an EEG IC chip (signal amplification unit, AD conversion unit and / or signal transmission unit).
[0097] In addition, in the embodiment, the brainwave sensor unit (150) can obtain a signal (1 Hz to 50 Hz, size of approximately ±1 mVpp) including a potential change that occurs according to the activity state of the human brain through a predetermined electrode.
[0098] Additionally, in the embodiment, the brainwave sensor unit (150) may include a signal amplifier unit that amplifies the acquired signal.
[0099] Additionally, in the embodiment, the brainwave sensor unit (150) may include an AD converter unit that converts the signal amplified by the signal amplifier unit into a digital signal and outputs it.
[0100] In detail, the above AD conversion unit can convert an analog brainwave signal into a digital brainwave signal and output it through Op-amps, a low-noise amplifier circuit, a channel multiplexer, and a 12-bit ADC (256Hz sampling) circuit.
[0101] Additionally, in the embodiment, the brainwave sensor unit (150) may include a signal transmitter that wirelessly transmits the digital brainwave signal output from the AD converter unit.
[0102] Additionally, in the embodiment, the brainwave sensor unit (150) can transmit the digital brainwave signal to the processor (120).
[0103] The PPG sensor unit (160) may be a sensor unit that measures the amount of blood flowing in peripheral blood vessels by irradiating red light to the earphone user's ear using a red light source and measuring the user's pulse or pulse wave (Photoplethysmogram, PPG) using a light sensor from the light transmitted or reflected therefrom.
[0104] In the embodiment, the light emitting unit and the light receiving unit of the PPG sensor unit (160) can be installed at a position corresponding to a predetermined measurement position on the user's head.
[0105] This PPG sensor unit (160) may include a PPG IC chip (signal amplification unit, AD conversion unit, and / or signal transmission unit).
[0106] In detail, the PPG sensor unit (160) can use a photoplethysmography method that reflects light (LED) into the arterioles in the subcutaneous layer of the forehead and detects how much light is absorbed using a photodetector (photo diode).
[0107] In addition, in the embodiment, the PPG sensor unit (160) can obtain an analog heartbeat signal including a potential change that occurs according to a human pulse activity state through a light-emitting unit and a light-receiving unit using the photoplethysmography method.
[0108] In addition, the above analog heart rate signal can be transmitted to the PPC IC chip, converted into a digital heart rate signal through algorithm analysis and digital filtering, and output.
[0109] In addition, in the embodiment, the PPG sensor unit (160) can transmit the digital heartbeat signal to the processor (120) based on a signal transmission unit that wirelessly transmits the converted and output digital heartbeat signal.
[0110] In an embodiment, the device (100) may further include various sensors, such as a position sensor (IMU), an audio sensor, a distance sensor, a proximity sensor, and a contact sensor, in addition to the brainwave sensor unit (150) and PPG sensor unit (160) described above.
[0111] The input / output system (170) can detect user input (e.g., voice commands, button operation, or other types of input) related to a user-customized content provision service.
[0112] In detail, the input / output system (170) may include a predetermined button and / or touch sensor, etc. In an embodiment, the input / output system (170) may include a control button (171).
[0113] Additionally, the input / output system (170) can be connected to an external controller through an interface module (140) to receive user input.
[0114] Additionally, the input / output system (170) may include a display unit for outputting a predetermined light. In an embodiment, this display unit may be an LED (173).
[0115] In addition, the input / output system (170) can output a predetermined light based on the LED (173) when it detects a state preset by the processor (120) (e.g., charging required, charging complete, brain wave measurement in progress, brain wave measurement error, etc.).
[0116] A device (100) including the above-described components can store user sensing data including at least one EEG data, PPG data, left and right brain balance data, auditory data, etc. in a memory (110) according to an embodiment.
[0117] Hereinafter, the device (100) will be briefly described as performing the operation of at least one processor to execute the instructions of the application.
[0118] The brain wave sensor unit (150) according to the embodiment can amplify and convert an analog brain wave signal (e.g., brain wave with a frequency of 1 to 30 Hz) generated in the user's brain measured by the electrode into a digital signal so that it can be analyzed.
[0119] In addition, the PPG sensor unit (160) according to the embodiment can amplify an analog pulse signal generated in the user's artery measured by the light receiving unit and convert it into a digital signal so that the pulse signal can be analyzed.
[0120] Additionally, in the embodiment, the device (100) can transmit the converted digital signal to a predetermined terminal using short-range wireless communication.
[0121] Meanwhile, the device (100) including the above-described components for providing a user-customized content provision service in the embodiment may be implemented in a hairband type in terms of hardware.
[0122] FIGS. 3 to 5 are examples for explaining the external appearance of a device (100) according to an embodiment of the present invention. FIG. 3 is a perspective view showing the structure and shape of a device (100) according to an embodiment, FIG. 4 is a cross-sectional view for explaining the EEG electrode structure of a brainwave sensor unit (150) according to an embodiment of the present invention, and FIG. 5 is an example for explaining the appearance of a device (100) and a band (1000) combined according to an embodiment of the present invention.
[0123] Referring to FIG. 3, in an embodiment, the device (100) can be implemented as a housing (H) with a curved structure having a curvature optimized for a human head.
[0124] Additionally, in the embodiment, the device (100) may include an EEG sensor unit (150) including first and second EEG electrodes (151, 152), a PPG sensor unit (160), a control button (171), and an LED (173) within a housing (H).
[0125] In detail, the housing (H) may have an oval shape with the long axis in the normal direction from the PPG sensor unit (160) and the short axis in the left and right directions, and may have a structure with one side open.
[0126] Bands (1000) are coupled to both ends of the housing, so that one open side of the device (100) can form an oval-shaped structure closed by the bands (1000), as shown in FIG. 5.
[0127] Here, in the embodiment, the band (1000) has an elastic structure and is adjustable in length, and the combined shape of the device (100) and the band (1000) may be variable depending on whether the length is adjusted. That is, the structure of the device (100) and the band (1000) may be a structure that fits the head shape of a user using the band (1000) whose length is adjustable.
[0128] In addition, the housing (H) can be divided into first to third body parts (B1, B2, B3). In addition, the first to third body parts (B1, B2, B3) can define an area in the direction of contact with the user's head as an inner body (B11, B21, B31), and an opposite area symmetrical to the inner body as an outer body (B12, B22, B32).
[0129] Additionally, the first and second body parts (B1, B2) may be connected but may be separated by a first boundary part (C1), and the first and third body parts (B1, B3) may be connected but may be separated by a second boundary part (C2).
[0130] In addition, the housing (H) may have a curvature of the first body portion (B1) that is greater than that of the second and third body portions (B2, B3) in terms of the curvature, which indicates the degree of bending. However, when the length of the band (1000) is shortened and tightened, the second and third body portions (B2, B3), which have a relatively higher tension than the first body portion (B1), are bent further, increasing the curvature, and may be deformed to have a curvature that is equal to or greater than that of the first body portion (B1).
[0131] Since the relative curvature difference and tension difference of the first to third body parts (B1, B2, B3) cause a change in the relative curvature according to the tightening of the band part (1000), the sensors of the first body part (B1) have the effect of closely contacting the user while providing the user with a comfortable wearing feeling.
[0132] Additionally, the first inner body (B11) of the first body (B1) may include an EEG sensor unit (150) and a PPG sensor unit (160).
[0133] At this time, the wire connected to the brain wave sensor unit (150) and the wire connected to the PPG sensor unit (160) can be separated from each other and placed inside the housing (H).
[0134] In addition, the brainwave sensor unit (150) includes first and second EEG electrodes (151, 152), and a PPG sensor unit (160) may be positioned between the first and second EEG electrodes (151, 152).
[0135] In detail, a PPG sensor unit (160) is placed in the inner center of the first body unit (B1), and a first EEG electrode (151) can be placed on the left side and a second EEG electrode (152) can be placed on the right side so as to be symmetrical left and right around the PPG sensor unit (160).
[0136] The PPG sensor unit (160) measures the pulse using light emission, so it may generate noise, and when worn, it may measure the distance from the user's forehead.
[0137] Accordingly, since noise caused by the PPG sensor unit (160) is equally introduced into the first EEG electrode (151) and the second EEG electrode (152) having the same relative distance, the EEG IC can easily remove noise caused by the PPG sensor unit (160) by including a common noise removal filter caused by the PPG sensor unit (160) introduced into both electrodes.
[0138] In addition, the PPG sensor unit (160) measures the distance to detect whether it is worn or not. When the close contact is adjusted to the distance measured by the PPG sensor unit (160), the first EEG electrode (151) and the second EEG electrode (152) will be symmetrical to each other left and right and close to the same degree, so that the intensity of the user's left and right brain waves can be sensed in the same amount.
[0139] Referring to FIG. 4, the first and second EEG electrodes (151, 152) are sensing electrodes for measuring the user's brain waves and can be placed at a location corresponding to a body part (e.g., forehead).
[0140] At this time, in order to ensure close contact with the user's body, the electrode surfaces (151-SF, 152-SF) of the first and second EEG electrodes (151, 152) may protrude from the surface (B1-SF) of the first inner body (B1) in the direction of the inner body by a predetermined length.
[0141] In addition, the first and second EEG electrodes (151, 152) may be connected to a substrate (S) included inside the housing (H) by combining with a predetermined spring (155). In this case, in the embodiment, the substrate (S) may be a flexible printed circuit board (FPCB).
[0142] Accordingly, if a user wears the device (100) on his / her head, the first and second EEG electrodes (151, 152) can move a predetermined length in the direction of the substrate (S) included inside the housing (H) due to elasticity through the spring.
[0143] In addition, the first and second EEG electrodes (151, 152) may have a convex structure opposite to the curvature of the first body part (B1). Accordingly, the first and second EEG electrodes (151, 152) may be in closer contact with the user's body.
[0144] In addition, a first base electrode (153) may be arranged on the lower side of the second body part (B2) where the second inner body (B21) and the second outer body (B22) of the second body part (B2) are in contact. In addition, a second base electrode (154) may be arranged on the lower side of the third body part (B3) where the third inner body (B31) and the third outer body (B32) of the third body part (B3) are in contact.
[0145] In addition, according to the first and second base electrodes (153, 154) arranged above, a predetermined step may be formed along the outer surface of the second and third outer bodies (B22, B32) of the second and third body parts (B2, B3).
[0146] Additionally, in the embodiment, the first base electrode (153) may have a shape in which the width increases from the first boundary portion (C1) toward the first band hole (BH-1).
[0147] Likewise, in the embodiment, the second base electrode (154) may have a shape in which the width increases from the second boundary portion (C2) toward the second band hole (BH-2).
[0148] Since the first and second base electrodes (153, 154) have the above shape, the area in contact with the user's skin can be increased regardless of the user's different head shapes, thereby providing the effect of sensing more accurate EEG data.
[0149] In addition, in the embodiment, the second body part (B2) including the first base electrode (153) and the third body part (B3) including the second base electrode (154) can rotate at a predetermined angle in the direction of the first and second base electrodes (153, 154) with the first boundary part (C1) and the second boundary part (C2) as a reference axis.
[0150] The rotation of the second and third body parts (B2, B3) can occur simultaneously when the user tightens the band (1000) to fit the device (100) to the head.
[0151] In detail, the first connecting portion between the second body portion (B2) and the first body portion (B1) may be configured with a rotational axis connecting the second body portion (B2) and the first body portion (B1), and a return spring that moves the rotational axis to a reference position. At this time, the axial direction of the rotational axis may be a longitudinal direction extending from the first body portion (B1) to the second body portion (B2).
[0152] The above first coupling part can rotate the second body part (B2) so that the first base electrode (153) arranged in the second body part (B2) faces inward (toward the user's head) when a force pulling the second body part (B2) is applied due to the tightening of the band (100).
[0153] Accordingly, the lower side area of the first base electrode (153) arranged to surround the lower part of the second body part (B2) is directed toward the user's skin side and comes into close contact with each other, so that the bonding area is improved and the degree of adhesion can be increased.
[0154] When the user releases the band (100) for removal, the tightening force applied to the second body part (B2) is removed, and depending on the elasticity of the return spring of the second body part (B2), the second body part (B2) can be returned and positioned so that the reference position (reference axis) matches that of the first body part (B1).
[0155] A second joint may be arranged between the first body part (B1) and the third body part (B3) so as to be arranged symmetrically with the same structure as the first joint part. The description of the second joint part will be replaced with the description of the first joint part.
[0156] In this way, since the first and second base electrodes (153, 154) have a predetermined shape and the body portion including the plurality of electrodes rotates at a predetermined angle, the first and second base electrodes (153, 154) can increase the area of contact with the user's skin regardless of the user's different head shapes and can make the electrodes more closely adhere to the user, thereby having the effect of sensing more accurate EEG data.
[0157] At this time, the first and second base electrodes (153, 154) may be electrodes formed by, for example, gold plating using an ABS material injection molding method.
[0158] In detail, in the embodiment, the first and second base electrodes (153, 154) may be a reference electrode and / or a ground electrode.
[0159] In an embodiment, the first base electrode (153) may be a reference electrode, and the second base electrode (154) may be a ground electrode. This is merely an example, and in other embodiments, the first base electrode (153) may be a ground electrode, and the second base electrode (154) may be a reference electrode. Hereinafter, these may be collectively referred to as electrodes.
[0160] That is, in the embodiment, the second base electrode (154), which is a ground electrode, can measure the potential difference between the first and second EEG electrodes (151, 152), which are sensing electrodes, and the first base electrode (153), which is a reference electrode.
[0161] Accordingly, in the embodiment, the device (100) can obtain EEG data measuring the user's brain waves based on the brain wave sensing unit (150).
[0162] Additionally, a control button (171) and an LED (173) may be included on the upper side of the third body part (B3) where the third inner body (B31) and the third outer body (B23) of the third body part (B3) are in contact.
[0163] In an embodiment, the control button (171) may be placed in a position that is easy to control with the user's hand.
[0164] Additionally, in the embodiment, the control button (171) can detect a predetermined input for controlling the device (100).
[0165] Additionally, in the embodiment, the control button (171) may include a predetermined pressure sensor and / or touch sensor.
[0166] In this embodiment, the LED (173) may be placed on one side of the control button (171).
[0167] Additionally, in the embodiment, the LED (173) can emit light under the control of a terminal and / or server including the device (100).
[0168] Additionally, first and second band holes (BH-1, BH-2) may be formed at both ends of the second and third body parts (B2, B3).
[0169] Accordingly, in the embodiment, the band (1000) can be coupled to the second and second band holes (BH-1, BH-2).
[0170] FIG. 6 is an example for explaining a band (1000) coupled to a device (100) according to an embodiment of the present invention.
[0171] Referring to FIG. 6, the band (1000) in the embodiment may be an elastic band for length adjustment. For example, the band (1000) may be composed of a rubber material including a predetermined ABS material and / or a fabric material including Velcro. For convenience of explanation, the following description will be based on the embodiment in which the band (1000) is made of a fabric material.
[0172] In an embodiment, the band (1000) may include a loop (1100), a hook (1200), and a closing piece (1300).
[0173] Additionally, in the embodiment, the loop (1100) may be a horizontally long bar-shaped string made of fabric material.
[0174] Additionally, for example, the horizontal length of the loop (1100) may be approximately 350 mm so as to be adjusted to the user's head size. Additionally, for example, the vertical length of the loop (1100) may be approximately 24 mm so as to be similar to the vertical length of the device (100).
[0175] Additionally, in the embodiment, the hook (1200) may be a slim Velcro having a vertically long shape.
[0176] Additionally, at least one hook (1200) may be placed at each end of the loop (1100). FIG. 6 illustrates an example in which four hooks (1200) are placed at each end area of the loop (1100).
[0177] At this time, the first hook assembly (1210) placed on one end of the loop (1100) and the second hook assembly (1220) placed on the opposite end may be made of different materials so that the male and female Velcro can be distinguished.
[0178] Accordingly, the first hook assembly (1210) and the second hook assembly (1220) can be fixed in a contact state when they come into contact with each other. That is, the user can wear the device (100) by adjusting the length of the loop (1100) to fit the size of the head using the hook (1200).
[0179] Additionally, in the embodiment, the finishing piece (1300) may be placed at both horizontal corners of the loop (1100). This may be for aesthetic reasons and / or to smooth the corner finish of the loop (1100).
[0180] At this time, for example, the finishing piece (1300) may be made of a rigid material and / or a fabric material.
[0181] Returning again, a PPG sensor unit (160) may be positioned between the first and second EEG electrodes (151, 152) arranged in the first inner body (B11) of the first body unit (B1).
[0182] In detail, in the embodiment, the location where the PPG sensor unit (160) is placed may be a location corresponding to a body part for measuring pulse on the user's head. In the embodiment, the location may refer to the center of the user's forehead.
[0183] In other words, the first and second EEG electrodes (151, 152) can be arranged symmetrically on the left and right at a predetermined distance from the PPG sensor unit (160) positioned at a position corresponding to the center of the user's forehead.
[0184] Figure 7 is a conceptual diagram of a PPG sensor unit (160) according to an embodiment of the present invention.
[0185] Referring to FIG. 7, in the embodiment, the PPG sensor unit (160) may include a light emitting unit (3000), a light receiving unit (3100), and an optical diffuser (3200).
[0186] The light emitting unit (3000) is a unit that outputs light and may be composed of a Visual RGB color LED (VCSEL) that generates light with a wavelength of about 400 nm to 700 nm and an infrared (NIR) LED (VCSEL) that generates light with a wavelength of about 850 nm to 1050 nm.
[0187] In addition, the light receiving unit (3100) is an area that senses scattered or reflected light and may be composed of an optic module having a photo diode, a photo transistor, and a photo detector attached thereto.
[0188] In an embodiment, the light receiving unit (3100) may include an optical sensor that senses reflected light and an optical filter coated on the optical sensor.
[0189] Additionally, the optical diffuser (3200) may be a part that is positioned adjacent to the light emitting unit (3000) and light receiving unit (3100) to increase the light emitting and light receiving areas.
[0190] In an embodiment, the light (L) output from the light emitting unit (3000) may be reflected by a predetermined blood vessel (2) included in the user's body (1), and the reflected light (RL), which is the reflected light, may enter the light receiving unit (3100).
[0191] In addition, the light emitting area, which is the area of light output from the light emitting unit (3000), and the light receiving area, which is the area that can receive light from the light receiving unit (3100), may correspond to the sizes of the light emitting unit (3000) and the light receiving unit (3100), respectively.
[0192] However, the optical diffuser (3200) according to the embodiment can increase the sensitivity of the PPG sensor unit (160) by increasing the light-emitting area (A1) and the light-receiving area (A2) and reduce the deviation of the user's heart rate (PPG) data measured by the PPG sensor unit (160).
[0193] In other words, the light (L) output from the light emitting unit (3000) can be diffused by the light emitting area (A1) by passing through the optical diffuser (3200), and the reflected light (RL) reflected by a predetermined blood vessel (2) included in the user's body (1) can be received by the light receiving unit (3100) by passing through the optical diffuser (3200) again and entering the increased light receiving area (A2).
[0194] To this end, the PPG sensor unit (160) including the optical diffuser (3200) according to the embodiment can be implemented with a predetermined structure.
[0195] Fig. 8 is a cross-sectional view for explaining the structure of a PPG sensor unit (160) according to an embodiment of the present invention.
[0196] Referring to FIG. 8, in the embodiment, the PPG sensor unit (160) may be placed on the substrate (S) of the device (100) that supports the light emitting unit (3000) and the light receiving unit (3100) placed next to the light emitting unit (3000).
[0197] Additionally, in the embodiment, the PPG sensor unit (160) may include a partition (B) arranged between the light-emitting unit (3000) and the light-receiving unit (3100).
[0198] The above-mentioned partition (B) can be arranged to prevent light (L) emitted from the light emitting unit (3000) from being reflected inside the housing (H) rather than the blood vessels (2) of the user's body (1) and being received by the light receiving unit (3100).
[0199] Additionally, in the embodiment, the optical diffuser (3200) may include a first lens (3210) that diffuses light (L) output from the light emitting unit (3000) and a second lens (3220) that receives reflected light (RL) toward the light receiving unit (3100).
[0200] In detail, the first lens (3210) may be formed and placed at a position spaced apart from the light-emitting unit (3000) in the optical diffuser (3200), and the second lens (3220) may be formed and placed at a position spaced apart from the light-receiving unit (3100) in the optical diffuser (3200).
[0201] Additionally, in the embodiment, the light receiving unit (3100) may include an optical filter having a predetermined structure to transmit only reflected light (RL) incident at a predetermined position in the light receiving unit (3100).
[0202] Additionally, in the embodiment, the PPG sensor unit (160) may further include an optical plate (3200-P) that supports the first lens (3210) and the second lens (3220).
[0203] Additionally, in the embodiment, the PPG sensor unit (160) may include a glass unit (3300) for passing light through the optical plate (3200-P).
[0204] At this time, the glass part (3300) is placed on the first inner body (B11) of the first body part (B1) of the device (100), and can be in direct contact with the user's head (e.g., forehead) when worn.
[0205] Accordingly, in the embodiment, the device (100) can obtain PPG data measuring the user's pulse wave based on the PPG sensor unit (160) having the above-described structure.
[0206] That is, in the embodiment, the device (100) can simultaneously obtain EEG data and / or PPG data when a user wears the device (100).
[0207] Meanwhile, when the user wears the device (100), a certain amount of noise may be generated as the spring (155) connected to the first and second EEG electrodes (151, 152) moves.
[0208] To this end, in the embodiment, the device (100) may further include a noise detection sensor in an area extending from the brainwave sensor unit (150) and / or the PPG sensor unit (160).
[0209] Additionally, in the embodiment, the device (100) may stop measuring EEG data and / or PPG data when noise is detected in at least one spring (155) connected to the first and second EEG electrodes (151, 152) based on a noise detection sensor.
[0210] In addition, in the embodiment, the device (100) can detect whether the user is wearing it by setting a predetermined length by which the first and second EEG electrodes (151, 152) move in the direction of the surface (B1-SF) of the first inner body (B1) by the plurality of springs (155).
[0211] At this time, when the first and second EEG electrodes (151, 152) move in the direction of the surface (B1-SF) of the first inner body (B1) by a predetermined length or more, the device (100) in the embodiment can be determined to be in a state where the user is wearing it.
[0212] Additionally, if it is determined that the user is wearing the device and there is no noise data sensed by the noise detection sensor for a predetermined period of time, the device (100) in the embodiment can start measuring EEG data and / or PPG data.
[0213] That is, in the embodiment, the device (100) can simultaneously remove noise included in EEG data and / or PPG data acquired based on a noise detection sensor.
[0214] Additionally, in another embodiment, the device (100) can remove noise included in EEG data and / or PPG data when noise is generated by a plurality of springs (155) connected to the first and second EEG electrodes (151, 152).
[0215] Additionally, in the embodiment, the device (100) can separately remove only the noise included in the EEG data by removing the EOG (Electrooculogram) generated by the movement of the user's eyes.
[0216] Additionally, in an embodiment, the device (100) can synchronize acquired EEG data and / or PPG data.
[0217] Additionally, in the embodiment, the device (100) can transmit the noise-free and synchronized EEG data and / or PPG data to a predetermined terminal.
[0218] In more detail, the device (100) can set the bias of the noise to be proportional to the shortened length of the spring if the length of the spring measured by the noise detection sensor is within a predetermined threshold.
[0219] And the device (100) can remove noise caused by the spring based on the set noise bias, noise characteristics caused by the spring in the first EEG electrode and the second EEG electrode, and noise characteristics caused by symmetry in the measured EEG raw data of both electrodes.
[0220] In more detail, the device (100) stores a pattern of noise characteristics generated by the movement of a spring, and when the first EEG electrode and the second EEG electrode, which are arranged symmetrically at equal intervals on the left and right sides, simultaneously generate the stored noise characteristics, by synchronizing the EEG raw data on both sides, a signal pattern having a predetermined matching rate or higher with the stored noise characteristic pattern can be detected as noise in both EEG raw data.
[0221] Likewise, the device (100) can store a noise pattern caused by the light emission of the PPG sensor and a noise pattern caused by the user's eye movement, respectively.
[0222] As with the removal by the spring noise pattern, the device (100) can simultaneously detect and remove a signal pattern having a predetermined coincidence rate with the noise characteristic pattern after synchronizing the stored noise characteristic pattern and the EEG raw data measured from both EEG electrodes.
[0223] Meanwhile, in another embodiment, the device (100) may further include third and fourth EEG electrodes. That is, in another embodiment, the device (100) may be a device including four-channel electrodes, since it additionally includes third and fourth EEG electrodes in addition to the first and second EEG electrodes (151, 152).
[0224] At this time, the third and fourth EEG electrodes are sensing electrodes additionally installed to collect the user's bio-data, and can be placed at locations corresponding to the user's two temporal lobes.
[0225] FIG. 9 is an example for explaining the corresponding positions of the third and fourth EEG electrodes included in a device (100) according to another embodiment of the present invention.
[0226] Referring to FIG. 9, in another embodiment, the third and fourth EEG electrodes included in the device (100) may be placed at positions corresponding to the first temporal lobe (T3) and the second temporal lobe (T4) on the user's head (10). In another embodiment, the third and fourth EEG electrodes included in the device (100) may be placed at positions corresponding to the first ear ground (A1) and the second ear ground (A2) on the user's head (10).
[0227] Additionally, in another embodiment, the third and fourth EEG electrodes may further include a micro needle array on their surface to increase the measurement accuracy of sensing data.
[0228] In addition, in another embodiment, the device (100) may include a first base electrode (153) as a reference electrode and a second base electrode (154) as a ground electrode. Since the details thereof are the same as those in the above-described embodiment, they are omitted.
[0229] A device (100) according to another embodiment can acquire not only EEG data but also left-right brain balance data and auditory data by including additional third and fourth EEG electrodes. In particular, an auditory test based on left-hand and right-hand sounds can be performed using the device (100) according to another embodiment.
[0230] Accordingly, based on the device (100) according to various embodiments of the present invention, it is possible to obtain user sensing data including PPG data, left and right brain balance data, and auditory data, rather than simply measuring brain waves, and to provide user-customized biofeedback and / or user-customized content through the obtained user sensing data.
[0231]
[0232] -User Terminal (200)
[0233] A user terminal (200) according to an embodiment of the present invention may be a predetermined computing device on which a mental healthcare application (hereinafter, “application”) providing mental healthcare services is installed.
[0234] In detail, from a hardware perspective, the user terminal (200) may include a mobile type computing device and / or a desktop type computing device on which an application is installed.
[0235] Here, the mobile type computing device may be a mobile device such as a smart phone or tablet PC on which an application is installed.
[0236] For example, mobile type computing devices may include smart phones, mobile phones, digital broadcasting devices, personal digital assistants (PDAs), portable multimedia players (PMPs), tablet PCs, etc.
[0237] Additionally, desktop type computing devices may include devices installed with programs for executing mental healthcare services based on wired / wireless communication, such as personal computers such as fixed desktop PCs, laptop computers, and ultrabooks with applications installed.
[0238] Additionally, depending on the embodiment, the user terminal (200) may further include a server computing device that provides a mental healthcare service environment.
[0239] Figure 10 is an internal block diagram of a user terminal according to an embodiment of the present invention.
[0240] Referring to FIG. 10, from a functional perspective, the user terminal (200) may include a storage unit (210), a control unit (220), a communication unit (230), an interface unit (240), an input unit (250), a sensor system (260), and a display system (270). These components may be configured to be included within the housing of the user terminal (200).
[0241] In detail, in the storage unit (210), an application (211) is stored, and the application (211) can store one or more of various application programs, data, and commands for providing a mental healthcare service environment.
[0242] That is, the storage unit (210) can store commands and data that can be used to create a mental healthcare service environment.
[0243] Additionally, the storage unit (210) may include a program area and a data area.
[0244] Here, the program area according to the embodiment may be linked between the operating system (OS) that boots the user terminal (200) and functional elements, and the data area may store data generated according to the use of the user terminal (200).
[0245] Additionally, the storage unit (210) may include at least one non-transitory computer-readable storage medium and one or more temporary computer-readable storage medium.
[0246] For example, the storage unit (210) may be a variety of storage devices such as a ROM, EPROM, flash drive, hard drive, etc., and may include web storage that performs the storage function of the storage unit (210) on the Internet.
[0247] The control unit (220) may include at least one processor capable of executing commands of an application (211) stored in the storage unit (210) to perform various tasks for creating a mental healthcare service environment.
[0248] In an embodiment, the control unit (220) can control the overall operation of the components through the application (211) of the storage unit (210) to provide mental healthcare services.
[0249] This control unit (220) may be a system on chip (SOC) suitable for a user terminal (200) including a central processing unit (CPU) and / or a graphics processing unit (GPU), and may execute an operating system (OS) and / or application programs stored in a storage unit (210) and control each component mounted on the user terminal (200).
[0250] In addition, the control unit (220) can communicate with each component internally via a system bus and can include one or more predetermined bus structures including a local bus.
[0251] In addition, the control unit (220) may be implemented by including at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, and other electrical units for performing functions.
[0252] The communication unit (230) may include one or more devices for communicating with external devices. The communication unit (230) may communicate via a wireless network.
[0253] In detail, the communication unit (230) can communicate with a user terminal (200) that stores a content source for implementing a mental healthcare service environment, and can communicate with various user input components such as a controller that receives user input.
[0254] In an embodiment, the communication unit (230) can transmit and receive various data related to mental healthcare services to and from other user terminals (200) and / or external servers.
[0255] This communication unit (230) can wirelessly transmit and receive data with at least one of a base station, an external terminal, and an arbitrary server on a mobile communication network constructed through a communication device capable of performing technical standards or communication methods for mobile communication (e.g., LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), 5G NR (New Radio), WIFI) or short-range communication methods.
[0256] The interface unit (240) can connect the user terminal (200) to one or more other devices so that they can communicate with each other. In detail, the interface unit (240) can include wired and / or wireless communication devices compatible with one or more different communication protocols.
[0257] Through this interface unit (240), the user terminal (200) can be connected to multiple input / output devices.
[0258] For example, the interface unit (240) can be connected to an audio output device such as a headset port or speaker to output audio.
[0259] As an example, the audio output device is described as being connected through the interface unit (240), but an embodiment in which it is installed inside the user terminal (200) may also be included.
[0260] Additionally, for example, the interface unit (240) may be connected to an input device such as a keyboard and / or mouse to obtain user input.
[0261] This interface unit (240) may be configured to include at least one of a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, an audio I / O (Input / Output) port, a video I / O (Input / Output) port, an earphone port, a power amplifier, an RF circuit, a transceiver, and other communication circuits.
[0262] The input unit (250) can detect user input (e.g., gestures, voice commands, button operations, or other types of input) related to mental healthcare services.
[0263] In detail, the input unit (250) may include a predetermined button, a touch sensor, and / or an image sensor (261) that receives user motion input.
[0264] Additionally, the input unit (250) can be connected to an external controller through the interface unit (240) to receive user input.
[0265] The sensor system (260) may include various sensors such as an image sensor (261), a position sensor (IMU, 263), an audio sensor (265), a distance sensor, a proximity sensor, and a contact sensor.
[0266] Here, the image sensor (261) can capture images and / or videos of the physical space around the user terminal (200).
[0267] In an embodiment, the image sensor (261) can capture and acquire various images and / or videos related to mental healthcare services.
[0268] In addition, the image sensor (261) can capture an image by photographing the direction in which it is positioned on the front or / and rear of the user terminal (200), and can capture a physical space through a camera positioned toward the outside of the user terminal (200).
[0269] This image sensor (261) may include an image sensor device and an image processing module. In detail, the image sensor (261) may process still images or moving images obtained by an image sensor device (e.g., CMOS or CCD).
[0270] In addition, the image sensor (261) can process still images or moving images acquired through the image sensor device using an image recognition process (e.g., OCR, etc.) and / or an image processing module to extract necessary information and transmit the extracted information to the processor.
[0271] Such an image sensor (261) may be a camera assembly including at least one camera. The camera assembly may include a general camera that captures images in the visible light band, and may further include a special camera such as an infrared camera or a stereo camera.
[0272] In addition, the image sensor (261) as described above may be included in the user terminal (200) and operated according to an embodiment, or may be included in an external device (e.g., an external server, etc.) and operated through linkage based on the communication unit (230) and / or interface unit (240) described above.
[0273] The position sensor (IMU, 263) can detect at least one of the movement and acceleration of the user terminal (200). For example, it can be formed by a combination of various position sensors such as an accelerometer, a gyroscope, and a magnetometer.
[0274] In addition, the position sensor (IMU, 263) can recognize spatial information about the physical space around the user terminal (200) by linking with a position communication unit (230), such as the GPS of the communication unit (230).
[0275] The audio sensor (265) can recognize sounds around the user terminal (200).
[0276] In detail, the audio sensor (265) may include a microphone capable of detecting a voice input of a user using the user terminal (200).
[0277] In an embodiment, the audio sensor (265) can receive voice data required for mental healthcare services from the user.
[0278] The display system (270) can output various information related to mental healthcare services as graphic images.
[0279] As an example, the display system (270) can display various user interfaces for mental healthcare services.
[0280] Such displays may include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display, and an e-ink display.
[0281] The above components may be arranged within the housing of the user terminal (200), and the user interface may include a touch sensor (273) on a display (271) configured to receive user touch input.
[0282] In detail, the display system (270) may include a display (271) that outputs an image and a touch sensor (273) that detects a user's touch input.
[0283] For example, the display (271) may be implemented as a touch screen by forming a mutual layer structure with the touch sensor (273) or forming an integral structure. Such a touch screen may function as a user input unit that provides an input interface between the user terminal (200) and the user, and at the same time, provide an output interface between the user terminal (200) and the user.
[0284] The user terminal (200) including the above-described components can store user sensing data including at least one EEG data, PPG data, left and right brain balance data, auditory data, etc. in the storage unit (210) according to an embodiment.
[0285] Meanwhile, depending on the embodiment, the user terminal (200) may further perform at least some of the functional operations performed by the service provision server (300) described below.
[0286]
[0287] -Service Providing Server (300)
[0288] Meanwhile, the service provision server (300) according to an embodiment of the present invention can perform a series of processes for providing mental healthcare services.
[0289] In detail, in an embodiment, the service providing server (300) can provide the mental healthcare service by exchanging data necessary to enable the mental healthcare service process to be run on an external device such as a user terminal (200) with the external device.
[0290] In more detail, in an embodiment, the service providing server (300) may provide an environment in which an application (211) can operate on an external device (in an embodiment, a mobile type computing device and / or a desktop type computing device, etc.).
[0291] To this end, the service providing server (300) may include application programs, data and / or commands for the application (211) to operate, and may transmit and receive various data based thereon with the external device.
[0292] Additionally, in the embodiment, the service providing server (300) can perform various deep learning for mental healthcare services in conjunction with a deep learning neural network.
[0293] Here, the deep learning neural network according to the embodiment may include a convolutional neural network (CNN), an R-CNN (Regions with CNN features), a Fast R-CNN, a Faster R-CNN, a Mask R-CNN, etc., and may include any deep learning neural network that includes an algorithm capable of performing the embodiment described below, and the embodiment of the present invention does not limit or restrict such deep learning neural network itself.
[0294] At this time, depending on the embodiment, the deep learning neural network may be installed directly on the service providing server (300) or may operate as a device separate from the service providing server (300) to perform deep learning for the mental healthcare service.
[0295] In the following examples, an example is described in which a deep learning neural network is directly installed on a service providing server (300) to perform deep learning.
[0296] In addition, in the embodiment, the service providing server (300) can read out a predetermined deep learning neural network driving program constructed to perform the above-described deep learning from memory and perform the deep learning described below according to the read-out predetermined deep learning neural network system.
[0297] Additionally, in the embodiment, the service provision server (300) can store and manage various application programs, commands, and / or data for implementing mental healthcare services.
[0298] As an example, the service providing server (300) can store and manage user sensing data and / or user interfaces, etc.
[0299] However, in the embodiment of the present invention, the functional operations that the service providing server (300) can perform are not limited to those described above, and other functional operations can be performed.
[0300] Meanwhile, referring further to FIG. 1, in the embodiment, the above service provision server (300) may be implemented as a predetermined computing device including at least one processor module (310: Processor Module) for data processing, at least one communication module (320: Communication Module) for data exchange with an external device, and at least one memory module (330: Memory Module) for storing various application programs, data, and / or commands for providing mental healthcare services.
[0301] Here, the memory module (330) can store one or more of an operating system (OS), various application programs, data, and commands for providing mental healthcare services.
[0302] Additionally, the memory module (330) may include a program area and a data area.
[0303] Here, the program area according to the embodiment may be linked between the operating system (OS) that boots the server and functional elements, and the data area may store data generated according to the use of the server.
[0304] In an embodiment, such a memory module (230) may be a variety of storage devices such as ROM, RAM, EPROM, flash drive, hard drive, etc., and may also be a web storage that performs the storage function of the memory module (330) on the Internet.
[0305] Additionally, the memory module (330) may be a removable recording medium on the server.
[0306] Meanwhile, the processor module (310) can control the overall operation of each unit described above to implement a mental healthcare service.
[0307] This processor module (310) may be a system on chip (SOC) suitable for a server including a central processing unit (CPU) and / or a graphics processing unit (GPU), and may execute an operating system (OS) and / or application programs stored in a memory module (330) and control each component mounted on the server.
[0308] In addition, the processor module (310) can communicate with each component internally via a system bus and can include one or more predetermined bus structures including a local bus.
[0309] Additionally, the processor module (310) may be implemented using at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, and other electrical units for performing functions.
[0310] In the above description, it has been described that the service providing server (300) according to the embodiment of the present invention performs the functional operations as described above, but depending on the embodiment, at least a part of the functional operations performed by the service providing server (300) may be performed by an external device (e.g., a user terminal (200), etc.), and at least a part of the functional operations performed by the external device may be further performed by the service providing server (300), and various other embodiments may be possible.
[0311]
[0312] - A method for deriving mental indices based on composite data from EEG and PPG.
[0313] Hereinafter, a method for deriving a mental index based on composite data of EEG and PPG to provide a mental healthcare service by an application (211) executed by at least one processor of a user terminal (200) according to an embodiment of the present invention is described in detail with reference to the attached FIG. 11.
[0314] In an embodiment of the present invention, at least one processor of the user terminal (200) can execute at least one application (211) stored in at least one storage unit (210) or operate in a background state.
[0315] Hereinafter, the method of deriving a mental index based on the composite data of EEG and PPG described above by operating at least one processor to execute the command of the application (211) is briefly described as being performed by the application (211).
[0316] FIG. 11 is a flowchart illustrating a method for deriving a mental index based on composite data of EEG and PPG according to an embodiment of the present invention.
[0317] Referring to FIG. 11, in the embodiment, the user terminal (200) can obtain EEG data and PPG data based on the device (100). (S101)
[0318] Here, the composite data according to the embodiment may refer to data encompassing the acquired EEG data and PPG data.
[0319] In detail, in the embodiment, the user terminal (200) can obtain EEG data sensed by the brainwave sensor unit (150) and PPG data sensed by the PPG sensor unit (160) provided in the device (100).
[0320] In more detail, in the embodiment, the user terminal (200) can obtain first EEG data sensed by the first EEG electrode (151) included in the brainwave sensor unit (150) of the device (100), second EEG data sensed by the second EEG electrode (152), and PPG data sensed by the PPG sensor unit (160).
[0321] At this time, since the first EEG data and the second EEG data have different sensing locations, the sensing values contained in each data may be different. Here, the first EEG data may include a sensing value measured in the user's first frontal lobe (Fp1), and the second EEG data may include a sensing value measured in the user's second frontal lobe (Fp2).
[0322] In addition, the first EEG data and the second EEG data may be composed of values sensed by frequency domain (band), such as theta waves, alpha waves, beta waves, gamma waves, and SMR (Sensorimotor Rhythm) (brain waves having a frequency between alpha waves and beta waves).
[0323] In addition, in the embodiment, the user terminal (200) may calculate a specific frequency value including SEF50 (Spectral Edge Frequency 50) (a specific frequency value in which the area from the left of the frequency side to a specific frequency value in a power spectrum graph occupies 50% of the area for the entire frequency range) based on the first EEG data and the second EEG data.
[0324] Additionally, the above PPG data can be composed of waveform values according to the user's pulse.
[0325] Additionally, in the embodiment, the user terminal (200) may calculate a specific value including the ratio of LF (sympathetic nerve frequency) and HF (parasympathetic nerve frequency) and / or HRV (Heart Rate Variability).
[0326] Additionally, in the embodiment, the user terminal (200) can calculate a basic mental index for the first mental index based on the acquired EEG data. (S103)
[0327] Here, mental indicators according to the embodiment may include attention, brain activity, stress, mood, condition, cognitive, etc.
[0328] In addition, the basic mental index according to the embodiment is an index that calculates the value for each mental index described above, and the frequency band and / or formula required for this may be different for each mental index.
[0329] For example, the frequency bands required for the concentration mental index may be theta waves, beta waves, and SMR, and the user terminal (200) may match a predetermined formula for deriving the concentration mental index using the corresponding frequency bands.
[0330] Similarly, the frequency band required for brain activity mental indicators may be the SEF50 brainwave.
[0331] Additionally, the frequency bands required for the stress mental index can be theta waves, alpha waves (High), beta waves (Low / High), and gamma waves (Low).
[0332] Additionally, the frequency band required for mood mental indicators may be alpha waves.
[0333] Additionally, the frequency band required in the condition mental index and short-term (long-term) stress mental index may be the sympathetic nerve frequency (LF) and / or parasympathetic nerve frequency (HF) of the HRV (heart rate variability) data derived based on the PPG data.
[0334] Additionally, in the embodiment, the user terminal (200) can match the required frequency band and / or formula for each mental indicator.
[0335] In the embodiment, the formula for calculating the basic mental index for each mental indicator is expressed as follows.
[0336] [Formula 1]
[0337] 집중력(Attention_original_score) = ( LN( smAtt( Left EEG 90s ) ) + LN( smAtt ( Right EEG 90s ) ) ) / 2, Attention_score = 50 + 10 x ( m_attention - Attention_original_score ) / sd_attention
[0338] [수식 2]
[0339] 뇌 활성도(Activity_original_score) = ( LN( smAct( Left EEG 90s ) ) + LN( smAct( Right EEG 90s ) ) ) / 2, Activity_score = 50 + 10 x ( m_activity - Activity_original_score ) / sd_activity
[0340] [수식 3]
[0341] 스트레스(Stress_original_score) = ( LN( smStr( Left EEG 90s ) ) + LN( smStr( Right EEG 90s ) ) ) / 2, Stress_score = 50 + 10 x ( m_stress - Stress_original_score ) / sd_stress
[0342] [수식 4]
[0343] 단기 스트레스(ShortStr_original_score) = LN( smShortStr( HRV 90s ) ), ShortStr_score = 50 + 10 x ( m_ShortStr - ShortStr_original_score ) / sd_ShortStr
[0344] [수식 5]
[0345] Mood (Mood_original_score) = smMood ( Left EEG 90s , Right EEG 90s ), Mood_score = 50 + 10 x ( m_mood - Mood_original_score ) / sd_mood
[0346] [Formula 6]
[0347] condition (Cond_original_score) = ArcTan ( smCond ( HRV 90s , tau ) ), Cond_score = 50 + 10 x ( m_cond - Cond_original_score ) / sd_cond
[0348] That is, in the embodiment, the user terminal (200) can calculate the basic mental index for each mental indicator based on the plurality of formulas.
[0349] Additionally, in the embodiment, the user terminal (200) can correct the basic mental index calculated based on the acquired PPG data. (S105)
[0350] In detail, in the embodiment, the user terminal (200) can correct the basic mental index for the calculated first mental index based on the value of the acquired PPG data. Hereinafter, the correction of the basic mental index by the user terminal (200) may be referred to as "basic correction."
[0351] The reason for performing the correction is that, assuming that the first mental index is a stress mental index, the basic mental index is measured high as a result of calculation by substituting the values of the required frequency band in the brain waves, and thus the stress index is determined to be high, but the stress index is determined to be low as a result of calculation based on the acquired PPG data, which may cause confusion in the final determination of the stress index.
[0352] To this end, in the embodiment, the user terminal (200) can match the PPG average value to the basic mental index calculated for each mental index.
[0353] For example, in the first mental index, the basic mental index may be 100 and the PPG average value matched to it may be 10. In other words, if the basic mental index of the first mental index calculated based on the user's EEG data is 100, this may mean that the average PPG data measured from users with a basic mental index of 100 is approximately 10.
[0354] That is, in the embodiment, the user terminal (200) can compare the PPG average value and the acquired PPG data matched to the basic mental index of the calculated first mental index.
[0355] At this time, in the embodiment, the user terminal (200) can correct the result value by multiplying the basic mental index by a predetermined value based on the comparison result of the matched PPG average value and the acquired PPG data.
[0356] In detail, in the embodiment, if the acquired PPG data is greater than or equal to the pre-matched PPG average value, the user terminal (200) can perform a correction to maintain or increase the result value by multiplying the basic mental index by a predetermined value of 1 or more.
[0357] For example, if the acquired PPG data is 12 and the matched PPG average is 10, the acquired data is greater than the average, so a correction can be made by multiplying the basic mental index by 1.2 to increase the resulting value. In this case, the resulting value of the basic mental index will increase, which may further increase the stress index.
[0358] Conversely, in the embodiment, if the acquired PPG data is lower than the matched PPG average value, the user terminal (200) can perform a correction to maintain or lower the result value by multiplying the basic mental index by a predetermined value of 1 or lower.
[0359] For example, if the acquired PPG data is 8 and the matched PPG average is 10, the acquired data is smaller than the average, so a correction can be made by multiplying the basic mental index by 0.8 to lower the resulting value. In this case, the resulting basic mental index value will be lower, which can further reduce the stress index.
[0360] Additionally, in the embodiment, the user terminal (200) can determine the corrected basic mental index as the first mental index for the first mental index. (S107)
[0361] At this time, in the embodiment, the mental index may mean the final result value determined for the mental index.
[0362] Additionally, the mental index according to the embodiment may be expressed as a predetermined value and / or level (e.g., low-normal-high, etc.). For convenience of explanation, the following description will be based on the mental index being expressed as a three-classified level of low-normal-high.
[0363] To this end, in the embodiment, the user terminal (200) can set a predetermined level for each mental index and pre-allocate a predetermined mental index parameter to each level.
[0364] For example, the user terminal (200) may preset the mental index parameters for the first mental index, which is the concentration mental index, such that a 'low' level mental index is 100 or less, a 'normal' level mental index is more than 100 and less than 150, and a 'high' level mental index is 150 or more. Accordingly, if the first mental index of the first mental index is determined to be 120, the user's concentration mental index may be determined to be at a 'normal' level.
[0365] Additionally, in the embodiment, the user terminal (200) can determine the nth mental index for the nth mental index using the same EEG and PPG data. (S109)
[0366] In detail, in the embodiment, the user terminal (200) can obtain and determine the nth mental index of a plurality of nth mental indices other than the first mental index of the first mental index determined above with the same EEG and PPG data.
[0367] To determine a mental index for a concentration mental index according to an embodiment, SMR waves, theta waves, and beta waves can be extracted from brain waves (EEG data). At this time, as concentration increases, theta waves may be lower, and SMR waves and mid-beta waves may be higher. Accordingly, by performing correction according to PPG data, the user terminal (200) in the embodiment can determine a mental index for a concentration mental index.
[0368] To determine a mental index for a brain activity mental indicator according to an embodiment, SEF50 waves may be extracted from brain waves (EEG data). At this time, the lower the brain activity, the lower the SEF50 brain wave may appear. Accordingly, by performing a correction based on PPG data, the user terminal (200) in the embodiment can determine a mental index for a brain activity mental indicator.
[0369] In order to determine a mental index for a stress mental indicator according to an embodiment, (High) alpha waves, (High) beta waves, (Low) beta waves, and (Low) gamma waves can be extracted from brain waves (EEG data), and HRV (heart rate variability) can be extracted from pulse waves (PPG data). At this time, as stress increases, (High) alpha waves may appear lower, (High) beta waves may appear higher, and HRV may appear higher. In this way, the user terminal (200) in the embodiment can determine a mental index for a stress mental indicator.
[0370] In another embodiment, based on a 4-channel electrode mental healthcare device, in order to determine a mental index for a mood mental index, the first and second alpha waves may be extracted from each of the regions (e.g., F7 and F8) that acquire frontal lobe EEG. At this time, when characteristic anxiety is induced, the asymmetry index of the first and second alpha waves may increase. In detail, the first alpha wave of the right frontal lobe may decrease, and the second alpha wave of the left frontal lobe may increase. In this way, the user terminal (200) in the embodiment may determine a mental index for a mood mental index.
[0371] To determine a mental index for a condition mental indicator according to an embodiment, HRV can be extracted from PPG data. In this case, the worse the condition, the higher the HRV. In this way, the user terminal (200) in the embodiment can determine a mental index for a condition mental indicator.
[0372] To determine a mental index for cognitive mental indices according to an embodiment, (Pre) alpha and beta waves can be extracted from brain waves (EEG data). Here, the more cognitively impaired a subject is, the higher the (Pre) alpha waves and the lower the beta waves may appear.
[0373] In an embodiment, the user terminal (200) may determine the cognitive mental index using only the average value of each preset frequency, without performing formula input or correction, unlike the multiple mental indices described above. Furthermore, in an embodiment, the user terminal (200) may provide a user-tailored mental healthcare service that includes neurofeedback training, thereby providing cognitive ability enhancement exercises for the user.
[0374] Accordingly, in the embodiment, the user terminal (200) can generate comprehensive result content including the mental index for each mental indicator of the determined user.
[0375] For example, the comprehensive results content may be displayed including text, images, and / or videos containing content such as 'low concentration, low brain activity, high stress'.
[0376] Additionally, in the embodiment, the user terminal (200) may provide a user-customized mental healthcare service to restore the user's mental health based on the generated comprehensive result content.
[0377] For example, the user terminal (200) can provide a user-customized mental healthcare service including meditation music, neurofeedback, etc. to help a user with ADHD recover from the mental illness.
[0378] Meanwhile, the above comprehensive result content may include a mental care graph visualized by accumulating composite data measured multiple times by the user based on the device (100).
[0379] Additionally, in the embodiment, the user terminal (200) can change or update the user-customized mental healthcare service provided by reflecting the generated mental care graph.
[0380] To this end, in the embodiment, the user terminal (200) can generate a mental care graph, which is visual content that accumulates and displays mental indicators measured multiple times over a predetermined period of time at preset specific times, and provide service feedback for changing and updating a user-customized mental healthcare service already provided based on the generated mental care graph.
[0381]
[0382] - A method for providing service feedback based on accumulated composite data.
[0383] FIG. 12 is a flowchart illustrating a method for providing service feedback based on accumulated composite data according to an embodiment of the present invention.
[0384] Referring to FIG. 12, in the embodiment, the user terminal (200) can obtain the first composite data at the first reference time. (S301)
[0385] Here, the first composite data according to the embodiment may include EEG data and PPG data acquired at the first reference time.
[0386] These first composite data can be reflected in identifying changes in long-term mental indicators, and a detailed explanation of this will be provided later.
[0387] Additionally, the first reference time according to the embodiment may mean a specific time zone set in advance to check long-term change trends for at least one mental indicator of the user over n days.
[0388] This nth reference time can be set as a baseline for determining the average range for a user's specific mental indicators. That is, it can be a fixed, specific time, regardless of the execution time of a dynamic mental health care program.
[0389] Additionally, the first reference time may be at least one time based on a 24-hour period. Furthermore, the first reference time may be set at the start of the day, and the second reference time may be set at the end of the day, in accordance with the user's daily routine. This may be to determine how the user's mental indicators change over the course of a day, week, or month, depending on the user's daily schedule.
[0390] For example, the first reference time may be 6:00 AM, and the second reference time may be 9:00 PM. For convenience of explanation, the first reference time is assumed to be set for the morning, and the second reference time is assumed to be set for the evening.
[0391] In an embodiment, this first reference time may be set automatically by the own process and / or manually by user input.
[0392] In an embodiment, the user terminal (200) may consider composite data measured within a predetermined time before or after a preset first reference time as being measured at the first reference time.
[0393] Additionally, in the embodiment, if the user terminal (200) measures the first composite data at the first reference time but does not execute the mental healthcare service after a predetermined period of time, the composite data may not be reflected in the short-term measurement results and may only be reflected in the long-term measurement results. In the embodiment, the mental healthcare service may include a provided mental healthcare program, and may be referred to as a mental healthcare program hereinafter.
[0394] Here, the short-term measurement results according to the embodiment may be measurement results for clearly identifying the immediate before and after effects of executing a mental healthcare program based on the user's composite data collected in real time.
[0395] In addition, the long-term measurement results according to the embodiment may be measurement results for confirming long-term changes in mental indicators (e.g., stress) that are difficult to immediately identify from the short-term measurement results based on composite data of multiple users accumulated over a long period of time, and for identifying trends of improvement by consistently performing a mental healthcare program over a long period of time.
[0396] In other words, in the embodiment, when the user terminal (200) measures the first composite data at the first reference time, the first composite data can be accumulated over several days and reflected in the long-term measurement results.
[0397] Additionally, in the embodiment, the user terminal (200) can calculate a mental index for the first mental index based on the first composite data. (S303)
[0398] In detail, in the embodiment, the user terminal (200) can calculate a mental index (hereinafter, the first mental index) for the first mental index among the nth mental indices calculated for the first composite data using the above-described steps S101 to S107.
[0399] At this time, the nth mental indicator according to the embodiment may include 1) a mental indicator derived from only EEG data, 2) a mental indicator derived from only PPG data, and 3) a mental indicator derived by combining EEG data and PPG data.
[0400] For example, 1) mental indicators derived from EEG data alone include concentration, brain activity, stress, and mood mental indicators, and 2) mental indicators derived from PPG data alone include short-term stress and condition mental indicators.
[0401] Here, 3) As for the mental indicator derived by combining EEG data and PPG data, a representative example is a stress mental indicator in the embodiment, and for the convenience of explanation, the description below is based on the first mental indicator being a stress mental indicator.
[0402] In an embodiment, the user terminal (200) can perform basic correction that reflects the amount of change in PPG data by a first weight based on EEG data included in the first composite data.
[0403] Hereinafter, the new indicator generated by performing the above basic correction may be referred to as mental data.
[0404] FIG. 13 is an example of a drawing for explaining mental data according to an embodiment of the present invention.
[0405] Referring to FIG. 13, according to an embodiment, a graph (20) of EEG data included in composite data (hereinafter, EEG graph) may have a smaller rate of change than a graph (21) of PPG data (hereinafter, PPG graph) as illustrated.
[0406] Therefore, in the embodiment, the user terminal (200) can generate mental data by reflecting the weight of the PPG graph (21) as the first weight based on the EEG graph (20).
[0407] That is, the graph (22) of the generated mental data (hereinafter, mental graph) may have a change rate intermediate between that of the EEG graph (20) and the PPG graph (21), as shown.
[0408] In other words, in the embodiment, the user terminal (200) can generate mental data by performing basic correction that reflects the amount of change in PPG data based on EEG data in the first composite data by a first weight.
[0409] The mental data generated above may be EEG data to which basic correction has been applied.
[0410] The reason for generating mental data according to the embodiment is that EEG data has the characteristic of changing over a long period of time, while PPG data has the characteristic of changing instantly over a short period of time. Therefore, while the amount of change in EEG data may be minimal when viewed over a short period of time, the amount of change in PPG data can be significant. Therefore, it may be to reflect the amount of change in PPG data in EEG data. If this mental data is accumulated, it is possible to understand the change trend of EEG data over a long period of time.
[0411] Additionally, in the embodiment, the user terminal (200) can calculate a first mental index for the first mental index using the mental data.
[0412] In detail, in the embodiment, the user terminal (200) can calculate the first mental index by substituting the mental data into a formula for calculating the mental index for the first mental index.
[0413] Additionally, in the embodiment, if the PPG data included in the first composite data is greater than a predetermined value, the user terminal (200) may perform re-measurement or recommend a predetermined mental healthcare program.
[0414] That is, through the above-described S303 step, the user terminal (200) in the embodiment can acquire and accumulate composite data at the first and second reference times over several days.
[0415] Additionally, in the embodiment, the user terminal (200) can execute a mental healthcare program and measure second composite data. (S305)
[0416] Here, the mental healthcare program according to the embodiment may be a program provided to improve areas in need of improvement identified based on measured composite data.
[0417] For example, a mental healthcare program may include meditation music and neurofeedback (a treatment method that uses brain wave information generated in the brain to train specific brain waves useful for treatment) to help users with ADHD recover from that mental illness.
[0418] FIG. 14 is an example of a drawing for explaining n-th composite data measured over time in an embodiment of the present invention.
[0419] Referring to FIG. 14, in the embodiment, the user terminal (200) can measure and obtain first composite data at a first reference time (510).
[0420] Additionally, in the embodiment, the user terminal (200) can measure and obtain second composite data at the time of executing the mental healthcare program (hereinafter, execution time (520)).
[0421] Additionally, in the embodiment, the user terminal (200) can measure and obtain third composite data at the time of termination of the mental healthcare program (hereinafter, the termination time (530)).
[0422] Additionally, in the embodiment, the user terminal (200) can measure and obtain the fourth composite data at the second reference time (540).
[0423] In detail, in the embodiment, the user terminal (200) can utilize the first composite data measured at the first reference time (510) and the fourth composite data measured at the second reference time (540) when calculating long-term measurement results.
[0424] Additionally, in the embodiment, the user terminal (200) can utilize the second composite data measured at the execution time (520) and the third composite data measured at the end time (530) when calculating short-term measurement results.
[0425] In the embodiment, the reason why the user terminal (200) calculates the short-term measurement results and long-term measurement results separately is that the EEG data included in the composite data does not change immediately but changes gradually over a predetermined period of time, and the PPG data changes immediately. Therefore, as the user proceeds with the mental healthcare program multiple times, it may be possible to determine how much the mental healthcare program has affected the user's mental health.
[0426] To summarize, in the embodiment, the user terminal (200) can obtain composite data a total of four times, including once at the first reference time (510) per day, once each before and after measuring the mental healthcare program (520, 530), and once at the second reference time (540).
[0427] In addition, in the embodiment, the user terminal (200) can analyze the change trend of the user's mental indicator by accumulating the first composite data acquired at the first reference time (510) and the fourth composite data acquired at the second reference time (540) among the acquired composite data over multiple days.
[0428] Then, the EEG data included in the measured user's composite data can gradually change according to the user's mental state over time.
[0429] That is, in the embodiment, the second composite data may be composite data about a user before executing the mental healthcare program.
[0430] In this way, in the embodiment, the user terminal (200) can obtain the third composite data at the end point (530) of the mental healthcare program. (S307)
[0431] In an embodiment, the user terminal (200) may perform an application correction that reflects the amount of change in PPG data based on the EEG data included in the second and third composite data by a second weight. Hereinafter, the indicator generated by performing the application correction may also be referred to as mental data, similar to the basic correction described above.
[0432] In the embodiment, even when the mental healthcare program is executed, the rate of change of the PPG graph (21) can be measured to be greater than the rate of change of the EEG graph (20), as in the case of FIG. 13.
[0433] If there is a difference, the rate of change of the PPG graph (21) in the second and third composite data may be greater than the rate of change in the first composite data measured at the first reference time, as it is a rate of change affected by the effect of the mental healthcare program.
[0434] Therefore, in the embodiment, the user terminal (200) can generate mental data by reflecting the weight of the PPG graph (21) as the second weight based on the EEG graph (20).
[0435] That is, the second weight may be greater than the first weight.
[0436] Additionally, the second weight may be set as a default value in the system until composite data measured at the nth reference time is accumulated.
[0437] Additionally, in the embodiment, the user terminal (200) can provide short-term measurement results for the mental healthcare program at the end point (530) of the mental healthcare program.
[0438] Additionally, in the embodiment, the user terminal (200) can obtain the fourth composite data at the second reference time. (S309)
[0439] In the embodiment, the user terminal (200) can generate mental data by performing basic correction that reflects the amount of change in PPG data by the first weight based on the EEG data included in the fourth composite data, similar to the step S303 described above.
[0440] Accordingly, in the embodiment, the user terminal (200) can accumulate and store the nth composite data measured at the nth reference time or measured before and after the mental healthcare program.
[0441]
[0442]
[0443] In this manner, in the embodiment, the user terminal (200) can acquire composite data once a day at a first reference time, once before and after the mental healthcare program is executed, and once at a second reference time. Furthermore, by acquiring multiple composite data sets acquired within a single day multiple times over n days, composite data for the first mental indicator can be accumulated.
[0444] Additionally, in the embodiment, the user terminal (200) can accumulate the first to fourth composite data and provide a mental healthcare service according to changes in the first mental indicator. (S311)
[0445] In detail, in the embodiment, the user terminal (200) may accumulate the basic corrected first and fourth composite data and the application corrected second and third composite data over multiple days, provide visual content indicating a change in the first mental indicator based on the accumulated nth composite data, and provide a mental healthcare service including providing feedback on a mental healthcare program according to a change in the first mental indicator.
[0446] In an embodiment, the user terminal (200) can determine the immediate change rate of the user's first mental indicator according to the performance of the mental healthcare program based on the accumulated short-term measurement results.
[0447] The above instantaneous rate of change can be determined by accumulating and analyzing the second and third composite data obtained above.
[0448] Additionally, in the embodiment, the user terminal (200) can determine the long-term change rate of the user's first mental indicator according to long-term performance of the mental healthcare program based on accumulated long-term measurement results.
[0449] The above long-term change rate can be determined by accumulating and analyzing the first and fourth composite data acquired above.
[0450] Consequently, in the embodiment, the user terminal (200) can provide a mental healthcare service including visual content indicating changes in the first mental indicator and feedback for adjusting the difficulty level of a mental healthcare program being provided to the user based on accumulated short-term and long-term measurement results. In this case, the visual content may be provided based on short-term and long-term measurement results, but the mental healthcare program feedback may be provided based solely on long-term measurement results.
[0451] Figure 15 is an example of visual content that accumulates mental indicators according to an embodiment of the present invention.
[0452] Referring to FIG. 15, in the embodiment, the user terminal (200) can accumulate the first mental indicator and provide visual content (CO).
[0453] In this case, the visual content (CO) according to the embodiment may include text, images, and / or videos that can indicate changes in the user's mental indicators. For convenience of explanation, the following description assumes that the visual content is a graph.
[0454] In an embodiment, the user terminal (200) may provide visual content (CO) including daily and / or cumulative results for a first mental indicator. For convenience of explanation, the following description is based on the user measuring composite data at a standard time every day for one month and conducting a mental healthcare program.
[0455] Additionally, in the embodiment, the user terminal (200) can provide different graphs (GR) for each mental indicator.
[0456] Additionally, in the embodiment, the user terminal (200) can display an accumulated result corresponding to a predetermined parameter based on a user input as a graph (GR). In this case, the predetermined parameter may be a month and / or mental indicator set by the user. Taking FIG. 12 as an example, the user selects a first icon (710) corresponding to October and a second icon (720) corresponding to a stress mental indicator, and accordingly, the user terminal (200) can display an accumulated result corresponding to the corresponding parameter as a graph (GR).
[0457] At this time, the graph (GR) according to the embodiment may include at least one marker. Furthermore, when a user selects a marker, the value corresponding to that marker may be displayed numerically.
[0458] Additionally, a mark included in a graph (GR) according to an embodiment may correspond to one day. In this case, the mark may be a mental index calculated based on the first composite data measured at the first reference time during the day and / or an average mental index of the composite data measured on the corresponding day.
[0459] Returning again, in the embodiment, the user terminal (200) can provide mental healthcare program feedback (hereinafter, “feedback”) according to changes in the first mental indicator.
[0460] Here, feedback according to the embodiment may be performed based on at least one of the following methods: 1) changing the type of the provided mental healthcare program, 2) changing the frequency, 3) changing the required time, or 4) changing the difficulty level.
[0461] The reason why the user terminal (200) according to the embodiment provides feedback may be to promote improvement in the user's first mental indicator by providing a program more suitable for the user according to the user's characteristics analyzed based on long-term data accumulation, rather than a program previously provided.
[0462] To this end, in the embodiment, the user terminal (200) can analyze the accumulated nth composite data to check the change trend of the user's first mental indicator.
[0463] In an embodiment, if the change trend of the confirmed first mental indicator is an improvement trend, the user terminal (200) can reduce the frequency of the mental healthcare program, reduce the time required, or lower the difficulty level.
[0464] Conversely, in the embodiment, if the change trend of the confirmed first mental indicator is a worsening trend, the user terminal (200) can increase the frequency of the mental healthcare program, increase the time required, or increase the difficulty level.
[0465] Additionally, in the embodiment, the user terminal (200) can provide different mental healthcare programs according to mental indicators.
[0466] For example, for ADHD patients with low mental quotients on the concentration mental index, a concentration improvement program could be offered. Similarly, for those with high stress levels, those with extreme stress, a stress relief meditation program could be offered.
[0467] Accordingly, the user terminal (200) has the effect of enabling not only short-term but also long-term improvement of mental indicators through provision of a mental healthcare program and feedback on various mental indicators.
[0468] Above, the mental healthcare device having an electrode contact structure according to an embodiment of the present invention is combined with a band whose length can be adjusted, thereby improving aesthetics and wearing convenience by adjusting the band to fit the size of the user's head.
[0469] In addition, a mental healthcare device having an electrode contact structure according to an embodiment of the present invention has the effect of reducing the error rate due to changes in the measurement environment by simultaneously measuring and acquiring EEG data and PPG data.
[0470] In addition, a mental healthcare device having an electrode contact structure according to an embodiment of the present invention has the effect of minimizing the occurrence of noise due to movement of the electrode while increasing the accuracy of EEG data by having a structure for the EEG electrode to be in contact with the user's body.
[0471] Meanwhile, the method and system for deriving mental indicators based on composite data of EEG and PPG according to an embodiment of the present invention is based on a mental healthcare device mounted on the user's head, thereby simultaneously obtaining EEG data and PPG data with a single device without separately wearing a device for measuring brain waves (EEG) and a device for measuring pulse waves (PPG), and has the effect of greatly increasing physical and procedural efficiency by simplifying separate data transmission and reception procedures.
[0472] In addition, the method and system for deriving a mental index based on composite data of EEG and PPG according to an embodiment of the present invention corrects the basic mental index based on PPG data, thereby calculating the mental index not only with EEG data but also comprehensively considering PPG data, thereby improving the accuracy of the user's mental index.
[0473] In addition, the method and system for deriving mental indicators based on composite data of EEG and PPG according to an embodiment of the present invention has the effect of improving the utility of using a mental healthcare device and user satisfaction by deriving multiple mental indicators using only one composite data.
[0474] In addition, the method and system for deriving a mental index based on composite data of EEG and PPG according to an embodiment of the present invention have the effect of providing a program that immediately stabilizes the mental state of a user by identifying a long-term trend of changes in the user's sensing data for one mental index, and further, more accurately identifying the mental state of the user by considering the long-term mental changes of the user, and providing a more effective program in which feedback is applied to further improve the identified mental state of the user.
[0475] The embodiments of the present invention described above may be implemented in the form of program commands that can be executed through various computer components and recorded on a computer-readable recording medium. The computer-readable recording medium may include program commands, data files, data structures, etc., either singly or in combination. The program commands recorded on the computer-readable recording medium may be specially designed and configured for the present invention or may be known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specifically configured to store and execute program commands, such as ROMs, RAMs, and flash memories. Examples of program commands include not only machine language codes generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc. Hardware devices may be changed into one or more software modules to perform processing according to the present invention, and vice versa.
[0476] The specific implementations described in the present invention are exemplary embodiments and do not limit the scope of the present invention in any way. For the sake of brevity, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted. In addition, the lines connecting or connecting members between components illustrated in the drawings are merely representative of functional connections and / or physical or circuit connections, and may be replaced or represented as various additional functional connections, physical connections, or circuit connections in an actual device. In addition, unless specifically mentioned as “essential,” “important,” etc., a component may not be absolutely necessary for the application of the present invention.
[0477] Although the detailed description of the present invention has been described with reference to preferred embodiments of the present invention, it will be understood by those skilled in the art or having ordinary knowledge in the art that various modifications and changes can be made to the present invention without departing from the spirit and technical scope of the present invention as set forth in the claims below. Accordingly, the technical scope of the present invention should not be limited to the contents described in the detailed description of the specification, but should be defined by the claims.
[0478] The present invention has industrial applicability in that it provides a mental healthcare device that includes a structure capable of accurately measuring a user's brain waves by having an electrode contact structure combined with a length-adjustable band, and that simultaneously measures EEG data and PPG data to derive precise mental indicators for the user based on composite data of EEG and PPG.
[0479] In addition, the present invention has industrial applicability in that it provides a mental index with improved accuracy based on composite data including EEG data and PPG data by utilizing a healthcare device capable of simultaneously acquiring EEG data and PPG data, and provides a feedback service for further improving the mental state of a user by considering the long-term mental changes of the user by identifying a long-term trend of changes in the user's sensing data related to one mental index.
Claims
1. A housing including a first body part including an EEG sensor part and a PPG sensor part, a second body part connected to the first body part and having a first band hole formed at one end opposite the part connected to the first body part, a third body part connected to the first body part and having a second band hole formed at one end opposite the part connected to the first body part, and a processor for controlling the EEG sensor part and the PPG sensor part; and A band coupled to the first and second band holes and having an adjustable length; A mental scare device with an electrode contact structure.
2. In paragraph 1, The curvature of the first body part is formed to be greater than the curvatures of the second body part and the third body part, The above housing has an oval-shaped structure with one side open, with the long axis in the normal direction from the PPG sensor unit and the short axis in the left and right directions. A mental healthcare device with an electrode-contact structure.
3. In paragraph 1, The above PPG sensor part is arranged at the inner center of the first body part, The above brain wave sensor unit includes a first EEG electrode positioned on the left side and a second EEG electrode positioned on the right side based on the PPG sensor unit. A mental healthcare device with an electrode-contact structure.
4. In paragraph 3, The first EEG electrode and the second EEG electrode, Protrudes in the inner body direction by a predetermined length from the inner body surface of the first body part, Connected to the substrate and spring contained inside the above housing A mental healthcare device with an electrode-contact structure.
5. In paragraph 4, The first EEG electrode and the second EEG electrode, When worn by a user, the spring is elastic and is pressed toward the substrate included inside the housing of the first body part. The surfaces of the first EEG electrode and the second EEG electrode have a structure that is in close contact with the user's body. A mental healthcare device with an electrode-contact structure.
6. In paragraph 5, The surfaces of the first EEG electrode and the second EEG electrode are formed in a convex structure opposite to the inner body curvature of the first body portion. A mental healthcare device with an electrode-contact structure.
7. In paragraph 1, The above PPG sensor part, A light emitting part that outputs light, A glass part for passing the reflected light output from the above light emitting part, Including a light receiving unit that senses the reflected light A mental healthcare device with an electrode-contact structure.
8. In paragraph 7, The above glass part, When worn by a user, it is placed at a location corresponding to the center of the user's forehead. A mental healthcare device with an electrode-contact structure.
9. In paragraph 1, The second body part and the third body part are, When the above band is tightened according to the length adjustment, the first base electrode placed in the second body part and the second base electrode placed in the third body part are structured to rotate inward at a predetermined angle so as to be in close contact with the user's head. A mental healthcare device with an electrode-contact structure.
10. In paragraph 1, It further includes a noise detection sensor located inside the housing and connected to the brain wave sensor unit and the PPG sensor unit, The above processor, When noise is detected from the springs connected to the first and second EEG electrodes based on the noise detection sensor, the measurement of EEG data sensed by the brainwave sensor unit and PPG data sensed by the PPG sensor unit is stopped. A mental healthcare device with an electrode-contact structure.
Citation Information
Patent Citations
Apparatus for measuring photoplethysmogram and electroencephalogram
KR1020080046969A
Apparatus for Accuarcy Judgment of EEG Signal
KR1020140128042A
Apparatus for manufacturing tissue
KR102260334B1
EEG measuring device customizable for user's head
KR102332155B1
KR20220152700A
