Method, program, and device for acquiring user-customized neural network model for identifying biometric information

The method updates deep learning models with user-specific biometric data to improve prediction accuracy, addressing the variability in biometric information formats and characteristics, thereby enhancing medical diagnostics and reducing labor costs.

WO2024248501A1PCT designated stage expired Publication Date: 2024-12-05MEDICAL AI CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/007392
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-05-30
Filing Date
2024-05-30
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Pre-trained deep learning models in the medical field often produce varying results due to differences in biometric information formats and user-specific biological characteristics, necessitating a personalized approach to improve accuracy.

Method used

A method for obtaining a user-customized neural network model by updating the model based on new biometric data, including both non-invasive and invasive measurements, through continuous learning and data accumulation, allowing for personalized prediction of biometric information.

Benefits of technology

This approach enables more accurate biometric information prediction by reflecting user-specific characteristics, reducing the need for extensive human intervention and labor in patient management.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024007392_05122024_PF_FP_ABST
    Figure KR2024007392_05122024_PF_FP_ABST
Patent Text Reader

Abstract

A method for acquiring a user-customized neural network model for predicting biometric information about a user according to an embodiment of the present disclosure may comprise the steps of: acquiring a neural network model trained to predict second biometric information of a type different from that of first biometric information on the basis of the first biometric information; and, when new data about the user is acquired, updating the neural network model on the basis of the acquired new data so that the neural network model is personalized to the user, wherein the new data includes at least one of the first biometric information about the user or the second biometric information about the user.
Need to check novelty before this filing date? Find Prior Art

Description

Method, program and device for obtaining a user-customized neural network model for identifying biometric information

[0001] The present disclosure relates to deep learning technology in the medical field, and more specifically, to a method, program, and device for obtaining a user-customized neural network model that identifies biometric information.

[0002] Recent advancements in information and communication technology have led to the application of deep learning in various fields. In particular, deep learning is being utilized in various fields, particularly in the medical field, where diagnosis of patient illnesses traditionally relied on specialized and limited resources such as doctors and researchers. For example, users can input their biometric information into pre-trained deep learning models to analyze their health status or diagnose diseases in real time without visiting a specialized medical institution. Furthermore, interest in real-time patient monitoring using deep learning has grown as a means of reducing labor costs associated with patient care.

[0003] However, deep learning models used in the medical field are pre-trained based on pre-set learning data and provided to each user. Therefore, in real-world applications, they can sometimes yield different results for different users or subjects (e.g., patients). This is because even biometric information of the same type or condition can be acquired in different formats or values ​​for different users. This is partly due to the biological characteristics of each user. Therefore, even with the same deep learning model, there is a need for a method to personalize it for each user by reflecting their environment and characteristics.

[0004] The present disclosure is conceived in response to the aforementioned background technology, and aims to provide a method, program, and device for obtaining a user-customized neural network model for identifying biometric information.

[0005] However, the problems to be solved in this disclosure are not limited to the problems mentioned above, and other problems not mentioned can be clearly understood based on the description below.

[0006] In order to achieve the above-described task, a method for obtaining a user-customized neural network model for predicting biometric information of a user, performed by a computing device including at least one processor according to an embodiment of the present disclosure, comprises the steps of: obtaining a neural network model trained to predict second biometric information of a different type from the first biometric information based on the first biometric information; and, when new data about the user is obtained, updating the neural network model based on the obtained new data so that the neural network model is personalized for the user, wherein the new data includes at least one of the first biometric information about the user and the second biometric information about the user.

[0007] Alternatively, the updating step may include a step of continuously acquiring first biometric information about the user and a step of performing first learning on the neural network model based on the acquired first biometric information, thereby updating the neural network model.

[0008] Alternatively, the updating step may include a step of acquiring second biometric information about the user while continuously acquiring first biometric information about the user, and a step of updating the neural network model by performing second learning on the neural network model based on the acquired second biometric information and first biometric information corresponding to the acquired second biometric information among the continuously acquired first biometric information.

[0009] Alternatively, the step of updating the neural network model by performing second learning on the neural network model may include the step of performing the second learning on the neural network model based on the acquired second biometric information and the first biometric information corresponding to the acquired second biometric information, whenever the second biometric information is acquired.

[0010] Alternatively, the step of updating the neural network model by performing second learning on the neural network model includes, when the second biometric information is acquired, the step of adding the acquired second biometric information and the first biometric information corresponding to the acquired second biometric information to a data set accumulated and acquired at a previous time to update the data set, and the step of performing second learning on the neural network model based on the updated data set, wherein the data set may include at least one second biometric information accumulated and acquired at the previous time and at least one first biometric information corresponding to the at least one second biometric information matched.

[0011] Alternatively, the first biometric information corresponding to the second biometric information may be acquired within a preset time range based on the time at which the second biometric information was acquired.

[0012] Alternatively, the method may include a step of inputting the first biometric information corresponding to the acquired second biometric information into the neural network model to obtain predicted second biometric information, and comparing the acquired second biometric information with the predicted second biometric information to determine whether to update the neural network model.

[0013] Alternatively, the method may include the steps of identifying biological information of the user, clustering the user and a plurality of other users based on the identified biological information, and assigning a data set composed of the new data to each clustering.

[0014] Alternatively, the first learning may be a self-supervised learning method based on the first biometric information obtained above.

[0015] Alternatively, the second learning may be a supervised learning method based on the acquired second biometric information and the first biometric information corresponding to the acquired second biometric information.

[0016] Alternatively, the first biometric information may include biometric information obtained from the user based on a non-invasive measurement method, and the second biometric information may include biometric information obtained from the user based on an invasive measurement method or biometric information obtained by direct measurement by medical staff.

[0017] A method for diagnosing a disease of a user based on a user-tailored neural network model, performed by a computing device including at least one processor according to one embodiment of the present disclosure, includes the steps of: obtaining first biometric information; inputting the obtained first biometric information into a pre-trained neural network model to identify second biometric information of a different type from the first biometric information; wherein the pre-trained neural network model is updated based on new data regarding the user whenever new data regarding the user is obtained, and the new data includes at least one of the first biometric information regarding the user and the second biometric information regarding the user.

[0018] According to one embodiment of the present disclosure, a computer program stored in a computer-readable storage medium, wherein the computer program, when executed on one or more processors, causes the computer program to perform an operation of obtaining a user-customized neural network model for predicting biometric information of a user, the operation including an operation of obtaining a neural network model trained to predict second biometric information of a different type from the first biometric information based on the first biometric information, and an operation of updating the neural network model based on the obtained new data when new data about the user is obtained so that the neural network model is personalized for the user, wherein the new data includes at least one of the first biometric information about the user and the second biometric information about the user.

[0019] A computing device for obtaining a user-customized neural network model for predicting biometric information of a user according to an embodiment of the present disclosure, comprising: a memory including program codes; a network unit; a sensing unit for obtaining first biometric information of the user; and one or more processors for obtaining a neural network model learned to predict second biometric information of a different type from the first biometric information based on the first biometric information, and updating the neural network model based on the obtained new data when new data about the user is obtained through the sensing unit so that the neural network model is personalized for the user, wherein the new data includes at least one of the first biometric information about the user and the second biometric information about the user.

[0020] According to a method for obtaining a user-customized neural network model for identifying biometric information according to one embodiment of the present disclosure, a neural network model can be obtained that reflects the user's characteristics and identifies more accurate biometric information about the user. Furthermore, simply by obtaining the user's biometric information, the neural network model stored in the computing device can be personalized for the user.

[0021] FIG. 1 is an exemplary diagram of a device for obtaining a user-customized neural network model for predicting biometric information according to one embodiment of the present disclosure.

[0022] FIG. 2 is a block diagram of a computing device according to an embodiment of the present disclosure.

[0023] FIG. 3 is a flowchart schematically illustrating a method for obtaining a user-customized neural network model for predicting biometric information according to one embodiment of the present disclosure.

[0024] FIG. 4 is an exemplary diagram illustrating updating a neural network model based on first and second biometric information according to one embodiment of the present disclosure.

[0025] FIG. 5 is a flowchart illustrating updating a neural network model based on first and second biometric information according to an embodiment of the present disclosure.

[0026] FIG. 6 is an exemplary diagram illustrating updating a neural network model based on first biometric information and a plurality of second biometric information included in a data set according to one embodiment of the present disclosure.

[0027] FIG. 7 is a block diagram of a computing device according to another embodiment of the present disclosure.

[0028] Below, embodiments of the present disclosure are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. The embodiments presented in this disclosure are provided to enable those skilled in the art to utilize or implement the contents of the present disclosure. Accordingly, various modifications to the embodiments of the present disclosure will be apparent to those skilled in the art. That is, the present disclosure may be implemented in various different forms and is not limited to the embodiments described below.

[0029] Throughout the specification of this disclosure, identical or similar drawing numbers refer to identical or similar components. Furthermore, for the purpose of clearly describing the disclosure, drawing numbers for parts in the drawings that are not relevant to the description of the disclosure may be omitted.

[0030] The term "or" as used herein is intended to mean an inclusive "or" rather than an exclusive "or." That is, unless otherwise specified herein or clear from context, "X employs A or B" should be understood to mean either of the natural inclusive permutations. For example, unless otherwise specified herein or clear from context, "X employs A or B" can be interpreted to mean either X employs A, X employs B, or X employs both A and B.

[0031] The term "and / or" as used herein should be understood to refer to and include all possible combinations of one or more of the related concepts listed.

[0032] The terms "comprises" and / or "comprising" as used herein should be understood to mean the presence of certain features and / or components. However, it should be understood that the terms "comprises" and / or "comprising" do not exclude the presence or addition of one or more other features, other components, and / or combinations thereof.

[0033] Unless otherwise specified in this disclosure or unless the context makes it clear that the singular form is intended to be referred to, the singular should generally be construed to include “one or more.”

[0034] The term "Nth (N is a natural number)" used in this disclosure can be understood as an expression used to mutually distinguish components of this disclosure based on a predetermined standard such as a functional perspective, a structural perspective, or convenience of explanation. For example, components performing different functional roles in this disclosure can be distinguished as a first component or a second component. However, components that are substantially the same within the technical spirit of this disclosure but must be distinguished for convenience of explanation may also be distinguished as a first component or a second component.

[0035] The term "acquisition" as used in this disclosure may be understood to mean not only receiving data through a wired or wireless communication network with an external device or system, but also generating data in an on-device form.

[0036] Meanwhile, the term "module" or "unit" used in the present disclosure can be understood as a term referring to an independent functional unit that processes computing resources, such as a computer-related entity, firmware, software or a part thereof, hardware or a part thereof, or a combination of software and hardware. At this time, the "module" or "unit" may be a unit composed of a single element, or a unit expressed as a combination or set of multiple elements. For example, as a narrow concept, a "module" or "unit" may refer to a hardware element of a computing device or a set thereof, an application program that performs a specific function of software, a processing process implemented through software execution, or a set of instructions for program execution, etc. In addition, as a broad concept, a "module" or "unit" may refer to the computing device itself that constitutes the system, or an application running on the computing device, etc. However, since the above-described concept is only an example, the concept of “module” or “part” may be defined in various ways within a range understandable to those skilled in the art based on the contents of the present disclosure.

[0037] The term "model" as used herein may be understood as a system implemented using mathematical concepts and language to solve a specific problem, a set of software units to solve a specific problem, or an abstract model of a processing process to solve a specific problem. For example, a neural network "model" may refer to the entire system implemented as a neural network that has problem-solving capabilities through learning. In this case, the neural network can have problem-solving capabilities by optimizing the parameters connecting nodes or neurons through learning. A neural network "model" may include a single neural network or a set of neural networks that are a combination of multiple neural networks.

[0038] The term "data" used in this disclosure may include "images," signals, and the like. The term "image" used in this disclosure may refer to multidimensional data composed of discrete image elements. In other words, "image" may be understood as a term referring to a digital representation of an object visible to the human eye. For example, "image" may refer to multidimensional data composed of elements corresponding to pixels in a two-dimensional image. "Image" may refer to multidimensional data composed of elements corresponding to voxels in a three-dimensional image.

[0039] The explanation of the above terms is intended to aid understanding of the present disclosure. Therefore, unless explicitly stated as limiting the contents of the present disclosure, it should be noted that the above terms are not intended to limit the technical ideas of the present disclosure.

[0040] FIG. 1 is an exemplary diagram of a device for obtaining a user-customized neural network model (10) for predicting bio-information according to one embodiment of the present disclosure.

[0041] A computing device (100) according to an embodiment of the present disclosure may be a hardware device or a part of a hardware device that performs comprehensive processing and calculation of data, or may be a software-based computing environment connected to a communication network. For example, the computing device (100) may be a server that performs intensive data processing functions and shares resources, or may be a client that shares resources through interaction with a server. In addition, the computing device (100) may be a cloud system in which multiple servers and clients interact to comprehensively process data. Since the above description is only one example related to the type of computing device (100), the type of computing device (100) may be configured in various ways within a range understandable to those skilled in the art based on the contents of the present disclosure.

[0042] Referring to FIG. 1, a computing device (100) according to an embodiment of the present disclosure may be implemented as a biosignal measuring device that measures bioinformation of a user (1) (e.g., a patient, etc.). However, the present invention is not limited thereto, and the computing device (100) may be implemented as various electronic devices such as a desktop, laptop, smartphone, server device, smart watch, smart band, smart ring, etc.

[0043] Meanwhile, a pre-learned neural network model (10) may be stored in the computing device (100). The neural network model (10) may be a model pre-learned to predict the user's (1) condition, symptoms, diseases, biometric information, etc. In particular, the neural network model (10) may be pre-learned according to the type, purpose of use, etc. of the computing device (100).

[0044] According to one embodiment of the present disclosure, a neural network model (10) may be pre-trained to predict other bio-information of a user (1) based on bio-information acquired from the user (1) by a computing device (100). Here, the bio-information may include bio-signals acquired for the user (1) (e.g., electrocardiogram (ECG), electroencephalogram (EEG), photoplethysmogram (PPG), disease type (e.g., heart failure, etc.) and disease probability, measurements (e.g., body temperature, blood pressure (particularly, arterial blood pressure (ABP), central venous pressure (CVP)), left ventricular ejection fraction (EF), etc.).

[0045] Hereinafter, for the convenience of explanation of the present disclosure, biometric information directly acquired by a computing device (100) and input into a neural network model (10) is referred to as first biometric information. In addition, biometric information predicted by a neural network model (10) using the first biometric information as input data is referred to as second biometric information.

[0046] The first biometric information and the second biometric information may be different types of biometric information. In particular, according to one embodiment of the present disclosure, the first biometric information may include biometric information obtained from the user (1) based on a non-invasive measurement method. In particular, the first biometric information may be biometric information obtained in real time from the user (1). For example, the first biometric information may include an electrocardiogram signal, an electroencephalogram signal, a photoapplication pulse wave, etc. On the other hand, the second biometric information may include biometric information obtained from the user (1) based on an invasive measurement method or biometric information obtained by direct measurement by a medical professional. For example, the second biometric information may include body temperature, blood pressure (e.g., arterial blood pressure, central venous blood pressure, etc.), left ventricular ejection fraction, etc.

[0047] That is, the neural network model (10) can be trained to predict second biometric information obtained based on a non-invasive method that requires intervention by a medical professional or is generally difficult to measure, using first biometric information obtained based on a non-invasive method that can be easily measured from the user (1). Through this, the second biometric information of the user (1) can be monitored and the condition of the user (1) can be examined in real time only by using the computing device (100) without the intervention of a professional such as a doctor or nurse. In particular, since real-time monitoring of the second biometric information of a patient requiring continuous management is possible, the effect of reducing the manpower of nurses required for patient management can be exerted.

[0048] Meanwhile, the neural network model can be implemented as a multi-layer perceptron (MLP), a convolutional neural network (CNN), a recurrent neural network (RNN), a generative adversarial network, etc. In particular, the neural network model can include a plurality of residual blocks that extract latent features of the input first biometric information and a classifier that classifies second biometric information or a specific disease based on the extracted latent features.

[0049] Meanwhile, the computing device (100) may be manufactured in a state in which a neural network model (10) is stored. Alternatively, the computing device (100) may obtain the neural network model (10) from an external computing device (e.g., a server device, etc.) that is linked to the computing device (100). At this time, the computing device (100) may update the neural network model (10) stored in the computing device (100) to suit the user (1). Specifically, the neural network model (10) obtained by the computing device (100) may be a model that has been previously trained based on a preset training data set. At this time, the computing device (100) may retrain the neural network model based on new data obtained from the user (1) and update it to suit the user (1).

[0050] Here, updating the neural network model (10) may be to calibrate the neural network model (10) to suit the user based on the biometric information acquired by the computing device (100). For example, the computing device (100) may perform a learning process for fine-tuning the neural network model (10) based on the acquired biometric information.

[0051] For example, referring to FIG. 1, if the neural network model (10) is a model learned to predict second biometric information based on first biometric information, the computing device (100) can retrain and update the neural network model (10) based on the first biometric information acquired from the user (1). More specifically, if the first biometric information is an electrocardiogram signal and the second biometric information is blood pressure, when the computing device (100) acquires the electrocardiogram signal of the user (1), the computing device (100) can input the electrocardiogram signal into the neural network model (10) to predict the blood pressure of the user (1), and can also train the neural network model (10) based on the acquired electrocardiogram signal to update the neural network model (10) to suit the user (1). By repeating this process, the computing device (100) can acquire a personalized neural network model (10) (i.e., a user-customized neural network model (10)) that more accurately predicts the second biometric information of the user (1) based on the first biometric information of the user (1).

[0052] Meanwhile, referring to FIG. 1, the computing device (100) may also acquire second biometric information. The acquired second biometric information is information acquired by directly measuring the user (1), and is distinct from the second biometric information predicted by inputting the first biometric information into the neural network model (1). The second biometric information may be acquired directly by the computing device (100), or may be acquired from an external computing device (200) (e.g., an external biometric signal measuring device) and transmitted to the computing device (100). In this case, the computing device (100) may update the neural network model (10) based on the acquired second biometric information and the first biometric information acquired by directly measuring the user (1) by the computing device (100). In particular, since the acquired second biometric information may be labeled learning data, the computing device (100) may update the neural network model (10) to more accurately predict the second biometric information for the user (1) by using the first and second biometric information.

[0053] That is, according to one embodiment of the present disclosure, the learning method when only the first biometric information is acquired and the learning method when the second biometric information is acquired together with the first biometric information may be different.

[0054] Hereinafter, an embodiment of the present disclosure will be described in detail with reference to FIGS. 2 to 6.

[0055] FIG. 2 is a block diagram of a computing device (100) according to one embodiment of the present disclosure.

[0056] Referring to FIG. 2, a computing device (100) according to an embodiment of the present disclosure may include one or more processors (hereinafter, “processors”) (110), a memory (120), a network unit (130), and a sensing unit (140). However, FIG. 1 is merely an example, and thus the computing device (100) may further include other components for implementing a computing environment. In addition, only some of the disclosed components may be included in the computing device (100).

[0057] A processor (110) according to an embodiment of the present disclosure may be understood as a configuration unit including hardware and / or software for performing computing operations. For example, the processor (110) may read a computer program to perform data processing for machine learning. The processor (110) may process computational processes such as processing input data for machine learning, feature extraction for machine learning, and error calculation based on backpropagation. The processor (110) for performing such data processing may include a central processing unit (CPU), a general purpose graphics processing unit (GPGPU), a tensor processing unit (TPU), an application specific integrated circuit (ASIC), or a field programmable gate array (FPGA). The above-described type of processor (110) is only one example, and thus, the type of processor (110) may be configured in various ways within a range understandable to those skilled in the art based on the contents of the present disclosure.

[0058] The processor (110) is electrically connected to other components of the computing device (100) (i.e., memory (120), network unit (130), and sensing unit (140)) and controls the overall operation of the computing device (100).

[0059] The memory (120) according to one embodiment of the present disclosure may be understood as a configuration unit including hardware and / or software for storing and managing data processed in the computing device (100). That is, the memory (120) may store any type of data generated or determined by the processor (110) and any type of data received by the network unit (130). For example, the memory (120) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory, a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk. In addition, the memory (120) may also include a database system that controls and manages data in a predetermined system. The type of memory (120) described above is only one example, and thus the type of memory (120) can be configured in various ways within a range understandable to those skilled in the art based on the contents of the present disclosure.

[0060] The memory (120) can structure and organize and manage data, combinations of data, and program codes executable by the processor (110) required for the processor (110) to perform operations. For example, the memory (120) can store a neural network model (10) trained to predict second biometric information based on first biometric information. In addition, the memory (120) can store program codes that operate the neural network model (10) to perform learning based on the acquired first and second biometric information, program codes that operate the neural network model (10) to receive the first and second biometric information and perform inference according to the purpose of use of the computing device (100), and processed data generated as the program codes are executed.

[0061] The network unit (130) according to one embodiment of the present disclosure may be understood as a component that transmits and receives data through any type of known wired or wireless communication system. For example, the network unit (130) may perform data transmission and reception using a wired or wireless communication system such as a local area network (LAN), wideband code division multiple access (WCDMA), long term evolution (LTE), wireless broadband internet (WiBro), fifth generation mobile communication (5G), ultrawide-band, ZigBee, radio frequency (RF) communication, wireless LAN, wireless fidelity, near field communication (NFC), or Bluetooth. Since the above-described communication systems are only examples, the wired and wireless communication system for data transmission and reception of the network unit (130) may be applied in various ways other than the above-described examples.

[0062] The network unit (130) can receive data necessary for the processor (110) to perform calculations through wired or wireless communication with any system or any client, etc. In addition, the network unit (130) can transmit data generated through the calculations of the processor (110) through wired or wireless communication with any system or any client, etc. For example, the network unit (130) can receive medical data through communication with a cloud server that performs tasks such as databases in a hospital environment, standardization of medical data, or a computing device, etc. The network unit (130) can transmit output data of the neural network model (10), and intermediate data, processed data, etc. derived from the calculation process of the processor (110) through communication with the aforementioned database, server, or computing device, etc. As an example, the processor (110) can obtain a neural network model (10) trained to predict second biometric information based on first biometric information from an external computing device (e.g., an external server device) through the network unit (130). Additionally, the processor (110) can obtain second biometric information of the user (1) from an external computing device (e.g., another biometric signal measuring device) through the network unit (130).

[0063] The sensing unit (140) can obtain first biometric information about the user (1). In particular, the sensing unit (140) can obtain the first biometric information about the user (1) based on a non-invasive method. That is, according to one embodiment of the present disclosure, the first biometric information may be biometric information measured based on a non-invasive method. For example, the sensing unit (140) may include a plurality of electrodes. In this case, the processor (110) may obtain an electrocardiogram signal of the user (1) as the first biometric information through at least one electrode. In addition, the sensing unit (140) may include an image sensor or an optical sensor. In this case, the processor (110) may obtain a photoplethysmographic blood flow signal of the user (1) as the first biometric information through the image sensor (or optical sensor). In addition, the sensing unit (140) may further include a sensing module for second biometric information that can be obtained by a medical professional directly measuring the second biometric information. For example, the sensing unit (140) may further include a blood pressure monitor, a thermometer, etc.

[0064] FIG. 3 is a flowchart schematically illustrating a method for obtaining a user-customized neural network model (10) for predicting bio-information according to one embodiment of the present disclosure.

[0065] Referring to FIG. 3, first, the processor (110) obtains a neural network model learned to predict second biometric information of a different type from the first biometric information based on the first biometric information (S310).

[0066] Specifically, the processor (110) can obtain a neural network model (10) stored in a memory (120). At this time, the neural network model (10) can be stored in the memory (120) at the time of manufacturing the computing device (100).

[0067] In addition, a plurality of neural network models (10) may be stored in the memory (120) of the computing device (100). Specifically, a plurality of neural network models (10) corresponding to a plurality of users (1) (e.g., patients, etc.) may be stored in advance in the memory (120), and at this time, the processor (110) may select and acquire a neural network model (10) corresponding to the user (1) among the plurality of neural network models (10) based on the identification information (e.g., name, resident registration number, etc.) (or biological information) of the user (1). For example, when the computing device (100) is a biosignal measuring device installed in a specialized medical institution, a plurality of neural network models (10) corresponding to a plurality of patients who have visited the specialized medical institution may be stored in the computing device (100), and each neural network model (10) may be repeatedly updated according to an embodiment of the present disclosure, which will be described later, based on the first and second biosignals acquired for each patient, and may be stored in the memory (120).

[0068] Meanwhile, the neural network model (10) may be trained to predict a plurality of second bio-information based on the first bio-information. Specifically, the first bio-information may be an electrocardiogram signal, and the plurality of second bio-information may be blood pressure (the second-first bio-information) and left ventricular ejection fraction (the second-second bio-information). In this case, the neural network model (10) may extract specific information corresponding to blood pressure (the second-first bio-information) from the first bio-information and predict the blood pressure (the second-first bio-information), and may extract specific information corresponding to left ventricular ejection fraction (the second-second bio-information) and predict the left ventricular ejection fraction (the second-second bio-information). At this time, the neural network model (10) may include a plurality of residual blocks that extract potential features of blood pressure (2-1 biometric information) and left ventricular ejection fraction (2-2 biometric information), and a plurality of classifiers that classify blood pressure (2-1 biometric information) and left ventricular ejection fraction (2-2 biometric information) based on the extracted potential features.

[0069] In addition, a plurality of neural network models (10) corresponding to a plurality of first bio-information may be stored in the memory (120) of the computing device (100). Specifically, a plurality of neural network models (10) corresponding to each of the first bio-information and second bio-information predicted to match each of the first bio-information may be stored in the memory (120). For example, a neural network model (first neural network model) that predicts the left ventricular ejection fraction of the user (1) as the second bio-information based on the electrocardiogram signal as the first bio-information and a neural network model (second neural network model) that predicts the blood pressure of the user (1) as the second bio-information based on the photoapoptotic pulse wave as the first bio-information may be stored. At this time, the processor (110) may manually select and acquire a specific neural network model (i.e., a neural network model corresponding to the first bio-information) from the plurality of neural network models according to the type of the first bio-information that the computing device (100) measures (or is set to measure) in real time.

[0070] Meanwhile, the processor (110) may also obtain a neural network model (10) from an external computing device (e.g., a server device, etc.) that is interconnected with the computing device (100) via the network unit (130). Here, the external computing device may be a server device that is interconnected with the computing device (100) and monitors the health status of the user (1) of the computing device (100). Alternatively, the external computing device may be a biosignal measuring device that measures second bioinformation of the user (1).

[0071] And, when new data about the user is acquired, the processor (110) can update the neural network model based on the acquired new data so that the neural network model is personalized for the user (S320).

[0072] Here, the new data may include at least one of the first biometric information of the user (1) and the second biometric information of the user (1) acquired by the processor (110) through the sensing unit (140). The first and second biometric information included in the new data are distinguished from the first and second biometric information included in the learning data set used to train the neural network model (10) in advance in that they are acquired by directly measuring the user.

[0073] According to one embodiment of the present disclosure, the processor (110) can continuously acquire first biometric information about a user (1). Then, the processor (110) can perform first learning on the neural network model (10) based on the acquired first biometric information, thereby updating the neural network model. The process of updating the neural network model can be performed in parallel with the process of predicting second biometric information based on the first biometric information continuously acquired by the processor (110). That is, when the first biometric information is continuously acquired, the processor (110) can input the continuously acquired first biometric information into the neural network model (10), predict second biometric information, and provide the predicted second biometric information to the user (1). In addition, the processor (110) can update the neural network model (1) using the first biometric information continuously acquired in parallel and the second biometric information predicted through the first biometric information (and a loss function, a backpropagation algorithm, etc.).

[0074] Specifically, the processor (110) can continuously obtain first biometric information about the user (1) through the sensing unit (140). For example, the processor (110) can set a plurality of sample points (e.g., 125 points or 250 points) for a preset time (e.g., 1 second) and repeatedly obtain first biometric information about the user (1) for each of the plurality of sample points. When the first biometric information is an electrocardiogram signal, the processor (110) can obtain the electrocardiogram signal by measuring it at a sampling rate of 500 Hz for 10 seconds through the sensing unit (140). At this time, the processor (110) can process the electrocardiogram signal by removing a 1-second region where the electrocardiogram signal starts and a last 1-second region where the electrocardiogram signal ends in order to remove noise or artifacts included in the electrocardiogram signal.

[0075] In addition, the processor (110) continuously acquires the first biometric information of the user (1) through the sensing unit (140), and the processor (110) can acquire a plurality of pieces of first biometric information by dividing the continuous first biometric information based on the set sample points.

[0076] Additionally, the processor (110) may periodically acquire first biometric information from an external computing device. For example, if the computing device (100) is implemented as a server device, the processor (110) may continuously receive first biometric information acquired from an external biometric signal measuring device that measures the first biometric information by coming into contact with the body of the user (1). In this case, the processor (110) may receive the first biometric information from the external biometric signal measuring device through the network unit (130).

[0077] When first biometric information is acquired, the processor (110) can perform first learning on the neural network model (10) based on the acquired first biometric information of the user (1), thereby updating the neural network model (10). That is, the processor (110) can correct the previously learned neural network model (10) to suit the user (1) based on the first biometric information.

[0078] For example, when the processor (110) periodically acquires first biometric information, the processor (110) may perform first learning on the neural network model (10) with the acquired first biometric information each time the processor (110) acquires the first biometric information. That is, the first learning may be performed on the neural network model in accordance with the cycle in which the first biometric information is acquired.

[0079] According to one embodiment of the present disclosure, the first learning may be a self-supervised learning method based on the acquired first biometric information. Specifically, the processor (110) may extract latent features from the acquired first biometric information, assign a virtual label to the first biometric information based on the extracted latent features, and then train the neural network model (10) based on the first biometric information to which the virtual label has been assigned. For example, the processor (110) may preprocess the first biometric information to obtain converted first biometric information, input the first biometric information and the converted first biometric information into a pre-trained neural network model (10), obtain a plurality of second biometric information predicted based on the extracted latent features for each of the first biometric information and the converted first biometric information, and train the neural network model (10) in a direction that minimizes the loss between the acquired second biometric information based on a loss function. At this time, the loss function may use a contrastive loss or an info NCE loss function. The processor (110) can adjust the parameters of the pre-learned neural network model (10) through a backpropagation algorithm.

[0080] FIG. 4 is an exemplary diagram illustrating updating a neural network model (10) based on first and second biometric information according to an embodiment of the present disclosure. FIG. 5 is a flowchart illustrating updating a neural network model based on first and second biometric information according to an embodiment of the present disclosure.

[0081] Meanwhile, according to one embodiment of the present disclosure, the processor (110) may acquire second biometric information about the user (1) while continuously acquiring first biometric information about the user (1). Then, the processor (110) may perform second learning on the neural network model (10) based on the acquired second biometric information and the first biometric information corresponding to the acquired second biometric information among the continuously acquired first biometric information, thereby updating the neural network model.

[0082] The processor (110) may acquire second biometric information about the user (1) while continuously acquiring first biometric information. The acquired second biometric information may be information measured from the user (1). This is distinguished from second biometric information predicted by inputting the first biometric information into the neural network model (1). While continuously acquiring the first biometric information, the processor (110) may receive second biometric information from an external computing device via the network unit (130). Alternatively, the processor (110) may also receive second biometric information via a user interface.

[0083] Here, the second biometric information may include biometric information obtained from the user (1) based on an invasive measurement method or biometric information obtained through direct measurement by medical staff. As this has been described in FIG. 1, a detailed description thereof will be omitted.

[0084] Meanwhile, when second biometric information is acquired, the processor (110) may perform second learning on the neural network model (10) based on the acquired second biometric information to update the neural network model (10). Specifically, the processor (110) may correct the pre-learned neural network model (10) to suit the user (1) based on the second biometric information and the first biometric information corresponding to the second biometric information. Here, the first biometric information corresponding to the second biometric information may be acquired within a preset time range based on the time at which the second biometric information is acquired. When the second biometric information is acquired, the processor (110) may identify the first biometric information acquired through the sensing unit (140) (or acquired within a preset time range based on the time at which the second biometric information is acquired) at the time at which the second biometric information is acquired (more specifically, the time at which the second biometric information is acquired by an external computing device), and perform second learning on the neural network model (10) using the first and second biometric information.

[0085] According to one embodiment of the present disclosure, the second learning may be a supervised learning method based on the acquired second biometric information and the acquired first biometric information corresponding to the acquired second biometric information. Specifically, the processor (110) may set the first biometric information corresponding to the second biometric information as input data and the second biometric information as a label, and train the neural network model (10) on the relationship between the first and second biometric information. For example, the processor (110) may input the first biometric information into the pre-trained neural network model (10), obtain the predicted second biometric information based on the potential features extracted for the first biometric information, and train the neural network model (10) in a direction that minimizes the loss between the acquired second biometric information measured and the predicted second biometric information based on a loss function. At this time, the loss function may use a contrastive loss or an info NCE loss function. The processor (110) can adjust the parameters of the pre-learned neural network model (10) through a backpropagation algorithm.

[0086] Meanwhile, referring to FIG. 4, for example, the first learning may be performed using the first biometric information acquired each time the first biometric information is acquired, and the second learning may be performed using the second biometric information and the first biometric information corresponding to the second biometric information each time the second biometric information is acquired. At this time, when the second biometric information is acquired, the processor (110) may not perform the first learning for the neural network model (10), but may only perform the second learning. This is to increase the accuracy of the neural network model (10) by not using the same first biometric information for different learning (first and second learning), but only using it for the second learning that enables more accurate correction of the neural network model (10). However, the present invention is not limited thereto.

[0087] Meanwhile, referring to FIG. 5, the processor (110) may perform the first learning and second learning processes in parallel as the first and second biometric information are acquired. Meanwhile, referring to FIG. 5, the processor (110) may perform the first learning and second learning processes in parallel as the first and second biometric information are acquired (S521 and S523), respectively (S522 and S524).

[0088] The processor (110) can perform first learning on a neural network model using the first biometric information of the user (1) obtained periodically based on the first to third equations below, and can perform second learning on the neural network model using the second biometric information obtained. Specifically, the processor (110) can update the neural network model based on the gradient descent method according to the equations 1 to 3 below. At this time, the processor (110) can train the neural network model using data of a time step of t with a batch size of 1.

[0089] [Formula 1]

[0090]

[0091] [Formula 2]

[0092]

[0093] [Formula 3]

[0094]

[0095] Here, can be a parameter of the neural network model at time t. is the first biometric information acquired from t, may be the second biometric information obtained from t. And, L is the overall loss function of the neural network model, is the supervised learning loss function, can be a self-supervised learning loss function. is the cross-entropy loss of the second biometric information predicted by the first biometric information acquired at t and the second biometric information actually acquired at t. ) is defined as, silver The result of embedding and input data It can be defined as a loss function that minimizes the Euclidean distance between them.

[0096] FIG. 6 is an exemplary diagram showing updating a neural network model based on first biometric information and a plurality of second biometric information included in a data set (20) according to one embodiment of the present disclosure.

[0097] Meanwhile, when second biometric information is acquired according to an embodiment of the present disclosure, the processor (110) may add the acquired second biometric information and the first biometric information corresponding to the acquired second biometric information to a data set (20) accumulated and acquired at a previous time, and perform second learning on the neural network model based on the data set (20), thereby updating the neural network model. At this time, the data set (20) may include at least one second biometric information accumulated and acquired at a previous time and first biometric information corresponding to at least one second biometric information in a matched manner.

[0098] Specifically, referring to FIG. 6, when second biometric information is newly acquired, the processor (110) may identify the first biometric information acquired at the time when the second biometric information is acquired, and add the second biometric information and the first biometric information to a data set (20) that was accumulated and acquired at a previous time. Here, the data set (20) may include a plurality of second biometric information accumulated and acquired before the time when the second biometric information is newly acquired and a plurality of first biometric information corresponding to the plurality of second biometric information, respectively. That is, when second biometric information is acquired, the processor (110) may update the data set (20) with the acquired second biometric information and the first biometric information corresponding to the acquired second biometric information. In addition, the processor (110) may perform second learning on the neural network model (10) based on the data set (20) to update the neural network model (10).

[0099] At this time, the processor (110) may perform first learning on the neural network model using the first biometric information of the user (1) periodically acquired based on the fourth to seventh equations below, and may perform second learning on the neural network model using the data set (20) including the plurality of acquired second biometric information. Specifically, the processor (110) may update the neural network model based on the gradient descent method according to the following equations 4 to 7.

[0100] [Formula 4]

[0101]

[0102] [Formula 5]

[0103]

[0104] [Formula 6]

[0105]

[0106] [Formula 7]

[0107]

[0108] Here, can be a parameter of the neural network model at time t. is the first biometric information acquired from t, may be the second biometric information obtained from t. And, L is the overall loss function of the neural network model, is the supervised learning loss function, can be a self-supervised learning loss function. is the cross-entropy loss of the second biometric information predicted by the first biometric information acquired at t and the second biometric information actually acquired at t. ) is defined as, silver The result of embedding and input data It can be defined as a loss function that minimizes the Euclidean distance between them. may be a data set (20).

[0109] Meanwhile, the processor (110) may identify biological information of the user (1) and share a data set (20) related to second biometric information with another computing device (100) of another user (1) having biological information similar to the identified biological information. Here, the biological information may include the height, weight, age, gender, etc. of the user (1). For example, when the computing device (100) is a smart watch, the processor (110) may obtain biological information of the other user (1) from information of another smart watch of the other user (1). The processor (110) may identify a similarity between the biological information of a plurality of other users (1) and the biological information of the user (1), and may identify another computing device (100) of another user (1) having biological information similar to the biological information of the user (1) based on the identified similarity. And, the processor (110) can share the data set (20) related to the second biometric information by transferring the acquired data set (20) to the identified computing device (100). Alternatively, the processor (110) can also receive the data set (20) related to the second biometric information of the other user (1) from the computing device (100) of the other user (1) having similar biological information to the biological information of the user (1). In particular, in the case of the second biometric information, it is acquired intermittently as it is measured non-invasively or by medical staff, and the amount of data may be small. Therefore, in the case of multiple users (1) having similar biological information, the neural network model (10) can be updated to more quickly reflect the characteristics of the user (1) by sharing the acquired data set (20) related to the second biometric information.

[0110] For example, a server device that is linked to a computing device (100) may obtain biological information of a user (1) from the computing device (100) and transmit a neural network model (10) corresponding to the obtained biological information to the computing device (100). Specifically, the server device may store a plurality of neural network models (10) corresponding to a plurality of users (1). In particular, each neural network model (10) may correspond to a user (1) group including a plurality of users (1) having similar biological information. Accordingly, when the server device receives biological information of a user (1) from the computing device (100), the server device may select biological information similar to the received biological information and transmit a neural network model (10) corresponding to the selected biological information to the computing device (100). At this time, the server device may also include the user (1) of the computing device (100) in the user (1) group corresponding to the selected biological information. The server device can share second biometric information (or a data set (20) set based on the second biometric information) obtained from each computing device (100) with multiple users (1) included in the same user (1) group.

[0111] According to one embodiment of the present disclosure, the processor (110) can identify biological information of a user (1), cluster the user (1) and a plurality of other users (1) based on the identified biological information, and allocate a data set (20) composed of new data to each clustering group. Specifically, the processor (110) can obtain biological information of a plurality of users (1) from a plurality of user (1) terminal devices that are linked to the computing device (100). At this time, the processor (110) can cluster the plurality of users (1) based on the biological information of the plurality of users (1). In addition, the processor (110) can set a data set (20) for each clustering group using a second bio-signal obtained from a user (1) terminal device included in each clustering group. That is, when the second bio-signal is obtained from each of the plurality of user (1) terminal devices included in a specific clustering group, the processor can collect the obtained plurality of bio-signals, set a data set (20) for the specific clustering group, and allocate the data set (20) to the specific clustering group. At this time, the computing device (100) may be implemented as a server device or the like that manages the health status of multiple users (1).

[0112] According to one embodiment of the present disclosure, the processor (110) may input the periodically acquired first biometric information of the user (1) into the neural network model (10) to acquire second biometric information about the user (1). This may be performed through the first learning process described above. In addition, the processor (110) may periodically monitor the trend of the acquired second biometric information, and if it is detected that the trend of the second biometric information has changed, it may perform second learning on the neural network model (10) based on the acquired second biometric information to update the neural network model (10). That is, if it is detected that the trend or tendency of the second biometric information has changed, the processor (110) may determine to perform an update on the neural network model (10) based on the second biometric information. For example, if the processor (110) determines that the similarity between the trend of the second biometric information of the previous cycle and the trend of the second biometric information of the current cycle is less than a preset value, the processor (110) may determine that the trend of the second biometric information has changed and perform second learning on the neural network model (10) using the second biometric information.

[0113] According to one embodiment of the present disclosure, when first biometric information is acquired, the processor (110) may input the acquired first biometric information into a pre-trained neural network model (10), predict second biometric information, and output the predicted second biometric information. For example, the processor (110) may output the predicted second biometric information through a display or output interface of the computing device (100). This may be performed in parallel with the first learning process, or may be performed after the first learning process based on the acquired first biometric information is completed.

[0114] According to one embodiment of the present disclosure, when second biometric information is acquired, the processor (110) may input first biometric information corresponding to the second biometric information into a neural network model (10) to acquire predicted second biometric information as output data. In addition, the processor (110) may compare the predicted second biometric information with the acquired second biometric information to identify an error. At this time, if the error between the second biometric information acquired as output data and the second biometric information acquired from another computing device (100) is less than a preset value, the processor (110) may decide to stop the second learning. This is to determine that the personalization process of the neural network model (10) for the user (1) is completed, and to save resources of the computing device (100) required for learning.

[0115] FIG. 7 is a block diagram of a computing device (400) according to another embodiment of the present disclosure.

[0116] Referring to FIG. 7, a computing device (400) according to an embodiment of the present disclosure includes a processor (410), a memory (420), a network unit (430), a sensing unit (440), a display (450), a user interface (460), a camera (470), and a speaker (480). Among the configurations illustrated in FIG. 7, the processor (410), the memory (420), the network unit (430), and the sensing unit (440) correspond to the configurations of the processor (110), the memory (120), the network unit (130), and the sensing unit (140) of the computing device (100) illustrated in FIG. 2, and thus a detailed description thereof will be omitted.

[0117] The display (450) can display various images. Here, the images include both still images and moving images. The display (450) can output guide information regarding activities generated based on the user (1) status. The display (450) can be implemented as various types of displays, such as an LCD (Liquid Crystal Display Panel), an OLED (Organic Light Emitting Diodes), an LCoS (Liquid Crystal on Silicon), a DLP (Digital Light Processing), etc. In addition, the display (450) can also include a driving circuit, a backlight unit, etc., which can be implemented in a form such as an a-si TFT, an LTPS (low temperature poly silicon) TFT, an OTFT (organic TFT), etc.

[0118] Meanwhile, the display (450) may be implemented as a touch screen by being combined with a touch panel, and in this case, the display (450) may perform the function of not only an output interface that outputs an image through the touch screen, but also an input interface that receives a touch input from a user (1).

[0119] The user interface (460) is a configuration used by the computing device (100) to perform interaction with the user (1), and may include at least one of a touch sensor, a motion sensor, a button, a jog dial, and a switch, but is not limited thereto. The processor (410) can receive second biometric information and biological information (occupation, age, gender, etc.) of the user (1) through the user interface (460).

[0120] The camera (470) captures an image of an object around the user (1) and obtains an image of the object. Specifically, the camera (470) can capture an image of food consumed by the user (1). At this time, the processor (410) can determine the nutritional status of the user (1) based on the state of the user (1) and the image of the food consumed by the user (1) and provide recommended diet information as guide information. To this end, the camera (470) can be implemented with an imaging device such as an imaging device having a CMOS structure (CIS, CMOS Image Sensor) or an imaging device (Charge Coupled Device) having a CCD structure. However, the present invention is not limited thereto, and the camera (470) can be implemented with a camera module having various resolutions capable of capturing an object. Meanwhile, the camera (470) can be implemented with a depth camera (for example, an IR depth camera, etc.), a stereo camera, an RGB camera, etc.

[0121] The speaker (480) is a component that outputs various audio data on which various processing operations such as decoding, amplification, and noise filtering have been performed by an audio processing unit (not shown). The speaker (480) can output various notification sounds or voice messages. According to one embodiment of the present disclosure, the processor (410) can convert an electrical signal received from an external device into a user's (1) voice and output it through the speaker (480). For example, the speaker (480) can output a voice message warning of or suggesting a diagnosis of a disease related to second biometric information identified through a neural network model (10).

[0122] The various embodiments of the present disclosure described above can be combined with additional embodiments and modified within the scope understood by those skilled in the art in light of the detailed description above. It should be understood that the embodiments of the present disclosure are illustrative in all respects and not restrictive. For example, each component described as a single component may be implemented in a distributed manner, and likewise, components described as distributed may be implemented in a combined manner. Accordingly, all changes or modifications derived from the meaning, scope, and equivalent concepts of the claims of the present disclosure should be construed as being included within the scope of the present disclosure.

Claims

1. A method for obtaining a user-customized neural network model for predicting user biometric information, the method being performed by a computing device including at least one processor, A step of obtaining a neural network model trained to predict second biometric information of a different type from the first biometric information based on the first biometric information; and When new data about the user is acquired, a step of updating the neural network model based on the acquired new data so that the neural network model is personalized for the user; Including, The new data includes at least one of first biometric information about the user and second biometric information about the user. method.

2. In paragraph 1, The above updating steps are: A step of continuously acquiring first biometric information about the user; and A step of updating the neural network model by performing first learning on the neural network model based on the first biometric information obtained above; including, method.

3. In paragraph 1, The above updating steps are: A step of acquiring second biometric information about the user while continuously acquiring first biometric information about the user; and A step of updating the neural network model by performing second learning on the neural network model based on the acquired second biometric information and the first biometric information corresponding to the acquired second biometric information among the continuously acquired first biometric information; including, method.

4. In paragraph 3, The step of updating the neural network model by performing a second learning on the neural network model is as follows: A step of performing the second learning for the neural network model based on the acquired second biometric information and the first biometric information corresponding to the acquired second biometric information, whenever the second biometric information is acquired; including, method.

5. In paragraph 3, The step of updating the neural network model by performing a second learning on the neural network model is as follows: When the second biometric information is acquired, a step of updating the data set by adding the acquired second biometric information and the first biometric information corresponding to the acquired second biometric information to the acquired data set by accumulating them at a previous point in time; and A step of performing second learning for the neural network model based on the updated data set; Including, The above data set is, At least one second biometric information accumulated and acquired at the previous point in time is matched and included with at least one first biometric information corresponding to the at least one second biometric information. method.

6. In paragraph 3, The first biometric information corresponding to the second biometric information is acquired within a preset time range based on the time at which the second biometric information is acquired. method.

7. In paragraph 3, A step of inputting the first biometric information corresponding to the acquired second biometric information into the neural network model to obtain predicted second biometric information, and comparing the acquired second biometric information with the predicted second biometric information to determine whether to stop the update process of the neural network model; including, method.

8. In paragraph 1, A step of identifying biological information of the user, clustering the user and a plurality of other users based on the identified biological information, and allocating a data set composed of the new data to each clustering; including, method.

9. In paragraph 2, The above first learning is, A self-supervised learning method based on the first biometric information obtained above, method.

10. In paragraph 3, The second learning above is, A supervised learning method based on the acquired second biometric information and the first biometric information corresponding to the acquired second biometric information, method.

11. In paragraph 1, The above first biometric information is, Contains biometric information obtained from the user based on a non-invasive measurement method, The above second biometric information is, Including biometric information obtained from the user based on an invasive measurement method or biometric information obtained by direct measurement by medical staff, method.

12. A method for diagnosing a user's disease based on a user-customized neural network model, performed by a computing device including at least one processor, Step of obtaining first biometric information; and A step of inputting the acquired first biometric information into a pre-trained neural network model to identify second biometric information of a different type from the first biometric information; The above-mentioned pre-trained neural network model is, Whenever new data about the above user is obtained, it is updated based on the new data, The new data includes at least one of first biometric information about the user and second biometric information about the user. method.

13. A computer program stored in a computer-readable storage medium, wherein the computer program, when executed on one or more processors, performs an operation of obtaining a user-customized neural network model that predicts the user's biometric information. The above action is, An operation of obtaining a neural network model trained to predict second biometric information of a different type from the first biometric information based on the first biometric information; and When new data about the user is acquired, an operation of updating the neural network model based on the acquired new data so that the neural network model is personalized for the user; Including, The new data includes at least one of first biometric information about the user and second biometric information about the user. Computer program.

14. A computing device that obtains a user-customized neural network model that predicts the user's biometric information, Memory containing program codes; network unit; A sensing unit that obtains the user's first biometric information; and A neural network model is acquired based on first biometric information and trained to predict second biometric information of a different type from the first biometric information, and when new data about a user is acquired through the sensing unit, at least one processor is included to update the neural network model based on the acquired new data so that the neural network model is personalized for the user. The new data includes at least one of first biometric information about the user and second biometric information about the user. Computing device.

Citation Information

Patent Citations

  • Method for real time analyzing stress using deep neural network algorithm

    KR102043376B1

  • Multi-member bluetooth device capable of dynamically switching operation mode

    KR102326925B1

  • Apparatus and method for providing care service

    KR102414769B1

  • System and Method for Personalized Blood Glucose Control

    KR102464709B1

  • Method, system, and program for creating health level positioning map and health function, and method for using these

    US20220044817A1