Method, system and computer program for detecting heart health status
By placing an IMU on the user body, measuring six-dimensional signals and calculating cardiac dynamics parameters in combination with device characteristics, the problem of inaccurate IMU measurement in the prior art is solved, and a high-accurate heart health status detection is achieved.
Patent Information
- Application Number
- CN202380043985.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-03-29
- Filing Date
- 2023-03-14
- Publication Date
- 2025-01-10
AI Technical Summary
The existing cardiac monitoring technology has inaccurate IMU measurements outside the user's centroid, resulting in limited comparability and accuracy of heart health status detection.
By placing an IMU on the device, measuring the six-dimensional signal, including acceleration and angular velocity in linear and rotational dimensions, combining the mass and moment of inertia of the device, the kinetic parameters of the heart are calculated, independent of the ECG signal, and the cardiac health status is determined using the ML engine.
It improves the accuracy and robustness of heart health status detection, can achieve good cardiac status detection on standard smartphones, reduces dependence on IMU direction, and enhances the robustness of the detection.
Smart Images

Figure CN119301698A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a method, system and computer program for detecting a user's heart health status, preferably a method, system and computer program for detecting congestive heart failure (CHF). Prior art
[0002] The health of a human heart is crucial to their health. Early detection of heart problems can avoid serious complications of human health. These problems can be CHF, coronary artery disease, atrial fibrillation, hypertension, etc. Traditionally, heart monitoring is done with an electrocardiogram (ECG). Some heart monitoring technologies are based on ballistocardiography (BCG) or shockcardiography (SCG). SCG is usually measured on a person's chest. BCG can be measured in many different ways. While many SCG or BCG only measure or use one or a few dimensions, WO201736887 proposes to base heart monitoring on a combination of ECG and BCG measured at the center of gravity of the body, and eventually combined with SCG. It is proposed to use multidimensional BCG and SCG measurements, measuring three linear dimensions with accelerometers to obtain the linear kinetic energy of heart motion, and three rotational dimensions with gyroscopes to obtain the rotational kinetic energy of heart motion. The kinetic energy is calculated based on the moment of inertia and the mass of the user. This calibrates the BCG and SCG measurements and makes them comparable for different users. While this calibration works well for the BCG at the user's center of mass, it does not work properly for IMU measurements placed outside the user's center of mass like the SCG at the user's chest. Summary of the invention
[0003] The object of the present invention is to provide a method, system and computer program for detecting the heart health status of a user, which overcomes the problems of the prior art.
[0004] According to the invention, this object is solved by a method, a system and a computer program according to the independent claims.
[0005] According to the present invention, the purpose is solved by a system for detecting the heart health status of a user, the system comprising: a device and a processing device; the device comprises an IMU, wherein the IMU is configured to measure a measurement signal when the device is placed on the user's body; the processing device is configured to determine the characteristics of the device, determine the heart health status of the user based on the measurement signal and based on the characteristics of the device, and output information based on the determined health status.
[0006] According to the present invention, the object is solved by a method for detecting the heart health status of a user, the method comprising the following steps: when the device is placed on the user's body, receiving a measurement signal from an IMU included in the device in a processing device; determining the characteristics of the device in the processing device; in the processing device, determining the heart health status based on the received measurement signal and based on the characteristics of the device.
[0007] The inventors have found that calibration of the measurement signal based on characteristics of the device works much better than calibration based on the user, especially when the device is not placed at the center of mass of the user.
[0008] The dependent claims relate to further advantageous embodiments.
[0009] In one embodiment, the characteristic of the device is related to the weight and / or size of the device.
[0010] In one embodiment, the characteristic of the device includes the mass of the device and / or the moment of inertia of the device.
[0011] The weight and / or dimensions, in particular the mass / moment of inertia, allow the determination of calibrated dynamic parameters of the heart.
[0012] In one embodiment, the processing device is configured to calculate at least one feature based on the measurement signal and based on a characteristic of the device, wherein the processing device is configured to determine the health state based on the calculated at least one feature.
[0013] In one embodiment, the at least one characteristic calculated includes or is based on at least one of cardiac force or torque, cardiac energy, cardiac work, and cardiac power.
[0014] In one embodiment, the at least one characteristic calculated includes or is based on at least one of cardiac torque, cardiac rotational kinetic energy, cardiac rotational work, and cardiac rotational power.
[0015] In one embodiment, at least one characteristic is calculated based on a mass of the device and / or a moment of inertia of the device.
[0016] In one embodiment, the processing means is configured to determine the type of device and determine the characteristics of the device based on the determined device type. This allows obtaining the correct characteristics of the device for calibration even when the system is implemented in software and / or when the system is used with different types of devices having different characteristics.
[0017] In one embodiment, the device is a smartphone or a wearable device, wherein the type of the device is the type of smartphone or the type of wearable device.
[0018] In one embodiment, the wearable device is connected to a smartphone.
[0019] In one embodiment, the type of device is received from user input.
[0020] In one embodiment, the type of device is received from an operating system running on a smartphone or wearable device.
[0021] In one embodiment, the system comprises a server, wherein the application runs on a processor of a smartphone, wherein the application is configured to connect to the server, wherein the processor of the smartphone and / or the processor of the server operates as a processing device.
[0022] In one embodiment, the processing device includes a ML engine configured to determine a heart health state.
[0023] In one embodiment, the IMU is arranged in a smartphone or a wearable device connected to the smartphone, wherein the measurement signal comprises a six-dimensional signal having three linear dimensions representing the linear acceleration of the heart measured by the accelerometer of the IMU and three rotational dimensions representing the angular velocity of the heart measured by the gyroscope of the IMU, wherein a heartbeat cycle of the user's heart is identified based on the measurement signal, wherein a plurality of sub-cycles in the heartbeat cycle are determined, wherein a plurality of features comprises linear features and rotational features, wherein the linear features comprise the value of at least one linear feature variable of the heart motion in each sub-cycle calculated based on the three linear dimensions of the measurement signal, wherein the rotational features comprise the value of at least one rotational feature variable of the heart motion in each sub-cycle calculated based on the three rotational dimensions of the measurement signal. The combination of ML, six-dimensional IMU measurement by smartphone, ECG independence and robustness of rotational and linear parameters with respect to the orientation of the smartphone allows good heart state detection using a standard smartphone, simply by running software on the smartphone, and measuring the six-dimensional measurement signal with the IMU of the smartphone. Even if this combination of features is particularly effective, several features may be used alone or in other sub-combinations. Preferably, the plurality of features are determined independently of the ECG measurements.However, it is also possible to determine the plurality of features based on additional ECG measurements.
[0024] In one embodiment, the measurement signal comprises a six-dimensional signal, wherein three linear dimensions represent the linear acceleration of the heart measured by an accelerometer of the IMU, and three rotational dimensions represent the angular velocity of the heart measured by a gyroscope of the IMU, wherein a heartbeat cycle of the user's heart is identified based on the measurement signal, wherein a plurality of sub-cycles in the heartbeat cycle are determined, wherein a plurality of features comprise linear features and rotational features, wherein the linear features comprise the value of at least one linear feature variable of the heart motion in each sub-cycle calculated based on the three linear dimensions of the measurement signal, wherein the rotational features comprise the value of at least one rotational feature variable of the heart motion in each sub-cycle calculated based on the three rotational dimensions of the measurement signal. Having a combined / scalar linear value and a combined / scalar rotational value allows to eliminate the dependency of the measurement signal on the orientation of the IMU. The dependency of the measured components on the orientation of the IMU indicates an increased error rate in the determination of the health state.
[0025] In one embodiment, the plurality of features include values of a linear feature variable at different times in a heartbeat and values of a second feature variable at different times in a heartbeat, wherein the first feature variable is determined based on three linear dimensions, and wherein the second feature variable is determined based on three rotational dimensions. Having combined / scalar linear values and combined / scalar rotational values allows for elimination of dependency of the measured signal on the orientation of the IMU. Dependence of measured components on the orientation of the IMU has been shown to increase the error rate of health state determination.
[0026] In one embodiment, the (at least one) linear characteristic variable is one or more of the following: linear (cardiac) power, linear (cardiac) kinetic energy, and linear (cardiac) work. In one embodiment, the (at least one) rotational characteristic variable is one or more of the following: rotational (cardiac) power, rotational (cardiac) kinetic energy, and rotational (cardiac) work. These kinetic parameters are independent of the orientation of the sensor and have been shown to be very robust in detecting cardiac health states.
[0027] In one embodiment, the measurement signal includes a six-dimensional signal having three linear dimensions representing the linear acceleration of the heart measured by an accelerometer of the IMU, and three rotational dimensions representing the angular velocity of the heart measured by a gyroscope of the IMU, wherein a heartbeat cycle of the user's heart is identified, wherein multiple sub-cycles in the heartbeat cycle are determined, wherein multiple features include linear features and rotational features, wherein the linear features include values of linear kinetic energy of the heart motion in each sub-cycle calculated based on the three linear dimensions of the measurement signal, and wherein the rotational features include values of rotational kinetic energy of the heart motion in each sub-cycle calculated based on the three rotational dimensions of the measurement signal.
[0028] In one embodiment, the measurement signal comprises a six-dimensional signal having three linear dimensions representing the linear acceleration of the heart measured by the accelerometer of the IMU, and three rotational dimensions representing the angular velocity of the heart measured by the gyroscope of the IMU. The inventors have found that measurement signals in all six dimensions bring significantly better results, because information cannot be hidden in some unmeasured dimensions. Prior art usually measures only certain dimensions, or at least only considers certain dimensions for analysis.
[0029] In one embodiment, a linear velocity signal is calculated based on three linear dimensions, and the plurality of features include at least one linear feature calculated based on the linear velocity signal; and / or a rotational acceleration signal is calculated based on three rotational dimensions, and the plurality of features include at least one rotational feature calculated based on the rotational acceleration signal. It has been found that dynamic features based on linear velocity and / or based on rotational acceleration that are not directly measured contain a lot of valuable information that cannot be obtained from the measured signals. Features that use these features to determine the state of health have proven to be more robust than features that use only the signal characteristics of the signals measured in the IMU. In particular, the linear kinetic energy calculated from the linear velocity signal is of particular interest as a feature for determining the state of health.
[0030] In one embodiment, the method comprises the step of determining in the processing device a velocity signal based on the measurement signal, the velocity signal being representative of the velocity of the cardiodynamic movement, wherein the processing device determines a plurality of features based on the velocity signal.
[0031] In one embodiment, the processing device determines from the velocity signal a processed velocity signal representing the velocity squared of the cardiac dynamic motion or the kinetic energy of the cardiac motion, wherein the processing device determines a plurality of features based on the processed velocity signal.
[0032] In one embodiment, the plurality of features comprises values of at least one feature variable at different times in a heartbeat.
[0033] In one embodiment, a heartbeat cycle of a user's heart is identified, wherein a plurality of sub-cycles in the heartbeat cycle are determined, wherein a plurality of features include the value of at least one feature variable in each determined sub-cycle. The definition of sub-cycles based (only) on measurement signals from an IMU (and not on an ECG) allows such segmentation to be created also in the absence of an ECG signal. This allows the feature extraction to be performed also in a simple smartphone.
[0034] In one embodiment, a reference point in a heartbeat cycle is determined, and a sub-cycle is defined based on the reference point and based on a fixed time width of the sub-cycle. Instead of calculating the time width (or start and end) of the sub-cycle for each heartbeat, the time width of each sub-cycle is selected to be fixed (from one heartbeat to another heartbeat), so it can be easily and reliably determined relative to the reference point. The use of a fixed time width of a sub-cycle allows a simple, robust and repeatable calculation of the sub-cycle, and therefore allows a repeatable and robust calculation of the value of the characteristic variable of the sub-cycle. Preferably, the fixed time width is defined independently of a physiological parameter or a time point (e.g., certain peaks in the signal, or the end or beginning of the systolic or diastolic phase). If only one physiological parameter is not correctly detected, the sub-cycle defined based on the physiological parameter is computationally complex and prone to error. The fixed time width is preferably an absolute fixed time width or a relative fixed time width. The absolute fixed time width has an absolute value of the time width that does not change from one heartbeat to another heartbeat. The relatively fixed time width has a relative value (percentage value) with respect to, for example, the length of a heartbeat cycle, and the relative value does not change from one heartbeat cycle to another.
[0035] In one embodiment, a heartbeat cycle in the measured signal is identified based on a matrix profile motif algorithm applied to the signal based on the measured signal, wherein the matrix profile motif algorithm identifies one or more reference heartbeat cycles as motifs in the signal based on the matrix profile. It is difficult to detect heartbeats in IMU signals without measuring ECG signals. The use of matrix profiles allows robust detection of heartbeat cycles at low computational cost.
[0036] In one embodiment, breathing information of the user is detected based on the measurement signal.
[0037] In one embodiment, the multiple features include the user's breathing information. Since the heartbeat depends largely on the user's breathing phase / state, it was found that this feature as an input to health state determination can significantly improve the health state results. This is especially true when the breathing information is combined with multiple feature variables related to the linear and rotational motion of the heart in different sub-cycles. This allows the ML engine to distinguish between different movements of the heart in different breathing states, thus avoiding erroneous conclusions due to differences in the user's breathing state.
[0038] In one embodiment, multiple features are determined independently of the ECG measurement. This allows the method to be implemented in any common smartphone with an IMU.
[0039] In one embodiment, the health status determines whether the heart exhibits congestive heart failure.
[0040] In one embodiment, the method includes the steps of placing the IMU on the chest of the user and measuring the measurement signal with the IMU when placed on the chest of the user.
[0041] In one embodiment, the user lies down while a smartphone including an IMU is placed on the user's chest. Although the prior art mainly proposes sleeves or fixtures for fixing the measuring device to the chest or other parts of the body, the inventors have found that measuring the IMU signal while lying down has several advantages for the measurement quality. The user does not move, so the movement caused by the user's movement does not interfere with the measurement. The user relaxes when lying down, and the measurement signal is always measured in a relaxed state, which produces a more repeatable signal. Finally, the sleeve that fixes the device with the IMU suppresses movement, thereby reducing the signal quality. Other embodiments according to the invention are mentioned in the attached claims and the subsequent description of the embodiments of the invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] Figure 1 An embodiment of a system for detecting a user's heart health status according to the present invention is shown.
[0043] Figure 2 An embodiment of a method for detecting a user's heart health status according to the present invention is shown.
[0044] Figure 3 An exemplary embodiment of feature extraction is shown.
[0045] Figure 4 A first embodiment of the system is shown.
[0046] Figure 5 A second embodiment of the system is shown.
[0047] In the drawings, the same reference numerals are assigned to the same or similar elements.
[0048] Figure 6 Examples of measurement signals of a breathing signal and a pre-characteristic signal are shown.
[0049] Figure 7 An example illustration of some steps of feature extraction is shown. DETAILED DESCRIPTION
[0050] Other characteristics and advantages of the invention will emerge from the following non-limiting description, made with reference to the accompanying drawings and examples.
[0051] The system, method and computer program according to the present invention detect the cardiac health state (cardiac health state) of the user 10. The terms body and heart refer to the body and heart of the user 10 whose cardiac health state is detected. The user is usually a human being. However, the user can also be an animal, preferably a mammal. The user 10 is called a user, not a patient, because the system, method and computer program can be performed by anyone and does not require medical monitoring. Obviously, this does not exclude that medical personnel can also perform the system, method and computer program according to the present invention on the user 10 (in this case, the patient). The user 10 should always be the person whose cardiac health state needs to be detected. The person who controls the system, method and computer program according to the present invention is preferably the same user, but can also be another person.
[0052] Figure 1 An embodiment of a system for detecting a user's heart health status according to the present invention is shown. The system comprises a device 11 and a processing device 2 .
[0053] The device 11 includes an inertial measurement unit (IMU) 1. The IMU 1 is configured to measure a measurement signal of a heart motion. When the device is in contact with the body of the user 10, the IMU 1 is configured to measure the motion of the device 11 so that the measured motion indicates the motion of the user's heart. The measurement signal preferably includes at least six dimensions. The six dimensions include three translation dimensions (also called linear dimensions) and three rotation dimensions (also called angular dimensions). The IMU 1 typically includes an accelerometer for measuring heart motion acceleration (three linear dimensions) and a gyroscope for measuring angular velocity (three rotational dimensions). The IMU 1 includes an accelerometer and a gyroscope, which are usually in a common chip or device. However, the gyroscope and accelerometer can also be implemented as independent chips or devices and will still be considered as an IMU 1. The IMU 1 is preferably placed on the chest of the user 10 to measure the measurement signal, which is usually called SCG. Usually SCG refers only to three linear acceleration measurements, or even only to one linear and / or rotational dimension. However, in this article, SCG should refer to a six-dimensional measurement signal including three linear dimensions and three rotational dimensions. Usually, one, two or three of the three linear dimensions are called SCG, and one, two or three of the three rotational dimensions are called gyrocardiogram (GCG). For simplicity, the six-dimensional measurement signal with SCG and GCG is referred to as SCG in this article.
[0054] In a preferred embodiment, the IMU 1 is arranged in a smartphone 5, such as Figure 4As shown in the embodiment of the present invention, the device 11 is a smartphone 5. Therefore, the standard IMU 1 available in almost every smartphone 5 can be used to detect the cardiac measurement signals required by the present invention. No other sensors or additional sensors are required to perform cardiac measurements. However, the health status may obviously be based on additional sensor measurements, such as ECG signals. The term smartphone 5 should include tablets, wearable devices, or other mobile devices that can directly access the cellular phone network and / or the Internet through a SIM card (physical or virtual). Preferably, the smartphone 5 has a specific application software downloaded for implementing the functions of the present invention described below. However, it is also possible that the IMU 1 is not arranged in the smartphone 5, but in another device. For example, the IMU 1 can be arranged in a wearable device 7 as a device 11 worn on the user's body, such as a smart watch, a heart monitor fixed on the chest with a sleeve around the torso, or other wearable devices. Such a wearable device 7 can preferably be connected to the smartphone 5 via a wireless connection (e.g., a Bluetooth connection). For example, the IMU 1 can be arranged in a heart monitor that is fixed on the chest of the user 10 with a sleeve. The wearable device 7 is preferably connected to the smartphone 5. However, it is also possible that the wearable device 7 itself acts as a smartphone 5 directly accessing the Internet (no connected smartphone 5 is required).
[0055] It is also possible that the IMU 1 is arranged in a dedicated device 11 which is not associated with the smartphone 5 and / or is not connected to the Internet or any other device. In this case, the processing means 2 may be completely included in the dedicated device 11.
[0056] The smartphone 5 preferably comprises a smartphone processor, storage means, communication means, input means (preferably a touch screen) and output means (preferably a (touch) screen). The storage means of the smartphone 5 is configured to store application programs so that when the application programs are executed on the smartphone processor, specific functions are performed on the smartphone 5. Such application programs are also generally referred to as applications (apps). Figure 4 and Figure 5 The smartphone 5 in the embodiment of the present invention preferably includes an application (hereinafter referred to as a monitoring application) for executing or requesting at least some steps of the method of the present invention described later. The monitoring application is preferably installed on the smartphone 5, i.e. stored in a storage device of the smartphone 5. However, the term "monitoring application" should also refer to a front-end program that is downloaded each time a website is accessed using a browser of the smartphone. Preferably, the monitoring application is configured to request measurement of a measurement signal from the IMU 1 and to obtain the measurement signal from the IMU 1 (arranged in a manner similar to the IMU 1). Figure 4 in the same smartphone 5 or connect to Figure 5The IMU 1 of the smartphone 5 in the embodiment of the present invention receives the measurement signal. Preferably, the monitoring application is configured to communicate with the server 6. The communication device is configured to establish a communication connection to the server 6. The communication device may be a WLAN and / or cellular telephone network communication module. The cellular telephone network communication module preferably includes a user identification module (virtual user identification module (eSIM), SIM card or holder of such a SIM card) for receiving data required for communication with the cellular telephone network.
[0057] The processing device 2 is configured to perform all or at least some / most of the steps (S2 to S4) of the present invention described in more detail below.
[0058] The processing device 2 may be a single processor or may be a combination of multiple processors. For example, different processors may implement different steps. Preferably, the processing device 2 may include a local processor and a remote processor. The local processor may be arranged in a smartphone 5 (smartphone processor) and / or a wearable device 7 or the above-mentioned dedicated device. The remote processor may be arranged in a server 6 connected to the local processor (or a device including a local processor) via the Internet, for example. The remote processor should not be understood as only a physical processor, but anything that implements the functions of the remote processor or server 6, such as a server center or a cloud. The steps from S2 to S4 described below may all be implemented on a local processor, or all on a remote processor, or distributed on both. The local processor may be implemented by a processor of a wearable device 7 and / or a processor of a smartphone 5. Preferably, the processing device 2 includes a general-purpose processor (or multiple general-purpose processors), on which software is run to implement the functions of the method of the present invention described later. The software may implement all functions or only part of the functions. If there is a local processor, there is preferably local software running on the local processor, such as a monitoring application. If there is a remote processor, there is preferably remote software, such as a server or backend software, running on the remote processor.
[0059] Preferably, the remote processor (server 6) and the local processor (client 5, 7) work as a client server system, where some functions are implemented on the server 6 and some functions are implemented on the client 5, 7. In this case, the local software is the client software and the remote software is the server software. The client device 5, 7 or its client software is configured to authenticate the user by means of user credentials, and the configuration and / or results of the client software are stored on the server 6 associated with the user. The server 6 includes a user management for storing user credentials to authenticate the user in the client software and storing configuration and / or results and / or measurement signals associated with the user.
[0060] In an embodiment, the processing device 2 comprises a device designator 9 and a health status device 4. Preferably, the processing device 2 further comprises a feature extractor 3.
[0061] The device specifier 9 is configured to determine a characteristic C of the device 11. The device specifier 9 preferably implements step S2 described later. The device specifier 9 is preferably implemented in the local processor / smartphone 5, in particular when the device 11 corresponds to the smartphone 5 or a wearable device connected to the smartphone 5. However, the device specifier 9 may also be arranged in the remote processor / server 6 or in both. For example, the type of the device 11 may be determined via user input at the smartphone 5, the wearable device 7 or another client device (different from the device 11), and the determination of the characteristic C based on the user input may be done at the server 6. Preferably, the processing means 2 comprises a general purpose processor (or a plurality of general purpose processors) on which software is run to implement the functionality of the device specifier 9, such as a monitoring application and / or server software.
[0062] The feature extractor 3 is configured to implement step S3 described later to extract features from the measurement signal for use as input to the health status device 4. The feature extractor 3 may be implemented in a local processor / smartphone 5 or a remote processor / server 6 or both. Preferably, the processing device 2 comprises a general purpose processor (or multiple general purpose processors) on which software is run to implement the functionality of the feature extractor 3, such as a monitoring application and / or server software.
[0063] The health state device 4 is configured to implement step S4 described later. If the health state device 4 is implemented as an ML engine, the health state device 4 can be implemented on a general-purpose processor or a dedicated ML processor. The general-purpose processor can be the same processor as the one running the feature extractor 3. In this case, the health state device 4 is implemented as software. However, the health state device 4 can also be implemented on a dedicated chip or processor dedicated to ML applications. Such an ML dedicated chip will then be programmed for the present ML application as described below. The ML engine 4 is preferably arranged on a remote processor / server 6. However, it is also possible to have the ML engine 4 on a local processor / smartphone 5.
[0064] The system preferably also includes an output device for outputting output information based on the determined heart health state. The output device is preferably implemented in a client device (in the case of a client server system). The output device is preferably implemented in a smartphone 5 or a wearable device 7. The output device is, for example, a display or an audio output.
[0065] Figure 2 An embodiment of a method for detecting a user's heart health status according to the present invention is shown.
[0066] In a first step S1, a measurement signal is measured using a device 11 containing an IMU 1 placed on the body of a user 10. The measurement signal is preferably an SCG. The device 11 / IMU 1 is placed on the user's body so that the IMU 1 can detect the movement of the heart. Preferably, the IMU 1 is placed on the torso, preferably on the upper part of the torso and / or preferably on the chest side of the torso, most preferably on the chest of the user 10. Preferably, the user 10 lies down for the measurement and the device 11 with the IMU 1 (preferably in the form of a smartphone 5) is placed on the torso. Since the user 10 lies down, the smartphone 5 does not have to be fixed to the torso and can freely measure the movement generated by the heart. The sleeve or any other device for pushing the IMU 1 against the torso may inhibit the movement of the IMU 1. In addition, in this way, the user 10 is in a relaxed state and the measurement results are not tampered with by other body movements that may tamper with the measurement results. The user 10 can start the measurement by providing an input command to the monitoring application / smartphone 5 / IMU 1 and perform the measurement himself by placing the smartphone 5 / IMU 1 on his torso / chest (in any order). Therefore, the measurement can be performed with any ordinary smartphone 5 including an IMU 1. The user only needs to download a specific monitoring application (client software) on the smartphone 5. Preferably, the measurement lasts less than a maximum length, preferably less than 10 minutes, preferably less than 5 minutes, preferably less than 2 minutes, preferably less than 1 minute. Therefore, the user 10 can quickly implement the measurement steps. The measurement lasts preferably longer than a minimum length, which is preferably longer than one heartbeat, preferably longer than 1 second, preferably longer than 5 seconds, preferably longer than 10 seconds, preferably longer than 20 seconds. Therefore, the IMU 1 records the measurement signal SCG of a certain measurement window. The measurement window is preferably between the minimum length and the maximum length. However, other lengths are obviously possible. Since the IMU 1 / smartphone 5 is placed on the torso of the user 10, it moves with the movement of the heart or heartbeat. As described above, step S1 is also applicable to another device 11, such as a wearable device 7 or another dedicated device. If the wearable device 7 is fixed, preferably fixed on the chest, the measurement can also be performed during the user's activity. In this case, the measurement can also be performed as continuous monitoring, for example longer than 1 hour, preferably longer than 12 hours.
[0067] The measurement signal SCG therefore represents the heart movement in a measurement window of six dimensions (degrees of freedom). The measurement signal SCG is measured at a certain sampling rate. The sampling rate is preferably higher than 10 Hz, preferably higher than 25 Hz, preferably higher than 50 Hz, preferably higher than 60 Hz, preferably higher than 70 Hz, preferably higher than 80 Hz, preferably higher than 90 Hz, preferably higher than 100 Hz. Figure 6A six-dimensional measurement signal having three linear dimensions 17 and three rotational dimensions 18 is shown.
[0068] The processing device 2 or its computer program receives the described measurement signal SCG. The monitoring application / smartphone 5 / dedicated device preferably receives a user input to start measuring with the IMU 1. Once this user input is received, the monitoring application / smartphone 5 / dedicated device sends an instruction to the IMU 1 to start measuring the measurement signal SCG. The duration of the measurement is preferably predetermined or can be configured in the monitoring application. When the duration of the measurement has ended, the monitoring application / smartphone 5 / dedicated device preferably gives an indication that the measurement has ended, such as an audio signal.
[0069] In step S2, the processing device 2 determines a characteristic C of the device 11. The characteristic C of the device 11 is preferably related to the weight and / or size of the device 11. The characteristic C of the device 11 is preferably the mass and / or the moment of inertia I of the device 11. The moment of inertia I preferably includes the moment of inertia I in each direction of the coordinate system xx ,I yy ,I zz . However, for a 3×3 tensor I with nonzero elements on its off-diagonal elements, the moment of inertia can also be more complex. If the device 11 is sufficiently symmetric, the moment of inertia can also be a scalar value.
[0070] Preferably, the processing means 2 determines the type of the device 11 and determines the characteristic C based on the determined type of the device 11. The characteristic C may be stored, for example, in a database or a lookup table which stores a corresponding value of C for each type of device 11. For example, the type of the device 11 may be identified by a product type identifier such as a combination of the manufacturer and the product name (and, if necessary, the version number). For example, Apple iPhone Pro 13. The type of the device may be automatically retrieved from the device 11. For example, if the smartphone 5 is used directly as the device 11, the software running on the smartphone 5 may request the type of the smartphone 5 from the operating system running on the smartphone 5. If a wearable device 7 connected to the smartphone 5 is used, the software running on the smartphone 5 may request the type of the connected wearable device 7 from the operating system running on the smartphone 5 to obtain the type of the wearable device 7. It is also possible that the software running on the smartphone 5 directly requests what type of the wearable device 7 is. The type of the device 11 may also be determined by a user input selecting the type of the device 11. It is necessary to determine the characteristic C based on the type of the device 11, wherein the processing means 2 or the software of the present invention may be implemented with different devices 11. Step S2 does not have to be implemented at each measurement, but can be implemented once when setting up the system. For example, when the wearable device 7 is connected to the smartphone 5, or when the software is installed on the smartphone 5. Once the characteristic C is determined based on the type of device 11, the characteristic C is preferably stored in the processing means 2 associated with the system and can be used for each measurement as long as the configuration of the system does not change. If the device 11 is a dedicated device or always the same device, the step of determining the characteristic C based on the type of device 11 can be omitted, and step S2 is basically to read out the stored characteristic C when needed.
[0071] In step S3, the processing device 2 determines a plurality of features based on the measurement signal SCG and the characteristic C. These features are used as input features (also called feature vectors) in a next step S4, preferably to determine the health state by the ML engine 4. These features preferably include data features derived from the measurement signal SCG and subject features related to the user 10.
[0072] The subject characteristics are typically independent of the measurement signal SCG. The subject characteristics preferably include one or more of the age, sex, weight, height, body mass index (BMI), body surface area (BSA) of the user 10. The subject characteristics are preferably derived from input information, preferably from user input. The user input can be received, for example, at a monitoring application in the smartphone 5. However, the input information can also be stored in a database on the server 6 for use by the user and retrieved therefrom. For example, the information can be received from a parallel application that already has the information and allows transmission. BMI and BSA can be calculated based on the weight and height of the user 10. Even if the subject characteristics are preferably present in the characteristics of the ML engine 4, step S4 can be performed without the subject characteristics or with different subject characteristics.
[0073] In a preferred embodiment, the data features are (only) derived from the measurement signal SCG measured with the IMU 1. Preferably, the data features are derived only from the measurement signal SCG measured with the IMU 1, i.e. the IMU 1 is independent of other sensors arranged on the body, in particular independent of sensors not included in a standard smartphone, in particular independent of ECG measurements which usually require specific equipment. However, the invention can also be applied to more complex embodiments comprising ECG sensors and / or other sensors, such as a specific wearable device 7 having an IMU sensor 1 and an ECG sensor.
[0074] Figure 3 An embodiment is described in which data features are determined based on a measurement signal SCG (hereinafter referred to as SCG for short) and based on a characteristic C. The data features may be obtained for a complete measurement window of the SCG signal or only for a sub-window of the measurement window.
[0075] In step S31, the breathing information is retrieved from the SCG. Since breathing causes an increase and decrease in the volume of the trunk or chest / thoracic cavity, the SCG also reflects the breathing information. Preferably, a breathing signal is extracted from the SCG. This can be achieved by independent component analysis, a low-pass filter or other measures. The breathing signal is preferably determined based on a complete measurement window. The breathing information is preferably based on the breathing signal. Preferably, the breathing signal is discretized into multiple breathing states. The breathing state preferably includes at least four breathing states. The breathing state preferably includes two or more of the following: a high volume state (HV), a medium volume state during exhalation (MV-EX), a low volume state (LV) and a medium volume state during inspiration (MV-IN). There may also be more than four breathing states. The high volume state HV can be divided into two states (high volume HV-EX during exhalation and high volume LV-IN during inspiration) or three states (HV-EX, HV, HV-IN). This can also be done for the low volume state LV. Similarly, the medium volume state MV can be divided into smaller states. Thus, one respiratory cycle / period comprises a sequence of HV, a subsequent MV-EX, a subsequent LV and a subsequent MV-IN (or other complete sequence of respiratory states of a respiratory cycle / period). Discretization of the respiratory signal results in a respiratory state signal showing that the respiratory state changes over time (in the measurement window). Discretization of the respiratory signal can be performed only on the complete measurement window or only on the subwindow of interest. These features preferably include at least one respiratory information, preferably the respiratory state at at least one time point of the heartbeat. The respiratory signal / information can be determined from all six dimensions of the SCG, from subsets of the SCG dimensions or from one or more composite signals, each composite signal being determined from one or more (preferably different) subsets of the SCG signal. Figure 6 An example of a breathing signal 23 extracted from an example SCG is shown.
[0076] In step S32, preprocessing of the SCG signal is performed. This mainly includes removing noise, that is, removing signal components that are not related to cardiac motion. This can be achieved, for example, by a frequency filter (such as a high-pass filter or a low-pass filter or a band-pass filter). The preprocessing step preferably removes frequencies above 100 Hz, preferably above 80 Hz, preferably above 70 Hz, preferably above 60 Hz. The preprocessing step preferably removes frequencies below 1 Hz, preferably below 2 Hz, preferably below 3 Hz. Preferably, the preprocessing also removes any trends in the SCG. Preprocessing is a preferred step, but is not essential to the present invention. The respiratory signal / information is preferably determined based on the SCG before preprocessing or using a different preprocessing that excludes the removal of frequencies below the normal heart rate. Figure 6 shows a having three linear dimensions a x (t), a y(t), a z (t) and three rotation dimensions ωx(t), ω y (t),ω z (t) An example of a preprocessed six-dimensional SCG signal. Signal a x (t) shows the acceleration in the x direction, signal a y (t) shows the acceleration in the y direction, signal a z (t) shows the acceleration in the z direction. Signal ω x (t) shows the rotation speed around the x direction, signal ω y (t) shows the rotation speed around the y direction, signal ω z (t) shows the rotation speed around the z direction. The x direction, y direction and z direction refer to the three vertical dimensions of the Cartesian coordinate system of the IMU 1. Preferably, the coordinate system of the IMU 1 is aligned with the coordinate system of the user 10. The user's coordinate system preferably has a y direction in the direction from the user's feet to the head, an x direction in the direction from one arm to the other arm (preferably from the right arm to the left arm), and a z direction from the back of the torso to the chest. This alignment can be achieved by giving the user instructions on how to place the smartphone 5 on the body. For example, the instructions may display an arrow pointing to the head of the user 10. However, it is also possible that the arrangement of the IMU 1 relative to the user 10 is not known. In particular, when using the pre-features mentioned below, the correct positioning / orientation of the IMU 1 is not required because they are independent of the orientation of the device 11.
[0077] In step S33, at least one pre-characteristic signal is calculated based on the (preferably pre-processed) SCG signal and the characteristic C, which in this example is the mass or weight of the device 11 and the moment of inertia I of the device 11. In a preferred embodiment, based on the three linear dimensions a of the SCG x (t), a y (t), a z (t)(independent of the three rotation dimensions ω of the SCG x (t),ω y (t),ω z (t)) determines at least one (scalar) linear pre-signal and / or three rotational dimensions ω based on SCG x (t),ω y (t),ω z (t)(Independent of the three linear dimensions of SCG a x (t), a y (t), a z(t)) determine at least one (scalar) rotation pre-signature signal. The (linear and / or rotational) pre-signature preferably corresponds to a physical variable describing the heart motion, such as kinetic energy, kinetic power, work, force / torque, etc. The physical value describing the linear motion of the heart is, for example,
[0078]
[0079] Vector a is a three-dimensional vector describing the linear acceleration at each sampling time, m is the weight (mass) of the device including the IMU 1, and vector v is a three-dimensional vector describing the linear velocity of the heart at the sampling time. The arrows above the variables represent vectors. As shown in equation (1), the force vector F(t) at each sampling time t is obtained by multiplying the mass m by the acceleration vector a(t) at each sampling time t = (F x (t), F y (t), F z (t))=(ma x (t), ma y (t), ma z The acceleration vector a(t) corresponds to the acceleration vector a(t) measured by the IMU 1 (and preferably preprocessed in S32) = (a x (t), a y (t), a z (t)). Based on the mass multiplied by the square of the linear velocity v at sampling time t 2 (t) to calculate the linear kinetic energy K at sampling time t lin (t), as shown in equation (2). The square of the linear velocity v 2 (t) is preferably based on the velocity vector v at sampling time t = (v x (t), v y (t), v z The distance / length of the velocity vector is preferably the square root of the sum of the squares of the three linear components of the velocity sqrt That is, the Euclidean distance metric of the velocity vector v. However, other distance metrics can be used. Velocity vector v = (v x (t), v y (t), v z (t)) can be obtained by calculating the acceleration vector a(t)=(a(t)) from t0 (e.g. the start of the measurement signal) until sampling time t. x (t), a y (t), a z (t)) is integrated to obtain the linear velocity signal. Preferably, the linear velocity signal is calculated based on the linear acceleration vector signal (by integration). The linear velocity signal may be a signal having three linear velocity components (v x(t), v y (t), v z (t)) or the length of the linear velocity vector or a linear velocity vector signal of a function thereof. The linear velocity signal can be used to calculate a linear pre-characteristic signal and / or (data) feature, such as linear kinetic energy. The linear kinetic energy K lin (t) is distinguished from the signal energy often used in the prior art. For example, the signal energy of the SCG in the x direction is defined as the acceleration on the measured signal The sum of and the linear kinetic energy K of the heart at sampling time t lin (t) is irrelevant. The linear work of the heart during the period between t1 and t2 is W lin (t1, t2) is the force vector F(t) at time t and the path change vector d at time t s The linear kinetic power dP at sampling time t can be calculated by the scalar product of the velocity vector v(t) at sampling time t and the force vector F(t) at sampling time t: lin (t)(or P lin (t))P lin (t) = v x (t)F x (t)+v y (t)F y (t)+v z (t)F z (t). As is known, these physical variables can be obtained in different ways without departing from the invention.
[0080] Physical values describing the rotational motion of the heart are, for example,
[0081]
[0082] The vector α(t) is a 3D vector describing the rotation / angular acceleration at each sampling time, I is the moment of inertia of the device containing the IMU 1, and the vector ω(t) is the 3D vector of the rotation / angular velocity of the heart at sampling time t. More precisely, the moment of inertia I is a 3×3 tensor / matrix, and the rotational kinetic energy is calculated as 0.5ω(t)Iω(t) T The superscript T denotes the transpose of a vector. The moment of inertia tensor I can be simplified to the three principal moments of inertia I xx ,I yy ,I zz is the diagonal matrix of the diagonal, I xx ,I yy ,I zzMoments of inertia along the three principal axes of the coordinate system of the device containing the IMU 1, in the x-, y- and z-directions. The formula is written in the form of vectors and tensors, but can also be written in different forms without changing the protection range, for example, in the case of a tensor in diagonal form, such as K rot =0.5*(I xx *ω x (t) 2 +I yy *ω y (t) 2 +I zz *ω z (t) 2 ). If the device has the same moment of inertia in all three directions, the formula can be simplified to I being the scalar value of the moment of inertia. Obviously, the tensor can also be more complex, with non-diagonal elements not equal to zero. As shown in equation (5), the torque vector τ(t) at each sampling time t is obtained by multiplying the moment of inertia I by the rotational acceleration vector α(t) at the corresponding sampling time t. The angular acceleration vector α(t) corresponds to the first-order time derivative of the measured (and preferably preprocessed) angular velocity vector ω(t), where the vector α(t) = (d x ω(t) / dt, d y ω(t) / dt, d z ω(t) / dt). The angular / rotational acceleration signal is a signal in which the acceleration vector, one of its components, or a combination of its components (e.g., its length) changes with time. The rotational acceleration signal can be used to calculate the rotational pre-signature signal. The rotational kinetic energy K at sampling time t rot (t) is based on the moment of inertia (of the device containing the IMU 1) multiplied by the square of the rotational velocity at sampling time t, ω 2 (t) is calculated as shown in equation (6). The square of the rotation speed v 2 (t) is preferably based on the rotational velocity vector ω=(ω at sampling time t x (t),ω y (t),ω z The heart rotation work W in the time period between t1 and t2 is calculated as the square of the distance / length of the heart. rot (t1, t2) is the integral of the scalar product of the torque vector τ(t) at time t and the angle change vector dθ(t) at time t over the time t between t1 and t2 (see equation (3)). rot (t)(or P rot (t)) can be calculated by the scalar product of the angular velocity vector ω(t) at sampling time t and the linear force vector F(t) at sampling time t, P rot (t) = ω x(t)F x (t)+ω y (t)F y (t)+ω z (t)F z (t). As is known, these physical variables can be obtained in different ways without departing from the invention.
[0083] The measurement or preprocessing step S32 of the IMU 1 provides the following two measurement sub-signals: a three-dimensional linear acceleration vector signal a(t) and a three-dimensional angular velocity vector signal ω(t). Preferably, in step S33, at least one composite linear dynamic pre-signal signal is calculated based on the three-dimensional linear acceleration vector signal a(t) and / or at least one composite rotational dynamic pre-signal signal is calculated based on the three-dimensional rotational velocity vector signal ω(t). The at least one composite linear dynamic pre-signal signal is preferably a scalar value combining the three linear dimensions of the measurement signal into one scalar value, and / or the at least one composite rotational dynamic pre-signal signal is preferably a scalar value combining the three rotational dimensions of the measurement signal into one scalar value, so that when the measurement signal is measured, the composite value is independent of the direction of the IMU 1. The at least one composite linear pre-signal signal preferably includes a linear kinetic energy signal K lin (t) and / or linear dynamic power signal P lin (t). A composite linear pre-characteristic signal and / or linear kinetic energy signal K lin (t) is preferably calculated based on the linear velocity vector v(t). The at least one composite rotation pre-signature signal preferably includes a rotational kinetic energy signal K rot (t) and / or rotational power signal P rot (t). A composite linear pre-characteristic signal and / or a rotary power signal P rot (t) is preferably calculated based on the rotational acceleration vector α(t).
[0084] The movement of the heart is approximated in this article as the movement of the IMU 1. Therefore, the physical variables of the heart movement ultimately correspond to the (preferably preprocessed) movement of the IMU 1 or the device containing the IMU 1. The value / signal of the linear or rotational kinetic energy and the value of the linear or rotational kinetic power depend on the device in which the IMU 1 is arranged, for example, on its moment of inertia I and / or its mass m. If this is a dedicated device that is always the same, this is just a constant and will not play a big role. However, when using a smartphone 5 or other wearable device, the correct mass and / or moment of inertia must be retrieved to calculate the pre-characteristic signal, characteristic, lin / rot kinetic energy and / or lin / rot kinetic power. In this case, the processing device, preferably a monitoring application, retrieves the type of device including the IMU 1 from the operating system of the smartphone 5 or the wearable device. Based on the type of device 11, the mass and / or moment of inertia of the device 11 can be retrieved. Therefore, the device characteristics of measuring the heart movement are used to calibrate the kinetic energy and power, thereby avoiding erroneous results based on the use of different measuring devices. When the IMU 1 is located outside the center of mass of the user 10, this calibration based on the device 11 rather than the user works better. Subsequently, the term kinetic energy signal K(t) refers to the two-dimensional signal K(t)=(K lin (t), K rot (t)), which contains as a first dimension or component the linear kinetic energy signal K lin (t) and the rotational kinetic energy signal K as the second dimension or component rot (t), or refers to one of the two components alone. Subsequently, the term dynamic power signal P(t) refers to the two-dimensional signal P(t) = (P lin (t), P rot (t)), which contains as a first dimension or component the linear dynamic power signal P lin (t) and the rotational power signal P as the second dimension or component rot (t), or refers to one of the two components alone.
[0085] In step S34, at least one heartbeat is identified. Preferably, multiple heartbeats (e.g., all) are identified in the SCG. If multiple heartbeats have been identified, at least one heartbeat is selected for further analysis. A heartbeat is a time window associated with one heartbeat of the heart. A heartbeat is a periodic cardiac cycle of the heart. A heartbeat is usually defined relative to a characteristic point in the heartbeat (usually R or Q in the ECG signal). Because the present invention is preferably implemented without any ECG signal, at least one heartbeat is identified based on the SCG, preferably based on at least one pre-characteristic signal calculated in step S33, preferably based on a kinetic energy signal and / or a kinetic power signal, or a combination thereof. In a preferred embodiment, the (data) feature is calculated based on the SCG (or pre-characteristic signal) of one heartbeat (i.e., one cardiac cycle). This will also include the case where a representative heartbeat is calculated by averaging multiple heartbeats (preferably multiple heartbeats of the same respiratory state). In a preferred embodiment, the heart health state is determined based on multiple heartbeats by selecting multiple heartbeats and detecting the health state of each heartbeat in steps S34, S35, and S4. The composite heart health state can then be calculated by combining the heart health states from a single heartbeat. The prior art generally does not calculate feature vectors based on a single heartbeat, which reduces the robustness of the method. Some prior art documents propose to calculate feature vectors based on data from one heartbeat, but these methods always require ECG signals to detect heartbeats. This is one of the innovations of the present invention, that is, heartbeats can be identified from SCG (without using ECG signals). The heartbeat cycle is determined based on heartbeat characteristics in SCG and / or pre-feature signals (e.g., kinetic energy or power) obtained from SCG. Although the heartbeats in SCG and pre-feature signals lack such clear characteristics in ECG signals, robust detection of heartbeat cycles is difficult. A preferred embodiment for detecting heartbeats in SCG is subsequently described.
[0086] It is proposed to detect the heartbeat cycle in SCG (also in the pre-feature signal determined from SCG) based on a matrix profile. The matrix profile m(t1) of the signal s(t) at the sampling time t1 shows the distance from s(t1) to its nearest neighbor in the signal s(t) in the complete time window of the signal s(t). The distance is preferably the Euclidean distance metric, but other distance metrics can obviously also be used. The matrix profile m(t1) allows similar motifs to be found in the signal s(t). Since each person's heartbeat looks a little different, this allows repeated motifs of the heartbeat to be found in the signal used to determine the matrix profile m(t). Preferably, the matrix profile m(t) is calculated based on SCG (including calculating the matrix profile m(t) based on the (pre-feature) signal calculated from SCG), and the heartbeat cycle is determined very quickly and with high robustness. The matrix profile m(t) provides not only the location of the motif, i.e., the regular heartbeat, but also the data anomalies called conflicts and the quality of each motif. The quality of each motif is a similarity measure of the most common motif in the signal s(t). Preferably, the multidimensional signal s(t) is used to detect the motif / heartbeat cycle. More details of examples of algorithms based on motifs in multidimensional signals based on matrix profiles can be found in the article "Meaningful Multidimensional Motif Discovery" written by Chin-Chia MichaelYeh, NickolasKavantzas, Eamonn Keogh, published in ICDM 2017, which is incorporated herein by reference as exemplary details of matrix profiles. The motif length is preferably set to a value less than 1 second, preferably less than 800 milliseconds (ms), preferably less than 700ms. The motif length is preferably set to a value greater than 200ms, preferably greater than 400ms, preferably greater than 500ms. The motif length is preferably set to a value less than 1800ms, preferably less than 1500ms, preferably less than 1000ms, preferably less than 800ms. Figure 7 It shows that in step S34, the linear kinetic energy K is used lin (t) and rotational kinetic energy K rot (t) is an example of a motif 22 detected by the matrix profile. In the embodiment, one motif 22 is detected. However, as Figure 7 As shown, two or more motifs 22 can also be detected in the basic signal.
[0087] The heartbeat cycle is preferably identified based on a pre-signature signal, preferably based on a kinetic energy and / or power signal.
[0088] In step S35, a sub-period 24 of a heartbeat is identified in the identified heartbeat cycle. Preferably, the sub-period 24 is determined based on a characteristic point of the SCG in the heartbeat cycle (also including the meaning of the pre-characteristic signal determined based on the SCG). Preferably, the characteristic point is the maximum rotational kinetic energy or the maximum rotational kinetic power in the heartbeat. Preferably, the sub-period 24 is determined based on the time of the characteristic or reference point and the fixed time relationship / width between the sub-periods 24 of the heartbeat cycle. The fixed time relationship / width of the sub-period 24 means that the time width of each sub-period 24 does not change from one heartbeat to the next. This is not the case if the start and end points of the sub-period are defined by the physiological time points that need to be detected for each heartbeat. The fixed time relationship / width can be an absolute fixed time relationship / width or a relatively fixed time relationship / width. The absolutely fixed time relationship means that the width of the sub-period 24 and the time distance between them have a fixed absolute time relationship (fixed absolute time value), and only the position of the sub-period 24 and the fixed absolute time relationship between them are correctly located based on the time of the characteristic point. Relatively fixed time relationship refers to that the width of sub-period 24 and / or the time distance between them all have fixed relative time relationship (fixed percentage). Therefore, in addition to the correct positioning of sub-period 24, the ratio must also be adjusted. For example, the ratio can depend on the heart rate or the length of the selected heartbeat. Sub-period 24 preferably has the same (absolute or relative) width. The width of each sub-period 24 is preferably less than 200 milliseconds, preferably less than 150 milliseconds, preferably less than 140 milliseconds, preferably less than 130 milliseconds, preferably less than 120 milliseconds, preferably less than 110 milliseconds, preferably less than 105 milliseconds, and / or preferably greater than 20 milliseconds, preferably greater than 40 milliseconds, preferably greater than 50 milliseconds, preferably greater than 60 milliseconds, preferably greater than 70 milliseconds, preferably greater than 80 milliseconds, preferably greater than 90 milliseconds, preferably greater than 95 milliseconds. Preferably, the width of each sub-period 24 is 100 milliseconds. Preferably, the width of each sub-period 24 is preferably less than 30%, preferably less than 25%, preferably less than 20%, preferably less than 15%, preferably less than 10%, and / or preferably greater than 2%, preferably greater than 5%, preferably greater than 7%, preferably greater than 8%, preferably greater than 9% of the heartbeat period / length. The sub-periods 24 preferably do not overlap, i.e. there are no sampling times that occur in two sub-periods 24. The sub-periods 24 are preferably arranged one after another, so that there are no sampling times between two sub-periods 24 that do not belong to any sub-period 24. Preferably, more than 5, preferably more than 6, preferably more than 7, preferably more than 8, preferably more than 9, preferably more than 10 sub-periods 24 are identified. Preferably, less than 20, preferably less than 15, preferably less than 14, preferably less than 13, preferably less than 12 sub-periods 24 are identified. Preferably, 11 sub-periods 24 are identified. Preferably, the first sub-period 24 is arranged to cover the characteristic point.A first group of sub-periods 24 is arranged before a first sub-period 24 and a (different) second group of sub-periods 24 is arranged after the first sub-period 24. The first group preferably comprises less than half of the sub-periods 24 and / or the second group preferably comprises more than half of the sub-periods 24. Figure 7 An example of step S35 is shown, for an arrangement of 11 sub-cycles 24 per 100 ms, wherein four sub-cycles 24 are before the characteristic point, one is at the characteristic point, and six are after the characteristic point. The cumulative period of all sub-cycles 24 may be longer or shorter than the heartbeat cycle, i.e. may have extended to the previous and / or next heartbeat cycle, or may not cover the entire heartbeat cycle.
[0089] In step S36, (data) features are calculated (used as input in the health state device 4). The (data) features preferably include at least one feature K for each sub-period 24 i, where i represents the index of the corresponding sub-cycle 24 from sub-cycle i=1 to sub-cycle i=n, where n is the number of sub-cycles in the cardiac cycle. Preferably, the same physical (dynamic) variable is calculated for each sub-cycle. Preferably, the data features include one or more of linear kinetic energy, rotational kinetic energy, linear kinetic power, rotational kinetic power, respiratory information or state, rotational cardiac work, linear cardiac work for each corresponding sub-cycle. The linear / rotational kinetic energy of a sub-cycle can be one or more of the cumulative linear / rotational kinetic energy in the sub-cycle, the linear / rotational kinetic energy density in the sub-cycle, the maximum value of the linear / rotational kinetic energy in the sub-cycle, the time sample of the maximum value of the linear / rotational kinetic energy in the sub-cycle, the minimum value of the linear / rotational kinetic energy in the sub-cycle, the time sample of the minimum value of the linear / rotational kinetic energy in the sub-cycle, or other values (such as the average value, median, variance, etc. of the linear / rotational kinetic energy in the sub-cycle). The cumulative linear / rotational energy of a sub-cycle means the integral of the linear / rotational energy over the sub-cycle. The linear / rotational kinetic energy density in a sub-cycle is the cumulative linear / rotational kinetic energy in the sub-cycle divided by the width of the sub-cycle (its duration). The linear / rotational kinetic power of a sub-cycle can be one or more of the cumulative linear / rotational kinetic power in the sub-cycle, the maximum value of the linear / rotational kinetic power in the sub-cycle, the time sample of the maximum value of the linear / rotational kinetic power in the sub-cycle, the minimum value of the linear / rotational kinetic power in the sub-cycle, the time sample of the minimum value of the linear / rotational kinetic power in the sub-cycle, or other values (such as the average, median, variance, etc. of the linear / rotational kinetic power in the sub-cycle). The cumulative linear / rotational kinetic power of a sub-cycle means the integral of the linear / rotational power over the sub-cycle. The linear / rotational kinetic power density in a sub-cycle is the cumulative linear / rotational kinetic power in the sub-cycle divided by the width of the sub-cycle (its duration). For simplicity, linear / rotational in this paragraph means that this applies to linear variables such as linear kinetic energy, linear kinetic power, etc. and / or rotational variables such as rotational kinetic energy, rotational kinetic power, etc. These (data) features are calculated based on the SCG signal in the cardiac cycle (or the corresponding sub-cycle), preferably based on the pre-feature signal in the cardiac cycle (or the corresponding sub-cycle), preferably based on the linear / rotational kinetic energy signal in the cardiac cycle (or the corresponding sub-cycle) and / or based on the linear / rotational kinetic power signal in the cardiac cycle (or the corresponding sub-cycle). Step S33 for calculating the pre-feature signal can also be implemented later, i.e. after steps S33 and S35, if these steps are not needed. Step S33 can also be omitted and directly included in step S36 for calculating the (data) features.
[0090] Based on the respiratory signal or respiratory state in the sub-cycle determined in step S31, the respiratory state of each sub-cycle is calculated. The respiratory information / state can also be input only once for the entire heartbeat, rather than for each sub-cycle. In this case, it is preferred to select a heartbeat cycle that completely corresponds to (only) one respiratory state.
[0091] The (data) features may also include the motif quality obtained in step S34. This provides a deviation from the normal heartbeat pattern of the user 10 and may be used as another input feature of interest to the heart state device 4.
[0092] Figure 3 A preferred embodiment for determining features of the data fed to the cardiac state device 4 is described. Obviously, alternative embodiments of (data) feature extraction are possible. For example, a sub-cycle may extend over multiple heartbeats (two or more). For example, different feature variables are calculated for different sub-cycles. The start and end points of a sub-cycle may be detected based on characteristic points in the data. One, some or all features may be calculated for a complete cardiac cycle instead of a sub-cycle. Many alternatives are possible. It is also possible that in step S4, one or more of the above-mentioned pre-feature signals are used as a basis for determining the health state (and steps S34 to S36 are skipped). It is also possible to skip the feature extraction step S3 entirely and input the SCG and the characteristic C into the health state device 4, preferably into an ML engine.
[0093] Back to Figure 2 In step S4, the health state is determined based on the measurement signal SCG and on the device characteristic C. Preferably, the health state is determined based on a pre-characteristic signal, which is calculated based on the SCG signal and the characteristic C. The pre-characteristic signal is, for example, one or more of the linear cardiac energy, linear cardiac work, linear cardiac power, cardiac force, rotational cardiac energy, rotational cardiac work, rotational cardiac power, cardiac torque, total cardiac energy, total cardiac work and total cardiac power as described above. Total cardiac energy is the sum or linear combination of rotational cardiac energy and linear cardiac energy. Total cardiac work is the sum or linear combination of rotational cardiac work and linear cardiac work. Total cardiac power is the sum or linear combination of rotational cardiac power and linear cardiac power. Preferably, the pre-characteristic signal calculated in step S33 is used to determine the health state in step S4. Even more preferably, the characteristic determined in step S3 (based on SCG and C or based on the pre-characteristic signal) is used as an input to the health state device 4 or for determining the health state.
[0094] The health state device 4 processes the feature input (input feature) and outputs the heart health state of the user 10 based on the input feature. The heart health state preferably refers to a medical indication / problem of the heart. In a preferred embodiment, the heart health state refers to CHF. However, the method discussed can also be used to detect other medical indications / problems of the heart, such as atrial fibrillation, valvular disease, arrhythmia, heart murmur, myocardial infarction, and drug-induced cardiotoxicity. Preferably, the heart health state is binary, that is, the heart health state corresponds to a first heart health state indicating that the heart of the user 10 is not suffering from a medical indication / problem (such as CHF), or corresponds to a second heart health state indicating that the heart of the user 10 is actually suffering from or has a risk of suffering from a medical indication / problem (such as CHF). In addition to the binary output of the ML engine, a heart health state with more than two states can also be output. The second heart health state can be distinguished into, for example, different stages of the medical indication / problem or different risk ranges of the medical indication / problem and / or also distinguished into different medical indications / problems. For CHF, the second heart health state may be subdivided into different second sub-states indicating the stage of CHF, such as stage A, stage B, stage C, stage D. Thus, the output of the ML engine will indicate not only the presence of CHF, but also its stage. It is also possible that the second heart health state may additionally give a score indicating the probability of having the medical indication / problem.
[0095] Preferably, the health status device 4 includes a machine learning (ML) engine. Based on SCG and C, preferably based on the above-mentioned pre-features, and even more preferably based on the features determined in step S3, input features are fed to the ML engine. Preferably, the input features are the features determined in step S3. However, the input features may also be different features. The ML engine can follow simple ML methods, such as random forest models or more complex ML methods, such as deep learning models or neural network models. In an embodiment, the measurement signal SCG and the device characteristic C (instead of the features calculated in S3) can be directly input into the ML engine to detect the health status. In this case, it is preferred to use a deep learning model, preferably a neural network model or a convolutional neural network model.
[0096] The ML engine is preferably trained through a supervised training model. The ML engine can run in detection mode and training mode.
[0097] In detection mode, input features calculated for the user 10 are input into the ML engine (without prior knowledge of the user's 10 heart health status), and the user's 10 heart health status is output by the trained ML engine.
[0098] In the training mode, the input features calculated for the training user 10 (the same features as used in the detection mode) are input into the ML engine together with the heart health state of the user 10, i.e., a plurality of features are input into the ML engine, which are annotated with the actual health state of the heart of the training user 10. The heart health state of the training user 10 annotated with a plurality of features is used for training and can be determined before the doctor's diagnosis. The diagnosis can be based on the measurement signal alone, but is preferably based on additional measurements, such as ECG, echocardiography, cardiovascular magnetic resonance imaging, phonocardiogram, electrocardiogram, MRT, CT, etc. Preferably, the additional measurements also depend on the health state of the heart to be assessed. For example, if the health state of the cardiac output is about the health state of the user's congestive heart failure, the diagnosis of the user 1 can be based on ECG, blood pressure measurement and SCG measurement. Other heart problems may require other additional measurements. Obviously, the heart state of the user used for training can also be estimated based on a computerized estimate (rather than a doctor), but based on a more complete set of data that provides a very high certainty of the estimated heart state of the user input in the ML engine for training. Training is performed on a plurality of users 10 of at least two types. A first type of user has a first health state, and a second type of user has a second health state. To train the ML engine, the same features are typically used as input to the ML engine for a known output of the user 10, i.e., a heart health state. This known heart health state is also input into the ML engine along with the features of the user 10 to train the ML engine. This is done for many users 10 to obtain a well-trained ML engine.
[0099] Preferably, steps S3 and S4 are repeated for multiple heartbeats so as to estimate the cardiac health state for multiple heartbeats. The results of the cardiac health state for multiple heartbeats can be combined to obtain a combined cardiac health state. The combination can, for example, count the number of first cardiac health states and the number of second cardiac health states, and if the percentage of the second cardiac health state is higher than a threshold, give the second cardiac health state as the combined cardiac health state. In the case of outputting a score for the second cardiac health state, the score can be used to improve the combination of different cardiac cycles, for example by weighted averaging. Step S3 may not be completely repeated for all cardiac cycles. Steps S31 to S34 can be performed once for a complete measurement window, and only steps S35 and S36 are repeated for each cardiac cycle that needs to be analyzed by the cardiac state device 4.
[0100] In step S5, output information is determined based on the health status determined in step S4, and the output information is output via the output device 8. The output information may be visual information and / or audio information. The output information is, for example, information indicating a first cardiac health status and / or a second cardiac health status. In an embodiment, the output information is output each time a cardiac health status is determined. This is particularly advantageous for short measurements for checking the cardiac health status of the user 10. In another embodiment, the cardiac health status is only output when the second cardiac health status is detected. The output information may be like an alarm. This is preferred for long-term monitoring.
[0101] In a preferred embodiment, the feature extractor 3 and the health state extractor 4 are arranged in a server 6 or a remote processor. Preferably, the local processor or smartphone 5 or client device sends the measurement signal SCG received from the IMU 1 (via a communication connection like the Internet) to the server 6 or remote processor for further processing (e.g., steps S31 to S36 and S4). The output of the health state extractor 4, i.e., the heart health state, is preferably sent back to the local processor or smartphone 5 and output to the user 10 through the output device 8 of the smartphone 5. Obviously, it is also possible to send the heart health state elsewhere, such as to a healthcare professional (who has requested the measurement), to the user's account or elsewhere. However, some or all of these steps may also be performed in the local processor or smartphone 5. If all steps are performed on the smartphone 5 or local processor, there is no problem of data privacy, and the output from the health state extractor 4 does not have to be sent back to the smartphone 5 or elsewhere.
[0102] It is understood that the invention is not limited to the embodiments described and that variations can be applied without exceeding the scope of the claims.
Claims
1. A system for detecting a cardiac health status of a user (10), the system comprising: A device (1), comprising an IMU (1), wherein the IMU (1) is configured to measure a measurement signal (17, 18) when the device is placed on the body of the user (10), processing means (2) configured to determine a characteristic (C) of the device (11); determining a cardiac health state of the user (10) based on the measurement signals (17, 18) and based on a characteristic (C) of the device (11), and Output information is output based on the determined health status.
2. A system according to the preceding claim, wherein: The characteristic (C) of the device (11) is related to the weight and / or size of the device.
3. A system according to the preceding claim, wherein: The characteristic (C) comprises the mass of the device (5, 7) and / or the moment of inertia of the device (5, 7).
4. System according to one of the preceding claims, wherein: The processing device (2) is configured to calculate at least one feature based on the measurement signals (17, 18) and based on a characteristic (C) of the device (11), wherein the processing device (2) is configured to determine a health state based on the calculated at least one feature.
5. A system according to the preceding claim, wherein: The at least one characteristic calculated includes or is based on at least one of cardiac force or torque, cardiac energy, cardiac work, and cardiac power.
6. A system according to the preceding claim, wherein: The at least one characteristic calculated includes or is based on at least one of cardiac torque, cardiac rotational kinetic energy, cardiac rotational work, and cardiac rotational power.
7. The system according to claim 5 or 6, wherein: The at least one characteristic is calculated based on the mass of the device (11) and / or the moment of inertia of the device (11).
8. System according to one of the preceding claims, wherein: The processing means (2) is configured to determine a type of the device (11) and to determine a characteristic (C) of the device (11) based on the determined type of the device (5, 7).
9. A system according to the preceding claim, wherein: The device (5, 7) is a smartphone (5) or a wearable device (7), wherein the type of the device (5, 7) is the type of the smartphone (5) or the type of the wearable device (7).
10. A system according to the preceding claim, wherein: The wearable device is connected to a smartphone (5).
11. The system according to one of claims 8 to 10, wherein: The type of device (5, 7) is received from a user input.
12. The system according to one of claims 9 to 10, wherein: The type of the device (5, 7) is received from an operating system running on the smartphone (5) or the wearable device (7).
13. System according to one of claims 9 to 12, comprising a server (6), wherein: An application is run on a processor of the smartphone (5), wherein the application is configured to connect to the server (6), wherein the processor of the smartphone (5) and / or the processor of the server (6) operates as the processing device (2).
14. A method for detecting a heart health status of a user (10), the method comprising the following steps: When a device (11) comprising an IMU (1) is placed on the body of the user (10), receiving (S1) in a processing device (2) measurement signals (17, 18) from the IMU (1), determining (S3) in the processing device (2) a cardiac health state of the user (10) based on the measurement signals (17, 18) and based on a characteristic (C) of the device (11), and Output information is sent to an output device (8) based on the determined health status.
15. A computer program comprising instructions configured to, when executed on a processing device (2), perform the steps of the method according to the preceding claim.
Citation Information
Patent Citations
Improvements in or relating to heart monitoring
WO2017036887A1