METHOD FOR RECONSTRUCTING AN ECG IN REAL TIME FROM A PPG SIGNAL

Abstract

METHOD FOR RECONSTRUCTING AN ECG IN REAL TIME FROM A PPG SIGNAL Method for generating an ECG signal from a PPG signal and a trained machine learning model comprising: A first acquisition (ACQ1) of a first signal (S1), called the PPG signal, by means of a sensor arranged on a signal acquisition device in contact with the skin of an individual to measure variations in the pulsatile volume of the blood; Segmentation (SEG1) of the first signal (S1); Use of a trained learning model to produce a second segmented signal of an ECG from an input vector comprising the data of a cycle of a first PPG signal; Recombination of the segments produced to reconstruct a continuous ECG signal from: detection of two consecutive ECG markers of the second signal present in each cycle of said second signal; Reconstruction of the ECG signal by concatenation of segments from time markers. Figure for abstract: Fig.1

Description

Title of the invention: METHOD FOR RECONSTRUCTING AN ECG IN REAL TIME FROM A PPG SIGNAL Field of invention

[0001] The field of the invention relates to the field of methods and devices for transforming, analyzing and processing cardiac signals. In particular, the field of the invention relates to the field of methods for transforming a photoplethysmography signal, called a PPG signal, into an electrocardiographic signal, called an ECG signal, in order to produce a continuous ECG signal from a simple acquisition device. State of the art

[0002] Currently, there are solutions for obtaining an electrocardiograph from a photoplethysmogram.

[0003] The ECG has technical disadvantages of implementation unlike the PPG. To perform an ECG, it is necessary to use multiple electrodes, while for PPG, a sensor is used to perform a continuous recording. Furthermore, the material used to provide a good quality ECG signal with the electrode can cause skin irritation, discomfort, and even allergic reactions during long-term use of these devices.

[0004] Certain factors such as the positioning of the electrodes, their detachment or their retention on the skin can influence the results of the ECG and lead to false positive or negative results.

[0005] There are, in the prior art, methods for reconstructing an ECG signal from a PPG signal using a machine learning algorithm. In this type of method, a segmentation of the PPG signal of a fixed length with several epochs is used.

[0006] One problem is that an ECG signal comprises many signal descriptors, namely the data characterizing the QRS complex and the heart rate data as well as the variations of this frequency over time. Learning does not make it possible to obtain reliable restitution of both the QRS complex and the heart rate variability.

[0007] Consequently, the accuracy of the predictions of current models remains unsatisfactory for exploiting the ECG signal reconstructed from a PPG signal, in particular for providing assistance in the diagnosis of cardiac pathologies.

[0008] There is a need to improve the accuracy of the reconstruction of an ECG signal from a PPG signal to obtain a continuous signal and generate indicators characterizing singularities of the ECG signal thus reconstructed. Summary of the invention

[0009] An objective of the invention is to overcome the aforementioned drawbacks.

[0010] According to a first aspect, the invention relates to a method for generating an ECG signal from a PPG signal and a trained machine learning model comprising: • A first acquisition of a first signal, called the PPG signal, by means of a sensor arranged on a signal acquisition device in contact with the skin of an individual to measure variations in the pulsatile volume of the blood; • A sampling of the first signal at a predefined frequency; • A recording of the heart rate; • Segmentation of the first signal comprising: • Definition of a first time window of a first predefined duration; • Extraction of a first set of sampled points from the first PPG signal, called PPG points, comprising a first subset of points between two consecutive PPG markers and a second subset of consecutive points from the second PPG marker, the number of points of the second subset being less than the number of bridges of the first subset; • Positioning of said first segmented signal in the first time window from the second PPG marker; • Using a trained learning model to produce an output vector defining a second segmented signal of an ECG from an input vector comprising the data of the first set; • Recombination of the segments produced to reconstruct a continuous ECG signal from: • Detection of at least two consecutive ECG markers of the second signal present in each cycle of said second signal; • Reconstruction of the ECG signal by concatenation of segments from time markers.

[0011] An advantage of using a time window comprising less than two cycles is to obtain a reliable and precise reconstruction method of the QRS complex. The learning has a very good performance and the reconstruction is of better quality than when using a plurality of cycles considered at the input of the network.

[0012] According to one embodiment, the heart rate is used to identify the local maximum corresponding to the desired ECG marker.

[0013] According to one embodiment, the ECG markers used during the recombination of the segments are R peaks. An advantage is to minimize the error during the segmentation of the cycles.

[0014] According to one embodiment, two consecutive markers of the first signal are used to interpolate the lengths between two consecutive ECG markers of the second signal.

[0015] According to one embodiment, the machine learning model is trained according to the method for training a neural network to generate an ECG from a PPG signal according to the invention.

[0016] According to another aspect, the invention relates to a method for training a neural network to generate an ECG from a PPG signal, said method comprising: • A first acquisition of a first signal, called the PPG signal, by means of a sensor arranged on a signal acquisition device in contact with the skin of an individual to measure variations in the pulsatile volume of the blood; • A second acquisition of a second signal, called an ECG signal, by means of at least one pair of electrodes placed on the skin of an individual; • A sampling of the first signal and the second signal each at a predefined frequency; • A recording of heart rate; • A synchronization of the first signal with the second signal, said synchronization comprising: • Detection of at least one first PPG marker of the first signal present in each cycle of said first signal; • Detection of at least one first ECG marker of the second signal present in each cycle of said second signal; • Estimation of a transit time of the first PPG signal; • Alignment of the two signals from an offset of one of the two signals by the transit time value; • Segmentation of the first signal and the second signal comprising: • Definition of a first time window of a first predefined duration; • Extraction of a first set of sampled points from the first PPG signal, called PPG points, comprising a first subset of points between two consecutive PPG markers and a second subset of consecutive points from the second PPG marker; • Positioning of said first segmented signal in the first time window, said window comprising the two consecutive PPG markers; • Definition of a second time window of a second predefined duration; • Extracting a second set of sampled points from the second ECG signal, called ECG points, comprising a first subset of points between two consecutive ECG markers and a second subset of consecutive points from a second marker; • Positioning said second segmented signal in the first time window, said window comprising the two consecutive ECG markers; • Training of a machine learning model comprising: • Generation of input vectors comprising the first set of points; • Implementation of a loss function from the second set of points; • Generation of a trained machine learning model.

[0017] According to one embodiment, the first marker is an R peak of a QRS complex and in that the second marker is a local minimum of the second signal.

[0018] According to one embodiment, the transit time is estimated by means of calculating the minimum difference measured between two markers of each of the two signals considered in the same cycle. One advantage is to make it possible to synchronize the PPG and ECG signals homogeneously for each cycle.

[0019] According to one embodiment, the second subset of points of the second consecutive segmented ECG signal of a second marker comprises a number of points less than the number of points of the first subset.

[0020] One advantage is that it allows for precise recalibration at the network output to the heart rate. In particular, by selecting a marker that defines a local minimum or a local maximum, the second set of points makes it possible to better detect these minimums or maximums at the network output and therefore to group the segments together according to the heart rate.

[0021] According to one embodiment, a third subset of points of the second set of points comprises a set of ECG points of the same value following the second subset of points so as to complete the second time window. An advantage is to make it possible to obtain windows of fixed size for training by considering a signal which can be up to a predefined duration. One advantage of filling is that it does not disrupt learning with QRS complex data from a cycle other than the cycle defining the network input.

[0022] According to one embodiment, the acquisition of the heart rate is carried out by means of the analysis of the second ECG signal comprising the estimation of the intervals between two consecutive peaks of the acquired ECG signal, called RR intervals. An advantage is to obtain an accurate heart rate.

[0023] According to one embodiment, the method comprises an indicator of the deviation of the heart rate calculated from the PPG signal and that calculated from the ECG signal. One advantage is to take into account the deviation between the two measurements during learning.

[0024] The following features apply both to the method for generating an ECG signal from a PPG signal and a trained machine learning model and to the method for training the machine learning model.

[0025] According to an embodiment of one and / or the other of these methods, the second subset of points of the first segmented PPG signal consecutive to a second marker comprises a number of points less than the number of points of the first subset. An advantage is to allow precise resetting at the output of the network to the heart rate. In particular, by selecting a marker which defines a local minimum or a local maximum, the second set of points makes it possible to better detect these minima or maxima at the output of the network and therefore to group the segments together according to the heart rate.

[0026] According to an embodiment of one and / or the other of these methods, a third subset of points of the first set of points comprises a set of PPG points of the same value succeeding the second subset of points so as to complete the first time window. An advantage is to make it possible to obtain windows of fixed size for training by considering a signal which can be up to a predefined duration. An advantage of the filling is not to disturb the learning with data from the QRS complex of a cycle other than the cycle defining the input of the network.

[0027] According to one embodiment of one and / or the other of these methods, the machine learning model is a convolutional neural network known as CNN.

[0028] According to one embodiment of one and / or the other of these methods, the CNN neural network is a U-NET type network composed of an encoder, a decoder and a tool making it possible to concentrate the neural network on the most important or relevant parts of the data, a tool called Attention Gate.

[0029] According to an embodiment of one and / or the other of these methods, the training of the coefficients of the machine learning model is carried out from an optimizer and an implementation of a cost function.

[0030] According to one embodiment of one and / or the other of these methods, the acquisition of the heart rate is carried out by means of the analysis of the first PPG signal comprising the estimation of the intervals between two consecutive markers of the acquired PPG signal. An advantage is to obtain the heart rate directly from the PPG sensor and a computer.

[0031] According to another aspect, the invention relates to a device for generating a continuous ECG signal comprising a PPG signal sensor and a computer and a memory for implementing the method of the invention. An advantage is that it makes it possible to arrange such a device on a bracelet with a single point of contact on the wrist. Brief description of the figures

[0032] Other characteristics and advantages of the invention will emerge on reading the detailed description which follows, with reference to the appended figures, which illustrate: • [Fig. 1]: A flowchart of a preprocessing and training system of a machine learning model from two acquired signals including an ECG signal and a PPG signal; • [Fig.2]: A flowchart of training a neural network; • [Fig.3]: A flowchart of the operation of the trained neural network detailed in [Fig.2]; • [Fig.4]: A flowchart of the operation of the neural network trained;

[0033] [Fig.5]: A flowchart of the pre-processing system, training of the network of neurons; • [Fig.6]: An example of a PPG signal acquired by a measuring device; • [Fig.7]: The example of the PPG signal sampled at 100Hz after filtering; • [Fig.8]: An example of a raw ECG signal acquired by electrodes; • [Fig.9]: The example of ECG signal sampled at 100Hz after filtering; • [Fig. 10]: An example of filtered and peak-aligned PPG and ECG signals R of the ECG signal and the corresponding minima of the PPG signal; • [Fig. 11]: An example of segmentation of the PPG signal on a window comprising a portion of a subsequent cycle and a filling; • [Fig. 12]: An example of segmentation of the ECG signal on a window comprising a portion of a subsequent cycle and a filling; • [Fig. 13]: An example of segmentation with a fixed window of two seconds of the ECG signal; • [Fig. 14]: An example of segmentation with a fixed window of two seconds of the filtered PPG signal; • [Fig. 15]: An example of neural architecture of a machine learning algorithm model for automatic reconstruction of an ECG; • [Fig. 16]: an example of representation of the output signals of the network trained with a first type of segmentation; • [Fig. 17]: an example of representation of the output signals of the network trained with a second type of segmentation; • [Fig. 18]: an example of representation of the signals recombined by the method of the invention. Detailed description

[0034] According to a first aspect, the invention relates to a method for generating an ECG signal from a PPG signal and an MLi machine learning model. This method is for example described in Figures 3 and 4.

[0035] According to a second aspect, the invention relates to a method for training an MLi machine learning model from the acquisition of an ECG signal and the acquisition of a PPG signal. This method implements a cost function to learn the model. This method is for example described in Figures 1 and 2. Acquisition of the PPG signal

[0036] The method for generating an ECG signal comprises a first step of acquiring ACQi a PPG signal denoted signal Sp

[0037] The acquisition can be carried out from different devices. According to one example, the device can be a bracelet or a watch comprising at least one PPG sensor.

[0038] According to one embodiment, the PPG sensor comprises an emitter of a light source, such as a diode and a receiver such as a photodetector.

[0039] The optical measurement for generating a PPG signal and deducing the heart rate from this technique may be known as "optical heart rate monitoring" or "OHR / OHRM". The acronym PPG may sometimes be used to refer to the technology, the signal or the equipment. In the remainder of the description, a signal from this technology will be called a PPG signal and equipment such as a sensor will be called a PPG sensor.

[0040] Photoplethysmography or PPG is a non-invasive optical method for analyzing variations in blood volume in superficial tissues. This method is based on analyzing the variation in light absorption in tissues. This method is used, for example, for oximeters to measure oxygen saturation in the blood, in smart watches and bracelets to calculate heart rate.

[0041] According to one embodiment, the PPG sensor is an optoelectronic sensor. It is composed of an emitter of a light source, such as a diode and a receiver such as a photodetector. The diode emits light that passes through different successive layers of the skin: the surface, the stratum corneum, the epidermis and the dermis. Part of the light is absorbed by the blood, part of the light is reflected. The photodetector receives the reflected light.

[0042] According to one embodiment, the transmitter and the receiver are placed next to each other, called reflection mode.

[0043] According to one embodiment, the photoreceptor detects the variations in reflected light and converts them into an electrical signal.

[0044] A cardiac cycle can be divided into two phases depending on the blood flow. When the heart contracts, it expels blood into the vascular system, this is the so-called systole phase. This results in an increase in blood volume in the vessels. The so-called diastole phase is the dilation phase of the heart. This phase results in a decrease in blood volume in the vessels. In the systole phase, the increase in blood volume results in an increase in the light absorbed by the blood and a decrease in the intensity of the transmitted light. In the diastole phase, the decrease in blood volume results in an increase in the intensity of the transmitted light. Thus, the signal acquired by the sensor includes a variation in a physical parameter measured during this cyclic phenomenon.

[0045] According to one embodiment, the PPG signal denoted Si is a signal whose amplitude is expressed in volts or in arbitrary units as a function of time. According to one embodiment, the heart rate can be deduced from the signal Si. According to one embodiment, a computer configured to detect characteristic markers of the PPG signal makes it possible to deduce the heart rate.

[0046] In an illustrative example, with reference to [Fig.6], we obtain the graphical representation of a raw PPG signal noted Si sampled at 100Hz after its acquisition by a device. ECG acquisition

[0047] During the learning phase and the implementation of the training method, the method acquires an ECG signal and a PPG signal so as to train the MLi machine learning model. The ECG signal is denoted S2 and the PPG signal is denoted Si.

[0048] In the latter case, according to one embodiment, an ECG signal is acquired from an individual whose PPG signal is also acquired. In order to achieve efficient training, the ECG and PPG signals used to train the MLi model are synchronized and acquired from the same individual. One advantage is to train the model with correlated PPG and ECG signals.

[0049] According to one embodiment, during the ECG acquisition, the individual is at rest. According to another embodiment, the acquisition of the ECG signal is carried out during an effort. According to one embodiment, ECG signals are acquired in different configurations corresponding to different states of an individual. One interest is to obtain the most exhaustive training possible of all the states of cardiac activity of the individual.

[0050] According to one example, the acquisition is carried out during a stress test for the generation of a stress electrocardiogram. In this context, the individual performs increasingly intense physical effort.

[0051] According to one embodiment, the acquisition of the ECG signal comprises the implementation of an arrangement of ten adhesive electrodes connected to an electrocardiograph by means of cables. For a more precise measurement, twelve or eighteen electrodes can be used.

[0052] The four electrodes, called peripheral electrodes, are distributed at the level of each handle and ankles. At least six electrodes, called precordial electrodes, are distributed in the region of the thorax located in front of the heart, called the precordial zone.

[0053] According to a lighter mode, two electrodes are used to obtain at least one potential difference.

[0054] According to one embodiment, the electrodes are stuck to the bare skin.

[0055] An electrocardiogram or ECG is a method for visualizing variations in the electrical current flowing through the heart over time. This method relies on recording and transcribing the electrical currents flowing through the heart during each cardiac contraction. The ECG provides information on the rhythm, frequency and conduction of the heart. It allows the analysis of electrical signals generated and conducted by the heart muscle or the analysis of blood circulation.

[0056] An electrical current from the heart appears at a specific point located at the top of the right atrium, a point called the sinus node. The generated current propagates in the heart. When the current passes through the cardiac atria, it causes a contraction of the heart muscle. The conduction system maintains the heart rate within a specific range of values. Electrical propagation can be disturbed due to cardiac pathology.

[0057] According to one embodiment, the electrical current generated at the sinus node is measured between two points, on the surface of the body, using the electrodes and is captured by the electrocardiograph.

[0058] According to one embodiment, the signal obtained is the ECG signal S2 is a signal whose amplitude is expressed in Volts as a function of time.

[0059] In an illustrative example, with reference to [Fig.8], the graphical representation of a raw ECG signal sampled at 100Hz is obtained after acquisition by an electrocardiograph.

[0060] The method for generating an ECG signal comprises a step of recording the heart rate. This heart rate can be deduced from the ECG signal S2.

[0061] According to another embodiment, a calculator configured to detect characteristic markers of the ECG signal makes it possible to deduce the heart rate.

[0062] According to one embodiment, the heart rates are deduced from the two signals S1 and S2. In the latter case, the measurement of the two heart rates originating from the two signals makes it possible to carry out measurement error corrections on one or other of the signals.

[0063] Preferably, the heart rate is deduced from the PPG signal. An advantage is to train the MLi model in the operating conditions of the method of the invention in which the ECG is not acquired since we seek to regenerate it from the PPG signal. Filtering

[0064] The method for training the MLi model comprises a step of filtering and sampling the PPG signal Si and the ECG signal S2 each at a predefined frequency.

[0065] According to one embodiment, the filtering and sampling step carried out during the execution of the training method are identical to those which will be carried out during the execution of the method for generating an ECG signal. In this case, the filtering and sampling steps are only carried out on the acquired PPG signal.

[0066] According to one embodiment, the PPG signal is filtered. The use of a bandpass filter between 40 and 400 Hz to filter the high and low frequencies eliminates artifacts related to the movement of the individual. The step of filtering the PPG signal is denoted FILTi in [Fig.l]. The step of sampling the PPG signal is denoted ECHi in [Fig.l].

[0067] In an illustrative example, with reference to [Fig.7], the raw PPG signal sampled at 100Hz of [Fig.6] is filtered and resampled to 125Hz.

[0068] The filtered signal Si also noted SiF of [Fig.7] represents a signal in which the baseline is made stable over time.

[0069] According to one embodiment, the ECG signal is filtered using a method called the “Tarvainen” method to reduce the shape effect. Indeed, during the recording of the ECG, certain phenomena such as the movement of the individual, the detachment of the electrodes, the induced effects of respiration, variations in skin impedances, etc. can cause an overall wave-like tendency affecting the electrical signal produced by the heart. This phenomenon is also known as baseline drift. The baseline or isoelectric line of the core corresponds to the plot of the average amplitude of the signal smoothed over a given period of time.

[0070] This filtering is based on the use of a high-pass filter. In the case of the so-called "Tarvainen" method, finite impulse response filters are used. This means that the output of the filter reacts only for a finite time after the application of an input pulse. This is a so-called "detrending" method. Detrending a signal consists of eliminating or reducing an underlying trend in the collected data, the trend corresponding to variations in the average signal other than those generated by the cardiac electrical activity measured over time.

[0071] In an illustrative example, with reference to [Fig.9], the ECG signal sampled at 100Hz in [Fig.8] is filtered so as to eliminate the “trend” phenomenon. It is verified that this filtering makes it possible to normalize the average value of the signal over time, reducing or even eliminating its variations over time. The step of filtering the ECG signal is denoted FILT2 in [Fig.l]. The step of sampling the ECG signal is denoted ECH2 in [Fig.l]. Preferably, the sampling on signal Si will be chosen to be identical to the sampling of signal S2.

[0072] According to other embodiments, other types of filtering can be implemented such as filtering of the electromyogram, filtering of interference noise at a certain predefined frequency.

[0073] The signals Si F and S2 F are then recorded in a memory to be processed to train the MLb model. The processing can correspond to the shaping of the input vector of the model, data enrichment, or data control. Indeed, certain signals can be eliminated when the quality of the latter is not sufficient and it does not allow the MLi model to be correctly trained. The signal recording step is noted ENRi in [Fig.l]. Synchronization - Alignment

[0074] When training the MLB model, the acquisitions of the PPG and ECG signals are carried out simultaneously, consequently the context for acquiring an ECG signal is the same as for acquiring a PPG signal. By context, we mean the data of days, times, dates, individual, physical state of the individual, etc.

[0075] When the MLi model is trained and a first acquisition ACQi of a PPG signal is carried out jointly with a second acquisition ACQ2 of an ECG signal, according to one embodiment, the method for generating an ECG signal comprises a step of synchronizing the filtered ECG signal and the filtered PPG signal. This step is denoted SYNCi in [Fig.l]. This step is also called signal alignment.

[0076] This step has the advantage of improving the learning of the MLi machine learning model because the shifts and the variations of these shifts during of time do not alter the training of the neural network. This synchronization makes it possible to erase the longer transit times of the PPG signal with respect to the ECG signal given the nature of the signals and the body conducting them.

[0077] This synchronization phase is no longer carried out during the exploitation phase of the trained neural network given the fact that only the PPG signal will be acquired.

[0078] The graphical representation of an ECG signal groups together a set of waves which are broken down as follows: • The P wave representing the contraction of the heart's atria • The so-called “QRS” complex corresponds to mechanical systole, in other words to ventricular contraction. It contains three waves: the Q wave is the first negative deflection, Fonde R is the first positive deflection and Fonde S is the second negative deflection following the R wave. • The T wave represents the so-called repolarization phase of the ventricles, in other words the return to the resting phase of the ventricles.

[0079] The Q, R and S peaks are called the peaks of each corresponding wave. [Fig. 14] shows an example of an S2 signal having a QRS complex in which the P, R and T waves are represented.

[0080] The graphical representation of a PPG signal groups together a set of waves which are broken down as follows: • The systolic wave which reaches its maximum SY during cardiac systole at a point called “the peak” or “systolic summit”; • The diastolic wave observed between the time the heart completes the systolic cycle and the diastolic peak DI.

[0081] A representation of these two waves is illustrated in [Fig.l 1].

[0082] It is understood that the ECG and PPG signals are cyclic signals due to the heart rate and due to the reproduction of a pattern at each period in time with the heart rate. These patterns make it possible to discriminate areas of interest allowing the definition of time markers in the cycle to synchronize the signals.

[0083] In order to achieve synchronization of these signals, different steps can be implemented.

[0084] According to one embodiment, the first step for synchronizing the ECG signal and the PPG signal comprises determining a first marker of the PPG signal and a second marker of the corresponding ECG signal. These markers are, for example, local minima or maxima such as characteristic peaks.

[0085] According to one example, the markers used are the R peaks of the ECG signal and the trough corresponding to the R peak of the PPG signal taken in the same cycle. [Fig. 10] illustrates the MECgi and MECg2 markers which are consecutive R peaks on the Sp signal [Fig. 10] illustrates the MPPGi and MPPG2 markers which are consecutive troughs on the S2 signal.

[0086] According to one embodiment, the second step comprises estimating the transit time of the PPG signal relative to the transit time of the ECG signal.

[0087] A pulse transit time is a measure of the transmission delay between the ECG signal and the PPG signal at a certain point in the body.

[0088] According to one embodiment, a measurement of the time difference between an ECG marker and a corresponding marker for the PPG is carried out for each cycle. According to one embodiment, the transit time is considered as the minimum difference measured between two markers of each of the two signals considered from the same cycle. It is understood that the transit time is globally constant over time since this delay only depends on the physics of the signals propagating in a body. By considering the minimum difference, the method of the invention makes it possible to dissociate the transit time from all the other phenomena altering the signal measurements.

[0089] In an illustrative example, with reference to [Fig. 10], the filtered ECG and PPG signals of Figures 7 and 9 are synchronized using as markers, the peaks R, for the ECG signal, and the corresponding troughs for the PPG signal. Signal segmentation ECG signal

[0090] The method for training the model of the invention comprises a step of segmentation SEGi of the ECG signal S2 and of the PPG signal Si. According to one embodiment, the training method and the method for reconstructing an ECG implement a segmentation of each cardiac cycle of the PPG signal. The method for training the model MLi implements a step of segmentation of the ECG signal S2 necessary for training the model. The segmented signals are denoted respectively Si' and S2' relative to the segmented PPG signals and the segmented ECG signals.

[0091] [Fig. 12] illustrates a segmentation of an ECG signal in an FT1 window.

[0092] The duration of the segmentation window is advantageously strictly less than two cardiac cycles.

[0093] An advantage is to learn the model with data essentially characterizing the waveform over a cycle and not with data characterizing the rhythm or frequency of the signal.

[0094] This segmentation window has the advantage of improving the learning of the machine learning model because it attenuates the error in reconstructing the ECG signal obtained by machine learning for the “QRS” complex.

[0095] This advantage results from the fact that the training data only represents the signal data over a single cycle. In other words, in the case of segmentation of several cycles, the learning will involve learning the reconstruction of the rhythm. However, in the present invention, the heart rate is obtained by an analysis of the ECG and / or PPG signal not necessarily using a machine learning model. This heart rate is then used to reconstruct or consolidate the reconstruction of the segmented signal into a continuous signal of all the cycles.

[0096] According to different embodiments, the segmentation window comprises at least one complete cycle and possibly a fraction of a following and / or previous cycle. This window is identical when learning the model and when using the learned model.

[0097] According to one embodiment, the method for training the model and the method for generating an ECG signal comprises a step of segmentation SEGi of the signals.

[0098] Concerning the method for training the model, the latter comprises an extraction of a second set of sampled points E2 from the second ECG signal S2.

[0099] According to one embodiment, a time window FT 2 of a predefined duration is fixed. For the ECG signal, this window FT2 is called the second time window. For the PPG signal, the equivalent segmentation window will be noted as the first time window, it is noted Fn.

[0100] We denote by E2 the set of points extracted from the ECG signal defining a segmented signal S2' resulting from the segmentation of the ECG signal in a time window FT2. The points of the set E2 make it possible to define an input vector of a machine learning model MLi such as a neural network.

[0101] We denote by Ei the set of points extracted from the PPG signal defining a segmented signal Sf resulting from the segmentation of the PPG signal in a time window FT1 so as to define an input vector of a machine learning model MLi such as a neural network.

[0102] According to one embodiment, two consecutive ECG markers are defined, denoted MECg i,Mec g2- These markers are defined so as to obtain a complete cycle. These markers make it possible to collect a first set of sampled points denoted ENS21 between said two markers MECGi and MECG2- These points ENS2i are extracted from the received or acquired signal.

[0103] A second subset of sampled points denoted ENS2 2 is extracted from the second ECG marker MEC G2 for a predefined duration following the second predefined marker MECg2. The sets of points ENS2i and ENS22 partly compose the set of points E2.

[0104] According to one example, the consecutive markers used are two consecutive R peaks of the ECG signal S2'. They are denoted MECgi,MECG2 in [Fig. 10].

[0105] According to one embodiment, the size of the set of points ENS2 2 is smaller than the size of the set of points ENS21. This ensures that a complete cycle is obtained while strictly limiting the points to two cycles.

[0106] According to one embodiment, a third subset of points ENS23 of the second set of points E2 comprises a set of points of the same value succeeding the second subset of points ENS2 2 so as to complete the second time window FT2. The set of points ENS23 completes the set of points E2. Indeed, the window FT2 having a fixed duration and the heart rate being able to evolve, the number of points taken from the sets ENS2i and ENS22 can vary and consequently, the size of the set ENS23 can vary. This third set of points makes it possible to perform a filling so as to maintain a fixed segmentation window.

[0107] In an illustrative example, with reference to [Fig. 12], this segmentation is used for the ECG signal of [Fig. 10]. The set of points in the third subset of points ENS23a has a zero value. PPG signal

[0108] The method for generating an ECG signal comprises a step of segmentation SEGi of the PPG signal Si. This method comprises an extraction of a first set of sampled points Ei of the first PPG signal Si. The segmentation of the signal is preferably identical during the method for training the MLb model.

[0109] [Fig. 11] illustrates a segmentation of a PPG signal in an FTi window.

[0110] According to one embodiment, a first time window FTi of a predefined duration is fixed. According to one embodiment, the time window Fn is of the same size as the second time window FT2.

[0111] According to one embodiment, the method of the invention makes it possible to define two consecutive PPG markers denoted MPPGi MPPG2. A first set of sampled points denoted ENSnest is extracted between the two MPP markers GietMPP G2. A second subset of sampled points denoted ENSi2est is extracted from the second PPG marker MPPG2 up to a predefined point. The set of points Ei comprises the subsets of points ENSi iet ENSi 2.

[0112] According to an example, the two consecutive PPG markers MPPGi MPPG2 are two consecutive minima corresponding substantially to the two markers MECgi,M ECg2 of the ECG signal in the learning method of the MLi model. One interest is to retain points that are highly correlated and correspond to the same physiological phenomena.

[0113] According to one embodiment, the length of the set of points ENS^ is less than the length of the set of points ENSn. This ensures that the window is strictly less than two epochs, in other words two cardiac cycles.

[0114] According to one embodiment, a third subset of points ENSn of the second set of points Ei comprises a set of points PPG of the same value succeeding the second subset of points ENSi 2 so as to complete the first time window FT b The set of points ENS23 completes the set of points ENSi i and ENSi2.

[0115] In an illustrative example, with reference to [Fig. 11], this segmentation is used for the PPG signal of [Fig. 10]. The set of points in the third subset of points ENSi 3a has a zero value. Other segmentation

[0116] According to a second embodiment, another segmentation is possible for the ECG and PPG signals. The segmentation takes all the points included over a predefined time interval. The segmentation window includes at least one cardiac cycle and can go beyond two cycles.

[0117] In an illustrative example, with reference to Figures 13 and 14, a segmentation with a two-second window is used for the PPG Si' and ECG S2' signals. The segmentation is 250 points long with sampling at 125Hz.

[0118] In order to estimate the performance of the models, the relative root mean square error rRMSE and the Pearson correlation coefficient value p can be estimated to evaluate the methods.

[0119] The first segmentation allows to obtain very good results with p = 0.94 + / -0.05 and RS ME = 0.05 + / -0.02. The second method also allows to obtain good results but inferior to the first segmentation method with p = 0.68 + / -0.24 and RSME = 0.11 + / -0.04

[0120] Pearson correlation is a statistical measure that evaluates the linear relationship between two continuous variables. It describes the extent to which the variation in one variable is associated with the variation in another variable. Pearson correlation takes its values ​​in the range between -1 and 1. The closer the Pearson correlation coefficient is to -1 or 1, the stronger the correlation between the two variables. Here, the ECG signal obtained by machine learning follows a similar trend to the expected ECG signal.

[0121] That is, the two signals increase or decrease together in a linear manner.

[0122] Training a machine learning (ML) model

[0123] [Fig.2] represents the different signals processed during the training of the MLp model. The PPG signal acquired by a measuring device is noted Sp. The ECG signal acquired by another measuring device is noted S2. The signals segmented and processed by the neural network to be trained are noted Sf and S2' respectively. The signal output from the neural network to be trained is noted S2 a'.

[0124] The trained MLi machine learning model makes it possible to predict the continuous ECG signal from the sole measurement of a PPG signal. Training the model makes it possible to transform the input vector from the PPG into an output vector that is as close as possible to the ECG signal that would have been measured by an ECG measuring device if the latter were used.

[0125] According to one embodiment, during the machine learning phase, the machine learning model receives as input vectors the set of sampled points E2 from the ECG and the set of sampled points Eqssu from the PPG.

[0126] According to one embodiment, the CNNi machine learning model is a convolutional neural network called CNN.

[0127] According to an exemplary embodiment, the machine learning model comprises a U-NET type architecture. Such a U-NET architecture is itself based on a CNN architecture.

[0128] In this case, the model includes an encoder ENC, a decoder DEC, a software component allowing the neural network to be focused on the most important or relevant parts of the data, a software component called “Attention Gâte” and a memory layer represented by the “Biderectional Gated Recourent Unit” called BiGRU.

[0129] BiGRU is a type of recurrent neural network. It consists of two GRU blocks, one in the forward direction of data propagation and the other in the reverse direction.

[0130] According to another embodiment, an LSTM layer may be used instead of the GRU block. However, this embodiment may require longer training.

[0131] According to one embodiment, three blocks are used to produce the ENC encoder. Each block comprises at least one convolution layer. The convolution layer denoted CONV in [Fig. 15] uses filters that scan the input data by performing convolution operations.

[0132] According to one example, the dimensions of the core of each layer increase with the advance of the layers.

[0133] Each block further comprises a normalization layer such as a layer called “Layer normalization” in English terminology. This layer is denoted LN in [Fig. 15]. It makes it possible to normalize the outputs of each layer of the neural network. This layer allows the stabilization of the neural network, to accelerate the learning of the model by allowing it to converge more quickly.

[0134] The latter allows faster and more stable learning thanks to the standardization of layer inputs.

[0135] Each block also includes an activation function, such as a rectified linear activation called ReLU, noted LR. This function makes it possible to activate or deactivate neurons by adding biases. The so-called “ReLU” layer is also called a linear rectification unit. The activated features are transmitted to the next layer, which promotes faster and more efficient learning.

[0136] [Fig. 15] represents an example of architecture of a U-NET type network comprising 3 blocks in the encoder ENC and 3 blocks in the decoder DEC.

[0137] The convolution layers are noted CONV, the input normalization layers are noted LN for “Layer normalization” in English terminology and the activation layers are noted LR.

[0138] The second block and the third block are denoted RB and correspond to residual blocks. One advantage of a residual block is to improve learning in deep neural networks by allowing a more direct flow of the gradient during backpropagation.

[0139] The implementation of a residual block RB provides a skip connection, which bypasses one or more layers. This connection passes the input of the block directly to its output, adding it to the output of the intermediate layer or layers. This is represented in [Fig. 15] in the RB block by an arrow starting from the input of the block and allowing to add the variables or coefficients with the variables or coefficients at the output of the RB block before the last activation layer LR. One interest is to allow the error signal to propagate more efficiently through the network during backpropagation. This helps to mitigate the gradient vanishing problem, especially in very deep networks. A residual block RB comprises at least one convolution layer CONV, one normalization layer LN and one rectified activation layer LR. [Fig. 15] represents an example of such an architecture.

[0140] According to one embodiment, two “Attention Gates” in English terminology and noted AG in [Fig. 15] connect the encoder ENC and the decoder DEC.

[0141] According to one embodiment, the decoder also comprises three blocks. The first two blocks each respectively comprise a transposed convolution layer CONV_T, a normalization layer denoted LN and a rectified activation layer ReLU, denoted LR. The final block of the decoder comprises two transposed convolution layers CONV_T separated by a memory layer composed of a BiGRU denoted BG in [Fig. 15].

[0142] The DEC decoder allows the reconstruction of the segmented signal from the characteristics learned by the encoder. Cost function

[0143] According to one embodiment, the training method comprises the implementation of a cost function making it possible to calculate the error between the produced output S2 a' representing the reconstructed ECG signal and the initial measured ECG signal S2'. The machine learning model generates an ECG signal S2 a' which is therefore compared to the signal S2 ' corresponding to the input E2 to calculate this error and minimize it by modifying the coefficients of the convolution layers. The difference A = IS2'-S2b'l is measured from a distance function such as a quadratic error for example.

[0144] According to one embodiment, the method comprises a feedback loop, for example carried out by means of gradient descent, which allows the network to be trained by modifying the coefficients of the matrices of the convolution layers.

[0145] The ECG signals measured by the S2 electrodes can be split into two groups. A first set of signals is used within the cost function for training the network and the second set of signals is used to validate that sufficient training allows given performances to be obtained.

[0146] The output signals of the neural network for training are denoted S2a' and for the use of the trained network the output signals of the network are denoted S2b'.

[0147] Recombination of signals to form the continuous ECG

[0148] [Fig.3] represents the recombination steps of the reconstructed segmented signals. The recombination step is denoted RECOMBi. In this figure the segmentation step is denoted SEGi and the processing step by the trained neural network is denoted MLi.

[0149] The PPG signal acquired by a measuring device is denoted Sp The signal processed by the trained neural network is denoted Si'. The signal output by the trained neural network is denoted S2b' and the recombined signal is denoted S2b.

[0150] [Fig. 16] shows ECG signals S2 b' produced for different epochs following one another with the first segmentation. The signals S2 b(t;)', S2 b(ti+i)' and S2 b(ti+2)' are shown.

[0151] [Fig. 17] represents ECG signals S2 b' produced for different epochs succeeding one another with the second segmentation. The signals S2 b(t;)', S2 b(ti+1)' and S2 b(tj+2)' are represented with this second segmentation.

[0152] With the first or second segmentation, the invention makes it possible to recombine these signals with each other in order to produce a continuous signal.

[0153] We denote S2 b' the non-recombined signals at the output of the neural network and we denote S2 b the recombined signals forming a continuous signal comprising a plurality of epochs.

[0154] For this purpose, the method for generating an ECG comprises a step of combining the signals formed by the output vectors of the neural network. The reconstruction is carried out continuously so as to form a continuous ECG signal. The sequence of reconstructed ECG signals is recorded in a memory so as to allow exploitation by a computer embedded in the PPG measuring device or by a remote computer, for example that of a computer, a digital tablet or a server.

[0155] The training method made it possible to generate segmented ECG signals faithful to those which could have been measured by electrodes of an ECG. An advantage of the method of the invention is that a simple PPG measuring device makes it possible to generate a continuous ECG signal which can be used to detect singularities of the ECG signal such as arrhythmias, QRS complex fragmentation rates, variations in heart rate.

[0156] In order to reconstruct the signals produced by the machine learning model, the method for generating the ECG comprises a detection of consecutive ECG markers. [Fig. 16] represents only the markers MECgi and MECg2 on the first signal S2 b(ti). The markers used can be local minima or local maxima such as the marker MECgi and the marker MECG2. The second signals S2 b generated by the machine learning model MLi will be “glued together” to form a continuous signal using the markers present in each cycle of said second signal S2'. In other words, the recombination can be carried out by concatenating the segments produced by the neural network from the temporal markers.

[0157] The detection of markers can be carried out using an algorithm that allows two elements to be taken into account: the search for local minimums or local maximums and the heart rate. Indeed, by correlating these two pieces of information, the method of the invention ensures that the correct local minimum is considered in combination with the heart rate analyzed upstream of the neural network, during the acquisition of the signals.

[0158] With regard to the training method, the heart rate can be deduced from the PPG signal or from the acquired ECG signal. With regard to the method of generating the ECG signal, the heart rate is advantageously deduced from the PPG signal acquired by the device.

[0159] One interest is to search for a local minimum or maximum around the heart rate to avoid considering a marker corresponding to the marker of the previous cycle. For this purpose a predefined margin of error can be used to search for a local maximum or minimum around a point in the cycle.

[0160] The segments are then combined so as to join one end of one segment with another end of the next segment instead of the maximum value of the local maximum or local minimum, i.e. the marker generated at each cycle. For example, the segments can be joined together at the top of the R peaks.

[0161] Sometimes, because the segmented data of the ECG and the PPG are not perfectly consistent with the relationship that exists between the PPG and the ECG signal, in particular because the arrival time of the pulse has been considered constant, the method of the invention comprises a step of interpolating the RR segments to the length of the local maxima or local minima of the corresponding PPG signal. One advantage is to reinject the known knowledge of the acquired PPG signal in order to obtain the most reliable and faithful reconstructed ECG signal possible.

[0162] [Fig. 18] represents a first diagram comprising the acquired PPG signal Si, a second diagram comprising the reconstructed ECG signal S2 b, and a third diagram representing the two signals Si and S2 b allowing the local maxima and local minima of each cycle to be visualized.

[0163] An advantage of the invention is that it allows an ECG to be reconstructed in real time and continuously from the measurement of a PPG signal. One advantage is that a PPG device only requires one measurement point and can be embedded in a device such as a bracelet or a watch.

[0164] An advantage of the invention is to take advantage of a trained neural network to reconstruct an ECG signal from a cycle of a PPG signal and to reconstruct the signal continuously through analysis of the heart rate. Thus, the network's training is not affected by the frequency of the cycles, the variation in the rate and possible errors related to the reconstruction of the heart rate by the neural network.

Claims

Claims

1. A method for generating an ECG signal from a PPG signal and a trained machine learning (MLi) model comprising: • A first acquisition (ACQi) of a first signal (Si), called PPG signal, by means of a sensor arranged on a signal acquisition device in contact with the skin of an individual to measure the variations in the pulsatile volume of the blood • A sampling (ECHi) of the first signal (Si) at a predefined frequency; • A recording (ENRi) of the heart rate (Fc); • Segmentation (SEGi) of the first signal (Si) comprising: • Definition of a first time window (FTi) of a first predefined duration (Ti); • Extraction of a first set of sampled points (Ei) from the first PPG signal (Si), called PPG points, comprising a first subset of points (ENSn) between two consecutive PPG markers (Mppgi MPPg2) and a second subset (ENS 12) of consecutive points from the second PPG marker (MPpg2), the number of points of the second subset (ENS 12) being less than the number of bridges of the first subset (ENSn); • Positioning of said first segmented signal (Si ') in the first time window (Fn) from the second PPG marker (MpPG2); • Use of a trained learning model to produce an output vector (VECg) defining a second segmented signal (S2') of an ECG from an input vector (VP pg) comprising the data of the first set (Ei); • Recombination of segments (VECg) produced to reconstruct a continuous ECG signal from: • Detection of at least two consecutive ECG markers (MECG 1) of the second signal (S2') present in each cycle of said second signal (S2'); • Reconstruction of the ECG signal (S2b) by concatenation of the segments from the time markers S.

2. Method for generating an ECG signal from a PPG signal and a machine learning model (MLi) trained according to the preceding claim, characterized in that the heart rate (Fc) is used to identify the local maximum corresponding to the ECG marker sought.

3. Method for generating an ECG signal from a PPG signal and a machine learning model (MLi) trained according to the preceding claim, characterized in that the ECG markers used during the recombination of the segments are R peaks.

4. Method according to the preceding claim characterized in that two consecutive markers (MPPGi, MPPG2) of the first signal (Si) are used to interpolate the lengths between two consecutive ECG markers of the second signal (S2b).

5. Method according to any one of the preceding claims, characterized in that the machine learning model (MLi) is trained according to claim 6.

6. Method for training a neural network to generate an ECG from a PPG signal, said method comprising: • A first acquisition (ACQi) of a first signal (Si), called the PPG signal, by means of a sensor arranged on a signal acquisition device in contact with the skin of an individual to measure variations in the pulsatile volume of the blood • A second acquisition (ACQ2) of a second signal (S2), called the ECG signal, by means of at least one pair of electrodes affixed to the skin of an individual; • A sampling (ECHi, ECH2) of the first signal (Si) and the second signal (S2) each at a predefined frequency; • A recording (ENRi) of the heart rate (Fc); • A synchronization (SYNCi) of the first signal (Si) with the second signal (S2), said synchronization (SYNCi) comprising: • Detection of at least one first PPG marker (MppGi) of the first signal (Si) present in each cycle of said first signal (Si); • Detection of at least one first ECG marker (MECgi) of the second signal (S2) present in each cycle of said second signal (S2); • Estimation of a transit time (TJ of the first PPG signal (S2); • Alignment of the two signals (Si, S2) from a shift of one of the two signals (Sb S2) of the value of the transit time (TJ; Segmentation (SEGi) of the first signal (SJ and the second signal (S2) comprising: • Definition of a first time window (Fn) of a first predefined duration (TJ; • Extraction of a first set of sampled points (EJ of the first PPG signal (Si), called PPG points, comprising a first subset of points (ENSh) between two consecutive PPG markers (Mppgi MppG2) and a second subset (ENS 12) of consecutive points of the second PPG marker (MpPG2); • Positioning of said first segmented signal (Si') in the first time window (FTi), said window comprising the two consecutive PPG markers (MPPgi, MppG2); • Definition of a second time window (FT2) of a second predefined duration (T2); • Extraction of a second set of sampled points (E2) from the second ECG signal (S2), called ECG points, comprising a first subset of points (ENS2i) between two consecutive ECG markers (MECgi,MECg2) and a second subset (ENS 22) of consecutive points from a second marker (M ECG2); • Positioning of said second segmented signal (S2') in the first time window (Fn), said fe being comprising the two consecutive ECG markers (MECgi, MECg2); • Training of a machine learning model (MLi) comprising: • Generation of input vectors comprising the first set of points (Ei); • Implementation of a loss function from the second set of points (E2); • Generation of a trained machine learning model (MLi).

7. Method according to claim 6 characterized in that the first marker (Mi) is an R peak of a QRS complex and in that the second marker (M2) is a local minimum of the second signal.

8. Method according to claim 6 characterized in that the transit time is estimated by means of calculating the minimum difference measured between two markers (Mb M2) of each of the two signals (Si, S2) considered in the same cycle.

9. Method according to any one of claims 6 to 8 characterized in that the second subset (ENS22) of points of the second segmented ECG signal (S2') consecutive to a second marker (MECg2) comprises a number of points less than the number of points of the first subset (ENS2i).

10. Method according to any one of claims 6 to 9 characterized in that a third subset of points (ENS23) of the second set of points (E2) comprises a set of ECG points of the same value succeeding the second subset of points (ENS22) so as to complete the second time window (FT2).

11. Method according to any one of claims 6 to 10, characterized in that the acquisition of the heart rate (Fc) is carried out by means of the analysis of the second ECG signal (S2) comprising the estimation of the intervals between two consecutive peaks (RJ) of the acquired ECG signal, called RR intervals.

12. Method according to claim 11 characterized in that it comprises an indicator of the difference between the heart rate (Fc) calculated from the PPG signal (Si) and that calculated from the ECG signal (S2).

13. Method according to any one of claims 1 to 12 characterized in that the second subset (ENSi2) of points of the first consecutive segmented PPG signal (Si') of a second marker (MPPG 2) comprises a number of points less than the number of points of the first subset (ENS21).

14. Method according to any one of claims 1 to 13 characterized in that a third subset of points (ENS b) of the first set of points (EJ comprises a set of PPG points of the same value succeeding the second subset of points (ENS12) so as to complete the first time window (Fn).

15. Method according to any one of claims 1 to 14 characterized in that the machine learning model (CNNi) is a convolutional neural network called CNN.

16. Method according to claim 15 characterized in that the CNN neural network is a U-NET type network composed of an encoder, a decoder and a tool making it possible to concentrate the neural network on the most important or relevant parts of the data, a tool called Attention Gate.

17. Method according to any one of claims 1 to 16 characterized in that the training of the coefficients of the machine learning model (MLi) is carried out from an optimizer and an implementation of a cost function.

18. Method according to any one of claims 1 to 17 characterized in that the acquisition of the heart rate (Fc) is carried out by means of the analysis of the first PPG signal (Si) comprising the estimation of the intervals between two consecutive markers of the acquired PPG signal.

19. A device for generating a continuous ECG signal comprising a PPG signal sensor and a computer and a memory for implementing the method of any one of claims 1 to 5.

Images