Biometric information acquisition device, processing device, and computer program

Abstract

To enhance interpretation performance for a result of biological information processing executed using a deep layer learning technique.SOLUTION: A biological information acquisition unit 10 acquires biological information on a subject 20. An input interface 111 receives waveform data WD corresponding to a measurement waveform of the biological information from a sensor 30. An inference unit 112a extracts a feature amount from the waveform data WD using a convolution neural network, and infers the probability of the waveform data WD being classified into each of a plurality of classes. A degree-of-importance specification unit 112b specifies a degree of importance of the feature amount for an inference result of the probability on at least one of the plurality of classes. An output unit 12 outputs the inference result and an index indicating the degree of importance together with the measurement waveform WF.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an apparatus for acquiring biological information of a subject. The present invention also relates to a processing device for processing the biological information, and a computer program executable by a processor of the processing device. [Background technology]

[0002] Patent Document 1 discloses a device for measuring a pulse wave, which is an example of biological information of a subject. If it is determined that a noise of a predetermined level or more is mixed in the measured waveform of the pulse wave obtained from a sensor, a notification is given to the user. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2009-100934 A Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present invention is to improve the interpretability of the results of processing of biological information using deep learning techniques. [Means for solving the problem]

[0005] One aspect of the present invention to achieve the above object is a biological information acquiring device for acquiring biological information of a subject, comprising: an input interface that receives waveform data corresponding to a measured waveform of the biological information from a sensor; an inference unit that extracts features from the waveform data using a convolutional neural network and infers the probability that the waveform data will be classified into each of a plurality of classes; an importance specification unit that specifies an importance of the feature amount with respect to an inference result of the probability for at least one of the plurality of classes; an output unit that outputs the inference result and an index indicating the importance together with the measured waveform; It is equipped with:

[0006] One aspect of the present invention to achieve the above object is a processing device for processing biological information of a subject, comprising: an input interface that receives waveform data corresponding to a measured waveform of the biological information from a sensor; a processor that uses a convolutional neural network to extract features from the waveform data, infer a probability that the waveform data will be classified into each of a plurality of classes, specifies a degree of importance of the features with respect to the inference result of the probability for at least one of the plurality of classes, and causes an output device to output the inference result and an index indicating the degree of importance together with the measured waveform; It is equipped with:

[0007] One aspect for achieving the above object is a computer program executable by a processor of a processing device for processing biological information of a subject, the computer program comprising: When executed, the processing device: receiving waveform data corresponding to a measured waveform of the biological information from a sensor; extracting features from the waveform data using a convolutional neural network to infer the probability that the waveform data falls into each of a plurality of classes; determining an importance of the feature to the probability inference for at least one of the classes; The inference result and an index indicating the importance are output to an output device together with the measured waveform.

[0008] Attempts are being made to use deep learning models to make judgments about a subject's biological information. However, when using deep learning models, it is fundamentally difficult to obtain a clear basis for the inference results. In the medical field, there is a tendency to avoid ambiguous grounds for judgments.

[0009] According to the configurations of the above aspects, while using a convolutional neural network, which is a deep learning technology, to make a judgment on biological information, by visually presenting to a user information that can be the basis for inference through an index showing which part of the measured waveform contributed to the judgment, it is possible to leave the interpretation or verification of the judgment result to the user. Therefore, it is possible to improve the interpretability of the processing result of biological information made using deep learning technology. [Brief description of the drawings]

[0010] [Figure 1] 1 illustrates a configuration of a biological information acquisition device according to an embodiment. [Diagram 2] 2 illustrates an example of importance determined by the importance determining unit in FIG. 1; [Diagram 3] 2 shows an example of a display on the display unit of FIG. 1. [Figure 4] 1 illustrates an example of a noise-contaminated measured electrocardiogram waveform. [Diagram 5] 2 shows an example of a process performed by the inference unit of FIG. 1. [Figure 6] 6 shows an example of a display on a display unit based on the processes of FIGS. 4 and 5. [Figure 7] 6 shows another example of a display on the display unit based on the processes of FIGS. 4 and 5. [Figure 8] 1. FIG. 4 shows another example of the display on the display unit of FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Exemplary embodiments are described in detail below with reference to the accompanying drawings.

[0012] 1 illustrates an example of a configuration of a biological information acquiring device 10 according to an embodiment. The biological information acquiring device 10 is configured to acquire an electrocardiogram of a subject 20. The electrocardiogram is an example of biological information.

[0013] The biological information acquiring device 10 includes a processing device 11. The processing device 11 is configured to process an electrocardiogram of the subject 20 acquired by the biological information acquiring device 10.

[0014] The processing device 11 includes an input interface 111. The input interface 111 is configured to receive waveform data WD corresponding to a measured waveform WF of an electrocardiogram of the subject 20 through the sensor 30. The waveform data WD corresponds to a change over time in the measured electrocardiogram potential. The waveform data WD may be in the form of analog data or digital data depending on the specifications of the sensor 30. When the waveform data WD is in the form of analog data, the input interface 111 includes an appropriate conversion circuit including an A / D converter.

[0015] The processing device 11 includes a processor 112. The processor 112 may be realized by a general-purpose microprocessor that operates in cooperation with a general-purpose memory. Examples of the general-purpose microprocessor include a CPU, an MPU, and a GPU. Examples of the general-purpose memory include a ROM and a RAM. In this case, the ROM may store a computer program that executes the above-mentioned processing. The ROM is an example of a non-transitory computer-readable medium that stores a computer program. The general-purpose microprocessor specifies at least a part of the program stored on the ROM, expands it on the RAM, and executes the above-mentioned processing in cooperation with the RAM. The computer program may be pre-installed in the general-purpose memory, or may be downloaded from an external server via a communication network and then installed in the general-purpose memory. In this case, the external server is an example of a non-transitory computer-readable medium that stores a computer program.

[0016] The processor 112 may be realized by a dedicated integrated circuit capable of executing the above computer program, such as a microcontroller, an ASIC, or an FPGA. In this case, the above computer program is pre-installed in a storage element included in the dedicated integrated circuit. The storage element is an example of a computer-readable medium storing a computer program. The processor 112 may also be realized by a combination of a general-purpose microprocessor and a dedicated integrated circuit.

[0017] By executing the above computer program, the processor 112 can operate as an inference unit 112a. The inference unit 112a is configured to extract features from the waveform data WD using a convolutional neural network (CNN) and infer the probability that the waveform data WD is classified into each of a plurality of classes. Examples of the CNN include GoogleNet, ResNet, LeNet, AlexNet, and VGG.

[0018] In this example, the waveform data WD is classified into a "no noise" class and a "noise" class. The "no noise" class corresponds to a state in which it is determined that no noise is superimposed on the measured electrocardiogram waveform WF acquired from the subject 20. The "noise" class corresponds to a state in which it is determined that noise is superimposed on the measured electrocardiogram waveform WF acquired from the subject 20.

[0019] The CNN uses a trained model obtained by performing training in advance using as training data a large amount of waveform data corresponding to the measured waveform of an electrocardiogram that is known to have noise superimposed thereon and a large amount of waveform data corresponding to the measured waveform of an electrocardiogram that is known not to have noise superimposed thereon. Specifically, at least one of the weights and bias values ​​in the feature extraction layer and classification layer is adjusted so that the difference between the inference result output from the CNN and the correct answer is reduced.

[0020] Therefore, the feature amount in this example corresponds to a part of the measured waveform WF having a shape that serves as a clue for obtaining an inference result.

[0021] The biometric information acquisition device 10 includes an output unit 12. The processing device 11 includes an output interface 113. The processor 112 is configured to output an output control signal OC, which causes the output unit 12 to output an inference result by the inference unit 131, from the output interface 113. The output control signal OC may be an analog signal or a digital signal depending on the specifications of the output unit 12. When the output control signal OC is an analog signal, the output interface 113 includes an appropriate conversion circuit including a D / A converter.

[0022] The output unit 12 is a user interface that notifies the user of the inference result by the inference unit 131 based on the output control signal OC. The inference result is output through at least one of a visual notification, an auditory notification, and a tactile notification. The output unit 12 is an example of an output device. The output unit 12 includes a display unit 121. When the inference result is output through a visual notification, the display unit 121 may be used.

[0023] In the example shown in Figure 1, it is inferred that there is a 95.4% probability that noise is superimposed on the measured electrocardiogram waveform WF obtained from the subject 20, and that there is a 4.6% probability that noise is not superimposed on the measured waveform WF.

[0024] By executing the above computer program, the processor 112 can operate as an importance determining unit 112b. The importance determining unit 112b is configured to perform a process of determining the importance of the feature extracted by the inference unit 112a to the inference result by using Gradient-weighted Class Activation Mapping (Grad-CAM).

[0025] The importance identification unit 112b is configured to apply Grad-CAM to at least one of the classes used in the classification by the inference unit 112a. That is, in the above example, Grad-CAM is applied to at least one of the "noisy" class and the "noisy" class.

[0026] FIG. 2 illustrates an example in which Grad-CAM is applied to the "noisy" class. The dashed line indicates the identified importance. The importance is shown as a probability taking a value from 0 to 1 or from 0% to 100%. That is, in this example, the importance of each feature extracted by the inference unit 112a is identified for the above inference result that the probability that noise is superimposed on the measured electrocardiogram waveform WF acquired from the subject 20 is 95.4%.

[0027] Specifically, for each feature extracted by the inference unit 112a, a process is performed in which the value of the waveform data WD corresponding to a part of the measured waveform WF related to the feature is changed by the same amount, and the change in the inference result (probability value) caused by the change is observed. A feature that causes a larger change in the probability value due to the change is determined to have a larger importance.

[0028] This identifies which parts of the measured waveform WF illustrated in FIG. 2 have greater importance for inferring the probability of noise being superimposed.

[0029] The processor 112 is configured to output a display control signal DC, which causes the display unit 121 to display a color indicating the importance identified by the importance identification unit 112b together with the measured waveform WF, from the output interface 113. The display control signal DC may be an analog signal or a digital signal depending on the specifications of the display unit 121. When the display control signal DC is an analog signal, the output interface 113 includes an appropriate conversion circuit including a D / A converter.

[0030] 3, the display unit 121 can be configured to display a color indicating the importance identified by the importance identification unit 112b superimposed on the measured waveform WF based on the display control signal DC. In this example, a darker color is assigned to the inference result that the probability of "noise present" is 95.4%, indicating a higher importance. The "darker color" may be achieved by changing the brightness or saturation of a specific color, or by using another color having a hue that can be recognized as a darker color. The color is an example of an indicator.

[0031] The importance may be divided into a number of ranges of values. In this case, each range of values ​​may be assigned a different color and / or pattern to distinguish the ranges of values ​​from one another. The pattern is also an example of an index.

[0032] Attempts are being made to use deep learning models to make judgments about a subject's biological information. However, when using deep learning models, it is fundamentally difficult to obtain a clear basis for the inference results. In the medical field, there is a tendency to avoid ambiguous grounds for judgments.

[0033] According to the configuration of this embodiment, while using a convolutional neural network, which is a deep learning technology, to make a judgment on the biological information, information that can be the basis for the inference is visually presented to the user through an index showing which part of the measured waveform WF contributed to the judgment, so that the interpretation or verification of the judgment result can be left to the user. For example, in the case of the example shown in FIG. 3, the user can verify whether the inference result by the inference unit 112a is valid by focusing on the part of the measured waveform WF corresponding to the part displayed in dark color. Therefore, the interpretability of the processing result of the biological information made using the deep learning technology can be improved.

[0034] Another example of the process that can be executed in the biometric information acquisition device 10 will be described with reference to FIGS.

[0035] Figure 4 shows examples of electrocardiogram measurement waveforms with superimposed noise. Measurement waveform N1 is an example of a measurement waveform with superimposed noise due to baseline fluctuation. Measurement waveform N2 is an example of a measurement waveform with superimposed myoelectric noise. Measurement waveform N3 is an example of a measurement waveform with superimposed noise due to electrode deterioration or misalignment.

[0036] The inference unit 112a according to the present example extracts features from waveform data WD corresponding to the measured waveform WF of an electrocardiogram acquired from the subject 20, and infers the probability that the waveform data WD is classified into each of a "no noise" class, a "baseline fluctuation noise" class, a "myoelectric noise" class, and an "electrode noise" class. The "baseline fluctuation noise" class corresponds to a state in which it is determined that noise originating from baseline fluctuation is superimposed on the measured waveform WF of an electrocardiogram acquired from the subject 20. The "myoelectric noise" class corresponds to a state in which it is determined that myoelectric noise is superimposed on the measured waveform WF of an electrocardiogram acquired from the subject 20. The "electrode noise" class corresponds to a state in which it is determined that noise originating from electrodes is superimposed on the measured waveform WF of an electrocardiogram acquired from the subject 20.

[0037] In the example shown in Fig. 5, it is inferred that the probability that noise is not superimposed on the measured waveform WF of the electrocardiogram acquired from the subject 20 is 4.6%. It is inferred that the probability that noise resulting from baseline fluctuation is superimposed on the measured waveform WF of the electrocardiogram acquired from the subject 20 is 0.1%. It is inferred that the probability that myoelectric noise is superimposed on the measured waveform WF of the electrocardiogram acquired from the subject 20 is 92.1%. It is inferred that the probability that noise resulting from electrodes is superimposed on the measured waveform WF of the electrocardiogram acquired from the subject 20 is 3.2%. That is, the inference unit 112a infers that noise is superimposed on the measured waveform WF of the electrocardiogram acquired from the subject 20, and that the noise is generally myoelectric noise.

[0038] The importance determination unit 112b in this example applies Grad-CAM to the inference results relating to each of the “baseline fluctuation noise” class, “myoelectric noise” class, and “electrode noise” class, and determines the importance of the inference results relating to each class of the features of the waveform data WD extracted by the inference unit 112a.

[0039] As a result, as illustrated in Figure 6, an index I1 indicating the importance of the feature with respect to the probability that the measured waveform WF will be classified into the "baseline fluctuation noise" class, an index I2 indicating the importance of the feature with respect to the probability that the measured waveform WF will be classified into the "myoelectric noise" class, and an index I3 indicating the importance of the feature with respect to the probability that the measured waveform WF will be classified into the "electrode noise" class are displayed on the display unit 121 together with the measured waveform WF.

[0040] Each of the indices I1, I2, and I3 includes a color corresponding to the identified importance. Similar to the example shown in FIG. 3, darker colors are assigned to higher importance. However, the color intensity is based on the relative importance within each class, and does not indicate absolute importance across all classes.

[0041] One of the "baseline perturbation noise" class, the "electromyographic noise" class, and the "electrode noise" class may be an example of the first class. In this case, another one of the "baseline perturbation noise" class, the "electromyographic noise" class, and the "electrode noise" class may be an example of the second class.

[0042] Here, the probability that the waveform data WD inferred by the inference unit 112a is classified into the first class is an example of a first inference result. The importance of the feature amount identified by the importance identification unit 112b with respect to the first inference result is an example of a first importance. The index indicating the first importance is an example of a first index.

[0043] Similarly, the probability that the waveform data WD inferred by the inference unit 112a is classified into the second class is an example of a second inference result. The importance of the feature amount identified by the importance identification unit 112b with respect to the second inference result is an example of a second importance. The index indicating the second importance is an example of a second index.

[0044] According to the configuration of this example, an index indicating the importance of the feature amount to the inference result is provided for the multiple classes used for classification by the inference unit 112a. Therefore, the user can verify whether the inference result by the inference unit 112a is valid for multiple noise cause candidates. For example, it is possible to confirm not only which part of the measured waveform WF contributed to the determination that the probability of myoelectric noise being superimposed is the highest, but also which part of the measured waveform WF contributed to the determination that there is a possibility that electrode noise is superimposed. This can enable more multifaceted interpretation and verification of the determination made using deep learning technology.

[0045] In this example, the indexes I1, I2, and I3 are displayed on the display unit 121 so as not to overlap the measured waveform WF.

[0046] According to such a configuration, it is possible to prevent a decrease in visibility of the measured waveform WF due to a plurality of indices being displayed on the display unit 121. The display method according to this example is also applicable to the example of Fig. 3 in which an index is provided for a single class.

[0047] On the other hand, as illustrated in Fig. 7, a plurality of indices each assigned with a different color for each classified class may be displayed so as to overlap with the measured waveform WF. For example, an indice having a first color is assigned to indicate the importance of a feature to an inference result related to the "baseline perturbation noise" class. An indice having a second color is assigned to indicate the importance of a feature to an inference result related to the "myoelectric noise" class. An indice having a third color is assigned to indicate the importance of a feature to an inference result related to the "electrode noise" class. The expression "different colors" used in this specification means colors that differ in at least one of hue, brightness, and saturation.

[0048] Note that, if the multiple classes can be distinguished from one another, different patterns may be assigned to each class.

[0049] In this case, in order to prevent a decrease in visibility of the measured waveform WF due to multiple types of indices being displayed in a superimposed manner, it is preferable that indices are displayed only for areas corresponding to features having importance exceeding a threshold value.

[0050] The above-described embodiment is merely an example for facilitating understanding of the present invention. The configurations according to the above-described embodiment may be appropriately modified or improved without departing from the spirit and scope of the present invention.

[0051] In the above embodiment, the indicator displayed on the display unit 121 includes a color that changes according to the importance level identified by the importance level identification unit 112b. However, the graph display used in FIG. 2 to explain the importance level may also be adopted as the indicator. In this case, the indicator may be displayed so as to overlap with the measured waveform WF, or may not be displayed so as to overlap with it.

[0052] A part of the measured waveform WF may be displayed in a different manner according to the importance specified by the importance specifying unit 112b. For example, the color or line type of a part of the measured waveform WF determined to have high importance may be changed, or the part may be highlighted by blinking, etc. Such a display manner is also an example of an index.

[0053] The biological information of the subject 20 acquired by the biological information acquisition device 10 is not limited to an electrocardiogram. The presence or absence of noise superimposition and the type of superimposed noise can also be inferred for measured waveforms such as pulse waves, electroencephalograms, invasive blood pressure, and respiration. Fig. 8 shows an example in which, when it is inferred that noise is superimposed on the measured waveform WF of a pulse wave based on the feature extracted from the measured waveform WF, an indicator showing the importance of the feature to the inference result is displayed on the display unit 121.

[0054] Specifically, colors corresponding to the importance are displayed as indicators superimposed on the measured waveform WF. As in the example of Figure 3, darker colors are assigned to higher importance.

[0055] The subject of inference by the inference unit 112a is not limited to the presence or absence of noise superposition. For example, the subject of inference may be the acquired biometric information and the presence or absence of a symptom associated with the biometric information. The presence or absence of a symptom is an example of a plurality of classes. Examples of combinations of biometric information and symptoms include an electrocardiogram and atrial fibrillation, a pulse wave and arrhythmia, an electroencephalogram and epileptic seizure, an invasive blood pressure and hypertension, and respiration and apnea syndrome.

[0056] In the above embodiment, the inference unit 112a and the importance identification unit 112b are described as functional modules realized by the same processor 112. However, the processor that realizes the function of the inference unit 112a and the processor that realizes the function of the importance identification unit 112b may be different.

[0057] In the above embodiment, the output unit 12 that outputs the inference result and the index together with the measured waveform WF is mounted on the bioinformation acquisition device 10. However, the function of the output unit 12 can be realized in an independent output device that is capable of data communication with the bioinformation acquisition device 10 via a communication network. In this case, the processor 112 of the processing device 11 transmits, from the output interface 113, an output control signal OC and a display control signal DC that cause the output device to notify the inference result and display the measured waveform WF and the index.

[0058] In the above embodiment, the processing device 11 is mounted on the bioinformation acquisition device 10. However, at least a part of the functions of the processing device 11 may be realized by a processor mounted on a cloud server device capable of data communication with the bioinformation acquisition device 10 via a communication network. In this case, the waveform data WD is transmitted from the sensor 30 or the bioinformation acquisition device 10 to the cloud server device, and the inference process and the importance identification process may be performed by the processor. The processor transmits an output control signal OC and a display control signal DC from the cloud server device to the bioinformation acquisition device 10, which causes the bioinformation acquisition device 10 to notify the inference result and display the measured waveform WF and the index. The bioinformation acquisition device 10 executes an operation based on the received output control signal OC and display control signal DC. The device that executes the operation based on the output control signal OC and display control signal DC transmitted from the cloud server device may be an output device independent of the bioinformation acquisition device 10. [Explanation of symbols]

[0059] 10: bioinformation acquisition device, 11: processing device, 111: input interface, 112: processor, 112a: inference unit, 112b: importance determination unit, 12: output unit, 121: display unit, 20: subject, I1 to I3: indexes, WD: waveform data, WF: measured waveform

Claims

1. A biological information acquiring device for acquiring biological information of a subject, an input interface that receives waveform data corresponding to a measured waveform of the biological information from a sensor; an inference unit that extracts features from the waveform data using a convolutional neural network and infers the probability that the waveform data will be classified into each of a plurality of classes; an importance specification unit that specifies an importance of the feature amount with respect to an inference result of the probability for at least one of the plurality of classes; an output unit that outputs an indicator of the importance together with the measured waveform; Equipped with The indicator is at least one of a color and a pattern corresponding to the importance. Biometric information acquisition device.

2. A biometric information acquisition device for acquiring biometric information of a subject, an input interface that receives waveform data corresponding to a measured waveform of the biological information from a sensor; an inference unit that extracts features from the waveform data using a convolutional neural network and infers the probability that the waveform data will be classified into each of a plurality of classes; an importance specification unit that specifies an importance of the feature amount with respect to an inference result of the probability for at least one of the plurality of classes; an output unit that outputs an indicator of the importance together with the measured waveform; Equipped with The indicator is displayed so as to overlap with the measurement waveform. Biometric information acquisition device.

3. A biometric information acquisition device for acquiring biometric information of a subject, an input interface that receives waveform data corresponding to a measured waveform of the biological information from a sensor; an inference unit that extracts features from the waveform data using a convolutional neural network and infers the probability that the waveform data will be classified into each of a plurality of classes; an importance specification unit that specifies an importance of the feature amount with respect to an inference result of the probability for at least one of the plurality of classes; an output unit that outputs an indicator of the importance together with the measured waveform; Equipped with the output unit outputs a first inference result that is an inference result of the probability for a first class included in the plurality of classes, and a second inference result that is an inference result of the probability for a second class included in the plurality of classes; the importance specifying unit specifies a first importance which is an importance of the feature amount with respect to the first inference result and a second importance which is an importance of the feature amount with respect to the second inference result; The index includes a first index indicating the first importance and a second index indicating the second importance and different from the first index. Biometric information acquisition device.

4. A biometric information acquisition device for acquiring biometric information of a subject, an input interface that receives waveform data corresponding to a measured waveform of the biological information from a sensor; an inference unit that extracts features from the waveform data using a convolutional neural network and infers the probability that the waveform data will be classified into each of a plurality of classes; an importance specification unit that specifies an importance of the feature amount with respect to an inference result of the probability for at least one of the plurality of classes; an output unit that outputs an indicator of the importance together with the measured waveform; Equipped with the output unit outputs a first inference result that is an inference result of the probability for a first class included in the plurality of classes, and a second inference result that is an inference result of the probability for a second class included in the plurality of classes; the importance specifying unit specifies a first importance which is an importance of the feature amount with respect to the first inference result and a second importance which is an importance of the feature amount with respect to the second inference result; the index includes a first index indicating the first importance and a second index indicating the second importance, The first index and the second index are displayed so as not to overlap with the measurement waveform. Biometric information acquisition device.

5. A processing device for processing biological information of a subject, an input interface that receives waveform data corresponding to a measured waveform of the biological information from a sensor; a processor that uses a convolutional neural network to extract features from the waveform data, infer a probability that the waveform data will be classified into each of a plurality of classes, specifies a degree of importance of the features with respect to the inference result of the probability for at least one of the plurality of classes, and causes an output device to output the inference result and an index indicating the degree of importance together with the measured waveform; Equipped with The indicator is at least one of a color and a pattern corresponding to the importance. Processing unit.

6. A computer program executable by a processor of a processing device for processing biological information of a subject, When executed, the processing device: receiving waveform data corresponding to a measured waveform of the biological information from a sensor; extracting features from the waveform data using a convolutional neural network to infer the probability that the waveform data falls into each of a plurality of classes; determining an importance of the feature to the probability inference for at least one of the classes; outputting the inference result and the index indicating the importance together with the measured waveform to an output device; The indicator is at least one of a color and a pattern corresponding to the importance. Computer program.

7. A processing device for processing biological information of a subject, comprising: an input interface that receives waveform data corresponding to a measured waveform of the biological information from a sensor; a processor that uses a convolutional neural network to extract features from the waveform data, infer a probability that the waveform data will be classified into each of a plurality of classes, specifies a degree of importance of the features with respect to the inference result of the probability for at least one of the plurality of classes, and causes an output device to output the inference result and an index indicating the degree of importance together with the measured waveform; Equipped with The indicator is displayed so as to overlap with the measurement waveform. Processing unit.

8. A computer program executable by a processor of a processing device for processing biological information of a subject, When executed, the processing device: receiving waveform data corresponding to a measured waveform of the biological information from a sensor; extracting features from the waveform data using a convolutional neural network to infer the probability that the waveform data falls into each of a plurality of classes; determining an importance of the feature to the probability inference for at least one of the classes; outputting the inference result and the index indicating the importance together with the measured waveform to an output device; The indicator is displayed so as to overlap with the measurement waveform. Computer program.

9. A processing device for processing biological information of a subject, comprising: an input interface that receives waveform data corresponding to a measured waveform of the biological information from a sensor; a processor that uses a convolutional neural network to extract features from the waveform data, infer a probability that the waveform data will be classified into each of a plurality of classes, specifies a degree of importance of the features with respect to the inference result of the probability for at least one of the plurality of classes, and causes an output device to output the inference result and an index indicating the degree of importance together with the measured waveform; Equipped with the processor causes the output device to output a first inference result, which is an inference result of the probability for a first class included in the plurality of classes, and a second inference result, which is an inference result of the probability for a second class included in the plurality of classes; the processor identifies a first importance that is an importance of the feature amount relative to the first inference result and a second importance that is an importance of the feature amount relative to the second inference result; The index includes a first index indicating the first importance and a second index indicating the second importance and different from the first index. Processing unit.

10. A computer program executable by a processor of a processing device for processing biological information of a subject, When executed, the processing device: receiving waveform data corresponding to a measured waveform of the biological information from a sensor; extracting features from the waveform data using a convolutional neural network to infer the probability that the waveform data falls into each of a plurality of classes; determining an importance of the feature to the probability inference for at least one of the classes; outputting the inference result and the index indicating the importance together with the measured waveform to an output device; outputting, to the output device, a first inference result which is an inference result of the probability for a first class included in the plurality of classes, and a second inference result which is an inference result of the probability for a second class included in the plurality of classes; identifying a first importance level, which is an importance level of the feature quantity with respect to the first inference result, and a second importance level, which is an importance level of the feature quantity with respect to the second inference result; The index includes a first index indicating the first importance and a second index indicating the second importance and different from the first index. Computer program.

11. A processing device for processing biological information of a subject, comprising: an input interface that receives waveform data corresponding to a measured waveform of the biological information from a sensor; a processor that uses a convolutional neural network to extract features from the waveform data, infer a probability that the waveform data will be classified into each of a plurality of classes, specifies a degree of importance of the features with respect to the inference result of the probability for at least one of the plurality of classes, and causes an output device to output the inference result and an index indicating the degree of importance together with the measured waveform; Equipped with the processor causes the output device to output a first inference result, which is an inference result of the probability for a first class included in the plurality of classes, and a second inference result, which is an inference result of the probability for a second class included in the plurality of classes; the processor identifies a first importance that is an importance of the feature amount relative to the first inference result and a second importance that is an importance of the feature amount relative to the second inference result; the index includes a first index indicating the first importance and a second index indicating the second importance, The first index and the second index are displayed so as not to overlap with the measurement waveform. Processing unit.

12. A computer program executable by a processor of a processing device for processing biological information of a subject, When executed, the processing device: receiving waveform data corresponding to a measured waveform of the biological information from a sensor; extracting features from the waveform data using a convolutional neural network to infer the probability that the waveform data falls into each of a plurality of classes; determining an importance of the feature to the probability inference for at least one of the classes; outputting the inference result and the index indicating the importance together with the measured waveform to an output device; outputting, to the output device, a first inference result which is an inference result of the probability for a first class included in the plurality of classes, and a second inference result which is an inference result of the probability for a second class included in the plurality of classes; identifying a first importance level, which is an importance level of the feature quantity with respect to the first inference result, and a second importance level, which is an importance level of the feature quantity with respect to the second inference result; the index includes a first index indicating the first importance and a second index indicating the second importance, The first index and the second index are displayed so as not to overlap with the measurement waveform. Computer program.

Images