Biosignal processing systems and programs

Abstract

To provide a biosignal processing system capable of performing suitable processing for each characteristic interval of a biosignal.SOLUTION: A signal processing system comprises: an acquisition unit which acquires a measurement result concerning a predetermined object in a living body; an interval identification unit which identifies a time interval on the basis of at least one of the temporal position variation or temporal shape variation of the predetermined object; and a processing unit which performs processing according to the interval identified by the interval identification unit, with respect to the measurement result acquired by the identification unit.SELECTED DRAWING: Figure 1

Description

Technical Field

[0005] , , , , , , ,

[0006]

[0001] The present disclosure relates to a biological signal processing system and a program.

Background Art

[0002] Measurement of biological signals and processing of the measured biological signals have been performed. Conventionally, development regarding the processing of biological signals has been made.

[0003] In the technique described in Patent Document 1, each of a plurality of repetitive signal features in a biomedical signal is segmented, and one or more segments are analyzed to find values of a plurality of parameters that describe the shape of one or more segments, record the values, and track changes in the values through the biomedical signal has been proposed (see claim 1 of Patent Document 1). In this technique, for example, a template is defined based on the shape of one or more waveforms (see claim 19 of Patent Document 1).

Prior Art Documents

Patent Documents

[0004] <00,0002,0>

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the conventional techniques as described above, there are cases where optimization of processing for each characteristic section of a biological signal is insufficient.

[0006] For example, when measuring the waveform of a magnetocardiogram (MCG) signal, which is an example of a biological signal, fluctuations in the position of the heart (e.g., the overall position of the heart) or fluctuations in the shape of the heart (e.g., the shape of a part of the heart) may occur due to the movement of the human body containing the heart being measured. Therefore, if processing is performed on the entire length of the MCG signal waveform at once, sections where appropriate processing is achieved and sections where appropriate processing is not achieved may be mixed, resulting in an unoptimal outcome. Similar problems have also occurred with other biological signals, such as electrocardiogram (ECG) signals. Similar problems have also occurred with biological signals such as MRI (Magnetic Resonance Imaging) signals or CT (Computed Tomography) signals.

[0007] This disclosure has been made in consideration of these circumstances and aims to provide a biosignal processing system and program that can enable appropriate processing for each characteristic section of a biological signal. [Means for solving the problem]

[0008] One embodiment includes: an acquisition unit that acquires measurement results relating to a predetermined object in a living organism; an interval identification unit that identifies a temporal interval based on at least one of the temporal positional variation or temporal shape variation of the predetermined object; and a processing unit that performs processing on the measurement results acquired by the acquisition unit according to the interval identified by the interval identification unit. The section identification unit identifies the section based on at least one of the temporal positional variation or temporal shape variation of the predetermined object in the measurement result or other signals related thereto acquired by the acquisition unit, the measurement result or other signals include information of an indicator other than the biological organism, the section identification unit identifies at least one of the temporal positional variation or temporal shape variation of the predetermined object based on the information of the indicator, and the processing unit performs a process to align the position of the predetermined object with the measurement result and a second measurement result, which is another measurement result relating to the predetermined object and includes information of the indicator. It is a biosignal processing system.

[0009] One embodiment involves acquiring measurement results related to a predetermined object in a living organism. acquisition The function and at least one of the temporal variation in the position or temporal variation in the shape of the predetermined object are used to identify the temporal interval. Section identificationThe function and the acquired measurement results are processed according to the specified interval. process Functions and, in order to make them a reality on a computer A program wherein the interval identification function identifies the interval based on at least one of the temporal positional variation or temporal shape variation of the predetermined object in the measurement result or other signals related thereto acquired by the acquisition function, the measurement result or other signals include information of a non-biological indicator, the interval identification function identifies at least one of the temporal positional variation or temporal shape variation of the predetermined object based on the information of the indicator, and the processing function performs a process to align the position of the predetermined object with the measurement result and a second measurement result relating to the predetermined object which includes information of the indicator. It is a program. [Effects of the Invention]

[0010] According to this disclosure, it is possible to enable appropriate processing to be performed for each characteristic section of a biological signal in a biosignal processing system and program. [Brief explanation of the drawing]

[0011] [Figure 1] This figure shows a schematic configuration of a biosignal measurement system including a biosignal processing system according to an embodiment. [Figure 2] This figure shows an example of a biosignal according to the embodiment. [Figure 3] This figure shows an electrocardiogram signal (predetermined pattern signal) corresponding to a magnetocardiogram signal, which is an example of a biosignal according to the embodiment. [Figure 4] This figure shows an example of segmentation of a biosignal according to the present invention. [Figure 5] This figure shows an example of biological information at a reference position according to the embodiment. [Figure 6A] This figure shows an example of biological information at the first change position according to the embodiment. [Figure 6B] This figure shows an example of biological information at the first change position according to the embodiment. [Figure 7A] This figure shows an example of biological information at the second change position according to the embodiment. [Figure 7B] This figure shows an example of biological information at the second change position according to the embodiment. [Figure 8A] This figure shows an example of biological information in the first state according to the embodiment. [Figure 8B] This figure shows an example of biological information in the second state according to the embodiment. [Figure 8C] This figure shows an example of biological information in the third state according to the embodiment. [Figure 8D] It is a diagram showing an example of biological information in the fourth state according to the embodiment. [Figure 9] It is a diagram showing an example of the state of MRI measurement using the marker according to the embodiment. [Figure 10] It is a diagram showing an example of the state of measurement of a magnetic sensor using the marker according to the embodiment. [Figure 11] It is a diagram showing an example of the alignment result according to the embodiment. [Figure 12] It is a diagram showing an example of the procedure of processing performed by the biological signal processing system in the biological signal measurement system according to the embodiment. [Figure 13] It is a diagram showing another example of the procedure of processing performed by the biological signal processing system in the biological signal measurement system according to the embodiment.

Mode for Carrying Out the Invention

[0012] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0013] [Biological Signal Measurement System] FIG. 1 is a diagram showing a schematic configuration of a biological signal measurement system 1 including a biological signal processing system 12 according to the embodiment. The biological signal measurement system 1 includes a biological signal measurement device 11 and a biological signal processing system 12. In the present embodiment, a configuration example in which the biological signal measurement device 11 and the biological signal processing system 12 are separate bodies is shown. However, as another configuration example, the biological signal processing system 12 may include the biological signal measurement device 11. Note that the measurement may be referred to as, for example, measurement, detection, or inspection.

[0014] [Biological Signal Measurement Device: Example of Magnetic Sensor] The biological signal measurement device 11 measures biological signals. In this example, the biosignal measurement device 11 is equipped with a magnetocardiograph (magnetic sensor), and uses the magnetocardiograph to measure the biomagnetic field on the front (the side with the abdomen) of the area from the shoulders to the torso of a person (in this example, for the sake of explanation, referred to as the upper body), and detects the magnetocardiogram signal, which is the measured signal, as a biosignal. The biosignal measurement device 11 may also use the magnetocardiograph to measure the biomagnetic field on other sides, such as the sides (the sides with the armpits) or the back (the side with the back). In addition, the biosignal measurement device 11 may perform measurements at any location using a magnetocardiograph, although this is not limited to this example.

[0015] Furthermore, the biosignal measurement device 11 may simultaneously measure multiple locations on the same person. In this embodiment, each of these multiple measurement systems will be referred to as a channel. For example, the biosignal measurement device 11 is equipped with a sensor (magnetic sensor) that performs measurement for each channel, and by using these multiple channel sensors, measurement results for multiple channels can be obtained in a single measurement.

[0016] Here, the biosignal measurement device 11 may be equipped with any measuring instrument other than a magnetocardiograph, and any biosignal may be measured by such measuring instrument instead of the magnetocardiogram signal in this example. For example, the biosignal measurement device 11 may be equipped with an electrocardiograph and measure the human electrocardiogram signal as a biosignal using the electrocardiograph. Furthermore, for example, the biosignal measurement device 11 may simultaneously measure magnetocardiogram signals and electrocardiogram signals from the same person.

[0017] The biological signals (magnetocardiogram signals in this example) measured by the biological signal measuring device 11 are input to the biological signal processing system 12. Here, the biosignal may be input to the biosignal processing system 12 by any method. Specifically, the biosignal may be transmitted from the biosignal measuring device 11 to the biosignal processing system 12 by wired or wireless communication, or the biosignal may be output from the biosignal measuring device 11, stored in a portable storage device, the storage device may be transported, and the biosignal may be input from the storage device to the biosignal processing system 12. The storage device may be, for example, a USB (Universal Serial Bus) memory.

[0018] Furthermore, the biological signal output from the biological signal measuring device 11 and input to the biological signal processing system 12 may be, for example, the raw measured signal, or a signal that has undergone predetermined processing after being measured. Furthermore, the biological signal may be an analog signal or a digital signal. In this embodiment, the biological signal processed by the biological signal processing system 12 is shown as a configuration in which the biological signal is converted into a digital signal (digital data) by the biological signal measuring device 11 or the biological signal processing system 12 and then processed by the biological signal processing system 12. However, as another configuration example, a configuration in which the biological signal is processed as an analog signal by the biological signal processing system 12 may be used.

[0019] Regarding magnetocardiography (MGOC) measurements, research is being conducted on obtaining three-dimensional magnetic field distributions by arranging sensors, obtaining magnetic field distributions of vector quantities in three axes, and reconstructing current sources from magnetic field data (three-dimensional distribution estimation). For this reason, it is expected that magnetocardiography measurements will yield a wider variety of information distributed in three dimensions compared to electrocardiograms, and technologies are needed to process spatially distributed information more appropriately. In this embodiment, it is also possible to address such requirements.

[0020] <Biosignal measurement device: Example of an MRI machine> The biosignal measurement device 11 may be equipped with an MRI machine, and the MRI machine may be used to measure signals representing images of the human heart as biosignals. The biological signals measured by the biological signal measuring device 11 (in this example, MRI signals) are input to the biological signal processing system 12.

[0021] Here, for example, various configurations may be used regarding the format of the biosignal (analog or digital signal), whether or not the biosignal is processed (raw signal or processed signal), and the exchange of biosignals between the biosignal measuring device 11 and the biosignal processing system 12, similar to the case where a magnetocardiograph (magnetic sensor) is used. For example, instead of using an MRI machine, a CT scanner may be used for measurement. In this embodiment, for the sake of explanation, the results measured by the biosignal measurement device 11 will be referred to as biosignals, but they may also be called, for example, biological information.

[0022] <Biosignal measurement device: Measurement of two or more types> The biosignal measurement device 11 may perform two or more types of measurements, and may output the signals resulting from the two or more types of measurements as biosignals to the biosignal processing system 12. These two or more types of measurements may include, for example, measurements using a magnetocardiograph and measurements using an MRI machine, or measurements using a magnetocardiograph, measurements using an electrocardiograph, and measurements using an MRI machine. For example, instead of using an MRI machine, a CT scanner may be used for measurement. Furthermore, two or more types of measurements may include measurements using an MRI machine and measurements using a CT machine.

[0023] <Biometric Signal Processing System> The biosignal processing system 12 comprises an input unit 111, an output unit 112, a storage unit 113, and a control unit 114. The input unit 111 includes a biosignal acquisition unit 131. The output unit 112 includes a display unit 141. The control unit 114 includes a section identification unit 151, a biosignal processing unit 152, and a display control unit 153. The section identification unit 151 includes a section division unit 171 and a period identification unit 172.

[0024] The input unit 111 receives input from an external source. In this embodiment, the input unit 111 receives a biological signal output from the biological signal measuring device 11. Specifically, the input unit 111 may receive the biological signal transmitted from the biological signal measuring device 11, or it may receive a biological signal stored in a portable storage device from the storage device. Furthermore, the input unit 111 may have, for example, an operating unit operated by a user, and information corresponding to the operation performed by the user may be input to the operating unit.

[0025] The biosignal acquisition unit 131 acquires the biosignal input by the input unit 111. The biosignal acquisition unit 131 may store the acquired biosignals in the storage unit 113. In this case, if the biological signal input by the input unit 111 is an analog signal, for example, the biological signal acquisition unit 131 may be equipped with an A / D (Analog to Digital) conversion function to convert the biological signal from an analog signal to a digital signal. Furthermore, when the biosignal processing system 12 is applied to real-time processing, the biosignal acquisition unit 131 acquires biosignals in real time. Even when the biosignal processing system 12 is not applied to real-time processing, the biosignal acquisition unit 131 may still acquire biosignals in real time.

[0026] The output unit 112 outputs to the outside. The display unit 141 displays and outputs information related to the processing results of biological signals. The display unit 141 has a screen such as a liquid crystal display (LCD), and displays and outputs information regarding the processing results of biological signals on this screen. In another configuration example, the display unit 141 may print and output information regarding the processing results of biological signals onto paper. The output unit 112 may also have a function to output in other ways, such as audio output.

[0027] The memory unit 113 has a storage device such as a memory, and stores information. The memory unit 113 stores information such as the input biological signal and the processing results of the said biological signal. Furthermore, the memory unit 113 stores information such as control programs.

[0028] The control unit 114 performs various processes or controls in the biosignal processing system 12. In this embodiment, the control unit 114 is the CPU (Central Processing The system has a processor such as a Unit, and the processor performs various processes or controls by executing a control program stored in the memory unit 113. Furthermore, the processor is equipped with an arithmetic unit that performs various calculations.

[0029] <<Specification of the section>> The section identification unit 151 identifies a section in the biological signal. In this embodiment, the section is a temporal section. The interval division unit 171 has the function of dividing the duration of the biological signal into multiple intervals. The period identification unit 172 has the function of identifying the period of the biological signal. Any method may be used as the method for identifying the period of the biological signal by the period identification unit 172.

[0030] Here, the method used by the section identification unit 151 to identify the section is a method that identifies the section according to the fluctuations of the biological object being measured. The changes in the biological object being measured may include, for example, changes in the overall position of the object, changes in the shape of the object, or both. As an example of the overall positional variation of the object being measured, the variation in the position of the object's center of gravity may be used. The overall positional variation of the object being measured may be due to, for example, human respiration. The changes in the shape of the object being measured may be due to the activity of the object being measured, such as the changes in the shape of the heart (an example of an object being measured) due to heartbeat.

[0031] Furthermore, as a method for dividing the duration of the biological signal into multiple intervals using the interval division unit 171, for example, a method is used in which the signal is divided into multiple intervals corresponding to the fluctuations of the biological object being measured. The fluctuations may include, for example, a change in the overall position of the object being measured, a change in the shape of the object being measured, or both.

[0032] The section identification unit 151 has the function of identifying fluctuations in the measurement target of a living organism. Any method may be used as the method for identifying fluctuations in the measurement target of the living organism by the interval identification unit 151. As an example, the section identification unit 151 may identify the variation of the measurement target based on the variation of a predetermined component included in the measurement signal relating to the measurement target. As another example, the section identification unit 151 may identify the variation of the measurement target based on the variation in the position of a predetermined indicator. For example, a marker may be used as the indicator.

[0033] Here, when the interval identification unit 151 identifies an interval in the biological signal, it may use either or both of the functions of the interval division unit 171 and the period identification unit 172. Furthermore, the section identification unit 151 may identify sections in the biological signal without using the functions of the section division unit 171 and the period identification unit 172, or both. In this case, the unused functions (in this case, either or both of the section division unit 171 and the period identification unit 172) do not need to be provided in the section identification unit 151.

[0034] For example, the section identification unit 151 may identify a predetermined section from among a plurality of sections pre-set for the biological signal. In this case, the section division unit 171 and the period identification unit 172 do not need to be provided in the section identification unit 151. As another example, the section identification unit 151 may divide the duration of the biological signal into multiple sections using the section division unit 171, and then identify a predetermined section from among the divided multiple sections. In this case, the period identification unit 172 does not need to be provided in the section identification unit 151. As another example, the section identification unit 151 may identify the period of the biological signal using the period identification unit 172, and then identify a predetermined section in the biological signal based on the identified period. In this case, the section division unit 171 does not necessarily have to be provided in the section identification unit 151. As another example, the section identification unit 151 may identify the period of the biological signal using the period identification unit 172, divide the period of the biological signal into multiple sections using the section division unit 171, and then identify a predetermined section from among the multiple divided sections.

[0035] As a specific example, the interval division unit 171 may detect the feature quantities of the read biological signal and divide the interval based on the detected feature quantities. These feature quantities may be arbitrary feature quantities, or they may be feature quantities of the waveform of the biological signal.

[0036] For example, the interval division unit 171 may detect a predetermined waveform of the read biological signal and divide the interval based on the detected predetermined waveform. In this case, as an example, a pattern in which a predetermined waveform appears in the biological signal to be measured is stored in advance in the storage unit 113, and the interval division unit 171 may divide the interval based on this pattern and the predetermined waveform detected from the measurement result (biological signal). Here, the predetermined waveform may be, for example, a peak waveform, or it may be the waveform of the remaining signal components after removing the desired signal components from the measurement result (biological signal). The waveform of the remaining signal component after removing the desired signal component from the measurement result (biometric signal) may be considered, for example, as the waveform of the noise signal component.

[0037] As a specific example, the interval division unit 171 may divide the interval as specified by the user's operation. As a specific example, the interval division unit 171 may dynamically (in real time) process the biological signal to divide the interval. In this case, for example, a model relating to dynamic features such as changes in the amplitude of the biological signal may be stored in the storage unit 113 in advance, and the interval division unit 171 may divide the interval based on this model and the dynamic features detected from the measurement results (biological signal). As a specific example, the section identification unit 151 may use the period identification unit 172 to identify the period of the biosignal acquired dynamically (in real time), and estimate the temporal position of the object to be processed based on the identified period.

[0038] The interval identification unit 151 may, for example, divide or identify intervals in future time periods (future compared to the past) in a biological signal based on intervals in past time periods in the biological signal. In this embodiment, the biological signal is a signal in which periodic waveforms with similar characteristics are repeated, and it is possible to infer the period (or interval) in a certain time period from the period (or interval) in a time period earlier. For example, the interval identification unit 151 may identify the next period (or interval in the next period) of the biological signal based on the period (or interval) of the biological signal one period ago.

[0039] In this case, if the interval identification unit 151 determines that the period of the biological signal is gradually becoming shorter, it may estimate a period shorter than the previous period as the next period. For example, one such case is when the period of the heartbeat of the person being measured is gradually becoming shorter. On the other hand, if the interval identification unit 151 determines that the period of the biological signal is gradually getting longer, it may estimate a period longer than the previous period as the next period. For example, this may occur when the period of the heartbeat of the person being measured is gradually getting longer.

[0040] Furthermore, for example, if a pattern with a relatively short or relatively long period occurs once in a predetermined number of trials, or if such a pattern is determined, the interval identification unit 151 may estimate the period (or interval) based on that pattern.

[0041] The period identification unit 172 may, for example, identify the period using the number of samples, or it may identify the period based on the interval of peaks detected based on biological signal data (biological data). In this embodiment, the period identification unit 172 may, for example, identify the period based on the analysis results of the biological signal instead of the biological signal itself.

[0042] The period identification unit 172 may, for example, identify a period based on fluctuations in the measurement target of a living organism. The fluctuations may include, for example, a change in the overall position of the object being measured, a change in the shape of the object being measured, or both.

[0043] The interval identification unit 151 may estimate the time at which the information to be processed (information relating to biological signals) is located within a period, based on the period identified by the period identification unit 172. This time only needs to be able to identify the position within the period and does not necessarily have to be an absolute time. In other words, the interval identification unit 151 may estimate which position of information the information to be processed (information relating to biological signals) corresponds to in terms of time within one period (i.e., which position of biological signal the information is based on).

[0044] Furthermore, the section identification unit 151 may identify sections not only based on the main biological signal to be processed, but also based on other biological signals related to the main biological signal to be processed. For example, the section identification unit 151 may identify a section based on the main biological signal to be processed (for example, a magnetocardiogram signal), and the biological signal processing unit 152 may then process the said biological signal (for example, a magnetocardiogram signal). As another example, a configuration may be used in which the section identification unit 151 identifies a section based on other biological signals related to the main biological signal to be processed (for example, a magnetocardiogram signal) (for example, an electrocardiogram signal measured simultaneously with the main biological signal to be processed), and the biological signal processing unit 152 processes the main biological signal to be processed (for example, a magnetocardiogram signal).

[0045] <<Processing of biosignals>> The biosignal processing unit 152 processes biosignals. In this embodiment, the biosignal processing unit 152 has the function of performing processing on the biosignal according to each section. For example, the biosignal processing unit 152 may perform the processing for each section on the signal portion of the measurement signal relating to the object being measured for that section.

[0046] Here, the processing performed by the biosignal processing unit 152 may include a variety of processes. The processing performed by the biosignal processing unit 152 may include processing to analyze the measured signal. As a specific example, the process of analyzing the measurement signal may be, for instance, a process of analyzing the magnetic field distribution of the heart or brain.

[0047] Furthermore, the processing performed by the biosignal processing unit 152 may include processing to calculate information about a predetermined location (predetermined part) of a living organism, and may also include processing to analyze the calculated information. Furthermore, the processing performed by the biosignal processing unit 152 may include processing related to the position of a predetermined location (predetermined part) in a living organism, and processing related to the shape of a predetermined location (predetermined part) in a living organism, or both. Furthermore, the processing performed by the biosignal processing unit 152 may include processing related to one or more of the following: identification of intervals, division of intervals, or identification of periods. Furthermore, the processing performed by the biosignal processing unit 152 may include processing to analyze the relationships between multiple different biosignals (biological information). Processing to analyze the relationships between multiple different biosignals (biological information) may include, for example, processing to synchronize the timing between multiple different biosignals (biological information), or processing to synchronize the positions of predetermined locations (predetermined parts) in a living organism between multiple different biosignals (biological information).

[0048] Furthermore, when the biosignal processing unit 152 performs processing using parameters, it may use predetermined initial values ​​as such parameters, or it may perform processing to dynamically update such parameters.

[0049] Furthermore, the biosignal processing unit 152 may select and execute a suitable (for example, optimal) processing for each section. For example, the biosignal processing unit 152 may select and execute one or more processing methods suitable for each interval from among multiple processing methods. As a concrete example, the processing method may be a method for aligning the positions of predetermined locations (predetermined parts) in a living organism with multiple different biological signals (biological information). Furthermore, the processing method may be one or more of the following: a frequency filtering method, a current estimation calculation method, or a region extraction method.

[0050] For example, the biosignal processing unit 152 may include a processing execution unit and a processing control unit. The processing unit performs the processing of biological signals. For example, the processing unit has the function of switching between multiple different processing methods for the same type of processing to perform the processing of biological signals. The processing control unit controls the execution of processing by the processing execution unit. For example, the processing control unit selects a processing method based on the interval specified by the interval specification unit 151 and controls the processing execution unit to perform processing of the biological signal using the selected processing method. For example, the processing control unit selects a different processing method for at least one interval compared to other intervals. Although the functions of the processing execution unit and the processing control unit have been described separately here, these functions may also be considered as being provided collectively in the biosignal processing unit 152 without distinction.

[0051] <<Processing of biosignals: Feedback for segment identification>> The section identification unit 151 may refer to the results of signal processing performed by the biosignal processing unit 152 when identifying sections in the biosignal. The results of signal processing performed by the biosignal processing unit 152 may show the characteristics of the biosignal (for example, waveform characteristics such as peaks or noise in each section) more strongly than before the signal processing was performed, which may be useful for identifying sections in the biosignal.

[0052] Thus, the section identification unit 151 may identify sections based on the results of predetermined processing performed on the biological signal. This predetermined processing may be all or part of the processing performed by the biological signal processing unit 152. For example, the section identification unit 151 may identify a section based on the detection result of noise in the biological signal. As a specific example, the interval division unit 171 may divide the interval based on the detection result of noise in the biological signal. As a specific example, the period identification unit 172 may identify the period based on the detection result of noise in the biological signal. As a specific example, the section identification unit 151 may estimate the temporal position of the object to be processed based on the detection result of noise in the biological signal. In these cases, the control unit 114 includes a noise detection unit that detects noise contained in the biological signal. This function may be provided, for example, in the biological signal processing unit 152. The noise detection result may be, for example, the level of the noise or the waveform. The noise may be, for example, white noise.

[0053] The section identification unit 151 may adjust the section (for example, a predetermined section or a divided section) based on the noise detection result. Here, the value related to noise may be, for example, the noise level, or the ratio of the noise level to the level of the biological signal (in this example, the biological signal) on which the noise is superimposed.

[0054] Figure 1 shows an arrow FB1 schematically representing the feedback from the biosignal processing unit 152 to the section identification unit 151. Furthermore, feedback from the biosignal processing unit 152 to the section identification unit 151 is not necessarily required.

[0055] <<Processing of biosignals: Sections where processing is unnecessary>> The biosignal processing unit 152 does not need to process biosignals in sections where processing is not required.

[0056] <<Display Control>> The display control unit 153 controls the display mode when displaying information related to biological signals using the display unit 141. In this embodiment, the display control unit 153 controls the display mode of the information related to biological signals for each section according to the section specified by the section specification unit 151. In this case, the display control unit 153 may, for example, control the display mode of the result of processing performed by the processing method selected in the biological signal processing unit 152 (i.e., the processing method associated with each section). Information regarding biological signals may include, for example, information about the biological signal itself, or information resulting from a predetermined process applied to the biological signal.

[0057] For example, when the display control unit 153 displays information related to a biological signal, if the information spans multiple sections, it may control the display control unit to display information indicating the range of one or more of these sections. The range of a section may be displayed, for example, by information such as a line or symbol indicating the entire range, by using different colors for each section, or by information indicating boundary lines that show the demarcation between adjacent sections. In this case, the display control unit 153 may adjust (correct) one or both of the information from one of the two adjacent sections (e.g., waveform) and the information from the other section (e.g., waveform) if the processing methods differ between the two adjacent sections, so that the information is smoothly connected at the boundary between the two sections.

[0058] The display control unit 153 may switch the time range to be displayed for each section when displaying time-series information. For example, when displaying information related to biological signals, the display control unit 153 may control the display to show the information with a different screen display for each of multiple sections. As an example, the display control unit 153 may control the display to show only the information of a specific section on the screen, and switch the screen display by switching the section to be displayed.

[0059] For example, the display control unit 153 may be controlled to display information related to each section for each section. The information related to each section is not particularly limited and may include one or more of the following: information identifying the section, information identifying the processing method applied to each section, or information about the period used to identify the section. Here, the information used to identify the sections may be the name, number, or mark of each section.

[0060] Furthermore, in this embodiment, the information identifying the processing method may be the name, number, or mark of each processing method, or it may be information indicating the characteristics of each processing method. As an example, the frequency representing the filter characteristics may be used as a characteristic of a frequency filtering method (an example of a processing method). For example, the cutoff frequency may be used when a high-pass filter (HPF) or low-pass filter (LPF) is applied.

[0061] The display control unit 153 may switch the area to be displayed for each section when displaying information in association with a biological area (for example, the human body). For example, when the display control unit 153 displays information in a three-dimensional display (a display that appears three-dimensional) in association with the region of a living organism (e.g., the human body), it may control the display to display the information in a display manner that focuses on the information of the region extracted by the region extraction method corresponding to each section. Examples of display manners that focus on the information of the region may include a display manner that cuts out the region and displays the information, or a display manner that enlarges the region and displays the information. In this embodiment, a three-dimensional display is shown, but a two-dimensional display (planar display) may be performed along with or instead of the three-dimensional display.

[0062] Here, for multiple sections, the correspondence between each section, the name of the section, and the processing method applied to each section may be stored in the storage unit 113 as section information. In this case, the display control unit 153 may control the display mode based on the section information.

[0063] <<Example configuration for the control unit>> Note that the section identification unit 151 (section division unit 171, period identification unit 172), the biosignal processing unit 152, and the display control unit 153 are functional units exemplified to explain the functions of the control unit 114, and are not limited to this embodiment; the control unit 114 may have any functions.

[0064] Furthermore, although the example in Figure 1 shows a configuration in which the biosignal processing system 12 includes various functional units (input unit 111, output unit 112, storage unit 113, and control unit 114), these multiple functional units may be configured as a single device, or they may be distributed across two or more separate devices. Furthermore, the configuration of the functional units (input unit 111, output unit 112, storage unit 113, control unit 114) of the biosignal processing system 12 shown in Figure 1 is just one example and is not limited to this embodiment; the biosignal processing system 12 may have any functional units.

[0065] Furthermore, in this embodiment, the temporal position (value on the temporal axis) of the biological signal is described as time, but instead of time, the sampling number or the like may be used. For example, in sampling at a constant time interval, the advance of the sampling number is proportional to the advance of time. Furthermore, absolute values ​​or relative values ​​may be used for time or sampling numbers, for example. For instance, in this embodiment, any value may be used for the time axis as long as it is possible to identify the interval of the biological signal.

[0066] [Examples of biosignals] Here, we will describe the magnetocardiogram signal, which is a biological signal that may be processed in this embodiment. However, since the waveform of the magnetocardiogram signal is similar to the waveform of the electrocardiogram signal, which is the standard for cardiac waveforms, and can be considered the same as the waveform of the electrocardiogram signal, we will explain using the magnetocardiogram signal as an example, referring to Figure 2. Furthermore, in this embodiment, in order to simplify the explanation, we will explain assuming that the characteristics of the electrocardiogram signal waveform shown in Figure 3 also apply to the magnetocardiogram signal.

[0067] Figure 2 shows an example of a biosignal 2011 according to an embodiment. In the graph shown in Figure 2, the horizontal axis represents time (duration), and the vertical axis represents the signal level (amplitude in the example in Figure 2). The graph in question shows the Biosignals 2011 data.

[0068] Biosignals 2011 are magnetocardiographic signals. In the biosignal 2011, a predetermined pattern signal 2021 corresponding to one heartbeat is periodically generated. In the example in Figure 2, only one predetermined pattern signal 2021 is labeled.

[0069] Furthermore, in the example shown in Figure 2, the multiple predetermined pattern signals 2021 in the biosignal 2011 have the characteristic of being superimposed on a waveform that fluctuates overall. This is due to fluctuations in the position of the heart (for example, the overall position of the heart) associated with the movement of the human body that is the subject of measurement. Here, the movement of the human body is, for example, body movement due to breathing. The fluctuations of the heart that are subject to measurement may include, for example, changes in the shape of the heart due to the movement of the heart itself. Furthermore, fluctuations may also be called changes, for example.

[0070] <Predetermined pattern signal> Figure 3 shows an electrocardiogram signal (predetermined pattern signal) corresponding to a magnetocardiogram signal, which is an example of a biosignal according to the embodiment. Note that the electrocardiogram signal shown in Figure 3 is a schematic diagram for the sake of explanation. Figure 3 shows the biosignal 201, which is an electrocardiogram signal (a signal with a waveform corresponding to the predetermined pattern signal 2021 in the example in Figure 2).

[0071] In the graph shown in Figure 3, the horizontal axis represents time (duration), and the vertical axis represents the signal level (amplitude in the example in Figure 3). The graph shows the biological signal 201.

[0072] The horizontal axis of the graph shows time points t1 to t10, corresponding to the progression of time. In the example in Figure 3, these time points t1 to t10 are not necessarily equally spaced. In this embodiment, the biosignal 201 has a periodic waveform. Furthermore, the biosignal 201 does not necessarily have to have a waveform that perfectly matches with each period. For example, if the state of the organism being measured remains unchanged, the biosignal 201 is expected to repeat the same waveform with each period. However, if the state of the organism being measured changes, the waveform of the biosignal 201 may change with each period. Also, if the state of the organism being measured changes, the period of the biosignal 201 may change as well.

[0073] Figure 3 shows an example of the biological signal 201 for one period 211 and the periods immediately before and after it. In addition, in the example in Figure 3, period 211 is divided into the first period 231 to the sixth period 236. The first period 231 is the period from time t1 to time t2, and is the period corresponding to the P wave of the biological signal 201. The second period 232 is the period from time t2 to time t3, and is the period between the P wave and the QRS complex of the biological signal 201 (corresponding to the PR segment).

[0074] The third period 233 is the period from time t3 to time t7, and corresponds to the portion of the QRS complex of the biological signal 201. During the third period 233, the biosignal 201 reaches a Q-wave peak, which is a local minimum, at time t4; an R-wave peak, which is a local maximum, at time t5; and an S-wave peak, which is a local minimum, at time t6.

[0075] The fourth period 234 is the period from time t7 to time t8, and is the period between the QRS complex and the T wave of the biological signal 201 (the part corresponding to the ST segment). The fifth period, 235, is the period from time t8 to time t9, and corresponds to the T wave portion of the biological signal 201.

[0076] In this embodiment, the waveform of a commonly known electrocardiogram was described as an example of a biosignal 201 having a periodic waveform. However, this does not limit the way in which the electrocardiogram is interpreted (for example, the names of each part of the waveform, or how the waveform is divided), and similarly, it does not limit the way in which a magnetocardiogram corresponding to such an electrocardiogram is interpreted (for example, the names of each part of the waveform, or how the waveform is divided).

[0077] For example, in signal processing, it is possible to divide the PR segment so that part or all of it is included in the P-wave portion or the QRS group portion. For example, in signal processing, it is possible to divide the ST segment so that some or all of it is included in the QRS group or the T wave. For example, in signal processing, it is possible to further subdivide the QRS complex into smaller parts. Specific examples include dividing it into sections from time t3 to time t4, time t4 to time t6, and time t6 to time t7.

[0078] Here, the magnetocardiogram signal, which is the measurement result from a magnetocardiograph, is similar to the electrocardiogram signal, which is the measurement result from an electrocardiograph that has been widely used in the past, and the waveform of the magnetocardiogram signal exhibits characteristics (features) similar to those of the electrocardiogram signal (P wave, QRS complex, T wave, etc.). The period 211 shown in Figure 3 corresponds to the waveform of one heartbeat (one period) in a human heart. The biosignal 201 then repeats a waveform similar to that of one heartbeat.

[0079] In this embodiment, the electrocardiogram signal, which is a measurement signal from an electrocardiograph, was used as an example of the biological signal 201. However, as described above, similar characteristics can be observed in the magnetocardiogram signal, which is a measurement signal from a magnetocardiograph. Furthermore, the biological signals are not limited to magnetocardiogram signals or electrocardiogram signals; other signals may also be used.

[0080] [Example of segmentation of biosignals] Refer to Figures 4, 5, 6A, 6B, 7A, and 7B to see examples of segmentation of biological signals. This example demonstrates how to segment biological signals based on the respiratory characteristics (features) of a human body with a heart that is being measured. This example demonstrates the use of time-series biological signals.

[0081] Figure 4 shows an example of segmentation of a biological signal according to the present invention. In the graph shown in Figure 4, the horizontal axis represents time (duration), and the vertical axis represents the signal level (amplitude in the example in Figure 4). The graph shows the biological signal 2111. In the example shown in Figure 4, the biological signal 2111 is a signal similar to the biological signal 2011 shown in Figure 2. Furthermore, in the example shown in Figure 4, as in the case of Figure 2, only one predetermined pattern signal 2121 is assigned a code.

[0082] Figure 4 shows the values ​​(threshold Th1 and threshold Th2) used to divide the level on the vertical axis into intervals. Here, threshold Th2 is greater than threshold Th1. In this embodiment, for the sake of explanation, the level of signal components other than the periodic predetermined pattern signal 2121 present in the biological signal 2011 will be referred to as the base level. The baseline may be determined by analyzing the biosignal 2011 using any method. This analysis may involve, for example, averaging the biosignal 2011 to determine the baseline.

[0083] In this example, the interval in which the base level is less than the threshold Th1 is called interval A1. In this example, the interval where the base level is greater than or equal to threshold Th1 and less than threshold Th2 is called interval A2. In this example, the interval in which the base level is equal to or greater than the threshold Th2 is called interval A3.

[0084] In the biosignal 2111 shown in Figure 4, the interval from time t103 to time t104 is interval A1. Furthermore, the intervals from the beginning of the timeline in the graph to time t101, from time t102 to time t103, from time t104 to time t105, and from time t106 to the end of the timeline in the graph are all considered interval A2. Furthermore, the intervals from time t101 to time t102 and from time t105 to time t106 are both considered interval A3.

[0085] In the example shown in Figure 4, two values ​​that divide the base level into three equal parts are set as thresholds Th1 and Th2. However, any method can be used to set the values ​​(thresholds) for interval division. The values ​​(thresholds) used for interval division may be predetermined, or they may be set based on biological signals 2111, etc. (for example, newly set or changed from the initial value).

[0086] In this embodiment, the section identification unit 151 may identify one or more sections from the multiple sections shown in Figure 4. Furthermore, in this embodiment, the interval division unit 171 may divide the temporal period in which the biological signal 2111 exists into a plurality of intervals (temporal intervals) as shown in Figure 4. Furthermore, in this embodiment, the period identification unit 172 may identify the period for one or more of the sections A1, A2, and A3 shown in Figure 4.

[0087] <Examples of changes in the position of a specific location (specific part) in a living organism> Figure 5 shows an example of biological information 311 at a reference position according to the embodiment. In this example, the biological information 311 is information about the human heart. Note that the biological information 311 may also be considered as a biological signal (a signal representing biological information) in signal processing, for example. For the sake of explanation, Figure 5 shows the XYZ Cartesian coordinate system, which is a three-dimensional Cartesian coordinate system. Furthermore, Figure 5 shows a reference frame 3011 of a cube having edges parallel to each axis of the XYZ Cartesian coordinate system. Furthermore, the reference frame 3011 may or may not be used, for example, when displaying biometric information 311.

[0088] Figures 6A and 6B show an example of biological information 321 at the first change position according to the embodiment. Biological information 321 is the same human heart information as biological information 311 shown in Figure 5, but the position of the heart is fluctuating (changing). In the examples in Figures 6A and 6B, the areas where the position of the heart has changed are schematically shown with darker patterns. Note that the examples in Figures 6A and 6B are approximate and not necessarily precise.

[0089] For the sake of explanation, Figures 6A and 6B show the same XYZ Cartesian coordinate system as in Figure 5. Furthermore, Figures 6A and 6B show a reference frame 3111 of a cube having edges parallel to each axis of the XYZ Cartesian coordinate system. The reference frame 3111 coincides with the reference frame 3011 shown in Figure 5. Furthermore, the reference frame 3111 may or may not be used, for example, when displaying biometric information 321.

[0090] Figures 7A and 7B show an example of biological information 331 at the second change position according to the embodiment. Biological information 331 is the same human heart information as biological information 311 shown in Figure 5, but the position of the heart is fluctuating (changing). In the examples in Figures 7A and 7B, the areas where the position of the heart has changed are schematically shown with darker patterns. Note that the examples in Figures 7A and 7B are approximate and not necessarily precise.

[0091] For the sake of explanation, Figures 7A and 7B show the same XYZ Cartesian coordinate system as in Figure 5. Furthermore, Figures 7A and 7B show a reference frame 3211 of a cube having edges parallel to each axis of the XYZ Cartesian coordinate system. The reference frame 3211 coincides with the reference frame 3011 shown in Figure 5. The reference frame 3211 may or may not be used, for example, when displaying biometric information 331.

[0092] In this example, the reference position of the biological information 311 in the example in Figure 5 represents the position where the position of the heart is considered to be unchanged when the position of the heart changes due to the body's respiration. This reference position may be, for example, the central position in the fluctuation of the heart's position or a predetermined reference position. Furthermore, the first change position of the biological information 321 in the examples of Figures 6A and 6B represents the change position (fluctuation position) of the heart when the heart (or a part thereof) moves to the negative side of the Y-axis when the human body inhales due to respiration. Furthermore, the second change position of the biological information 331 in the examples of Figures 7A and 7B represents the change position (fluctuation position) of the heart when the heart (or a part thereof) moves to the positive side of the Y-axis when the human body exhales due to respiration. Here, the position of the heart may be, for example, the position of the center of gravity of the heart.

[0093] In this example, the reference position in the example in Figure 5 corresponds to section A2 shown in Figure 4, the first change position in the examples in Figures 6A and 6B corresponds to section A3 shown in Figure 4, and the second change position in the examples in Figures 7A and 7B corresponds to section A1 shown in Figure 4.

[0094] In this example, we have shown a case where the level of the biological signal is divided into three intervals (interval A1, interval A2, and interval A3). However, the number of intervals can be arbitrary; for example, it could be two, or four or more. Furthermore, it is believed that increasing the number of divisions in the interval will improve the accuracy of analysis for each interval.

[0095] <Examples of changes in the state of biological information> Refer to Figures 8A, 8B, 8C, and 8D to see examples of changes in the state of biological information. This example demonstrates the use of time-series biological information (biometric signals). This example illustrates a change in the state of the heart itself, which is the subject of measurement. Figure 8A shows an example of biological information 711 in the first state according to the embodiment. Figure 8B shows an example of biological information 712 in the second state according to the embodiment. Figure 8C shows an example of biological information 713 in the third state according to the embodiment. Figure 8D shows an example of biological information 714 in the fourth state according to the embodiment.

[0096] Here, these biometric data 711-714 are the same human heart information as the biometric data 311 shown in Figure 5, but in each case, the shape of the heart is fluctuating. Normally, the shape of the heart fluctuates with each heartbeat. In the example in Figure 8A, the biological information 711 is the cardiac information during the first period 231 in the example in Figure 3. In the example in Figure 8B, the biological information 712 is the cardiac information from the third period 233 in the example in Figure 3. In the example in Figure 8C, the biological information 713 is the cardiac information in the fifth period 235 in the example in Figure 3. In the example in Figure 8D, the biological information 714 is the cardiac information from period 236 in the example in Figure 3.

[0097] Thus, interval division may be performed for each set of biological information 711-714 from different periods. In this case, the other periods shown in Figure 3 (second period 232, fourth period 234) may be included in the same interval as another adjacent period, for example, or they may be considered as independent intervals.

[0098] In this embodiment, the section identification unit 151 may identify one or more sections from among the sections corresponding to the example in Figure 8A, the section corresponding to the example in Figure 8B, the section corresponding to the example in Figure 8C, and the section corresponding to the example in Figure 8D. Furthermore, in this embodiment, the interval division unit 171 may divide the temporal period in which the biological signal exists into these multiple temporal intervals (the interval corresponding to the example in Figure 8A, the interval corresponding to the example in Figure 8B, the interval corresponding to the example in Figure 8C, and the interval corresponding to the example in Figure 8D). Furthermore, in this embodiment, the period identification unit 172 may identify the period for one or more of the following sections: the section corresponding to the example in Figure 8A, the section corresponding to the example in Figure 8B, the section corresponding to the example in Figure 8C, and the section corresponding to the example in Figure 8D.

[0099] Here, the segmentation may be based on either one of the following: changes in the position of biological information due to respiration in a human body with a heart, as explained using Figures 4, 5, 6A, 6B, 7A, and 7B; or changes in the shape of biological information due to changes in the state of the heart itself, as explained using Figures 8A to 8D; or it may be based on both of these. Specifically, either one of the following may be performed: the division of intervals using a base level as shown in Figure 4, or the division of intervals using a period as shown in Figure 3, or both may be performed.

[0100] [Example of alignment using markers] Refer to Figures 9 to 11 to see an example of alignment using markers. This example demonstrates how to align MRI and magnetic sensor measurements using markers placed at the same location near the heart being measured. In this example, five markers are used, but for example, in a three-dimensional analysis, at least three markers (three different markers) may be used. Each marker may be attached, for example, by sticking it to the surface of a human body. This example demonstrates the use of time-series biological signals (measurement results).

[0101] Figure 9 shows an example of MRI measurement using the marker according to this embodiment. Figure 9 shows the heart, which is the object of measurement, 411. It also shows five markers 511-515 placed on the surface of the human body containing the heart, near the heart. Each marker 511-515 is configured to be detectable by MRI measurement. As a result, the MRI measurement results include information on the measurement target 411 and information on each marker 511-515. There are no particular limitations on markers 511-515; any markers may be used.

[0102] Figure 10 shows an example of how a magnetic sensor measures data using a marker according to this embodiment. Figure 10 shows five markers 511-515 placed on the surface of a human body containing the heart (measurement target 411 shown in Figure 9), near the heart. Figure 10 also shows magnetic sensors 611-616, as well as magnetic sensors 621, 631, 641, 651, and 661, which are multiple magnetic sensors used for measurement. In the example in Figure 10, all six magnetic sensors 611-616 arranged in a straight line are labeled, but for the other six magnetic sensors arranged in a straight line, only one magnetic sensor in each line (magnetic sensor 621, magnetic sensor 631, magnetic sensor 641, magnetic sensor 651, magnetic sensor 661) is labeled. In other words, in the example in Figure 10, a total of 36 (= 6 x 6) magnetic sensors are arranged.

[0103] In the example shown in Figure 10, these multiple magnetic sensors are arranged in a planar (or nearly planar) configuration. For example, these multiple magnetic sensors are installed on a flat plate-shaped part of a measuring device (not shown), and the measurement is performed with the human heart to be measured positioned near this part. In this embodiment, the measuring device is provided in the biosignal measuring device 11. Each marker 511-515 is configured to be detectable by measurement using a magnetic sensor. As a result, the measurement results from the magnetic sensor include information attributable to the measurement target 411 and information attributable to each marker 511-515.

[0104] Here, the markers 511-515 shown in Figure 9 and the markers 511-515 shown in Figure 10 are, for example, the same markers attached to the same location on the human body. For example, MRI measurements in the example of Figure 9 and magnetic sensor measurements in the example of Figure 10 are performed sequentially on a human body to which markers 511-515 are attached. Furthermore, MRI measurements and magnetic sensor measurements may be performed in any order. Also, if multiple different types of measurements are to be performed, and there are two or more measurements that can be performed simultaneously, these two or more measurements may be performed at the same time.

[0105] In this example, the MRI measurement results include information on the measurement target 411 and information on each marker 511-515. Furthermore, in this example, the information from the magnetic sensor measurement results includes information attributable to the heart being measured (measurement target 411) and information attributable to each of the markers 511-515. Furthermore, since the positions of markers 511-515 are the same in both the MRI measurement results and the magnetic sensor measurement results, it is possible to align and combine the information from these measurement results.

[0106] In this embodiment, the biosignal acquisition unit 131 acquires information on the MRI measurement results and information on the magnetic sensor measurement results from the biosignal measurement device 11. Furthermore, in this embodiment, the biosignal processing unit 152 performs a process to align the information obtained from the MRI measurement results with the information obtained from the magnetic sensor measurement results. In this embodiment, the biosignal processing unit 152 may switch the alignment processing method for each section identified by the section identification unit 151. The section identification unit 151 may identify a section based on, for example, one or more of the following: MRI measurement results, other signals related to the MRI measurement results, magnetic sensor measurement results, other signals related to the magnetic sensor measurement results, etc. The section may be based on either or both of the changes in the position and / or shape of the heart (measurement target 411) being measured.

[0107] Figure 11 shows an example of the alignment result according to the embodiment. Figure 11 shows the measurement target 411, magnetic sensors 611-616, 621, 631, 641, 651, and 661, and five markers 511-515. In this way, the biosignal processing unit 152 can align and combine the information from the MRI measurement results and the information from the magnetic sensor measurement results. In other words, MRI can obtain information about the position and shape of the heart, which is the object being measured (e.g., image information), and magnetic sensors can obtain information about the magnetic field originating from that heart. By aligning these two pieces of information, it is possible to correlate them and obtain comprehensive information (information that combines both).

[0108] Here, various methods may be used for the alignment process. For example, methods using the ICP (Iterative Closest Point) algorithm, methods using the least squares method, or methods using the affine transformation algorithm may be used. Furthermore, as a method for alignment processing, for example, a method that uses the same algorithm but with different parameters may be considered a separate method and used.

[0109] Note that the examples in Figures 6A and 6B show cases where two of the alignment markers 511-515 moved perpendicular (or nearly perpendicular) to the position of the magnetic sensor, but this is not the only example. Similarly, the examples in Figures 7A and 7B show, but are not limited to, cases where two of the alignment markers 511-515 move perpendicular (or nearly perpendicular) to the position of the magnetic sensor.

[0110] Furthermore, the number and arrangement of sensors (magnetic sensors in this example) can be any configuration. For example, multiple sensors do not necessarily have to be arranged in a planar shape; they may be arranged in a straight line or in other shapes.

[0111] [Example of correction in response to variations in the measurement target] The biosignal processing unit 152 may perform correction processing according to the fluctuations in the measurement target. This correction may be, for example, a correction that corresponds to changes in the position of the object being measured, a correction that corresponds to changes in the shape of the object being measured, or both of these.

[0112] For example, the biosignal processing unit 152 may perform correction of the biosignal 2111 or other related signals for each section shown in Figure 4 (section A1, section A2, section A3). As a specific example, the biosignal processing unit 152 may perform a process to correct (convert) the signal of a certain section (any one of section A1, section A2, or section A3) to a signal corresponding to a different section. In this case, the unit may perform a correction to compensate for the difference between the position of the object to be measured in the given section and the position of the object to be measured in the different section (to match the position of the object to be measured in the different section).

[0113] For example, regarding fluctuations in the position of the heart, a process may be performed to correct (convert) the signal (information) from one interval to a signal that matches the position of the heart in a different interval. In other words, if the position of the heart in one interval is different from the position of the heart in a different interval, a process may be performed to correct (convert) the signal from one interval to a signal that matches the position of the heart in the other interval.

[0114] For example, the biosignal processing unit 152 may correct the biosignals (biological information 711-714) or other related signals for each state (first state, second state, third state, fourth state) shown in Figures 8A-8D. Here, each state corresponds to, for example, each interval. As a specific example, the biosignal processing unit 152 may perform a process to correct (convert) a signal of a certain state (one of the first, second, third, or fourth states) to a signal corresponding to a different state. In this case, the unit may perform a correction to compensate for the difference in the shape of the object to be measured in a certain interval with respect to the shape of the object to be measured in the different state (to match the shape of the object to be measured in the different interval).

[0115] For example, regarding fluctuations in the shape of the heart, a process may be performed to correct (convert) the signal (information) of a certain state (a certain interval) to a signal that matches the shape of the heart in a different state (a different interval). In other words, if the shape of the heart in a certain state is different from the shape of the heart in a different state, a process may be performed to correct (convert) the signal of the certain state to a signal that matches the shape of the heart in the different state.

[0116] For example, the biosignal processing unit 152 may perform a process to correct (convert) the signal (information) in a certain section to a signal that matches the position and shape of the object being measured in a different section, in the case of a variation that combines both the variation in the position and the variation in the shape of the object being measured.

[0117] [An example of a processing procedure in a biosignal processing system] Figure 12 shows an example of the processing procedure performed by the biosignal processing system 12 in the biosignal measurement system 1 according to the embodiment. In the example shown in Figure 12, the control unit 114 of the biosignal processing system 12 reads the entire time-series data of the biosignals in advance. The biological signals to be processed may be, for example, one type of biological signal, or two or more types of biological signals. Specifically, the biological signals may be either or both of the following: the signal from the measurement result of an MRI and the signal from the measurement result of a magnetic sensor.

[0118] (Step S1) The control unit 114 (for example, the section identification unit 151) reads the entire time-series biological signal data (biological data) from the storage unit 113. In this case, the entire biological data has already been input by the input unit 111 and stored in the storage unit 113. Then, the process moves on to step S2.

[0119] (Step S2) The section identification unit 151 divides the duration of the biological signal into multiple sections based on the biological data, using the section division unit 171. Then, the process moves on to step S3.

[0120] (Step S3) The section identification unit 151 selects the time of the biological signal to be processed. Furthermore, the section identification unit 151 identifies the section to which the relevant time belongs. Then, the process moves on to step S4.

[0121] Here, the section identification unit 151 may, for example, select the time of the biological signal to be processed based on predetermined rules, or it may select the time of the biological signal to be processed based on instructions from a user or the like. The rule in question may be, for example, a rule that sequentially selects one or more predetermined times (for example, multiple times according to the progression of time).

[0122] (Step S4) The biosignal processing unit 152 executes processing based on the interval (the interval to which the selected time belongs) identified by the interval identification unit 151. Then, the process moves on to step S5.

[0123] Here, for example, the biosignal processing unit 152 may, by the function of the processing control unit, select a processing method based on the interval specified by the interval identification unit 151 (the interval to which the selected time belongs), and by the function of the processing execution unit, execute the processing of the biosignal to be processed using the processing method selected by the function of the processing control unit.

[0124] (Step S5) The display control unit 153 displays information regarding the results of processing performed by the biosignal processing unit 152 on the display unit 141. In this case, the display control unit 153 may control the display method (display format) based on the section identified by the section identification unit 151 (the section to which the selected time belongs). Then, the processing of this flow is completed.

[0125] In this case, if the control unit 114 processes biological data from multiple predetermined time points in sequence, it may proceed to the processing of step S3 again after the processing of step S5 is completed. As another example, the control unit 114 may, after the processing in step S5 is completed, proceed back to the processing in step S3 if the user or other party instructs a change in the biometric data to be processed.

[0126] The result of the processing in step S4 may be fed back into the processing in step S2. In the example in Figure 12, such feedback FB11 is schematically shown, but such feedback FB11 is not required.

[0127] <Variation> A modified version of the processing flow shown in Figure 12 is presented. In the biosignal processing system 12, a configuration may be used in which the control unit 114 reads time-series biosignal data as needed. This modified processing is particularly effective, for example, when the total amount of time-series biosignal data is large.

[0128] In this modified example, the interval identification unit 151 first divides the duration of the biological signal into multiple intervals. In this modified example, the format of the biological signal data is predetermined, and the interval identification unit 151 pre-defines the intervals based on this format. As an alternative configuration, the section identification unit 151 may divide the section based on biometric data used in past processing, or it may use the same section as used in past processing as the result of the section division.

[0129] Next, the section identification unit 151 selects the biological signal to be processed (in this case, the signal portion of the biological signal to be processed). This selection may be made, for example, using the waveform of the biological signal. Alternatively, this selection may be made, for example, using the time of the biological signal to be processed. Then, the control unit 114 (for example, the section identification unit 151) reads selected biological data (biological data corresponding to the time of the biological signal to be processed) from the storage unit 113 among the time-series biological signal data (biological data). In this modified example, the entirety of the biological data has already been input by the input unit 111 and stored in the storage unit 113. Subsequently, the control unit 114 performs the processes shown in steps S4 and S5 in Figure 12.

[0130] [Another example of a processing procedure in a biosignal processing system] Figure 13 shows another example of the processing procedure performed by the biosignal processing system 12 in the biosignal measurement system 1 according to the embodiment. Figure 13 shows an example where the biosignal processing system 12 reads time-series biosignals (magnetocardiogram signals in this embodiment) from the biosignal measurement device 11 in real time as needed. The biosignal acquisition unit 131 acquires biosignal data (biological data) in accordance with the progression of time. For example, the storage unit 113 stores the biosignal. The information related to the biosignal is the information to be processed. The biological signals to be processed may be, for example, one type of biological signal, or two or more types of biological signals. Specifically, the biological signals may be either or both of the following: the signal from the measurement result of an MRI and the signal from the measurement result of a magnetic sensor.

[0131] (Step S21) The section identification unit 151 identifies the period of the biological signal using the period identification unit 172. In this embodiment, the period identification unit 172 identifies the period of the biological signal based on the biological signal acquired by the biological signal acquisition unit 131. Here, if the period of the biological signal is known and information representing that period is stored in the storage unit 113 beforehand, the process of identifying that period may be omitted. Then, the section identification unit 151 divides the duration of the biological signal into multiple sections based on the period identified by the period identification unit 172, using the section division unit 171. This division of sections is performed dynamically. Then, the process proceeds to step S22.

[0132] Here, if the period and interval of the biological signal are known and information representing the period and information representing the interval are stored in the storage unit 113 in advance, the processing in step S21 may be omitted. Furthermore, if the method of dividing the interval of the biological signal is known, and the result of the interval division is determined when the period is specified, and information representing the method of dividing the interval is stored in the storage unit 113 in advance, the process of dividing the interval may be omitted.

[0133] (Step S22) The section identification unit 151 selects the position (temporal position, which may be time, etc.) of the biological signal to be processed. Furthermore, the section identification unit 151 identifies the section to which the location belongs. Then, the process moves on to step S23.

[0134] Here, the section identification unit 151 may, for example, select the location of the biological signal to be processed based on predetermined rules, or it may select the location of the biological signal to be processed based on instructions from a user or the like. The rule may be, for example, a rule that sequentially selects one or more predetermined positions (for example, multiple positions according to the progression of time).

[0135] (Step S23) The biosignal processing unit 152 reads the biosignal data (biological data) at the position selected by the section identification unit 151. Then, the process moves on to step S24.

[0136] (Step S24) The biosignal processing unit 152 executes processing based on the interval (the interval to which the selected time belongs) identified by the interval identification unit 151. Then, the process moves on to step S25.

[0137] Here, for example, the biosignal processing unit 152 may, by the function of the processing control unit, select a processing method based on the interval specified by the interval identification unit 151 (the interval to which the selected time belongs), and by the function of the processing execution unit, execute the processing of the biosignal to be processed using the processing method selected by the function of the processing control unit.

[0138] (Step S25) The display control unit 153 displays information regarding the results of processing performed by the biosignal processing unit 152 on the display unit 141. In this case, the display control unit 153 may control the display method (display format) based on the section (the section to which the selected position belongs) identified by the section identification unit 151. Then, the processing of this flow is completed.

[0139] Here, if the control unit 114 processes biological data from a plurality of predetermined locations (times) in sequence, it may proceed to the processing of step S22 again after the processing of step S25 is completed. As another example, the control unit 114 may, after the processing in step S25 is completed, proceed back to the processing in step S21 if the user or other party instructs a change in the biometric data to be processed.

[0140] Furthermore, the result of the processing in step S24 may be fed back into the processing in step S21. In the example in Figure 13, such feedback FB12 is schematically shown, but such feedback FB12 is not required.

[0141] In step S21, if the period is identified and the interval is divided, these may be used fixedly or updated at any time. Specifically, the period identification unit 172 may identify the period of the biological signal at any given time and update the already identified period with the newly identified period. As an example configuration, the period identification unit 172 identifies the period of the biological signal based on different biological data (biological data) than the biological data used to identify the period of the biological signal last time. The different biological data (biological data) than the biological data used to identify the period of the biological signal last time is, for example, data that is newer in time series than the biological data used to identify the period of the biological signal last time. As another example of configuration, the period identification unit 172 may update the period by averaging a predetermined number of identified periods and setting the average value as the new period. The predetermined number of periods may be any number. The predetermined number of periods may be, for example, the most recent period and a predetermined number of consecutive periods prior to it (one less than the predetermined number of periods). In the biosignal processing system 12 according to this embodiment, the period may be stabilized by such averaging.

[0142] Furthermore, the interval division unit 171 may divide the period of the biological signal into multiple intervals based on the period updated by the period identification unit 172, and update the previous interval division result with the new interval division result. As another example of configuration, the interval division unit 171 may update the intervals by averaging the results of interval divisions a predetermined number of times and making the averaged result the new interval. The predetermined number of times may be any number. The predetermined number of times may be, for example, the most recent division and a predetermined number of consecutive divisions prior to it (one less than the predetermined number of divisions). In the biosignal processing system 12 according to this embodiment, the stabilization of interval division may be achieved by such averaging.

[0143] In addition, in the initial stage of the processing flow shown in Figure 13, a provisional initial value may be set as the period of the biological signal, and the accuracy of the period may be improved by updating this initial value thereafter. In this case, the identification of the initial period may be omitted in the processing of step S21. In such cases, a provisional initial value may be set for the interval division result at the beginning of the processing flow shown in Figure 13, and the accuracy of the interval division may be improved by updating this initial value afterward. In this case, the processing in step S21 may be omitted.

[0144] As described above, the biosignal processing system 12 according to this embodiment makes it possible to perform appropriate processing for each characteristic section of the biosignal. In the biosignal processing system 12 according to this embodiment, processing can be performed according to each interval based on either or both of the changes in the position and / or shape of a predetermined location (predetermined part) in a living organism.

[0145] As a specific example, in the biosignal processing system 12 according to this embodiment, by processing biosignals (biological information) such as the position or shape of the heart in time intervals, it is possible to improve the measurement results or analysis results from a magnetocardiograph into more accurate information, thereby increasing the added value of the system, for example. In other words, to obtain good analysis results from magnetocardiography, the accuracy of not only the measurement or analysis results from the magnetocardiograph, but also the position and shape of the heart may be important. In particular, magnetocardiography measurements are expected to display and analyze diverse information distributed in three dimensions, compared to electrocardiography measurements, and require more accurate calculation and analysis of information distributed in space. Therefore, the biosignal processing system 12 according to this embodiment can improve the accuracy of the analysis results of signals (information) used for three-dimensional spatial distribution estimation, etc., by appropriately processing one or more types of biosignals (biological information) in each temporal interval.

[0146] As a specific example, the biosignal processing system 12 according to this embodiment allows for alignment of measurement results from MRI or CT with measurement results from a magnetic sensor. For example, the position of the heart required for analysis can be obtained by aligning the heart information acquired by MRI or CT with the sensor coordinate system (for example, the coordinate system set for the magnetic sensor). As a simple method of alignment, it is possible to use a method that aligns the MRI or CT coordinate system with the sensor coordinate system using predetermined markers. In magnetocardiogram (MCG) analysis, the position of the heart is crucial information. However, in reality, the heart's position fluctuates over time due to bodily movements such as respiration, and such fluctuations can pose a problem in achieving high-precision analysis. Similarly, variations in the heart's shape during the heartbeat cycle can also be problematic. In the biosignal processing system 12 according to this embodiment, for example, the characteristics (features) of the marker used for alignment are divided into characteristics (features) for each temporal interval corresponding to various periods, and by accurately aligning two or more types of biosignals (biological information) using a coordinate system, it is possible to improve the accuracy of magnetocardiography analysis.

[0147] In this embodiment, we have shown a case where a marker detectable by MRI and a magnetic sensor is used, but for example, a sensor that detects information capable of identifying position or amount of movement may be used as a marker. As a specific example, acceleration sensors may be used as markers, in which case it is possible to determine the amount of movement (amount of positional change) of each marker (accelerometer) based on the signals detected by each marker. The biosignal measurement device 11 may, for example, output a biosignal (biological information) containing information on the amount of movement of each such marker to the biosignal processing system 12.

[0148] Furthermore, any part of the living body can be used as the measurement target, which is a predetermined location (predetermined part). For example, the brain, not just the heart, may be used. Furthermore, the organism used may not be limited to humans; other animals may also be used.

[0149] Furthermore, in this embodiment, a three-dimensional MRI image or a three-dimensional CT image was shown as an example of a biological signal, but a two-dimensional X-ray image may also be used, for example. Furthermore, although this embodiment shows the use of a magnetic sensor, other types of sensors, such as electric field sensors, may also be used.

[0150] <Example Configuration> As an example configuration, a biosignal processing system (in the example of Figure 1, biosignal processing system 12) comprises: an acquisition unit (in the example of Figure 1, biosignal acquisition unit 131) that acquires measurement results relating to a predetermined object in a living organism (e.g., heart, brain, etc.); an interval identification unit (in the example of Figure 1, interval identification unit 151) that identifies a temporal interval based on at least one of the temporal positional variation or temporal shape variation of the predetermined object; and a processing unit (in the example of Figure 1, biosignal processing unit 152) that performs processing on the measurement results acquired by the acquisition unit according to the interval identified by the interval identification unit. Therefore, a biosignal processing system can enable appropriate processing for each characteristic section of the biosignal.

[0151] As an example configuration, in a biosignal processing system, the interval identification unit identifies an interval based on at least one of the temporal positional variation or temporal shape variation of a predetermined object in the measurement result acquired by the acquisition unit or other related signals. Therefore, a biosignal processing system can identify intervals based on measurement results related to a predetermined object or fluctuations in other related signals, and perform appropriate processing for each characteristic interval of the biosignal.

[0152] As an example configuration, in a biosignal processing system, the measurement result or other signal includes information on a non-biological indicator (e.g., a marker), and the interval identification unit identifies at least one of the temporal positional variation or temporal shape variation of a predetermined object based on the information on the indicator. Therefore, in a biosignal processing system, it is possible to accurately identify temporal fluctuations of a given target using non-biological indicators.

[0153] As an example configuration, in a biosignal processing system, the processing unit performs a process to align the position of a predetermined object using the measurement result and a second measurement result, which is another measurement result related to the predetermined object and includes index information. Therefore, the biosignal processing system can perform alignment of two measurement results related to a predetermined object. Furthermore, in the biosignal processing system, the positional alignment of three or more measurement results for a predetermined object may be performed on that predetermined object.

[0154] As an example configuration, in a biosignal processing system, one of the measurement results and the second measurement result may be an MRI measurement result, a CT measurement result, or an X-ray measurement result. The other of the measurement results and the second measurement result may be a measurement result from a magnetic sensor. Therefore, the biosignal processing system can, for example, align MRI measurement results with magnetic sensor measurement results, CT measurement results with magnetic sensor measurement results, and X-ray measurement results with magnetic sensor measurement results.

[0155] As an example configuration, in a biosignal processing system, the designated target is either the heart or the brain. Therefore, a biosignal processing system can enable appropriate processing for each characteristic segment of the biosignal for the heart or brain.

[0156] It is possible to implement programs (computer programs) that realize the processing performed in a biological signal processing system. As an example configuration, the program is a program that enables a computer to perform the following functions: acquiring measurement results for a predetermined object in a living organism; identifying a temporal interval based on at least one of the temporal changes in the object's position or temporal changes in its shape; and processing the acquired measurement results according to the identified interval.

[0157] Furthermore, a program to realize the function of any component in any of the devices described above may be recorded on a computer-readable recording medium, and that program may be loaded into a computer system and executed. Here, "computer system" includes hardware such as operating systems and peripheral devices. "Computer-readable recording medium" refers to portable media such as flexible disks, magneto-optical disks, ROMs, CD (Compact Disc)-ROMs (Read Only Memory), and storage devices such as hard disks built into computer systems. Moreover, "computer-readable recording medium" also includes volatile memory within a computer system that retains a program for a certain period of time, such as volatile memory within a computer system that acts as a server or client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. Such volatile memory may be, for example, RAM (Random Access Memory). The recording medium may be, for example, a non-temporary recording medium.

[0158] Furthermore, the above program may be transmitted from a computer system that stores the program in a memory device or the like to another computer system via a transmission medium or by transmission waves within the transmission medium. Here, the "transmission medium" used to transmit the program refers to a medium that has the function of transmitting information, such as a network like the Internet or a communication line like a telephone line. Furthermore, the above program may be intended to implement only a portion of the functions described above. Moreover, the above program may be a so-called differential file, capable of implementing the aforementioned functions in combination with programs already recorded in the computer system. A differential file may also be called a differential program.

[0159] Furthermore, the functions of any component in any device described above may be implemented by a processor. For example, each process in the embodiment may be implemented by a processor that operates based on information such as a program, and a computer-readable recording medium that stores information such as a program. Here, the processor may be implemented by having the functions of each part implemented by separate hardware, or by having the functions of each part implemented by integrated hardware. For example, the processor includes hardware, and the hardware may include at least one of a circuit that processes digital signals and a circuit that processes analog signals. For example, the processor may be configured using one or more circuit devices or one or both of one or more circuit elements mounted on a circuit board. An IC (Integrated Circuit) may be used as the circuit device, and a resistor or capacitor may be used as the circuit element.

[0160] Here, the processor may be, for example, a CPU. However, the processor is not limited to a CPU; various types of processors may be used, such as a GPU (Graphics Processing Unit) or a DSP (Digital Signal Processor). The processor may also be, for example, a hardware circuit using an ASIC (Application Specific Integrated Circuit). Furthermore, the processor may be composed of, for example, multiple CPUs, or multiple hardware circuits using ASICs. The processor may also be composed of, for example, a combination of multiple CPUs and multiple hardware circuits using ASICs. The processor may also include, for example, one or more amplifier circuits or filter circuits that process analog signals.

[0161] While embodiments of this disclosure have been described in detail above with reference to the drawings, the specific configuration is not limited to these embodiments and may include designs and other elements that do not depart from the gist of this disclosure. [Explanation of symbols]

[0162] 1...Biosignal measurement system, 11...Biosignal measurement device, 12...Biosignal processing system, 111...Input unit, 112...Output unit, 113...Storage unit, 114...Control unit, 131...Biosignal acquisition unit, 141...Display unit, 151...Section identification unit, 152...Biosignal processing unit, 153...Display control unit, 171...Section division unit, 172...Period identification unit, 201, 2011, 2111...Biosignal, 211...Period, 2 31...First period, 232...Second period, 233...Third period, 234...Fourth period, 235...Fifth period, 236...Sixth period, 311, 321, 331, 711~714...Biometric information, 411...Measurement target, 511~515...Marker, 611~616, 621, 631, 641, 651, 661...Magnetic sensor, 2021, 2121...Predetermined pattern signal, 3011, 3111, 3211...Reference frame

Claims

1. An acquisition unit that acquires measurement results for a predetermined target in a living organism, A section identification unit that identifies a temporal interval based on at least one of the temporal positional variation or temporal shape variation of the predetermined object, A processing unit performs processing on the measurement results obtained by the acquisition unit according to the section identified by the section identification unit, Equipped with, The section identification unit identifies the section based on at least one of the temporal positional variation or temporal shape variation of the predetermined object in the measurement result or other related signals acquired by the acquisition unit, The measurement results or other signals include information on indicators other than those of the biological organism. The section identification unit identifies at least one of the temporal positional variation or temporal shape variation of the predetermined object based on the information of the indicator. The processing unit performs a process to align the position of the predetermined object using the measurement result and a second measurement result, which is another measurement result relating to the predetermined object and includes information on the index. Biosignal processing system.

2. One of the above measurement results and the second measurement result is an MRI measurement result, a CT measurement result, or an X-ray measurement result. The other of the above measurement result and the second measurement result is the measurement result obtained by a magnetic sensor. The biosignal processing system according to claim 1.

3. The aforementioned designated object is the heart or the brain. A biosignal processing system according to claim 1 or claim 2.

4. An acquisition function for acquiring measurement results related to a specified target in a living organism, A function for identifying a time interval based on at least one of the temporal changes in the position or temporal changes in the shape of the predetermined object, A processing function that performs processing on the acquired measurement results according to the specified interval, A program to make a computer realize this, The interval identification function identifies the interval based on at least one of the temporal positional variation or temporal shape variation of the predetermined object in the measurement result or other related signals acquired by the acquisition function, The measurement results or other signals include information on indicators other than those of the biological organism. The interval identification function identifies at least one of the temporal positional variation or temporal shape variation of the predetermined object based on the information of the indicator. The processing function performs a process to align the position of the predetermined object using the measurement result and a second measurement result, which is another measurement result relating to the predetermined object and includes information on the indicator. program.

Images