Ultrasonic diagnostic device, medical information processing device, and hardness calculation program

Abstract

To improve accuracy of hardness measurement of a biological tissue by calculating the hardness of the biological tissue using a pressure displacement amount instead of a measurement displacement amount.SOLUTION: An ultrasonic diagnostic device for acquiring pressure applied to a subject from a pressure sensor attached to an ultrasonic probe includes: an image generation unit; a displacement amount calculation unit; and a hardness calculation unit. The image generation unit generates a plurality of first images in the time series including a biological tissue with applied pressure less than a pressure threshold, and generates a plurality of second images in the time series including the biological tissue with applied pressure of a pressure threshold or more. The displacement amount calculation unit calculates a displacement amount of the biological tissue between each second image of the plurality of second images and the plurality of first images. The hardness calculation unit calculates the hardness of the biological tissue on the basis of the displacement amount corresponding to each second image and applied pressure of the pressure threshold or more corresponding to each second image.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The embodiments disclosed in this specification and the drawings relate to an ultrasound diagnostic apparatus, a medical information processing apparatus, and a hardness calculation program. [Background technology]

[0002] In the medical field, an ultrasonic diagnostic device is used that includes an ultrasonic probe and an ultrasonic image processing device, and images the inside of a subject using ultrasonic waves generated by multiple transducers (or piezoelectric transducers) of the ultrasonic probe. The ultrasonic image processing device transmits ultrasonic waves from the ultrasonic probe into the subject, generates echo signals based on the reflected waves, and obtains a desired ultrasonic image by image processing.

[0003] There is a technology in which an operator applies pressure to a subject manually or automatically by a robot arm to obtain an ultrasound image, and an elasticity image is generated that shows the hardness of biological tissue based on the amount of displacement based on multiple ultrasound images with different phases (hereinafter referred to as the "measured displacement amount") and the applied pressure. This technology involves providing a pressure sensor behind the transducer element of an ultrasound probe, determining the pressure applied to the ultrasound probe by applying pressure to the subject, determining the Young's modulus, and displaying an elasticity image. The measured displacement amount used here includes noise components caused by periodic movements such as pulsation and respiratory fluctuation, and the measured displacement amount is not the displacement amount excluding the noise components (hereinafter referred to as the "pressure displacement amount"). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2018-20140 A Summary of the Invention [Problem to be solved by the invention]

[0005] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to improve the accuracy of measuring the stiffness of biological tissue by calculating the stiffness of biological tissue using the pressure displacement amount instead of the measurement displacement amount. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problem. Problems corresponding to the effects of each configuration shown in each embodiment described later can also be positioned as other problems. [Means for solving the problem]

[0006] According to an embodiment, an ultrasonic diagnostic device that acquires an applied pressure to a subject from a pressure sensor attached to an ultrasonic probe includes an image generating unit, a displacement amount calculating unit, and a stiffness calculating unit. The image generating unit generates a plurality of first images in a time series including the biological tissue with an applied pressure less than a pressure threshold, and generates a plurality of second images in a time series including the biological tissue with an applied pressure equal to or greater than the pressure threshold. The displacement amount calculating unit calculates a displacement amount of the biological tissue between each of the second images of the plurality of second images and the plurality of first images. The stiffness calculating unit calculates stiffness of the biological tissue based on the displacement amount corresponding to each second image and the applied pressure equal to or greater than the pressure threshold corresponding to each second image. [Brief description of the drawings]

[0007] [Figure 1] 1 is a schematic diagram showing an example of the configuration of an ultrasound diagnostic apparatus according to a first embodiment. [Diagram 2] FIG. 2 is a flowchart showing a first operation example of the ultrasound diagnostic apparatus according to the first embodiment. [Diagram 3] FIG. 4 is a diagram showing the relationship between a plurality of images and an electrocardiogram waveform in a first operation example of the ultrasound diagnostic apparatus according to the first embodiment. [Figure 4] 4 is a diagram showing the relationship between a first image and a second image in a first operation example of the ultrasound diagnostic apparatus according to the first embodiment. FIG. [Diagram 5] FIG. 4 is a diagram showing an example of a hysteresis loop in a first operation example of the ultrasound diagnostic apparatus according to the first embodiment. [Figure 6]FIG. 4 is a flowchart showing a second operation example of the ultrasound diagnostic apparatus according to the first embodiment. [Figure 7] FIG. 11 is a flowchart showing a third operation example of the ultrasound diagnostic apparatus according to the first embodiment. [Figure 8] FIG. 11 is a diagram showing the relationship between a plurality of images and an electrocardiogram waveform in a third operation example of the ultrasound diagnostic apparatus according to the first embodiment. [Figure 9] 13 is a diagram showing the relationship between a first image and a second image in a third operation example of the ultrasound diagnostic apparatus according to the first embodiment. FIG. [Figure 10] FIG. 11 is a schematic diagram showing an example of the configuration of a medical information processing apparatus according to a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, embodiments of an ultrasonic diagnostic apparatus, a medical information processing apparatus, and a stiffness calculation program will be described in detail with reference to the drawings.

[0009] (First embodiment) 1 shows an ultrasonic diagnostic device 1 including an ultrasonic image processing device 10 according to a first embodiment. In addition to the ultrasonic image processing device 10, the ultrasonic diagnostic device 1 includes an ultrasonic probe 20, an input interface 30, a display 40, a pressure sensor 50, and a phase sensor 60. Note that the ultrasonic diagnostic device 1 may include at least one of the ultrasonic probe 20, the input interface 30, the display 40, the pressure sensor 50, and the phase sensor 60. In the following description, a case will be described in which the ultrasonic diagnostic device 1 includes all of the ultrasonic probe 20, the input interface 30, the display 40, the pressure sensor 50, and the phase sensor 60.

[0010] The ultrasonic image processing device 10 includes an ultrasonic transmission circuit 11, an ultrasonic reception circuit 12, an image memory 13, a network interface 14, a processing circuit 15, and a main memory 16. The circuits 11 and 12 are configured by an application specific integrated circuit (ASIC) or the like. However, the present invention is not limited to this case, and all or part of the functions of the circuits 11 and 12 may be realized by the processing circuit 15 executing a computer program.

[0011] The ultrasonic transmission circuit 11 and the ultrasonic reception circuit 12 control the transmission directivity and reception directivity in transmitting and receiving ultrasonic waves under the control of the processing circuit 15. Although a case where both the ultrasonic transmission circuit 11 and the ultrasonic reception circuit 12 are provided in the ultrasonic image processing device 10 will be described, at least one of the ultrasonic transmission circuit 11 and the ultrasonic reception circuit 12 may be provided in the ultrasonic probe 20, or may be provided in both the ultrasonic image processing device 10 and the ultrasonic probe 20.

[0012] Although not shown, the ultrasonic transmission circuit 11 includes a pulse generation circuit, a transmission delay circuit, a pulsar circuit, and the like, and supplies a drive signal to the ultrasonic transducer of the ultrasonic probe 20. The pulse generation circuit repeatedly generates a rate pulse for forming a transmission ultrasonic wave at a predetermined repetition frequency (PRF: Pulse Repetition Frequency). The transmission delay circuit provides each rate pulse generated by the pulse generation circuit with a delay time for each piezoelectric transducer required for focusing the ultrasonic waves generated from the ultrasonic probe 20 into a beam shape and determining the transmission directivity. The transmission direction or the transmission delay time that determines the transmission direction is stored in the main memory 16 and is referred to at the time of transmission. The pulsar circuit applies a drive signal (drive pulse) to the multiple ultrasonic transducers provided in the ultrasonic probe 20 at a timing based on the rate pulse. The transmission direction from the piezoelectric transducer surface can be arbitrarily adjusted by changing the delay time provided to each rate pulse by the transmission delay circuit.

[0013] The ultrasonic receiving circuit 12 includes an amplifier circuit, an A / D (Analog to Digital) converter, an adder, etc., which are not shown in the figure, and receives echo signals received by the ultrasonic transducer of the ultrasonic probe 20 and performs various processes on the echo signals to generate echo data. The amplifier circuit amplifies the echo signals for each channel and performs gain correction processing. The A / D converter A / D converts the gain-corrected echo signals and gives the digital data a delay time required to determine the reception directivity. The adder performs addition processing on the echo signals processed by the A / D converter to generate echo data. The addition processing by the adder emphasizes the reflection components from a direction corresponding to the reception directivity of the echo signals.

[0014] The image memory 13 includes, for example, a magnetic or optical recording medium, or a processor-readable recording medium such as a semiconductor memory. The image memory 13 stores a plurality of ultrasound images under the control of the processing circuit 15. The image memory 13 is an example of a storage unit.

[0015] The network interface 14 implements various information communication protocols according to the form of the network. The network interface 14 connects the ultrasound diagnostic apparatus 1 to other devices such as an external medical image management apparatus 70 and a medical information processing apparatus 80 in accordance with the various protocols. This connection can be an electrical connection via an electronic network. Here, the electronic network refers to a general information communication network that uses electrical communication technology, and includes a wireless / wired hospital-based LAN (Local Area Network) and the Internet, as well as a telephone communication line network, an optical fiber communication network, a cable communication network, and a satellite communication network.

[0016] The network interface 14 may also implement various protocols for non-contact wireless communication. In this case, the ultrasonic image processing device 10 can directly transmit and receive data to and from, for example, the ultrasonic probe 20 without going through a network. The network interface 14 is an example of a network connection unit.

[0017] The processing circuit 15 refers to a dedicated or general-purpose central processing unit (CPU), a microprocessor unit (MPU), or a graphics processing unit (GPU), as well as an ASIC and a programmable logic device, etc. Examples of the programmable logic device include a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA).

[0018] The processing circuit 15 may be configured by a single circuit, or may be configured by a combination of multiple independent circuit elements. In the latter case, the main memory 16 may be provided for each circuit element, or a single main memory 16 may store programs corresponding to the functions of multiple circuit elements. The processing circuit 15 is an example of a processing unit.

[0019] The main memory 16 is composed of a semiconductor memory element such as a RAM (random access memory) or a flash memory, a hard disk, an optical disk, etc. The main memory 16 may be composed of a portable medium such as a USB (universal serial bus) memory or a DVD (digital video disk). The main memory 16 stores various processing programs (including application programs, an OS (operating system), etc.) used in the processing circuit 15 and data required for executing the programs. The OS may also include a GUI (graphical user interface) that makes extensive use of graphics to display information to the operator on the display 40 and allows basic operations to be performed by the input interface 30. The main memory 16 is an example of a storage unit.

[0020] The ultrasonic probe 20 has a number of tiny transducers (piezoelectric elements) on the front surface, and transmits and receives ultrasonic waves to and from an area including a scanning target. Each transducer is an electroacoustic conversion element, and has the function of converting an electric pulse into an ultrasonic pulse during transmission, and converting a reflected wave into an electric signal (received signal) during reception. The ultrasonic probe 20 is small and lightweight, and is connected to the ultrasonic image processing device 10 via a cable (or wireless communication).

[0021] The ultrasonic probe 20 is divided into types such as a linear type, a convex type, and a sector type according to the difference in the scanning method. Also, the ultrasonic probe 20 is divided into types such as a 1D array probe in which a plurality of transducers are arranged one-dimensionally (1D) in the azimuth direction (i.e., the long axis direction) and a 2D array probe in which a plurality of transducers are arranged two-dimensionally (2D) in the azimuth direction and the elevation direction (i.e., the short axis direction) according to the difference in the array arrangement dimension. The 1D array probe includes a probe in which a small number of transducers are arranged in the elevation direction.

[0022] Here, when a 3D scan, that is, a volume scan, is performed, a 2D array probe equipped with a scanning method such as a linear type, a convex type, or a sector type is used as the ultrasonic probe 20. Alternatively, when a volume scan is performed, a 1D probe equipped with a scanning method such as a linear type, a convex type, or a sector type and equipped with a mechanism for mechanically swinging in the elevation direction is used as the ultrasonic probe 20. The latter probe is also called a mechanical 4D probe.

[0023] The input interface 30 includes an input device that can be operated by an operator, and an input circuit that inputs a signal from the input device. The input device can be realized by a trackball, a switch, a mouse, a keyboard, a touchpad that performs an input operation by touching the operation surface, a touchscreen in which a display screen and a touchpad are integrated, a non-contact input device using an optical sensor, and a voice input device. When the input device is operated by the operator, the input circuit generates a signal according to the operation and outputs it to the processing circuit 15. The input interface 30 is an example of an input unit.

[0024] The display 40 is configured by a general display output device such as a liquid crystal display, an OLED (Organic Light Emitting Diode) display, etc. The display 40 displays various information according to the control of the processing circuit 15. The display 40 is an example of a display unit.

[0025] The pressure sensor 50 is attached to the ultrasonic probe 20 and detects the pressure from the ultrasonic probe 20 to the subject as an electrical signal. The pressure sensor 50 performs various processes including digitalization on the detected pressure signal and transmits it as pressure data to the ultrasonic image processing device 10. Note that the pressure sensor 50 can also be an acceleration sensor, and information related to pressure can be generated from the output signal of the acceleration sensor.

[0026] The phase sensor 60 is composed of, for example, either an electrocardiograph or a respiration sensor. The electrocardiograph as the phase sensor 60 acquires information of a specific phase (cardiac phase) in one cycle of periodically repeated pulsations as an electrocardiogram waveform signal (ECG: Electrocardiogram). The electrocardiograph detects the electrocardiogram waveform signal of the subject as an electrical signal. The electrocardiograph performs various processes including digitization on the detected electrocardiogram waveform signal and transmits it to the ultrasound image processing device 10.

[0027] The respiratory sensor as the phase sensor 60 acquires information of a specific phase of one cycle of breathing, which is repeated periodically, as a respiratory waveform signal. The respiratory sensor acquires the respiratory waveform signal of the subject as an electrical signal. For example, the respiratory sensor has a laser generator and a light receiver, and processes a signal of reflected light from the abdominal surface of the subject, and repeatedly calculates the distance between the laser generator and the abdominal surface of the subject in real time based on the time from laser irradiation to reception of reflected light or the phase change of the reflected light signal, and transmits the distance as time-series data to the ultrasonic image processing device 10. Note that the respiratory sensor may be configured to attach a pressure sensor between a band attached to the subject's abdomen and the abdomen, and observe the state of breathing based on changes in pressure. Alternatively, the respiratory sensor may observe the state of breathing by placing an object with a light reflecting material on the abdomen, photographing it with a camera, and tracking the movement of the light reflecting material.

[0028] 1 also shows a medical image management device 70 and a medical information processing device 80, which are external devices of the ultrasound diagnostic apparatus 1. The medical image management device 70 is, for example, a DICOM (Digital Imaging and Communications in Medicine) server, and is connected to devices such as the ultrasound diagnostic apparatus 1 so as to be able to transmit and receive data via a network N. The medical image management device 70 manages ultrasound images generated by the ultrasound diagnostic apparatus 1 as DICOM files.

[0029] The medical information processing device 80 is connected to devices such as the ultrasound diagnostic device 1 and the medical image management device 70 so as to be able to transmit and receive data via the network N. Examples of the medical information processing device 80 include a workstation that performs various image processing on the ultrasound images generated by the ultrasound diagnostic device 1, and a portable information processing terminal such as a tablet terminal. Note that the medical information processing device 80 may be an offline device that is capable of reading out the ultrasound images generated by the ultrasound diagnostic device 1 via a portable storage medium.

[0030] Next, the functions of the ultrasonic image processing device 10 will be described with reference to FIG.

[0031] The processing circuitry 15 realizes a B-mode processing function F1, a Doppler processing function F2, an image generating function F3, a displacement amount calculating function F4, a stiffness calculating function F5, and a display control function F6 by reading and executing a computer program stored in the main memory 16 or a memory in the processing circuitry 15. Below, a case where the functions F1 to F6 are realized by a computer program will be described as an example, but all or a part of the functions F1 to F6 may be provided in the ultrasonic image processing device 10 as functions of a circuit such as an ASIC.

[0032] The B-mode processing function F1 receives echo data from the ultrasonic receiving circuit 12, and performs logarithmic amplification, envelope detection processing, etc. to generate data (two-dimensional or three-dimensional data) in which the signal strength is expressed by the brightness of luminance. This data is generally called B-mode data.

[0033] The B-mode processing function F1 can change the frequency band to be visualized by changing the detection frequency through filter processing. By using the filter processing function of the B-mode processing function F1, it is possible to perform harmonic imaging such as contrast harmonic imaging (CHI) and tissue harmonic imaging (THI).

[0034] The Doppler processing function F2 performs frequency analysis on the velocity information from the echo data from the ultrasonic receiving circuit 12, and generates data (two-dimensional or three-dimensional data) that extracts the moving information of the moving object such as the average velocity, variance, and power for multiple points. This data is generally called Doppler data. Here, the moving object is, for example, blood flow, tissue such as the heart wall, or a contrast agent.

[0035] The B-mode data generated by the B-mode processing function F1 and the Doppler data generated by the Doppler processing function F2 are ultrasound image data before the scan conversion process. On the other hand, the data generated by the display control function F6 described later is display image data after the scan conversion process. The B-mode data and the Doppler data are also called raw data.

[0036] The image generating function F3 generates an ultrasonic image expressed in a predetermined brightness range as image data based on the reception signal received by the ultrasonic probe 20. For example, the image generating function F3 generates, as an ultrasonic image, a B-mode image (a first image and a second image described later) in which the intensity of a reflected wave is expressed as brightness from two-dimensional B-mode data generated by the B-mode processing function F1. The image generating function F3 generates, as a plurality of first images, a plurality of B-mode images in a time series including biological tissues at an applied pressure less than a pressure threshold when pressure is not actively applied, and generates, as a plurality of second images, a plurality of B-mode images in a time series including biological tissues at an applied pressure equal to or greater than a pressure threshold when pressure is actively applied.

[0037] In addition, the image generation function F3 generates, as an ultrasound image, an average velocity image, a variance image, a power image, or a color Doppler image as a combination of these images, which represent mobility information from the two-dimensional Doppler data generated by the Doppler processing function F2.

[0038] Here, the image generating function F3 generally converts (scan converts) a scan line signal sequence of an ultrasonic scan into a scan line signal sequence of a video format represented by a television or the like, and generates an ultrasonic image. Specifically, the image generating function F3 generates an ultrasonic image by performing coordinate conversion according to the ultrasonic scanning form of the ultrasonic probe 20. In addition to scan conversion, the image generating function F3 also performs various image processing, such as image processing (smoothing processing) that regenerates an average brightness image using multiple image frames after scan conversion, and image processing (edge ​​enhancement processing) that uses a differential filter in the image. In addition, the image generating function F3 synthesizes text information of various parameters, scales, body marks, etc., into the ultrasonic image.

[0039] That is, the B-mode data and the Doppler data are ultrasonic images before the scan conversion process, and the data generated by the image generation function F3 is an ultrasonic image for display after the scan conversion process. Note that the B-mode data and the Doppler data are also called raw data. The image generation function F3 generates a two-dimensional ultrasonic image for display from the two-dimensional ultrasonic image before the scan conversion process.

[0040] The displacement amount calculation function F4 includes a function of calculating the displacement amount of biological tissue between each second image generated by the image generation function F3 and a plurality of first images generated by the image generation function F3 as a pressure displacement amount (a displacement amount obtained by removing noise components from a measured displacement amount). For example, the displacement amount calculation function F4 calculates the pressure displacement amount by a block matching method or the like. The block matching method divides an image into blocks, for example, each consisting of N×N pixels, searches the first image for a block that is most similar to a block of interest in the second image, and performs predictive coding by referring to the block.

[0041] The hardness calculation function F5 includes a function for calculating the hardness of biological tissue based on the pressure displacement amount corresponding to each second image calculated by the displacement amount calculation function F4 and the applied pressure equal to or greater than the pressure threshold corresponding to each second image.

[0042] The display control function F6 includes a function for displaying a plurality of ultrasound images on the display 40, and a function for displaying on the display 40 the stiffness of the biological tissue calculated by the stiffness calculation function F5.

[0043] (First operation example) Next, a first operation example of the ultrasound diagnostic device 1 will be described with reference to Fig. 2. In the flowchart shown in Fig. 2, the reference characters with a number added to "S" indicate each step.

[0044] The ultrasonic image processing device 10 receives an instruction to start an ultrasonic scan after receiving examination order information from an examination request device (not shown) such as HIS (Hospital Information Systems). The operator places the tip of the ultrasonic probe 20 on the body surface of the subject while suppressing pressure application toward biological tissue (for example, the heart, liver, pancreas, etc.). The B-mode processing function F1 controls the ultrasonic transmission circuit 11, the ultrasonic reception circuit 12, the pressure sensor 50, the phase sensor 60, etc., to perform an ECG-synchronized scan using the ultrasonic probe 20. Note that the operation of the pressure sensor 50 is not necessarily required in the first operation example. Then, the image generating function F3 generates a plurality of first images (step S1). If the pressure application is suppressed and considered to be 0, the image generating function F3 acquires a plurality of first images G1 (G11, G12, ...) generated only by pulsation (or respiratory fluctuation) together with an ECG waveform prior to step S2 (first measurement shown in FIG. 3(A)). FIG. 3(A) shows a number of first images G1 when no pressure is actively applied, the applied pressure PG1 when these images are acquired, and an electrocardiogram waveform signal.

[0045] 3A, images of biological tissue appearing in the multiple first images G1 are not still but change due to pulsation, respiratory fluctuation, etc. Pressures PG11, PG12, ... associated with the multiple first images G11, G12, ... respectively are pressures measured by the pressure sensor 50 when the multiple first images G11, E12, ... were acquired. The pressures PG11, PG12, ... are approximately constant values ​​because the ultrasound probe 20 is not actively pressed against the body surface in the first measurement.

[0046] Next, the operator applies pressure to the body surface of the subject toward the same biological tissue and then places the tip of the ultrasonic probe 20 on the tissue. The B-mode processing function F1 controls the ultrasonic transmission circuit 11, the ultrasonic reception circuit 12, the pressure sensor 50, the phase sensor 60, and the like to perform a scan using the ultrasonic probe 20. Then, the image generation function F3 generates a plurality of second images (B-mode images) (step S2). That is, the image generation function F3 acquires a plurality of second images G2 (G21, G22, ...) generated by pressure application and pulsation (or respiratory fluctuation based on the respiratory sensor) together with an electrocardiogram waveform (second measurement shown in FIG. 3(B)). FIG. 3(B) shows a plurality of second images G2 when pressure is actively applied, pressure PG2 (PG21, PG22, ...) [Pa] at that time, and an electrocardiogram waveform signal.

[0047] 3B, the images of the biological tissue appearing in the second images G2 change in response to the applied pressure PG2 in addition to pulsation and respiratory fluctuation. The pressures PG21, PG22, ... associated with the second images G21, G22, ... respectively are pressures measured by the pressure sensor 50 when the second images G21, G22, ... were acquired.

[0048] The displacement amount calculation function F4 aligns the phases based on the electrocardiogram waveform (or respiratory waveform) between the multiple first images acquired in step S1 and the multiple second images acquired in step S2, and calculates the displacement amount of the biological tissue between the first image and the second image having corresponding phases as the pressure displacement amount (step S3). That is, noise components caused by periodic movements such as pulsation and respiratory fluctuation are removed from the second image. The phase may be acquired as the cardiac phase based on phase information acquired from an electrocardiograph, or may be acquired as the respiratory phase based on phase information acquired from a respiratory sensor.

[0049] For example, based on the electrocardiogram waveform, the second image G22 shown in FIG. 3(B) can be determined to be in the same phase as the first image G11 in FIG. 3(A) (as shown in FIG. 4, the phase of the peak of the R wave). The displacement amount calculation function F4 calculates the displacement amount of the biological tissue between the first image G11 and the second image G22, and sets the displacement amount as the pressure displacement amount CE22 at the phase of the second image G22. The displacement amount is calculated by block matching or the like. The displacement amount calculation function F4 records the pressure displacement amount CG22 corresponding to the second image G22 in the main memory 16 together with the applied pressure PG22 applied at that phase.

[0050] Similarly, the second image G23 shown in FIG. 3(B) can be determined to be in the same phase as the first image G12 shown in FIG. 3(A) based on the electrocardiogram waveform (shown in FIG. 4). For example, the second image G23 and the first image G12 are images in which the elapsed time from the R wave or the "elapsed time from the R wave / heartbeat interval" is approximately equal. The displacement amount calculation function F4 calculates the displacement amount of the biological tissue between the first image G12 and the second image G23, and sets the displacement amount as the pressure displacement amount CG23 at the phase of the second image G23. The displacement amount calculation function F4 records the pressure displacement amount CG23 corresponding to the second image G23 in the main memory 16 together with the applied pressure PG23 applied at that phase.

[0051] Similarly, the second image G24 shown in FIG. 3(B) can be determined to be in the same phase as the first image G13 shown in FIG. 3(A) based on the electrocardiogram waveform (shown in FIG. 4). For example, the second image G24 and the first image G13 are images in which the elapsed time from the R wave or the "elapsed time from the R wave / heartbeat interval" is approximately equal. The displacement amount calculation function F4 calculates the displacement amount of the biological tissue between the first image G13 and the second image G24, and sets the displacement amount as the pressure displacement amount CG24 at the phase of the second image G24. The displacement amount calculation function F4 records the pressure displacement amount CG24 corresponding to the second image G24 in the main memory 16 together with the applied pressure PG24 applied at that phase.

[0052] Similarly, the second image G25 shown in FIG. 3(B) can be determined to be in the same phase as the first image G14 shown in FIG. 3(A) based on the electrocardiogram waveform (shown in FIG. 4). For example, the second image G25 and the first image G14 are images in which the elapsed time from the R wave or the "elapsed time from the R wave / heartbeat interval" is approximately equal. The displacement amount calculation function F4 calculates the displacement amount of the biological tissue between the first image G14 and the second image G25, and sets the displacement amount as the pressure displacement amount CG25 at the phase of the second image G25. The displacement amount calculation function F4 records the pressure displacement amount CG25 corresponding to the second image G25 in the main memory 16 together with the applied pressure PG25 applied at that phase.

[0053] Similarly, the second image G26 shown in FIG. 3(B) can be determined to be in the same phase as the first image G15 shown in FIG. 3(A) based on the electrocardiogram waveform (shown in FIG. 4). For example, the second image G26 and the first image G15 are images in which the elapsed time from the R wave or the "elapsed time from the R wave / heartbeat interval" is approximately equal. The displacement amount calculation function F4 calculates the displacement amount of the biological tissue between the first image G15 and the second image G26, and sets the displacement amount as the pressure displacement amount CG26 at the phase of the second image G26. The displacement amount calculation function F4 records the pressure displacement amount CG26 corresponding to the second image G26 in the main memory 16 together with the applied pressure PG26 applied at that phase.

[0054] Returning to the explanation of Fig. 2, the stiffness calculation function F5 calculates the stiffness (or elasticity) of the biological tissue based on the pressure displacement amount corresponding to each second image and the applied pressure equal to or greater than the pressure threshold corresponding to each second image (step S4). Specifically, the stiffness calculation function F5 obtains the applied pressure according to the pressure displacement amount as a stress-displacement hysteresis loop, and calculates the slope of the hysteresis loop as the stiffness of the biological tissue.

[0055] FIG. 5 shows a stress-displacement hysteresis loop in which the applied pressure P according to the pressure displacement amount C is plotted. The stiffness calculation function F5 acquires the pressure displacement amount CG22 and the corresponding applied pressure PG22 from the main memory 16, and plots the applied pressure PG22 according to the pressure displacement amount CG22. Similarly, the stiffness calculation function F5 acquires the pressure displacement amount CG23 and the corresponding applied pressure PG23 from the main memory 16, and plots the applied pressure PG23 according to the pressure displacement amount CG23. Similarly, the stiffness calculation function F5 acquires the pressure displacement amount CG24 and the corresponding applied pressure PG24 from the main memory 16, and plots the applied pressure PG24 according to the pressure displacement amount CG24. Similarly, the stiffness calculation function F5 acquires the pressure displacement amount CG25 and the corresponding applied pressure PG25 from the main memory 16, and plots the applied pressure PG25 according to the pressure displacement amount CG25. Similarly, the hardness calculation function F5 acquires the pressure displacement amount CG26 and the corresponding applied pressure PG26 from the main memory 16, and plots the applied pressure PG26 according to the pressure displacement amount CG26. Note that a description of the pressure displacement amount CG27 and subsequent values ​​will be omitted.

[0056] When the pressure of the biological tissue by the ultrasonic probe 20 increases (compression), the plot increases from the lower left to the upper right of the hysteresis loop, whereas when the pressure of the biological tissue by the ultrasonic probe 20 decreases (release), the plot increases from the upper right to the lower left of the hysteresis loop. By repeatedly compressing and releasing the biological tissue by the ultrasonic probe 20, the stiffness calculation function F5 obtains multiple slopes. The stiffness calculation function F5 may obtain a single slope or an average value of multiple slopes.

[0057] As described above, the stiffness can be calculated after removing the effects of periodic deformation and movement of biological tissues due to pulsation of the heart and blood vessels using the electrocardiogram waveform signal. Note that the stiffness can also be calculated after removing the effects of periodic deformation and movement of biological tissues due to respiratory fluctuations using the respiratory signal instead of the electrocardiogram waveform signal.

[0058] The display control function F6 displays the stiffness of the biological tissue calculated in step S4 on the display 40 (step S5).

[0059] In the first operation example of the ultrasound diagnostic device 1, the displacement amount calculation function F4 associates the first images with the second images using the phase information acquired from the phase sensor 60, but the present invention is not limited to this case. For example, the displacement amount calculation function F4 may acquire cardiac phases or respiratory phases in the first images and the second images based on the morphology of the biological tissue contained in the first images and the second images. In this case, the phase sensor 60 is not required. The displacement amount calculation function F4 may acquire the phase information of each image using machine learning. For example, deep learning using a multi-layer neural network such as a CNN (Convolutional Neural Network) or a Convolutional Deep Belief Network (CDBN) is used as the machine learning. The displacement amount calculation function F4 constructs a trained model using a pair of an image and phase information indicated by the image, and inputs the first images and the second images to the trained model, respectively, to output the phase information of each image.

[0060] As described above, according to the first operation example of the ultrasound diagnostic device 1, it is possible to obtain only the pressure displacement amount by removing noise components from the measured displacement amount, which includes the pressure displacement amount dependent on the external applied pressure and the noise components due to the biological displacement caused by pulsation and respiratory fluctuation. By calculating the stiffness of the biological tissue using the pressure displacement amount instead of the measured displacement amount, it is possible to improve the accuracy of measuring the stiffness of the biological tissue.

[0061] (Second operation example) The second operation example of the ultrasound diagnostic device 1 is a case in which, in the first operation example described above, if the pressure acquired during the first measurement exceeds a threshold value, the scan is forcibly terminated and a message to that effect is output to the operator.

[0062] A second operation example of the ultrasound diagnostic device 1 will be described with reference to Fig. 6. In the flowchart shown in Fig. 6, the reference characters with numbers added to "S" indicate each step. Note that in Fig. 6, the same steps as in Fig. 2 are given the same reference characters and the description thereof will be omitted.

[0063] The ultrasonic image processing device 10 receives an instruction to start a scan after receiving examination order information from an examination request device (not shown) such as an HIS. The operator places the tip of the ultrasonic probe 20 against the body surface of the subject while aiming at the biological tissue and suppressing the application of pressure. The B-mode processing function F1 controls the ultrasonic transmission circuit 11, the ultrasonic reception circuit 12, the pressure sensor 50, the phase sensor 60, etc., and starts performing an ECG-gated scan using the ultrasonic probe 20. Note that, unlike the first operation example described above, the second operation example requires the operation of the pressure sensor 50. Then, the image generating function F3 starts generating a plurality of first images (B-mode images) (step S11).

[0064] The image generating function F3 judges whether or not an applied pressure equal to or greater than the pressure threshold has been detected when acquiring the first images (step S12). If the judgment in step S12 is YES, that is, if it is judged that an applied pressure equal to or greater than the pressure threshold has been detected, the image generating function F3 judges whether or not the applied pressure equal to or greater than the pressure threshold detected in step S12 continues beyond the time threshold (step S13). If the judgment in step S13 is NO, that is, if the applied pressure equal to or greater than the pressure threshold only lasts for a period equal to or less than the time threshold (immediately drops below the pressure threshold), the image generating function F3 stops acquiring the first images (transmitting and receiving ultrasonic waves) since the first measurement is inappropriate due to the large influence of the applied pressure, and outputs a message indicating that the acquisition has stopped (step S14). For example, the image generating function F3 causes the display 40 to display a message indicating that the acquisition of the first images has stopped.

[0065] On the other hand, if the determination in step S13 is YES, that is, if it is determined that the applied pressure equal to or greater than the pressure threshold continues beyond the time threshold, the process proceeds to step S2. If the determination in step S12 is NO, that is, if it is determined that the applied pressure equal to or greater than the pressure threshold has not been detected, the image generating function F3 continues scanning until it detects an applied pressure equal to or greater than the pressure threshold.

[0066] As described above, according to the second operation example of the ultrasonic image processing device 10, in addition to the effect of the second operation example described above, it is possible to stop an inappropriate first measurement and notify the operator of that fact. As a result, the operator can recognize that the first measurement is necessary again.

[0067] (Third operation example) The third operation example of the ultrasound diagnostic device 1 differs from the above-described first and third operation examples in that it does not require the phase sensor 60 and does not require acquisition of an electrocardiogram waveform or a respiratory waveform.

[0068] A third operation example of the ultrasound diagnostic device 1 will be described with reference to Fig. 7. In the flowchart shown in Fig. 7, the reference numerals each consisting of "S" and a number indicate each step. Note that in Fig. 7, the same steps as those in Fig. 2 are given the same reference numerals and their description will be omitted.

[0069] The ultrasonic image processing device 10 receives an instruction to start a thrustography scan after receiving examination order information from an examination request device (not shown) such as an HIS. The operator places the tip of the ultrasonic probe 20 against the body surface of the subject while suppressing the application of pressure toward the living tissue. The B-mode processing function F1 controls the ultrasonic transmission circuit 11, the ultrasonic reception circuit 12, the pressure sensor 50, and the like to perform a scan using the ultrasonic probe 20. Then, the image generation function F3 acquires multiple images (B-mode images) (step S21). If the pressure application is suppressed and considered to be 0, the image generation function F3 acquires multiple first images H1 (H11, H12, ...) generated only by pulsation (or respiratory fluctuation) together with an electrocardiogram waveform prior to step S22 (first measurement shown in FIG. 8(A)). FIG. 8(A) shows multiple first images H1 when pressure is not actively applied and the applied pressure PH1 when the images are acquired.

[0070] 8(A) are not still but are changing due to pulsation, respiratory fluctuation, etc. The pressures PH11, PH12, ... associated with the first images H11, H12, ... respectively are pressures measured by the pressure sensor 50 when the first images H11, H12, ... were acquired, and since the ultrasonic probe 20 was not actively pressed against the body surface in the first measurement, the pressures are approximately constant values.

[0071] Next, the operator applies pressure to the body surface of the subject toward the same biological tissue and then places the tip of the ultrasonic probe 20 on the tissue. The B-mode processing function F1 controls the ultrasonic transmission circuit 11, the ultrasonic reception circuit 12, the pressure sensor 50, and the like to perform a scan using the ultrasonic probe 20. Then, the image generation function F3 acquires a plurality of second images (B-mode images) (step S22). That is, the image generation function F3 applies pressure to acquire a plurality of second images H (H21, H22, ...) (the second measurement shown in FIG. 8(B)). FIG. 8(B) shows a plurality of second images H22 when pressure is actively applied and the pressure PH2 (PH21, PH22, ...) at that time.

[0072] 8B, the images appearing in the second images H2 change according to the applied pressure PH in addition to pulsation and respiratory fluctuation. The pressures PH21, PH22, ... associated with the second images H21, H22, ... respectively are pressures measured by the pressure sensor 50 when the second images H21, H22, ... were acquired.

[0073] The displacement amount calculation function F4 aligns the phases based on the electrocardiogram waveform (or respiratory waveform) between the multiple first images acquired in step S21 and the multiple second images acquired in step S22, and calculates the displacement amount of the biological tissue between the first image and the second image having corresponding phases as the pressure displacement amount (step S23). In other words, noise components caused by periodic movements such as pulsation and respiratory fluctuation are removed from the second image.

[0074] For example, six variation elements CH211-CH216 of the biological tissue are calculated between the second image H21 shown in Fig. 8(B) and each of the six first images H11-H16 shown in Fig. 8(A) (shown in Fig. 9). The displacement amount calculation function F4 obtains the average value of the six displacement amount elements CH211-CH216 as the pressure displacement amount CH21 in the second image H21, and records the pressure displacement amount CH21 in the second image H21 in the main memory 16 together with the applied pressure PH21 applied at that phase.

[0075] Similarly, six displacement amount elements CH221-CH226 of the biological tissue are calculated between the second image H22 shown in Fig. 8(B) and each of the six first images H11-H16 shown in Fig. 8(A). The type of the first image to be compared with the second image H22 is the same as the type of the second image H21 described above. The displacement amount calculation function F4 obtains the average value of the six displacement amount elements CH221-CH226 as the pressure displacement amount CH22 of the second image H22, and records the pressure displacement amount CH22 in the second image H22 in the main memory 16 together with the applied pressure PH22 applied at that phase.

[0076] The method of calculating the pressure displacement amount from the second image H23 onwards shown in FIG. 8(B) is similar. The displacement amount calculation function F4 has been described as calculating a plurality of displacement amount elements of the biological tissue between each second image and the same plurality of first images (six first images H11 to H16) among the plurality of first images, and taking the average value of the plurality of displacement amount elements as the pressure displacement amount corresponding to each second image, but is not limited to this case. It is sufficient to calculate a plurality of displacement amount elements of the biological tissue between each second image and a plurality of first images among the plurality of first images, and take the average value of the plurality of displacement amount elements as the pressure displacement amount corresponding to each second image. For example, the displacement amount calculation function F4 may shift the acquisition time while keeping the number of the plurality of first images to be compared with the second image the same.

[0077] Next, the stiffness calculation function F5 calculates the stiffness (or elasticity) of the biological tissue based on the displacement amount of the biological tissue calculated in step S23 and the pressure P corresponding thereto (step S4).

[0078] As described above, according to the third operation example of the ultrasonic image processing device 10, it is possible to extract only the pressure displacement amount by removing noise components from the measured displacement amount, which includes the pressure displacement amount dependent on the externally applied pressure and the noise components due to the biological displacement caused by pulsation and respiratory fluctuation, without the phase sensor 60. By calculating the stiffness of biological tissue using the pressure displacement amount instead of the measured displacement amount, it is possible to improve the accuracy of measuring the stiffness of biological tissue.

[0079] Second embodiment The second embodiment relates to a medical information processing device 80 (also shown in FIG. 1) communicably connected to an ultrasonic diagnostic device 1 that acquires the pressure applied to a subject from a pressure sensor 50 attached to an ultrasonic probe 20.

[0080] 10, the medical information processing device 80 includes a network interface 84, a processing circuit 85, a memory 86, an input interface 87, and a display 88. Note that the configurations of the network interface 84, the processing circuit 85, the memory 86, the input interface 87, and the display 88 are equivalent to the configurations of the network interface 14, the processing circuit 15, the main memory 16, the input interface 30, and the display 40 shown in FIG. 1, respectively, and therefore description thereof will be omitted.

[0081] The processing circuit 85 realizes a displacement amount calculation function F4, a stiffness calculation function F5, a display control function F6, and an image generation function F7 by reading and executing a computer program stored in the memory 86 or a memory in the processing circuit 85. Hereinafter, a case where the functions F4 to F7 are realized by a computer program will be described as an example, but all or a part of the functions F4 to F7 may be provided as functions of a circuit such as an ASIC in the medical information processing device 80. In addition, in FIG. 10, the same functions as those shown in FIG. 1 are denoted by the same reference numerals, and description thereof will be omitted.

[0082] The image acquisition function F7 includes a function to acquire, via the network N, a plurality of first images in a time series including biological tissue, which were generated at an applied pressure below a threshold value, and to acquire, via the network N, a plurality of second images in a time series including biological tissue, which were generated at an applied pressure equal to or greater than the threshold value.

[0083] The displacement amount calculation function F4 includes a function of calculating the displacement amount of biological tissue between each second image acquired by the image acquisition function F7 and multiple first images acquired by the image acquisition function F7 as a pressure displacement amount (a displacement amount obtained by removing noise components from the measured displacement amount).

[0084] The medical information processing device 80 operates in the post-processing in the same manner as the first to third operation examples of the ultrasonic diagnostic device 1 described above.

[0085] As described above, according to the operation example of the medical information processing device 80, it is possible to extract only the pressure displacement amount by removing noise components from the measured displacement amount, which includes the pressure displacement amount dependent on the external applied pressure and the noise components due to the biological displacement caused by pulsation and respiratory fluctuation. By calculating the stiffness of biological tissue using the pressure displacement amount instead of the measured displacement amount, it is possible to improve the accuracy of measuring the stiffness of biological tissue.

[0086] According to at least one of the embodiments described above, the accuracy of measuring the stiffness of biological tissue can be improved by calculating the stiffness of biological tissue using the pressure displacement amount rather than the measured displacement amount.

[0087] The B-mode processing function F1 is an example of a B-mode processing unit. The Doppler processing function F2 is an example of a Doppler processing unit. The image generation function F3 is an example of an image generation unit. The displacement amount calculation function F4 is an example of a displacement amount calculation unit. The stiffness calculation function F5 is an example of a stiffness calculation unit. The display control function F6 is an example of a display control unit. The image acquisition function F7 is an example of an image acquisition unit.

[0088] Although some embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, combinations of embodiments, and combinations of embodiments with one or more modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0089] 1. Ultrasound diagnostic equipment 10...Ultrasound image processing device 15...Processing circuit 20...Ultrasound probe 30…Input interface 40…Display 50...Pressure sensor 60...Phase sensor 80...Medical information processing device F1…B mode processing function F2: Doppler processing function F3: Image generation function F4…Displacement calculation function F5…Hardness calculation function F6…Display control function F7…Image acquisition function

Claims

1. An ultrasonic diagnostic apparatus that acquires an applied pressure to a subject from a pressure sensor attached to an ultrasonic probe, an image generating unit that generates a plurality of first images in a time series including the biological tissue at an applied pressure less than a pressure threshold, and generates a plurality of second images in a time series including the biological tissue at an applied pressure equal to or greater than the pressure threshold; a displacement amount calculation unit that calculates a displacement amount of the biological tissue between each of the second images of the plurality of second images and the plurality of first images; a stiffness calculation unit that calculates stiffness of the biological tissue based on the displacement amount corresponding to each of the second images and the applied pressure equal to or greater than the pressure threshold corresponding to each of the second images; An ultrasound diagnostic device comprising:

2. The displacement amount calculation unit calculating a displacement amount of the biological tissue between each of the second images and a first image among the plurality of first images, the first image having a corresponding cardiac phase or respiratory phase; The ultrasonic diagnostic apparatus according to claim 1 .

3. The displacement amount calculation unit acquiring the cardiac phase in each of the first images and the second images based on phase information acquired from an electrocardiograph, and acquiring the respiratory phase in each of the first images and the second images based on phase information acquired from a respiratory sensor; The ultrasonic diagnostic apparatus according to claim 2 .

4. The displacement amount calculation unit acquiring the cardiac phase or the respiratory phase in each of the first images and the second images based on morphologies of the biological tissue included in the first images and the second images; The ultrasonic diagnostic apparatus according to claim 2 .

5. The displacement amount calculation unit Calculating a plurality of displacement amount elements of the biological tissue between each of the second images and a plurality of first images among the plurality of first images, and setting an average value of the plurality of displacement amount elements as the displacement amount corresponding to each of the second images. The ultrasonic diagnostic apparatus according to claim 1 .

6. The displacement amount calculation unit Calculating a plurality of displacement amount elements of the biological tissue between each of the second images and the same plurality of first images among the plurality of first images, and setting an average value of the plurality of displacement amount elements as the displacement amount corresponding to each of the second images. The ultrasonic diagnostic apparatus according to claim 1 .

7. The image generating unit includes: When an applied pressure equal to or greater than the pressure threshold is detected for a period equal to or less than a time threshold during acquisition of the plurality of first images, the acquisition of the plurality of first images is stopped, and a message is output to inform the user that the acquisition has been stopped.

7. The ultrasonic diagnostic apparatus according to claim 1.

8. A medical information processing device communicably connected to an ultrasonic diagnostic device that acquires an applied pressure to a subject from a pressure sensor attached to an ultrasonic probe, an image acquisition unit that acquires a plurality of first images in a time series including biological tissue generated at an applied pressure less than a pressure threshold, and acquires a plurality of second images in a time series including biological tissue generated at an applied pressure equal to or greater than the pressure threshold; a displacement amount calculation unit that calculates a displacement amount of the biological tissue between each of the second images of the plurality of second images and the plurality of first images; a stiffness calculation unit that calculates stiffness of the biological tissue based on the displacement amount corresponding to each of the second images and the applied pressure equal to or greater than the pressure threshold corresponding to each of the second images; A medical information processing device comprising:

9. On the computer, generating a plurality of first images in a time series including the biological tissue at an applied pressure less than a pressure threshold, and generating a plurality of second images in a time series including the biological tissue at an applied pressure equal to or greater than the pressure threshold; a function of calculating a displacement amount of the biological tissue between each of the second images of the plurality of second images and the plurality of first images; a function of calculating a stiffness of the biological tissue based on the displacement amount corresponding to each of the second images and the applied pressure equal to or greater than the pressure threshold corresponding to each of the second images; A hardness calculation program that makes this possible.

Images