Information Processing Apparatus, Ultrasonic Diagnostic Apparatus, Information Processing Method, and Information Processing Program

Abstract

An information-processing device comprising: an acquisition unit that acquires an ultrasonic image of a vein in a predetermined region spanning from the center to a periphery of a subject; a detection unit that detects an anomaly site where an anomaly is present in the vein, from the acquired ultrasonic image; and a determination unit that determines whether or not it is appropriate to perform paracentesis on the vein, on the basis of the detected anomaly site, and outputs the result of the determination.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an ultrasonic diagnostic apparatus, an information processing method, and an information processing program.

Background Art

[0002] An ultrasonic diagnostic apparatus is known that captures an ultrasonic image of a subject using an ultrasonic probe that receives an ultrasonic echo caused by ultrasonic waves transmitted toward the subject and outputs a reception signal based on the received ultrasonic echo.

[0003] As techniques for detecting abnormalities in blood vessels using ultrasonic images, for example, the techniques described in JP-A-2009-195585 and JP-A-2018-000346 are known. In the technique described in JP-A-2009-195585, a technique for specifying the position of a stenosis candidate in a blood vessel based on the area of the lumen of the blood vessel derived using volume data obtained by scanning the surface of the subject's body with an ultrasonic probe is described. Further, JP-A-2018-000346 describes a technique for determining an abnormal site based on the blood flow in a blood vessel detected based on an ultrasonic image of the subject.

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, the blood vessels of a subject are punctured by inserting an insert such as a so-called puncture needle and catheter. As a puncture method such as the echo-guided puncture method, a method is known in which an ultrasonic image of the blood vessel of a subject is captured and puncture is performed with reference to the blood vessel shown in the captured ultrasonic image.

[0005] When performing puncture, if there is an abnormality in the blood vessel, it is necessary to consider the existing abnormality. According to the techniques described in JP-A-2009-195585 and JP-A-2018-000346, although the abnormal location where an abnormality has occurred in the blood vessel can be presented to the user performing the puncture, the case of performing puncture has not been sufficiently considered.

[0006] The present disclosure has been made in consideration of the above circumstances, and provides an information processing apparatus, an ultrasonic diagnostic apparatus, an information processing method, and an information processing program that can assist a user who performs puncture of a blood vessel in considering an abnormal puncture position with respect to the blood vessel abnormality.

Means for Solving the Problems

[0007] The information processing apparatus according to the first aspect of the present disclosure includes an acquisition unit that acquires an ultrasonic image of a vein in a predetermined region from the center to the periphery of a subject, a detection unit that detects an abnormal portion where an abnormality has occurred in the vein from the acquired ultrasonic image, and a determination unit that determines the suitability of puncture in the vein according to the detected abnormal portion and outputs a determination result.

[0008] The information processing apparatus according to the second aspect of the present disclosure is the information processing apparatus according to the first aspect, wherein the determination unit determines that puncture at a position on the peripheral side of the abnormal portion is inappropriate.

[0009] The information processing apparatus according to the third aspect of the present disclosure is the information processing apparatus according to the first aspect or the second aspect, wherein when the detection unit detects a plurality of abnormal portions, the determination unit determines that puncture at a position on the peripheral side of the abnormal portion located most centrally is inappropriate.

[0010] The information processing apparatus according to the fourth aspect of the present disclosure is the information processing apparatus according to any one of the first aspect to the third aspect, wherein the acquisition unit further acquires the position of the ultrasonic probe when the acquired ultrasonic image is taken, and the determination unit determines the suitability of puncture based on the detection result of the detection unit and the position of the ultrasonic probe.

[0011] The information processing apparatus according to the fifth aspect of the present disclosure is the information processing apparatus according to any one of the first aspect to the fourth aspect, wherein the determination unit outputs information indicating a warning as a determination result.

[0012] The information processing apparatus according to the sixth aspect of the present disclosure is the information processing apparatus according to any one of the first to fifth aspects, wherein the detection unit detects veins from an ultrasonic image.

[0013] The information processing apparatus according to the seventh aspect of the present disclosure includes an acquisition unit that acquires an ultrasonic image of blood vessels in a predetermined region from the center to the end of a subject, a detection unit that detects an abnormal location where an abnormality has occurred in the blood vessels from the acquired ultrasonic image, and determines that puncture of the blood vessels at a position upstream of the detected abnormal location in terms of blood flow is inappropriate, and outputs the determination result comprising a determination unit 。

[0014] The ultrasonic diagnostic apparatus according to the eighth aspect of the present disclosure includes an ultrasonic probe that receives an ultrasonic echo by transmitted ultrasonic waves and outputs a reception signal based on the received ultrasonic echo, an image generation unit that generates an ultrasonic image based on the reception signal input from the ultrasonic probe, and the information processing apparatus of the present disclosure.

[0015] The information processing method according to the ninth aspect of the present disclosure is a method for a computer to execute a process of acquiring an ultrasonic image of veins in a predetermined region from the center to the periphery of a subject, detecting an abnormal location where an abnormality has occurred in the veins from the acquired ultrasonic image, determining the appropriateness of puncture in the veins according to the detected abnormal location, and outputting the determination result.

[0016] The information processing program according to the tenth aspect of the present disclosure is for causing a computer to execute a process of acquiring an ultrasonic image of veins in a predetermined region from the center to the periphery of a subject, detecting an abnormal location where an abnormality has occurred in the veins from the acquired ultrasonic image, determining the appropriateness of puncture in the veins according to the detected abnormal location, and outputting the determination result.

Advantages of the Invention

[0017] According to the present disclosure, it is possible to assist a user who performs puncture of blood vessels in considering an abnormal blood vessel when determining a puncture position.

Brief Description of the Drawings

[0018]

Figure 1

Figure 2

Figure 3

Figure 4A

Figure 4B

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9A

Figure 9B

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Embodiments for Carrying Out the Invention

[0019] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. Note that these embodiments do not limit the present disclosure.

[0020] First, an example of the overall configuration of the ultrasonic diagnostic apparatus according to this embodiment will be described. FIG. 1 shows a block diagram representing an example of the overall configuration of the ultrasonic diagnostic apparatus 1 according to this embodiment. As shown in FIG. 1, the ultrasonic diagnostic apparatus 1 according to this embodiment includes an ultrasonic probe 10 and a main body unit 12.

[0021] The ultrasonic probe 10 includes a transducer array 20 and a transmission / reception circuit 22 including a transmission circuit 24 and a reception circuit 26. The transducer array 20 includes a plurality of transducers (not shown) arranged in a one-dimensional or two-dimensional manner. As an example, in this embodiment, a form in which the ultrasonic probe 10 is a linear ultrasonic probe in which a plurality of transducers are linearly arranged will be described. Note that the ultrasonic probe 10 is not limited to this form, and may be a convex or sector type ultrasonic probe in which the transducers are curved and arranged. Each of the plurality of transducers transmits ultrasonic waves based on a drive signal received from the transmission circuit 24, and receives an ultrasonic echo generated in the subject, and outputs an electrical signal corresponding to the received ultrasonic echo. applied Each of the plurality of transducers transmits ultrasonic waves based on the drive signal received from the transmission circuit 24, and receives the ultrasonic echo generated in the subject, and outputs an electrical signal corresponding to the received ultrasonic echo.

[0022] Each of the plurality of transducers is configured by forming electrodes on both ends of a piezoelectric body, which is a material having piezoelectricity such as piezoelectric ceramics represented by PZT (Lead Zirconate Titanate), polymer piezoelectric elements represented by PVDF (Poly Vinylidene Di Fluoride), and piezoelectric single crystals represented by PMN-PT (Lead Magnesium Niobate-Lead Titanate).

[0023] The transmission circuit 24 causes the oscillator array 20 to transmit an ultrasonic beam toward the subject. Specifically, the transmission circuit 24 includes, for example, a plurality of pulse generators (not shown), and based on a transmission delay pattern selected according to a control signal from the imaging control unit 30 of the main body unit 12, for each of the plurality of oscillators included in the oscillator array 20, the respective delay amounts are adjusted to supply a drive signal and apply a voltage. Each drive signal is a pulsed or continuous-wave voltage signal. When a voltage is applied to the electrodes of the oscillators of the oscillator array 20, the piezoelectric body expands and contracts. As a result of the above, pulsed or continuous-wave ultrasonic waves are generated from each oscillator, and an ultrasonic beam is formed from the combined wave of these ultrasonic waves.

[0024] The transmitted ultrasonic beam is reflected by each part (e.g., blood vessels and other tissues, etc.) in the subject and instruments arranged in the subject, thereby generating ultrasonic echoes. The generated ultrasonic echoes propagate through the subject and are received by the plurality of oscillators included in the oscillator array 20. Each oscillator generates an electrical signal corresponding to the received ultrasonic echo. The electrical signals generated at each oscillator are output to the reception circuit 26.

[0025] The reception circuit 26 performs processing on the signal output from the oscillator array 20 (strictly speaking, an analog electrical signal) according to a control signal from the imaging control unit 30 of the main body unit 12 to generate a beam signal. FIG. 2 shows a block diagram representing an example of the configuration of the reception circuit 26 of the present embodiment. As shown in FIG. 2, the reception circuit 26 has, for example, an amplification unit 60, an AD (Analog Digital) conversion unit 62, and a beam former 64.

[0026] The amplifier unit 60 amplifies the electrical signals output from each of the plurality of vibrators included in the vibrator array 20, and outputs the amplified electrical signals to the AD conversion unit 62. The AD conversion unit 62 converts the amplified electrical signals into digital received data, and outputs each of the converted received data to the beamformer 64. The beamformer 64 gives respective delays to each of the received data converted by the AD conversion unit 62 according to the speed of sound or the distribution of the speed of sound set based on the reception delay pattern selected according to the control signal from the imaging control unit 30 of the main body unit 12, and adds them up to perform reception focusing processing. By this reception focusing processing, each of the received data converted by the AD conversion unit 62 is integrally added, and a sound line signal with the focus of the ultrasonic echo narrowed down is generated. The generated sound line signal is output to the image generation unit 32 of the main body unit 12.

[0027] On the other hand, the main body unit 12 includes an imaging control unit 30, an image generation unit 32, an acquisition unit 34, a detection unit 36, a determination unit 38, and a display unit 40. As an example, the main body unit 12 of the present embodiment is a portable terminal device such as a smartphone or a tablet terminal. The main body unit 12 has a function of taking an ultrasonic image, which is a B-mode image (tomographic image) regarding tissues in a subject, from the sound line signal obtained by scanning the subject with the ultrasonic probe 10 when a program such as application software is installed. The main body unit 12 of the present embodiment is an example of the information processing apparatus of the present disclosure.

[0028] When taking an ultrasonic image, the imaging control unit 30 has a function of outputting a control signal to the transmission / reception circuit 22 of the ultrasonic probe 10 as described above. When the control signal output from the imaging control unit 30 is input to the transmission circuit 24 and the reception circuit 26, a sound line signal is output from the reception circuit 26 of the ultrasonic probe 10 to the image generation unit 32 as described above.

[0029] The image generation unit 32 has a function of generating an ultrasonic image based on the beam signal input from the reception circuit 26 of the ultrasonic probe 10. FIG. 3 shows a block diagram representing an example of the configuration of the image generation unit 32 of the present embodiment. As shown in FIG. 3, the image generation unit 32 includes, for example, a signal processing unit 70, a DSC (Digital Scan Converter) 72, and an image processing unit 74. The signal processing unit 70 performs attenuation correction based on distance according to the depth of the reflection position of the ultrasonic wave on the beam signal generated by the reception circuit 26, and then performs envelope detection processing to generate a B-mode image signal indicating the ultrasonic image U. The DSC 72 converts the B-mode image signal generated by the signal processing unit 70 into an image signal conforming to the scanning method of a normal television signal by raster conversion or the like. The image processing unit 74 performs various necessary image processing such as tone processing on the B-mode image signal input from the DSC 72, and then outputs the B-mode image signal. The B-mode image signal output from the image generation unit 32 corresponds to the ultrasonic image U.

[0030] The transmission / reception circuit 22 of the ultrasonic probe 10 and the image generation unit 32 of the main body unit 12 continuously acquire a plurality of ultrasonic images at a constant frame rate during the ultrasonic image shooting period under the control of the shooting control unit 30.

[0031] Note that by moving the ultrasonic probe 10 while it is in contact with the subject, the part where the tomogram is observed changes in the ultrasonic image, and by changing the direction in which the ultrasonic probe 10 contacts the subject, the observation direction of blood vessels or the like in the subject can be switched. For example, when the ultrasonic probe 10 contacts the subject with the direction in which a plurality of vibrators are arranged in the vibrator array 20 (that is, the scanning direction) intersecting the extending direction of the blood vessel and the insert, that is, when the short-axis method (crossing method) is adopted, the cross-section of the blood vessel and the insert is observed in the ultrasonic image. FIG. 4A shows an example of the ultrasonic image U taken by the short-axis method. In the ultrasonic image U shown in FIG. 4A, the cross-section of the blood vessel B and the cross-section of the puncture needle N, which is an example of the insert, are shown. Here, the cross-section of each of the blood vessel B and the puncture needle N means a cross-section orthogonal to the extending direction of each of the blood vessel B and the puncture needle N.

[0032] On the other hand, when the ultrasonic probe 10 contacts the subject with the array direction (scanning direction) of the vibrators in the vibrator array 20 along the extending direction of the blood vessel and the insert, that is, when the long-axis method (parallel method) is adopted, a longitudinal section of the blood vessel and the insert is observed in the ultrasonic image. FIG. 4B shows an example of the ultrasonic image U taken by the long-axis method. In the ultrasonic image U shown in FIG. 4B, a longitudinal section of the blood vessel B and a longitudinal section of the puncture needle N, which is an example of the insert, are shown. Here, the longitudinal sections of the blood vessel B and the puncture needle N respectively mean cross-sections along the extending directions of the blood vessel B and the puncture needle N.

[0033] In the present embodiment, as shown in FIGS. 4A and 4B, in the ultrasonic image U, the direction connecting the body surface S and the inside of the subject is referred to as the depth direction D. The depth direction D corresponds to the direction in which a plurality of scanning lines in the ultrasonic image U extend. Each part such as the blood vessel B and the puncture needle N in the ultrasonic image U is displayed at a position corresponding to the distance from the body surface of the subject contacted by the ultrasonic probe 10, that is, the depth, in the depth direction D.

[0034] The ultrasonic image U generated by the image generation unit 32 is output to the acquisition unit 34.

[0035] The acquisition unit 34 has a function of acquiring the ultrasonic image U generated and output by the image generation unit 32. Specifically, it has a function of photographing a predetermined region from the center to the end of the subject with the ultrasonic probe 10 and acquiring the ultrasonic image U generated and output by the image generation unit 32.

[0036] In addition, the acquisition unit 34 of the present embodiment has a function of acquiring information representing the position of the ultrasonic probe 10. As an example for detecting the position of the ultrasonic probe 10, in the present embodiment, a transmitter 14 and a magnetic sensor 16 as three-dimensional position detection sensors are provided. Each of the transmitter 14 and the magnetic sensor 16 includes orthogonal coils in three directions corresponding to each of the x-axis, y-axis, and z-axis. By sequentially exciting each coil of the transmitter 14 and measuring the electromotive force of each coil included in the magnetic sensor 16, the three-dimensional position of the ultrasonic probe 10 can be measured. As an example, the transmitter 14 of the present embodiment is fixed at a predetermined position on the head side of the subject of the bed on which the subject lies when performing puncture. On the other hand, the magnetic sensor 16 is attached to the ultrasonic probe 10.

[0037] The acquisition unit 34 outputs a detection instruction signal to the transmitter 14. When the detection instruction signal is input from the acquisition unit 34, the transmitter 14 sequentially excites the orthogonal coils in three directions as described above. Information representing the position of the ultrasonic probe 10 is output from the magnetic sensor 16 to the acquisition unit 34 as a detection result. In this way, the acquisition unit 34 acquires the position of the ultrasonic probe 10 when the ultrasonic image U is taken. The acquisition unit 34 associates the ultrasonic image U acquired from the image generation unit 32 with the information representing the position of the ultrasonic probe 10 when the ultrasonic image U is taken, which is acquired from the magnetic sensor 16, and outputs the result to the detection unit 36.

[0038] When the image generation unit 32 functions as the information processing apparatus of the present disclosure as in the present embodiment, the functions of the image generation unit 32 and the acquisition unit 34 may be integrated. In other words, when the information processing apparatus of the present disclosure includes the image generation unit 32, the image generation unit 32 may further function as the acquisition unit 34.

[0039] The detection unit 36 has a function of detecting an abnormal location where an abnormality has occurred in the blood vessel B that is the target of puncture from the ultrasonic image U input from the acquisition unit 34. In this embodiment, since the vein BV is the target of puncture, the detection unit 36 detects an abnormal location where an abnormality has occurred in the vein BV. Therefore, as an example, the detection unit 36 of this embodiment first detects the vein BV from the ultrasonic image U. The method by which the detection unit 36 detects the vein BV from the ultrasonic image U is not particularly limited. For example, it may be in a form where all blood vessels B including the artery and the vein BV included in the ultrasonic image U are detected, and then the vein BV is further detected from the detected blood vessels B. Also, for example, it may be in a form where only the vein BV among the blood vessels B is detected from the ultrasonic image U.

[0040] As an example, the detection unit 36 of this embodiment analyzes the ultrasonic image U acquired by the acquisition unit 34, in other words, the ultrasonic image U generated by the image generation unit 32, according to a known algorithm to detect the vein BV in the ultrasonic image U. For example, the detection unit 36 stores in advance, as a template, typical pattern data of a blood vessel region where the vein BV exists, searches the inside of the ultrasonic image U with the template, derives the similarity to the pattern data, and can consider that the vein BV exists at the location where the similarity is equal to or greater than the reference value and is the maximum.

[0041] In addition to simple template matching, methods using a learned learning model based on the feature amount of an image representing the vein BV can be mentioned for deriving the similarity. For example, Csurka e t a l.: Visual Categorization with Bags of Keypoints, Proc. of ECCV Workshop on Statistical Learning in Computer Vision, pp.59-74 (2004) describes SVM (Support Vector Machine) and AdaBoost (Adaptive Boos tiMachine learning methods such as ng), or general image recognition methods using deep learning described in Krizhevsk et al.: ImageNet Classification with Deep Convolutional Neural Networks, Advances in Neural Information Processing Systems 25, pp.1106-1114 (2012) can be used.

[0042] Also, for example, the detection unit 36 may detect the vein BV in the ultrasonic image U using a vein detection model that is a trained model machine-learned by a plurality of ultrasonic images U labeled for the vein BV. The vein detection model is, for example, an object detection algorithm using deep learning. As the vein detection model, for example, an object detection model constituted by R-CNN (Regional CNN), which is a type of convolutional neural network (CNN: Convolutional Neural Network), can be used. The vein detection model detects the vein BV as an object from the input ultrasonic image U and outputs information representing the vein BV in the ultrasonic image U.

[0043] Note that the detection unit 36 of the present embodiment detects all the vein BVs included in the ultrasonic image U. When the ultrasonic image U includes a plurality of vein BVs, for each of the plurality of vein BVs, for example, a form in which detection is performed by applying template matching, a general image recognition method, or a vein detection model may be used. Also, for example, one or more vein BVs may be grouped together and detection may be performed by applying template matching, a general image recognition method, or a vein detection model.

[0044] Furthermore, the detection unit 36 detects an abnormal location where an abnormality has occurred in the detected vein BV. Examples of abnormalities in the vein BV include, for example, thrombus, a portion connected to an artery for a shunt, and the like. As a specific example, in the present embodiment, a case where the abnormality is a thrombus and the abnormal location is a location where a thrombus has occurred in the vein BV will be described.

[0045] Note that the method for the detection unit 36 to detect an abnormal location where a thrombus has occurred in the vein BV is not particularly limited. For example, the blood vessel diameter of the vein BV in each of a plurality of ultrasonic images U taken along the vein BV may be detected, and a location where a stenosis has occurred with the blood vessel diameter being narrower than that in other ultrasonic images U may be detected as an abnormal location where a thrombus has occurred.

[0046] Also, for example, typical pattern data of a thrombus in the vein BV is stored in advance as a template, the similarity to the pattern data is derived while searching the region of the vein BV in the ultrasonic image U with the template, and it can be considered that a thrombus exists at a location where the similarity is equal to or greater than a reference value and is maximum.

[0047] In addition, for the derivation of the similarity, in addition to simple template matching, there is a method using a learned learning model based on the feature amount of an image representing a thrombus. For example, machine learning methods such as SVM and AdaBoost described above, or general image recognition methods using deep learning described above can be used.

[0048] Also, for example, the detection unit 36 may detect a thrombus in the vein BV in the ultrasonic image U using a thrombus detection model which is a learned model machine-learned by a plurality of ultrasonic images U labeled with respect to the thrombus. The thrombus detection model is, for example, an algorithm for object detection using deep learning. As the thrombus detection model, for example, an object detection model constituted by R-CNN (Regional CNN) which is a type of convolutional neural network (CNN) can be used. The thrombus detection model detects a thrombus as an object from the input ultrasonic image U and outputs information representing the thrombus in the ultrasonic image U.

[0049] Note that the present invention is not limited to this embodiment, and the detection unit 36 may be configured to directly detect an abnormal location where a thrombus has occurred in the vein BV from the ultrasonic image U.

[0050] The detection result of the detection unit 36 is output to the determination unit 38. Specifically, information representing the vein BV in the ultrasonic image U detected by the detection unit 36 and information on the abnormal location where a thrombus has occurred in the vein BV are output to the determination unit 38. In this embodiment, as the abnormal location, the position of the ultrasonic probe 10 associated with the ultrasonic image U is adopted.

[0051] The determination unit 38 has a function of determining the suitability of puncture in the vein BV according to the abnormal location detected by the detection unit 36 and outputting a determination result. Regarding puncture, it may not be preferable to perform it on the peripheral side of the abnormal location where an abnormality has occurred in the vein BV. In particular, when blood, infusion fluid, etc. are caused to flow into the vein BV by puncture, it may not be preferable to perform it on the peripheral side of the abnormal location, so this will be described with reference to FIG. 5. In this embodiment, "central side" refers to the side closer to the heart of the subject, and "peripheral side" refers to the end side such as the fingertips of the subject. As shown in FIG. 5, in the vein BV, blood flows from the peripheral side to the central side. In other words, the blood flow in the vein BV is in the direction from the peripheral side to the central side. When a thrombus BC has occurred in the vein BV, if puncture is performed on the peripheral side of the thrombus BC and blood or infusion fluid is caused to flow in, there is a concern that the thrombus BC may be detached by the flowing-in blood or infusion fluid and the detached thrombus BC may reach the circulatory organs. Therefore, in this embodiment, as shown in FIG. 5, it is considered inappropriate to perform puncture on the peripheral side of the abnormal location where the thrombus BC has occurred in the vein BV. In other words, it is considered appropriate to perform puncture on the central side of the abnormal location where the thrombus BC has occurred in the vein BV. abnormal part For the location closer to the central side than the abnormal location where the thrombus BC has occurred, it is considered appropriate to perform puncture.

[0052] Therefore, the detection unit 36 of this embodiment determines that it is inappropriate to perform puncture in the vein BV on the peripheral side of the abnormal location where the thrombus BC has occurred in the vein BV, and also determines that it is appropriate to perform puncture in the vein BV on the central side of the abnormal location.

[0053] When the determination unit 38 determines that it is inappropriate to perform the puncture, it outputs information indicating a warning. As an example in this embodiment, information indicating a warning that it is inappropriate to perform the puncture is added to the ultrasonic image U input from the acquisition unit 34 and output to the display unit 40 for display. On the other hand, when the determination unit 38 determines that it is appropriate to perform the puncture, only the ultrasonic image U input from the acquisition unit 34 is output to the display unit 40.

[0054] The display unit 40 has a function of displaying the ultrasonic image U to which information indicating a warning output from the display unit 40 is added, or various information such as the ultrasonic image U. Examples of the display unit 40 include an LCD (Liquid Crystal Display), an organic EL (ElectroLuminescence) display, and a head-mounted display.

[0055] The main body unit 12 described above can be configured by, for example, the hardware shown in FIG. 6. FIG. 6 shows a configuration diagram representing an example of the hardware configuration of the main body unit 12 of this embodiment. As shown in FIG. 6, the main body unit 12 includes a display unit 40, a control unit 50, a storage unit 52, communication an I / F (Interface) unit 54, and an input I / F unit 56. The display unit 40, the control unit 50, the storage unit 52, the communication I / F unit 54, and the input I / F unit 56 are connected to each other via a bus 59 such as a system bus or a control bus so that various information can be exchanged.

[0056] The control unit 50 controls the overall operation of the main body unit 12. The control unit 50 includes a CPU (Central Processing Unit) 50A, a ROM (Read Only Memory) 50B, and a RAM (Random Access Memory) 50C. In the ROM 50B, various programs including a puncture assistance processing program 51 executed by the CPU 50A and a photographing program (not shown) are stored in advance. The RAM 50C temporarily stores various data. The puncture assistance processing program 51 of this embodiment is an example of the information processing program of the present disclosure.

[0057] By executing the imaging program stored in the ROM 50B, the CPU 50A functions as the imaging control unit 30. Also, by executing the puncture assistance processing program 51 stored in the ROM 50B, the CPU 50A functions as the acquisition unit 34, the detection unit 36, and the determination unit 38.

[0058] The storage unit 52 stores the image data of the ultrasonic image U generated by the image generation unit 32, information representing the position of the ultrasonic probe 10, and various other information. Specific examples of the storage unit 52 include an HDD (Hard Disk Drive), an SSD (Solid State Drive), and an SD (Secure Digital) card, etc.

[0059] The input I / F unit 56 is used for the user to input instructions regarding the imaging of the ultrasonic image U and various other information. The input I / F unit 56 is not particularly limited, and examples include various switches, a touch panel, a touch pen, a camera, and a mouse, etc. Note that the display unit 40 and the input I / F unit 56 may be integrated into a touch panel display.

[0060] The communication I / F unit 54 communicates various information with external devices such as the ultrasonic probe 10, the transmitter 14, the magnetic sensor 16, and the ultrasonic diagnostic apparatus 1 via wireless communication such as WiFi (registered trademark) or Bluetooth (registered trademark), or wired communication. As described above, a control signal for imaging the ultrasonic image U is output from the main body unit 12 to the ultrasonic probe 10 via the communication I / F unit 54. Also, an acoustic line signal is input from the ultrasonic probe 10 to the main body unit 12 via the communication I / F unit 54. Also, from the main body unit 12 communication a detection instruction signal for detecting the position of the ultrasonic probe 10 is output to the transmitter 14 via the I / F unit 54. Also, from the magnetic sensor 16 communication information representing the position of the ultrasonic probe 10 is input to the main body unit 12 via the I / F unit 54.

[0061] Next, the operation of the main body 12 of the present embodiment will be described with reference to the drawings. In this embodiment, as an example, the CPU 50A of the control unit 50 executes the puncture assistance processing program 51 stored in the ROM 50B to execute the puncture assistance processing shown as an example in FIG. 7. FIG. 7 shows a flowchart representing an example of the flow of the puncture assistance processing executed in the main body 12 of the present embodiment. The puncture assistance processing shown in FIG. 7 is executed, for example, when the main body 12 is powered on or when execution is instructed by the user via the input I / F unit 56.

[0062] When performing a puncture, in order to search for the puncture site, the user scans the body surface of the subject with the ultrasonic probe 10 from the central side to the peripheral side or from the peripheral side to the central side with respect to the part of the subject where the puncture is to be performed, such as the upper limb or the lower limb. The region where the body surface of the subject is scanned by the ultrasonic probe 10 in the present embodiment is an example of the predetermined region of the present disclosure. Hereinafter, as an example, a form in which scanning is performed from the central side to the peripheral side of the subject will be described in advance.

[0063] In step S100 of FIG. 7, acquisition unit 34 determines whether or not the scan of the subject by ultrasonic probe 10 has started. The method by which acquisition unit 34 determines whether or not the scan of the subject has started is not particularly limited. For example, it may be a form in which acquisition unit 34 determines that the scan has started by acquiring the scan start information input by the user via input I / F unit 56. Also, for example, it may be a form in which acquisition unit 34 determines that the scan has started when ultrasonic probe 10 changes from the air emission state to the contact state with the subject using image recognition or a temperature sensor. Note that the air emission state means a state in which ultrasonic probe 10 emits ultrasonic waves into the air away from the body surface of the subject. As a technique for detecting whether ultrasonic probe 10 is in the air emission state or the contact state with the subject, for example, the technique described in International Publication No. 2017 / 033502 can be applied. The technique described in International Publication No. 2017 / 033502 is a technique based on the fact that when ultrasonic probe 10 contacts the body surface of the subject and emits ultrasonic waves into the body of the subject, some structure, that is, tissue in the subject, is depicted in ultrasonic image U, but when ultrasonic probe 10 emits ultrasonic waves into the air away from the body surface of the subject, no structure is depicted in ultrasonic image U. That is, when the presence or absence of a structure in ultrasonic image U generated by image generation unit 32 is detected and it is detected that there is a structure in ultrasonic image U, it is determined that ultrasonic probe 10 is in the contact state with the subject. On the other hand, when it is detected that there is no structure in ultrasonic image U, it is determined that ultrasonic probe 10 is in the air emission state.

[0064] Until the scan of the subject by ultrasonic probe 10 starts, the determination in step S100 is a negative determination. On the other hand, when the scan of the subject by ultrasonic probe 10 starts, the determination in step S100 becomes an affirmative determination and the process proceeds to step S102.

[0065] In step S102, the acquisition unit 34 starts acquiring the ultrasonic image U and the position of the ultrasonic probe 10. As described above, the acquisition unit 34 of the present embodiment acquires the ultrasonic image U from the image generation unit 32, and also acquires information representing the position of the ultrasonic probe 10 when the acquired ultrasonic image U is taken from the magnetic sensor 16. The acquisition unit 34 associates the ultrasonic image U with the information representing the position of the ultrasonic probe 10 when the ultrasonic image U is taken, and outputs the result to the detection unit 36.

[0066] In the next step S104, the detection unit 36 stores the acquired ultrasonic image U in the storage unit 52 in a state where the ultrasonic probe 10 is associated therewith.

[0067] In the next step S106, the acquisition unit 34 determines whether or not the scan of the subject by the ultrasonic probe 10 has ended. The method by which the acquisition unit 34 determines whether or not the scan of the subject has ended is not particularly limited. For example, the acquisition unit 34 may determine that the scan has ended by acquiring the scan end information input by the user via the input I / F unit 56. Also, for example, the acquisition unit 34 may determine that the scan has ended when the ultrasonic probe 10 changes from the state of being in contact with the subject to the state of radiating into the air. In addition, as a technique for detecting whether the ultrasonic probe 10 is in the state of radiating into the air or the state of being in contact with the subject in this case, the technique described in step S100 can be applied.

[0068] If the scan of the subject by the ultrasonic probe 10 has not ended, the determination in step S106 becomes a negative determination, and the process returns to step S102, and the processes of steps S102 and S104 are repeated to repeatedly acquire and store the ultrasonic image U and the position of the ultrasonic probe 10. On the other hand, when the scan of the subject by the ultrasonic probe 10 ends, the determination in step S106 becomes an affirmative determination, and the process proceeds to step S108.

[0069] In step S108, the acquisition unit 34 ends the acquisition of the ultrasonic image U and the position of the ultrasonic probe 10.

[0070] In the next step S110, the detection unit 36 detects the vein BV from the ultrasonic image U as described above.

[0071] In the next step S112, the detection unit 36 detects an abnormal location where a thrombus BC has occurred from the vein BV in the ultrasonic image U as described above. Specifically, the position of the ultrasonic probe 10 when the ultrasonic image U in which the thrombus BC has occurred in the vein BV is taken is detected. When a plurality of veins BV are detected in the step S110, the thrombus BC in each vein BV is detected. Also, when a plurality of thrombi BC are detected for one vein BV, for all the thrombi BC, the abnormal locations where each thrombus BC has occurred are detected. The detection unit 36 outputs information representing the abnormal locations where the detected thrombus BC has occurred to the determination unit 38.

[0072] In the next step S114, the determination unit 38 determines whether there is an abnormal location. When an abnormal location is detected in the step S112, specifically, when information indicating that there is no abnormal location is input from the detection unit 36 to the determination unit 38, since no thrombus BC has occurred in all the veins BV in the scan range, the determination in step S114 becomes a negative determination, and the process proceeds to step S116.

[0073] In step S116, the determination unit 38 outputs information indicating that there is no abnormal location where a thrombus BC has occurred in all the veins BV in the scan range to the display unit 40. As a result, information 80 indicating that there is no abnormal location is displayed on the display unit 40 as shown in an example in FIG. 8. When the user sees that the information 80 indicating that there is no abnormal location is displayed on the display unit 40, the user performs puncture at a desired location in the scan range. In this case, the subject may be scanned again by the ultrasonic probe 10 to take the ultrasonic image U, and the ultrasonic image U acquired by the image generation unit 32 and displayed on the display unit 40 may be referred to, and so-called echo-guided puncture may be performed. Also, the subject may not be scanned, in other words, puncture may be performed without taking the ultrasonic image U. When the process of step S116 ends, the puncture assistance process shown in FIG. 7 ends.

[0074] On the other hand, when an abnormal location is detected in step S112, the determination in step S114 becomes an affirmative determination, and the process proceeds to step S118. In step S118, the determination unit 38 derives a position that is inappropriate for performing puncture. As shown in FIG. 5, for each detected vein BV, the determination unit 38 derives, as a position inappropriate for performing puncture, a position on the peripheral side of the abnormal location where the thrombus BC has occurred. In other words, for each detected vein BV, the determination unit 38 derives, as a position appropriate for performing puncture, a position on the central side of the abnormal location where the thrombus BC has occurred. When a plurality of thrombi BC have occurred in one vein BV, from the viewpoint of suppressing the detachment of the thrombus BC as described above, a position on the peripheral side of the abnormal location where the most central thrombus BC has occurred is derived as a position inappropriate for performing puncture. In other words, when a plurality of thrombi BC have occurred in one vein BV, the determination unit 38 derives, as a position appropriate for performing puncture, a position on the central side of the abnormal location where the most central thrombus BC has occurred.

[0075] In addition, when the position where the abnormal location has occurred is close to the central side of the subject, for example, within several centimeters from the most central side in the scan region, the determination unit 38 may determine that puncture at that site of the blood vessel B is inappropriate and derive, as a position appropriate for performing puncture, the opposite site or the like.

[0076] Thus, in this embodiment, when there is an abnormal location in the vein BV, the information 80 indicating that there is no abnormal location is not displayed on the display unit 40. As a result, the user can recognize that there is an abnormal location in the vein BV within the scan range. In this case, the user scans the scan range again to search for a position for performing puncture.

[0077] Therefore, in the next step S120, the acquisition unit 34 determines, in the same manner as in step S100, whether the scan of the subject by the ultrasonic probe 10 has been started. The determination in step S120 remains a negative determination until the scan of the subject is started. On the other hand, when the scan of the subject is started, the determination in step S120 becomes an affirmative determination, and the process proceeds to step S122.

[0078] In step S122, acquisition unit 34 acquires the ultrasonic image U and the position of the ultrasonic probe 10. The acquisition unit 34 associates the ultrasonic image U with information representing the position of the ultrasonic probe 10 when the ultrasonic image U is taken, and outputs the result to the determination unit 38.

[0079]

[0078] In the next step S124, the determination unit 38 determines whether the position of the ultrasonic probe 10 acquired in step S122 is on the peripheral side of the abnormal location where the thrombus BC detected in step S112 has occurred. The determination unit 38 of the present embodiment determines whether the position of the ultrasonic probe 10 is included in the position where puncture is inappropriate derived in step S118, thereby determining whether it is on the peripheral side of the abnormal location. If the position of the ultrasonic probe 10 is not on the peripheral side of the abnormal location where the thrombus BC has occurred, in other words, if it is on the central side of the abnormal location where the thrombus BC has occurred, the determination in step S124 is a negative determination, and the process proceeds to step S126.

[0080] In step S126, after the determination unit 38 outputs the ultrasonic image U acquired in step S122 to the display unit 40, the process proceeds to step S130. FIG. 9A shows an example of the ultrasonic image U displayed on the display unit 40 in this case. In the example shown in FIG. 9A, an example of a state in which the ultrasonic image U including two veins BV, i.e., vein BV1 and vein BV2, is displayed on the display unit 40 is shown. Also, in the example shown in FIG. 9A, an example of a form in which information 821 and 822 indicating the respective positions are given and displayed for each of the veins BV1 and BV2 is shown. Note that, in the example shown in FIG. 9A, an example of a form in which relatively thick solid lines surrounding the outer shapes of the veins BV1 and BV2 are applied as the information 821 and 822 is shown. In this way, the determination unit 38 of the present embodiment adds information indicating the position of the vein BV to the ultrasonic image U and outputs the result to the display unit 40. By emphasizing the vein BV in the ultrasonic image U in this way, the user can be guided to the position of the vein BV. Note that the information representing the position of the vein BV is not limited to the form shown as the information 821 and 822. For example, it may be in a form in which the outer shape of the vein BV is surrounded by a solid line of a relatively conspicuous color.

[0081] As shown in FIG. 9A, when the ultrasonic image U is displayed, the user can recognize that the position of the current ultrasonic probe 10 is an appropriate position for puncturing the vein BV displayed on the display unit 40.

[0082] In this way, the determination unit 38 can guide the user to the position of the vein BV by emphasizing the vein BV detected in step S110 in the ultrasonic image U output to the display unit 40.

[0083] On the other hand, in step S124, if the position of the ultrasonic probe 10 is on the peripheral side of the abnormal part where the thrombus BC has occurred, the determination is an affirmative determination, and the process proceeds to step S128. In step S128, after adding information indicating a warning to the ultrasonic image U acquired in step S122 and outputting it to the display unit 40, the process proceeds to step S130. FIG. 9B shows an example of the ultrasonic image U and the information 84 indicating a warning displayed on the display unit 40 in this case. In the example shown in FIG. 9B, an example of a state in which the ultrasonic image U including two veins BV, i.e., vein BV1 and vein BV2, and the information 84 indicating a warning for vein BV1 are displayed on the display unit 40 is shown. As shown in FIG. 9B, in the present embodiment, when there are a plurality of veins BV, for any of the plurality of veins BV, information 84 indicating a warning is displayed so that it is possible to recognize whether there is a thrombus on the central side.

[0084] Also, in the example shown in FIG. 9B, an example of a form in which information 823 and 822 indicating their respective positions are given and displayed for each of vein BV1 and vein BV2 is shown. As shown in FIG. 9B, for vein BV1 where puncture is considered inappropriate and vein BV2 where puncture is considered appropriate, by making the display forms of the information 823 and 822 indicating their respective positions different, it is possible to more clearly display the appropriateness of puncture. The method of making the display forms different is not particularly limited. For example, as shown in FIG. 9B, it may be a form of making the types of lines different, such as a solid line or a dotted line. Also, for example, it may be a form of making the colors of the lines different.

[0085] As shown in FIG. 9B, when the information 84 indicating a warning is displayed, the user can recognize that the position is inappropriate for puncturing the vein BV1. In this case, the user performs the puncture at a position more central than the current position of the ultrasonic probe 10.

[0086] In step S130, the determination unit 38 determines whether the puncture has ended. In the present embodiment, when the user instructs the end of the puncture through the input I / F unit 56, when the power of the main body unit 12 is cut off, when the ultrasonic probe 10 changes from the contact state with the subject to the airborne radiation state, etc., if a predetermined end condition is satisfied, it is determined that the puncture has ended. If the end condition is not satisfied, the determination in step S130 becomes a negative determination, and the process returns to step S120, and the processes of steps S120 to S130 are repeated. On the other hand, if the end condition is satisfied in step S130, it becomes an affirmative determination, and the puncture assistance process shown in FIG. 7 ends.

[0087] In the above-described embodiment, the form in which the transmitter 14 is fixed at a predetermined position on the head side of the subject of the bed on which the subject lies has been described. However, the position where the transmitter 14 is provided is not limited to this form. For example, the transmitter 14 may be directly fixed to a predetermined part such as the wrist or ankle of the subject.

[0088] Further, the detection of the position of the ultrasonic probe 10 does not necessarily need to derive the three-dimensional position as described above. As long as it is possible to determine at which position within the scan region from the central side to the peripheral side of the subject, more specifically, at which position on the central side and the peripheral side with respect to the abnormal part, the detection method and the like are not particularly limited. For example, when the transmitter 14 is fixed at a predetermined position on the head side of the subject of the bed on which the subject lies as in the above-described embodiment, when the distance between the transmitter 14 and the magnetic sensor 16 becomes long, it can be detected that the ultrasonic probe 10 is located on the peripheral side. Also, when the distance between the transmitter 14 and the magnetic sensor 16 becomes short, it can be detected that the ultrasonic probe 10 is located on the central side.

[0089] Note that the present embodiment is not limited thereto. Modification examples 1 and 2 of the method for obtaining the position of the ultrasonic probe 10 will be shown.

[0090] [Modification Example 1] In this modification example, a modification example of a form using an imaging device that captures a distance image will be described for a modification example of the method for obtaining the position of the ultrasonic probe 10.

[0091] As shown in FIG. 10, the ultrasonic diagnostic apparatus 1 of the present embodiment includes a TOF camera 90 instead of the transmitter 14 and the magnetic sensor 16 of the ultrasonic diagnostic apparatus 1 (see FIG. 1) of the above-described form. Since the other configurations are the same as those of the ultrasonic diagnostic apparatus 1 (see FIG. 1) of the above-described form, the description in FIG. 10 is omitted.

[0092] A TOF (Time of Flight) camera 90 is a camera that captures a distance image representing the distance to the imaging target using the TOF method. Specifically, the TOF camera 90 irradiates the imaging target with light such as infrared rays, and measures the distance between the TOF camera 90 and the imaging target based on the time until the reflected light is received or the phase change between the emitted light and the received light. The distance image captured by the TOF camera 90 has distance information representing the distance between the TOF camera 90 and the imaging target for each pixel. Note that a distance image refers to an image from which the distance to the imaging target can be derived. The distance image captured by the TOF camera 90 has information representing the distance between the TOF camera 90 and the imaging target as the pixel value of each pixel.

[0093] In this modification example, a landmark serving as a mark for measuring the distance is provided on the wrist or ankle of the subject, or on the head side or ankle side of the subject on the bed where the subject lies when performing puncture. Further, the TOF camera 90 is installed on the ultrasonic probe 10, and the TOF camera 90 captures a distance image representing the distance between the landmark and the TOF camera 90. The acquisition unit 34 communicationA distance image is acquired from the TOF camera 90 via the I / F unit 54. The acquisition unit 34 acquires the position of the ultrasonic probe 10 by deriving the distance between the ultrasonic probe 10 and the landmark from the pixel values of the acquired distance image.

[0094] For example, when the landmark is provided on the peripheral side such as the ankle of the subject, it can be derived that the ultrasonic probe 10 is located on the peripheral side as the distance derived from the distance image becomes smaller. Also, for example, when the landmark is provided on the central side such as the head of the subject, it can be derived that the ultrasonic probe 10 is located on the peripheral side as the distance derived from the distance image becomes larger. Note that, as described above, since the pixel value of the distance image corresponds to the distance between the TOF camera 90 and the imaging target, it may be in a form where the pixel value is used instead of the distance itself without deriving the distance itself.

[0095] Conversely, in contrast to the above example, the TOF camera 90 may be provided on the head side or ankle side of the subject of the bed where the subject lies when performing a wrist or ankle of the subject or puncture, and the landmark may be provided on the ultrasonic probe 10, or the ultrasonic probe 10 itself may be used as the landmark.

[0096] Also, in this modified example, an example of a form of capturing a distance image using the TOF camera 90 has been described, but it may also be in a form of capturing a distance image using other imaging devices. For example, it may be in a form of applying the Structured Light method using a distance image capturing device that irradiates the imaging target with patterned infrared light and captures a distance image corresponding to the reflected light from the imaging target. Also, for example, it may be in a form of applying the DFD (Depth from Defocus) method that restores the distance based on the degree of blur of the edge region captured in the distance image. In the case of this form, for example, a form of using a distance image captured by a monocular camera using a color aperture filter is known.

[0097] [Modified Example 2] In this modification example, a modification example of the method for obtaining the position of the ultrasonic probe 10 and a modification example of the form using an optical position sensor will be described.

[0098] As shown in FIG. 11, the ultrasonic diagnostic apparatus 1 of the present embodiment includes an optical position sensor 92 instead of the transmitter 14 and the magnetic sensor 16 of the ultrasonic diagnostic apparatus 1 (see FIG. 1) of the above form. Since other configurations are the same as those of the ultrasonic diagnostic apparatus 1 (see FIG. 1) of the above form, the description in FIG. 11 is omitted.

[0099] The optical position sensor 92 is an optical sensor that applies the principle of triangulation, and utilizes the fact that the angle of the reflected light reflected by the measurement object changes as the distance to the measurement object changes, in other words, the position where the light is condensed on the light receiving element changes, to measure the distance to the measurement object.

[0100] As shown in FIG. 11, the optical position sensor 92 includes a light emitting LED (Light Emitting Diode) 93A and a light receiving element 93B. The light emitting LED 93A has a function of projecting measurement light onto the measurement object, and examples thereof include a laser diode. The light receiving element 93B has a function of receiving the reflected light generated when the measurement light projected from the light emitting LED 93A is reflected by the measurement object, and examples thereof include a photocoupler. The optical position sensor 92 derives the distance to the measurement object from the light condensing position on the light receiving element 93B.

[0101] In this modification example, a reflector for reflecting the measurement light projected from the optical position sensor 92 is provided on the wrist or ankle of the subject, or on the head side or ankle side of the subject on the bed where the subject lies when performing puncture. Also, the ultrasonic probe 10 to is provided with the optical position sensor 92, and the optical position sensor 92 measures the distance between the reflector and the optical position sensor 92. The acquisition unit 34 communication acquires the distance between the reflector and the optical position sensor 92 from the optical position sensor 92 via the I / F unit 54. The acquisition unit 34 acquires the position of the ultrasonic probe 10 by acquiring the acquired distance between the reflector and the optical position sensor 92.

[0102] For example, when the reflector is provided on the peripheral side such as the ankle of the subject, the closer the distance between the reflector and the optical position sensor 92 is, the more it can be derived that the ultrasonic probe 10 is located on the peripheral side. Also, for example, when the landmark is provided on the central side such as the head of the subject, the farther the distance between the reflector and the optical position sensor 92 is, the more it can be derived that the ultrasonic probe 10 is located on the peripheral side.

[0103] Conversely, in contrast to the above example, the optical position sensor 92 may be provided on the wrist or ankle of the subject, or on the head side or ankle side of the subject on the bed where the subject lies when performing puncture, and the reflector may be provided on the ultrasonic probe 10, or the ultrasonic probe 10 itself may be used as the reflector.

[0104] Note that the method for obtaining the position of the ultrasonic probe 10 is not limited to the above Modification Examples 1 and 2, and various other methods can also be applied. For example, the position of the ultrasonic probe 10 may be obtained using GPS (Global Positioning System). In this case, for example, the position of the reference point provided on the head side or ankle side of the subject on the wrist or ankle of the subject, or on the bed where the subject lies when performing puncture, and the position of the ultrasonic probe 10 are obtained from the GPS communication in a form where the acquisition unit 34 acquires via the I / F unit 54. In this case, for example, when a reference point is provided on the peripheral side of the subject, the closer the distance derived from the positions of the reference point and the ultrasonic probe 10 is, the more it can be derived that the ultrasonic probe 10 is located on the peripheral side.

[0105] As described above, the main body 12 of the above form includes an acquisition unit 34 that acquires an ultrasonic image U of the vein BV in a predetermined region from the center to the periphery of the subject, a detection unit 36 that detects an abnormal location where an abnormality has occurred in the vein BV from the acquired ultrasonic image U, and a determination unit 38 that determines the appropriateness of puncture in the vein BV according to the detected abnormal location and outputs the determination result.

[0106] Therefore, according to the main body 12 of the present embodiment, as described above, it is possible to assist the puncture position in consideration of blood vessel abnormalities for the user who performs the puncture of the blood vessel. Further, according to the main body 12 of each of the above embodiments, since the user who performs the puncture can easily recognize a position suitable for the puncture, it becomes easier to identify a blood vessel B or the position of the blood vessel suitable for the puncture.

[0107] Note that the technology of the present disclosure is not limited to the above embodiments, and various modifications are further possible.

[0108] For example, in the puncture assistance process (see FIG. 7) of the above embodiment, after detecting an abnormal portion from the ultrasonic image U (step S114), the form in which the user performs the puncture was subsequently described. The present invention is not limited to this embodiment, and the detection of the abnormal portion in the vein BV and the puncture of the vein BV may be performed at different timings. That is, the processes up to steps S100 to S118 of the puncture assistance process shown in FIG. 7 may be performed in advance, and a position inappropriate for puncture or a position appropriate for puncture may be used as puncture suitability position information and stored in a storage unit 52 or the like in association with the subject and the puncture site. When actually performing the puncture, the puncture suitability position information stored in the storage unit 52 may be read out, and step S12 of the puncture assistance process shown in FIG. 7 after 0 The process may be performed.

[0109] Further, in the puncture assistance process (see FIG. 7) of each of the above embodiments, after once detecting an abnormal portion of the vein BV, the form in which the subject is scanned again with the ultrasonic probe 10 for puncture, that is, the form in which the subject is scanned twice for puncture was described. However, the present invention is not limited to this embodiment, and for example, the detection of the abnormal portion and the puncture may be performed by one scan. In this case, for example, while the ultrasonic probe 10 is moving from the central side to the peripheral side of the subject, the main body 12 sequentially acquires the ultrasonic image U to detect the abnormal portion, and information indicating a warning is displayed on the display unit 40 when the abnormal portion is detected. The user who performs the puncture can recognize the area scanned before the time when the information indicating the warning is displayed on the display unit 40 as a position suitable for the puncture.

[0110] Also 、ultra In addition to the ultrasonic image U and the information indicating the suitability of puncture, it may also be in a form where other information for assisting puncture is displayed on the display unit 40. In FIG. 12, in addition to the example shown in FIG. 9B, the ultrasonic image U1 and the puncture region map M are sub- window shown in the figure. The ultrasonic image U1 is an image obtained by extracting the thrombus BC portion from the ultrasonic image U. For example, the determination unit 38 generates the ultrasonic image U1 by cutting it out from the ultrasonic image U in which an abnormal portion has been detected, and displays it on the display unit 40 as a sub-image. By displaying the ultrasonic image U1 in this way, the user can check the condition of the thrombus BC, and thus it can be used for the treatment of the thrombus BC.

[0111] On the other hand, the puncture region map M is a map that clearly shows the scan region and abnormal locations. The puncture region map M includes scan region information 96 representing the scan region and abnormal location information 98 representing the abnormal locations. For example, the determination unit 38 acquires a puncture site schematic diagram 94 by specifying a puncture site such as the right lower limb or the left upper arm input via the imaging menu or the input I / F unit 56 by the user. The determination unit 38 provides the scan region information 96 on the acquired puncture site schematic diagram 94 based on the position of the detected ultrasonic probe 10, and provides the abnormal location information 98 based on the position of the detected abnormal location. Thereby, the user can more clearly and intuitively recognize the region suitable for performing puncture, in other words, the region unsuitable for performing puncture. Note that the display unit 40 for displaying the puncture region map M may be a head-mounted display worn by the user, and in place of the puncture site schematic diagram 94, the scan region information 96 and the abnormal location information 98 may be displayed on the body surface of the actual subject. For example, it may also be in a form where a visual field image including the ultrasonic probe 10 is acquired by an imaging device provided on the head-mounted display, the operation position by the ultrasonic probe 10 is detected by analyzing the visual field image, and the scanned region is displayed as the scan region information 96 on the body surface of the subject.

[0112] In each of the above embodiments, the form of puncturing the vein BV has been described, but a form of puncturing an artery may also be used. In this case, since the blood flow in the blood vessel B which is an artery is from the central side to the peripheral side, a position more central than the abnormal portion where the thrombus BC has occurred may be set as an inappropriate position for puncturing, and a position more peripheral than the abnormal portion may be set as an inappropriate position for puncturing.

[0113] Also, in each of the above embodiments, the case where the abnormality occurring in the vein BV is the thrombus BC has been specifically described, but as described above, even if the abnormality is caused by a shunt or the like, the same form can be adopted.

[0114] Also, in each of the above embodiments, the form in which the main body portion 12 is an example of the information processing apparatus of the present disclosure has been described, but a device other than the main body portion 12 may have the functions of the information processing apparatus of the present disclosure. In other words, part or all of the functions of the acquisition unit 34, the detection unit 36, and the determination unit 38 may be provided in, for example, the ultrasonic probe 10 or an external device other than the main body portion 12.

[0115] Also, in each of the above embodiments, the image generation unit 32 that generates the ultrasonic image U based on the acoustic line signal is provided in the main body portion 12, but instead, the image generation unit 32 may be provided in the ultrasonic probe 10. In this case, the ultrasonic probe 10 generates the ultrasonic image U and outputs it to the main body portion 12. The CPU 50A of the control unit 50 of the main body portion 12 performs puncture assistance processing and the like based on the ultrasonic image U input from the ultrasonic probe 10.

[0116] Also, in the above embodiment, the form in which the display unit 40, the input I / F unit 56, and the ultrasonic probe 10 are provided in the main body portion 12 has been described, but the display unit 40, the input I / F unit 56, the ultrasonic probe 10, and the control unit 50 may be indirectly connected via a network.

[0117] As an example, the ultrasonic diagnostic apparatus 1 shown in FIG. 13 has a display unit 40, an input I / F unit 56, and an ultrasonic probe 10 connected to a main body unit 12 via a network NW. The main body unit 12 is obtained by removing the display unit 40 and the input I / F unit 56 from the main body unit 12 of the above-described form shown in FIG. 1 and adding a transmission / reception circuit 22, and includes a transmission / reception circuit 22, a control unit 50, and a storage unit 52. The ultrasonic probe 10 is obtained by removing the transmission / reception circuit 22 from the ultrasonic probe 10 of the above-described form shown in FIG. 1.

[0118] As described above, in the ultrasonic diagnostic apparatus 1 shown in FIG. 13, since the display unit 40, the input I / F unit 56, and the ultrasonic probe 10 are connected to the main body unit 12 via the network NW, the main body unit 12 can be used as a so-called remote server. Thereby, for example, the user can prepare the display unit 40, the input I / F unit 56, and the ultrasonic probe 10 at hand, improving convenience. Further, by configuring the display unit 40 and the input I / F unit 56 with a portable terminal such as a smartphone or a tablet terminal, convenience is further improved.

[0119] In another example, in the ultrasonic diagnostic apparatus 1 shown in FIG. 14, the display unit 40 and the input I / F unit 56 are provided in the main body unit 12, and the ultrasonic probe 10 is connected to the main body unit 12 via the network NW. In this case, the main body unit 12 may be configured by a remote server. It is also possible to configure the main body unit 12 with a portable terminal such as a smartphone or a tablet terminal.

[0120] Also, in the above-described embodiment, for example, as the hardware structure of a processing unit that executes various processes such as the acquisition unit 34, the detection unit 36, and the determination unit 38, the following various processors can be used. As described above, among the above various processors, in addition to the CPU which is a general-purpose processor that executes software (program) and functions as various processing units, there are also programmable logic devices (PLDs) such as FPGAs (Field Programmable Gate Arrays), which are processors whose circuit configuration can be changed after manufacturing, and dedicated electric circuits and the like, which are processors having a circuit configuration designed specifically to execute specific processes such as ASICs (Application Specific Integrated Circuits).

[0121] One processing unit may be constituted by one of these various processors, or may be constituted by a combination of two or more processors of the same type or different types (for example, a combination of a plurality of FPGAs, or a combination of a CPU and an FPGA). Also, a plurality of processing units may be constituted by one processor.

[0122] As an example of constituting a plurality of processing units by one processor, firstly, as represented by computers such as clients and servers, there is a form in which one processor is constituted by a combination of one or more CPUs and software, and this processor functions as a plurality of processing units. Secondly, as represented by System On Chip (SoC) and the like, there is a form in which a processor that realizes the functions of the entire system including a plurality of processing units with one IC (Integrated Circuit) chip is used. Thus, various processing units are constituted by using one or more of the above various processors as the hardware structure.

[0123] Furthermore, as the hardware structure of these various processors, more specifically, an electrical circuitry combined with circuit elements such as semiconductor elements can be used.

[0124] In addition, in each of the above embodiments, the mode in which the puncture assistance processing program 51 is pre-stored (installed) in the ROM 50B has been described, but it is not limited thereto. Each of the puncture assistance processing programs 51 may be provided in a form recorded on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), and a USB (Universal Serial Bus) memory. Further, each of the puncture assistance processing programs 51 may be in a form downloaded from an external device via a network.

[0125] From the above description, the technologies disclosed in the following Supplementary Notes 1 to 7 can be grasped.

[0126] [Supplementary Note 1] Comprising at least one processor, The processor is To acquire an ultrasonic image of a vein in a predetermined region from the center to the periphery of the subject, To detect an abnormal location where an abnormality has occurred in the vein from the acquired ultrasonic image, To determine the appropriateness of puncture in the vein according to the detected abnormal location and output a determination result, An information processing apparatus.

[0127] [Supplementary Note 2] The processor is To determine that puncture at a position on the peripheral side of the abnormal location is inappropriate The information processing apparatus according to Supplementary Note 1.

[0128] [Supplementary Note 3] The processor is When a plurality of the abnormal locations are detected, it is determined that the puncture at a position on the peripheral side of the abnormal location located closest to the center is inappropriate. The information processing apparatus according to Appendix 1 or Appendix 2.

[0129] [Appendix 4] The processor further obtains the position of the ultrasonic probe when the acquired ultrasonic image is taken, and determines the appropriateness of the puncture based on the detection result and the position of the ultrasonic probe. The information processing apparatus according to any one of Appendices 1 to 3.

[0130] [Appendix 5] The processor outputs information representing a warning as the determination result. The information processing apparatus according to any one of Appendices 1 to 4.

[0131] [Appendix 6] The processor detects a vein from the ultrasonic image. The information processing apparatus according to any one of Appendices 1 to 5.

[0132] [Appendix 7] comprises at least one processor, The processor acquires an ultrasonic image of blood vessels in a predetermined region from the center to the end of the subject, detects an abnormal location where an abnormality has occurred in the blood vessels from the acquired ultrasonic image, determines that the puncture of the blood vessel at a position on the upstream side of the blood flow from the detected abnormal location is inappropriate, and outputs the determination result. Information processing apparatus.

[0133] The disclosure of Japanese Patent Application No. 2020-197656 filed on November 27, 2020 is incorporated herein by reference in its entirety. All documents, patent applications, and technical standards described in this specification are incorporated herein by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually indicated to be incorporated by reference.

Explanation of Signs

[0134] 1 Ultrasonic diagnostic device 10 Ultrasonic probe 12 Main body 14 Transmitter 16 Magnetic sensor 20 Transducer array 22 Transmission / reception circuit 24 Transmission circuit 26 Reception circuit 30 Imaging control unit 32 Image generation unit 34 Acquisition unit 36 Detection unit 38 Judgment unit 40 Display unit 50 Control unit, 50A CPU, 50B ROM, 50C RAM 51 Puncture assistance processing program 52 Storage unit 54 Communication I / F unit 56 Input I / F unit 59 Bus 60 Amplification unit 62 A / D conversion unit 64 Beamformer 70 Signal processing unit 72 DSC 74 Image processing unit 80, 821~823, 84 Information 90 TOF camera 92 Optical position sensor 93A Light-emitting LED, 93B Light-receiving element 94 Puncture site schematic diagram 96 Scan area information 98 Abnormal location information B Blood vessel BC Thrombus BV, BV1, BV2 Vein D Depth direction M Puncture Area Map N Puncture Needle NW Network S Body Surface U, U1 Ultrasonic Image

Claims

1. An acquisition unit that acquires an ultrasonic image of a vein in a predetermined region from the center to the periphery of a subject; A detection unit that detects an abnormal location where an abnormality has occurred in the vein from the acquired ultrasonic image; A determination unit that determines the suitability of puncture in the vein according to the detected abnormal location and outputs a determination result; An information processing apparatus comprising the above.

2. The determination unit determines that puncture at a position on the peripheral side of the abnormal location is inappropriate. The information processing apparatus according to Claim 1.

3. When the detection unit detects a plurality of the abnormal locations, the determination unit determines that puncture at a position on the peripheral side of the abnormal location located most centrally is inappropriate. The information processing apparatus according to Claim 1 or Claim 2.

4. The acquisition unit further acquires the position of the ultrasonic probe when the acquired ultrasonic image is taken; The determination unit determines the suitability of puncture based on the detection result of the detection unit and the position of the ultrasonic probe. The information processing apparatus according to any one of Claims 1 to 3.

5. The determination unit outputs information indicating a warning as the determination result. The information processing apparatus according to any one of Claims 1 to 4.

6. The detection unit detects a vein from the ultrasonic image. The information processing apparatus according to any one of Claims 1 to 5.

7. An acquisition unit that acquires an ultrasonic image of a blood vessel in a predetermined region from the center to the end of a subject; A detection unit that detects an abnormal location where an abnormality has occurred in the blood vessel from the acquired ultrasonic image; A determination unit that determines that puncture of the blood vessel at a position where the blood flow is upstream of the detected abnormal location is inappropriate and outputs a determination result; An information processing apparatus comprising the above.

8. An ultrasonic probe that receives an ultrasonic echo by transmitted ultrasonic waves and outputs a received signal based on the received ultrasonic echo; An image generation unit that generates an ultrasonic image based on the received signal input from the ultrasonic probe; The ultrasonic diagnostic apparatus comprising the information processing apparatus according to any one of Claims 1 to 7. The above.

9. Acquire an ultrasonic image of a vein in a predetermined region from the center to the periphery of a subject; Detect an abnormal location where an abnormality has occurred in the vein from the acquired ultrasonic image; Determine the suitability of puncture in the vein according to the detected abnormal location and output a determination result. An information processing method in which a computer executes the above process.

10. Obtain an ultrasonic image of a vein in a predetermined region from the center to the periphery of the subject, Detect an abnormal location where an abnormality has occurred in the vein from the obtained ultrasonic image, Determine the suitability of puncture in the vein according to the detected abnormal location, and output the determination result, An information processing program for causing a computer to execute the process.

Images