Ultrasound diagnostic device and assessment method
The ultrasound diagnostic apparatus addresses the inefficiency in determining the measurement direction by using an acquisition and determination unit to automatically align the caliper, improving workflow and accuracy in ultrasound measurements.
Patent Information
- Application Number
- JP2022009984
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-01-26
- Publication Date
- 2026-01-14
- Estimated Expiration
- 2042-01-26
AI Technical Summary
Existing ultrasound measurement methods, such as the IMT-C10 measurement for carotid artery, face inefficiencies in determining the correct measurement direction due to the need for manual adjustment of the caliper based on the orientation of the ultrasound image, leading to potential misalignment and increased workflow time.
An ultrasound diagnostic apparatus that includes an acquisition unit to determine the reference position and a determination unit to automatically adjust the measurement position relative to the reference position based on image information or position sensors, ensuring accurate and efficient measurement.
The apparatus improves measurement workflow by automatically aligning the measurement caliper in the correct direction relative to the reference position, reducing the need for manual adjustments and enhancing measurement accuracy.
Smart Images

Figure 0007798587000001 
Figure 0007798587000002 
Figure 0007798587000003
Abstract
Description
[Technical Field]
[0001] The embodiments disclosed in this specification relate to an ultrasound diagnostic apparatus and a determination method. [Background technology]
[0002] Conventionally, various measurements have been performed in ultrasound examinations. For example, the intima-media thickness (IMT) of the carotid artery has been measured as an indicator of diseases such as lifestyle-related diseases and arteriosclerosis. IMT is the thickness of the intima-media complex of the carotid artery, and is defined as the distance between the hyperechoic layer on the intima side and the hyperechoic layer on the outer side in an ultrasound image showing the longitudinal cross section of the carotid artery.
[0003] The "Standard Method for Ultrasound Assessment of Carotid Artery Lesions 2017" proposes IMT-C10 as the measurement location for IMT. IMT-C10 refers to the IMT on the distal wall, 10 mm proximal to the transition between the common carotid artery and the carotid sinus. To measure this location, a method has been proposed in which the cursor is placed on the transition and a caliper is placed 10 mm from there to measure the IMT. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] International Publication No. 2018 / 047404 Summary of the Invention [Problem to be solved by the invention]
[0005] One of the problems that the embodiments disclosed herein aim to solve is to improve the workflow related to measurement. However, the problems solved by the embodiments disclosed herein are not limited to the above problem. Problems corresponding to the effects of the configurations described in the embodiments below can also be considered as other problems that the embodiments disclosed herein aim to solve. [Means for solving the problem]
[0006] According to an embodiment, an ultrasound diagnostic apparatus includes an acquisition unit, an acquisition unit, and a determination unit. The acquisition unit acquires ultrasound images. The acquisition unit acquires a reference position for measurement in the ultrasound images. The determination unit determines a direction of a measurement position relative to the reference position in the ultrasound images based on information about a region included in the ultrasound images. [Brief explanation of the drawings]
[0007] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of an ultrasound diagnostic apparatus according to the first embodiment. [Figure 2A] FIG. 2A is a diagram for explaining an example of measurement by the IMT-C10 according to the first embodiment. [Figure 2B] FIG. 2B is a diagram for explaining an example of measurement by the IMT-C10 according to the first embodiment. [Figure 3] FIG. 3 is a flowchart illustrating a processing procedure according to the first embodiment. [Figure 4] FIG. 4 is a flowchart illustrating a processing procedure according to the first embodiment. [Figure 5A] FIG. 5A is a diagram illustrating an example of constructing a trained model according to the first embodiment. [Figure 5B] FIG. 5B is a diagram for explaining processing by the determination function according to the first embodiment. [Figure 6] FIG. 6 is a diagram for explaining an example of the measurement position determination process according to the first embodiment. [Figure 7] FIG. 7 is a flowchart illustrating a processing procedure according to the first modification. [Figure 8] FIG. 8 is a block diagram showing an example of the configuration of an ultrasound diagnostic apparatus according to the second embodiment. [Figure 9] FIG. 9 is a flowchart illustrating a processing procedure according to the second embodiment. [Figure 10] FIG. 10 is a diagram for explaining the process performed by the determination function according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0008] Hereinafter, embodiments of an ultrasound diagnostic apparatus and a determination method according to the present application will be described in detail with reference to the accompanying drawings. Note that the ultrasound diagnostic apparatus and determination method according to the present application are not limited to the embodiments shown below. In the following description, similar components will be assigned common reference numerals, and duplicated descriptions will be omitted.
[0009] (First embodiment) Fig. 1 is a block diagram showing an example of the configuration of an ultrasound diagnostic apparatus 10 according to the first embodiment. As shown in Fig. 1, the ultrasound diagnostic apparatus 10 according to this embodiment includes an ultrasound probe 1, a display 2, an input interface 3, and a device main body 4, and the ultrasound probe 1, the display 2, and the input interface 3 are connected to the device main body 4 so as to be able to communicate with each other.
[0010] The ultrasonic probe 1 is connected to a transmission / reception circuit 41 included in the device main body 4. The ultrasonic probe 1 has, for example, a plurality of piezoelectric vibrators in the probe main body, and these plurality of piezoelectric vibrators generate ultrasonic waves based on drive signals supplied from the transmission / reception circuit 41. The ultrasonic probe 1 also receives reflected waves from the subject and converts them into electrical signals. The ultrasonic probe 1 also has, in the probe main body, a matching layer provided on the piezoelectric vibrators, a backing material that prevents ultrasonic waves from propagating backward from the piezoelectric vibrators, and the like. The ultrasonic probe 1 is detachably connected to the device main body 4. For example, the ultrasonic probe 1 is a sector type, linear type, or convex type ultrasonic probe.
[0011] When ultrasonic waves are transmitted from the ultrasonic probe 1 to the subject, the transmitted ultrasonic waves are reflected successively by discontinuous surfaces of acoustic impedance in the subject's internal tissues and are received as reflected wave signals by the multiple piezoelectric transducers of the ultrasonic probe 1. The amplitude of the received reflected wave signals depends on the difference in acoustic impedance at the discontinuous surfaces where the ultrasonic waves are reflected. When the transmitted ultrasonic pulses are reflected by the surface of a moving blood flow or heart wall, the reflected wave signals undergo a frequency shift due to the Doppler effect, depending on the velocity component of the moving object relative to the direction of ultrasonic transmission.
[0012] This embodiment is applicable to both cases where a subject is scanned two-dimensionally using an ultrasonic probe 1 that is a one-dimensional ultrasonic probe in which multiple piezoelectric vibrators are arranged in a row, and cases where a subject is scanned three-dimensionally using an ultrasonic probe 1 that mechanically vibrates multiple piezoelectric vibrators of a one-dimensional ultrasonic probe or an ultrasonic probe 1 that is a two-dimensional ultrasonic probe in which multiple piezoelectric vibrators are arranged two-dimensionally in a lattice pattern.
[0013] The display 2 displays a GUI (Graphical User Interface) that allows the operator of the ultrasound diagnostic apparatus 10 to input various setting requests using the input interface 3, as well as ultrasound images generated in the apparatus main body 4. The display 2 also displays various messages and display information to notify the operator of the processing status and results of the apparatus main body 4. The display 2 also has a speaker and can output sound.
[0014] The input interface 3 is operated to set predetermined positions (e.g., various positions related to measurement), and may be realized by, for example, a trackball, switch buttons, a mouse, a keyboard, a touchpad that performs input operations by touching the operation surface, a touch monitor that integrates a display screen and a touchpad, a non-contact input circuit using an optical sensor, and a voice input circuit. The input interface 3 is connected to a processing circuit 45 (described later) and converts input operations received from an operator into electrical signals and outputs the signals to the processing circuit 45. Note that, in this specification, the input interface 3 is not limited to those having physical operation components such as a mouse and a keyboard. For example, an electrical signal processing circuit that receives electrical signals corresponding to input operations from an external input device provided separately from the device and outputs the electrical signals to the processing circuit 45 is also included as an example of an input interface.
[0015] The device main body 4 has a transmitting / receiving circuitry 41, a B-mode processing circuitry 42, a Doppler processing circuitry 43, a memory 44, and a processing circuitry 45. In the ultrasound diagnostic device 10 shown in FIG. 1, each processing function is stored in the memory 44 in the form of a program executable by a computer. The transmitting / receiving circuitry 41, the B-mode processing circuitry 42, the Doppler processing circuitry 43, and the processing circuitry 45 are processors that realize the function corresponding to each program by reading and executing the program from the memory 44. In other words, when each program is read, each circuit has the function corresponding to the read program.
[0016] The transmission / reception circuit 41 includes a pulse generator, a transmission delay circuit, a pulser, etc., and supplies a drive signal to the ultrasonic probe 1. The pulse generator repeatedly generates rate pulses at a predetermined rate frequency to form transmitted ultrasonic waves. The transmission delay circuit focuses the ultrasonic waves generated from the ultrasonic probe 1 into a beam and provides a delay time for each piezoelectric transducer required to determine the transmission directivity to each rate pulse generated by the pulse generator. The pulser applies a drive signal (drive pulse) to the ultrasonic probe 1 at a timing based on the rate pulse. In other words, the transmission delay circuit changes the delay time provided to each rate pulse to arbitrarily adjust the transmission direction of the ultrasonic waves transmitted from the piezoelectric transducer surface.
[0017] The transmitter / receiver circuit 41 has a function of being able to instantaneously change the transmission frequency, transmission drive voltage, etc. in order to execute a predetermined scan sequence based on instructions from the processing circuit 45, which will be described later. In particular, the change in transmission drive voltage is realized by a linear amplifier type oscillation circuit that can instantaneously switch its value, or a mechanism that electrically switches between multiple power supply units.
[0018] The transmission / reception circuit 41 also has a preamplifier, an A / D (Analog / Digital) converter, a reception delay circuit, an adder, etc., and performs various processes on the reflected wave signals received by the ultrasonic probe 1 to generate reflected wave data. The preamplifier amplifies the reflected wave signals for each channel. The A / D converter A / D converts the amplified reflected wave signals. The reception delay circuit provides the delay time required to determine the reception directivity. The adder performs addition processing on the reflected wave signals processed by the reception delay circuit to generate reflected wave data. The addition processing by the adder emphasizes the reflected components from the direction corresponding to the reception directivity of the reflected wave signals, and an overall beam for ultrasonic transmission and reception is formed based on the reception directivity and transmission directivity.
[0019] The B-mode processing circuit 42 receives the reflected wave data from the transmission / reception circuit 41, and performs logarithmic amplification, envelope detection processing, etc. to generate data (B-mode data) in which the signal intensity is expressed as brightness.
[0020] The Doppler processing circuit 43 performs frequency analysis on the velocity information from the reflected wave data received from the transmitting / receiving circuit 41, extracts blood flow, tissue, and contrast agent echo components due to the Doppler effect, and generates data (Doppler data) that extracts moving object information such as velocity, dispersion, and power for multiple points. For example, the moving object is a fluid such as blood flowing in blood vessels or lymph flowing in lymphatic vessels.
[0021] The B-mode processing circuit 42 and the Doppler processing circuit 43 are capable of processing both two-dimensional reflected wave data and three-dimensional reflected wave data. That is, the B-mode processing circuit 42 generates two-dimensional B-mode data from two-dimensional reflected wave data, and generates three-dimensional B-mode data from three-dimensional reflected wave data. Also, the Doppler processing circuit 43 generates two-dimensional Doppler data from two-dimensional reflected wave data, and generates three-dimensional Doppler data from three-dimensional reflected wave data.
[0022] The B-mode processing circuit 42 can also generate three-dimensional reflected wave data by combining multiple two-dimensional reflected wave data, and generate three-dimensional B-mode data from the generated three-dimensional reflected wave data. The Doppler processing circuit 43 can also generate three-dimensional reflected wave data by combining multiple two-dimensional reflected wave data, and generate three-dimensional Doppler data from the generated three-dimensional reflected wave data.
[0023] The memory 44 stores the ultrasound images for display generated by the processing circuitry 45. The memory 44 can also store B-mode data generated by the B-mode processing circuitry 42 and Doppler data generated by the Doppler processing circuitry 43. The memory 44 also stores control programs for transmitting and receiving ultrasound, image processing, and display processing, as well as various data such as diagnostic information (e.g., patient ID, doctor's findings, etc.), diagnostic protocols, and various body marks.
[0024] The processing circuitry 45 controls the overall processing of the ultrasound diagnostic apparatus 10. Specifically, the processing circuitry 45 performs various processes by reading from the memory 44 and executing programs corresponding to the control function 451, image generation function 452, acquisition function 453, and determination function 454 shown in FIG. 1. For example, the processing circuitry 45 is a processor that realizes the function corresponding to each program by reading and executing each program from the memory 44. In other words, the processing circuitry 45 in a state where each program has been read has each function shown in the processing circuitry 45 in FIG. 1.
[0025] Here, the control function 451 is an example of a collection function and a display control unit. The acquisition function 453 is an example of an acquisition unit. The determination function 454 is an example of a determination unit. Note that in this embodiment, each of the processing functions described below is described as being realized by a single processing circuit 45, but it is also possible to configure a processing circuit by combining multiple independent processors, and realize the functions by each processor executing a program.
[0026] The control function 451 controls the processing of the transmission / reception circuit 41, the B-mode processing circuit 42, and the Doppler processing circuit 43 based on various setting requests input by the operator via the input interface 3 and various control programs and various data read from the memory 44. The control function 451 also controls the display 2 to display ultrasound images and various information. The control function 451 also executes various measurement processes.
[0027] The image generation function 452 generates an ultrasound image from the data generated by the B-mode processing circuit 42 and the Doppler processing circuit 43. That is, the image generation function 452 generates an ultrasound image in which the intensity of the reflected wave is represented by brightness from the two-dimensional B-mode data generated by the B-mode processing circuit 42. The image generation function 452 also generates an ultrasound image representing moving object information from the two-dimensional Doppler data generated by the Doppler processing circuit 43. The ultrasound image based on the Doppler data is velocity image data, variance image data, power image data, or image data combining these.
[0028] Here, the image generation function 452 generally converts (scan converts) a scan line signal sequence of an ultrasonic scan into a scan line signal sequence of a video format, such as that of a television, to generate an ultrasonic image for display. Specifically, the image generation function 452 generates an ultrasonic image for display by performing coordinate conversion according to the ultrasonic scanning form of the ultrasonic probe 1. In addition to scan conversion, the image generation function 452 also performs various image processing, such as image processing (smoothing processing) that regenerates an average brightness image using multiple image frames after scan conversion, and image processing (edge enhancement processing) that uses a differential filter within the image. The image generation function 452 also combines text information of various parameters, scales, body marks, etc., with the ultrasonic image.
[0029] Furthermore, the image generation function 452 generates three-dimensional B-mode image data by performing coordinate transformation on the three-dimensional B-mode data generated by the B-mode processing circuit 42. Moreover, the image generation function 155b generates three-dimensional Doppler image data by performing coordinate transformation on the three-dimensional Doppler data generated by the Doppler processing circuit 43. Furthermore, the image generation function 155b can perform rendering processing on the volume data in order to generate various two-dimensional images for displaying this three-dimensional image data (volume data) on the display 2.
[0030] The acquisition function 453 acquires a reference position for measurement in an ultrasound image. Specifically, the acquisition function 453 acquires information on a reference position for determining a measurement in a measurement related to a region depicted in an ultrasound image. For example, the acquisition function 453 acquires position information of the transition between the common carotid artery and the carotid sinus in an IMT-C10 acquired ultrasound image of the carotid artery. Details of the processing by the acquisition function 453 will be described later.
[0031] The determination function 454 determines the direction of the measurement position relative to the reference position on the ultrasound image based on information about the part included in the ultrasound image. Specifically, the determination function 454 determines in which direction the measurement position is located relative to the measurement reference position on the ultrasound image displayed on the display 2. In other words, the determination function 454 determines the positional relationship between the reference position and the measurement position on the ultrasound image. Details of the processing by the determination function 454 will be described later.
[0032] The configuration of the ultrasound diagnostic device 10 according to the first embodiment has been described above. With this configuration, the ultrasound diagnostic device 10 makes it possible to improve the workflow related to measurement. Specifically, the ultrasound diagnostic device 10 determines the direction of the measurement position relative to the reference position of measurement on the ultrasound image, making it possible to display a measurement GUI at the correct measurement position, thereby improving the workflow related to measurement.
[0033] As mentioned above, the IMT-C10 measurement position is 10 mm central (closer to the heart) from the transition between the common carotid artery and the carotid sinus, and a method has been proposed to measure this position by positioning the cursor at the transition and displaying a caliper 10 mm from there. However, with this method, because the caliper display must be set in advance on either the left or right side of the cursor on the ultrasound image, the caliper may be displayed 10 mm peripheral (farther from the heart) from the transition depending on the orientation of the collected ultrasound image.
[0034] 2A and 2B are diagrams illustrating an example of IMT-C10 measurement according to the first embodiment. Here, FIGS. 2A and 2B illustrate a case where the caliper display position is set to the left of the cursor position. For example, when the ultrasound image shown in FIG. 2A is acquired, the operator first observes the common carotid artery and carotid sinus depicted in the ultrasound image and places cursor a1 at the transition between them (the point where the blood vessel begins to widen from the common carotid artery toward the carotid sinus). In response to this operation, the ultrasound diagnostic device displays caliper b1 for IMT measurement 10 mm to the left of cursor a1 (10 mm centrally from the transition). In this case, caliper b1 is displayed in the correct direction relative to cursor a1.
[0035] On the other hand, as shown in FIG. 2B, when an ultrasound image is acquired in which the display position of the region is inverted from that of the ultrasound image in FIG. 2A, the ultrasound diagnostic device will display the caliper b1 at a position 10 mm to the left of the cursor a1 (a position 10 mm distal to the transition region) according to the positioning of the cursor a1 by the operator. In other words, the caliper b1 will be displayed in an incorrect position. In this case, the operator will need to set the measurement direction again, which will take extra time.
[0036] Therefore, the ultrasound diagnostic device 10 according to this embodiment determines in advance the display position of the measurement GUI relative to the reference position, thereby eliminating the need to reset the direction of the measurement position and improving the workflow. The details of the processing performed by the ultrasound diagnostic device 10 are described below. The processing performed when measuring IMT-C10 is described below as an example.
[0037] First, the processing procedure by the ultrasound diagnostic apparatus 10 according to the first embodiment will be described with reference to FIGS. 3 and 4. FIGS. 3 and 4 are flowcharts for describing the processing procedure according to the first embodiment. Here, FIG. 4 shows an example of the processing in step S106 in FIG. 3. Note that step S101 in FIG. 3 is realized by the processing circuitry 45 reading out from the memory 44 and executing programs corresponding to the control function 451 and the image generation function 452. Also, steps S102, S103, and S108 are realized by the processing circuitry 45 reading out from the memory 44 and executing the program corresponding to the control function 451. Also, step S104 is realized by the processing circuitry 45 reading out from the memory 44 and executing the program corresponding to the determination function 454. Also, steps S105 and S107 are realized by the processing circuitry 45 reading out from the memory 44 and executing the program corresponding to the acquisition function 453. Furthermore, step S106 is realized by the processing circuitry 45 reading out from the memory 44 and executing a program corresponding to the control function 451 and the determination function 454.
[0038] 4 is realized by the processing circuitry 45 reading out from the memory 44 a program corresponding to the determination function 454 and executing it. Also, steps S202 to S205 are realized by the processing circuitry 45 reading out from the memory 44 a program corresponding to the control function 451 and executing it.
[0039] 3, in the ultrasound diagnostic apparatus 10 according to the first embodiment, the processing circuitry 45 acquires ultrasound images of the carotid artery (step S101) and determines whether the freeze button has been pressed (step S102). If the freeze button has been pressed (step S102: Yes), the processing circuitry 45 determines whether the IMT-C10 button has been pressed (step S103). The processing circuitry 45 continues acquiring ultrasound images until the freeze button is pressed (step S102: No).
[0040] In step S103, when the IMT-C10 button is pressed (step S103: Yes), the processing circuitry 45 extracts the common carotid artery from the ultrasound image and acquires the coordinates of the extracted common carotid artery (step S104). Note that the processing circuitry 45 is in a standby state until the IMT-C10 button is pressed (step S103: No).
[0041] Next, the processing circuitry 45 acquires the coordinates of a cursor indicating a reference position for measuring IMT-C10 (step S105). Then, the processing circuitry 45 determines the direction in which to display the caliper for IMT measurement based on the acquired coordinates of the common carotid artery and the cursor, and performs the measurement (step S106).
[0042] Thereafter, the processing circuit 45 determines whether the cursor position has been moved (step S107). If the cursor position has been moved (step S107: Yes), the processing circuit 45 returns to step S105 and acquires the cursor coordinates again.
[0043] On the other hand, if the cursor position has not been moved (step S107: No), the processing circuit 45 determines whether the measurement process has ended (step S108). Here, if the measurement process has not ended (step S108: No), the processing circuit 45 continues the determination of step S107. On the other hand, if the measurement process has ended (step S108: Yes), the processing circuit 45 ends the process.
[0044] 4, in the process of step S106, for example, the processing circuitry 45 determines whether the coordinates of the common carotid artery are to the right of the cursor coordinates in the collected ultrasound image (step S201). If the coordinates of the common carotid artery are to the right of the cursor coordinates (step S201: Yes), the processing circuitry 45 displays a caliper to the right of the cursor (step S202). On the other hand, if the coordinates of the common carotid artery are not to the right of the cursor coordinates (step S201: No), the processing circuitry 45 displays a caliper to the left of the cursor (step S203).
[0045] Then, the processing circuit 45 performs a measurement in which the distance between the top and bottom of the caliper is set as the IMT value (step S204), and displays the measurement value on the display 2. Then, the processing circuit 45 determines whether the width between the top and bottom of the caliper has been changed (step S205). Here, if the width between the top and bottom of the caliper has been changed (step S205: Yes), the processing circuit 45 displays the measurement value according to the change in the caliper width on the display 2. On the other hand, if the width between the top and bottom of the caliper has not been changed (step S205: Yes), the processing circuit 45 ends the processing in step S106.
[0046] 4, the case of determining whether the coordinates of the common carotid artery are to the right of the coordinates of the cursor has been described as an example, but the determination process for determining the positional relationship between the coordinates of the common carotid artery and the coordinates of the cursor is not limited to the above. For example, it may be determined whether the coordinates of the common carotid artery are to the left of the coordinates of the cursor, or any other determination process may be executed as long as it is a process that can determine the positional relationship.
[0047] (Ultrasound image collection) As described in step S101, the control function 451 collects ultrasound images including the region to be measured. For example, in the case of IMT-C10 measurement, the control function 451 collects ultrasound images showing the long-axis cross section of the carotid artery (longitudinal cross section of the blood vessel). Here, the orientation of the carotid artery displayed on the display 2 changes depending on the orientation of the ultrasound probe 1 relative to the subject. That is, the orientation of the carotid artery in the left-right direction of the ultrasound image changes depending on the operation of the ultrasound probe 1 by the operator.
[0048] (Part extraction processing) As described above, processing circuitry 45 extracts a region (the common carotid artery in FIG. 4) from the ultrasound image and compares the coordinates of the extracted region with the coordinates of the cursor to determine the direction in which the caliper should be displayed. Here, determination function 454, which executes the process of extracting a region from the ultrasound image, can extract the region using various methods. For example, determination function 454 can extract a region from the ultrasound image and acquire its coordinates (position) using a trained model generated using image data indicating the direction of the measurement region relative to a reference position as training data.
[0049] FIG. 5A is a diagram illustrating an example of constructing a trained model according to the first embodiment. For example, as shown in FIG. 5A, the trained model is generated by machine learning an ultrasound image of the carotid artery and common carotid artery labeling information indicating the coordinates (position) of the common carotid artery in the ultrasound image. Here, the trained model is generated using, as training data, inverted image data obtained by inverting image data in a direction to be determined. For example, as shown in FIG. 5A, the trained model is generated using an ultrasound image (in the figure, the acquired image) acquired by an ultrasound diagnostic device and an ultrasound image (in the figure, the horizontally inverted image) obtained by inverting the acquired image left and right, which is the running direction of the carotid artery. Note that the common carotid artery labeling information is input for each of the acquired image and the horizontally inverted image. As a result, a trained model is generated that uses the acquired image as an input and the coordinates of the common carotid artery in the acquired image as an output.
[0050] 5B, the determination function 454 inputs the ultrasound image (collected image in the figure) collected in step S101 into the trained model to obtain the coordinates of the common carotid artery in the input ultrasound image. Note that FIG. 5B is a diagram for explaining the processing by the determination function according to the first embodiment.
[0051] In the above example, the common carotid artery is extracted from an ultrasound image and its coordinates are acquired. However, the embodiment is not limited to this. The coordinates of any part may be acquired as long as the direction can be determined. For example, the coordinates of the carotid sinus may be acquired from an ultrasound image. In such a case, a trained model is generated by machine learning the ultrasound image and carotid sinus labeling information indicating the coordinates of the carotid sinus in the ultrasound image. Then, the determination function 454 inputs the ultrasound image into the generated trained model to acquire the coordinates of the carotid sinus.
[0052] In the above example, a method using a trained model has been described as a method for acquiring coordinates of a region from an ultrasound image. However, the embodiment is not limited to this, and a region may be extracted from an ultrasound image and its coordinates may be acquired by various other methods. For example, the coordinates may be acquired by extracting a target region from an ultrasound image using a method such as pattern matching or analysis based on anatomical landmarks.
[0053] (Reference position acquisition process) As described in step S105, the acquisition function 453 acquires the coordinates (position) of the cursor on the ultrasound image. That is, the acquisition function 453 acquires information on the reference position in the measurement of the IMT-C10. For example, the acquisition function 453 acquires the reference position of the measurement designated on the ultrasound image by the operator.
[0054] When the freeze button is pressed during collection of an ultrasound image and then the IMT-C10 button is pressed, the control function 451 displays a cursor for specifying a reference position on the ultrasound image. Specifically, the control function 451 displays a cursor for specifying a transition portion on the ultrasound image at the time the freeze button was pressed. The operator specifies the transition portion by manipulating the position of the displayed cursor via the input interface 3. The acquisition function 453 acquires the coordinates of the cursor placed on the ultrasound image by the operator, thereby acquiring the reference position for IMT-C10 measurement.
[0055] (Measurement position determination process) As described in step S106, the determination function 454 determines the direction of the measurement position relative to the reference position. Specifically, the determination function 454 determines the direction of the measurement position relative to the reference position in the ultrasound image based on image information of the part included in the ultrasound image. For example, the determination function 454 determines the direction of the measurement position relative to the reference position in the ultrasound image using a trained model generated using image data indicating the direction of the measurement position relative to the reference position as training data.
[0056] FIG. 6 is a diagram illustrating an example of a measurement position determination process according to the first embodiment. Here, FIG. 6 illustrates a process performed by the determination function 454 after the coordinates of the common carotid artery are acquired using a trained model. For example, as shown in FIG. 6, when an operator places a cursor a1 at the transition section, the determination function 454 compares the coordinates of the cursor a1 with the coordinates of the common carotid artery. Here, since the coordinates of the common carotid artery are to the right of the coordinates of the cursor a1, the determination function 454 determines that the measurement position of the IMT-C10 is to the right of the cursor a1. That is, the determination function 454 determines that the caliper b1 should be placed to the right of the cursor a1.
[0057] The control function 451 displays the caliper b1 at a position according to the determination result by the determination function 454. Specifically, the control function 451 displays the caliper b1 for measuring the measurement position in the direction relative to the reference position in the ultrasound image determined by the determination function 454. For example, the control function 451 displays the caliper b1 at a position 10 mm to the right of the cursor a1, as shown in FIG.
[0058] (Measurement processing) As described in step S204, the control function 451 performs measurement based on the distance specified by the measurement GUI. For example, the control function 451 measures the distance between the top and bottom of the caliper b1 as the IMT value. Here, the operator can arbitrarily change the distance between the top and bottom of the caliper b1 by operating the input interface 3. For example, the operator observes an ultrasound image to identify the intima and media in the distal wall of the common carotid artery, and places the top of the caliper b1 at the boundary between the lumen and intima of the common carotid artery, and places the bottom of the caliper b1 at the boundary between the media and adventitia. The distal wall of the common carotid artery is the vascular wall displayed at a position far from the ultrasound probe in the ultrasound image of the long-axis cross section.
[0059] The control function 451 measures the distance between the upper and lower parts of the caliper b1 placed by the operator as the IMT value. Note that the placement of the caliper b1 is not limited to the above-described placement by the operator, and may be performed automatically. In such a case, the control function 451 extracts the boundary between the lumen and intima of the common carotid artery and the boundary between the tunica media and adventitia based on the brightness information of the ultrasound image, and places the upper and lower parts of the caliper b1 at each extracted boundary.
[0060] (Variation 1) In the above-described embodiment, the reference position is acquired by acquiring the coordinates of the cursor designated by the operator. However, the embodiment is not limited to this, and the reference position may be acquired automatically. In such a case, for example, the acquisition function 453 acquires the reference position for measurement in the ultrasound image based on image information of a region included in the ultrasound image.
[0061] As one example, the acquisition function 453 acquires the coordinates of the transition part by extracting the transition part included in the ultrasound image using techniques such as machine learning, pattern matching, analysis based on anatomical landmarks, etc. For example, the acquisition function 453 can acquire the coordinates of the transition part in the ultrasound image using a trained model generated by machine learning an ultrasound image of the carotid artery and transition part labeling information indicating the coordinates (positions) of the transition part in the ultrasound image.
[0062] The transition area and the common carotid artery may be simultaneously extracted from the ultrasound image. In such a case, for example, a trained model is generated by machine learning an ultrasound image of the carotid artery, transition area labeling information indicating the coordinates of the transition area in the ultrasound image, and common carotid artery labeling information indicating the coordinates of the common carotid artery in the ultrasound image. Then, using this trained model, the transition area and the common carotid artery are simultaneously extracted from the ultrasound image, and their coordinates are acquired. In this case, the determination function 454 may execute a reference position acquisition process.
[0063] As described above, the ultrasound diagnostic device 10 can automatically acquire the reference position for measurement. In such a case, the cursor a1 does not need to be displayed on the ultrasound image. However, for example, the cursor a1 may be displayed on the ultrasound image when, for example, extraction of a transition portion from the ultrasound image is unsuccessful. For example, the control function 451 displays the cursor a1 on the ultrasound image when extraction of the transition portion fails or when, in the extraction results of the transition portion and the common carotid artery, the relative positional relationship between each portion deviates from the expected positional relationship (for example, the coordinates of the transition portion and the coordinates of the common carotid artery are aligned vertically). This makes it possible to specify the reference position using the cursor.
[0064] The processing procedure performed by the ultrasound diagnostic apparatus 10 according to Modification 1 will be described below with reference to Fig. 7. Fig. 7 is a flowchart for explaining the processing procedure according to Modification 1. Here, steps S301 to S303, S305, and S306 in Fig. 7 are the same as steps S101 to S103, S106, and S108, respectively, in Fig. 3. Step S304 is realized by the processing circuitry 45 reading out from the memory 44 and executing a program corresponding to the acquisition function 453 and the determination function 454.
[0065] 7, in the ultrasound diagnostic device 10 according to the first modification, the processing circuitry 45 acquires ultrasound images of the carotid artery (step S301) and determines whether the freeze button has been pressed (step S302). If the freeze button has been pressed (step S302: Yes), the processing circuitry 45 determines whether the IMT-C10 button has been pressed (step S303). The processing circuitry 45 continues acquiring ultrasound images until the freeze button is pressed (step S302: No).
[0066] In step S303, when the IMT-C10 button is pressed (step S303: Yes), the processing circuitry 45 extracts the common carotid artery and its transition region from the ultrasound image and acquires their coordinates (step S304). Note that the processing circuitry 45 remains in a standby state until the IMT-C10 button is pressed (step S303: No).
[0067] Next, the processing circuitry 45 determines the direction in which to display the caliper for IMT measurement based on the acquired coordinates of the common carotid artery and the coordinates of the transition portion, and performs the measurement (step S305).
[0068] Thereafter, the processing circuit 45 determines whether the measurement process has ended (step S306). If the measurement process has not ended (step S306: No), the processing circuit 45 continues the measurement. On the other hand, if the measurement process has ended (step S306: Yes), the processing circuit 45 ends the process.
[0069] As described above, according to the first embodiment, the control function 451 acquires ultrasound images. The acquisition function 453 acquires a reference position for measurement in the ultrasound image. The determination function 454 determines the direction of the measurement position relative to the reference position in the ultrasound image based on information about the area included in the ultrasound image. Therefore, the ultrasound diagnostic apparatus 10 according to the first embodiment can display a measurement GUI in the correct direction relative to the reference position, improving the measurement workflow.
[0070] Furthermore, according to the first embodiment, the determination function 454 determines the direction of the measurement location relative to the reference position in the ultrasound image based on image information of the location included in the ultrasound image. Therefore, the ultrasound diagnostic apparatus 10 according to the first embodiment can accurately determine the correct direction of the measurement location relative to the reference position.
[0071] Furthermore, according to the first embodiment, the determination function 454 determines the direction of the measurement location relative to the reference position in the ultrasound image using a trained model generated using image data indicating the direction of the measurement location relative to the reference position as training data. Therefore, the ultrasound diagnostic apparatus 10 according to the first embodiment can easily determine the correct direction of the measurement location relative to the reference position.
[0072] Furthermore, according to the first embodiment, the trained model is generated using, as training data, inverted image data obtained by inverting image data in a direction determined by the determination function 454. Therefore, the ultrasound diagnostic apparatus 10 according to the first embodiment can use a trained model with high accuracy.
[0073] Furthermore, according to the first embodiment, the acquisition function 453 acquires the reference position of measurement designated on the ultrasound image by the operator. Therefore, the ultrasound diagnostic apparatus 10 according to the first embodiment can easily acquire an accurate reference position.
[0074] Furthermore, according to the first embodiment, the acquisition function 453 acquires a reference position for measurement in an ultrasound image based on image information of a region included in the ultrasound image. Therefore, the ultrasound diagnostic apparatus 10 according to the first embodiment can reduce the burden on the operator.
[0075] Furthermore, according to the first embodiment, the control function 451 displays the caliper for measuring the measurement region in the direction relative to the reference position in the ultrasound image determined by the determination function 454. Therefore, the ultrasound diagnostic apparatus 10 according to the first embodiment can display the caliper in the correct direction relative to the reference position.
[0076] Furthermore, according to the first embodiment, the control function 451 displays a cursor for specifying a reference position on an ultrasound image. Therefore, the ultrasound diagnostic apparatus 10 according to the first embodiment can facilitate the operator to specify a reference position.
[0077] (Second embodiment) In the first embodiment described above, a case has been described in which the direction of a measurement region relative to a reference position is determined based on image information of the region included in an ultrasound image. In the second embodiment, a case has been described in which a position sensor is used when collecting ultrasound images, and the direction of a measurement region relative to a reference position is determined based on position information acquired by the position sensor. FIG. 8 is a block diagram showing an example of the configuration of an ultrasound diagnostic device 10 according to the second embodiment. Here, the ultrasound diagnostic device 10 according to the second embodiment differs from the first embodiment in that a transmitter 5a and position sensors 5b to 5d are newly connected, that a processing circuitry 45a newly executes a detection function 455, and in the processing content of a determination function 454. These differences will be mainly described below.
[0078] The transmitter 5a is a device that generates a magnetic field that extends outward from the device itself as its center, and is placed at an arbitrary position near the device main body 4a.
[0079] The position sensor 5b is, for example, a magnetic sensor, and is placed on the head side or the lower leg side of the subject, and detects the strength and gradient of the three-dimensional magnetic field formed by the transmitter 5a. Then, based on the information of the detected magnetic field, the position sensor 5b calculates the position (coordinates and angle) of the device itself in a space with the transmitter 5a as the origin, and transmits the calculated position to the device main body 4a.
[0080] Position sensors 5c and 5d are magnetic sensors attached to the ultrasonic probe 1 and detect the strength and gradient of the three-dimensional magnetic field formed by transmitter 5a. Based on the detected magnetic field information, position sensors 5c and 5d calculate the position (coordinates and angle) of their own devices in a space with transmitter 5a as the origin, and transmit the calculated positions to device main body 4a.
[0081] The detection function 455 controls the transmitter 5a and the position sensors 5b to 5d, and acquires position information from the position sensors 5b to 5d.
[0082] The determination function 454 according to the second embodiment determines the direction of the measurement region relative to the reference position based on the position information acquired by the position sensors 5b to 5d. Specifically, the determination function 454 identifies the positional relationship of the regions included in the ultrasound image based on the position information acquired by the position sensors when the ultrasound image is collected, and determines the direction of the measurement region relative to the reference position in the ultrasound image based on the identified positional relationship.
[0083] First, the processing procedure by the ultrasound diagnostic apparatus 10 according to the second embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart for explaining the processing procedure according to the second embodiment. Here, steps S401 to S403 and S405 to S408 in Fig. 9 are the same as steps S101 to S103 and S105 to S108 in Fig. 3, respectively. Furthermore, step S405 is realized by the processing circuitry 45a reading out from the memory 44 and executing a program corresponding to the determination function 454 and the detection function 455.
[0084] 9, in the ultrasound diagnostic apparatus 10 according to the second embodiment, the processing circuitry 45a acquires ultrasound images of the carotid artery (step S401) and determines whether the freeze button has been pressed (step S402). If the freeze button has been pressed (step S402: Yes), the processing circuitry 45a determines whether the IMT-C10 button has been pressed (step S403). The processing circuitry 45a continues acquiring ultrasound images until the freeze button is pressed (step S402: No).
[0085] In step S403, when the IMT-C10 button is pressed (step S403: Yes), the processing circuitry 45a acquires the position information acquired by the position sensors 5b to 5d at the time the freeze button was pressed, and identifies the positional relationship of the parts included in the ultrasound image based on the acquired position information (step S404). Note that the processing circuitry 45a remains in a standby state until the IMT-C10 button is pressed (step S403: No).
[0086] Next, the processing circuitry 45a acquires the coordinates of a cursor indicating a reference position for measuring IMT-C10 (step S405). Then, the processing circuitry 45a determines the direction in which to display the caliper for IMT measurement based on the acquired coordinates of the common carotid artery and the cursor, and performs the measurement (step S406).
[0087] Thereafter, the processing circuit 45a determines whether the cursor position has been moved (step S407). If the cursor position has been moved (step S407: Yes), the processing circuit 45a returns to step S405 and acquires the cursor coordinates again.
[0088] On the other hand, if the cursor position has not been moved (step S407: No), the processing circuit 45a determines whether the measurement process has ended (step S408). Here, if the measurement process has not ended (step S408: No), the processing circuit 45a continues the determination of step S407. On the other hand, if the measurement process has ended (step S408: Yes), the processing circuit 45a ends the process.
[0089] (Processing to identify the positional relationship of parts) As explained in step S404, the determination function 454 identifies the positional relationship of the parts included in the ultrasound image based on the position information of the position sensors 5b to 5d detected by the detection function 455. Fig. 10 is a diagram for explaining the processing by the determination function according to the second embodiment. Here, Fig. 10 shows the arrangement of the position sensors 5b to 5d when collecting the ultrasound image.
[0090] For example, position sensor 5b is placed on the head side of the subject as shown in Fig. 10. Position sensor 5c is placed on one side of ultrasound probe 1 (the side corresponding to the right side in the left-right direction of the ultrasound image). Position sensor 5d is placed on the other side of ultrasound probe 1 (the side corresponding to the left side in the left-right direction of the ultrasound image). During ultrasound collection, detection function 455 acquires position information from position sensors 5b to 5d placed at the positions shown in Fig. 10.
[0091] The determination function 454 identifies the positional relationship of the regions included in the ultrasound image based on the position information acquired by the detection function 455. For example, if the position information of each position sensor at the time the freeze button is pressed during ultrasound image collection is arranged as shown in Fig. 10, the determination function 454 identifies the region on the right side of the ultrasound image as the region closer to the head (i.e., the region on the peripheral side) because the position sensor 5c is closer to the position sensor 5b than the position sensor 5d. The determination function 454 also identifies the region on the left side of the ultrasound image as the region closer to the heart (i.e., the region on the central side).
[0092] This allows the determination function 454 to determine that the common carotid artery is on the left side and the carotid sinus is on the right side in the ultrasound image. As a result, the determination function 454 can determine that the left side of the coordinates of the specified cursor is the direction of the measurement position.
[0093] As described above, according to the second embodiment, the determination function 454 identifies the positional relationship of the parts included in the ultrasound image based on the position information acquired by the position sensor when the ultrasound image was collected, and determines the direction of the measurement part relative to the reference position in the ultrasound image based on the identified positional relationship. Therefore, the ultrasound diagnostic apparatus 10 according to the second embodiment can determine the correct direction of the measurement part without analyzing the ultrasound image.
[0094] (Other embodiments) In the above-described embodiment, the case of measuring IMT-C10 has been described as an example. However, the embodiment is not limited to this, and any measurement method in which the measurement position is set in a predetermined direction relative to a reference position can be applied. In this case, the direction relative to the reference position is not limited to the left-right direction in the ultrasound image described above, and various directions can be determined, such as the up-down direction in the ultrasound image, the long axis direction of a part included in the ultrasound image, or the short axis direction of a part.
[0095] The term "processor" used in the above description refers to a circuit such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an Application Specific Integrated Circuit (ASIC), a programmable logic device (e.g., a Simple Programmable Logic Device (SPLD), a Complex Programmable Logic Device (CPLD), and a Field Programmable Gate Array (FPGA)). A processor realizes its function by reading and executing a program stored in a memory. Instead of storing a program in a memory, the processor may be configured so that the program is directly embedded in its circuit. In this case, the processor realizes its function by reading and executing the program embedded in the circuit. Each processor in this embodiment is not limited to being configured as a single circuit, but may also be configured as a single processor by combining multiple independent circuits to realize its function.
[0096] Note that the components of each device illustrated in the above description of the embodiments are conceptual functional units and do not necessarily have to be physically configured as illustrated. In other words, the specific form of distribution and integration of each device is not limited to that illustrated, and all or part of the devices can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc. Furthermore, all or any part of the processing functions performed by each device can be realized by a CPU and a program analyzed and executed by the CPU, or can be realized as hardware using wired logic.
[0097] The determination method described in the above-described embodiment can be realized by executing a prepared determination program on a computer such as a personal computer or a workstation. This determination program can be distributed via a network such as the Internet. This determination program can also be recorded on a non-transitory computer-readable recording medium such as a hard disk, a flexible disk (FD), a CD-ROM, an MO, a DVD, a USB memory, or a flash memory such as an SD card memory, and can be executed by being read from the non-transitory recording medium by a computer.
[0098] As described above, according to the embodiment, it is possible to improve the workflow relating to measurement.
[0099] Although several embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, and combinations of embodiments can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, as well as within the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]
[0100] 10 Ultrasound diagnostic equipment 45, 45a Processing circuit 451 Control Functions 452 Image generation function 453 Retrieval Function 454 Judgment Function 455 detection function
Claims
1. an acquisition unit that acquires ultrasound images; an acquisition unit that acquires a reference position for measurement in the ultrasound image; a determination unit that determines a direction of a measurement position relative to the reference position in the ultrasound image based on information about a region included in the ultrasound image; a display control unit that controls the display of the ultrasound image; Equipped with When the reference position for the measurement is obtained based on image information of a part included in the ultrasound image, the display control unit hides a cursor for specifying the reference position on the ultrasound image, and displays a caliper for measuring the measurement position in a direction determined by the determination unit relative to the reference position in the ultrasound image.
2. The ultrasound diagnostic device according to claim 1 , wherein the determining unit determines a direction of the measurement position relative to the reference position in the ultrasound image based on image information of a region included in the ultrasound image.
3. 3. The ultrasound diagnostic device according to claim 2, wherein the determination unit determines the direction of the measurement position relative to the reference position in the ultrasound image using a trained model generated using image data indicating the direction of the measurement position relative to the reference position as training data.
4. The ultrasound diagnostic device according to claim 3 , wherein the trained model is generated using, as training data, inverted image data obtained by inverting the image data in a direction determined by the determination unit.
5. 2. The ultrasound diagnostic device according to claim 1, wherein the determination unit identifies a positional relationship of parts included in the ultrasound image based on position information acquired by a position sensor when the ultrasound image is collected, and determines a direction of the measurement position relative to the reference position in the ultrasound image based on the identified positional relationship.
6. 6. The ultrasonic diagnostic apparatus according to claim 1, wherein the acquisition unit acquires a reference position for the measurement designated on the ultrasonic image by an operator.
7. 6. The ultrasound diagnostic device according to claim 1, wherein the acquisition unit acquires a reference position for the measurement in the ultrasound image based on image information of a region included in the ultrasound image.
8. 7. The ultrasound diagnostic apparatus according to claim 6, wherein, when the reference position for the measurement is acquired by the operator specifying the reference position on the ultrasound image, the display control unit displays a cursor for specifying the reference position on the ultrasound image and also displays the caliper.
9. Acquire ultrasound images; acquiring a reference position for measurement in the ultrasound image; determining a direction of a measurement position relative to the reference position in the ultrasound image based on information about a region included in the ultrasound image; When the reference position of the measurement is acquired based on image information of a region included in the ultrasound image, a cursor for designating the reference position on the ultrasound image is hidden, and a caliper for measuring the measurement position is displayed in a direction determined with respect to the reference position on the ultrasound image. A determination method comprising:
Citation Information
Patent Citations
Ultrasonic diagnostic apparatus and method of controlling the same
JP2014217745A
Ultrasonic image diagnostic apparatus, medical image processing apparatus and medical image processing program
JP2018140163A
Device and program
JP2021164573A
Ultrasound diagnostic device and ultrasound diagnostic device control method
WO2013051275A1
Ultrasonic diagnostic system and method for controlling ultrasonic diagnostic system
WO2018047404A1