Ultrasound diagnostic device, medical image processing device, and program

Abstract

To automatically adjust the position of a light source in rendering processing according to the motion of a target.SOLUTION: An ultrasonic diagnostic device comprises: an acquisition unit; a detection unit; and a setting unit. The acquisition unit acquires voxel data generated for each ultrasonic image data including a target collected at a prescribed frame rate. The detection unit detects a target on the basis of the voxel data for each voxel data. The setting unit sets the position of a light source in rendering processing of the voxel data on the basis of the detected target for each voxel data.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The embodiments disclosed in this specification and the drawings relate to an ultrasound diagnostic apparatus, a medical image processing apparatus, and a program. [Background technology]

[0002] Some ultrasound diagnostic devices have a so-called Live 4D function that generates and displays a 3D image in real time while collecting 2D ultrasound images. The Live 4D function is used, for example, to check the development of a fetus or the circulatory system such as the heart. While the Live 4D function is running, the user can adjust the position of the light source in the lighting settings included in the rendering process that generates the 3D image to make it easier to observe the target.

[0003] However, if the object moves while the 3D images are being generated in real time, the object may not be illuminated sufficiently by the light source. In this case, the user must manually adjust the position of the light source, which is very cumbersome. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-181168 A [Non-patent literature]

[0005] [Non-Patent Document 1] Christopher M. Bishop, "Pattern recognition and machine learning", (USA), 1st edition, Springer, 2006, pp. 225-290 Summary of the Invention [Problem to be solved by the invention]

[0006] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to automatically adjust the position of a light source in a rendering process according to the movement of a target. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described later can also be positioned as other problems. [Means for solving the problem]

[0007] An ultrasound diagnostic device according to an embodiment includes an acquisition unit, a detection unit, and a setting unit. The acquisition unit acquires voxel data generated for each ultrasound image data including a target collected at a predetermined frame rate. The detection unit detects a target based on the voxel data for each piece of voxel data. The setting unit sets a position of a light source in a rendering process of the voxel data for each piece of voxel data based on the detected target. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of an ultrasound diagnostic apparatus according to an embodiment. [Diagram 2] FIG. 2 is a block diagram showing an example of functions implemented by a processor of a processing circuit. [Diagram 3] FIG. 13 is an explanatory diagram showing an example of a three-dimensional image of a fetus when a light source is substantially directly facing the face of the fetus. [Figure 4] FIG. 4 is an explanatory diagram showing an example of a three-dimensional image of a fetus when the light source is fixed in the same position as in the example shown in FIG. 3 and the face of the fetus is turned to the side; [Diagram 5] 5A and 5B are diagrams for explaining light source position adjustment according to the embodiment. [Figure 6] FIG. 4 is an explanatory diagram showing an example of a data flow during learning of a detection function. [Figure 7] FIG. 11 is an explanatory diagram showing an example of a data flow when a detection function is operated. [Figure 8]10 is a flowchart showing an example of a procedure for automatically adjusting the position of a light source in a rendering process in accordance with the movement of a fetus's face by a processor of the processing circuit shown in FIG. 1; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of an ultrasound diagnostic apparatus, a medical image processing apparatus, and a program will be described in detail with reference to the drawings.

[0010] The ultrasound diagnostic device, medical image processing device, and program according to the present embodiment automatically adjust the position of a light source in rendering processing according to the movement of a target. The target includes the face and body of a fetus as well as organs such as the heart. An example in which the target is the face of a fetus will be described below.

[0011] (composition) FIG. 1 is a block diagram showing an example of the configuration of an ultrasound diagnostic apparatus 10 according to an embodiment.

[0012] The ultrasonic diagnostic device 10 can be used by being connected to an ultrasonic probe 20, an input interface 21, and a display 22. The ultrasonic diagnostic device 10 may include at least one of the ultrasonic probe 20, the input interface 21, and the display 22. The ultrasonic diagnostic device 10 may be a tablet type or a smartphone type.

[0013] As shown in FIG. 1, the ultrasound diagnostic apparatus 10 includes a transmission / reception circuitry 11, a B-mode processing circuitry 12, a Doppler processing circuitry 13, an image generating circuitry 14, an image memory 15, a storage circuitry 16, a network connection circuitry 17, and a processing circuitry 18.

[0014] The transmission / reception circuit 11 has a transmission circuit and a reception circuit. The transmission / reception circuit 11 is controlled by the processing circuit 18 to control the transmission directivity and reception directivity in transmitting and receiving ultrasonic waves. Note that, although an example in which the transmission / reception circuit 11 is provided in the ultrasonic diagnostic device 10 is shown in FIG. 1, the transmission / reception circuit 11 may be provided in the ultrasonic probe 20, or may be provided in both the ultrasonic diagnostic device 10 and the ultrasonic probe 20.

[0015] The transmission circuit has a pulse generator, a transmission delay circuit, a pulsar circuit, etc., and supplies a drive signal to the ultrasonic transducer. The pulse generator repeatedly generates rate pulses for forming a transmission ultrasonic wave at a predetermined rate frequency. The transmission delay circuit provides each rate pulse generated by the pulse generator with a delay time for each piezoelectric transducer required to focus the ultrasonic waves generated from the ultrasonic transducer into a beam shape and determine the transmission directivity. In addition, the pulsar circuit applies a drive pulse to the ultrasonic transducer at a timing based on the rate pulse. The transmission delay circuit arbitrarily adjusts the transmission direction of the ultrasonic beam transmitted from the piezoelectric transducer surface by changing the delay time provided to each rate pulse.

[0016] The receiving circuit has an amplifier circuit, an A / D converter, an adder, etc., and receives the echo signal received by the ultrasonic transducer and performs various processing on this echo signal to generate echo data. The amplifier circuit amplifies the echo signal for each channel and performs gain correction processing. The A / D converter A / D converts the gain-corrected echo signal and gives the digital data a delay time required to determine the reception directivity. The adder performs addition processing of the echo signals processed by the A / D converter to generate echo data. The addition processing by the adder emphasizes the reflection components from the direction corresponding to the reception directivity of the echo signal.

[0017] The B-mode processing circuit 12 receives the echo data from the receiving circuit, and performs logarithmic amplification, envelope detection processing, etc. to generate data (B-mode data) in which the signal intensity is expressed as luminance brightness.

[0018] The Doppler processing circuit 13 performs frequency analysis on the velocity information from the echo data received from the receiving circuit, extracts blood flow, tissue, and contrast agent echo components due to the Doppler effect, and generates data (Doppler data) that extracts mobility information such as average velocity, variance, and power for multiple points.

[0019] The B-mode data and the Doppler data are two-dimensional ultrasound image data before the scan conversion process to display data by the image generating circuit 14, and are also called raw data. The raw data is temporarily stored in the image memory 15. The raw data may also be stored in the image server 40.

[0020] The image generating circuit 14 generates ultrasonic image data for display based on the echo signal received by the ultrasonic probe 20. For example, the image generating circuit 14 generates two-dimensional B-mode image data in which the intensity of the reflected wave is expressed by brightness from the two-dimensional B-mode data generated by the B-mode processing circuit 12. The image generating circuit 14 also generates image data of an average velocity image, a variance image, a power image, or a two-dimensional color Doppler image as a combination image thereof, which represents the locomotion information, from the two-dimensional Doppler data generated by the Doppler processing circuit 13. The image generating circuit 14 may also store the generated image data in the image server 40.

[0021] The image memory 15 is a memory that stores raw data and images generated by the processing circuit 18. The storage circuit 16 includes a processor-readable storage medium, such as a magnetic or optical storage medium or a semiconductor memory.

[0022] A part or all of the programs and data in the storage medium of the storage circuitry 16 may be downloaded by communication via the network 100, or may be provided to the storage circuitry 16 via a portable storage medium such as an optical disk. Note that a part or all of the information stored in the storage circuitry 16 may be distributed and stored in at least one of the storage media, such as an external storage circuit or a storage circuit (not shown) of the ultrasound probe 20, or may be copied and stored.

[0023] The storage circuit 16 includes a processor-readable storage medium, such as a magnetic or optical storage medium or a semiconductor memory. A part or all of the programs and data in the storage medium of the storage circuit 16 may be downloaded by communication via an electronic network, or may be provided to the storage circuit 16 via a portable storage medium, such as an optical disk. Note that a part or all of the information stored in the storage circuit 16 may be distributed and stored in at least one of storage media, such as an external storage circuit or a storage circuit (not shown) of the ultrasound probe 20, or may be copied and stored.

[0024] The network connection circuit 17 implements various information communication protocols according to the form of the network 100. The network connection circuit 17 connects the ultrasound diagnostic apparatus 10 to other electrical devices in accordance with these various protocols. For this connection, an electrical connection via an electronic network can be applied. Here, the electronic network means information and communication networks in general that utilize electrical communication technology, and includes wireless / wired LANs such as hospital backbone LANs (Local Area Networks) and the Internet, as well as telephone communication line networks, optical fiber communication networks, cable communication networks, and satellite communication networks.

[0025] The processing circuitry 18 realizes a function of overall control of the ultrasound diagnostic apparatus 10. The processing circuitry 18 is also a processor for executing a process for automatically adjusting the position of a light source in a rendering process according to the movement of a target by reading and executing a program stored in the storage circuitry 16.

[0026] The configuration and operation of processing circuitry 18 will be described in detail below with reference to FIGS. 2-8.

[0027] The ultrasonic probe 20 is detachably connected to the ultrasonic diagnostic device 10 via a cable. The ultrasonic probe 20 may be connected to the ultrasonic diagnostic device 10 wirelessly.

[0028] The ultrasound probe 20 may be a probe used in a transabdominal method in which the probe is placed in contact with the surface of the abdomen of a pregnant woman as a subject to transmit and receive ultrasound to and from the fetus in the pregnant woman's uterus, or it may be a rod-shaped transvaginal probe used in a transvaginal method in which the probe is inserted into the pregnant woman's vagina to transmit and receive ultrasound to and from the fetus from within the pregnant woman's body at a position closer to the fetus.

[0029] A two-dimensional array probe in which a plurality of ultrasonic transducers are arranged in the scan direction (azimuth direction) and a plurality of elements are also arranged in the lens direction (elevation direction) can be used as the ultrasonic probe 20. As this type of two-dimensional array probe, for example, a 1.5D array probe, a 1.75D array probe, a 2D array probe, etc. can be used.

[0030] In this embodiment, the ultrasonic probe 20 is configured to be capable of acquiring volume data. In this case, the ultrasonic probe 20, which is a two-dimensional array probe, may be used to scan the subject in three dimensions. Also, a one-dimensional ultrasonic probe in which a plurality of piezoelectric transducers are arranged in a line may be used as the ultrasonic probe 20. In this case, the subject may be scanned in three dimensions by rotating the plurality of ultrasonic transducers. Also, a mechanical 4D probe that scans a three-dimensional region by mechanically oscillating a plurality of piezoelectric transducers of the one-dimensional ultrasonic probe may be used as the ultrasonic probe 20.

[0031] When the ultrasound probe 20 can acquire volume data, the user can select either a two-dimensional display mode (2D mode) in which any of a plurality of two-dimensional ultrasound images is displayed as a real-time moving image or as a still image, or a four-dimensional display mode (4D mode) in which a three-dimensional ultrasound image is displayed as a moving image. In the 4D mode, two-dimensional ultrasound image data acquired in real time at a predetermined frame rate is converted by the processing circuitry 18 into volume data (voxel data group, hereinafter referred to as voxel data) in a sequential display format, and the processing circuitry 18 performs rendering processing including lighting processing on the voxel data to sequentially generate three-dimensional ultrasound images, which are then displayed on the display 22 as a moving image.

[0032] The input interface 21 is realized by a general input device such as a trackball, a switch, a button, a mouse, a keyboard, a touch pad that performs an input operation by touching an operation surface, a non-contact input circuit using an optical sensor, and a voice input circuit, and outputs an operation input signal corresponding to a user's operation to the processing circuit 18. The input interface 21 may be configured as an operation panel. In this case, the operation panel functions as a touch command screen and has, for example, a display, a touch input circuit provided near the display, and hard keys. The input interface 21 is an example of an input unit.

[0033] The display 22 is configured with a general display output device such as a liquid crystal display or an OLED (Organic Light Emitting Diode) display, and displays various information under the control of the processing circuit 18.

[0034] Furthermore, when the ultrasonic diagnostic device 10 is a tablet or smartphone type ultrasonic diagnostic device 10, the input interface 21 and the display 22 may be integrated to form a touch panel.

[0035] Furthermore, the ultrasound diagnostic apparatus 10 may be connected to a medical image processing apparatus 30 and an image server 40 via a network 100 so as to be able to transmit and receive data to and from each other.

[0036] Fig. 2 is a block diagram showing an example of functions realized by the processor of the processing circuitry 18. As shown in Fig. 2, the processor of the processing circuitry 18 realizes an acquisition function 31, a detection function 32, a reference point calculation function 33, a light source position setting function 34, and an image generation function 35. Each of these functions 31-35 is stored in the memory circuitry 16 in the form of a program.

[0037] The acquisition function 31 acquires two-dimensional raw data collected at a predetermined frame rate. The acquisition function 31 also acquires voxel data generated by converting the raw data by the image generation function 35. The acquisition function 31 is an example of an acquisition unit.

[0038] The detection function 32 detects a target based on the voxel data for each voxel data. As a method for detecting a target based on the voxel data, for example, a method of segmenting the voxel data into a plurality of regions by semantic segmentation and detecting the position and orientation of the target based on the segmentation result can be used. In this embodiment, an example in which the target is the face of a fetus will be described. The detection function 32 is an example of a detection unit.

[0039] The reference point calculation function 33 obtains the reference point of the detected target. As the reference point, the center (for example, the center of gravity) of the area (two-dimensional area or three-dimensional area) of the target can be used.

[0040] The light source position setting function 34 sets the position of the light source in the rendering process of the voxel data based on the detected target for each voxel data. For example, the light source position setting function 34 sets the position of the light source so that the light source is located at a preset distance and angle with respect to the reference point of the target. The light source position setting function 34 is an example of a setting unit.

[0041] The image generation function 35 generates a three-dimensional image for each voxel data by rendering the voxel data using the set light source position, and displays the image on the display 22. This rendering process includes a lighting process using the set light source position. For example, a technique such as global illumination can be used as the lighting process. The image generation function 35 is an example of an image generation unit.

[0042] (Light source position setting) 3A to 3C are explanatory diagrams showing an example of a 3D image of a fetus when a light source is substantially directly facing the fetal face 50. In Figs. 3-5, the areas hatched with diagonal lines indicate that the areas are in shadow.

[0043] The voxel data generated based on an ultrasound scan of the fetus includes multiple components such as the fetal body including the fetal face 50, amniotic fluid, and the placenta 60.

[0044] The fetal face 50 includes components such as left and right eyes 51 and a nose 52. When the light source is almost directly facing the fetal face 50, the left and right eyes 51 and the nose 52 can be clearly observed without being obstructed by the placenta 60, as shown in FIG.

[0045] However, if the target moves, a shadow may be cast on part or all of the target being observed, making it difficult to observe the target.

[0046] FIG. 4 is an explanatory diagram showing an example of a three-dimensional image of a fetus in a case where the face 50 of the fetus turns to the side while the light source is fixed at the same position as in the example shown in FIG.

[0047] 4, even though the position of the light source is fixed, the fetus's face 50 turns to the side, so most of the fetus's face 50 is in the shadow of the placenta 60. In this case, it is difficult for the user to observe the fetus's face 50.

[0048] Therefore, the processing circuitry 18 according to the present embodiment automatically adjusts the position of the light source in the rendering process according to the movement of the target.

[0049] Fig. 5 is a diagram for explaining light source position adjustment according to this embodiment. The left column of Fig. 5 shows an example of a transition of a three-dimensional image, and the right column shows an example of the relationship between the position and orientation of the fetus's face 50 and the position of the light source 70.

[0050] 5, when the user determines that the fetal face 50 faces forward and selects the 4D mode, the light source position setting function 34 sets the position of the light source 70 to a position directly facing the fetal face 50. At this time, the light source position setting function 34 sets the position of the light source 70 so that it is located at a preset distance and angle with respect to the reference point 55 of the fetal face 50.

[0051] The reference point 55 of the fetal face 50 may be the center (such as the center of gravity) of a triangle connecting the centers of the areas of the left and right eyes 51 and the center of the area of ​​the nose 52. The preset distance and angle may be set so that the light source 70 is positioned slightly above the reference point of the fetal face 50 rather than directly in front of it.

[0052] By positioning light source 70 almost directly opposite fetal face 50 in this manner, the left and right eyes 51 and nose 52 can be clearly observed without being obstructed by placenta 60 (see Figures 3 and 5, upper left).

[0053] Thereafter, as shown in the middle part of FIG. 5, if face 50 of the fetus turns to the side, the light from light source 70 is blocked by placenta 60.

[0054] Therefore, the light source position setting function 34 according to this embodiment sets the position of the light source 70 so that it is located at a preset distance and angle with respect to the reference point 55 of the fetal face 50 detected from the current voxel data, as shown in the lower right of Fig. 5. Therefore, even if the fetal face 50 moves, the light source 70 can be automatically positioned so as to face the fetal face 50 almost directly according to the current position and orientation of the fetal face 50, and the left and right eyes 51 and nose 52 can be clearly observed without being obstructed by the placenta 60 (see the lower left of Fig. 5).

[0055] In addition, a user's selection of whether to update the position of the light source 70 by executing automatic position setting and rendering processing of the light source 70, or to interrupt the automatic position setting and rendering processing of the light source 70 so as to maintain the current position of the light source 70, may be accepted via the input interface 21. In this case, after setting the position of the light source 70 when switching to the 4D mode, the processing may be interrupted, and the position of the light source 70 may be updated by starting the processing upon receiving a user instruction via the input interface 21. When the selection of interrupting the processing can be accepted, the user can also maintain the current position of the light source 70, so that it is possible to prevent adverse effects caused by an unintentional change in the position of the light source 70.

[0056] (Target Detection) The detection function 32 may detect a target from the voxel data by performing semantic segmentation using a trained model constructed by machine learning. In this case, deep learning using a multi-layered neural network such as a convolutional neural network (CNN) or a convolutional deep belief network (CDBN) may be used as the machine learning. An example in which the detection function 32 uses a trained model constructed by deep learning will be described below.

[0057] 6 is an explanatory diagram showing an example of a data flow during learning of the detection function 32. The detection function 32 performs deep learning using a large number of training data sets, thereby sequentially updating the parameter data 322.

[0058] Each of the multiple training data sets is made up of a set of learning data 81 and teacher data 82. The learning data 81 is voxel data 811, 812, 813, .... The teacher data 82 is segmented voxel data 821, 822, 823, ... corresponding to the voxel data 811, 812, 813, ....

[0059] The segmented voxel data 821, 822, 823, ... are obtained by segmenting the voxel data 811, 812, 813, ..., respectively. When the target is the face 50 of the fetus, segmentation may be performed on the region of the eyes 51, the region of the nose 52, the region of the fetus's body (entire body including the head), and the regions of other components such as the placenta 60. Also, all components except the eyes 51, the nose 52, the fetus's body (entire body including the head), and the amniotic fluid may be segmented into one other component.

[0060] The detection function 32 performs so-called learning, updating the parameter data 322 each time a training data set is provided, so that the result of processing the learning data 81 by the neural network 321 approaches the teacher data 82. In general, when the rate of change of the parameter data 322 converges within a threshold, learning is determined to be completed. Hereinafter, the parameter data 322 after learning is particularly referred to as learned parameter data 322t. The neural network 321 and the learned parameter data 322t configure a learned model 320.

[0061] The trained model may be constructed for each pregnancy cycle of the subject pregnant woman. For example, until about the 11th week of pregnancy, parts of the fetus such as the eyes 51 and nose 52 are underdeveloped and not formed in detail. For this reason, it is difficult to segment the eyes 51 and nose 52 of the fetus until the 11th week of pregnancy. Therefore, different trained models may be constructed and used according to the pregnancy cycle.

[0062] Specifically, for a pregnancy period up to 11 weeks, the target may be the fetus's body instead of the fetus's face 50, and the fetus's body (whole body including the head) and other components such as the placenta 60 may be segmented and used as segmented voxel data 821, 822, 823, ... to construct a trained model for a fetus with undeveloped parts. When the target is the fetus's body, the reference point may be the center (center of gravity, etc.) of the fetus's body. On the other hand, for a pregnant woman whose pregnancy period is 11 weeks or later, as described above, a trained model constructed using segmented voxel data 821, 822, 823, ... in which the eye 51 and nose 52 regions are also segmented may be used as a trained model for a fetus with developed parts.

[0063] 7 is an explanatory diagram showing an example of a data flow during operation of the detection function 32. During operation, the detection function 32 receives voxel data 91 as input and generates segmented voxel data 92 using the trained model 320.

[0064] The neural network 321 and the trained parameter data 322t constitute a trained model 320. Various methods are known for this type of training method and for constructing a trained model, such as the method disclosed in Non-Patent Document 1. The neural network 321 is stored in the memory circuitry 16 in the form of a program. The trained parameter data 322t may be stored in the memory circuitry 16, or may be stored in a storage medium connected to the processing circuitry 18 via the network 100.

[0065] When the trained model 320 (neural network 321 and trained parameter data 322t) is stored in the memory circuit 16, the detection function 32 realized by the processor of the processing circuit 18 can generate segmented voxel data 92 based on the voxel data 91 by reading the trained model 320 from the memory circuit 16 and executing it.

[0066] In addition, the trained model 320 may be constructed using an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0067] The functions 31-35 of the processing circuitry 18 may be realized by a processor of the medical image processing device 30. In this case, the medical image processing device 30 acquires raw data from the ultrasound diagnostic device 10 or the image server 40.

[0068] (operation) Next, an example of the operation of the ultrasound diagnostic apparatus 10, the medical image processing apparatus 30, and the program according to this embodiment will be described.

[0069] Fig. 8 is a flow chart showing an example of a procedure for automatically adjusting the position of the light source 70 in the rendering process according to the movement of the fetal face 50 by the processor of the processing circuit 18 shown in Fig. 1. In Fig. 8, the reference characters S followed by numbers indicate each step of the flow chart. This procedure is repeated for each voxel data.

[0070] FIG. 8 shows an example of using a trained model 320 constructed using segmented voxel data 821, 822, 823, ... in which the eye region 51 and the nose region 52 are also segmented regardless of the pregnancy cycle.

[0071] First, in step S1, the acquisition function 31 acquires voxel data generated by conversion from raw data.

[0072] Next, in step S2, the detection function 32 generates segmented voxel data 92 by inputting the voxel data 91 to a trained model 320 that generates segmented voxel data 92 by segmenting each of the areas of a plurality of components including the components of the fetal face 50 contained in the ultrasound image data based on the voxel data 91.

[0073] Next, in step S3, the detection function 32 determines whether or not the segmented voxel data 92 includes the regions of the eyes 51 and the nose 52.

[0074] If the segmented voxel data 92 includes the areas of the eyes 51 and the nose 52 (YES in step S3), the reference point calculation function 33 sets the fetal face 50 as the target and determines the center coordinates of the triangle connecting the centers of the left and right eye 51 areas and the center of the nose 52 area as the coordinates of the reference point 55 (step S4).

[0075] On the other hand, if the segmented voxel data 92 does not include the eye 51 area and the nose 52 area (NO in step S3), the reference point calculation function 33 sets the target to the fetal body and determines the center coordinates of the fetal body area as the coordinates of the reference point 55 (step S5).

[0076] Next, in step S6, the light source position setting function 34 automatically sets the position of the light source 70 so that it is located at a predetermined distance and a predetermined angle with respect to the reference point 55 of the target detected from the voxel data.

[0077] By performing the above steps S1 to S6, the position of the light source 70 in the rendering process can be automatically adjusted according to the movement of the fetus's face 50.

[0078] However, depending on the situation inside the uterus of a pregnant woman, a component such as the placenta 60 may be between the position of the light source 70 automatically set in step S6 and the fetus as an obstruction. In preparation for this case, it is advisable to prepare settings for correcting the position of the light source 70 to a position that avoids obstructions, and to specify in advance which setting to use or whether correction should not be made. This will be specifically described below using steps S7-S13.

[0079] In step S7, the light source position setting function 34 determines whether or not a component such as the placenta 60 exists as an obstruction between the position of the light source 70 automatically set in step S6 and the fetus. If an obstruction exists, the process proceeds to step S8. On the other hand, if no obstruction exists, the series of procedures for the current voxel data ends.

[0080] In addition, whether an obstruction exists between the position of the light source 70 and the fetus can be determined by using as criteria whether an obstruction exists between the light source 70 and the reference point 55 of the target, or whether an obstruction is included in the cone connecting the light source 70 and the target.

[0081] If the use of setting 1 has been specified in advance (YES in step S8), the light source position setting function 34 corrects the position of the light source 70 to a position on a line connecting the target and the edge of the obstruction and that is the shortest distance from the current setting position of the light source 70 (step S9), and the series of procedures ends. At this time, it is preferable to move the position of the light source 70 within a plane perpendicular to the depth direction, without moving it in the depth direction.

[0082] If the use of setting 1 is not specified (NO in step S8) and the use of setting 2 is specified (YES in step S10), the light source position setting function 34 corrects the position of the light source 70 so that the light source 70 is located on the target side of the obstruction (step S11), and the series of steps is completed.

[0083] Furthermore, if the use of setting 2 is not specified (NO in step S10) and the use of setting 3 is specified (YES in step S12), the light source position setting function 34 generates and outputs mask data in which the obstruction has been removed by masking processing, or mask data in which the obstruction has been given a predetermined transmittance by masking processing (step S13), and the series of procedures ends. Note that, if setting 3 is used, the image generating function 35 uses the corrected position of the light source 70 and performs rendering processing using the masking data to generate a masked 3D image so that the obstruction does not interfere with observation of the target.

[0084] By carrying out the above steps S7-13, a three-dimensional image can be generated in which the target can be easily observed, even if a component such as the placenta 60 is present between the position of the light source 70 automatically set in step S6 and the fetus as an obstruction.

[0085] Note that mask data may be generated by masking some or all of the desired components excluding the components of the fetus, regardless of the presence or absence of an obstruction or the use of setting 3, and a masked 3D image may be generated so that the desired components do not interfere with observation of the target. Whether or not to generate mask data may be selectable by the user via the input interface 21.

[0086] According to the ultrasound diagnostic device 10, medical image processing device 30, and program of this embodiment, the position of the light source 70 can be automatically set according to the position and orientation of the target for each voxel data. Therefore, an image with lighting suitable for observing the target can be efficiently provided to the user. In addition, it is very convenient because it relieves the user from the trouble of manually adjusting the light source 70 according to the movement of the target.

[0087] According to at least one of the embodiments described above, the position of the light source 70 in the rendering process can be automatically adjusted in response to the movement of the target.

[0088] In the above embodiment, the term "processor" refers to a circuit such as a dedicated or general-purpose CPU (Central Processing Unit), GPU (Graphics Processing Unit), or an Application Specific Integrated Circuit (ASIC), a programmable logic device (for example, a Simple Programmable Logic Device (SPLD), a Complex Programmable Logic Device (CPLD), and a Field Programmable Gate Array (FPGA)). When the processor is a CPU, for example, the processor realizes various functions by reading and executing a program stored in a memory circuit. When the processor is an ASIC, for example, instead of storing a program in a memory circuit, a function corresponding to the program is directly built into the processor circuit as a logic circuit. In this case, the processor realizes various functions by hardware processing that reads and executes the program built into the circuit. Alternatively, the processor can realize various functions by combining software processing and hardware processing.

[0089] In the above embodiment, an example was shown in which a single processor of the processing circuit realizes each function, but a processing circuit may be configured by combining multiple independent processors, and each processor may realize each function. In addition, when multiple processors are provided, a memory circuit for storing a program may be provided for each processor, or one memory circuit may collectively store programs corresponding to the functions of all the processors.

[0090] Although some embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, and combinations of embodiments can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents as described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]

[0091] 10. Ultrasound diagnostic equipment 18 Processing circuit 20 Ultrasound Probe 21 Input Interface 22 Display 30 Medical image processing device 31 Acquisition Function 32 Detection Function 33 Reference point calculation function 34 Light source position setting function 35 Image generation function 50 Fetal Face 51 eyes 52 Nose 55 Reference point 60 placenta 70 light source

Claims

1. an acquisition unit that acquires voxel data representing a three-dimensional ultrasound image acquired at a predetermined frame rate; A detection unit that detects a position and an orientation of a target included in the voxel data; a setting unit that sets a position of a light source in a rendering process for the target; Equipped with The setting unit is setting, as the position of the light source, a position according to the position and orientation of the target, where the target is not shaded by an obstructing object included in the voxel data; Ultrasound diagnostic equipment.

2. An acquisition unit that acquires voxel data representing a three-dimensional ultrasound image collected at a predetermined frame rate; A detection unit that detects a position and an orientation of a target included in the voxel data; a setting unit that sets a position according to the position and orientation of the target as a position of a light source in a rendering process for the target; Equipped with The setting unit is generating mask data for removing an obstruction between the setting position of the light source and the target or for providing a predetermined transmittance to the obstruction by performing a masking process on the voxel data; Ultrasound diagnostic equipment.

3. The setting unit is setting the light source at a position between the obstruction and the target; The ultrasonic diagnostic apparatus according to claim 1 .

4. The target is the face of the fetus.

4. The ultrasonic diagnostic apparatus according to claim 1.

5. The target is the fetal body, including the head.

4. The ultrasonic diagnostic apparatus according to claim 1.

6. an image generating unit that generates a three-dimensional image for each of the voxel data by performing rendering processing on the voxel data using the position of the light source set by the setting unit, and displays the three-dimensional image on a display; The ultrasonic diagnostic apparatus according to claim 1 , further comprising:

7. an input unit that accepts a user's selection of whether to update or maintain the position of the light source set by the setting unit; The ultrasonic diagnostic apparatus according to claim 1 , further comprising:

8. an acquisition unit that acquires voxel data representing a three-dimensional ultrasound image acquired at a predetermined frame rate; A detection unit that detects a position and an orientation of a target included in the voxel data; a setting unit that sets a position of a light source in a rendering process for the target; Equipped with The setting unit is setting, as the position of the light source, a position according to the position and orientation of the target, where the target is not shaded by an obstructing object included in the voxel data; Medical imaging equipment.

9. An acquisition unit that acquires voxel data representing a three-dimensional ultrasound image collected at a predetermined frame rate; A detection unit that detects a position and an orientation of a target included in the voxel data; a setting unit that sets a position according to the position and orientation of the target as a position of a light source in a rendering process for the target; Equipped with The setting unit is generating mask data for removing an obstruction between the setting position of the light source and the target or for providing a predetermined transmittance to the obstruction by performing a masking process on the voxel data; Medical imaging equipment.

10. On the computer, acquiring voxel data representing a three-dimensional ultrasound image acquired at a predetermined frame rate; detecting a position and orientation of a target included in the voxel data; setting a position of a light source in a rendering process for the target; A program for executing In the step of setting the position of the light source, setting, as the position of the light source, a position according to the position and orientation of the target, where the target is not shaded by an obstructing object included in the voxel data; program.

11. A computer comprising: acquiring voxel data representing a three-dimensional ultrasound image acquired at a predetermined frame rate; detecting a position and orientation of a target included in the voxel data; setting a position according to the position and orientation of the target as a position of a light source in a rendering process for the target; A program for executing In the step of setting the position of the light source, generating mask data for removing an obstruction between the setting position of the light source and the target or for providing a predetermined transmittance to the obstruction by performing a masking process on the voxel data; program.

Images