Medical image diagnostic device, medical image processing device, and program

Abstract

To conceal a portion of a rendering image undesirable to be viewed by simple processing.SOLUTION: A medical image diagnostic apparatus according to an embodiment comprises an acquisition unit, a first generation unit, a second generation unit, a concealment unit, and a providing unit. The acquisition unit acquires an image generation element generated by a medical appliance. The first generation unit generates a three-dimensional image based on the acquired image generation element. The second generation unit generates a rendering image by applying rendering processing to the generated three-dimensional image. The concealment unit sets a concealed area in the rendering image. The providing unit provides the rendering image to which the concealed area is set.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The embodiments disclosed in this specification and the drawings relate to a medical image diagnostic apparatus, a medical image processing apparatus, and a program. [Background technology]

[0002] For example, a three-dimensional image (hereinafter referred to as "3D image") of a fetus may be acquired by an ultrasound imaging diagnostic device, and this 3D image may be rendered and provided to a patient such as a pregnant woman. In this case, since there is a limit to the range where the probe can be applied and the range where the ultrasound beam can be applied by manipulating the probe when acquiring an image of the fetus, it may be difficult to include, for example, the entire face of the fetus in one frame of data. When showing such an acquired image to a patient, for example, if images of key parts such as the eyes, nose, and mouth are missing, it may evoke negative feelings at first glance.

[0003] There are rendering systems that have a function to cut out parts that you do not want to show in 3D so that they are not included in the rendered image. However, when cutting in 3D, the work of surrounding the parts to be cut is cumbersome. Furthermore, since the parts to be cut extend into the depth direction, there is a possibility that the parts you want to see will be cut out when you rotate the image after cutting it.

[0004] On the other hand, when using a rendering mode that performs light calculations, it is possible to make the parts you do not want to see less noticeable by shining light on them so that they are in shadow. However, in this case, it may not be possible to both darken the parts you do not want to see and brighten the parts you want to see. By increasing the number of light sources, it is possible to both darken the parts you do not want to see and brighten the parts you want to see, but position adjustment may become complicated. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2020-062215 A [Patent Document 2] Patent No. 5882217 [Patent Document 3] Patent No. 6060173 Summary of the Invention [Problem to be solved by the invention]

[0006] The problem to be solved by the embodiments disclosed in this specification and the drawings is to be able to hide parts of a rendering image that one does not want to show by simple processing. However, the problem to be solved by the embodiments disclosed in this specification and the drawings is not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described later can also be positioned as other problems. [Means for solving the problem]

[0007] A medical image diagnostic apparatus according to an embodiment includes an acquisition unit, a first generation unit, a second generation unit, a concealment unit, and a provision unit. The acquisition unit acquires image generation elements generated by a medical device. The first generation unit generates a three-dimensional image based on the acquired image generation elements. The second generation unit generates a rendering image by performing a rendering process on the generated three-dimensional image. The concealment unit sets a concealment area in the rendering image. The provision unit provides the rendering image in which the concealment area is set. [Brief description of the drawings]

[0008] [Figure 1] 1 is a diagram showing an example of the configuration of an ultrasound diagnostic imaging system 1 according to an embodiment. [Diagram 2] 4 is a flowchart showing an example of processing of the ultrasound imaging diagnostic system 100. [Diagram 3] FIG. 2 is a diagram showing an example of a rendering image displayed on a display device 200. [Figure 4]FIG. 2 is a diagram showing an example of a composite image displayed on a display device 200. [Diagram 5] FIG. 2 is a diagram showing an example of a rendering image displayed on a display device 200. [Figure 6] FIG. 2 is a diagram showing an example of a composite image displayed on a display device 200. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, a medical image diagnostic apparatus, a medical image processing apparatus, and a program according to embodiments will be described with reference to the drawings.

[0010] 1 is a diagram showing an example of the configuration of an ultrasound diagnostic imaging system 1 according to an embodiment. The ultrasound diagnostic imaging system 1 receives a reflected wave of an ultrasound wave transmitted by an ultrasound probe 10 and reflected by a subject, detects a waveform of the reflected wave, and displays an image for diagnosing the subject based on the detected waveform. The ultrasound diagnostic imaging system 1 includes, for example, the ultrasound probe 10, an input interface 20, an ultrasound diagnostic imaging device 100, and a display device 200.

[0011] The ultrasonic probe 10 is used, for example, when performing ultrasonic diagnosis on a subject. The ultrasonic probe 10 transmits ultrasonic waves to the subject based on, for example, a drive signal output by the ultrasonic imaging diagnostic device 100. The ultrasonic probe 10 receives reflected waves of the transmitted ultrasonic waves on an acoustic emission surface. The ultrasonic probe 10 generates reflected wave information (reflection intensity data) based on the reflected waves of the received ultrasonic waves and transmits the information to the ultrasonic imaging diagnostic device 100.

[0012] The input interface 20 accepts various input operations by an operator (hereinafter referred to as "user"), and outputs an electrical signal indicating the content of the accepted input operation to the ultrasound imaging diagnostic apparatus 100. For example, the input interface 20 accepts switching information for switching the rendering image displayed on the display device 200 between a first rendering image and a second rendering image.

[0013] The input interface 20 is realized by, for example, a mouse, a keyboard, a touch panel combined with a display device, a trackball (drag ball), a switch, a button, a joystick, a camera, an infrared sensor, a microphone, etc. The input interface 20 may be realized by a display device (for example, a tablet terminal) capable of wireless communication with the ultrasound diagnostic imaging apparatus 100.

[0014] In this specification, the input interface 20 is not limited to an interface having physical operation parts such as a mouse, a keyboard, etc. For example, an example of the input interface also includes an electrical signal processing circuit that receives an electrical signal corresponding to an input operation from an external input device provided separately from the device and outputs the electrical signal to a control circuit.

[0015] The ultrasound diagnostic imaging device 100 includes, for example, a transmission / reception circuit 110, a processing circuit 120, and a memory 150. The transmission / reception circuit 110 includes, for example, a drive circuit that vibrates a transducer of the ultrasound probe 10. The transmission / reception circuit 110 outputs a drive signal according to the transmission / reception conditions transmitted by the processing circuit 120 to the ultrasound probe 10. The transmission / reception circuit 110 acquires reflected wave information output by the ultrasound probe 10. The transmission / reception circuit 110 converts the acquired reflected wave information into a digital signal.

[0016] The processing circuit 120 includes, for example, an acquisition function 122, a first generation function 124, a setting function 126, a second generation function 128, a designation function 130, a concealment function 132, a third generation function 134, a composition function 136, and a provision function 138. Of these, the concealment function 132 includes the third generation function 134 and the composition function 136. The processing circuit 120 realizes these functions by, for example, a hardware processor executing a program stored in a memory (storage circuit) 150. The hardware processor refers to a circuit such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an Application Specific Integrated Circuit (ASIC), a programmable logic device (e.g., a Simple Programmable Logic Device (SPLD) or a Complex Programmable Logic Device (CPLD), or a Field Programmable Gate Array (FPGA) (hereinafter the same). Instead of storing a program in memory 150, the program may be directly embedded in the circuit of the hardware processor. In this case, the hardware processor realizes a function by reading and executing the program embedded in the circuit. The hardware processor is not limited to being configured as a single circuit, and may be configured as one hardware processor by combining multiple independent circuits to realize each function. Also, multiple components may be integrated into one hardware processor to realize each function.

[0017] The memory 150 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory), a flash memory, a hard disk, an optical disk, etc. The memory 150 stores a color map 152 and a light characteristic setting map 154 ​​used when generating a rendering image obtained by two-dimensionally converting a 3D image (model image).

[0018] The color map 152 stored in the memory 150 is a color map determined by a user from among a plurality of color maps. The color map 152 includes a plurality of colors for determining colors when generating a rendering image from a 3D image. The light characteristic setting map 154 ​​includes a plurality of colors (darkness) for determining colors (darkness) of shadows when generating a rendering image from a 3D image.

[0019] The color map 152 and the light characteristic setting map 154 ​​stored in the memory 150 may be stored in an external memory with which the ultrasound diagnostic imaging apparatus 100 can communicate, instead of the memory 150 (or in addition to the memory 150). The external memory is controlled by a cloud server that manages the external memory, for example, by the cloud server accepting a read / write request. The memory 150 is an example of a storage unit. The color map 152 and the light characteristic setting map 154 ​​are an example of a generation condition.

[0020] The acquisition function 122 acquires reflected wave information transmitted by the ultrasound probe 10. The acquisition function 122 acquires various information according to a user's input operation on the input interface 20. The acquisition function 122 outputs the acquired various information to an appropriate output destination. For example, the acquisition function 122 outputs the acquired reflected wave information to the first generating function 124. For example, the acquisition function 122 outputs the designated data output by the input interface 20 to the setting function 126. The acquisition function 122 is an example of an acquisition unit.

[0021] The first generating function 124 generates 3D digital data of the subject based on the reflected waves of the ultrasound received by the ultrasound probe 10. The first generating function 124 outputs the generated 3D digital data to the second generating function 128. The reflected waves of the ultrasound transmitted by the ultrasound probe 10 are an example of an image generating element. The first generating function 124 is an example of a first generating section.

[0022] The setting function 126 switches and sets the rendering mode of the ultrasound diagnostic imaging device 100. The ultrasound diagnostic imaging device 100 has a first rendering mode and a second rendering mode. The first rendering mode is a mode in which a rendering image is generated using surface rendering. The second rendering mode is a mode in which a light source is arranged like global illumination and a rendering image is generated using characteristics such as light attenuation.

[0023] The setting function 126 sets a color map to be used when generating a 3D image (3D digital data) for the first rendering mode. For example, the setting function 126 determines a color map 152 from among a plurality of color maps in response to a user's operation of the input interface 20, and stores the color map in the memory 150. For the second rendering mode, the setting function 126 sets a color map similar to that for the first rendering mode.

[0024] The second generation function 128 two-dimensionalizes the 3D digital data generated by the first generation function 124 through rendering processing according to the rendering mode to generate a rendered image. The second generation function 128 renders the 3D digital data in the first rendering mode to generate a first rendered image. The second generation function 128 renders the 3D digital data in the second rendering mode to generate a second rendered image.

[0025] When the rendering mode is the first rendering mode, the second generating function 128 generates a first rendering image by surface rendering using a color map 152 stored in the memory 150. The color used in the surface rendering is, for example, designated in advance by the user.

[0026] When the rendering mode is the second rendering mode, the second generating function 128 uses the light characteristic setting map 154 ​​stored in the memory 150 to arrange light sources like global illumination and generate a second rendering image by utilizing characteristics such as light attenuation. The second generating function 128 outputs the generated rendering image to the combining function 136 and the providing function 138. The second generating function 128 is an example of a second generating unit.

[0027] The designation function 130 designates a concealment area to be concealed in the rendering image based on an instruction input from outside the processing circuit 120, for example, from the input interface 20. When the designation function 130 designates the concealment area, the provision function 138 causes the display device 200 to display the rendering image generated by the second generation function 128. The provision function 138 causes the display device 200 to display, for example, a preset image for designating the concealment area together with the rendering image.

[0028] The preset images are simple shapes, such as a circle, a triangle, a rectangle (square, rectangle), an oval, etc. The providing function 138 displays, for example, a rectangular image as a preset image. The providing function 138 may display sample images of a plurality of preset images, such as a circle, a triangle, a rectangle, etc., on the display device 200 and allow the user to select one. The preset images may be displayed, for example, at the edge of the display area on the display device 200, or may be specified or changed by the user by a preset or the like.

[0029] The user operates the input interface 20, for example, a trackball, to enlarge or reduce or change the position of the preset image displayed on the display device 200, to specify a concealment area for concealing a part of the rendering image. The input interface 20 transmits specification information regarding the identified concealment area to the specification function 130. The specification function 130 specifies the concealment area based on the specification information transmitted by the input interface 20. The specification function 130 outputs the specified concealment area to the third generation function 134. The specification function 130 is an example of a specification unit.

[0030] The concealment function 132 sets a concealment area in the rendering image by using the third generation function 134 and the composition function 136, and generates a concealment image to be placed in the concealment area. For example, the concealment function 132 adjusts the color and darkness of the concealment area designated by the designation function 130 according to the rendering mode set by the setting function 126, and generates a concealment image (2D object) to be placed in the concealment area. The concealment function 132 composes the generated concealment image with the rendering image to conceal the concealment area. The concealment function 132 is an example of a concealment section.

[0031] When generating a concealment image, the third generation function 134 specifies, for the first rendering image, a color for dark areas contained in the color map 152 stored in the memory 150. The third generation function 134 specifies, for example, a color determined by the second generation function 128 as the color for dark areas. The third generation function 134 specifies, for the second rendering image, a darkness contained in the light characteristic setting map 154 ​​stored in the memory 150. The color map 152 and the light characteristic setting map 154 ​​are conditions for generating a concealment image.

[0032] The third generation function 134 generates a concealed image in a set generation mode. The third generation function 134 is linked to the second generation function in order to specify a color or darkness, and specifies a color or darkness for generating a concealed image according to the setting of the second generation function 128. For example, the third generation function 134 generates a first concealed image in a mode in which the concealed area is colored using a specified color for dark areas for the first rendering mode (hereinafter referred to as the "first generation mode"). The third generation function 134 generates a second concealed image in a mode in which the concealed area is brightened or darkened with a specified darkness for the second rendering mode (hereinafter referred to as the "second generation mode").

[0033] The first generation mode and the second generation mode correspond to the first rendering mode and the second rendering mode, and when the rendering mode is switched, the generation mode is also switched at the same time. The third generation function 134 outputs the generated concealed image to the synthesis function 136. The third generation function 134 may be configured to enlarge, reduce, move, etc. the concealed image when generating the concealed image. The third generation function 134 is an example of a third generation unit.

[0034] The compositing function 136 moves the concealed image by, for example, a user operating a trackball, and places the concealed image generated by the third generation function 134 in the concealed area in the rendering image output by the second generation function 128. The compositing function 136 composes the rendering image and the concealed image to generate a composite image. The compositing function 136 composes the first rendering image and the first concealed image to generate a first composite image. The compositing function 136 composes the second rendering image and the second concealed image to generate a second composite image. The compositing function 136 is an example of a compositing unit.

[0035] The compositing function 136 overlays all of the overlays, such as text, on the rendering image and the concealment image and adds them to a composite image. The rendering image and the concealment image are combined to generate a composite image in which the concealment area in the rendering image is concealed by the concealment image. The compositing function 136 outputs the generated composite image to the providing function 138. The third generating function 134 and the compositing function 136 are examples of a concealment unit.

[0036] The providing function 138 performs display control of an image to be displayed on the display device 200. The providing function 138 causes the display device 200 to display a rendering image corresponding to the rendering mode. When the first rendering mode is set, the providing function 138 causes the display device 200 to display the first rendering image. When the second rendering mode is set, the providing function 138 causes the display device 200 to display the second rendering image.

[0037] When a switching signal is output by the input interface 20 while a rendering image or a composite image is being displayed on the display device 200, and the rendering mode is switched, the providing function 138 switches between the rendering image or the composite image to be displayed on the display device 200. The providing function 138 provides the composite image to the user, for example, by causing the display device 200 to display the composite image output by the compositing function 136. The providing function 138 is an example of a providing unit. The providing function 138 may provide the composite image by a function other than display on the display device 200.

[0038] The display device 200 displays an image according to the control of the provision function 138. The ultrasound image diagnostic device 100 is used for diagnosis by a doctor or the like, for example, by displaying an ultrasound image on the display device 200. The display device 200 is, for example, a liquid crystal display. The display device 200 may be anything that displays an image, and may be, for example, a projector or a touch panel integrated with the input interface 20.

[0039] Next, the processing of the ultrasound diagnostic imaging apparatus 100 will be described. In the ultrasound diagnostic imaging apparatus 100, as processing before performing ultrasound diagnosis, the setting function 126 sets a first rendering mode for displaying a first rendering image on the display device 200 and a second rendering mode for displaying a second rendering image on the display device 200. Furthermore, the setting function 126 sets color maps 152 to be used in the first rendering mode and the second rendering mode, respectively. These settings by the setting function 126 are performed, for example, when the ultrasound diagnostic imaging apparatus 100 is started up or when a rendering image is displayed on the display device 200 for the first time.

[0040] The ultrasound diagnostic imaging apparatus 100 switches the rendering mode when a user operates the input interface 20 and switching information is output by the input interface 20. The ultrasound diagnostic imaging apparatus 100 switches the rendering mode by executing an interrupt process every time switching information is output during startup. Therefore, the ultrasound diagnostic imaging apparatus 100 is capable of switching the rendering mode at any time while running.

[0041] Next, an example of the processing of the ultrasound imaging diagnostic device 100 during diagnosis will be described. Here, the processing from when a user such as a doctor applies the ultrasound probe 10 to a pregnant woman who is a patient to obtain an image of a fetus in the patient by the ultrasound imaging diagnostic device 100, to when a rendering image is generated and shown to the patient will be described. Fig. 2 is a flowchart showing an example of the processing of the ultrasound imaging diagnostic device 100.

[0042] For example, when a user holds the ultrasound probe 10 against a patient and initiates transmission from the input interface 20 to the ultrasound diagnostic imaging device 100, ultrasound is transmitted from the ultrasound probe 10. When this reflected wave is input to the ultrasound diagnostic imaging device 100 through the ultrasound probe 10, it is stored in data storage in the acquisition function 122 of the processing circuit 120 (step S101). Next, the first generation function 124 compiles the stored reflected wave information for each volume to generate 3D digital data (step S103).

[0043] Next, the second generation function 128 performs rendering processing on the 3D digital data generated by the first generation function 124 to generate a rendering image (step S105). The second generation function 128 generates both a first rendering image in the first rendering mode and a second rendering image in the second rendering mode.

[0044] The second generation function 128 may generate only a rendering image corresponding to the current rendering mode. In this case, the second generation function 128 may store the generated rendering image in the memory 150 so that the generated rendering image can be used even after the rendering mode is switched.

[0045] The first rendering image is generated, for example, by using the reflection intensity indicated by the reflected wave information and the color in the color map 152 stored in the memory 150. The second rendering image is generated, for example, by taking into account the light source position and light attenuation, by using the reflection intensity indicated by the reflected wave information and the light characteristic setting map 154 ​​stored in the memory 150. The providing function 138 causes the display device 200 to display a rendering image corresponding to the set rendering mode, for example, the first rendering image when the first rendering mode is set (step S107).

[0046] Next, the providing function 138 causes the display device 200 to display an image for prompting the user to select whether or not to designate a hidden region. The user can select whether or not to designate a hidden region by operating the input interface 20. The input interface 20 transmits result information of the result of the user's selection to the ultrasound imaging diagnostic device 100.

[0047] The designation function 130 in the ultrasound diagnostic imaging apparatus 100 determines whether or not the user has decided to designate a hidden region based on the result information transmitted by the input interface 20 (step S109). If it is determined that the user has not decided to designate a hidden region, the designation function 130 advances the process to step S117.

[0048] When the designation function 130 determines that the user has decided to designate a hidden area, the designation function 130 designates a hidden area according to the user's input operation (step S111). When the designation function 130 designates a hidden area, the provision function 138 causes the display device 200 to display an image that prompts the user to designate a hidden area.

[0049] The user operates the input interface 20 according to the procedure shown in the image displayed on the display device 200 to specify the hidden area. When specifying the hidden area, the providing function 138 causes, for example, a simple rectangular partition line to be displayed on the display device 200. After the default display, the size of the partition line and the area enclosed by the partition line can be adjusted, for example, by operating a trackball as the input interface 20 to move, enlarge, or reduce the size.

[0050] In the rendered image, for example, due to the movable range of the ultrasound probe 10, a part of the image of the fetus may be missing. Since the missing part may give a negative impression to the examinee and may be a part that the user does not want to show to the examinee, the user may specify this part as a hidden area, for example. The hidden area is moved by the user operating a trackball, for example. For this reason, the user may adjust the size of the partition line or the area enclosed by the partition line by operating the trackball as the input interface 20, and specify, for example, the area that the user does not want the examinee to see as the hidden area.

[0051] Next, the third generation function 134 generates a concealment image (step S113). When the current rendering mode is the first rendering mode, the third generation function 134 generates the concealment image in the first generation mode. Therefore, the third generation function 134 automatically specifies a color for a dark area included in the color map 152 stored in the memory 150 to generate the concealment image.

[0052] The third generation function 134, for example, reads out the color map 152 stored in the memory 150, automatically specifies the color of the dark parts of the color map 152, colors the concealed area, and draws it in a buffer to generate a concealed image. The concealed image may be a single color using a color specified for the edge of the concealed area, or may be generated by executing a process of gradating the color up to the set color toward the center of the concealed area.

[0053] When the current rendering mode is the second rendering mode, the third generation function 134 generates a concealment image in the second generation mode. For this purpose, the light characteristic setting map 154 ​​stored in the memory 150 is read out, and the concealment area is colored with a color corresponding to the color when the light is sufficiently attenuated, and a concealment image is generated with a darkness equivalent to that of a shadow area, for example. The edge of the shadow may be blurred. The color of the concealment area may be any color different from the color specified using the color map. The color of the shadow may also be any color different from the color specified using the color map.

[0054] Next, the composition function 136 generates a composite image by, for example, arranging the concealed image generated by the third generation function 134 in the concealed area in the rendering image generated by the second generation function 128 in accordance with the user's operation of the trackball and combining the rendering image and the concealed image (step S115). The composition function 136 generates a first composite image by, for example, combining the first rendering image and the first concealed image. The composition function 136 generates a second composite image by, for example, combining the second rendering image and the second concealed image.

[0055] Next, the providing function 138 causes the display device 200 to display the composite image generated by the combining function 136 (step S117). If the designation function 130 determines in step S109 that the user has decided not to designate a hidden region, the providing function 138 causes the display device 200 to display the rendering image generated in step S107 as a composite image.

[0056] When the rendering mode is switched, the providing function 138 switches the display of the image to be displayed on the display device 200. For example, in the first rendering mode, the providing function 138 causes the display device 200 to display a first composite image, a first rendering image, a first concealed image, etc. When the rendering mode is switched from the first rendering mode to the second rendering mode, the providing function 138 switches the image to be displayed on the display device 200 to a second composite image, a second rendering image, a second concealed image, etc. In this way, the ultrasound imaging diagnostic device 100 ends the process shown in FIG. 2.

[0057] Next, the rendering image and composite image that the providing function 138 displays on the display device 200 will be described. Fig. 3 is a diagram showing an example of a rendering image displayed on the display device 200. Fig. 4 is a diagram showing an example of a rendering image displayed on the display device 200. Fig. 5 is a diagram showing an example of a rendering image displayed on the display device 200. Fig. 6 is a diagram showing an example of a rendering image displayed on the display device 200. Below, the first composite image will be described using Figs. 3 and 4, and the second composite image will be described using Figs. 5 and 6.

[0058] First, the first composite image will be described. In the first rendering image R1 shown in FIG. 3, the fetus's face is shown. In the first rendering image R1, the shape of the fetus's face is roughly shown. However, the image in the area that becomes the first concealed area X1 at the lower left end of the first rendering image R1 is partially missing due to reasons such as the ultrasonic waves output by the ultrasonic probe 10 not reaching there. The first concealed area X1 is, for example, a vertically long ellipse.

[0059] When the user operates the input interface 20 to specify the first hidden area X1, the specification function 130 specifies the first hidden area X1. Next, the third generation function 134 generates a first hidden image H1 that hides the first hidden area X1, as shown in FIG. 4. When generating the first hidden image H1, the third generation function 134 uses, for example, a color map that is stored in the memory 150 and includes the colors used when generating the first rendering image R1. The first hidden image H1 is an image generated to place simple shapes such as a circle or a square only in the first hidden area X1, which is the part to be hidden.

[0060] For example, when pink is used as the first rendering image R1, the third generating function 134 generates the first concealed image H1 using pink. The third generating function 134 automatically specifies the color of the dark part of the color map 152 and colors the concealed area. Therefore, the first concealed image H1 blends naturally with the first rendering image and does not interfere with the recognition of the image of the subject in the first rendering image R1. The color used by the third generating function 134 is linked to the color used by the second generating function 128, for example. Therefore, the user does not need to specify the color when generating the concealed image. The third generating function 134 may generate the first concealed image H1 by, for example, applying a gradation process that makes the vicinity of the outer periphery dark and gradually lightens toward the inside. The combining function 136 combines the first rendering image R1 and the first concealed image H1 to generate the first combined image S1 shown in FIG. 4.

[0061] In the first concealed region X1 of the first composite image S1, an image that was missing in the first rendering image R1 is displayed, but in the first composite image S1, a first concealed image H1 with a color close to the surrounding color is displayed. Therefore, the part that is missing and does not want to be shown is concealed, and the first concealed image H1 looks naturally blended with the surrounding image of the first concealed region X1, so that it is possible to make it difficult to interfere with the recognition of the examinee who sees the first composite image S1.

[0062] Next, the second composite image will be described. In the second rendering image R2 shown in FIG. 5, the fetus's face is shown in the same manner as in the first rendering image R1. In the second rendering image R2, the shape of the fetus's face is roughly shown, but a part of the image in the area that becomes the second concealed area X2 at the upper left end is missing. The second concealed area X2 is, for example, a vertically long rectangle with the edges chamfered.

[0063] As shown in the first rendering image R1 and the second rendering image R2, the missing portion often occurs at the edge of the rendering image. For this reason, the hidden area is often specified as the edge of the rendering image, and for example, when a template is prepared in advance for the shape of the hidden area, it is preferable to use a shape that is easy to place at the edge, such as a rectangle (including a shape with chamfered corners) or an ellipse.

[0064] When the user operates the input interface 20 to specify the second hidden area X2, the specification function 130 specifies the second hidden area X2. Next, the third generation function 134 generates a second hidden image H2 that hides the second hidden area X2, as shown in FIG. 6. When generating the second hidden image H2, the third generation function 134 uses, for example, the light characteristic setting map 154 ​​stored in the memory 150 and used when generating the second rendering image R2. The second hidden image H2 is an image generated to hide the second hidden area X2 by, for example, darkening a specified range by a simple shape to make it a shadow.

[0065] The third generating function 134 generates the second concealed image H2 according to, for example, the light characteristic setting map 154 ​​stored in the memory 150. The third generating function 134 generates the second concealed image H2 so that, for example, while darkening the inside of the second composite image S2, the color of the shadow part is automatically specified by coloring the vicinity of the part where the subject is projected, so that the image naturally blends in as a shadow with the image. The composition function 136 composes the second rendering image R2 and the second concealed image H2 to generate the second composite image S2 shown in FIG. 6.

[0066] In the second concealed region X2 of the second composite image S2, an image that was missing in the first rendering image R1 is displayed, but in the second composite image S2, the second concealed image H2 is displayed in a form that is unlikely to cause discomfort in relation to the surroundings. Therefore, the part that is missing and that is not desired to be shown is concealed, and the second concealed image H2 looks naturally blended with the surrounding images of the second concealed region X2, so that it is unlikely to interfere with the recognition of the examinee who sees the second composite image S2.

[0067] In the ultrasound diagnostic imaging device 100 of the embodiment, for example, a composite image in which an image of a part that is not desired to be shown to the examinee is concealed with a concealment image is shown to the examinee for diagnosis, so that the discomfort felt by the examinee can be reduced. In addition, the concealment image is generated with a color and darkness that matches the composite image, so that the unnatural feeling caused by using the concealment image can be reduced. In the ultrasound diagnostic imaging device 100 of the embodiment, the concealment image is generated not for a 3D image but for a rendering image that is a two-dimensionalized 3D image, and the rendering image and the concealment image are composited. Therefore, the concealment image can be generated with simple processing compared to processing for a 3D image, so that the part of the rendering image that is not desired to be shown can be concealed with simple processing.

[0068] In the above embodiment, the rendering image and the composite image are generated in the ultrasound diagnostic imaging apparatus 100, but the rendering image and the composite image may be generated by a medical imaging diagnostic apparatus other than the ultrasound diagnostic imaging apparatus 100. The medical imaging diagnostic apparatus that generates the rendering image and the composite image may be, for example, a modality such as a radiation diagnostic imaging apparatus, an MRI diagnostic imaging apparatus, or an X-ray CT diagnostic imaging apparatus. Furthermore, instead of the medical diagnostic imaging apparatus, a medical image processing apparatus may be used. The medical image processing apparatus may be, for example, an in-hospital console, a cloud console, a workstation, or various modalities (medical equipment).

[0069] In the above embodiment, the 3D image is generated based on reflected wave information corresponding to the reflected wave of the ultrasound, but in a medical image diagnostic device or a medical image processing device, the 3D image may be an image generated based on information corresponding to the characteristics of various devices. For example, in a radiation image diagnostic device, the 3D image may be a 3D image obtained by converting a radiation image into a 3D image. The 3D image includes a 4D image in which the 3D images are successively arranged on the time axis.

[0070] In the ultrasound imaging diagnostic device 100 of the above embodiment, for example, when the rendering image is rotated or the light source position of the rendering image is changed after the composite image is generated, the concealed image may be erased (reset) and the composite image may be generated again (regenerated), or the color specified in the first rendering mode may be preset. When the rendering image is rotated or the light source position of the rendering image is changed, the concealed area often moves, and it is often necessary to generate the concealed image (composite image). Therefore, when the rendering image is rotated or the light source position of the rendering image is changed, the concealed image area and even the area before the composite image are generated can be reduced by erasing the concealed image each time.

[0071] When erasing the concealed image, if the above erasure condition is satisfied, an image for allowing the user to select whether or not to erase the concealed image may be displayed on the display device 200, and whether or not to erase the concealed image may be determined by the user's instruction. When the rotation of the rendering image or the movement of the light source position is slight, the concealed area may hardly move. In this case, regenerating the concealed image may be a waste, so in order to suppress regeneration when regeneration of the concealed image is unnecessary, the user may be allowed to select whether or not to regenerate the concealed image. Alternatively, threshold values ​​may be set for the amount of rotation of the rendering or the amount of movement of the light source position, and the concealed image may be erased when these threshold values ​​are exceeded.

[0072] In the above embodiment, one concealment image is generated for one rendering image and then composited, but two or more concealment images may be generated for one rendering image and then composited. Also, previously generated concealment images may be stored and used as preset images when generating concealment images for other rendering images.

[0073] In the above embodiment, when the rendering mode is switched, the generation mode in the third generation function 134 and the image displayed by the provision function 138 are switched in tandem; however, the generation mode and some or all of the images to be displayed may not be switched even when the rendering mode is switched.

[0074] According to at least one of the embodiments described above, by having an acquisition unit that acquires image generation elements generated by a medical device, a first generation unit that generates a 3D image based on the image generation elements, a second generation unit that performs a rendering process on the 3D image to generate a rendered image, a concealment unit that conceals a hidden area in the rendered image, and a provision unit that provides the rendered image in which the hidden area is concealed, it is possible to hide parts of the rendered image that one does not want to show with simple processing.

[0075] Although some embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents as described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]

[0076] 1. Ultrasound imaging system 10…Ultrasonic probe 20...Input interface 100...Ultrasound imaging diagnostic device 110...Transmitting and receiving circuit 120...Processing circuit 122…Acquisition function 124…1st generation function 126…Settings function 128…Second generation function 130...Designated function 132…Concealment function 134…Third generation function 136…Composition function 138…Provided functions 150…Memory 152...Color map 154…Light characteristic setting map 200...Display device H1…First concealed image H2…Second concealed image R1: First rendering image R2: Second rendering image S1: First composite image S2: Second composite image X1: First concealment area X2: Second concealment area

Claims

1. An acquisition unit that acquires image generation elements generated by a medical device; A first generation unit that generates a three-dimensional image based on the acquired image generation elements; a second generation unit that generates a rendering image by performing a rendering process on the generated three-dimensional image; a concealment unit that sets a concealment area in the rendering image; a providing unit that provides the rendering image in which the hidden area is set; and a designation unit that designates the hidden area based on an instruction input from outside. Medical imaging diagnostic equipment.

2. An acquisition unit that acquires image generation elements generated by a medical device; A first generation unit that generates a three-dimensional image based on the acquired image generation elements; a second generation unit that generates a rendering image by performing a rendering process on the generated three-dimensional image; a concealment unit that sets a concealment area in the rendering image; a providing unit that provides the rendering image in which the hidden area is set, the concealment unit uses a color map used in generating the rendering image to specify a color of the concealment area and generates a concealment image to be displayed in the concealment area. Medical imaging diagnostic equipment.

3. An acquisition unit that acquires image generation elements generated by a medical device; A first generation unit that generates a three-dimensional image based on the acquired image generation elements; a second generation unit that generates a rendering image by performing a rendering process on the generated three-dimensional image; a concealment unit that sets a concealment area in the rendering image; a providing unit that provides the rendering image in which the hidden area is set, The concealment unit adjusts the darkness of the concealment area by using a light characteristic setting map used when generating the rendering image, and generates a concealment image to be displayed in the concealment area. Medical imaging diagnostic equipment.

4. An acquisition unit that acquires image generation elements generated by a medical device; A first generation unit that generates a three-dimensional image based on the acquired image generation elements; a second generation unit that generates a rendering image by performing a rendering process on the generated three-dimensional image; a concealment unit that sets a concealment area in the rendering image; a providing unit that provides the rendering image in which the hidden area is set; A storage unit that stores a generation condition for the concealment unit to generate a concealment image that conceals the concealment area. Medical imaging diagnostic equipment.

5. The concealment unit includes a third generation unit that generates a concealment image to be placed in the concealment unit; a synthesis unit that arranges the third generation unit in the concealment unit and synthesizes the rendering image and the concealment image, The medical image diagnostic apparatus according to claim 1 .

6. An acquisition unit that acquires image generating elements generated by a medical device; A first generation unit that generates a three-dimensional image based on the acquired image generation elements; a second generation unit that generates a rendering image by performing a rendering process on the generated three-dimensional image; a concealment unit that sets a concealment area in the rendering image; and a designation unit that designates the hidden area based on an instruction input from outside. Medical imaging equipment.

7. On the computer, acquiring an imaging element generated by a medical device; generating a three-dimensional image based on the acquired image generating elements; A rendering process is performed on the generated three-dimensional image to generate a rendered image; and a hidden area is set in the rendered image. providing the rendering image in which the occlusion region is set; The concealment area is designated based on an externally input instruction. program.

Images