Ultrasonic diagnostic apparatus, image processing apparatus and image processing program

Abstract

To increase variations in shading in a rendering image using three-dimensional Doppler data.SOLUTION: An ultrasonic diagnostic apparatus according to an embodiment comprises an acquisition unit, a gradient calculation unit, and a rendering unit. The acquisition unit acquires three-dimensional Doppler data for an observation target. The gradient calculation unit calculates a gradient of a surface of the observation target using a first element included in the Doppler data. The rendering unit generates a first rendering image of the observation target on the basis of a second element included in the Doppler data different from the first element, and generates a second rendering image in consideration of shading on the basis of the gradient and the first rendering image.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The embodiments disclosed in this specification and the drawings relate to an ultrasonic diagnostic apparatus, an image processing apparatus, and an image processing program.

Background Art

[0002] Conventionally, in an ultrasonic diagnostic apparatus, a technique for displaying blood flow in a 3D (or 4D) color Doppler mode is known. Generally, the expected value for a 3D (three-dimensional) blood flow image is considered to be higher for grasping the outer shape of a blood vessel than for grasping detailed velocity information of the blood flow. This is because a three-dimensional blood flow image can represent depth and thus it is easy to grasp the running direction of the blood flow.

[0003] For such a three-dimensional blood flow image (rendering image), a shading effect may be imparted. In a rendering image considering shading, since the shape of the curved surface in a blood vessel is more emphasized, it becomes easier to grasp the outer shape of the blood vessel.

[0004] For the calculation of shading, for example, information on the gradient (or normal) of the blood vessel surface is used. The gradient of the blood vessel surface is calculated from the values of the data displayed in the Doppler mode. For example, in the velocity display in the Doppler mode, the gradient is calculated from the velocity values of the Doppler data. Also for example, in the power display in the Doppler mode, the gradient is calculated from the power values of the Doppler data.

[0005] Specifically, the calculation of the gradient can be obtained from the differences in the Doppler data of the six surrounding voxels centered on the voxel to be calculated (target voxel). In a space where there are no voxels, since the value of the Doppler data is zero, the magnitude of the gradient becomes large for a surface where there are no voxels adjacent to the target voxel. As a result, the shading reflects the outer shape of the blood vessel surface.

[0006] By the way, in the velocity image, a boundary may occur between the region representing the flow approaching the probe and the region representing the flow moving away from the probe. Since the velocity values of the voxels near this boundary are small, the magnitude of the gradient becomes large. As a result, the shading emphasizes the boundary portion.

[0007] However, near the boundary of the velocity image, the emphasis on the boundary portion does not necessarily represent the shape of the blood vessel surface. As described above, this boundary can change depending on the position of the probe. Therefore, in the velocity display in Doppler mode, there was a possibility that a shading effect emphasizing the shape could not be imparted.

[0008] Also, as described above, conventionally, the data displayed in Doppler mode (for example, velocity values and power values) and the data used for shading calculation were common. As a result, there were few variations in shading.

Prior Art Documents

Patent Documents

[0009]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0010] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to increase the variations in shading in the rendering image using three-dimensional Doppler data. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problems. The problems corresponding to the respective effects of the respective configurations shown in the embodiments described later can also be positioned as other problems.

Means for Solving the Problems

[0011] The ultrasonic diagnostic apparatus according to the embodiment includes an acquisition unit, a gradient calculation unit, and a rendering unit. The acquisition unit acquires three-dimensional Doppler data about an observation target. The gradient calculation unit calculates the gradient of the surface of the observation target using a first element included in the Doppler data. The rendering unit generates a first rendering image of the observation target based on a second element included in the Doppler data different from the first element, and generates a second rendering image considering shading based on the gradient and the first rendering image.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

MODE FOR CARRYING OUT THE INVENTION

[0013] Hereinafter, embodiments of the ultrasonic diagnostic apparatus will be described in detail with reference to the drawings.

[0014] (First Embodiment) FIG. 1 is a block diagram showing a configuration example of an ultrasonic diagnostic apparatus according to the first embodiment. The ultrasonic diagnostic apparatus 1 in FIG. 1 includes an apparatus main body 100 and an ultrasonic probe 101. The apparatus main body 100 is connected to an input device 102 and an output device 103. Further, the apparatus main body 100 is connected to an external device 104 via a network NW. The external device 104 is, for example, a server equipped with a PACS (Picture Archiving and Communication Systems).

[0015] The ultrasonic probe 101 performs an ultrasonic scan on a scan region in a living body P, which is a subject, according to the control by, for example, the apparatus main body 100. The ultrasonic probe 101 has, for example, a plurality of piezoelectric vibrators, an acoustic lens, a matching layer provided between the plurality of piezoelectric vibrators and the acoustic lens, and a backing material that prevents the propagation of ultrasonic waves backward with respect to the radiation direction from the plurality of piezoelectric vibrators. The ultrasonic probe 101 is, for example, a two-dimensional array probe in which a plurality of ultrasonic vibrators are arranged along a first element array direction (elevation direction) and a second element array direction (azimuth direction). The ultrasonic probe 101 is detachably connected to the apparatus main body 100. Buttons may be arranged on the ultrasonic probe 101 to be pressed during, for example, offset processing and an operation to freeze an ultrasonic image (freeze operation).

[0016] The plurality of piezoelectric vibrators generate ultrasonic waves based on a drive signal supplied from an ultrasonic transmission circuit 110, which will be described later, that the apparatus main body 100 has. Thereby, ultrasonic waves are transmitted from the ultrasonic probe 101 to the living body P. When ultrasonic waves are transmitted from the ultrasonic probe 101 to the living body P, the transmitted ultrasonic waves are successively reflected at the discontinuous surfaces of the acoustic impedance in the body tissues of the living body P and received by the plurality of piezoelectric vibrators as reflected wave signals. The amplitude of the received reflected wave signal depends on the difference in acoustic impedance at the discontinuous surface where the ultrasonic waves are reflected. Also, when the transmitted ultrasonic pulse is reflected at the surface of a moving blood flow or a heart wall, etc., the reflected wave signal undergoes a frequency shift depending on the velocity component in the ultrasonic transmission direction of the moving object due to the Doppler effect. The ultrasonic probe 101 receives the reflected wave signal from the living body P and converts it into an electrical signal.

[0017] FIG. 1 illustrates the connection relationship between one ultrasonic probe 101 and the apparatus main body 100. However, it is possible to connect a plurality of ultrasonic probes to the apparatus main body 100. Which one of the plurality of connected ultrasonic probes is used for the ultrasonic scan can be arbitrarily selected, for example, by a software button on a touch panel, which will be described later.

[0018] The apparatus main body 100 is a device that generates an ultrasonic image based on the reflected wave signal received by the ultrasonic probe 101. The apparatus main body 100 includes an ultrasonic transmission circuit 110, an ultrasonic reception circuit 120, an internal memory circuit 130, an image memory 140, an input interface 150, an output interface 160, a communication interface 170, and a processing circuit 180.

[0019] The ultrasonic transmission circuit 110 is a processor that supplies a drive signal to the ultrasonic probe 101. The ultrasonic transmission circuit 110 is realized by, for example, a trigger generation circuit, a delay circuit, and a pulsar circuit. The trigger generation circuit repeatedly generates rate pulses for forming transmitted ultrasonic waves at a predetermined rate frequency. The delay circuit gives the delay time for each of a plurality of piezoelectric vibrators necessary for focusing the ultrasonic waves generated from the ultrasonic probe into a beam shape and determining the transmission directivity to each rate pulse generated by the trigger generation circuit. The pulsar circuit applies a drive signal (drive pulse) to a plurality of ultrasonic vibrators provided in the ultrasonic probe 101 at a timing based on the rate pulse. By changing the delay time given to each rate pulse by the delay circuit, the transmission direction from the surfaces of the plurality of piezoelectric vibrators can be arbitrarily adjusted.

[0020] Also, the ultrasonic transmission circuit 110 can arbitrarily change the output intensity of the ultrasonic waves by the drive signal. In an ultrasonic diagnostic apparatus, by increasing the output intensity, the influence of the attenuation of the ultrasonic waves in the living body P can be reduced. The ultrasonic diagnostic apparatus can obtain a reflected wave signal with a large signal-to-noise ratio at the time of reception by reducing the influence of the attenuation of the ultrasonic waves.

[0021] Generally, when ultrasonic waves propagate through a living body P, the intensity of the vibration of the ultrasonic waves corresponding to the output intensity (which is also referred to as acoustic power) attenuates. The attenuation of acoustic power occurs due to absorption, scattering, reflection, etc. Also, the degree of decrease in acoustic power depends on the frequency of the ultrasonic waves and the distance in the radiation direction of the ultrasonic waves. For example, by increasing the frequency of the ultrasonic waves, the degree of attenuation increases. Also, the longer the distance in the radiation direction of the ultrasonic waves, the greater the degree of attenuation.

[0022] The ultrasonic receiving circuit 120 is a processor that performs various processes on the reflected wave signal received by the ultrasonic probe 101 and generates a received signal. The ultrasonic receiving circuit 120 generates a received signal based on the reflected wave signal of the ultrasonic waves acquired by the ultrasonic probe 101. Specifically, the ultrasonic receiving circuit 120 is realized by, for example, a preamplifier, an A / D converter, a demodulator, and a beamformer. The preamplifier amplifies the reflected wave signal received by the ultrasonic probe 101 for each channel and performs gain correction processing. The A / D converter converts the gain-corrected reflected wave signal into a digital signal. The demodulator demodulates the digital signal. The beamformer, for example, gives a delay time necessary to determine the reception directivity to the demodulated digital signal and adds a plurality of digital signals given the delay time. By the addition process of the beamformer, a received signal in which the reflection component from the direction corresponding to the reception directivity is emphasized is generated. Hereinafter, the "reflected wave signal of the ultrasonic waves" and the "received signal" are collectively referred to as the "echo signal". Therefore, the "intensity of the received signal" may be rephrased as the "reflection intensity of the echo signal (echo reflection intensity)".

[0023] The internal memory circuit 130 has a storage medium readable by a processor, such as a magnetic storage medium, an optical storage medium, or a semiconductor memory, etc. The internal memory circuit 130 stores a program for realizing ultrasonic transmission and reception, a program related to the rendering image generation process described later, and various data. The program and various data may be stored in the internal memory circuit 130 in advance, for example. Also, the program and various data may be stored in a non-transitory storage medium, distributed, read from the non-transitory storage medium, and installed in the internal memory circuit 130, for example.

[0024] Also, the internal memory circuit 130 stores B-mode image data, contrast image data, image data related to blood flow video, and three-dimensional data generated by the processing circuit 180 according to an operation input via the input interface 150. The internal memory circuit 130 can also transfer the stored image data and three-dimensional data to an external device 104 or the like via the communication interface 170.

[0025] Note that the internal memory circuit 130 may be a driving device that reads and writes various information to and from a portable storage medium such as a CD drive, a DVD drive, and a flash memory. The internal memory circuit 130 can write the stored data to a portable storage medium and store the data in the external device 104 via the portable storage medium.

[0026] The image memory 140 has a storage medium readable by a processor, such as a magnetic storage medium, an optical storage medium, or a semiconductor memory, etc. The image memory 140 stores image data corresponding to a plurality of frames immediately before a freeze operation input via the input interface 150. The image data stored in the image memory 140 is continuously displayed (cine display), for example. Note that the image memory 140 may store three-dimensional data as well as storing image data.

[0027] The above internal memory circuit 130 and image memory 140 do not necessarily have to be realized by independent storage devices respectively. The internal memory circuit 130 and image memory 140 may be realized by a single storage device. Also, the internal memory circuit 130 and image memory 140 may each be realized by a plurality of storage devices.

[0028] The input interface 150 receives various instructions from the operator via the input device 102. The input device 102 is, for example, a mouse, keyboard, panel switch, slider switch, trackball, rotary encoder, operation panel, and touch panel. The input interface 150 is connected to the processing circuit 180 via, for example, a bus, converts the operation instructions input from the operator into electrical signals, and outputs the electrical signals to the processing circuit 180. Note that the input interface 150 is not limited to only connecting to physical operation components such as a mouse and keyboard. For example, a circuit that receives an electrical signal corresponding to an operation instruction input from an external input device provided separately from the ultrasonic diagnostic apparatus 1 and outputs this electrical signal to the processing circuit 180 is also included in the examples of the input interface.

[0029] The output interface 160 is, for example, an interface for outputting electrical signals from the processing circuit 180 to the output device 103. The output device 103 is any display such as a liquid crystal display, organic EL display, LED display, plasma display, or CRT display. The output device 103 may be a touch panel type display that also serves as the input device 102. The output device 103 may further include a speaker for outputting sound in addition to the display. The output interface 160 is connected to the processing circuit 180 via, for example, a bus, and outputs the electrical signals from the processing circuit 180 to the output device 103.

[0030] The communication interface 170 is connected to the external device 104 via, for example, the network NW and performs data communication with the external device 104.

[0031] The processing circuit 180 is, for example, a processor that functions as the center of the ultrasonic diagnostic apparatus 1. By executing the program stored in the internal storage circuit 130, the processing circuit 180 realizes the functions corresponding to the program. The processing circuit 180 has, for example, a B-mode processing function 181, a Doppler processing function 182, an image generation function 183, a three-dimensional data generation function 184 that functions as a three-dimensional data generation unit, an acquisition function 185A that functions as an acquisition unit, a gradient calculation function 185B that functions as a gradient calculation unit, a layer generation function 185C that functions as a layer generation unit, a rendering function 185D that functions as a rendering unit, a display control function 186 that functions as a display control unit, and a system control function 187.

[0032] The B-mode processing function 181 is a function of generating B-mode data based on the reception signal (echo signal) received from the ultrasonic reception circuit 120. By the B-mode processing function 181, the processing circuit 180 performs, for example, envelope detection processing and logarithmic compression processing on the reception signal received from the ultrasonic reception circuit 120, and generates data (B-mode data) in which the signal intensity (echo reflection intensity) of the reception signal is expressed as a luminance value (luminance value). The generated B-mode data is stored in a RAW data memory (not shown) as B-mode RAW data on a two-dimensional ultrasonic scanning line (raster).

[0033] Further, the processing circuit 180 can execute harmonic imaging by the B-mode processing function 181. Harmonic imaging is an imaging method that uses not only the fundamental wave component but also the harmonic component (harmonic component) included in the reflected wave signal of the ultrasonic wave. Harmonic imaging includes, for example, tissue harmonic imaging (THI) that does not use a contrast agent and contrast harmonic imaging (CHI) that uses a contrast agent.

[0034] In THI, harmonic components can be extracted using video methods called amplitude modulation (AM) method, phase modulation (PM) method, and AMPM method which combines AM method and PM method.

[0035] In the AM method, PM method, and AMPM method, ultrasonic transmissions with different amplitudes and phases are performed multiple times for the same scan line. As a result, the ultrasonic reception circuit 120 generates a plurality of reflected wave data for each scan line and outputs the generated reflected wave data. The processing circuit 180 extracts harmonic components by performing addition and subtraction processing according to the modulation method on the plurality of reflected wave data of each scan line by the B-mode processing function 181. Then, the processing circuit 180 performs envelope detection processing etc. on the reflected wave data of the harmonic components to generate B-mode data.

[0036] Also, in CHI, for example, harmonic components are extracted using a frequency filter. The processing circuit 180 can separate the reflected wave data (harmonic components) with the contrast agent as the reflection source and the reflected wave data (fundamental wave components) with the tissue in the living body P as the reflection source by the B-mode processing function 181. As a result, the processing circuit 180 can select the harmonic components from the contrast agent using a filter and generate B-mode data for generating contrast image data.

[0037] The B-mode data for generating contrast image data is data representing the echo reflection intensity with the contrast agent as the reflection source by luminance values. Also, the processing circuit 180 can extract the fundamental wave components from the reflected wave data of the living body P and generate B-mode data for generating tissue image data.

[0038] The Doppler processing function 182 is a function that generates data (Doppler information) by performing frequency analysis on the received signal received from the ultrasonic receiving circuit 120 and extracting motion information based on the Doppler effect of a moving object within the ROI (Region Of Interest) set in the scan region. The motion information of the moving object includes, for example, a velocity element, a dispersion element that indexes the variation in velocity, and a power element obtained by differentiating the velocity. The generated Doppler information is stored in a RAW data memory (not shown) as Doppler RAW data (also referred to as Doppler data) on a two-dimensional ultrasonic scan line.

[0039] Specifically, the processing circuit 180 estimates, for each of a plurality of sample points, a velocity value of the moving object, a dispersion value of the moving object velocity, and a power value of the moving object signal as motion information of the moving object by the Doppler processing function 182, and generates Doppler data indicating the estimated motion information. The moving object is, for example, a tissue such as blood flow or a heart wall, and a contrast agent. The processing circuit 180 according to the present embodiment estimates, for each of a plurality of sample points, a velocity value of the blood flow, a dispersion value of the blood flow velocity, and a power value of the blood flow signal as motion information (blood flow information) of the blood flow by the Doppler processing function 182, and generates Doppler data indicating the estimated blood flow information. In other words, the Doppler data includes velocity data having a velocity value, dispersion data having a dispersion value, and power data having a power value.

[0040] The image generation function 183 is a function that generates B-mode image data based on the data generated by the B-mode processing function 181. For example, by the image generation function 183, the processing circuit 180 converts the scan line signal sequence of the ultrasonic scan (scan convert) into a scan line signal sequence in a video format represented by a television or the like, and generates image data for display (display image data). Specifically, the processing circuit 180 performs RAW-pixel conversion on the B-mode RAW data stored in the RAW data memory, for example, coordinate conversion according to the scanning form of the ultrasonic wave by the ultrasonic probe 101, to generate two-dimensional B-mode image data (also referred to as ultrasonic image data) composed of pixels. In other words, the processing circuit 180 generates a plurality of ultrasonic images (medical images) corresponding to a plurality of consecutive frames respectively by transmitting and receiving ultrasonic waves by the image generation function 183.

[0041] Also, the processing circuit 180 generates Doppler image data in which blood flow information is visualized, for example, by performing RAW-pixel conversion on the Doppler RAW data stored in the RAW data memory. The Doppler image data is velocity image data, dispersion image data, power image data, or image data combining these. The processing circuit 180 generates, as Doppler image data, color Doppler image data in which blood flow information is displayed in color, and Doppler image data in which one blood flow information is displayed in a waveform in grayscale.

[0042] The three-dimensional data generation function 184 is a function that generates three-dimensional B-mode data (three-dimensional data) based on the received signal received from the ultrasonic reception circuit 120. The processing circuit 180 uses the B-mode data generated by the B-mode processing function 181 by the three-dimensional data generation function 184 to generate three-dimensional data by assigning luminance values to voxels arranged in a three-dimensional space. This three-dimensional data may be called volume data. Since the luminance value corresponds to the echo reflection intensity, it may be interpreted that the echo reflection intensity is assigned to the voxels of the volume data. Therefore, hereinafter, the "luminance value of the volume data" may be used in substantially the same meaning as the "echo reflection intensity".

[0043] Further, the processing circuit 180 according to the present embodiment may generate three-dimensional Doppler data (three-dimensional Doppler data) by assigning Doppler data to voxels arranged in a three-dimensional space by the three-dimensional data generation function 184.

[0044] The acquisition function 185A is a function of acquiring data related to the rendering image generation process described later. The data related to the rendering image generation process includes, for example, a two-dimensional ultrasonic image, three-dimensional data, and a simple rendering image obtained by performing an X-ray projection (full addition projection) on the three-dimensional data and the three-dimensional Doppler data in a predetermined ray direction and rendering them. Hereinafter, the two-dimensional ultrasonic image is simply referred to as an ultrasonic image. Also, when the ultrasonic image and the simple rendering image are not distinguished, they are referred to as two-dimensional images (2D images). The data related to the rendering image generation process includes, for example, three-dimensional data and three-dimensional Doppler data. In the present embodiment, the processing circuit 180 acquires three-dimensional Doppler data about the observation target by the acquisition function 185A. The observation target in the present embodiment is blood flowing in a blood vessel.

[0045] The gradient calculation function 185B is a function that calculates the gradient of the surface of the observation target using the elements (first elements) included in the three-dimensional Doppler data. By means of the gradient calculation function 185B, the processing circuit 180 calculates the gradient of the surface of the observation target using the first elements included in the three-dimensional Doppler data. When the observation target is the blood flowing in a blood vessel, the surface of the observation target substantially represents the blood vessel surface. Specifically, the processing circuit 180 may calculate the gradient of the blood vessel surface using the power value of the Doppler data. Further, the processing circuit 180 may calculate the gradient of the blood vessel surface using the variance value of the Doppler data. Further, the processing circuit 180 may calculate the gradient of the blood vessel surface using the velocity value of the Doppler data.

[0046] The calculation of the gradient is obtained from the values included in each of the six voxels located before and after, left and right, and above and below with respect to the voxel to be calculated (target voxel). Specifically, the processing circuit 180 calculates the gradient based on the difference in the values of the voxels before and after, the difference in the values of the voxels left and right, and the difference in the values of the voxels above and below with respect to the target voxel. The processing circuit 180 calculates the gradient using, for example, the following formula (1).

[0047]

Equation

[0048] In formula (1), f(x, y, z) represents the target voxel. At this time, the processing circuit 180 calculates the gradient with the value being zero for the space where the data does not exist. Therefore, when there is no voxel adjacent to the target voxel, that target voxel may correspond to the surface of the observation target. Note that the processing circuit 180 may specify in advance the voxels corresponding to the surface of the observation target, and calculate the gradient only for the specified voxels. Hereinafter, it is assumed that the processing circuit 180 calculates the gradient of the voxels corresponding to the surface of the observation target.

[0049] The layer generation function 185C is a function that generates a shading layer to apply shading to the rendering image using the gradient of the voxels corresponding to the surface of the observation target. The processing circuit 180 generates a shading layer by calculating shading using a known shading model according to the layer generation function 185C. Examples of known shading models include the Phong reflection model, Blinn-Phong shading model, and specular highlight shading model, which may also include diffuse specular shading. Note that the processing circuit 180 may calculate shading using a global illumination model involving light propagation.

[0050] The rendering function 185D is a function that generates a rendering image. The rendering image includes, for example, a volume rendering image and a global illumination image. In this embodiment, a rendering image that does not consider a light source is defined as a volume rendering image, and a rendering image that considers a light source is defined as a global illumination image.

[0051] The volume rendering image is obtained by volume-rendering volume data. In the volume rendering of this embodiment, the brightness and color of each voxel in the display are set according to the Doppler data assigned to the voxels of the volume data. Then, the volume rendering displays a projection image obtained by projecting voxels from an arbitrary viewpoint.

[0052] On the other hand, the global illumination image performs rendering processing using a photon map. For example, the ray tracing method is used for the rendering processing. In this embodiment, a global illumination image may be generated as the final rendering image actually displayed.

[0053] The processing circuit 180 generates a basic rendering image (first rendering image) of the observation target based on an element (second element) included in three-dimensional Doppler data that is different from the element (first element) used for gradient calculation by the rendering function 185D. It is assumed that this first rendering image does not consider shading. Then, the processing circuit 180 generates a second rendering image that takes shading into account based on the calculated gradient and the first rendering image.

[0054] Specifically, the processing circuit 180 generates a second rendering image based on the first rendering image and a shading layer generated from the calculated gradient. More specifically, the processing circuit 180 generates a second rendering image by superimposing the shading layer on the first rendering image.

[0055] Note that the processing circuit 180 may apply a predetermined filter to the first rendering image by the rendering function 185D. The predetermined filter is, for example, a non-linear diffusion filter.

[0056] The display control function 186 is a function that causes an image based on various ultrasonic image data generated by the image generation function 183 to be displayed on a display as the output device 103. Specifically, for example, the processing circuit 180 controls the display on the display of an image based on B-mode image data, Doppler image data, or image data including both of these generated by the image generation function 183 by the display control function 186.

[0057] More specifically, the processing circuit 180, by means of the display control function 186, converts (scan-converts), for example, the scan line signal sequence of ultrasonic scanning into a scan line signal sequence in a video format typified by a television or the like, and generates display image data. Further, the processing circuit 180 may perform various processes on the display image data, such as dynamic range, brightness, contrast, and γ curve correction, as well as RGB conversion. Further, the processing circuit 180 may add accessory information such as character information, scales, and body marks of various parameters to the display image data. Further, the processing circuit 180 may generate a user interface (GUI: Graphical User Interface) for an operator to input various instructions by means of an input device, and display the GUI on a display.

[0058] Further, the processing circuit 180 may display the rendering image generated by the rendering function 185D by means of the display control function 186. Incidentally, the processing circuit 180 may display a GUI related to the setting of the rendering image together with the rendering image. The setting of the rendering image includes, for example, the setting of parameters related to shading (shading parameters). The user can change the shading superimposed on the basic rendering image to a desired display in real time by changing the shading parameters displayed on the GUI. The shading parameters that can be changed by the user are, for example, a shading gain indicating the intensity of shading and a shading type indicating the type of shading. Incidentally, the shading gain and the shading type will be described later.

[0059] The system control function 187 is a function for comprehensively controlling the operation of the entire ultrasonic diagnostic apparatus 1. For example, by means of the system control function 187, the processing circuit 180 controls the ultrasonic transmission circuit 110 and the ultrasonic reception circuit 120 based on parameters related to the transmission and reception of ultrasonic waves.

[0060] The configuration of the ultrasonic diagnostic apparatus according to the first embodiment has been described above. Next, a rendering image without considering shading and a rendering image considering conventional shading will be described with reference to FIGS. 15 and 16.

[0061] FIG. 15 is a rendering image without considering shading. The rendering image 1500 in FIG. 15 shows a blood vessel as the observation target in a three-dimensional velocity image. That is, the rendering image 1500 is a basic rendering image generated using the velocity data included in the Doppler data.

[0062] The velocity image data of the present embodiment represents the direction of the flow coming toward the probe in red-based colors and the direction of the flow moving away from the ultrasonic probe in blue-based colors. In the rendering image 1500, the region 1510 with relatively dark color corresponds to the blue-based color, and the region 1520 with relatively light color corresponds to the red-based color. Also, it is assumed that in the region 1530, a part of the blue-based color region has an intrusion of the red-based color region. Since the shading layer is not superimposed on the rendering image 1500, when the user visually recognizes the rendering image 1500, the surface of the observation target appears to be flat.

[0063] FIG. 16 is a conventional view of a rendering image considering shading. The rendering image 1600 in FIG. 16 is obtained by superimposing a shading layer generated using the velocity data on the rendering image 1500 generated using the velocity data.

[0064] In the rendering image 1600, regions 1610, 1620, and 1630 correspond to regions 1510, 1520, and 1530 of the rendering image 1500. Shading (highlighting) along the shape of the observation target is applied to regions 1610 and 1620. However, shading along the boundary between the blue-colored region and the red-colored region can be seen in region 1630. Such a boundary in the velocity image is caused by the position of the ultrasonic probe and does not necessarily represent the surface shape of the observation target. For example, when shading is applied along the boundary, the user may visually recognize that there are undulations on the surface of the observation target.

[0065] Next, the rendering image generation process in the first embodiment will be described.

[0066] FIG. 2 is a flowchart showing an example of the operation of a processing circuit that executes the rendering image generation process in the first embodiment. The rendering image generation process in FIG. 2 is started, for example, when the user executes a mode for displaying a rendering image.

[0067] (Step ST110) When the rendering image generation process is started, the processing circuit 180 executes the acquisition function 185A. When the acquisition function 185A is executed, the processing circuit 180 acquires three-dimensional Doppler data and shading information. The shading information is information on the type of shading (shading type) selected by the user. The information on the shading type includes information on a first element included in the three-dimensional Doppler data used for gradient calculation and information on a second element for generating a basic rendering image different from the first element.

[0068] (Step ST120) After acquiring the three-dimensional Doppler data and shading information, the processing circuit 180 executes the gradient calculation function 185B. When executing the gradient calculation function 185B, the processing circuit 180 calculates a gradient using a first element included in the three-dimensional Doppler data. Specifically, the processing circuit 180 acquires the information of the first element based on the shading information, and uses this first element for the calculation of the gradient. Incidentally, the process of step ST120 may be referred to as gradient calculation processing.

[0069] (Step ST130) After calculating the gradient, the processing circuit 180 executes the layer generation function 185C. When executing the layer generation function 185C, the processing circuit 180 generates a shading layer using the calculated gradient. Incidentally, the process of step ST130 may be referred to as layer generation processing.

[0070] (Step ST140) After generating the shading layer, the processing circuit 180 executes the rendering function 185D. When executing the rendering function 185D, the processing circuit 180 generates a first rendering image without considering shading based on a second element included in the three-dimensional Doppler data.

[0071] (Step ST150) After generating the first rendering image, the processing circuit 180 generates a second rendering image considering shading based on the first rendering image and the shading layer by the rendering function 185D. After the process of step ST150, the rendering image generation process ends. Incidentally, the processes of step ST140 and step ST150 may be referred to as rendering processing.

[0072] Next, a first specific example of the rendering image generation process in the first embodiment will be described with reference to FIG. 3. In the first specific example in the first embodiment, the power value (power data) of the Doppler data is used as the first element, and the speed value (speed data) of the Doppler data is used as the second element.

[0073] FIG. 3 is a block diagram for explaining a first specific example of the rendering image generation process in the first embodiment. In FIG. 3, the processing circuit 180 executes a gradient calculation process (step ST120) and a layer generation process (step ST130) using the power data, and executes a rendering process (steps ST140 and ST150) using the shading layer based on the power data and the velocity data. A rendering image (second rendering image) considering the shading generated by this rendering process will be described with reference to FIG. 4.

[0074] FIG. 4 is an example of a rendering image considering shading in the first embodiment. The rendering image 400 in FIG. 4 is obtained by superimposing a shading layer generated using power data on a rendering image (for example, the rendering image 1500 in FIG. 15) generated using velocity data.

[0075] In the rendering image 400, regions 410, 420, and 430 correspond to regions 1510, 1520, and 1530 of the rendering image 1500. Shading (highlight) along the shape of the observation target is applied to all of the regions 410, 420, and 430. For example, when comparing the region 430 of the rendering image 400 with the region 1630 of the rendering image 1600, the shading corresponds to the elements for creating the shading layer superimposed on each of them.

[0076] Next, a second specific example of the rendering image generation process in the first embodiment will be described with reference to FIG. 5. In the second specific example in the first embodiment, the dispersion value (dispersion data) of the Doppler data is used as the first element, and the velocity value (velocity data) of the Doppler data is used as the second element.

[0077] FIG. 5 is a block diagram for explaining a second specific example of the rendering image generation process in the first embodiment. In FIG. 5, the processing circuit 180 executes a gradient calculation process (step ST120) and a layer generation process (step ST130) using distributed data, and executes a rendering process (steps ST140 and ST150) using a shading layer based on the distributed data and velocity data.

[0078] Next, a third specific example of the rendering image generation process in the first embodiment will be described with reference to FIG. 6. In the third specific example in the first embodiment, the velocity value (velocity data) of Doppler data is used as the first element, and the power value (power data) of Doppler data is used as the second element.

[0079] FIG. 6 is a block diagram for explaining a third specific example of the rendering image generation process in the first embodiment. In FIG. 6, the processing circuit 180 executes a gradient calculation process (step ST120) and a layer generation process (step ST130) using velocity data, and executes a rendering process (steps ST140 and ST150) using a shading layer based on the velocity data and power data.

[0080] Next, a fourth specific example of the rendering image generation process in the first embodiment will be described with reference to FIG. 7. In the fourth specific example in the first embodiment, the dispersion value (dispersion data) of Doppler data is used as the first element, and the power value (power data) of Doppler data is used as the second element.

[0081] FIG. 7 is a block diagram for explaining a fourth specific example of the rendering image generation process in the first embodiment. In FIG. 7, the processing circuit 180 executes a gradient calculation process (step ST120) and a layer generation process (step ST130) using dispersion data, and executes a rendering process (steps ST140 and ST150) using a shading layer based on the dispersion data and power data.

[0082] Next, the display image for setting the rendering image generation process will be described with reference to FIG. 8.

[0083] FIG. 8 is a diagram illustrating a display image for setting the rendering image generation process in the first embodiment. The display image 800 in FIG. 8 is displayed, for example, on the touch panel of the input device 102. On the display image 800, a software button 810 for setting the shading gain and a software button 820 for setting the shading type are displayed.

[0084] The setting of the shading gain is performed, for example, by the user selecting the intensity of the shading assigned to each numerical value displayed on the software button 810. The processing circuit 180 acquires the information on the intensity of the shading selected by the user and reflects it in the rendering image.

[0085] The setting of the shading type is performed, for example, by the user selecting the shading type assigned to each numerical value displayed on the software button 820. The shading type includes, for example, the conventional example in which the first element and the second element are speed data, speed + variance data, or power data, and the first to fourth specific examples in which the first element and the second element are different data from each other. The processing circuit 180 acquires the information on the type of shading (shading information) selected by the user and uses the acquired shading information to create a shading layer. Note that the processing circuit 180 may create a shading layer each time it acquires the shading information.

[0086] As described above, the ultrasonic diagnostic apparatus according to the first embodiment acquires three-dimensional Doppler data regarding an observation target, calculates the gradient of the surface of the observation target using a first element included in the Doppler data, generates a first rendering image of the observation target based on a second element included in Doppler data different from the first element, and generates a second rendering image considering shading based on the gradient and the first rendering image.

[0087] Therefore, since the ultrasonic diagnostic apparatus according to the first embodiment can generate a basic rendering image and shading from different elements included in the Doppler data, it is possible to increase the variations in shading in the rendering image using three-dimensional Doppler data.

[0088] (Second Embodiment) The ultrasonic diagnostic apparatus according to the first embodiment generated a shading layer using one element included in the Doppler data. On the other hand, the ultrasonic diagnostic apparatus according to the second embodiment generates a shading layer using a plurality of elements included in the Doppler data.

[0089] FIG. 9 is a block diagram showing a configuration example of the ultrasonic diagnostic apparatus according to the second embodiment. The ultrasonic diagnostic apparatus 1' in FIG. 9 includes an apparatus main body 100' and an ultrasonic probe 101. The apparatus main body 100' is connected to an input device 102 and an output device 103. Further, the apparatus main body 100' is connected to an external device 104 via a network NW. The external device 104 is, for example, a server equipped with a PACS. Note that hereinafter, the description of configurations having the same reference numerals as those in the first embodiment may be omitted.

[0090] The apparatus main body 100’ is an apparatus that generates an ultrasonic image based on a reflected wave signal received by an ultrasonic probe 101. The apparatus main body 100’ includes an ultrasonic transmission circuit 110, an ultrasonic reception circuit 120, an internal storage circuit 130, an image memory 140, an input interface 150, an output interface 160, a communication interface 170, and a processing circuit 180’.

[0091] The processing circuit 180’ is, for example, a processor that functions as the center of the ultrasonic diagnostic apparatus 1’. The processing circuit 180’ realizes the functions corresponding to the program by executing the program stored in the internal storage circuit 130. The processing circuit 180’ includes, for example, a B-mode processing function 181, a Doppler processing function 182, an image generation function 183, a three-dimensional data generation function 184 that functions as a three-dimensional data generation unit, an acquisition function 185A that functions as an acquisition unit, a conversion function 188 that functions as a conversion unit, a gradient calculation function 185B’ that functions as a gradient calculation unit, a layer generation function 185C that functions as a layer generation unit, a rendering function 185D’ that functions as a rendering unit, a display control function 186 that functions as a display control unit, and a system control function 187.

[0092] The conversion function 188 is a function that converts two different elements (a first element and a second element) into a new element. In the present embodiment, this new element is referred to as a “conversion element”. The processing circuit 180’ generates a conversion element by converting the first element and the second element included in the three-dimensional Doppler data using a predetermined function by the conversion function 188. Hereinafter, as a specific example, the case where the first element is velocity data and the second element is dispersion data will be described.

[0093] Since the dispersion is an index of the variation in velocity, the velocity data and the dispersion data are considered to be related to each other. Therefore, as a phase volume considering both of them, a first conversion element X and a second conversion element Y may be calculated using the following formulas (2) and (3).

[0094]

Number

[0095]

Number

[0096] In Equation (2), T(x, y, z) represents the dispersion element in the target voxel of the three-dimensional Doppler data, and V(x, y, z) represents the velocity element in the target voxel. Also, g() is an arbitrary function with T(x, y, z) as a variable, and h() is an arbitrary function with V(x, y, z) as a variable. Note that it may be arbitrarily determined whether to calculate either the first conversion element X or the second conversion element Y. Hereinafter, it is assumed that either the first conversion element X or the second conversion element Y is calculated, and it will simply be referred to as the "conversion element".

[0097] The gradient calculation function 185B' is a function that calculates the gradient of the surface of the observation target based on two different elements (the first element and the second element) included in the three-dimensional Doppler data. By the gradient calculation function 185B', the processing circuit 180' calculates the gradient of the surface of the observation target based on the first element and the second element included in the three-dimensional Doppler data. Specifically, the processing circuit 180' calculates the gradient using the conversion element converted from the first element and the second element. Also, the processing circuit 180' may calculate the gradient of the blood vessel surface using the velocity value and the dispersion value of the Doppler data.

[0098] The rendering function 185D' is a function that generates a rendering image considering shading. By the rendering function 185D', the processing circuit 180' generates a basic rendering image (the first rendering image) of the observation target based on an element (the third element) different from at least one of the first element and the second element used for generating the conversion element. Then, the processing circuit 180' generates a second rendering image considering shading based on the calculated gradient and the first rendering image.

[0099] Specifically, the processing circuit 180' generates a second rendering image based on the first rendering image and the shading layer generated from the calculated gradient. More specifically, the processing circuit 180' generates the second rendering image by superimposing the shading layer on the first rendering image.

[0100] The configuration of the ultrasonic diagnostic apparatus according to the second embodiment has been described above. Next, the rendering image generation process in the second embodiment will be described.

[0101] FIG. 10 is a flowchart showing an example of the operation of the processing circuit that executes the rendering image generation process in the second embodiment. The rendering image generation process in FIG. 10 is started, for example, when the user executes a mode for displaying a rendering image.

[0102] (Step ST210) When the rendering image generation process is started, the processing circuit 180' executes the acquisition function 185A. When the acquisition function 185A is executed, the processing circuit 180' acquires three-dimensional Doppler data and shading information. The shading information is information on the type of shading (shading type) selected by the user. The shading type information in the second embodiment includes information on the first element and the second element included in the three-dimensional Doppler data used for gradient calculation, and information on the third element for generating the basic rendering image. Note that the third element may be the same as either the first element or the second element, or may be different from the first element and the second element.

[0103] (Step ST220) After acquiring the three-dimensional Doppler data and the shading information, the processing circuit 180' executes the conversion function 188. When executing the conversion function 188, the processing circuit 180' generates converted elements by converting the first element and the second element included in the three-dimensional Doppler data. Incidentally, the process of step ST220 may be referred to as a conversion process.

[0104] (Step ST230) After generating the converted elements, the processing circuit 180' executes the gradient calculation function 185B'. When executing the gradient calculation function 185B', the processing circuit 180' calculates a gradient using the converted elements. Incidentally, the process of step ST230 may be referred to as a gradient calculation process.

[0105] (Step ST240) After calculating the gradient, the processing circuit 180' executes the layer generation function 185C. When executing the layer generation function 185C, the processing circuit 180' generates a shading layer using the calculated gradient. Incidentally, the process of step ST240 may be referred to as a layer generation process.

[0106] (Step ST250) After generating the shading layer, the processing circuit 180' executes the rendering function 185D'. When executing the rendering function 185D', the processing circuit 180' generates a first rendering image without considering shading based on the third element included in the three-dimensional Doppler data.

[0107] (Step ST260) After generating the first rendering image, the processing circuit 180' generates a second rendering image considering shading based on the first rendering image and the shading layer by the rendering function 185D'. After the process of step ST260, the rendering image generation process ends. Incidentally, the processes of step ST250 and step ST260 may be referred to as a rendering process.

[0108] Next, a first specific example of the rendering image generation process in the second embodiment will be described with reference to FIG. 11. In the first specific example of the second embodiment, the velocity value (velocity data) of the Doppler data is used as the first element and the third element, and the variance value (variance data) of the Doppler data is used as the second element.

[0109] FIG. 11 is a block diagram for explaining a first specific example of the rendering image generation process in the second embodiment. In FIG. 11, the processing circuit 180' executes conversion processing (step ST220), gradient calculation processing (step ST230), and layer generation processing (step ST240) using the velocity data and the variance data, and executes rendering processing (steps ST250 and ST260) using the shading layer based on the conversion data and the velocity data.

[0110] Next, a second specific example of the rendering image generation process in the second embodiment will be described with reference to FIG. 12. In the second specific example of the second embodiment, the velocity value (velocity data) of the Doppler data is used as the first element, the variance value (variance data) of the Doppler data is used as the second element, and the power value (power data) of the Doppler data is used as the third element.

[0111] FIG. 12 is a block diagram for explaining a second specific example of the rendering image generation process in the second embodiment. In FIG. 12, the processing circuit 180' executes conversion processing (step ST220), gradient calculation processing (step ST230), and layer generation processing (step ST240) using the velocity data and the variance data, and executes rendering processing (steps ST250 and ST260) using the shading layer based on the conversion data and the power data.

[0112] As described above, the ultrasonic diagnostic apparatus according to the second embodiment acquires three-dimensional Doppler data for an observation target, calculates the gradient of the surface of the observation target based on the first element and the second element included in the Doppler data, and generates a first rendering image of the observation target based on a third element included in Doppler data different from the second element, and generates a second rendering image considering shading based on the gradient and the first rendering image. Further, the ultrasonic diagnostic apparatus may generate a conversion element by converting the first element and the second element using a predetermined function, and calculate the gradient using the conversion element.

[0113] Therefore, similar to the first embodiment, the ultrasonic diagnostic apparatus according to the second embodiment can increase the variations in shading in the rendering image using three-dimensional Doppler data.

[0114] (Third Embodiment) In the first and second embodiments, an ultrasonic diagnostic apparatus having a plurality of functions related to rendering image generation processing has been described. On the other hand, in the third embodiment, an information processing apparatus having a plurality of functions corresponding to the first embodiment will be described.

[0115] FIG. 13 is a block diagram showing a configuration example of the information processing apparatus according to the third embodiment. The information processing apparatus 1300 in FIG. 13 is connected to an input device 1301 and an output device 1302. Further, the information processing apparatus 1300 is connected to a medical imaging apparatus 1303 via a network NW. The medical imaging apparatus 1303 corresponds to, for example, an ultrasonic diagnostic apparatus. Note that the input device 1301 and the output device 1302 are substantially the same as the input device 102 and the output device 103 in FIG. 1.

[0116] The information processing apparatus 1300 is a device that executes rendering image generation processing and generates a rendering image. The information processing apparatus 1300 includes a storage circuit 1310, an input interface 1320, an output interface 1330, a communication interface 1340, and a processing circuit 1350.

[0117] The memory circuit 1310 has a memory medium readable by a processor, such as a magnetic memory medium, an optical memory medium, or a semiconductor memory, etc. The memory circuit 1310 stores a program related to the rendering image generation process and various data. The program and various data may be stored in the memory circuit 1310 in advance, for example. Also, the program and various data may be stored in a non-transitory memory medium, distributed, read from the non-transitory memory medium, and installed in the memory circuit 1310, for example.

[0118] Also, the memory circuit 1310 stores B-mode image data, contrast image data, image data related to blood flow video, and three-dimensional data generated by the medical imaging device 1303 according to an operation input via the input interface 1320.

[0119] Note that the memory circuit 1310 may be a driving device that reads and writes various information to and from a portable memory medium such as a CD drive, a DVD drive, and a flash memory. The memory circuit 1310 can write the stored data to a portable memory medium and store the data in an external device via the portable memory medium.

[0120] The input interface 1320 receives various instructions from the operator via the input device 1301. The input device 1301 is, for example, a mouse, a keyboard, a panel switch, a slider switch, a trackball, a rotary encoder, an operation panel, and a touch panel. The input interface 1320 is connected to the processing circuit 1350 via a bus, for example, converts an operation instruction input by the operator into an electrical signal, and outputs the electrical signal to the processing circuit 1350. Note that the input interface 1320 is not limited to only connecting to physical operation components such as a mouse and a keyboard. For example, a circuit that receives an electrical signal corresponding to an operation instruction input from an external input device provided separately from the information processing device 1300 and outputs this electrical signal to the processing circuit 1350 is also included in the example of the input interface.

[0121] The output interface 1330 is an interface for outputting, for example, an electrical signal from the processing circuit 1350 to the output device 1302. The output device 1302 is any display such as a liquid crystal display, an organic EL display, an LED display, a plasma display, a CRT display, or the like. The output device 1302 may be a touch panel type display that also serves as the input device 1301. The output device 1302 may further include a speaker for outputting sound in addition to the display. The output interface 1330 is connected to the processing circuit 1350 via, for example, a bus and outputs an electrical signal from the processing circuit 1350 to the output device 1302.

[0122] The communication interface 1340 is connected to the medical imaging device 1303 via, for example, the network NW and performs data communication with the medical imaging device 1303.

[0123] The processing circuit 1350 is, for example, a processor that functions as the center of the information processing device 1300. The processing circuit 1350 realizes the functions corresponding to the program by executing the program stored in the storage circuit 1310. The processing circuit 1350 has, for example, an acquisition function 1351A that functions as an acquisition unit, a gradient calculation function 1351B that functions as a gradient calculation unit, a layer generation function 1351C that functions as a layer generation unit, a rendering function 1351D that functions as a rendering unit, and a display control function 1352 that functions as a display control unit.

[0124] The acquisition function 1351A is a function for acquiring data related to the rendering image generation process. By the acquisition function 351A, the processing circuit 1350 acquires three-dimensional Doppler data about the observation target.

[0125] The gradient calculation function 1351B is a function for calculating the gradient of the surface of the observation target using the first element included in the three-dimensional Doppler data. By the gradient calculation function 1351B, the processing circuit 1350 calculates the gradient of the surface of the observation target using the first element included in the three-dimensional Doppler data.

[0126] The layer generation function 1351C is a function that generates a shading layer using the gradient of the voxels corresponding to the surface of the observation target. By the layer generation function 1351C, the processing circuit 1350 generates a shading layer from the gradient using a known shading model.

[0127] The rendering function 1351D is a function that generates a rendering image. By the rendering function 1351D, the processing circuit 1350 generates a first rendering image of the observation target based on a second element included in the three-dimensional Doppler data different from the first element used for the gradient calculation, and generates a second rendering image considering shading based on the calculated gradient and the first rendering image.

[0128] Specifically, the processing circuit 1350 generates a second rendering image based on the first rendering image and the shading layer generated from the calculated gradient. More specifically, the processing circuit 1350 generates a second rendering image by superimposing the shading layer on the first rendering image.

[0129] The display control function 1352 is a function that displays a rendering image. By the display control function 1352, the processing circuit 1350 generates a second rendering image. Alternatively, the processing circuit 1350 may be able to switch between the first rendering image and the second rendering image. In addition, the processing circuit 1350 may display an interface that allows the user to select the type of shading.

[0130] Note that the information processing apparatus 1300 may generate three-dimensional Doppler data based on data related to the living body received from the medical imaging apparatus 1303 (for example, a reception signal in an ultrasonic diagnostic apparatus).

[0131] The combination of the first element and the second element in the third embodiment may be the same as the combination described in each specific example of the first embodiment.

[0132] Therefore, the information processing apparatus according to the third embodiment can be expected to have the same effects as those of the first embodiment.

[0133] (Fourth Embodiment) In the first and second embodiments, an ultrasonic diagnostic apparatus having a plurality of functions related to rendering image generation processing has been described. Also, in the third embodiment, an information processing apparatus having a plurality of functions corresponding to the first embodiment has been described. On the other hand, in the fourth embodiment, an information processing apparatus having a plurality of functions corresponding to the second embodiment will be described.

[0134] FIG. 14 is a block diagram showing a configuration example of an information processing apparatus according to the fourth embodiment. The information processing apparatus 1300' in FIG. 14 is connected to a medical imaging apparatus 1303 via a network NW. The medical imaging apparatus 1303 corresponds to, for example, an ultrasonic diagnostic apparatus. Hereinafter, the description of the configurations having the same reference numerals as those in the third embodiment may be omitted.

[0135] The information processing apparatus 1300' is an apparatus that executes rendering image generation processing and generates a rendering image. The information processing apparatus 1300' includes a storage circuit 1310, an input interface 1320, an output interface 1330, a communication interface 1340, and a processing circuit 1350'.

[0136] The processing circuit 1350' is, for example, a processor that functions as the center of the information processing apparatus 1300'. The processing circuit 1350' realizes the functions corresponding to the program by executing the program stored in the storage circuit 1310. The processing circuit 1350' includes, for example, an acquisition function 1351A that functions as an acquisition unit, a conversion function 1353 that functions as a conversion unit, a gradient calculation function 1351B' that functions as a gradient calculation unit, a layer generation function 1351C that functions as a layer generation unit, a rendering function 1351D' that functions as a rendering unit, and a display control function 1352 that functions as a display control unit.

[0137] The conversion function 1353 is a function that converts two different elements (the first element and the second element) into a new element (the conversion element). By the conversion function 1353, the processing circuit 1350' generates a conversion element by converting the first element and the second element included in the three-dimensional Doppler data using a predetermined function.

[0138] The gradient calculation function 1351B' is a function that calculates the gradient of the surface of the observation object based on two different elements (the first element and the second element) included in the three-dimensional Doppler data. By the gradient calculation function 1351B', the processing circuit 1350' calculates the gradient of the surface of the observation object based on the first element and the second element included in the three-dimensional Doppler data. Specifically, the processing circuit 1350' calculates the gradient using the conversion element converted from the first element and the second element. Also, the processing circuit 1350' may calculate the gradient of the blood vessel surface using the velocity value and the dispersion value of the Doppler data.

[0139] The rendering function 1351D' is a function that generates a rendered image considering shading. By the rendering function 1351D', the processing circuit 1350' generates a first rendered image of the observation object based on a third element different from at least one of the first element and the second element used for generating the conversion element, and generates a second rendered image considering shading based on the calculated gradient and the first rendered image.

[0140] Specifically, the processing circuit 1350' generates a second rendered image based on the first rendered image and the shading layer generated from the calculated gradient. More specifically, the processing circuit 180' generates a second rendered image by superimposing the shading layer on the first rendered image.

[0141] Note that the information processing apparatus 1300’ may generate three-dimensional Doppler data based on the data related to the living body received from the medical imaging apparatus 1303 (for example, the reception signal in an ultrasonic diagnostic apparatus).

[0142] The combination of the first element, the second element, and the third element in the fourth embodiment may be the same as the combination described in each specific example of the second embodiment.

[0143] Therefore, the information processing apparatus according to the fourth embodiment can be expected to have the same effects as those of the second embodiment.

[0144] (Modification example) In each of the above embodiments, a specific combination of each element included in the Doppler data (for example, the first element is power data and the second element is velocity data) has been described, but it is not limited thereto. For example, the combination of each element included in the Doppler data may be any combination. Thereby, variations in shading can be further increased.

[0145] In each of the above embodiments, the rendering process using each element included in the Doppler data has been described, but it is not limited thereto. For example, the rendering process may be performed using data obtained by performing a predetermined process (for example, a process for reducing motion artifacts at low flow velocities) on the Doppler data.

[0146] In each of the above embodiments, volume rendering (or global illumination) has been described as the creation of a rendering image, but it is not limited thereto. For example, surface rendering for expressing the object surface, thick MPR (Multi-Planer Reconstruction), and MIP (Maximum Intensity Projection) may be used as the creation of the rendering image.

[0147] According to at least one embodiment described above, it is possible to increase the variations in shading in a rendering image using three-dimensional Doppler data.

[0148] Note that the term "processor" used in the above description means, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or a circuit such as an Application Specific Integrated Circuit (ASIC) or a Programmable Logic Device (for example, a Simple Programmable Logic Device (SPLD), a Complex Programmable Logic Device (CPLD), and a Field Programmable Gate Array (FPGA)). When the processor is, for example, a CPU, the processor realizes its function by reading and executing a program stored in a storage circuit. On the other hand, when the processor is, for example, an ASIC, instead of storing the program in a storage circuit, the function is directly incorporated as a logic circuit in the circuit of the processor. Note that each processor of the present embodiment is not limited to being configured as a single circuit for each processor, and a plurality of independent circuits may be combined to form one processor to realize its function. Further, a plurality of components in the figure may be integrated into one processor to realize its function.

[0149] In addition, each function according to the embodiment can also be realized by installing a program for executing the above processing in a computer such as a workstation and expanding these on a memory. At this time, the program that can cause the computer to execute the above method can also be stored and distributed in a storage medium such as a magnetic disk (such as a hard disk), an optical disk (such as a CD-ROM, a DVD), or a semiconductor memory.

[0150] Although some embodiments have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, changes, and combinations of embodiments can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, as well as in the invention described in the claims and its equivalent scope.

Description of Reference Numerals

[0151] 1 Ultrasonic diagnostic apparatus 1’ Ultrasonic diagnostic apparatus 100, 100’ Apparatus main body 101 Ultrasonic probe 102, 1301 Input device 103, 1302 Output device 104 External device 110 Ultrasonic transmission circuit 120 Ultrasonic reception circuit 130 Internal memory circuit 140 Image memory 150, 1320 Input interface 160, 1330 Output interface 170, 1340 Communication interface 180, 180’, 1350, 1350’ Processing circuit 181 B-mode processing function 182 Doppler processing function 183 Image generation function 184 Three-dimensional data generation function 185A, 351A, 1351A Acquisition function 185B, 185B’, 1351B, 1351B’ Gradient calculation function 185C, 1351C Layer generation function 185D, 185D’, 1351D, 1351D’ Rendering function 186, 1352 Display control function 187 System control function 188,1353 Conversion function 400, 1500, 1600 Rendered images 410, 420, 430, 1510, 1520, 1530, 1610, 1620, 1630 Regions 800 Display image 810, 820 Software buttons 1300, 1300’ Information processing device 1303 Medical imaging device 1310 Memory circuit

Claims

1. An acquisition unit that acquires three-dimensional Doppler data about an observation target; A gradient calculation unit that calculates the gradient of the surface of the observation target using a first element included in the Doppler data; A rendering unit that generates a first rendering image of the observation target based on a second element included in the Doppler data different from the first element, and generates a second rendering image considering shading based on the gradient and the first rendering image An ultrasonic diagnostic apparatus comprising the above.

2. A layer generation unit that generates a shading layer for applying the shading to the first rendering image using the gradient further comprising, The rendering unit generates the second rendering image based on the first rendering image and the shading layer. The ultrasonic diagnostic apparatus according to Claim 1.

3. The rendering unit generates the second rendering image by superimposing the shading layer on the first rendering image. The ultrasonic diagnostic apparatus according to Claim 2.

4. The first element is the power value of the Doppler data, The second element is the velocity value of the Doppler data. The ultrasonic diagnostic apparatus according to Claim 1.

5. The first element is the dispersion value of the Doppler data, The second element is the velocity value of the Doppler data. The ultrasonic diagnostic apparatus according to Claim 1.

6. The first element is the velocity value of the Doppler data, The second element is the power value of the Doppler data. The ultrasonic diagnostic apparatus according to Claim 1.

7. The first element is the dispersion value of the Doppler data, The second element is the power value of the Doppler data. The ultrasonic diagnostic apparatus according to Claim 1.

8. A display control unit that displays an interface that allows a user to select the type of shading further comprising, The acquisition unit acquires shading information indicating the type of shading selected by the user, The shading information includes a combination of the first element and the second element. The ultrasonic diagnostic apparatus according to any one of Claims 1 to 7.

9. An acquisition unit that acquires three-dimensional Doppler data about an observation target; A gradient calculation unit that calculates the gradient of the surface of the observation target based on a first element and a second element included in the Doppler data; A rendering unit that generates a first rendering image of the observation target based on a third element included in the Doppler data different from the second element, and generates a second rendering image considering shading based on the gradient and the first rendering image; An ultrasonic diagnostic apparatus comprising:

10. A conversion unit that generates a conversion element by converting the first element and the second element using a predetermined function; Further comprising: The gradient calculation unit calculates the gradient using the conversion element; The ultrasonic diagnostic apparatus according to claim 9.

11. A layer generation unit that generates a shading layer for applying the shading to the first rendering image using the gradient; Further comprising: The rendering unit generates the second rendering image based on the first rendering image and the shading layer; The ultrasonic diagnostic apparatus according to claim 10.

12. The first element is a velocity value of the Doppler data; The second element is a dispersion value of the Doppler data; The third element is the same as the first element; The ultrasonic diagnostic apparatus according to claim 9.

13. The first element is a velocity value of the Doppler data; The second element is a dispersion value of the Doppler data; The third element is a power value of the Doppler data; The ultrasonic diagnostic apparatus according to claim 9.

14. A display control unit that displays an interface that allows a user to select a type of shading; Further comprising: The acquisition unit acquires shading information indicating the type of shading selected by the user; The shading information includes a combination of the first element, the second element, and the third element; The ultrasonic diagnostic apparatus according to any one of claims 9 to 13.

15. An acquisition unit that acquires three-dimensional Doppler data about an observation target; A gradient calculation unit that calculates the gradient of the surface of the observation target using a first element included in the Doppler data; Based on a second element included in the Doppler data different from the first element, a first rendering image of the observation target is generated, and based on the gradient and the first rendering image, a rendering unit that generates a second rendering image considering shading An image processing apparatus comprising the same. **Claim 16** An acquisition unit that acquires three-dimensional Doppler data about an observation target, A gradient calculation unit that calculates the gradient of the surface of the observation target based on a first element and a second element included in the Doppler data, Based on a third element included in the Doppler data different from the second element, a first rendering image of the observation target is generated, and based on the gradient and the first rendering image, a rendering unit that generates a second rendering image considering shading An image processing apparatus comprising the same. **Claim 17** A computer, Means for acquiring three-dimensional Doppler data about an observation target, Means for calculating the gradient of the surface of the observation target using a first element included in the Doppler data, Based on a second element included in the Doppler data different from the first element, a first rendering image of the observation target is generated, and based on the gradient and the first rendering image, means for generating a second rendering image considering shading An image processing program for causing the computer to function as such. **Claim 18** A computer, Means for acquiring three-dimensional Doppler data about an observation target, Means for calculating the gradient of the surface of the observation target based on a first element and a second element included in the Doppler data, Based on a third element included in the Doppler data different from the second element, a first rendering image of the observation target is generated, and based on the gradient and the first rendering image, means for generating a second rendering image considering shading An image processing program for causing the computer to function as such.

Images