Three-dimensional medical image output method and device

The method and device address the challenge of outputting heterogeneous three-dimensional medical images by removing gel and linking ultrasound and X-ray images, enabling coordinated display and comparison.

WO2025150951A1PCT designated stage expired Publication Date: 2025-07-17MEDICALPARK CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2025/000562
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-01-12
Filing Date
2025-01-09
Publication Date
2025-07-17

AI Technical Summary

Technical Problem

Existing methods fail to effectively output heterogeneous three-dimensional medical images using ultrasound and X-ray, and do not adequately remove gel applied to the body part from these images, nor link and display the coordinates of ultrasound and X-ray images for comparison.

Method used

A method and device that acquires three-dimensional medical images using ultrasound and X-ray, removes gel by setting contour points and forming a virtual surface, and links image coordinates for display and comparison.

Benefits of technology

Enables simultaneous output of heterogeneous three-dimensional medical images with gel removal and coordinated display of ultrasound and X-ray images, facilitating effective image comparison.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2025000562_17072025_PF_FP_ABST
    Figure KR2025000562_17072025_PF_FP_ABST
Patent Text Reader

Abstract

Disclosed is a three-dimensional medical image output method executed by a three-dimensional medical image output device and comprising the steps of: acquiring different types of three-dimensional medical images obtained by imaging a body part by using ultrasonic waves and X-rays; and removing, from the three-dimensional medical images, an area in which gel applied to the body part is displayed. The step of removing the area in which the gel is displayed includes the steps of: displaying a plurality of contour points on the boundary between the gel and the body part; forming a virtual three-dimensional curved surface by connecting the plurality of contour points to each other; and removing, along the virtual three-dimensional curved surface, the area in which the gel is displayed. According to the present invention, different types of three-dimensional medical images from which the gel applied to the body part is removed can be output.
Need to check novelty before this filing date? Find Prior Art

Description

3D medical image output method and device

[0001] The present invention relates to a method and device for outputting a three-dimensional medical image, and more particularly, to a method for outputting a three-dimensional medical image of a body part taken using different means and a device using the same.

[0002] The rapid advancement of medical imaging technology in the 21st century has enabled innovative, non-invasive diagnostics, establishing medical imaging as a vital component of the healthcare system. A key element that has enabled this advancement is medical image processing technology.

[0003] The overall data flow of an advanced medical imaging system may include medical image generation, medical image computing, and medical image management.

[0004] As a technology related to the present invention, a composite imaging device and a method for controlling the composite imaging device disclosed in the Korean Patent Publication are disclosed, which are characterized by determining the operation of an ultrasonic imaging unit according to the operation of a photoacoustic imaging unit. This related technology utilizes ultrasound and photoacoustics, while the present invention utilizes ultrasound and X-rays, and thus the two inventions are distinct from each other in purpose, structure, and effect.

[0005] The problem to be solved by the present invention is to provide a method and device capable of outputting heterogeneous 3D medical images.

[0006] The problem to be solved by the present invention is to provide a method and device capable of outputting heterogeneous medical images using ultrasound and X-ray.

[0007] The problem to be solved by the present invention is to provide a method and device for removing and outputting a gel applied to a body part from a heterogeneous 3D medical image.

[0008] The problem to be solved by the present invention is to provide a device and method for comparing and displaying the two images by mutually linking the coordinates of an ultrasound image and an X-ray image.

[0009] The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below.

[0010] In order to achieve the above object, according to one embodiment of the technical idea of ​​the present invention, a method executed by a 3D medical image output device is disclosed, comprising the steps of: acquiring a 3D medical image by photographing a body part using ultrasound; and removing an area in which gel applied to the body part is displayed in the 3D medical image, wherein the step of removing the area in which the gel is displayed comprises: setting a plurality of contour points at a boundary between the gel and the body part; forming a virtual 3D surface by connecting the plurality of contour points; and removing the area in which the gel is displayed along the virtual 3D surface.

[0011] In addition, the method for outputting a 3D medical image may be configured such that the step of obtaining a 3D medical image of a body part includes the step of moving a plurality of ultrasound probes arranged in the Y-axis direction in the X-axis direction and scanning a breast corresponding to the body part; and the step of obtaining a 3D medical image composed of a plurality of layers in the form of a YZ plane through scanning.

[0012] In addition, the method for outputting a 3D medical image may be configured such that the step of setting a plurality of contour points includes the step of setting n vertical contour points at different heights on the boundary of the breast using a 2D cross-sectional view extracted from a 3D ultrasound image; the step of extracting 2D plane views from the heights of the n points in the 3D ultrasound image; and the step of setting m horizontal contour points on the boundary of the breast set from the n 2D plane views.

[0013] In addition, the method for outputting a 3D medical image may be configured such that the step of forming a virtual 3D surface includes a step of predicting a missing point between the contour points through interpolation; and a step of forming a surface by connecting the contour points and the missing points.

[0014] In addition, the method for outputting a 3D medical image is characterized in that the step of removing the area where the gel is displayed further includes the step of selecting contour points of the nipple, and a virtual 3D surface is formed by connecting a plurality of contour points and the contour points of the nipple.

[0015] In addition, the method for outputting a 3D medical image may further include a step of acquiring a heterogeneous 3D medical image by photographing the body part using an X-ray at the same time as acquiring the 3D image; and a step of removing an area where a gel applied to the body part is displayed from the heterogeneous 3D medical image based on information about the contour points.

[0016] In addition, the method for outputting a 3D medical image may further include a step of correcting the specifications of different 3D medical images to be identical; and a step of linking the first coordinate value and the second coordinate value in the different 3D medical images to display the different images.

[0017] In addition, the method for outputting a 3D medical image may be configured such that the step of displaying different images includes a step of, when one of the 3D medical images of the different types is enlarged or reduced using linked coordinate values, enlarging or reducing the remaining images at the same ratio; a step of matching the center pixels of the 3D medical images of the different types in the visible area; and a step of displaying the trajectory of a point display displayed on one of the 3D medical images of the different types as the same trajectory on the remaining images.

[0018] In order to achieve the above object, according to one embodiment of the technical idea of ​​the present invention, a 3D medical image output device is disclosed, which comprises: a first photographing module for photographing a body part using ultrasound to obtain a 3D medical image; a processor for executing commands included in a program module; a memory for storing the program module, wherein the program module includes a correction module for removing an area where a gel applied to the body part is displayed in the 3D medical image, and the correction module includes: a contour point display module for setting a plurality of contour points at the boundary between the gel and the body part; a curved surface forming module for connecting the plurality of contour points to each other to form a virtual 3D curved surface; and a cropping module for removing an area where a gel is displayed along the virtual 3D curved surface.

[0019] In addition, the 3D medical image output device may be configured such that the program module further includes a display module that links first coordinate values ​​and second coordinate values ​​in different 3D medical images to display different images.

[0020] Specific details of other embodiments are included in the “Specific Details for Carrying Out the Invention” and the attached “Drawings.”

[0021] The advantages and / or features of the present invention and the methods for achieving them will become clear with reference to the various embodiments described in detail below together with the accompanying drawings.

[0022] However, the present invention is not limited to the configuration of each embodiment disclosed below, but may be implemented in various different forms, and each embodiment disclosed in this specification is provided only to ensure that the disclosure of the present invention is complete and to fully inform a person having ordinary skill in the art to which the present invention pertains of the scope of the present invention, and it should be understood that the present invention is defined only by the scope of each claim of the claims.

[0023] According to the present invention, different types of 3D medical images can be output simultaneously through a single device.

[0024] Additionally, heterogeneous medical images can be simultaneously output using ultrasound and X-ray through a single device.

[0025] Additionally, a heterogeneous 3D medical image can be output with the gel applied to the body part removed.

[0026] Additionally, the coordinates of the ultrasound image and the X-ray image can be mutually linked so that the two images can be displayed while being compared with each other.

[0027] The effects that can be obtained by the heterogeneous medical image output method and device according to the technical idea of ​​the present invention are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.

[0028] FIG. 1 is an exemplary diagram of an X-ray photographing and ultrasound examination device including a 3D medical image output device according to an embodiment of the present invention.

[0029] Figure 2 is a block diagram of a 3D medical image output device according to an embodiment of the present invention.

[0030] Figure 3 is a flowchart of a 3D medical image output method according to an embodiment of the present invention.

[0031] Figure 4 is a flowchart of 3D medical image acquisition (S111) in Figure 3.

[0032] Figure 5 is a flowchart of removing an area where gel is displayed in a 3D medical image in Figure 3 (S121).

[0033] Figure 6 is a flowchart of setting the contour points of the breast (S123) in Figure 5.

[0034] Figure 7 is a flowchart of three-dimensional surface formation (S128) in Figure 5.

[0035] Figure 8 is an example of a body part displayed in three-dimensional coordinates.

[0036] Figure 9 is an example of a 3D medical image of a body part.

[0037] Figure 10 is an example diagram in which vertical contour points are set in S124 of Figure 6.

[0038] Figure 11 is an example diagram in which horizontal contour points are set at the height of three vertical contour points in S126 of Figure 6.

[0039] Figure 12 is an example diagram in which horizontal contour points are set at the height of two vertical contour points in S126 of Figure 6.

[0040] Figure 13 is an example diagram in which horizontal contour points are set at the height of the 4th vertical contour point in S126 of Figure 6.

[0041] Fig. 14 is an example diagram in which the outline point of the nipple is set (S127) in S127 of Fig. 5.

[0042] Fig. 15 is an example diagram showing a three-dimensional surface formed in S128 of Fig. 5.

[0043] Figure 16 is an example diagram in which the gel-marked area in S131 of Figure 5 has been removed.

[0044] Before describing the present invention in detail, it should be understood that the terms or words used in this specification should not be interpreted as being unconditionally limited to their usual or dictionary meanings, and that the inventor of the present invention may appropriately define and use the concepts of various terms in order to explain his or her invention in the best possible manner, and further, that these terms or words should be interpreted as meanings and concepts that are consistent with the technical idea of ​​the present invention.

[0045] That is, it should be noted that the terms used in this specification are only used to describe preferred embodiments of the present invention, and are not intended to specifically limit the contents of the present invention, and that these terms are defined in consideration of various possibilities of the present invention.

[0046] Additionally, it should be noted that in this specification, singular expressions may include plural expressions unless the context clearly indicates a different meaning, and similarly, even if expressed in plural, may include a singular meaning.

[0047] Throughout this specification, whenever a component is described as "including" another component, it may mean that the component may further include any other component, rather than excluding any other component, unless specifically stated otherwise.

[0048] Furthermore, when a component is described as being "inside or connected to" another component, it should be understood that the component may be installed in direct connection with or in contact with the other component, may be installed spaced apart from the other component by a certain distance, and if installed spaced apart from the other component by a certain distance, there may be a third component or means for fixing or connecting the component to the other component, and the description of this third component or means may be omitted.

[0049] On the other hand, if a component is described as being "directly connected" or "directly connected" to another component, it should be understood that no third component or means exists.

[0050] Likewise, other expressions that describe the relationship between components, such as "between" and "directly between", or "adjacent to" and "directly adjacent to", should be interpreted as having the same meaning.

[0051] Additionally, it should be noted that the terms “one side,” “the other side,” “one side,” “the other side,” “first,” “second,” etc. in this specification, if used, are used to clearly distinguish one component from another component, and that the meaning of the component is not limited by such terms.

[0052] In addition, terms related to position, such as “upper,” “lower,” “left,” and “right,” etc., in this specification, if used, should be understood to indicate relative positions of the corresponding components in the corresponding drawings, and unless absolute positions are specified for these positions, these position-related terms should not be understood to refer to absolute positions.

[0053] In addition, in this specification, when specifying the drawing numbers for each component of each drawing, the same component has the same drawing number even if the component is shown in a different drawing, that is, the same reference number indicates the same component throughout the specification.

[0054] In the drawings attached to this specification, the size, position, connection relationship, etc. of each component constituting the present invention may be described with some exaggeration, reduction, or omission in order to sufficiently clearly convey the idea of ​​the present invention or for convenience of explanation, and therefore the proportions or scales may not be strict.

[0055] In addition, in the following description of the present invention, a detailed description of a configuration that is judged to unnecessarily obscure the gist of the present invention, for example, a known technology including a prior art, may be omitted.

[0056] Hereinafter, embodiments of the present invention will be described in detail with reference to the relevant drawings.

[0057] FIG. 1 is an exemplary diagram of an X-ray photographing and ultrasound examination device including a three-dimensional medical image output device according to an embodiment of the present invention.

[0058] Referring to FIG. 1, an X-ray photographing and ultrasound examination device (10) is provided with an upright stand (20) and a gantry (30) arranged in front of the upright stand (20). The upright stand (20) has a first axis (X), a second axis (Y) orthogonal to the first axis (X), and a third axis (Z) orthogonal to the first axis (X) and the second axis (Y). The upright stand (20) is composed of a hollow housing. The upright stand (20) may be composed of a portable upright stand that can be freely moved by a plurality of casters.

[0059] A 3D medical image output device (100) can be installed on one side of an upright stand (20) so that it can process X-ray images and ultrasound images using a program module.

[0060] A display can be mounted on an upright stand (20) to be connected to a 3D medical image output device (100). A gantry (30) is connected to the front of the upright stand (20) to enable translational motion along the third axis (Z) direction (height direction) and rotational motion around the second axis (Y).

[0061] The X-ray and ultrasound examination device (10) is equipped with a scanning table (40) positioned below the gantry (30) so that a breast (2) can be placed for X-ray and ultrasound examination.

[0062] The scanning table (40) has a second axis (Y) that is orthogonal to a first axis (X) that is aligned with the scanning direction of the breast (2), and a third axis (Z) that is perpendicular to the first axis (X) and the second axis (Y). The scanning table (40) defines a scanning surface (42) on which the breast (2) is placed, and is composed of a casing having a sealed chamber. A pair of liquid injection ports (46) are respectively coupled to both sides of the upper surface of the scanning table (40).

[0063] An X-ray photographing and ultrasound examination device (10) has an X-ray photographing device (60) that uses X-rays. An X-ray source (62), or an X-ray generator, or an X-ray tube may be provided on the upper side of a scanning table (40) and inside a gantry (30). An X-ray flat panel detector or a two-dimensional X-ray detector (two-dimensional X-ray detector) is arranged at the upper side of the chamber so as to be able to reciprocate along a first axis (X). The upper surface of the X-ray flat panel detector is aligned with an arbitrary horizontal plane parallel to the scanning surface (42). The X-ray flat panel detector may be configured to be 300 mm wide and 240 mm long.

[0064] The X-ray photographing and ultrasound examination device (10) according to the present invention is equipped with an ultrasonic transducer for breast ultrasound examination. The ultrasonic transducer may be arranged at one or both ends of the X-ray flat panel detector, and may be arranged longitudinally along the second axis (Y-axis) direction. That is, one ultrasonic transducer may be arranged, or a second ultrasonic transducer may be additionally arranged. Each receiving and transmitting surface may be arranged on a horizontal plane (66) that is substantially the same as the upper surface of the X-ray flat panel detector.

[0065] Each of the ultrasonic transducer and the second ultrasonic transducer can be configured to be 10 mm wide and 240 mm long.

[0066] An ultrasonic transducer may be configured to include a plurality of ultrasonic probes. When the X-axis direction is the scan direction, the plurality of ultrasonic probes may be arranged in the Y-axis direction. That is, a plurality of ultrasonic probes that output point-source ultrasonic waves are gathered to form an ultrasonic transducer, and the ultrasonic transducer can output ultrasonic waves in the form of a plane formed by gathering point-source ultrasonic waves.

[0067] The ultrasonic transducer consists of a phased array type probe. The phased array type configures the probe with multiple elements and performs ultrasonic inspection through electrical scanning.

[0068] An X-ray photographing and ultrasound examination device (10) may be configured to include, for example, an X-ray photographing device (60) and a 3D medical image output device (100) that processes, corrects, and outputs a 3D medical image photographed by an X-ray flat panel detector and a 3D medical image photographed by an ultrasonic converter, that is, an ultrasound image, within an upright stand (20). The 3D medical image output device (100) is a type of computer device and may be configured to include a processor and memory that drive a program module for image processing.

[0069] Figure 1 discloses a press plate (13) that presses the breast (2) from above, a housing (21) that houses an ultrasonic transducer, etc., an actuator (22) that moves a scanning table (40), and a cover (50) that is placed under the breast (2).

[0070] Figure 2 is a block diagram of a 3D medical image output device according to an embodiment of the present invention.

[0071] Referring to FIG. 2, a 3D medical image output device (100) may be configured to include a processor (110) and a memory (120).

[0072] The processor (110) has a function of executing instructions included in a program module. The processor (110) may be configured to include an operator that performs four-rule operations and a cache memory that stores instructions and data.

[0073] The memory (120) has a function of storing program modules. That is, the memory (120) may be configured to store or load various program modules. The program modules may be configured to include a first shooting module (121), a second shooting module (122), a correction module (123), and a display module (127).

[0074] The first photographing module (121) has a function of controlling the operation of individual ultrasonic probes constituting the ultrasonic transducer. That is, the first photographing module (121) has a function of generating an ultrasonic image by controlling the on / off and intensity of ultrasonic waves output from the ultrasonic probes.

[0075] The second photographing module (122) has a function of operating an X-ray photographing device (60) and an X-ray flat panel detector to photograph an X-ray image corresponding to a three-dimensional medical image.

[0076] The correction module (123) has a function of performing correction processing of ultrasound images corresponding to 3D medical images and X-ray images corresponding to heterogeneous 3D medical images. Specifically, the correction module (123) may be configured to include an outline point setting module (124), a curved surface forming module (125), and a cropping module (126).

[0077] The contour point setting module (124) has a function of setting the contour points of the breast and nipple using various cross-sectional views extracted from a 3D medical image, and can be configured to include a command that performs this function.

[0078] The surface forming module (125) has a function of forming a three-dimensional surface through rendering using set outline points, and can be configured to include a command that performs this function.

[0079] The crop module (126) has a function of removing noise parts where gel is displayed outside of body parts by using the generated three-dimensional surface, and can be configured to include a command that performs this function.

[0080] The display module (127) has a function of linking and displaying the coordinates of objects displayed in different 3D medical images. For example, when one 3D medical image is reduced or enlarged, the remaining 3D medical image is also reduced or enlarged at the same ratio, and when a coordinate point is selected and displayed in one 3D medical image, the coordinate point of the same object can be simultaneously selected and displayed in the remaining 3D medical image.

[0081] Figure 3 is a flowchart of a three-dimensional medical image output method according to an embodiment of the present invention.

[0082] Referring to FIG. 3, a 3D medical image output method (S100) performed by a 3D medical image output device (100) may be configured to include a step of acquiring a medical image (S111, S112), a step of removing a region where a gel is displayed in the medical image (S121, S122), a step of correcting the medical image (S140), and a step of displaying different types of medical images together (S150). In the present invention, the 3D medical image may be an ultrasound image using an ultrasound probe. And the remaining 3D medical image may be an X-ray image.

[0083] Figure 4 is a flowchart of 3D medical image acquisition (S111) in Figure 3.

[0084] Referring to FIG. 4, a step (S111) of acquiring a 3D medical image among medical images may be configured to include a step (S113) of scanning in the X-axis direction and a step (S114) of acquiring multiple layers in the form of a YZ plane.

[0085] A plurality of ultrasound probes arranged in the Y-axis direction can scan the three-dimensional shape of a body part, such as a breast, by outputting ultrasound waves and receiving reflected waves while moving in the X-axis direction. Depending on the movement speed of the ultrasound probes, a plurality of layers in the YZ plane shape can be acquired.

[0086] Figure 5 is a flowchart of removing an area where gel is displayed in a 3D medical image in Figure 3 (S121).

[0087] Referring to FIG. 5, (S111) can be configured to include setting contour points of the breast (S123), setting contour points of the nipple (S127), forming a three-dimensional curve (S128), and removing noise parts where gel is displayed (S131).

[0088] Figure 6 is a flowchart of setting the contour points of the breast (S123) in Figure 5.

[0089] Referring to Fig. 6, the breast contour point setting (S123) may be configured to include vertical contour point setting (S124), two-dimensional plane extraction (S125), and horizontal contour point setting (S126). A plurality of vertical contour points may be set on the boundary where the sagittal section and the body part meet (S124). A two-dimensional plane, for example, a horizontal section, may be extracted for some or all of the vertical contour points among the plurality of vertical contour points, and a plurality of horizontal contour points may be set on the boundary of the horizontal section.

[0090] Figure 7 is a flowchart of three-dimensional surface formation (S128) in Figure 5.

[0091] Referring to Fig. 7, the three-dimensional surface formation (S128) can be configured to include missing point interpolation (S129) and connecting contour points and missing points (S130). That is, a three-dimensional surface can be formed through rendering by connecting vertical contour points, horizontal contour points, and missing points to each other. A nipple outline can be set on the three-dimensional surface (S127).

[0092] Figure 8 is an example of a body part displayed in three-dimensional coordinates.

[0093] Referring to Figure 8, the breast is displayed as a three-dimensional coordinate system among body parts. Cross-sections in three directions, such as sagittal, horizontal, and coronal, are also displayed. The sagittal section divides the body into left and right, the horizontal section divides the body into upper and lower sections, and the coronal section divides the body into front and back.

[0094] The ultrasonic probes are arranged in the y-axis direction, and the scan direction in which the multiple arranged ultrasonic probes move is the x-axis direction.

[0095] A 3D medical image, such as an ultrasound image, is displayed on the left, and a different 3D medical image, such as an X-ray image, is displayed on the right. When taking an ultrasound image of the breast using an ultrasound probe, a gel may be applied to the body part, such as the breast, to help the ultrasound penetrate the body part and facilitate the collection of reflected waves.

[0096] Figure 9 is an example of a 3D medical image of a body part.

[0097] Referring to Figure 9, the gel applied to a body part may appear as noise not only in the 3D medical image, the ultrasound image shown on the left, but also in the X-ray image shown on the right. Therefore, to clearly define the boundaries of the body part, it is necessary to remove the noise portion where the gel appears.

[0098] To remove the noise portion where the gel is displayed, it is necessary to cut out the noise portion along the three-dimensional boundary of the breast.

[0099] In order to clearly define the three-dimensional boundary of the breast, vertical contour points are set using two-dimensional medical images of the sagittal sectioned plane in the three-dimensional medical image, and horizontal contour points can be set at each vertical contour point, i.e., at the horizontal section plane.

[0100] Figure 10 is an example diagram in which vertical contour points are set in S124 of Figure 6.

[0101] Referring to Fig. 10, the second quadrant may display a horizontal section of the breast, and the first quadrant may display a horizontal section that is the longest on the y-axis. The third quadrant displays the three-dimensional coordinates shown in Fig. 8. In addition, when key frame thickness is activated in the first quadrant, five points can be selected in a sagittal section. For example, a user can select and set multiple vertical contour points, for example, five vertical contour points, using the mouse on a sagittal section screen with key frame thickness activated. The fourth quadrant displays the five selected vertical contour points.

[0102] Figure 11 is an example diagram in which horizontal contour points are set at the height of three vertical contour points in S126 of Figure 6.

[0103] Referring to Fig. 11, when a horizontal cross-section is displayed at the height of three vertical contour points in the second quadrant, and the user selects multiple horizontal contour points, for example, five horizontal contour points, along the border of the breast using the mouse, the five horizontal contour points selected at the height of three vertical contour points are set in the fourth quadrant.

[0104] Figure 12 is an example diagram in which horizontal contour points are set at the height of two vertical contour points in S126 of Figure 6.

[0105] Referring to Figure 12, when a horizontal cross-section is displayed at the height of two vertical contour points in the second quadrant, and the user selects multiple horizontal contour points, for example, five horizontal contour points, along the border of the breast using the mouse, the five horizontal contour points selected at the height of two vertical contour points are set in the fourth quadrant.

[0106] Figure 13 is an example diagram in which horizontal contour points are set at the height of the 4th vertical contour point in S126 of Figure 6.

[0107] Referring to Figure 13, when a horizontal cross-section is displayed at the height of four vertical contour points in the second quadrant, when the user selects multiple horizontal contour points, for example, five horizontal contour points, along the border of the breast using the mouse, the five horizontal contour points selected at the height of four vertical contour points are set in the fourth quadrant.

[0108] Fig. 14 is an example diagram in which the outline point of the nipple is set (S127) in S127 of Fig. 5.

[0109] Referring to Fig. 14, in addition to setting the outline points of a body part, for example, a breast (S123), the outline points of a nipple can also be set (S127). That is, a user can directly select and set the outline points of a nipple using an input device, for example, a mouse, on the displayed image. The boundaries of the nipple can be set based on the set outline points of the nipple.

[0110] Fig. 15 is an example diagram showing a three-dimensional surface formed in S128 of Fig. 5.

[0111] Referring to Fig. 15, after selecting one point, pressing the next button at the bottom activates the breast surface model, and pressing a masking button as shown in Fig. 15 enables surface rendering. After this, if you want to apply it to the original image, which is the actual image, pressing the confirm button completes the final saving. In other words, based on the selected vertical and horizontal contour points, 3D rendering can be performed to display the boundary between the breast and the gel by interpolating between the contour points.

[0112] Figure 16 is an example diagram in which the gel-marked area in S131 of Figure 5 has been removed.

[0113] Referring to Fig. 16, if the boundary between the breast and the gel is clearly defined through 3D rendering, the noise portion where the gel is displayed outside the breast in the 3D medical image corresponding to the ultrasound image can be removed. Similarly, in the remaining 3D medical image, the noise portion where the gel is displayed in the 3D medical image, which is an X-ray image, can be removed based on the coordinates of the gel identified in the 3D medical image.

[0114] The display module (130) has a function of displaying different images by linking the coordinates of the subject to each other. Through the display module (130), different 3D medical images are displayed enlarged or reduced at the same ratio when enlarged or reduced, and when the coordinate points of a specific part are selected and displayed in one 3D medical image, the coordinate points of the same subject can be simultaneously selected and displayed in the remaining 3D medical image.

[0115] In this way, according to an embodiment of the present invention, different types of 3D medical images can be output simultaneously through a single device.

[0116] Additionally, heterogeneous medical images can be simultaneously output using ultrasound and X-ray through a single device.

[0117] Additionally, a heterogeneous 3D medical image can be output with the gel applied to the body part removed.

[0118] Additionally, the coordinates of the ultrasound image and the X-ray image can be mutually linked so that the two images can be displayed while being compared with each other.

[0119] Above, although some examples have been given and various preferred embodiments of the present invention have been described, the description of the various embodiments described in the “Specific Details for Carrying Out the Invention” section is merely exemplary, and those skilled in the art to which the present invention pertains will readily understand that they can carry out various modifications of the present invention or carry out equivalent implementations of the present invention based on the above description.

[0120] In addition, since the present invention can be implemented in various other forms, the present invention is not limited by the above description, and the above description is provided only to make the disclosure of the present invention complete and to fully inform a person having ordinary skill in the art to which the present invention belongs of the scope of the present invention, and it should be understood that the present invention is defined only by each claim of the claims.

[0121] The present invention can be used in the fields of manufacturing a 3D medical image output device and a 3D medical image output method.

Claims

1. A method executed by a 3D medical image output device, A step of obtaining a three-dimensional medical image of a body part using ultrasound; and Including a step of removing an area where a gel applied to the body part is indicated in the above 3D medical image, The step of removing the area where the above gel is indicated is: A step of displaying a plurality of outline points on the boundary between the above gel and the body part; A step of forming a virtual three-dimensional surface by connecting the above plurality of contour points; and Consisting of a step of removing the area where the gel is displayed along the virtual three-dimensional surface, 3D medical image output method.

2. In claim 1, the step of obtaining a three-dimensional medical image of the body part is as follows: A step of scanning a body part by moving a plurality of ultrasonic probes arranged in the Y-axis direction in the X-axis direction; and It is configured to include a step of obtaining a three-dimensional medical image composed of a plurality of layers in the form of a YZ plane through the above scanning. 3D medical image output method.

3. In claim 1, the step of displaying the plurality of outline points comprises: A step of marking n vertical contour points of different heights on the boundary of a breast using a two-dimensional cross-sectional view extracted from the three-dimensional medical image; A step of extracting a two-dimensional plane from the heights of the n points in the three-dimensional medical image; and It is configured to include a step of displaying m horizontal contour points on the boundary of the breast displayed in n of the above two-dimensional plane drawings (n, m are natural numbers), 3D medical image output method.

4. In claim 1, The step of forming the above virtual three-dimensional surface is: A step of predicting missing points between the above outline points through interpolation; and It is configured to include a step of forming a surface by connecting the above outline points and the above missing points. 3D medical image output method.

5. In claim 1, the step of removing the area where the gel is displayed comprises: Further comprising the step of marking the outline of the nipple, A virtual three-dimensional surface is formed by connecting the above plurality of contour points and the contour points of the nipple. 3D medical image output method.

6. In claim 1, A step of simultaneously obtaining the above 3D medical image and obtaining a heterogeneous 3D medical image of the above body part using X-ray; and Based on the information about the above outline points, the method further comprises the step of removing an area in which a gel applied to the body part is indicated in the heterogeneous 3D medical image. 3D medical image output method.

7. A first photographing module that obtains three-dimensional medical images by photographing body parts using ultrasound; A processor that executes instructions contained in a program module; Contains a memory for storing the above program module, The above program module, Including a correction module that removes an area where a gel applied to the body part is indicated in the above 3D medical image, The above correction module, A contour point display module that displays a plurality of contour points on the boundary between the above gel and the body part; A surface forming module that connects the above multiple contour points to form a virtual three-dimensional surface; and configured to include a crop module for removing the area where the gel is displayed along the virtual three-dimensional surface; 3D medical image output device.

8. In claim 7, It is further equipped with a second shooting module that obtains a heterogeneous 3D medical image by taking pictures of body parts using X-rays. The above program module, It is configured to further include a display module that displays images by linking the first coordinate value in the above 3D medical image and the second coordinate value in the above heterogeneous 3D medical image. 3D medical image output device.

Citation Information

Patent Citations

  • Ultrasonic diagnostic apparatus, ultrasonic diagnosis method, and computer-readable non-transitory recording medium stored with program

    JP2015061591A

  • Breast Slip Prevention Pad for Ultrasound Breast Scanner

    KR101898346B1

  • Beef liquid source for cold noodle and manufacturing method for cold noodle soup

    KR1020220056015A

  • Method and Apparatus for performing registraton of medical images

    KR102094502B1

  • Multi-modality image acquisition

    US20100166147A1