Apparatus and method for generating digital breast diagnosis image

Abstract

The present invention relates to a digital breast diagnostic image generation device and method, and more specifically, to a digital breast diagnostic image generation device and method capable of rapidly providing a diagnostic image without a separate post-processing step by processing an X-ray image of a subject in real time. The present invention discloses a diagnostic image generating device characterized by comprising: an X-ray source that sequentially irradiates X-rays onto a subject while moving along a predetermined path; an X-ray detection unit that detects X-rays sequentially irradiated from the X-ray source and transmitted through the subject to produce a plurality of X-ray images; a diagnostic image generating unit that synthesizes the plurality of X-ray images generated by the X-ray detection unit to generate and provide a diagnostic image of the subject in real time; and a control unit that controls the operation of the X-ray source, the X-ray detection unit, and the diagnostic image generating unit.

Description

Technology Field

[0001] The present invention relates to a digital breast diagnostic image generation device and method, and more specifically, to a digital breast diagnostic image generation device and method capable of rapidly providing a diagnostic image without a separate post-processing step by processing an X-ray image of a subject in real time. Background Technology

[0002] Recently, attempts have been made to screen for and treat various diseases, including cancer, at an early stage. In particular, cancer is considered one of the leading causes of death for modern people, and furthermore, it is reported that the incidence of cancer among Koreans is rapidly increasing as their dietary and lifestyle patterns become increasingly Westernized. The incidence of cancer varies by gender and type; for instance, breast cancer is one of the most prevalent cancers among women. The severity of the situation is particularly significant as the incidence of breast cancer among Korean women is increasing at a rate 20 times higher than the global average.

[0003] Since the possibility of treating cancer can vary significantly depending on the stage of progression after onset, diagnostic technology for early diagnosis is very important. Accordingly, diagnostic methods using X-ray imaging devices, such as those shown in Fig. 1(a), are being utilized to diagnose breast cancer and the like early.

[0004] However, in the case of the currently commonly used 2D planar mammography (see 2D in Fig. 2), it is difficult to accurately determine the presence of cancer through image interpretation, to the extent that the rate of images in which it is difficult to accurately identify the occurrence of cancer reaches 36.6%, such as when the contrast of the image is low or when cancerous tissue is obscured by muscle or fat tissue and difficult to distinguish. In particular, in the case of Asian women, breast tissue is dense, making it even more difficult to identify cancerous tissue.

[0005] In this regard, in Digital Breast Tomosynthesis (DBT), as can be seen in Fig. 1(b), about 9 to 15 two-dimensional images are captured while rotating at regular angular intervals, and then processed to synthesize a series of tomographic images (see 3D in Fig. 2). Accordingly, Digital Breast Tomosynthesis (DBT) can generate tomographic images and synthesized images with higher resolution, which has the advantage of increasing the accuracy of the examination.

[0006] However, in conventional digital breast tomography (DBT), the use of software post-processing to obtain synthetic images can lead to problems where the image's intrinsic information is partially distorted, resulting in an inability to accurately represent the original information. Furthermore, it can entail the inconvenience of requiring several seconds to tens of seconds for separate software post-processing after imaging.

[0007] Accordingly, in order to solve the problems of the conventional X-ray imaging technology described above, there is a need for a digital breast diagnostic image generation device and method that can rapidly provide diagnostic images without a separate post-processing step by processing the image in real-time immediately after capture while preventing distortion of the original image information; however, no appropriate alternative has yet been presented. Prior art literature

[0008] Korean Published Patent Application No. 10-2016-0079961 (July 7, 2016) The problem to be solved

[0009] The present invention was devised to solve the problems of the conventional technology described above, and aims to enable the rapid provision of diagnostic images without a separate post-processing step by processing the image in real-time immediately upon capture while preventing distortion of the original information of the image when generating diagnostic images of a subject.

[0010] Other detailed objectives of the present invention will be self-evident and understandable to experts or researchers in the art through the specific details described below. means of solving the problem

[0011] A diagnostic image generating device according to one aspect of the present invention for solving the above problem comprises: an X-ray source that sequentially irradiates X-rays onto a subject while moving along a predetermined path; an X-ray detection unit that detects X-rays sequentially irradiated from the X-ray source and transmitted through the subject to produce a plurality of X-ray images; a diagnostic image generating unit that synthesizes the plurality of X-ray images generated by the X-ray detection unit to generate and provide a diagnostic image of the subject in real time; and a control unit that controls the operation of the X-ray source, the X-ray detection unit, and the diagnostic image generating unit.

[0012] Here, the diagnostic image generation unit may include: an image acquisition unit that acquires the plurality of X-ray images in real time from the X-ray detection unit; and an image processing unit that processes the X-ray images acquired by the image acquisition unit to generate a diagnostic image in real time.

[0013] Additionally, the diagnostic image generation device is characterized by the fact that the X-ray source sequentially irradiates X-rays onto the subject at different angles, and the diagnostic image generation unit converts the plurality of X-ray images into transformed images in which each is irradiated vertically onto the subject, taking into account the irradiated angles, and then generates a diagnostic image of the subject from the plurality of transformed images.

[0014] At this time, the diagnostic image generation unit may divide each X-ray image into a predetermined plurality of grid regions and generate the transformed image by transforming each of the plurality of grid regions.

[0015] In addition, the diagnostic image generation unit may generate a Maximum Intensity Projection (MIP) image for each of the plurality of grid areas and synthesize them to generate the diagnostic image.

[0016] In addition, the control unit may configure and store a vector data set for each X-ray image, including location information where the X-ray was irradiated (1st information), sequence information for the plurality of grid areas (2nd information), X-ray image detected by the X-ray detector (3rd information), and local maximum information for each grid area representing the maximum intensity projection (MIP) (4th information).

[0017] Furthermore, the control unit can transmit the primary to tertiary information to a deep neural network to generate a cross-sectional image of the subject.

[0018] In addition, the diagnostic image generation unit may synthesize the plurality of X-ray images obtained from the X-ray detection unit to generate a diagnostic image of the subject in real time, and the control unit may transmit the first to third information to a separate tomographic image generation unit to generate a tomographic image of the subject after post-processing.

[0019] In addition, the X-ray source can sequentially irradiate a subject with X-rays of multiple different energy levels while moving along a predetermined path. Effects of the invention

[0020] According to the present invention, a diagnostic image generation device can be implemented that can rapidly provide a diagnostic image without a separate post-processing step by processing the image in real time immediately after shooting while preventing distortion of the original information of the image when generating a diagnostic image of a subject. Brief explanation of the drawing

[0021] The accompanying drawings, which are included as part of the detailed description to aid in understanding the present invention, provide embodiments of the present invention and explain the technical concept of the present invention together with the detailed description. FIG. 1 is a 2D and 3D imaging diagnostic device for breast cancer diagnosis according to the prior art. Figure 2 is a conceptual diagram of 2D and 3D images according to the prior art. FIG. 3 is a block diagram of a diagnostic image generation device according to one embodiment of the present invention. FIG. 4 is a diagram illustrating the operation of a diagnostic image generation device according to an embodiment of the present invention. FIG. 5 is a diagram illustrating the configuration of a diagnostic image generating device according to one embodiment of the present invention. FIGS. 6 and FIGS. 7 are specific example diagrams of a diagnostic image generation unit of a diagnostic image generation device according to an embodiment of the present invention. FIGS. 8 and FIGS. 9 are drawings illustrating the grid area of ​​a diagnostic image generating device according to an embodiment of the present invention. FIG. 10 is a diagram illustrating a vector data set according to one embodiment of the present invention. Specific details for implementing the invention

[0022] The present invention is capable of various modifications and may have various embodiments. Accordingly, specific embodiments will be described in detail below based on the attached drawings.

[0023] The following examples are provided to facilitate a comprehensive understanding of the methods, devices, and / or systems described herein. However, they are merely illustrative and the invention is not limited thereto.

[0024] In describing the embodiments of the present invention, detailed descriptions of known technologies related to the present invention are omitted if it is determined that such detailed descriptions may unnecessarily obscure the essence of the invention. Furthermore, the terms described below are defined in consideration of their functions within the present invention, and these may vary depending on the intentions or practices of the user or operator. Therefore, such definitions should be based on the content throughout this specification. Terms used in the detailed description are intended merely to describe the embodiments of the present invention and should not be limiting in any way. Unless explicitly stated otherwise, expressions in the singular form include the meaning of the plural form. In this description, expressions such as "include" or "comprise" are intended to refer to certain characteristics, numbers, steps, actions, elements, parts thereof, or combinations thereof, and should not be interpreted to exclude the existence or possibility of one or more other characteristics, numbers, steps, actions, elements, parts thereof, or combinations thereof other than those described.

[0025] Additionally, terms such as first, second, etc., may be used to describe various components, but said components are not limited by said terms, and said terms are used only for the purpose of distinguishing one component from another.

[0026] Below, exemplary embodiments of a digital breast diagnostic image generation device and method according to one embodiment of the present invention will be described in turn with reference to the accompanying drawings.

[0027] First, FIG. 3 shows a block diagram of a digital breast diagnostic image generating device (100) according to an embodiment of the present invention. As can be seen in FIG. 3, the diagnostic image generating device (100) according to an embodiment of the present invention may be configured to include an X-ray source (110) that sequentially irradiates X-rays onto a subject (200) while moving along a predetermined path, an X-ray detection unit (120) that detects X-rays sequentially irradiated from the X-ray source (110) and transmitted through the subject (200) to produce a plurality of X-ray images, a diagnostic image generating unit (130) that synthesizes the plurality of X-ray images generated by the X-ray detection unit (120) to generate and provide a diagnostic image for the subject (200) in real time, and a control unit (140) that controls the operation of the X-ray source (110), the X-ray detection unit (120), and the diagnostic image generating unit (130).

[0028] At this time, the diagnostic image generation unit (130) may include an image acquisition unit (132) that acquires the plurality of X-ray images in real time from the X-ray detection unit (120), and an image processing unit (134) that processes the X-ray images acquired from the image acquisition unit (132) to generate a diagnostic image in real time.

[0029] Accordingly, in a digital breast diagnostic image generation device (100) according to one embodiment of the present invention, when generating a diagnostic image for the subject (200), the image is processed in real-time immediately after shooting while preventing distortion of the original information of the image, thereby providing a diagnostic image quickly without a separate post-processing process. This allows an equipment operator, such as a radiographer, to immediately verify the validity of the shot and immediately determine the need for re-shooting and proceed with re-shooting, thereby preventing the waste of time and manpower due to repeated shooting, and also enables the generation of more accurate tomographic images without distortion of the original information of the subject.

[0030] Hereinafter, a digital breast diagnostic image generating device (100) according to one embodiment of the present invention is examined in detail by dividing it into components.

[0031] First, the X-ray source (110) sequentially irradiates X-rays onto the subject (200) while moving along a predetermined path, as can be seen in FIG. 4. At this time, the X-ray source (110) can irradiate X-rays onto the subject (200) at a plurality of locations including a first location and a second location of the first path.

[0032] More specifically, the X-ray source (110) can move along a concentric arc and sequentially irradiate the subject (200) with X-rays at regular angular intervals.

[0033] For example, the X-ray source (110) may rotate along an arc centered on the subject (200) to irradiate X-rays onto the subject (200) at a first position ((a1) in FIG. 4), irradiate X-rays onto the subject (200) at a second position ((a2) in FIG. 4) which is 15 degrees away from the first position, and then irradiate X-rays onto the subject (200) again at a third position ((a3) in FIG. 4) which is 15 degrees away from the second position.

[0034] However, although the X-ray source (110) may sequentially irradiate X-rays while moving at equal angular intervals as described above in the present invention, the present invention is not necessarily limited thereto, and it is also possible to irradiate X-rays at non-uniform angular intervals depending on the location where diagnostic images and tomographic images can be generated more efficiently by considering the characteristics of the subject (200), etc.

[0035] Additionally, the X-ray source (110) may generate X-rays of multiple energy levels and irradiate the subject (200). At this time, the X-ray source (110) may be configured using various devices capable of generating X-rays of multiple energy levels that can be used to generate X-ray images and irradiating the subject (200). For example, it is possible to configure it by including one or more X-ray tubes and a high-frequency X-ray generator (HFG) according to the prior art.

[0036] Next, the X-ray detection unit (120) detects X-rays that are sequentially irradiated from the X-ray source (110) and have passed through the subject (200), thereby producing a plurality of X-ray images.

[0037] At this time, the X-ray source (110) moves along a predetermined path and sequentially irradiates X-rays onto the subject (200), and the X-ray detector (120) also detects the X-rays that have been sequentially irradiated and passed through the subject (200) to sequentially produce a plurality of X-ray images.

[0038] For a more specific example, when the X-ray source (110) rotates along an arc centered on the subject (200) and irradiates the subject (200) with X-rays at a first position ((a1) in FIG. 4), the X-ray detector (120) produces an X-ray image for the first position; when the X-ray source (110) irradiates the subject (200) with X-rays at a second position ((a2) in FIG. 4), the X-ray detector (120) produces an X-ray image for the second position; and when the X-ray source (110) irradiates the subject (200) with X-rays at a third position ((a3) in FIG. 4), the X-ray detector (120) produces an X-ray image for the third position.

[0039] At this time, it is preferable for the X-ray detection unit (120) to generate a digital image so that the X-ray image can be processed more efficiently. The X-ray image thus formed is transmitted to the diagnostic image generation unit (130) and used to generate a diagnostic image of the subject (200).

[0040] Next, the diagnostic image generation unit (130) synthesizes a plurality of X-ray images produced by the X-ray detection unit (120) to generate and provide a diagnostic image of the subject (200) in real time.

[0041] At this time, the diagnostic image generation unit (130) may be configured to include an image acquisition unit (132) that acquires the plurality of X-ray images in real time from the X-ray detection unit (120), as can be seen in FIG. 3, and an image processing unit (134) that processes the X-ray images acquired from the image acquisition unit (132) to generate a diagnostic image in real time.

[0042] Accordingly, in conventional digital breast tomography (DBT) devices, as can be seen in FIG. 5(a), X-ray images detected by an X-ray detector are transmitted to an external host computer via a predetermined interface and stored in multiple file formats according to shooting angles. Then, these are read by image reconstruction software based on Filtered Back Projection (FBP) to produce tomographic images through a series of image processing processes, and furthermore, by generating and providing a synthetic image, the diagnostician can more effectively diagnose the lesion of the subject.

[0043] However, in the case of the above-mentioned conventional technology, the data may be deformed while undergoing the above-mentioned series of processes, and the information of the original data may be lost (for example, the 64-bit or 128-bit original data of the X-ray image generated by the X-ray detector (120) is deformed into 32-bit unsigned int or double data), and accordingly, even when applying the X-ray image to deep learning or the like to detect lesions, the problem of reduced accuracy due to the loss of information of the original data may occur.

[0044] In this regard, as can be seen in FIG. 5(b), the present invention does not transmit the X-ray image detected by the X-ray detector (120) to an external host computer, etc., but instead directly acquires it from the diagnostic image generation unit (130) composed of a HW module using an FPGA, etc., and generates and provides a synthetic image (300) in real time. This prevents distortion of the original data of the X-ray image and allows the image to be processed in real time immediately after shooting, thereby enabling the diagnostic image to be provided to the diagnostician without a separate post-processing process.

[0045] More specifically, as can be seen in FIG. 6, the diagnostic image generation unit (130) in the present invention may be configured to include an image acquisition unit (132) that acquires the plurality of X-ray images in real time from the X-ray detection unit (120) and an image processing unit (134) that processes the X-ray images acquired from the image acquisition unit (132) to generate a diagnostic image in real time.

[0046] At this time, as shown in FIG. 6, the diagnostic image generation unit (130) can be configured as a dedicated hardware module using a Field Programmable Gate Array (FPGA) or the like so as to process the X-ray image in real time to generate a synthetic image.

[0047] Accordingly, in the present invention, the diagnostic image generation unit (130) not only does not need to transmit the original data of the X-ray image to an external host computer via an interface, but also effectively reduces the time required for image processing on the host computer, thereby enabling the provision of a synthetic image (300) in real time.

[0048] In addition, in a digital breast diagnostic image generation device (100) according to one embodiment of the present invention, as can be seen in FIG. 7, the diagnostic image generation unit (130) may acquire a plurality of X-ray images from the X-ray detection unit (120), calculate a plurality of Maximum Intensity Projection (MIP) data, and then synthesize them to generate and provide a composite image of the subject (200) in real time.

[0049] Furthermore, in a digital breast diagnostic image generating device (100) according to one embodiment of the present invention, the X-ray source (110) sequentially irradiates X-rays at different angles toward the subject (200), and accordingly, the diagnostic image generating unit (130) can convert the plurality of X-ray images into a converted image in which each X-ray is irradiated in a vertical direction toward the subject (200) considering the irradiated angles, and then generate a diagnostic image of the subject from the plurality of converted images.

[0050] For a more specific example, referring to FIG. 4, when the X-ray source (110) rotates along an arc centered on the subject (200) and irradiates the subject (200) with X-rays at a first position ((a1) in FIG. 4), the X-ray detector (120) produces an X-ray image for the first position; when the X-ray source (110) irradiates the subject (200) with X-rays at a second position ((a2) in FIG. 4), the X-ray detector (120) produces an X-ray image for the second position; and when the X-ray source (110) irradiates the subject (200) with X-rays at a third position ((a3) in FIG. 4), the X-ray detector (120) produces an X-ray image for the third position.

[0051] At this time, the second position ((a2) in FIG. 4) corresponds to a vertical direction from the subject (200), but the first position ((a1) in FIG. 4) and the third position ((a3) in FIG. 4) are positions tilted by a predetermined angle, so the diagnostic image generating unit (130) can convert the X-ray images for the first position and the third position into a converted image when irradiating them vertically toward the subject (200), taking into account the irradiated angle (θ).

[0052] Next, the diagnostic image generation unit (130) can synthesize the converted plurality of converted images to generate and provide a composite image of the subject (200) in real time.

[0053] In addition, in a digital breast diagnostic image generation device (100) according to one embodiment of the present invention, the diagnostic image generation unit (130) can generate the converted image in real time by dividing each X-ray image obtained from the X-ray detection unit (120) into a predetermined plurality of grid areas, as can be seen in FIG. 8, and then converting each of the plurality of grid areas.

[0054] More specifically, as can be seen in FIG. 9, the diagnostic image generating unit (130) can convert the original grid area (410) of the X-ray image into a converted grid area (420) by considering the irradiated angle (θ) (e.g., A' = A x cosθ).

[0055] Next, the diagnostic image generation unit (130) can generate a Maximum Intensity Projection (MIP) image for each of the plurality of grid areas and synthesize it to generate and provide the diagnostic image in real time.

[0056] Furthermore, in a digital breast diagnostic image generation device (100) according to one embodiment of the present invention, the control unit (140) may configure and store a vector data set (500) for each X-ray image, which includes location information where the X-ray was irradiated (1st information), sequence information for the plurality of grid areas (2nd information), X-ray image detected by the X-ray detection unit (120) (3rd information), and local maximum information for each grid area representing the maximum intensity projection (MIP) (4th information).

[0057] More specifically, as can be seen in FIG. 10, the control unit (110) can divide a plurality of X-ray images detected by the X-ray detector into a plurality of grid regions, and then combine the converted grid region (Grid'(j,k)) data sets (510, 520, 530) converted for each of the plurality of grid regions (Grid(j,k)) to form a vector data set (500) (third information).

[0058] Furthermore, the control unit (140) may configure and store a vector data set (500) by including, in addition to the third information, location information where the X-ray was irradiated (first information), sequence information for the plurality of grid areas (second information), and local maximum information for each grid area to be indicated as the maximum intensity projection (MIP) among the plurality of transformed grid areas (fourth information).

[0059] Next, the control unit (140) can transmit the primary to tertiary information to a deep learning network to generate a cross-sectional image of the subject (200).

[0060] Accordingly, the diagnostic image generation unit (130) synthesizes the plurality of X-ray images obtained from the X-ray detection unit (120) to generate a diagnostic image of the subject (200) in real time, and subsequently, the control unit (140) can transmit the first to third information to a separate tomographic image generation unit to generate a tomographic image of the subject (200) after post-processing.

[0061] Furthermore, in a digital breast diagnostic image generating device (100) according to one embodiment of the present invention, the X-ray source (110) can sequentially irradiate a subject (200) with X-rays of different multiple energy levels while moving along a predetermined path, and accordingly, the diagnostic image generating unit (130) can generate and provide a diagnostic image of the subject (200) in real time using multiple X-ray images of different multiple energy levels generated by the X-ray detection unit (120).

[0062] Accordingly, in the digital breast diagnostic image generation device (100) and method according to one embodiment of the present invention, when generating a diagnostic image for a subject, the image is processed in real-time immediately after shooting while preventing distortion of the original information of the image, thereby enabling the rapid provision of a diagnostic image without a separate post-processing process.

[0063] The foregoing description is merely an illustrative explanation of the technical concept of the present invention, and those skilled in the art to which the present invention pertains will be able to make various modifications and variations within the scope of the essential characteristics of the present invention. Accordingly, the embodiments described in the present invention are intended to explain, not limit, the technical concept of the present invention, and are not limited to such embodiments. The scope of protection of the present invention shall be interpreted by the claims below, and all technical concepts within an equivalent scope shall be interpreted as being included within the scope of rights of the present invention. Explanation of the symbols

[0064] 100: Diagnostic image generation device 110 : X-ray source 120 : X-ray detector 130 : Diagnostic image generation unit 132 : Image acquisition unit 134 : Image processing unit 140 : Control unit 200 : Subject 300 : Diagnostic imaging 410 : Original grid area 420 : Transform grid area 500: Vector data set 510, 520, 530: Transformed grid area data

Claims

Claim 1 A diagnostic image generating device comprising: an X-ray source that sequentially irradiates X-rays onto a subject at different angles while moving along a predetermined path; an X-ray detection unit that detects X-rays sequentially irradiated from the X-ray source and transmitted through the subject to produce a plurality of X-ray images; a diagnostic image generating unit that synthesizes the plurality of X-ray images generated by the X-ray detection unit to generate and provide a diagnostic image for the subject in real time; and a control unit that controls the operation of the X-ray source, the X-ray detection unit, and the diagnostic image generating unit; wherein the diagnostic image generating unit converts the plurality of X-ray images into a converted image when each is irradiated vertically toward the subject, considering the irradiated angles, and then divides the plurality of X-ray images into a plurality of predetermined grid areas and converts them for each of the plurality of grid areas to generate the converted image, and generates a diagnostic image for the subject from the plurality of converted images. Claim 2 A diagnostic image generating device according to claim 1, wherein the diagnostic image generating unit comprises: an image acquisition unit that acquires the plurality of X-ray images in real time from the X-ray detection unit; and an image processing unit that processes the X-ray images acquired from the image acquisition unit to generate a diagnostic image in real time. Claim 3 delete Claim 4 delete Claim 5 A diagnostic image generating device according to claim 1, wherein the diagnostic image generating unit calculates a Maximum Intensity Projection (MIP) image for each of the plurality of grid areas and synthesizes them to generate the diagnostic image. Claim 6 A diagnostic image generating device according to claim 5, wherein the control unit comprises, for each X-ray image, a vector data set including location information where the X-ray was irradiated (1st information), sequence information for the plurality of grid areas (2nd information), an X-ray image detected by the X-ray detection unit (3rd information), and local maximum information for each grid area representing the maximum intensity projection (MIP) (4th information). Claim 7 A diagnostic image generating device according to claim 6, characterized in that the control unit transmits the primary to tertiary information to a deep neural network to generate a tomographic image of the subject. Claim 8 A diagnostic image generating device according to claim 6, wherein the diagnostic image generating unit synthesizes the plurality of X-ray images obtained from the X-ray detection unit to generate a diagnostic image of the subject in real time, and the control unit transmits the primary to tertiary information to a separate tomographic image generating unit to generate a tomographic image of the subject after post-processing. Claim 9 A diagnostic image generating device according to claim 1, characterized in that the X-ray source moves along a predetermined path and sequentially irradiates a subject with X-rays of multiple different energy levels.

Images