X-ray image processing methods

Abstract

This disclosure provides a method for processing X-ray images, comprising the following steps: activating one of a plurality of computing modules stored in an X-ray device, wherein the one of the plurality of computing modules corresponds to a measurement area; measuring the measurement area corresponding to the one of the plurality of computing modules by an image measurement module and generating a measurement signal; transmitting the measurement signal to a computing unit by the image measurement module; calculating a measurement image by the computing unit based on the measurement signal and storing the measurement image in a first storage unit of the X-ray device; writing the one of the plurality of computing modules to the computing unit; transmitting the measurement image to the computing unit through the first storage unit; and analyzing the measurement image using the one of the plurality of computing modules by the computing unit and generating an analysis image.

Description

Technical Field

[0001] This disclosure relates to an image processing method, and more particularly to a method for processing X-ray images. Background Technology

[0002] Currently, after acquiring X-ray images, X-ray flat panel detectors (FPDs) need to transmit these images to backend computer equipment for analysis. In other words, current X-ray flat panel detectors and their processing methods cannot provide real-time X-ray image processing. Furthermore, outdated computer equipment or insufficient communication bandwidth for data transmission can affect the processing speed of X-ray images. Therefore, in specific applications such as airport entry inspection, transportation system inspection, and emergency room inspection, where real-time X-ray images of conditions such as pneumonia or chest lesions are required, current equipment and processing methods are insufficient. In view of this, X-ray flat panel detectors that can provide real-time image analysis and X-ray image processing methods still need to be developed. Summary of the Invention

[0003] This disclosure relates to a method for processing X-ray images, which can generate analytical images of X-ray images.

[0004] According to embodiments of this disclosure, the X-ray image processing method includes the following steps: activating one of a plurality of computing modules stored in an X-ray device, wherein the one of the plurality of computing modules corresponds to a measurement area; measuring the measurement area corresponding to the one of the plurality of computing modules by an image measurement module and generating a measurement signal; transmitting the measurement signal to a computing unit by the image measurement module; calculating a measurement image by the computing unit based on the measurement signal and storing the measurement image in a first storage unit of the X-ray device; writing the one of the plurality of computing modules to the computing unit; transmitting the measurement image to the computing unit through the first storage unit; and analyzing the measurement image using the one of the plurality of computing modules by the computing unit and generating an analysis image.

[0005] Based on the above, the X-ray image processing method disclosed herein can utilize a calculation module corresponding to a specific measurement area to analyze the X-ray image and generate a corresponding analysis image.

[0006] To make the above-mentioned features and advantages disclosed herein more apparent and understandable, specific embodiments are described below in conjunction with the accompanying drawings for detailed explanation. Attached Figure Description

[0007] Figure 1 This is a block diagram of an X-ray apparatus according to an embodiment of the present disclosure;

[0008] Figure 2 This is a schematic diagram of the communication between the main control device and the display device according to an embodiment of the present disclosure;

[0009] Figure 3 This is a flowchart of an X-ray image processing method according to an embodiment of the present disclosure;

[0010] Figure 4A This is a schematic diagram of a measurement image according to an embodiment of the present disclosure;

[0011] Figure 4B This is a schematic diagram of the measurement region in a measurement image defined according to an embodiment of this disclosure;

[0012] Figure 4C This is a schematic diagram of an analytical image of an embodiment of this disclosure;

[0013] Figure 5 This is a flowchart of the output measurement image and analysis image of one embodiment of the present disclosure;

[0014] Figure 6 This is a schematic diagram of the output measurement image and analysis image of one embodiment of the present disclosure.

[0015] Explanation of reference numerals in the attached figures

[0016] 100: X-ray device;

[0017] 110: Control unit;

[0018] 120: Calculation unit;

[0019] 130: First storage unit;

[0020] 140: Second storage unit;

[0021] 141: Calculation module;

[0022] 150: Image measurement module;

[0023] 160: Third storage unit;

[0024] 200: Electronic devices;

[0025] S310, S320, S330, S340, S350, S360, S370, S510, S520, S530, S540: Steps;

[0026] 410: Measurement image;

[0027] 420: Measurement area;

[0028] 430: Analyze the image;

[0029] 431: Abnormal location;

[0030] 600: Display device. Detailed Implementation

[0031] Reference will now be made in detail to exemplary embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings. Wherever possible, the same element symbols are used in the drawings and description to denote the same or similar parts. It should be noted that, for ease of understanding and for the sake of brevity, many of the drawings in this disclosure depict only a portion of the electronic device or display device, and specific components in the drawings are not drawn to scale. Furthermore, the number and dimensions of the elements in the drawings are for illustrative purposes only and are not intended to limit the scope of this disclosure.

[0032] Throughout this specification and the appended claims, certain terms are used to refer to specific elements. Those skilled in the art will understand that electronic device manufacturers may use different names to refer to the same components. This document is not intended to distinguish between components that function identically but have different names. In the following specification and claims, words such as "having" and "comprising" are open-ended terms and should therefore be interpreted as "including but not limited to...".

[0033] In some embodiments disclosed herein, terms such as “connection” and “interconnection”, unless specifically defined, may refer to two structures being in direct contact, or to two structures not being in direct contact, with other structures disposed between them. Terms such as “connection” and “interconnection” may also include situations where both structures are movable or both are fixed. Furthermore, the terms “electrical connection” and “coupling” encompass any direct and indirect electrical connection means.

[0034] In the following embodiments, the same or similar elements will be referred to by the same or similar reference numerals, and their detailed descriptions will be omitted. Furthermore, features in different embodiments may be freely combined and used as long as they do not violate the spirit of the invention or conflict with it, and simple equivalent changes and modifications made in accordance with this specification or claims are still within the scope of this disclosure. In addition, the terms "first," "second," etc., mentioned in this specification or claims are only used to name different elements or distinguish different embodiments or scopes, and are not used to limit the upper or lower limit of the number of components, nor are they used to limit the manufacturing order or arrangement order of the components.

[0035] It should be understood that the technical features of several different embodiments can be replaced, reorganized, or mixed to complete other embodiments without departing from the spirit of this disclosure. Features between embodiments can be arbitrarily mixed and combined as long as they do not violate the spirit of the invention or conflict with it.

[0036] Figure 1This is a block diagram of a display device according to an embodiment of this disclosure. (See also...) Figure 1 The X-ray device 100 can be an X-ray flat panel detector (FPD). In particular, the X-ray device 100 disclosed herein can be, for example, a digital radiography (DR) system for off-site backup. The X-ray device 100 can be a mobile image acquisition device and can be used to acquire measurement images (e.g., X-ray images). The X-ray device 100 includes a control unit 110, a computing unit 120, a first storage unit 130, a second storage unit 140, an image measurement module 150, and a third storage unit 160. In this embodiment, the control unit 110 is coupled to the computing unit 120, the second storage unit 140, and the third storage unit 160. The computing unit 120 is also coupled to the first storage unit 130 and the image measurement module 150. The control unit 110 can communicate with other electronic devices or units to receive control signals and / or output image data. In some embodiments of this disclosure, a plurality of computing modules 141 may be stored in a second storage unit 140 of the X-ray apparatus 100. In some embodiments, each of the plurality of computing modules 141 may correspond to a different measurement region (i.e., corresponding to different human body parts), or at least one of the plurality of computing modules 141 may correspond to a plurality of different measurement regions, and this disclosure is not limited thereto. The computing module 141 may be a program, software, or other element capable of performing computing functions. In other embodiments of this disclosure, the X-ray apparatus 100 may not include a third storage unit 160.

[0037] In this embodiment, the control unit 110 may be a central processing unit (CPU) and can communicate with other electronic devices or units via wired or wireless communication modules. For example, the control unit 110 can be connected to other electronic devices or units via a connection cable, or the control unit 110 can communicate with other electronic devices or units via Bluetooth or Wi-Fi. The computing unit 120 may be a field-programmable gate array (FPGA) or a graphics processing unit (GPU) or other suitable components. The computing unit 120 can be used to receive and execute modules written by the control unit 110, and / or receive measurement signals transmitted by the image measurement module 150 and generate corresponding measurement images. In this embodiment, the image measurement module 150 may include a measuring instrument array, wherein the measuring instrument array includes multiple measuring instruments for measuring X-rays. When the image measurement module 150 performs measurement, the measurement target can be placed between the X-ray source and the image measurement module 150, the X-ray source can irradiate the measurement target, and the image measurement module 150 generates measurement signals and provides the measurement signals to the computing unit 120.

[0038] In this embodiment, the first storage unit 130 and the third storage unit 160 may be storage devices of the same type or different types. The first storage unit 130 and the second storage unit 140 may be storage devices of the same or different types. For example, the first storage unit 130 and the third storage unit 160 may be Dynamic Random Access Memory (DRAM), and the first storage unit 130 and the third storage unit 160 may be the same memory or separate different memories. The first storage unit 130 is accessible to the computing unit 120 and may store measurement images generated by the computing unit 120 based on measurement signals and / or analysis images generated by the computing unit 120 after analyzing the measurement images. In some embodiments, the first storage unit 130 may store modules written by the control unit 110. The third storage unit 160 is accessible to the control unit 110 and may store measurement images and / or analysis images. The second storage unit 140 may be flash memory. The second storage unit 140 is accessible to the control unit 110 and stores one or more computing modules 141.

[0039] Figure 2 This is a schematic diagram illustrating the communication between the main control device and the display device according to an embodiment of this disclosure. (See reference) Figure 1 and Figure 2In this embodiment, the X-ray device 100 can first connect (communicate) with the electronic device 200, which can be, for example, a personal computer (PC), laptop, tablet, or smartphone, and can output or automatically output control signals to the X-ray device 100 according to user control. For example, when a user needs to use the X-ray device 100 to measure and analyze X-ray images of the lung measurement area, the user can turn on the X-ray device 100 and connect it through the electronic device 200. The user can operate the electronic device 200 so that the electronic device 200 can output corresponding control signals to the X-ray device 100 to set the X-ray device 100 to execute the measurement module corresponding to the lung measurement area. For example, before activating the calculation module 141 stored in the X-ray device 100, the control unit 110 of the X-ray device 100 receives the control signal. Next, the X-ray device 100 and the electronic device 200 can be disconnected, and the user can move the X-ray device 100 to another location for image measurement. For example, the control signal can be provided by a device other than the X-ray device 100, or the control signal can be provided by a unit other than the control unit 110 located inside the X-ray device 100, and this disclosure is not limited thereto.

[0040] In other embodiments disclosed herein, the X-ray device 100 can perform an image measurement function for X-ray images via a setting. Furthermore, the X-ray device 100 can further display the current operating mode via a display screen or status light located on the side of the device. For example, when the X-ray device 100 activates the aforementioned image analysis function for X-ray images, the display screen or status light may display a first display state. When the X-ray device 100 does not activate (or deactivate) the aforementioned image analysis function for X-ray images, but performs an image measurement function for X-ray images, the display screen or status light may display a second display state. Alternatively, when the X-ray device 100 determines that the measured image includes a lung measurement area corresponding to a set setting, the display screen or status light may display a third display state. When the X-ray device 100 determines that the measured image does not include a lung measurement area corresponding to a set setting, the display screen or status light may display a fourth display state. Therefore, the user can confirm the current operating state of the X-ray device 100 via the display screen or status light.

[0041] Figure 3 This is a flowchart of an X-ray image processing method according to an embodiment of this disclosure. (See reference) Figures 1 to 3 When the X-ray device 100 completes the above-described process... Figure 2 After the operation of the embodiment, the X-ray device 100 can perform... Figure 3 The steps S310 to S370 are shown. In step S310, the control unit 110 can activate one of the multiple calculation modules stored in the X-ray device according to a control signal, wherein one of the multiple calculation modules corresponds to the measurement area. Specifically, as shown... Figure 1 The control unit 110 can activate the computing module 141 stored in the second storage unit 140 according to the control signal. The control unit 110 can first search for the storage location of the computing module 141 in the second storage unit 140. In step S320, the image measurement module 150 can measure the measurement area corresponding to one of the multiple computing modules and generate a measurement signal. In step S330, the image measurement module 150 can transmit the measurement signal to the computing unit 120. In step S340, the computing unit 120 can calculate the measurement image according to the measurement signal and store the measurement image in the first storage unit 130 of the X-ray device 100. Specifically, with reference to... Figure 4A The image measurement module 150 can measure the measurement area corresponding to one of the calculation modules 141 and generate a corresponding measurement signal. The image measurement module 150 can provide the measurement signal to the calculation unit 120. The calculation unit 120 can calculate the measurement image 410 based on the measurement signal and store the measurement image 410 in the first storage unit 130 of the X-ray device.

[0042] In step S350, one of the multiple computing modules is written to computing unit 120. Specifically, as follows: Figure 1 The control unit 110 can write one of the activated computing modules 141 to the computing unit 120. In other words, when the computing unit 120 wants to perform image analysis processing of a measurement image corresponding to a specific measurement area, since the control unit 110 has searched the storage location of the computing module 141 in the second storage unit 140, it can write it to the computing unit 120 for execution. Next, in step S360, the measurement image can be transferred to the computing unit 120 through the first storage unit 130. In step S370, the computing unit 120 can use one of the multiple computing modules 141 to analyze the measurement image and generate an analysis image. Specifically, with reference to... Figure 4B and Figure 4C The first storage unit 130 can transmit the stored measurement image 410 to the computing unit 120, and the computing unit 120 executes one of the computing modules 141 to analyze the measurement image 410. More specifically, the computing unit 120 can perform image analysis on the measurement region 420 in the measurement image 410.

[0043] It is worth noting that at least one of the multiple calculation modules 141 may include an algorithm, and the algorithm is used to perform grayscale value calculation processing on the measurement image 410. The measurement region 420 may be the region corresponding to the lung. The calculation unit 120 can determine the measurement region 420 in the measurement image 410. After the calculation unit 120 uses the calculation module 141 to perform image analysis on the measurement region 420 in the measurement image 410, it can generate an analysis image 430. The algorithm may include an artificial intelligence (AI) operation model, a neural network (NN) operation model, or a combination of the above models, and may perform deep learning. Through training, it can perform image analysis and recognition on X-ray images of specific parts of the human body. For example, the algorithm may include, for example, a U-Net deep learning segmentation network model or a similar semantic segmentation mode. The calculation unit 120 may first execute the above model to determine the measurement region 420 in the measurement image 410. The measurement image 410 can be a grayscale image, and the computing unit 120 can calculate the grayscale values ​​of each pixel in the measurement image 410. Furthermore, the algorithm may include, for example, a deep residual network (ResNet) model and / or a gradient-weighted class activation mapping (GRAD-CAM) model. The computing unit 120 can then execute, for example, the deep residual network model to determine the abnormal region 431 in the measurement region 420, and execute, for example, the gradient-weighted class activation mapping model to perform heatmap coloring processing to generate the analysis image 430. In other words, if there is an abnormal region 431 in the measurement region 420 of the measurement image 410, such as abnormal changes in lung tissue caused by pneumonia, in some embodiments, the pixels in the analysis image 430 corresponding to the location of the abnormal region 431 will present a specific color distribution to remind the user or medical personnel that the lung tissue at the corresponding location of the specific color distribution in the analysis image 430 can be used for medical image diagnosis. In other embodiments, the location in the analysis image 430 corresponding to the abnormal region 431 can be presented using different gray levels to facilitate medical image diagnosis by the user.

[0044] In this embodiment, the measurement image 410 and / or analysis image 430 generated by the computing unit 120 can be stored in the first storage unit 130 or the third storage unit 160. When the X-ray device 100 is connected to the display device, the control unit 110 can access the first storage unit 130 or the third storage unit 160 to output the measurement image 410 and / or analysis image 430 to the display device for display. Alternatively, in some embodiments disclosed herein, the X-ray device 100 may include a display device capable of displaying the measurement image 410 and / or analysis image 430. Accordingly, the X-ray image processing method and / or the X-ray device 100 of this embodiment can quickly generate the corresponding analysis image 430 based on the measurement image 410.

[0045] Figure 5 This is a flowchart of the output measurement image and analysis image of one embodiment of the present disclosure. Figure 6 This is a schematic diagram of the output measurement image and analysis image according to an embodiment of this disclosure. (Reference) Figure 5 and Figure 6 In some embodiments disclosed herein, when the X-ray device 100 completes the above... Figure 3 After the image processing and / or analysis operations of the embodiment, the X-ray device 100 may continue to execute the following steps S510 to S540. In step S510, the X-ray device 100 and the display device 600 may be connected. For example, the X-ray device 100 can be connected to the display device 600 via a connecting cable, or the X-ray device 100 can be connected to the display device 600 via Bluetooth or Wi-Fi, but this disclosure is not limited thereto. The display device 600 may be as described above. Figure 2 The electronic device 200, or the one described above Figure 2 The electronic device 200 has different devices. In step S520, the measurement image 410 and / or analysis image 430 are output to the display device 600. Figure 6 After the computing unit of the X-ray apparatus 100 generates the analysis image, the control unit of the X-ray apparatus 100 can output the measurement image 410 and / or the analysis image 430 to the display device 600. In step S530, the display device 600 can receive the measurement image 410 and / or the analysis image 430. In step S540, the display device 600 can display the measurement image 410 and / or the analysis image 430.

[0046] Accordingly, the display device 600 does not need to perform additional image analysis processing calculations. Instead, the X-ray device 100 performs the image analysis processing of the measurement image 410 before connecting to the display device 600. Therefore, after the display device 600 is connected to the X-ray device 100, the user can quickly obtain the X-ray measurement results and / or the X-ray image analysis results corresponding to a specific measurement site through the display device 600. From another perspective, the above-described X-ray image processing method can reduce the hardware requirements of the display device 600.

[0047] In summary, the X-ray image processing method disclosed herein can execute a calculation module corresponding to a specific measurement area to perform real-time image analysis on the acquired measurement image and generate a corresponding analysis image. The X-ray image processing method disclosed herein can transmit the measurement image and / or analysis image to a display device for display, reducing the need for external communication and / or external image data processing during the X-ray image processing process.

[0048] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present disclosure, rather than to limit them. Although the present disclosure has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present disclosure.

Claims

1. A method for processing X-ray images, characterized in that, include: Activate one of a plurality of computing modules stored in the X-ray device, wherein the one of the plurality of computing modules corresponds to the measurement area; The image measurement module measures the measurement area corresponding to one of the plurality of computing modules and generates a measurement signal. The measurement signal is transmitted to the computing unit via the image measurement module; The calculation unit calculates the measurement image based on the measurement signal and stores the measurement image in the first storage unit of the X-ray device; Write one of the plurality of computing modules to the computing unit; The measurement image is transmitted to the computing unit via the first storage unit; and The measurement image is analyzed by the computing unit using one of the plurality of computing modules, and an analysis image is generated. The steps of analyzing the measured image and generating the analyzed image include: The U-Net deep learning segmentation network model or a similar semantic segmentation model is executed to determine the measurement region in the measurement image; The deep residual network model is executed to calculate the grayscale values ​​of each pixel in the measured image, and abnormal areas in the measured region are identified; and A gradient-weighted class activation mapping model is performed to colorize the heatmap, thereby generating the analysis image.

2. The X-ray image processing method according to claim 1, characterized in that, After the analysis image is generated by the computing unit, the measurement image and the analysis image are output.

3. The X-ray image processing method according to claim 2, characterized in that, Also includes: Output the measurement image and the analysis image to the display device; as well as The measurement image and the analysis image are displayed on the display device.

4. The X-ray image processing method according to claim 1, characterized in that, The plurality of computing modules are stored in the second storage unit of the X-ray device.

5. The X-ray image processing method according to claim 4, characterized in that, The first storage unit and the second storage unit are storage devices of different types.

6. The X-ray image processing method according to claim 1, characterized in that, The control unit of the X-ray device activates one of the plurality of computing modules.

7. The X-ray image processing method according to claim 1, characterized in that, Before activating one of the plurality of computing modules stored in the X-ray apparatus, the control unit of the X-ray apparatus receives a control signal.

8. The X-ray image processing method according to claim 1, characterized in that, One of the plurality of computing modules includes an algorithm, and the algorithm is used to perform grayscale value calculation processing on the measured image.

9. The X-ray image processing method according to claim 1, characterized in that, The measurement area is the region corresponding to the lungs.

10. The X-ray image processing method according to claim 1, characterized in that, The X-ray device is an X-ray flat panel detector.

Images