Image generation device, image generation method and program
The image generation device and method generate virtual scintillation images using photon count data and convolution filters to address the challenges of Poisson noise and unpredictability in photon count and integral scintillation imaging, enhancing diagnosis and reducing costs and development time.
Patent Information
- Application Number
- JP2023070925
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-04-24
- Publication Date
- 2024-11-06
- Estimated Expiration
- 2043-04-24
Smart Images

Figure 2024156450000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to radiation imaging, for example, medical radiography, and more particularly to an image generating apparatus, an image generating method, and a program. [Background technology]
[0002] As a method for imaging flying particles such as penetrating X-rays, which is typified by medical X-ray radiography, integral scintillation imaging using a scintillator and an optical imaging element is the mainstream.
[0003] Recently, photon count imaging has been proposed, which counts the number of particles incident on each pixel of an image sensor and creates an image using a semiconductor material that generates an electrical signal in response to the incident particles.
[0004] Furthermore, indirect photon count imaging using a scintillator and an optical imaging element has also been proposed (for example, Patent Document 1). [Prior art documents] [Patent documents]
[0005] [Patent Document 1] JP 2017-020912 A Summary of the Invention [Problem to be solved by the invention]
[0006] However, although the above-mentioned photon count imaging provides clear images with high contrast, it also contains a large amount of Poisson noise, and the image properties are significantly different from the scintillation images that clinicians are accustomed to seeing. Therefore, there is a disadvantage that it is difficult for clinicians to make a diagnosis.
[0007] On the other hand, in integral scintillation imaging, the generated image is greatly affected by the characteristics of the scintillator and the image sensor, and it is difficult to predict the effect of this unless an imaging panel is actually fabricated by combining them and then evaluated by irradiating it with X-rays. This has the disadvantage of lengthening the development period and increasing costs.
[0008] The present invention provides an image generating device, an image generating method, and a program that are capable of generating virtual scintillation images, that can reproduce integral images simultaneously and in parallel in photon count imaging, and that can predict images that will be obtained without prototyping panels in scintillation imaging, thereby facilitating diagnosis, shortening development time, and reducing costs. [Means for solving the problem]
[0009] An image generating device according to a first aspect of the present invention includes a photon count image generating unit that generates a photon count image of a flying particle using actual measurements or random numbers, a filter generating unit that generates a convolution filter that reflects the internal diffusion state of scintillation light in an arbitrary scintillator, and a scintillation image generating unit that generates a virtual scintillation image of the flying particle by processing the photon count image with the convolution filter.
[0010] An image generating method according to a second aspect of the present invention includes a photon count image generating step of generating a photon count image of a flying particle using actual measurements or random numbers, a filter generating step of generating a convolution filter that reflects the internal diffusion state of scintillation light in an arbitrary scintillator, and a scintillation image generating step of generating a virtual scintillation image of the flying particle by processing the photon count image with the convolution filter.
[0011] A third aspect of the present invention is a program for causing a computer to execute each step of the image generating method. Effect of the Invention
[0012] According to the present invention, it is possible to generate a virtual scintillation image, and in photon count imaging, integral images can be reproduced simultaneously and in parallel, and in scintillation imaging, it is possible to predict the image that will be obtained without prototyping a panel, thereby making it possible to facilitate diagnosis, shorten development time, and reduce costs. [Brief description of the drawings]
[0013] [Figure 1] 1 is a block diagram showing an example of a basic configuration of an image generating device according to an embodiment of the present invention. [Diagram 2] 1 is a flowchart for explaining a basic concept of the present invention and an image generation procedure employed in this embodiment. [Diagram 3] FIG. 1 is an explanatory diagram of an imaging configuration assumed for generating a photon count image. [Figure 4] 11A and 11B are diagrams for explaining a procedure for generating a virtual photon count image. [Diagram 5] FIG. 2 is an explanatory diagram (cross-sectional view) of an imaging configuration for imaging an emission bright spot of one X-ray photon. [Figure 6] FIG. 13 is a diagram showing an example of a filter kernel obtained by imaging a bright spot emitting a single X-ray photon. [Figure 7] 1 is a diagram for explaining, in a one-dimensional simplified manner, the basic procedure for generating a filter kernel corresponding to a large pixel from a filter kernel corresponding to a small pixel. [Figure 8] FIG. 1 is a diagram with reference to the kernel of a general Gaussian filter. [Figure 9] 10 is a flowchart for explaining a second image generating procedure employed in the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. An embodiment of the present invention relates to radiation imaging, for example, medical transmission X-ray imaging, and in particular, this embodiment provides an image generating apparatus and an image generating method for generating a virtual scintillation image by an arbitrary scintillator from a photon count image.
[0015] With the present invention, photon count imaging allows clinicians to obtain a clear photon count image as well as the familiar scintillation image. On the other hand, in scintillation imaging, a virtual photon count image is generated, and then a scintillation image is generated from it, making it possible to predict the image that will be obtained without prototyping an imaging panel. This significantly improves the efficiency of developing imaging panels.
[0016] In the embodiments of the present invention, X-rays are exemplified as radiation, but radiation in the present invention may include α-rays, β-rays, γ-rays, etc., which are beams formed by particles (including photons) emitted by radioactive decay, as well as beams having the same or greater energy, such as X-rays, particle beams, and cosmic rays.
[0017] <Basic configuration example of an image generating device> FIG. 1 is a block diagram showing an example of a basic configuration of an image generating device according to an embodiment of the present invention.
[0018] As shown in FIG. 1, an image generating device 100 according to this embodiment includes a photon count image generating section 110, a filter generating section 120, and a scintillation image generating section .
[0019] The photon count image generating unit 110 generates a photon count image of flying particles such as X-rays using actual measurements or random numbers.
[0020] The filter generating unit 120 generates a convolution filter that reflects the internal diffusion state of the scintillation light in an arbitrary scintillator.
[0021] The scintillation image generating unit 130 processes the generated photon count image using a convolution filter, thereby generating a virtual scintillation image of the flying particles.
[0022] In the example of Figure 1, when the photon count image is generated using random numbers, the scintillation image generation unit 130 has a function of generating a realistic scintillation image by adding system noise to the generated virtual scintillation image.
[0023] In addition, in the case where the photon count image is generated using random numbers in the image generating device 100, it is also possible to configure the photon count image generating unit 110 to add scintillation noise to the generated virtual photon counts to generate a realistic photon count image.
[0024] The basic concept of the present invention and the image generation procedure employed in this embodiment will be described below with reference to the flowchart of FIG. FIG. 2 is a flowchart for explaining the basic concept and image generation procedure of the present invention employed in this embodiment.
[0025] <Basic concept and flow chart of the invention> The present invention virtually generates a scintillation image equivalent to an image obtained by actual integral imaging using a photon count image and a convolution filter, without performing integral imaging. The flow chart is shown in Figure 2. The flow is divided into two cases, CS1 and CS2, depending on the application.
[0026] The first case CS1 corresponds to a photon counting type imaging device. A photon-counting imaging device using the present invention simultaneously generates a photon-counting image as well as an integral-type image that is generally familiar to clinicians, and provides these images as a set.
[0027] The second case CS2 mainly contributes to the development of an imaging panel for integral imaging. The imaging panel is realized by combining any scintillator and an optical imaging element. However, the X-ray transmission images obtained vary greatly depending on the X-ray dose, radiation quality, the scintillator's luminescence performance, light diffusion within the scintillator, the pixel size of the optical imaging element, and the noise performance of the optical imaging element, making it difficult to predict in advance. The present invention enables a highly accurate and easy generation of a virtual integral image that comprehensively reflects these elements, thereby making it possible to predict panel performance.
[0028] The first step (ST1 to ST4) in the flow of FIG. 2 is processing related to generation of a photon count image in photon count image generating section 110. Here, the photon count image refers to an image or image data that is composed of the count number of flying particles that are incident on each pixel area that is divided at predetermined intervals.
[0029] In the first case CS1, the photon counting image is acquired through actual measurement using a photon counting imaging device. On the other hand, in the second case CS2, the radiation dose is virtually generated using the calculated penetration dose and random numbers. This procedure will be described in detail later.
[0030] The second step in the flow (ST5, ST6) is to generate a convolution filter that reflects the light diffusion in the scintillator in the filter generation unit 120 and the scintillation image generation unit 130, and to apply the convolution filter to the generated photon count image (ST6). The convolution filters are generated based on actual measurements for each scintillator, and differ depending on the pixel size of the assumed optical imaging element. The detailed procedure for generating such a filter and its application will be described later.
[0031] The scintillation image obtained at this point (ST7) is an ideal scintillation image that does not include system noise associated with readout of the optical imaging element, etc. Here, in the first case CS1, in addition to a high contrast photon count image, a low noise integral image with the same pixel size can be provided to the clinician.
[0032] On the other hand, when predicting the performance of the imaging panel in the second case CS2, system noise, including the readout noise of the optical imaging element, is uniformly added to this image for each pixel, which generates a realistic scintillation image.
[0033] For example, if a scintillator manufacturer provides a convolution filter for each scintillator that it sells, an imaging panel manufacturer can virtually generate a scintillation image in combination with any optical imaging element and predict its performance.
[0034] <Example of generating a virtual photon count image> Here, a procedure for generating a virtual photon count image using random numbers in the photon count image generation in the first steps ST1 to ST5 of the flowchart in FIG. 2 will be described below. FIG. 3 is an explanatory diagram of an imaging configuration assumed for generating a photon count image. FIG. 4 is a diagram for explaining a procedure for generating a virtual photon count image.
[0035] An example of the imaging configuration for photon count imaging is shown in Fig. 3. In Fig. 3, 1 indicates an imaging element, 2, 2b_1, and 2b_2 indicate pixels, 3 indicates an object, 4 and 4b indicate test pattern regions, 5 indicates a background region, and 6 indicates an X-ray. 3 shows how X-rays 6 pass through a subject 3 and reach an image sensor 1. Although actual X-rays have a spread, for the sake of simplicity, they are described here as parallel rays.
[0036] The subject 3 is, for example, a phantom for performance testing, and a disk-shaped test pattern 4 with a transmittance of 40% is formed on a background 5 with a transmittance of 30% for X-rays 6. A plurality of pixels 2 are formed in an array on the imaging element 1, and the number of X-ray photons incident on each pixel is counted. X-rays 6 are irradiated onto the subject 3 at an average density of 1000 photons per pixel.
[0037] Figure 4 shows the data values of the photon count image generated by the configuration of Figure 3, together with a projection 4b of the test pattern 4 onto the image sensor. F4_1 shows the average pixel output when an infinite number of exposures are performed. The average output of pixel 2b_1, which is completely included in the projection 4b of the test pattern, is 300, which is 30% of 1000 photons. Pixel 2b_2, which is outside the projection 4b of the test pattern and is completely contained in the background, has an output of 400, which is 40% of 1000 photons. Pixels that partially contain the projection of the test pattern generate a linear output between 300 and 400 depending on their area occupancy.
[0038] On the other hand, the actual photon count image F4_2 is obtained by adding Poisson noise to the image F4_1. This can be achieved, for example, by generating a random number with a Poisson distribution for each pixel output in image F4_1, with the average occurrence frequency λ. For simplicity, it is possible to generate random numbers with a normal distribution with a mean value of λ and a standard deviation of √λ. Since the image quality of a photon count image is dominated by Poisson noise, reproducing this noise using random numbers is the key to generating a virtual image.
[0039] The X-ray transmittance of the subject 3 can be easily calculated if the radiation quality (intensity spectrum) of the X-rays and the material composition of the subject 3 are known. In addition, since X-rays are usually irradiated from a light source close to a point source, their intensity is inversely proportional to the square of the distance from the light source. Therefore, the number of X-rays incident on the image sensor 1 can be corrected taking this into account.
[0040] <Example of generating a convolution filter> In the embodiment of the present invention, an example of creating a convolution filter corresponding to the light diffusion of an arbitrary scintillator through actual measurement will be described below.
[0041] FIG. 5 is an explanatory diagram (cross-sectional view) of an imaging configuration for imaging an emission bright spot of one X-ray photon. FIG. 6 is a diagram showing an example of a filter kernel obtained by imaging a bright spot emitting a single X-ray photon.
[0042] The actual measurement is carried out by imaging the luminescent spot of a single X-ray photon using a scintillator. Figure 5 shows a cross-sectional view of the imaging device used for the measurement. In Figure 5, 7 indicates an optical imaging element (image sensor), 8 indicates an imaging surface (pixel array), 9 indicates an adhesive layer, 10 indicates a scintillator plate, 11 indicates a scintillator, 12 indicates an FOP (fiber optic plate), 13 indicates one X-ray photon, and 14 indicates scintillation emission of one X-ray photon.
[0043] The imaging device is configured by bonding a scintillator plate 10 to an optical imaging element (image sensor) 7 via an adhesive layer 9. The optical imaging element 7 has an imaging surface 8 consisting of a pixel array. The scintillator plate 10 is configured by laminating a scintillator 11 and an FOP (fiber optical plate) for protecting the optical imaging element from direct incidence of X-rays. When a single X-ray photon 13 is incident on the scintillator 11, it generates scintillation light 14. The scintillation light 14 is diffused in the scintillator plate 10 and then imaged by the optical imaging element 7. This is recorded as an image of a bright spot emitting a single X-ray photon.
[0044] The luminescence intensity and light diffusion of the scintillation light 14 vary widely depending on the intensity spectrum distribution of the X-rays and the depth at which the X-rays react with the scintillator 11. Furthermore, noise from the optical imaging element 7 and the system, shot noise from the scintillation light, and the like also contribute, resulting in each luminescent bright spot image being different. However, by collecting many such images of bright spots and averaging them, it is possible to obtain a single light intensity profile that reflects the light diffusion of the scintillator plate 10. This is the light diffusion profile of the pixelated scintillator, and is used to generate the filter kernel.
[0045] An example of a filter kernel generated by actual measurement is shown in Figure 6. The filter kernel values (coefficients) are set corresponding to the 71x71 XY pixel arrangement with the center coordinates at (0,0). This was generated through the following process. 1. Using an image sensor with 15-micron square pixels and a mammography scintillator plate, many bright spots that emit single X-ray photons are captured. 2. Obtain pixel output within a concentric circle at a distance of 35 pixels from the pixel at the center of light emission of the bright spot. The image is subtracted from the average of many dark images taken with the same exposure time to remove offsets due to dark current. Bright spots are automatically extracted by the program, and bright spots whose concentric areas overlap with each other or extend beyond the frame are removed from the evaluation targets. 3. Obtain the pixel output within a concentric circle for approximately 18,000 bright spots, and obtain the average value for each pixel that has the same relative coordinate from the center of light emission. 4. Divide the output value of each pixel in the averaged concentric circle by the output sum. This creates a 71x71 filter kernel (all pixels outside the circle are set to 0).
[0046] Such a filter kernel is unique depending on the pixel size of the scintillator plate 10 and the optical imaging element 7 in the imaging device of Fig. 5. When applying this as a convolution filter to a photon count image, the pixel size of the assumed imaging element must match. The application of the filter follows that of a normal discrete convolution filter: for each pixel in the photon count image, the output of neighboring pixels is multiplied by the coefficient value of the filter kernel according to the relative coordinate from the center of the filter kernel, and the sum of these is used as the pixel output of the output image.
[0047] That is, if the coefficients of the 71x71 filter kernel are Wi,j and the pixel output value of the photon count image is I(x,y), the pixel output value J(x,y) after application of the filter is given by the following equation.
[0048]
number
[0049] <Additional generation of filter kernels for large pixels> Incidentally, a filter kernel corresponding to a large pixel can be generated from a filter kernel corresponding to a smaller pixel by numerical calculation. Therefore, for example, by using the actual measurement results of the filter generation described above, a filter kernel can be generated for any optical imaging element having pixels of 15 microns or more square corresponding to the same scintillator, and a virtual scintillation image can be generated.
[0050] FIG. 7 shows an example of generating a filter kernel with 25 micron intervals from a filter kernel with 15 micron intervals, in one dimension for simplicity. F7_1 is a one-dimensional filter kernel with 15 micron spacing. In F7_2, five kernels are shifted horizontally at 5 micron intervals to correspond to the central 25 micron region, and are evenly spaced from the center. In other words, five kernels are shifted -10 microns, -5 microns, 0 microns, 5 microns, and 10 microns. In F7_3, the above kernel was added to areas spaced 5 microns apart. F7_4 is then rounded by taking the average of F7_3 at 25 micron intervals from the center. If necessary, the coefficients are normalized so that the sum of the coefficients is 1.
[0051] The key point here is that instead of simply rounding the filter, multiple filter kernels that are shifted at equal intervals are placed and then rounded. Simple rounding would reflect the case where X-rays are only incident on the central 15 micron region of a 25 micron pixel, which would degrade the accuracy of the kernel. As a countermeasure to this, the shift placement is used. This type of processing can be easily achieved by numerical calculation.
[0052] For example, a scintillator manufacturer may obtain the basic kernel of its own scintillator from the above-mentioned actual measurement evaluation, and provide an application on the Web that generates a filter kernel according to the input of the scintillator selection and pixel size. This enables panel manufacturers to predict in advance the scintillation image that will be obtained by combining the above scintillator with any optical imaging element, without having to prototype the panel.
[0053] <Filters for use in photon-counting imaging devices> By the way, when applying a filter to a photon count image obtained by a photon count imaging device, a specific scintillator is not specified. For example, a general scintillator used for the same purpose in integral imaging is arbitrarily assumed, and a filter that reflects the light diffusion inside the scintillator and matches the pixel size of the imaging device is applied. In this case, actual measurement is not necessarily required, and existing data obtained elsewhere may be used, for example. Alternatively, a filter can be generated by imitating the data. The key to reproducing the integral image that clinicians are accustomed to seeing is to reflect the general properties of light diffusion inside the scintillator.
[0054] A Gaussian filter is a common filter used to remove noise from images. An example of a Gaussian filter kernel with a standard deviation three times the pixel width is shown in Figure 8. The noise removal effect of this filter is roughly equivalent to that of the scintillator filter kernel shown in Figure 6. The scintillator filter kernel shown in Figure 6 has the following clear characteristics. That is, compared to a Gaussian filter with the same noise removal effect, the profile slope is steeper near the center of the bright spot, while the slope is gentler farther away, with a long tail. As a result, compared to a Gaussian filter, the values are large near and far from the center of the bright spot, and small in between. Such filtering properties are unique to scintillators with columnar crystal structures used in medical imaging such as high definition mammography.
[0055] A desirable form of the photon counting imaging system using the present invention is to provide a virtual integral image that is filtered to reflect the light diffusion in the scintillator as described above, in addition to the photon count image. Furthermore, an image that is Gaussian filtered may be provided as an intermediate stage. For example, by gradually increasing the standard deviation of the Gaussian filter from a small value, an image with gradually reduced noise is provided from a clear but noisy photon count image. This leads to a virtual integral image that is familiar to clinicians. This provides more information for detecting lesions.
[0056] FIG. 9 shows a flowchart for explaining a second image generating procedure employed in this embodiment. In the above embodiment, the first image generation procedure associated with FIG. 2 has been described. However, as the image generation procedure, for example, the second image generation procedure shown in FIG. 9 may also be adopted. That is, since variations in the light emission of the scintillator may generate noise, this factor may be added to the rear of the photon count image as step ST11 (addition of scintillation noise). For example, if the pixel count value is A, the standard deviation σ of the noise caused by a 20% emission variation is σ = (0.2 2 xA) 0.5 It becomes. Therefore, for example, random numbers that follow a normal distribution with a mean of 0 and a standard deviation of σ are generated and added as noise to each pixel value of the photon count image. Note that while the output values of the photon count image generated by the poisson random numbers are integers, the noise added here and each pixel value after the noise is added are decimal or floating point numbers.
[0057] The present invention can also be realized by executing the following process: That is, software (programs) that realize the functions of the above-described embodiments are supplied to a system or device via a network or various storage media, and the computer (or CPU, MPU, etc.) of the system or device reads and executes the programs.
[0058] By using this invention, in the development of X-ray imaging panels, it is possible to predict the performance of any combination of scintillator and optical imaging element in advance without fabricating a prototype panel, which makes it possible to significantly reduce development costs and time.
[0059] On the other hand, photon counting medical imaging devices can provide integral scintillation images that clinicians are familiar with at the same time as photon count images, making it possible to provide more information for lesion detection. [Explanation of symbols]
[0060] 1. Image sensor 2,2b_1,2b_2 pixels 3. Subject 4,4b Test pattern area 5 Background area 6 X-ray 7 Optical imaging element (image sensor) 8 Imaging surface (pixel array) 9 Adhesive layer 10 Scintillator Plate 11 Scintillator 12 FOP (Fiber Optic Plate) 13 X-ray 1 photon 14 Scintillation emission of one X-ray photon 100 Image generating device 110 Photon count image generator 120 Filter Generation Unit 130 Scintillation image generator
Claims
1. a photon count image generator that generates a photon count image of flying particles using actual measurements or random numbers; a filter generating unit that generates a convolution filter that reflects the internal diffusion state of scintillation light in an arbitrary scintillator; a scintillation image generator that processes the photon count image using the filter to generate a virtual scintillation image of the flying particles; An image generating device comprising:
2. The scintillation image generating unit If the photon count image is generated using random numbers, a realistic scintillation image is generated by adding system noise to the generated virtual scintillation image.
2. The image generating device according to claim 1.
3. The photon count image generating unit If the photon count image is generated using random numbers, a realistic photon count image is generated by adding scintillation noise to the generated virtual photon count.
2. The image generating device according to claim 1.
4. The photon count image generating unit If the photon count image is generated using random numbers, adding scintillation noise to the generated virtual photon counts to generate a realistic photon count image; The scintillation image generating unit Since the photon count image is generated using random numbers, a realistic scintillation image is generated by adding system noise to the generated virtual scintillation image.
2. The image generating device according to claim 1.
5. The fill generation unit It is possible to generate a filter kernel corresponding to a larger pixel by numerical calculation from a filter kernel corresponding to a smaller pixel. Rounding is performed after placing multiple filter kernels that are shifted at equal intervals.
2. The image generating device according to claim 1.
6. a photon count image generation step of generating a photon count image of flying particles using actual measurements or random numbers; a filter generation step of generating a convolution filter that reflects the internal diffusion state of scintillation light in an arbitrary scintillator; a scintillation image generating step of generating a virtual scintillation image of flying particles by processing the photon count image with the convolution filter; An image generation method comprising:
7. In the scintillation image generating step, If the photon count image is generated using random numbers, a realistic scintillation image is generated by adding system noise to the generated virtual scintillation image.
7. The image generating method according to claim 6.
8. The photon count image generation step includes: If the photon count image is generated using random numbers, a realistic photon count image is generated by adding scintillation noise to the generated virtual photon count.
7. The image generating method according to claim 6.
9. In the fill generation process, It is possible to generate a filter kernel corresponding to a larger pixel by numerical calculation from a filter kernel corresponding to a smaller pixel. Rounding is performed after placing multiple filter kernels that are shifted at equal intervals.
7. The image generating method according to claim 6.
10. A program for causing a computer to execute each step of the image generating method according to any one of claims 6 to 9.
Citation Information
Patent Citations
Temperature compensation circuit for silicon photomultipliers and other single photon counters
CN102246058A
Photon detection device and radiation measuring device
JP2014215145A
Nuclear detection simulation device based on nanosecond light source and nuclear signal inversion technology
US20230010244A1
Radiographic imaging device, control method therefor, and program
JP2017020912A
