Radiography system, information processing device, and information processing method
The radiographic system uses a patterned marker and visible light imaging to accurately measure breast thickness, addressing the issue of compression plate inclination and enhancing mammography diagnostics.
Patent Information
- Application Number
- JP2021016788
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-02-04
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2041-02-04
AI Technical Summary
Existing mammography techniques struggle to accurately measure breast thickness due to the influence of compression plate inclination or deflection, leading to overlapping breast and marker images and inaccurate measurements.
A radiographic system with a compression plate featuring a two-dimensional patterned marker, a radiation source, a camera for visible light imaging, and a height information derivation unit that calculates breast thickness by analyzing the marker's image distortion, accounting for plate inclination.
Accurately measures breast thickness while considering compression plate tilt or deflection, enhancing diagnostic precision by minimizing marker interference and improving imaging conditions.
Smart Images

Figure 0007581070000001 
Figure 0007581070000002 
Figure 0007581070000003
Abstract
Description
[Technical field]
[0001] The technology disclosed herein relates to a radiation imaging system, a radiation imaging apparatus, an information processing apparatus, and an information processing method. [Background technology]
[0002] Mammography devices that use radiation to capture images of a subject's breasts are known. Mammography devices are provided with a compression plate that is configured to be movable toward and away from an imaging table that has a built-in radiation detector. In mammography, in order to spread and fix the subject's breast, the breast is sandwiched and compressed between the imaging table and the compression plate. By spreading and compressing the breast thinly, overlapping of mammary glands is reduced, making it easier to find lesions. Furthermore, by making the breast thin, it is possible to reduce the amount of radiation required for imaging.
[0003] In mammography, the thickness of the compressed breast, i.e., the height of the compression plate relative to the imaging table, is important information for determining imaging conditions and various image conditions. Various methods are known for measuring the compressed breast thickness. For example, Patent Document 1 describes a method in which a marker that absorbs radiation is provided on the compression plate, and the height of the compression plate is measured based on the image of the marker captured in the radiation image. Patent Document 2 describes a method in which the height of the compression plate is measured by acquiring an image of the side of the breast compressed by the compression plate using an optical camera. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2015-177884 A [Patent Document 2] JP 2017-225634 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, in the technology described in Patent Document 1, the marker image is captured in the radiation image, so the breast image and the marker image may overlap. When the breast image and the marker image overlap in this way, the marker image becomes an obstacle to breast diagnosis. In order to prevent the breast image and the marker image from overlapping, the marker must be placed at the end of the compression plate. Therefore, in the technology described in Patent Document 1, the height of the end of the compression plate is measured.
[0006] In the technology described in Patent Document 2, the height of the compression plate is measured based on an image of the side of the breast, and thus, similar to the technology described in Patent Document 1, the measured height is the height of the end of the compression plate.
[0007] The compression plate may tilt or bend. If the compression plate tilts or bends, the breast thickness cannot be measured accurately. The techniques described in Patent Documents 1 and 2 both measure the height of the end of the compression plate, and therefore cannot measure the breast thickness accurately while taking into account the effects of the tilt or bending of the compression plate.
[0008] The technology disclosed herein aims to provide a radiography system, a radiography device, an information processing device, and an information processing method that enable accurate measurement of breast thickness while taking into account the effects of inclination or deflection of a compression plate. [Means for solving the problem]
[0009] In order to achieve the above-mentioned object, the radiography system disclosed herein comprises an imaging table on which a subject's breast is placed, a compression plate that compresses the breast placed on the imaging table, a marker having a two-dimensional pattern provided on the compression plate, a radiation source that irradiates the compressed breast with radiation, a camera that captures a visible light image including the marker, and a height information derivation unit that derives height information of the compression plate relative to the imaging table based on a marker image showing the marker captured in the visible light image.
[0010] It is preferable that the height information derivation unit derives the height information based on a rate of change in length of the marker image depending on the height of the compression paddle.
[0011] If the distance from the camera to the imaging table is S and the length of the marker image in one direction when the height of the compression plate relative to the imaging table is H is L(H), it is preferable that the height information derivation unit derives height information based on the relational expression H=S×(1−L(0) / L(H)).
[0012] The height information preferably includes heights of the compression paddle at multiple positions.
[0013] The two-dimensional pattern is preferably any one of a frame shape, a lattice shape, a dot shape, and a cross shape, or a combination thereof.
[0014] The marker preferably has a different color than the compression paddle.
[0015] The marker is preferably formed by attaching a member to the compression plate.
[0016] The marker is preferably radiolucent.
[0017] The marker is preferably positioned so that at least a portion of the marker overlaps the breast.
[0018] The camera is preferably provided on a holder which holds the radiation source.
[0019] It is preferable that the imaging table, the compression plate, the marker, and the camera are provided in a radiation imaging apparatus, and the height information derivation unit is provided in an information processing device connected to the radiation imaging apparatus.
[0020] The radiographic imaging device disclosed herein includes an imaging table on which the subject's breast is placed, a compression plate that compresses the breast placed on the imaging table, a marker having a two-dimensional pattern provided on the compression plate, a radiation source that irradiates radiation onto the compressed breast, and a camera that captures a visible light image including the marker.
[0021] The information processing device disclosed herein is an information processing device connected to a radiography device that includes an imaging table on which a subject's breast is placed, a compression plate that compresses the breast placed on the imaging table, a marker having a two-dimensional pattern provided on the compression plate, a radiation source that irradiates the compressed breast with radiation, and a camera that captures a visible light image including the marker, and is equipped with a processor that derives height information of the compression plate relative to the imaging table based on a marker image showing the marker captured in the visible light image.
[0022] The information processing method disclosed herein is an information processing method for a radiography device that includes an imaging table on which a subject's breast is placed, a compression plate that compresses the breast placed on the imaging table, a marker having a two-dimensional pattern provided on the compression plate, a radiation source that irradiates the compressed breast with radiation, and a camera that captures a visible light image including the marker, and derives height information of the compression plate relative to the imaging table based on a marker image showing the marker captured in the visible light image. Effect of the Invention
[0023] According to the technology disclosed herein, it is possible to provide a radiation imaging system, a radiation imaging device, an information processing device, and an information processing method that enable accurate measurement of breast thickness while taking into account the effects of inclination or deflection of the compression plate. [Brief description of the drawings]
[0024] [Figure 1] FIG. 1 is a schematic diagram illustrating an example of the configuration of a radiation imaging system. [Diagram 2] FIG. 2 is a block diagram showing an example of a hardware configuration of the radiation imaging system. [Diagram 3] FIG. 13 is a perspective view showing an example of a marker provided on a compression plate. [Figure 4] 11A and 11B are diagrams illustrating an example of a change in a visible light image according to the height of the compression plate. [Diagram 5] 11A and 11B are diagrams illustrating an example of a change in a visible light image when a compression plate is tilted. [Figure 6] 2 is a block diagram showing an example of the functional configuration of a mammography apparatus and a console. FIG. [Figure 7] 11A and 11B are diagrams illustrating an example of a process for deriving height information. [Figure 8] FIG. 11 is a diagram illustrating an example of height information. [Figure 9] FIG. 11 is a diagram illustrating an example of a smoothing process. [Figure 10] 11A and 11B are diagrams illustrating an example of a shooting condition determination process. [Figure 11] 4 is a flowchart showing an example of the operation of the radiation imaging system. [Figure 12] FIG. 13 is a diagram showing an example of a state in which the breast is compressed by a compression plate. [Figure 13] FIG. 13 is a diagram showing a first modified example of a marker. [Figure 14] FIG. 13 is a diagram showing a second modified example of the marker. [Figure 15] FIG. 13 is a diagram showing a third modified example of the marker. [Figure 16] FIG. 13 is a diagram showing an example of generating a composite two-dimensional image based on a plurality of tomographic images. [Figure 17] FIG. 13 is a diagram showing another modified example of the marker. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0025] Hereinafter, embodiments of the technology of the present disclosure will be described with reference to the drawings.
[0026] First, the configuration of a radiation imaging system according to an embodiment will be described. Fig. 1 shows the configuration of a radiation imaging system 2 according to the present embodiment.
[0027] As shown in FIG. 1, the radiation imaging system 2 has a function of capturing radiation images through the operation of a user such as a doctor or a radiologist based on information (e.g., an imaging menu) input from an external system (e.g., a Radiology Information System (RIS)) via a console 20.
[0028] The radiation imaging system 2 is composed of a mammography apparatus 10 and a console 20. The mammography apparatus 10 is an example of a "radiography apparatus" according to the technology of the present disclosure. The console 20 is an example of an "information processing device" according to the technology of the present disclosure.
[0029] The mammography device 10 is a radiation imaging device that performs radiation imaging of a subject's breasts as an imaging target. Note that the mammography device 10 may be a device that images the subject's breasts not only when the subject is standing, but also when the subject is sitting in a chair or the like, and may be a radiation imaging device that can image at least the left and right breasts of the subject separately.
[0030] The mammography apparatus 10 includes an arm unit 11 and a base 12. The arm unit 11 is connected to the base 12 via a shaft unit 13. The arm unit 11 is held by the base 12 so as to be movable in the vertical direction (Z-axis direction). The arm unit 11 is also attached to the base 12 so as to be rotatable about the shaft unit 13 as the axis of rotation. The arm unit 11 is an example of a "holding unit for holding a radiation source" according to the technology of the present disclosure.
[0031] An imaging table 14 is provided at the bottom of the arm unit 11. A radiation source 15 is provided at the top of the arm unit 11. The radiation source 15 is disposed at a position corresponding to an imaging surface 14A of the imaging table 14. The imaging surface 14A is a plane including an X-axis direction and a Y-axis direction perpendicular to the Z-axis direction. A subject's breast is placed on the imaging surface 14A.
[0032] A compression plate 16 is also attached to the arm 11 so as to be movable in the Z-axis direction. The compression plate 16 is movable toward and away from the imaging table 14. That is, the height of the compression plate 16 relative to the imaging surface 14A is variable. The compression plate 16 is a plate-shaped compression member, and has an upper surface 16A and a lower surface 16B parallel to the imaging surface 14A. The compression plate 16 compresses the breast placed on the imaging surface 14A by pressing the breast downward with the lower surface 16B.
[0033] A moving mechanism 17 for moving the compression plate 16 is provided inside the arm unit 11. The moving mechanism 17 is a linear actuator including a ball screw 17A and a motor 17B. The compression plate 16 is connected to the ball screw 17A via a support unit 18. The compression plate 16 slides between the imaging table 14 and the radiation source 15 as the motor 17B drives it.
[0034] The compression plate 16 is formed of a material that transmits the radiation R emitted by the radiation source 15. The compression plate 16 of this embodiment is formed of, for example, a thermoplastic resin material (for example, polyethylene terephthalate). Note that the material forming the compression plate 16 is not limited to this, and polycarbonate, acrylic, polypropylene, or the like can also be used. Furthermore, the compression plate 16 is preferably formed of a transparent material that transmits visible light.
[0035] The compression plate 16 is not limited to a form that compresses the entire breast, but may be a form that compresses a part of the breast. In other words, the compression plate 16 may be smaller than the breast. The compression plate 16 may also be a compression plate with a concave cross-sectional shape, with the bottom part that contacts the breast surrounded by a wall part. In addition, although it is called a "compression plate" in this disclosure for convenience, the compression plate 16 is not limited to one that uses a plate-like member, and may be one that uses, for example, a film-like member.
[0036] The radiation source 15 includes a radiation tube 15A that emits radiation R, and a collimator 15B that limits the irradiation field of the radiation R. The radiation source 15 irradiates the breast compressed by the compression plate 16 with the radiation R. The radiation R is, for example, X-rays.
[0037] A radiation detector 19 is provided inside the imaging stand 14. The radiation detector 19 is disposed so that a detection surface for detecting radiation R is parallel to the imaging surface 14A.
[0038] The radiation detector 19 detects radiation R that is emitted from the radiation source 15 and passes through the compression paddle 16 and the breast. The radiation detector 19 is a so-called flat panel detector. The radiation detector 19 has radiation detection pixels arranged two-dimensionally, and generates a radiation image by detecting the dose of radiation R incident on each radiation detection pixel.
[0039] The radiation detector 19 is, for example, an indirect conversion type radiation detector that converts radiation R into visible light and then converts the converted visible light into an electric charge. Note that the radiation detector 19 may be a direct conversion type radiation detector that directly converts radiation R into an electric charge.
[0040] Further, a camera 30 for capturing a visible light image is provided on the upper portion of the arm portion 11. The camera 30 receives visible light VL and generates a visible light image based on the received visible light VL. The camera 30 is provided, for example, near the radiation source 15. The camera 30 has an angle of view θ set so as to capture an image of an area including the upper surface 16A of the compression plate 16. As will be described in detail later, a marker having a two-dimensional pattern is provided on the upper surface 16A of the compression plate 16, and the camera 30 captures an image of at least an area including the marker. The visible light image generated by the camera 30 is used in the console 20 to derive height information of the compression plate 16 relative to the imaging table 14.
[0041] In this embodiment, the radiation image generated by the radiation detector 19 of the mammography apparatus 10 and the visible light image generated by the camera 30 are transmitted to the console 20. The console 20 has a control function for controlling the operation of the mammography apparatus 10. The console 20 controls the mammography apparatus 10 using an imaging menu or various information acquired from an external system or the like via a wireless communication LAN (Local Area Network) or the like.
[0042] The console 20 is configured with a computer. The console 20 has a display unit 21 that displays various information. The display unit 21 is a display device such as a liquid crystal display or an organic EL (Electro Luminescence) display.
[0043] 2 shows an example of a hardware configuration of the radiation imaging system 2. The mammography apparatus 10 includes a radiation source 15, a compression paddle 16, a moving mechanism 17, a radiation detector 19, a control unit 40, a memory unit 41, an I / F unit 42, and an operation panel 43. The radiation source 15, the moving mechanism 17, the radiation detector 19, the control unit 40, the memory unit 41, the I / F (Interface) unit 42, and the operation panel 43 are connected via a bus 44 so as to be able to exchange various types of information with each other.
[0044] The control unit 40 is composed of, for example, a CPU (Central Processing Unit) 40A, a RAM (Random Access Memory) 40B, and a ROM (Read Only Memory) 40C. The ROM 40C stores various data including a program 45 executed by the CPU 40A in advance. The RAM 40C has a function of temporarily storing various data.
[0045] The storage unit 41 is configured with a hard disk drive (HDD) or a solid state drive (SSD), etc. The storage unit 41 stores the radiation image generated by the radiation detector 19 and the visible light image generated by the camera 30.
[0046] The I / F unit 42 has a function of communicating various types of information with the console 20 via wireless communication or wired communication.
[0047] The operation panel 43 is, for example, a touch panel display, and receives and displays information input by the user. The user can check the imaging conditions and give instructions to start imaging via the operation panel 43. The control unit 40 performs various controls of the mammography apparatus 10 based on the instructions input via the operation panel 43.
[0048] The console 20 includes a control unit 50, a storage unit 52, an I / F unit 54, a display control unit 55, a display unit 21, an operation input detection unit 56, and an operation unit 57. The control unit 50, the storage unit 52, the I / F unit 54, the display control unit 55, and the operation input detection unit 56 are connected via a bus 58 so as to be able to transmit and receive various information to and from each other.
[0049] The control unit 50 is composed of, for example, a CPU 50A, a RAM 50B, and a ROM 50C. The ROM 50C stores various data including a program 59 executed by the CPU 50A in advance. The RAM 50C has a function of temporarily storing various data.
[0050] The I / F unit 54 has a function of communicating various types of information between the mammography apparatus 10 and an external device (not shown) by wireless or wired communication. The external device is, for example, a Radiology Information System (RIS).
[0051] The display control unit 55 has a function of controlling the display of various information on the display unit 21 described above.
[0052] The operation unit 57 is composed of a keyboard, a mouse, a touch panel, a touch pen, etc. The operation unit 57 is used when the user inputs instructions regarding radiographic image capture, etc., or various information, etc. When the operation unit 57 is a touch panel, it is possible to integrate the operation unit 57 with the display unit 21. The operation input detection unit 56 has a function of detecting user operations on the operation unit 57.
[0053] Fig. 3 shows an example of a marker M having a two-dimensional pattern provided on the compression plate 16. The marker M shown in Fig. 3 is formed by applying ink to the upper surface 16A of the compression plate 16 by a method such as screen printing. The marker M is not limited to being formed by printing, and may be formed by attaching a member such as a colored resin film.
[0054] In this example, the marker M is composed of multiple dots D arranged in a two-dimensional lattice. The dots D are arranged at equal intervals in the X-axis direction and the Y-axis direction. The intervals between the dots D in the X-axis direction and the Y-axis direction are each defined as W.
[0055] The markers M have a different color from the compression plate 16. For example, the compression plate 16 is transparent and the markers M are black. The colors of the markers M and the compression plate 16 are not limited to this, and may be other colors.
[0056] In this example, the marker M is disposed at a position where at least a part of the marker M overlaps with the breast placed on the imaging table 14. If the marker M has radiation absorption properties, the marker image will be reflected in the radiation image generated by the radiation detector 19, which will hinder breast diagnosis. For this reason, in this example, the marker M is formed of a material having radiation transparency so as not to be reflected in the radiation image. The radiation transmittance of the marker M is not limited to 100% and may be less than 100%. The radiation transmittance of the marker M may be a transmittance that is not visible in the radiation image. The radiation transmittance of the marker M may be approximately the same as the radiation transmittance of the compression plate 16. If the radiation transmittance of the marker M and the compression plate 16 is approximately the same, even if the radiation transmittance is less than 100%, the image of the marker M will not be visible in the radiation image.
[0057] The camera 30 generates a visible light image by capturing an image of the upper surface 16A on which the markers M are formed from above the compression plate 16. The size of the image of the markers M in the visible light image changes depending on the height H of the compression plate 16 relative to the imaging table 14.
[0058] FIG. 4 illustrates the change in the visible light image according to the height H of the compression plate 16. FIG. 4(A) shows an example of the visible light image PV captured by the camera 30 when H=0. H=0 is a state in which the lower surface 16B of the compression plate 16 is brought into contact with the imaging surface 14A of the imaging table 14, thereby making the distance between the compression plate 16 and the imaging table 14 0. In this case, the distance between the images (hereinafter referred to as dot images) DI of the dots D contained in the images (hereinafter referred to as marker images) MI of the markers M captured in the visible light image PV is set to L(0). The distance L(0) is the same value in the X-axis direction and the Y-axis direction.
[0059] FIG. 4B shows an example of a visible light image PV captured by the camera 30 when H>0. H>0 is a state in which the lower surface 16B of the compression plate 16 is separated from the imaging surface 14A of the imaging table 14, so that the distance between the compression plate 16 and the imaging table 14 is greater than 0. In this case, the distance between the dot images DI included in the marker image MI captured in the visible light image PV is L(H). When the compression plate 16 is flat and parallel to the imaging surface 14A of the imaging table 14, that is, when the compression plate 16 is not tilted or bent, the distance L(H) between two adjacent dot images DI takes a constant value in the X-axis direction and the Y-axis direction. The distance L(H) between the dot images DI is an example of the "length of the marker image in one direction" according to the technology disclosed herein.
[0060] When H>0, the position of the marker M is closer to the camera 30 than when H=0, and the marker image MI captured in the visible light image PV is enlarged, so the interval L(H) becomes larger than the interval L(0). As will be described in detail later, the ratio of the interval L(H) to the interval L(0) depends on the height H of the compression paddle 16, so the height H can be derived based on the interval L(0) and the interval L(H).
[0061] FIG. 5 shows an example of a visible light image PV captured by the camera 30 when the compression plate 16 is tilted. As shown in FIG. 5, when the compression plate 16 is tilted, the interval L(H) between the dot images DI included in the marker image MI captured in the visible light image PV changes. In this example, the interval L(H) changes depending on the position in the Y-axis direction. By calculating the interval L(H) between each of the dot images DI included in the marker image MI and the adjacent dot images DI, the two-dimensional distribution of the height H of the compression plate 16 can be derived. When the compression plate 16 is bent, the two-dimensional distribution of the height H of the compression plate 16 can be derived by a similar method. Hereinafter, the two-dimensional distribution of the height H of the compression plate 16 is referred to as height information HI. The height information HI includes the height H at a plurality of positions of the compression plate 16.
[0062] Fig. 6 shows an example of the functional configuration configured in the mammography apparatus 10 and the console 20. As shown in Fig. 6, in the mammography apparatus 10, the control unit 40 (see Fig. 2) described above functions as a radiography control unit 60 that controls the radiation source 15 and the radiation detector 19 to perform radiography. In the console 20, the control unit 50 (see Fig. 2) described above functions as a height information derivation unit 61 that derives height information HI based on the visible light image PV, and an imaging condition determination unit 62 that determines the imaging conditions for radiography.
[0063] The radiography control unit 60 controls the tube voltage and tube current of the radiation tube 15A (see FIG. 1) included in the radiation source 15, and the irradiation time of radiation R, based on the radiography conditions determined by the radiography condition determination unit 62. The radiation exposure dose of the breast as the imaging target is determined by the tube voltage, tube current, and irradiation time. The radiography control unit 60 also controls the camera 30 to perform imaging during pre-radiation imaging.
[0064] The height information derivation unit 61 derives height information HI based on the visible light image PV captured by the camera 30. Specifically, the height information derivation unit 61 derives the height information HI based on the rate of change in length of the marker image MI according to the height H of the compression plate. The imaging condition determination unit 62 determines imaging conditions for performing main imaging based on the height information HI derived by the height information derivation unit 61 and the pre-imaging image PX obtained by pre-imaging. The pre-imaging is radiation imaging performed at a low dose before performing main imaging in order to determine the imaging conditions.
[0065] 7 illustrates an example of a process of deriving height information HI by height information derivation unit 61. Camera 30 includes an image sensor 31 and lens 32. Image sensor 31 is a two-dimensional image sensor such as a CMOS (Complementary Metal Oxide Semiconductor) type image sensor. Lens 32 is composed of one or more optical lenses. Image sensor 31 generates a visible light image PV by photoelectrically converting an optical image of visible light VL formed on image sensor 31A by lens 32.
[0066] In Fig. 7, f represents the focal length of camera 30, and S represents the distance from camera 30 to imaging stand 14. More specifically, f is the distance from the principal point of lens 32 to imaging surface 31A of image sensor 31, and S is the distance from the principal point of lens 32 to imaging surface 14A of imaging stand 14. Note that in Fig. 7, for simplicity of explanation, the thickness of compression plate 16 is set to 0, and marker M is shown at a position corresponding to height H of compression plate 16.
[0067] 7, even if the height H of the compression paddle 16 changes, the interval W between the dots D included in the marker M remains constant. From this, the following relational expressions (1) and (2) can be obtained geometrically. L(0) / f=W / S (1) L(H) / f=W / (SH) (2)
[0068] By combining and rearranging the above relational expressions (1) and (2), the following relational expression (3) is obtained. H = S(1 - L(0) / L(H)) (3)
[0069] The height information derivation unit 61 obtains the distance L(H) between each of the dot images DI captured in the visible light image PV and adjacent dot images DI, and derives height information HI, which is a two-dimensional distribution of height H, by substituting the obtained distance L(H) into the above relational expression (3). Note that L(0) is the distance between the dot images DI obtained by photographing the marker M with the camera 30 in a state where H=0. Also, the distance S is a design value. The height information derivation unit 61 holds the values of the distance L(0) and the distance S in advance.
[0070] The height information derivation unit 61 may derive the height information HI by referring to a look-up table (LUT) in which the relationship between the height H and the interval L(H) expressed by the relational expression (3) is recorded.
[0071] Furthermore, in order to improve the measurement accuracy of the interval L(H) based on the visible light image PV, it is necessary to accurately determine the center position of the dot image DI. In this embodiment, since the dot D is circular, if the compression paddle 16 is tilted or bent, the dot image DI will have a shape close to an ellipse. For this reason, it is preferable that the height information derivation unit 61 measures the interval L(H) after determining the center position of the dot image DI by approximating the dot image DI to an ellipse.
[0072] FIG. 8 shows an example of height information HI derived by the height information derivation unit 61. The height information HI is three-dimensional data representing a two-dimensional distribution of the height H. When deriving the height information HI, the height information derivation unit 61 preferably performs smoothing and complementation processing on discrete data representing the height H at multiple positions of the compression paddle 16. FIG. 9 shows an example of the smoothing processing. By performing the smoothing processing, it is possible to remove the influence of noise that may occur when deriving the height H. As the smoothing processing, a moving average or a Gaussian filter processing is used.
[0073] The height information HI derived by the height information derivation unit 61 while the breast is compressed by the compression paddle 16 makes it possible to accurately detect the thickness of the compressed breast during radiography (hereinafter referred to as compressed breast thickness).
[0074] Fig. 10 illustrates an example of the imaging condition determination process by the imaging condition determination unit 62. As shown in Fig. 10, the imaging condition determination unit 62 specifies an area 71 in which the content rate of mammary glands is equal to or higher than a certain value (hereinafter, referred to as a mammary gland-rich area) from an area 70 in which a breast image is captured, based on a pre-photographed image PX.
[0075] Specifically, the imaging condition determination unit 62 determines the mammary gland content rate for each pixel of the pre-photographed image PX based on the attenuation coefficient of radiation R for mammary gland tissue and adipose tissue. When determining the mammary gland content rate for each pixel, the imaging condition determination unit 62 determines the compressed breast thickness for each pixel based on the height information HI. The pixel value of the pre-photographed image PX corresponds to the reaching dose of radiation R from the radiation source 15. The imaging condition determination unit 62 calculates the mammary gland content rate based on the pixel value, the attenuation coefficient, and the compressed breast thickness. This method of calculating the mammary gland content rate is known, for example, from JP 2020-000368 A. According to the technology disclosed herein, it is possible to derive the compressed breast thickness for each pixel based on the height information HI, so that the mammary gland content rate can be calculated with high accuracy.
[0076] The imaging condition determination unit 62 determines the compressed breast thickness and the mammary gland content rate of the high mammary gland area 71, and determines the imaging conditions based on the determined compressed breast thickness and the mammary gland content rate. The imaging conditions include the tube voltage, the tube current, and the irradiation time.
[0077] In the glandular region 71, lesions are often hidden within the glands and difficult to see, so it is preferable to set the imaging conditions to optimal values for the glandular region 71. According to the technology of the present disclosure, the compressed breast thickness in the glandular region 71 can be accurately derived, and the glandular content rate can be accurately derived, so that the optimal imaging conditions can be accurately determined.
[0078] Next, the operation of the above configuration will be described with reference to the flow chart shown in Fig. 11. First, for example, a radiologist sets the imaging method and pre-exposure conditions by operating the operation unit 57 (see Fig. 2) of the console 20 in preparation for imaging (step S10). Also, in step S10, the radiologist positions the breast 81 of the subject 80 placed on the imaging table 14 of the mammography device 10 as shown in Fig. 12, and then operates the operation panel 43 to compress the breast 81 with the compression plate 16. At this time, there is a possibility that the compression plate 16 may tilt or bend.
[0079] Next, the radiography control unit 60 (see FIG. 6) determines whether or not the radiologist has performed an operation to start radiography using the operation panel 43 (step S11). If the radiography control unit 60 determines that an operation to start radiography has been performed (step S11: YES), it causes the camera 30 to capture a visible light image PV including the marker M formed on the compression plate 16 (step S12). The visible light image PV captured by the camera 30 is transmitted to the console 20.
[0080] In the console 20, the height information deriving unit 61 derives the height information HI based on the visible light image PV (step S13).
[0081] In the mammography apparatus 10, the radiography control unit 60 controls the radiation source 15 and the radiation detector 19 to execute pre-photography (step S14). The pre-photographed image PX generated by the radiation detector 19 is transmitted to the console 20.
[0082] In the console 20, the imaging conditions are determined by the imaging condition determination unit 62 based on the height information HI and the pre-photographed image PX (step S15). The imaging conditions determined by the imaging condition determination unit 62 are transmitted to the mammography apparatus 10.
[0083] In the mammography apparatus 10, the radiation imaging control unit 60 controls the radiation source 15 and the radiation detector 19 based on the imaging conditions received from the console 20 to execute the actual imaging (main radiation imaging) (step S16). A radiation image generated by the radiation detector 19 in the actual imaging is transmitted to the console 20 and displayed on the display unit 21.
[0084] As described above, according to the technology of the present disclosure, the height information derivation unit 61 derives the height information HI of the compression plate 16 based on the marker image MI indicating the marker M having a two-dimensional pattern captured in the visible light image PV. This makes it possible to accurately measure the thickness of the breast while taking into account the influence of the inclination or bending of the compression plate 16.
[0085] [Variations] Next, various modifications of the above embodiment will be described.
[0086] In the above embodiment, the marker M is in the form of a dot consisting of a plurality of dots D, but the marker M may be a two-dimensional pattern whose lengths in at least two directions are measurable. The two-dimensional pattern of the marker M can be modified in various ways.
[0087] 13 to 15 show modified examples of the marker M. Fig. 13 shows an example in which the two-dimensional pattern constituting the marker M is in a lattice shape. In this example, for example, the lattice intervals in the X-axis direction and the Y-axis direction are each defined as W, and the length of the marker image MI corresponding to the lattice interval W in the visible light image PV is measured as L(H).
[0088] 14 shows an example in which the two-dimensional pattern constituting the marker M is in the shape of a cross. The marker M includes a plurality of cross shapes C. In this example, for example, the length of the cross shape C in the X-axis direction and the Y-axis direction is defined as W, and the length of the marker image MI corresponding to the length W in the visible light image PV is measured as L(H). Note that W is not limited to the length of the cross shape C, and may be the distance between two cross shapes C.
[0089] 15 shows an example in which the two-dimensional pattern constituting the marker M is frame-shaped. In this example, for example, the length of the side of the frame in the X-axis direction and the Y-axis direction is W, and the length of the marker image MI corresponding to the length W in the visible light image PV is measured as L(H). Note that in this example, since most of the marker M is located outside the breast, the marker M does not need to be radiotransparent. In other words, the marker M may be formed of a material having radiation absorbing properties.
[0090] In the example shown in FIGS. 14 and 15, since there are few positions on the compression paddle 16 where the height H is measured, it is preferable to generate height information HI for the entire surface of the compression paddle 16 by performing an interpolation process.
[0091] In the above embodiment, the marker M is formed on the upper surface 16A of the compression plate 16, but if the compression plate 16 is transparent, the marker M may be formed on the lower surface 16B of the compression plate 16. Also, without forming a marker by printing or attaching a member, the edge portion of the outer periphery of the compression plate 16 may be regarded as the marker, and the height information HI may be derived based on the length of the edge portion of the compression plate 16 reflected in the visible light image PV.
[0092] In the above embodiment, the height information HI is used to calculate the mammary gland content rate, thereby improving the accuracy of the mammary gland content rate. Furthermore, the height information HI can also be applied to energy subtraction processing for generating an energy subtraction image. Energy subtraction is a method of obtaining an image in which a specific structure is extracted by multiplying one of two radiological images obtained by irradiating a subject with two types of radiation with different energy distributions by an appropriate weighting coefficient and then subtracting the two images (see, for example, Japanese Patent No. 6667462).
[0093] According to Japanese Patent No. 6667462, the weighting coefficients are determined based on the radiation absorption coefficients of the glandular tissue and the fatty tissue. The radiation absorption coefficients depend on the radiation energy, the compressed breast thickness, and the glandular content. Therefore, by accurately deriving the compressed breast thickness and the glandular content based on the height information HI, the accuracy of separating materials (glandular tissue and fatty tissue) by the energy subtraction process is improved. As a result, a high-quality energy subtraction image in which the glandular tissue is accurately extracted is generated.
[0094] The height information HI can also be applied to a composite two-dimensional image generation process that generates a composite two-dimensional image based on multiple tomographic images generated in tomosynthesis imaging. In tomosynthesis imaging, a three-dimensional image consisting of multiple tomographic images is generated by reconstructing multiple projection images obtained by irradiating a subject with radiation from a radiation source at multiple radiation source positions. In the composite two-dimensional image generation process, a composite two-dimensional image equivalent to the projection image is generated by synthesizing the multiple tomographic images.
[0095] In tomosynthesis imaging, as shown in FIG. 16 as an example, extra tomographic images SP are generated in the up-down direction (Z-axis direction) so as to include the range of a breast 81 as an imaging target. That is, some of the multiple tomographic images SP intersect with the compression plate 16 or the imaging table 14. If all of these tomographic images SP are selected and synthesized, the image quality of the breast captured in the synthesized two-dimensional image will be reduced. In particular, when the compression plate 16 is tilted or bent, the possibility of selecting a tomographic image SP that intersects with the compression plate 16 increases. In contrast, by using the height information HI, it is possible to accurately select a tomographic image SP that intersects only the breast 81. As a result, the image quality of the breast captured in the synthesized two-dimensional image is improved.
[0096] Furthermore, in the above embodiment and modified example, the marker M having a two-dimensional pattern is formed on the compression plate 16, but a single marker M having a predetermined shape may be formed on the compression plate 16. As an example, as shown in FIG. 17, the marker M is placed on the compression plate 16 at a position overlapping the breast 81 placed on the imaging table 14. In this example, the marker M has a cross shape. Based on the marker image captured in the visible light image PV, the height of the compression plate 16 at the position where the marker M is placed (i.e., the compressed breast thickness) can be obtained.
[0097] In this example, the marker M is preferably radiotransparent. In this example, the marker M is formed of a radiotransparent material so as not to be reflected in the radiographic image. The radiotransmittance of the marker M is not limited to 100% and may be less than 100%. The radiotransmittance of the marker M may be a transmittance that is not visible in the radiographic image. The radiotransmittance of the marker M may be approximately the same as the radiotransmittance of the compression plate 16. If the radiotransmittance of the marker M and the compression plate 16 is approximately the same, even if the radiotransmittance is less than 100%, the image of the marker M will not be visible in the radiographic image.
[0098] From the above description, the techniques described in Supplementary Items 1 to 4 below can be understood. [Additional note 1] an imaging table on which the subject's breast is placed; A compression plate that compresses the breast and is placed on the imaging table; A radiolucent marker provided on the compression plate; a radiation source for applying radiation to the compressed breast; a camera that captures a visible light image including the marker; A height information derivation unit that derives height information of the compression plate relative to the imaging table based on a marker image indicating the marker captured in the visible light image; A radiation imaging system comprising: [Additional note 2] an imaging table on which the subject's breast is placed; A compression plate that compresses the breast and is placed on the imaging table; A radiolucent marker provided on the compression plate; a radiation source for applying radiation to the compressed breast; a camera that captures a visible light image including the marker; A radiography apparatus comprising: [Additional note 3] An information processing device connected to a radiation imaging device including: an imaging table on which a breast of a subject is placed; a compression plate for compressing the breast placed on the imaging table; a radiolucent marker provided on the compression plate; a radiation source for irradiating the compressed breast with radiation; and a camera for capturing a visible light image including the marker; A processor is provided. The processor derives height information of the compression plate relative to the imaging table based on a marker image indicating the marker captured in the visible light image. Information processing device. [Additional note 4] 1. An information processing method for a radiography device including an imaging table on which a breast of a subject is placed, a compression plate for compressing the breast placed on the imaging table, a radiolucent marker provided on the compression plate, a radiation source for irradiating the compressed breast with radiation, and a camera for capturing a visible light image including the marker, comprising: Deriving height information of the compression plate relative to the imaging table based on a marker image showing the marker captured in the visible light image. An information processing method comprising:
[0099] In the above embodiment, the hardware structure of the processing unit that executes various processes, such as the radiation imaging control unit 60, the height information derivation unit 61, and the imaging condition determination unit 62, is various processors as shown below.
[0100] Various types of processors include CPUs, programmable logic devices (PLDs), dedicated electrical circuits, etc. As is well known, a CPU is a general-purpose processor that executes software (programs) and functions as various processing units. A PLD is a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field Programmable Gate Array). A dedicated electrical circuit is a processor with a circuit configuration designed specifically to execute specific processing, such as an ASIC (Application Specific Integrated Circuit).
[0101] A single processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (e.g., multiple FPGAs, or a combination of a CPU and an FPGA). In addition, multiple processing units may be configured with a single processor. As an example of configuring multiple processing units with one processor, first, there is a form in which one processor is configured by combining one or more CPUs and software, and this processor functions as multiple processing units. Second, there is a form in which a processor is used that realizes the functions of the entire system including multiple processing units with one IC chip, as typified by a system on chip (SoC). In this way, the various processing units are configured using one or more of the above various processors as a hardware structure.
[0102] Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit that combines circuit elements such as semiconductor elements.
[0103] The present invention is not limited to the above-described embodiment, and various configurations can be adopted without departing from the gist of the present invention. Furthermore, the present invention extends to a computer-readable storage medium that non-temporarily stores a program, in addition to the program. [Explanation of symbols]
[0104] 2 Radiography system 10 Mammography equipment 11 Arm section 12 Foundation 13 Shaft 14. Shooting stand 14A Shooting surface 15 Radiation source 15A radiation tube 15B Collimator 16 Compression plate 16A Top 16B Bottom 17 Moving mechanism 17A Ball screw 17B Motor 18 Support part 19 Radiation detector 20 Console 21 Display section 30 Camera 31 Image sensor 31A Imaging surface 32 Lens 40 Control section 40A CPU 40B RAM 40C ROM 41 Storage section 42 I / F section 43 Operation Panel 44 Bus 45 Programs 50 Control section 50A CPU 50B RAM 50C ROM 52 Storage section 54 I / F section 55 Display control unit 56 Operation input detection unit 57 Operation section 58 Bus 59 Programs 60 Radiography Control Unit 61 Height information derivation unit 62 Shooting condition determination unit 70 Area showing breast image 71 High mammary gland area 80 Subjects 81 Breast θ Angle of view C Cross Shape D Dot DI dot image HI Height Information M Marker MI marker image PV visible light image PX Pre-shooting image R Radiation SP tomographic image VL visible light
Claims
1. an imaging table on which the subject's breast is placed; A compression plate that compresses the breast and is placed on the imaging table; A marker including dots consisting of a plurality of isolated points or lattice points arranged in a two-dimensional lattice pattern on the surface of the compression plate; a radiation source for applying radiation to the compressed breast; A camera is arranged so that an optical axis is perpendicular to the surface of the compression plate and captures a visible light image including the marker; A height information derivation unit that derives height information of the compression plate relative to the imaging table based on a plurality of dot images included in a marker image indicating the marker captured in the visible light image; Equipped with The height information derivation unit derives the height information based on a relational expression of H=S×(1−L(0) / L(H)). Here, S is the distance from the camera to the imaging table, L(H) is the interval between two dot images located symmetrically about the optical axis when the height of the compression plate relative to the imaging table is H, and L(0) is the interval between the two dot images derived in advance based on the visible light image when H=0. Radiography system.
2. The marker has a different color from the compression plate. The radiation imaging system according to claim 1 .
3. The marker is formed by attaching a member to the compression plate.
3. The radiation imaging system according to claim 1.
4. The marker is radiolucent. The radiation imaging system according to claim 1 .
5. The marker is disposed at a position where at least a portion of the marker overlaps the breast. The radiation imaging system according to claim 4 .
6. The camera is provided on a holder that holds a radiation source. The radiation imaging system according to claim 1 .
7. the imaging table, the compression plate, the marker, and the camera are provided in a radiation imaging apparatus, The height information derivation unit is provided in an information processing device connected to the radiation imaging apparatus. The radiation imaging system according to claim 1 .
8. An information processing device connected to a radiation imaging device including: an imaging table on which a breast of a subject is placed; a compression plate for compressing the breast placed on the imaging table; a marker including dots consisting of a plurality of isolated points or lattice points arranged in a two-dimensional lattice pattern on a surface of the compression plate; a radiation source arranged with an optical axis perpendicular to the surface of the compression plate for irradiating radiation onto the compressed breast; and a camera for capturing a visible light image including the marker, A processor is provided to derive height information of the compression plate relative to the imaging table based on a plurality of dot images included in a marker image indicating the marker captured in the visible light image; The processor derives the height information based on a relational expression H=S×(1−L(0) / L(H)). Here, S is the distance from the camera to the imaging table, L(H) is the interval between two dot images located symmetrically about the optical axis when the height of the compression plate relative to the imaging table is H, and L(0) is the interval between the two dot images derived in advance based on the visible light image when H=0. Information processing device.
9. 1. An information processing method for a radiography device including: an imaging table on which a breast of a subject is placed; a compression plate that compresses the breast placed on the imaging table; a marker including dots consisting of a plurality of isolated points or lattice points arranged in a two-dimensional lattice pattern on a surface of the compression plate; a radiation source that is arranged with its optical axis perpendicular to the surface of the compression plate and irradiates radiation onto the compressed breast; and a camera that captures a visible light image including the marker, When deriving height information of the compression plate relative to the imaging table based on a plurality of dot images included in a marker image indicating the marker captured in the visible light image, the height information is derived based on the relational expression H = S × (1 - L (0) / L (H)). Here, S is the distance from the camera to the imaging table, L(H) is the interval between two dot images located symmetrically about the optical axis when the height of the compression plate relative to the imaging table is H, and L(0) is the interval between the two dot images derived in advance based on the visible light image when H=0. Information processing methods.
Citation Information
Patent Citations
X-ray tomograph
JP2004357912A
Image pickup device for breasts
JP2009240467A
Radiation image photographing apparatus, radiation image photographing program, and radiation image photographing method
JP2013233415A
Breast thickness measuring device, breast thickness measuring method, and radiographic system
JP2015177884A
Mammography apparatus, control device, mammography apparatus control method, and mammography apparatus control program
JP2017225634A
