Automatic Exposure Control Method Based on Depth Camera
By identifying the transformation between the beam coordinate system and the camera coordinate system through a depth camera calibration phantom, and combining this with the acquisition of lesion images by the depth camera, the exposure control problem of CBCT and spot film/photography modes was solved, achieving precise exposure control and improved image quality.
Patent Information
- Application Number
- CN202211484652.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-24
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2042-11-24
AI Technical Summary
Cone-beam computed tomography (CBCT) and spot/photographic modes struggle to obtain appropriate exposure parameters from prior probe frames, making automatic exposure control difficult.
By using a depth camera-based method, a calibration sphere embedded in the phantom is calibrated to identify the transformation relationship between the beam coordinate system and the camera coordinate system. Combined with the depth camera to acquire images of the patient's lesion, non-patient areas are identified, the thickness of the patient's surgical area is calculated, and appropriate exposure control parameters are obtained.
It achieves precise exposure control in CBCT, improving the quality and efficiency of image acquisition.
Smart Images

Figure CN115988324B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of X-ray technology, and more particularly to an automatic exposure control method based on a depth camera. Background Technology
[0002] The Automatic Brightness Adjustment System (ABS) uses a detector to sense and control light, automatically adjusting the perspective exposure parameters to ensure the exposure dose is within an appropriate range, resulting in a clear image. This automatic dimming process greatly simplifies user operation and reduces the risk of excessive exposure or poor image quality due to improper human intervention.
[0003] Automatic brightness adjustment system (ABS) needs prior probe frames to obtain the brightness effect of the current parameters during the dimming process, and then obtains the target exposure parameters through feedback control or dimming model.
[0004] Because of the rotational shooting, each frame of cone-beam computed tomography (CBCT) 3D image acquisition is a completely new shooting condition, making it impossible to obtain suitable exposure parameters through prior detection frames. Similarly, spot film / photographic mode, due to the single exposure, is also difficult to accept the prior detection frame method for automatic brightness adjustment. Summary of the Invention
[0005] Purpose of the invention: To address the above-mentioned shortcomings, this invention proposes an automatic exposure control method based on a depth camera, which can obtain appropriate exposure control parameters as control parameters or initial values for an automatic brightness adjustment system, thereby achieving precise exposure control in CBCT.
[0006] Technical solution:
[0007] Automatic exposure control methods based on depth cameras include:
[0008] The transformation relationship between the beam coordinate system of the 3D perspective device and the camera coordinate system of the depth camera is obtained by calibrating a calibration phantom containing several calibration spheres.
[0009] The patient's lesion image is acquired by a depth camera and the coordinates of each pixel in the lesion image in the beam coordinate system are calculated according to the aforementioned transformation relationship. Based on this, the non-patient area is identified.
[0010] The beam area is determined based on the beam angle of the X-ray source. The patient's surgical area and its thickness are obtained by combining the non-patient area identified above, and automatic exposure control is performed accordingly.
[0011] The calibration model contains two layers of calibration balls, one above the other. Each calibration ball in each layer is the same height, but the spacing between the calibration balls in each layer is different.
[0012] The specific transformation relationship between the beam coordinate system of the 3D perspective device and the camera coordinate system of the depth camera obtained through calibration is as follows:
[0013] A three-dimensional perspective device scans the perspective image of the calibration model, identifies and extracts the coordinates of the calibration sphere and its centroid.
[0014] The layer number of each calibration ball is obtained by identifying the spacing between calibration balls, and the height of the calibration ball is obtained according to the design parameters of the calibration phantom, thereby obtaining the coordinates of the centroid of the calibration ball in the beam coordinate system;
[0015] Images of the calibration phantom are acquired using a depth camera, and the coordinates of the centroid of the calibration sphere in the camera coordinate system are obtained by extracting the images.
[0016] Calculate the transformation relationship between the beam coordinate system and the camera coordinate system.
[0017] The threshold method was used to identify and extract the coordinates of the calibration sphere and its centroid in the perspective image.
[0018] Identifying the non-patient area specifically involves:
[0019] If an operating table is not available, the non-patient area can be identified by the grayscale values of pixels in the depth image.
[0020] If an operating table is present, the non-patient area can be obtained by identifying the operating table plane using a plane detection algorithm or by using markers.
[0021] The specific definition of the beam region is as follows:
[0022] P2.x / P2.z<tanφ && P2.y / P2.z<tanφ;
[0023] Where φ is the beam angle of the ray source, and P2.x, P2.y, and P2.z are the coordinates of each pixel on the x-axis, y-axis, and z-axis in the beam coordinate system, respectively.
[0024] The exposure voltage and exposure current corresponding to the thickness of the patient's surgical area are calculated based on the pre-obtained relationship curve between exposure voltage and exposure current, as well as the mapping relationship between exposure voltage and the thickness of the patient's surgical area.
[0025] In CT fluoroscopy mode, the obtained exposure voltage and exposure current are used as initial values, and the optimal exposure voltage is obtained through a feedback control algorithm.
[0026] The relationship curve between the exposure voltage and the exposure current was obtained through experiments or by referring to tables.
[0027] The mapping relationship between the exposure voltage and the thickness of the patient's surgical area is obtained by measuring the image brightness under different thicknesses of water film and different voltage parameters to obtain the corresponding brightness table, and then by function fitting or interpolation.
[0028] Beneficial effects: This invention can identify the range and depth of the patient's exposure area to radiation based on a depth camera, calculate the thickness of the patient's surgical area, and then calculate appropriate exposure control parameters as control parameters or initial values for the automatic brightness adjustment system, so as to achieve precise exposure control of CBCT. Attached Figure Description
[0029] Figure 1 This is a flowchart of the automatic exposure control method of the present invention;
[0030] Figure 2 This is a schematic diagram of the calibration phantom.
[0031] Figure 3 This is a schematic diagram of the beam coordinate system. Detailed Implementation
[0032] The present invention will be further explained below with reference to the accompanying drawings and specific embodiments.
[0033] like Figure 1 As shown, the automatic exposure control based on a depth camera of the present invention includes the following steps:
[0034] (1) Parameter calibration;
[0035] The parameter calibration of this invention adopts the following method: Figure 2 The calibration phantom shown is a cubic structure containing two layers of calibration balls. Specifically, the calibration balls are colored metal balls, or more specifically, steel balls. All calibration balls in each layer have the same height, which is h. u and h d The spacing between the calibration balls in each layer is different to identify the height of the calibration balls. The specific parameter calibration steps are as follows:
[0036] (11) The C-arm of the CBCT is placed vertically with the high-voltage X-ray tube (i.e., the X-ray source) above it. The depth camera is installed on the side of the high-voltage X-ray tube. A horizontal base is set between the high-voltage X-ray tube and the detector (the base will not significantly obstruct the X-ray). The calibration phantom is placed on the base and placed within the field of view of the C-arm and the depth camera. The height of the base surface is measured as h. b The source-image distance between the X-ray source and the detector is obtained as sid;
[0037] (12) Scan the perspective image of the calibration phantom, identify and extract the coordinates of the calibration sphere and its centroid;
[0038] Specifically, the calibration sphere is obtained by using the threshold method (i.e., extracting pixels with pixel values less than a set threshold on the perspective image) and calculating its centroid coordinate Z in the image coordinate system.
[0039] (13) The layer number of each calibration ball is obtained by identifying the spacing between calibration balls, and the height h of a certain calibration ball is obtained according to the design parameters of the calibration phantom. The coordinates Z1 of its centroid in the beam coordinate system are calculated by geometric projection based on the centroid coordinates of the ball obtained in step (12) in the image coordinate system. The beam coordinate system is as follows: Figure 3 As shown, a coordinate system is established with the ray source as the origin and the z-axis perpendicular to the imaging plane.
[0040] Specifically, the coordinate values Z1.x, Z1.y, and Z1.z of a certain calibration ball in the beam coordinate system along the x-axis, y-axis, and z-axis are respectively:
[0041] Z1.x = Zx(h + h) b ) / sid;
[0042] Z1.y=Zy(h+h b ) / sid;
[0043] Z1.z = h + h b ;
[0044] Where Zx and Zy are the coordinates of the calibration sphere on the x-axis and y-axis of the image coordinate system, respectively;
[0045] (14) Acquire images of the calibration model using a depth camera and extract the coordinates Z2 of the centroid of the calibration sphere in the camera coordinate system;
[0046] In this invention, the depth camera is an RGB binocular camera, and the coordinates of the centroid of the calibration sphere in the camera coordinate system are obtained by recognizing the acquired RGB image and depth image.
[0047] (15) Based on the coordinates of the centroids of each calibration sphere in the beam coordinate system obtained in step (13) and the coordinates of the centroids of each calibration sphere in the camera coordinate system obtained in step (14), the linear transformation matrix R between the beam coordinate system and the camera coordinate system is calculated:
[0048] R=(Z2 T Z2) -1 Z2 T Z1;
[0049] Among them, Z2 T This represents the transpose operation of Z2;
[0050] (2) Determine the patient's surgical area and its thickness;
[0051] (21) Acquire RGB and depth images of the patient’s lesion using a depth camera, and identify the coordinates P1 of each pixel in the camera coordinate system. Calculate the coordinates P2=RP1 in the beam coordinate system based on the linear transformation matrix R obtained in step (1).
[0052] (22) Identify the non-patient region O in the depth image of the patient's lesion;
[0053] In this invention, the identification of non-patient region O falls into the following two categories:
[0054] 1) No operating table: In the depth image, the gray values of pixels in the non-patient area are significantly different from those in the patient area. Therefore, the depth of the non-patient area will also be significantly different from that of the patient area. In other words, the non-patient area can be easily identified by the gray values of the pixels in the depth image.
[0055] 2) Operating table present: The operating table plane is identified by a plane detection algorithm or by using a marker method (a brightly colored thin marker is placed on the surface of the operating table, and the depth camera identifies the plane by color recognition and calculates its location). This allows us to obtain the distribution area of the operating table, i.e., the non-patient area.
[0056] (23) Determine the beam region C based on the beam angle φ of the CBCT X-ray source, such as... Figure 3 As shown, the details are as follows:
[0057] P2.x / P2.z<tanφ && P2.y / P2.z<tanφ;
[0058] Based on whether each pixel obtained in the above judgment step (21) is within the beam region C, remove the pixels that are not within the beam region C;
[0059] (24) Based on steps (22) and (23), the non-patient area in the beam region C is removed to obtain the patient surgical area P, and the maximum height h of the patient surgical area is obtained according to step (21). max and minimum height h min Based on this, the thickness of the patient's surgical area, D=h, is calculated. max -h min ;
[0060] (3) Automatic exposure control of CBCT;
[0061] The relationship curve between the exposure voltage V and the exposure current I of CBCT is determined by experiment or by looking up a table. The optimal mapping relationship between the exposure voltage V and the thickness D of the patient's surgical area is established by experiment. Then, the corresponding exposure voltage V can be obtained based on the thickness D of the patient's surgical area obtained in step (24), and then the corresponding exposure current I can be obtained.
[0062] Specifically:
[0063] In the spot film / photograph mode of CBCT, the exposure voltage V and exposure current I of each frame image are calculated through the steps described above, and image acquisition is performed accordingly.
[0064] The exposure voltage V and exposure current I of each frame of image captured in CBCT 3D mode are obtained through the aforementioned calculations, and image acquisition is performed accordingly.
[0065] In the fluoroscopic mode of CBCT, the exposure voltage V and exposure current I calculated above can be used as the initial values of the traditional dimming method. In the fluoroscopic mode, the optimal exposure voltage is calculated using a feedback control method. A suitable initial value can greatly accelerate the iteration speed, thereby accelerating the brightness adjustment speed.
[0066] In this invention, the image brightness is measured under different thicknesses of water film (the density of the water film is close to that of the human body) and different voltage parameters to obtain the corresponding brightness table. The optimal mapping relationship between the exposure voltage and the thickness of the patient's surgical area is obtained by function fitting or interpolation.
[0067] This invention uses a calibration phantom to calibrate parameters, thereby obtaining the transformation relationship between the beam coordinate system and the camera coordinate system. Then, by acquiring RGB and depth images of the patient's lesion using a depth camera, the range and depth of the patient's exposed area can be identified, the thickness of the patient's surgical area can be calculated, and appropriate exposure control parameters can be calculated as control parameters or initial values for the automatic brightness adjustment system to achieve precise exposure control.
[0068] The preferred embodiments of the present invention have been described in detail above. However, the present invention is not limited to the specific details of the above embodiments. Within the scope of the technical concept of the present invention, various equivalent transformations (such as quantity, shape, position, etc.) can be made to the technical solutions of the present invention, and these equivalent transformations all fall within the protection scope of the present invention.
Claims
1. An automatic exposure control method based on a depth camera, characterized in that: include: The calibration phantom, which contains two layers of calibration spheres, is scanned using a 3D perspective device to identify and extract the calibration spheres and their centroid coordinates. The layer number of each calibration ball is obtained by identifying the spacing between calibration balls, and the height of the calibration ball is obtained according to the design parameters of the calibration phantom. Then, the coordinates of the centroid of the calibration ball in the beam coordinate system of the three-dimensional perspective device are obtained. Images of the calibration phantom are acquired using a depth camera, and the coordinates of the centroid of the calibration sphere in the camera coordinate system of the depth camera are obtained by extracting the images. Based on this, the transformation relationship between the beam coordinate system and the camera coordinate system can be calculated; The patient's lesion image is acquired by a depth camera and the coordinates of each pixel in the lesion image in the beam coordinate system are calculated according to the aforementioned transformation relationship. Based on this, the non-patient area is identified. The beam region is determined based on the beam angle of the radiation source, specifically as follows: P2.x / P2.z<tanφ && P2.y / P2.z<tanφ; Where φ is the beam angle of the ray source, and P2.x, P2.y, and P2.z are the coordinate values of each pixel on the x-axis, y-axis, and z-axis in the beam coordinate system, respectively. The patient's surgical area and its thickness are obtained by combining the non-patient areas identified above, and automatic exposure control is performed accordingly.
2. The automatic exposure control method according to claim 1, characterized in that: The calibration model contains two layers of calibration balls, one above the other. Each calibration ball in each layer is the same height, but the spacing between the calibration balls in each layer is different.
3. The automatic exposure control method according to claim 1, characterized in that: The threshold method was used to identify and extract the coordinates of the calibration sphere and its centroid in the perspective image.
4. The automatic exposure control method according to claim 1, characterized in that: Identifying the non-patient area specifically involves: If an operating table is not available, the non-patient area can be identified by the grayscale values of pixels in the depth image. If an operating table is present, the non-patient area can be obtained by identifying the operating table plane through a plane detection algorithm or by using markers.
5. The automatic exposure control method according to claim 1, characterized in that: The exposure voltage and exposure current corresponding to the thickness of the patient's surgical area are calculated based on the pre-obtained relationship curve between exposure voltage and exposure current, as well as the mapping relationship between exposure voltage and the thickness of the patient's surgical area.
6. The automatic exposure control method according to claim 5, characterized in that: In CT fluoroscopy mode, the obtained exposure voltage and exposure current are used as initial values, and the optimal exposure voltage is obtained through a feedback control algorithm.
7. The automatic exposure control method according to claim 5, characterized in that: The relationship curve between the exposure voltage and the exposure current was obtained through experiments or by referring to tables.
8. The automatic exposure control method according to claim 5, characterized in that: The mapping relationship between the exposure voltage and the thickness of the patient's surgical area is obtained by measuring the image brightness under different thicknesses of water film and different voltage parameters to obtain the corresponding brightness table, and then by function fitting or interpolation.
Citation Information
Patent Citations
X-ray system and method for standing subject
CN108926355A
Three-dimensional perspective automatic dimming method
CN115153595A
Point group data conversion system, method, and program
WO2018025842A1
