Calibration method, system and storage medium for 3D camera in medical imaging system

By using 3D stereo calibration model in medical imaging systems, the data set acquisition and calibration process is simplified, the problem of complex and low efficiency of calibration in the existing technology is solved, and efficient and automated calibration of internal and external parameters of the camera is realized. and coordinate system conversion.

CN113554710BActive Publication Date: 2024-11-22SIEMENS SHENZHEN MAGNETIC RESONANCE
View PDF 20 Cites 0 Cited by

Patent Information

Application Number
CN202010330728.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-04-24
Publication Date
2024-11-22
Estimated Expiration
2040-04-24

AI Technical Summary

Technical Problem

The calibration process of 3D cameras in existing medical imaging systems is complex and inefficient. It requires handheld plane models to move and collect a large number of data sets over multiple degrees of freedom, resulting in a long calibration time and easy to interfere with human factors, and the calibration and coordinates of internal and external parameters of the camera. The system conversion is carried out independently, lacking automation and integration.

Method used

Using a 3D stereo calibration model, by moving the model horizontally in the coordinate system of the medical imaging system, collecting calibration images and recording coordinate information, combining the geometric relationship of feature points, the simultaneous calculation of the internal and external parameter calibration and the coordinate system conversion matrix of the camera are realized, and the data is simplified. Centralized collection and improve automation.

Benefits of technology

Reduces the number of pictures in the calibration data set, shortens the calibration time, improves calibration efficiency, realizes seamless connection between internal and external parameter calibration and coordinate system conversion, reduces calibration complexity, and improves the flexibility of data set acquisition and accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113554710B_ABST
    Figure CN113554710B_ABST
Patent Text Reader

Abstract

The embodiments of the present invention disclose a calibration method, system and storage medium for a 3D camera in a medical imaging system. The method includes: based on the horizontal movement of a 3D stereo calibration model at different set positions along the Z axis in the coordinate system of the medical imaging system, triggering a 3D camera to collect images of the 3D stereo calibration model at each set position to obtain a first calibration data set; recording the coordinate information of the center point of the model in the coordinate system of the medical imaging system at each set position to obtain a second calibration data set; based on the first calibration data set, calibrating the internal and external parameters of the camera; based on the calibration results of the internal and external parameters and the geometric relationship between the model center point and each feature point of the second calibration data set and the 3D stereo calibration model, obtaining a conversion relationship from the camera coordinate system to the medical imaging system coordinate system. The technical solution in the embodiments of the present invention can improve the speed of camera calibration.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the medical field, and in particular to a calibration method, system and storage medium for a 3D camera in a medical imaging system. Background Art

[0002] In medical imaging systems such as magnetic resonance imaging (MR) systems or computed tomography (CT) systems, a 3D camera is sometimes needed to collect auxiliary information such as the patient's body position information. The camera of a 3D camera usually consists of an RGB camera and a depth camera.

[0003] According to the imaging principle of the camera, in order to determine the geometric relationship of a point on the surface of the photographed object on the camera plane, it is necessary to establish a geometric parameter model of the camera. The parameters in these geometric parameter models are called camera parameters. Camera parameters include external parameters and internal parameters. The internal parameters are related to the characteristics of the camera itself, such as the focal length, pixel size, distortion shape, etc. of the camera; while the external parameters of the camera are used to describe the relationship between the camera coordinate system and the world coordinate system. The internal and external parameters of the camera need to be calculated through the corresponding algorithm. The process of obtaining the internal and external parameters of the camera is called the internal and external parameter calibration of the camera.

[0004] When applying 3D cameras to medical imaging systems, in addition to calibrating the internal and external parameters of the camera, the camera coordinate system needs to be mapped to the medical imaging system coordinate system, such as the bed coordinate system (TBCS) or the device coordinate system (DCS). In other words, the coordinate system needs to be mapped and transformed, and the corresponding coordinate transformation relationship needs to be calculated. The process of calculating the transformation matrix from the camera coordinate system to the medical imaging system coordinate system is called the calibration of the medical imaging system coordinate system. In the medical imaging system coordinate system, the Z axis generally corresponds to the direction in which the patient enters and exits the scanning area. Summary of the invention

[0005] In view of this, the embodiments of the present invention propose, on the one hand, a calibration method for a 3D camera in a medical imaging system, and on the other hand, propose a calibration system and a computer-readable storage medium for a 3D camera in a medical imaging system to improve the speed of camera calibration.

[0006] The calibration method of a 3D camera in a medical imaging system proposed in an embodiment of the present invention comprises: a data set acquisition step: based on the horizontal movement of a 3D stereo calibration model at different set positions along the Z axis in the medical imaging system coordinate system, triggering the 3D camera to acquire images of the 3D stereo calibration model at each set position to obtain a first calibration data set; recording the coordinate information of the center point of the model in the medical imaging system coordinate system at each set position to obtain a second calibration data set; the 3D stereo calibration model has a plurality of calibration patterns at different angles, and each calibration pattern has a plurality of feature points with known relative positional relationships; an internal and external parameter calibration step: based on the first calibration data set, determining the position of each feature point in each image; The method comprises the following steps: obtaining the coordinates of each feature point in the image, and calibrating the internal and external parameters of the 3D camera based on the coordinates of each feature point in each image to obtain the calibrated internal and external parameters of the 3D camera; obtaining the coordinates of each feature point in the camera coordinate system of the 3D camera based on the calibrated internal and external parameters; obtaining the coordinates of each feature point in the medical imaging system coordinate system based on the second calibration data set and the geometric relationship between the model center point of the 3D stereo calibration model and each feature point; and calculating the conversion relationship from the camera coordinate system to the medical imaging system coordinate system based on the coordinates of the same feature point in the camera coordinate system and the coordinates in the medical imaging system coordinate system.

[0007] In one embodiment, the method further includes a calibration result verification step: based on a first position of the 3D stereo calibration model on the Z axis of the medical imaging system coordinate system, determining the initial coordinates of the center point of the model in the medical imaging system coordinate system at the first position; based on a second position of the 3D stereo calibration model on the Z axis of the medical imaging system coordinate system, triggering the 3D camera to capture an image of the 3D stereo calibration model, and determining the coordinate information of the center point of the model in the medical imaging system coordinate system at the second position; based on the image, determining the coordinates of each feature point in the image in the camera coordinate system, and obtaining the coordinate information of each feature point in the image based on the conversion relationship from the camera coordinate system to the medical imaging system coordinate system. The coordinates of the point in the medical imaging system coordinate system are obtained to obtain the first calculated coordinates of each feature point; the coordinates of each feature point in the image in the medical imaging system coordinate system are calculated according to the initial coordinates of the model center point in the medical imaging system coordinate system at the first position and the coordinate information of the model center point in the medical imaging system coordinate system at the second position to obtain the second calculated coordinates of each feature point; for each feature point, the Euclidean distance between the first calculated coordinates and the second calculated coordinates of the feature point is calculated, and an average Euclidean distance is obtained according to the Euclidean distance calculation of each feature point; it is determined whether the average Euclidean distance is less than a preset threshold value, and if so, the verification is passed; otherwise, the step of returning to execute the data set acquisition step.

[0008] In one embodiment, the determining the initial coordinates of the center point of the model in the medical imaging system coordinate system at the first position based on the first position of the 3D stereo calibration model on the Z axis of the medical imaging system coordinate system includes: when the 3D stereo calibration model is fixed at any position of the target device corresponding to the medical imaging system coordinate system, and the center point of the model marked on the 3D stereo calibration model is located on the Z axis of the medical imaging system coordinate system, the coordinates of the center point of the model in the medical imaging system coordinate system are located by aligning a laser light on the medical imaging system or a ruler indicating arrow on the 3D stereo calibration model corresponding to the center point of the model with a ruler on the target device to obtain the initial coordinates; based on the second position of the 3D stereo calibration model on the Z axis of the medical imaging system coordinate system, triggering the 3D camera to acquire the An image of a 3D stereo calibration model, and determining the coordinate information of the center point of the model in the medical imaging system at the second position, including: moving the target device to a calibration position, and recording the moving distance of the target device; triggering the 3D camera to collect the image of the 3D stereo calibration model; calculating the coordinates of each feature point in the image in the medical imaging system coordinate system according to the coordinate information of the center point of the model in the medical imaging system coordinate system at the first position and the coordinate information of the center point of the model in the medical imaging system coordinate system at the second position, and obtaining the second calculated coordinates of each feature point, including: calculating the coordinates of each feature point in the image in the medical imaging system coordinate system according to the initial coordinates of the center point of the model in the medical imaging system coordinate system and the moving distance of the target device, and obtaining the second calculated coordinates of each feature point.

[0009] In one embodiment, the determining of the initial coordinates of the center point of the model in the medical imaging system coordinate system at the first position based on the first position of the 3D stereo calibration model on the Z axis of the medical imaging system coordinate system includes: when the 3D stereo calibration model is fixed at any position of the target device corresponding to the medical imaging system coordinate system, and the model center point marked on the 3D stereo calibration model is located on the Z axis of the medical imaging system coordinate system, the first coordinates of the center point of the model in the medical imaging system coordinate system are located by using a laser light on the medical imaging system or by aligning the scale indicator arrow corresponding to the model center point on the 3D stereo calibration model with the scale on the target device; based on the second position of the 3D stereo calibration model on the Z axis of the medical imaging system coordinate system, triggering the 3D camera to capture an image of the 3D stereo calibration model and determining the coordinate information of the center point of the model in the medical imaging system at the second position, includes: The 3D stereo calibration model is fixed at another position of the target device corresponding to the medical imaging system coordinate system, and when the model center point marked on the 3D stereo calibration model is located on the Z axis of the medical imaging system coordinate system, the second coordinate of the model center point in the medical imaging system coordinate system is located by aligning the scale indicator arrow corresponding to the model center point on the 3D stereo calibration model with the scale on the target device; the 3D camera is triggered to acquire an image of the 3D stereo calibration model; and according to the coordinate information of the model center point in the medical imaging system coordinate system at the first position and the model center point in the medical imaging system coordinate system at the second position, the coordinates of each feature point in the image in the medical imaging system coordinate system are calculated to obtain the second calculated coordinates of each feature point, including: according to the first coordinate and the second coordinate, the coordinates of each feature point in the image in the medical imaging system coordinate system are calculated to obtain the second calculated coordinates of each feature point.

[0010] In one embodiment, the data set acquisition step includes: when the 3D stereo calibration model is fixed at one end of the target device corresponding to the medical imaging system coordinate system, using the laser light on the medical imaging system or the ruler indicator arrow corresponding to the center point of the model on the 3D stereo calibration model to align with the ruler on the target device to locate the initial medical imaging system coordinates of the center point of the model, recording the coordinates and determining the position of the target device as the initial set position; triggering the 3D camera to acquire an image of the 3D stereo calibration model, storing the image and recording the set position of the target device; when the set position is not the last set position of the target device, controlling the target device together with the 3D stereo calibration model fixed thereon to move according to the set movement interval d LMove along the Z axis of the medical imaging system coordinate system to the next set position, and return to execute the operation of triggering the 3D camera to collect the image of the 3D stereo calibration model; wherein the moving step length d L =L / N, where L represents the total movable length of the model on the hospital bed, and N represents the number of images that need to be collected; wherein, all images of the 3D stereo calibration model collected by the 3D camera constitute the first calibration data set; the coordinate information of the center point of the model at each set position in the medical imaging system coordinate system composed of the initial medical imaging system coordinates of the center point of the model and the various set positions of the target device on the Z axis of the medical imaging system coordinate system constitutes the second calibration data set.

[0011] In one embodiment, the data set acquisition step includes: when the 3D stereo calibration model is fixed in sequence at each set position of the target device corresponding to the medical imaging system coordinate system, at each set position, the coordinates of the center point of the model in the medical imaging system coordinate system at the set position are located by aligning the scale indicator arrow on the 3D stereo calibration model corresponding to the center point of the model with the scale on the target device, and recording the coordinates to obtain the second calibration data set; and at each set position, triggering the 3D camera to acquire an image of the 3D stereo calibration model at the set position, storing the image, and obtaining the first calibration data set.

[0012] In one embodiment, the structure of the 3D stereo calibration model is a triangular prism structure with a triangular cross-section, and the calibration pattern is provided on the cylindrical surface where two sides of the triangle are located, and the cylindrical surface where the other side of the triangle is located is a fixed surface; or, the structure of the 3D stereo calibration model is a four-sloped trapezoidal structure, and the calibration pattern is provided on each inclined surface, and the bottom surface where the long bottom side of the trapezoid is located is a fixed surface.

[0013] In one embodiment, a buckle is disposed on the fixing surface, and the buckle is configured to be buckled into a corresponding slot of the target device.

[0014] In one embodiment, the 3D calibration model has a model support skeleton capable of maintaining the flatness of the calibration pattern.

[0015] In one embodiment, the calibration pattern is an alternating black and white checkerboard pattern, or a dot pattern evenly distributed or distributed according to a set pattern, or a triangle pattern evenly distributed or distributed according to a set pattern, or other set graphic patterns evenly distributed or distributed according to a set pattern.

[0016] In one embodiment, the medical imaging system coordinate system is a bed coordinate system TBSC or a device coordinate system DCS.

[0017] In one embodiment, the medical imaging system is a magnetic resonance imaging system or a computer tomography imaging system.

[0018] The calibration system of a 3D camera in a medical imaging system proposed in an embodiment of the present invention comprises: a data set acquisition unit, which is used to trigger a 3D camera to acquire images of the 3D calibration model at different set positions along the Z axis in a medical imaging system coordinate system based on horizontal movement of a 3D calibration model at different set positions in the medical imaging system coordinate system to obtain a first calibration data set; record the coordinate information of the center point of the model in the medical imaging system coordinate system at each set position to obtain a second calibration data set; the 3D calibration model has a plurality of calibration patterns at different angles, each calibration pattern has a plurality of feature points with known relative positional relationships; an internal and external parameter calibration unit, which is used to determine the position of each feature point in each image based on the first calibration data set; The invention relates to a method for obtaining a medical imaging system coordinate system, comprising: obtaining the coordinates of each feature point in the image, and calibrating the internal and external parameters of the 3D camera based on the coordinates of each feature point in each image to obtain the calibrated internal and external parameters of the 3D camera; a medical imaging system coordinate system calibration unit, used for obtaining the coordinates of each feature point in the camera coordinate system of the 3D camera based on the calibrated internal and external parameters; obtaining the coordinates of each feature point in the medical imaging system coordinate system based on the second calibration data set and the geometric relationship between the model center point of the 3D stereo calibration model and each feature point; and calculating the conversion relationship from the camera coordinate system to the medical imaging system coordinate system based on the coordinates of the same feature point in the camera coordinate system and the coordinates in the medical imaging system coordinate system.

[0019] In one embodiment, the data set acquisition unit includes: a first processing module, which is used to locate the initial medical imaging system coordinates of the center point of the model by aligning the laser light on the medical imaging system or the scale indicator arrow on the 3D stereo calibration model corresponding to the center point of the model with the scale on the target device when the 3D stereo calibration model is fixed at one end of the target device corresponding to the medical imaging system coordinate system, store the coordinates in a first storage module, and determine the position of the target device as the initial set position; a second processing module, which is used to trigger the 3D camera to acquire an image of the 3D stereo calibration model, the image is stored in the first storage module, and the set position of the target device is stored in the first storage module; a control module, which is used to control the target device together with the 3D stereo calibration model fixed thereon to move at a set interval d when the set position is not the last set position of the target device LMove along the Z axis of the medical imaging system coordinate system to the next set position, and instruct the second processing module to execute the operation of triggering the 3D camera to collect the image of the 3D stereo calibration model; wherein the moving step length d L =L / N, where L represents the total movable length of the model on the hospital bed, and N represents the number of images that need to be collected; and the first storage module is used to store all images of the 3D stereo calibration model collected by the 3D camera to obtain the first calibration data set; store the initial medical imaging system coordinates of the center point of the model and the various set positions of the target device on the Z axis of the medical imaging system coordinate system, obtain the coordinate information of the center point of the model at each set position in the medical imaging system coordinate system, and constitute the second calibration data set.

[0020] In one embodiment, the data set acquisition unit includes: a second storage module, and a third processing module, which is used to, when the 3D stereo calibration model is fixed in sequence at each set position of the target device corresponding to the medical imaging system coordinate system, at each set position, locate the coordinates of the center point of the model in the medical imaging system coordinate system at the set position by aligning the scale indicator arrow on the 3D stereo calibration model corresponding to the center point of the model with the scale on the target device, and store the coordinates in a second storage module to obtain the second calibration data set; and at each set position, trigger the 3D camera to acquire an image of the 3D stereo calibration model at the set position, and the image is stored in the second storage module to obtain the first calibration data set.

[0021] In one embodiment, it further includes a calibration result verification unit, which includes: a fourth processing module, which is used to determine the initial coordinates of the center point of the model in the medical imaging system coordinate system at the first position based on the first position of the 3D stereo calibration model on the Z axis of the medical imaging system coordinate system; a fifth processing module, which is used to trigger the 3D camera to acquire an image of the 3D stereo calibration model based on the second position of the 3D stereo calibration model on the Z axis of the medical imaging system coordinate system, and determine the coordinate information of the center point of the model in the medical imaging system coordinate system at the second position; a first calculation module, which is used to determine the coordinates of each feature point in the image in the camera coordinate system according to the image, and obtain the coordinates of each feature point in the image according to the conversion relationship from the camera coordinate system to the medical imaging system coordinate system. The coordinates of the feature points in the medical imaging system coordinate system are used to obtain the first calculated coordinates of each feature point; a second calculation module is used to calculate the coordinates of each feature point in the image in the medical imaging system coordinate system according to the coordinate information of the model center point in the medical imaging system coordinate system at the first position and the coordinate information of the model center point in the medical imaging system coordinate system at the second position, so as to obtain the second calculated coordinates of each feature point; a third calculation module is used to calculate the Euclidean distance between the first calculated coordinates and the second calculated coordinates of each feature point, and obtain an average Euclidean distance according to the Euclidean distance calculation of each feature point; a judgment module is used to judge whether the average Euclidean distance is less than a preset threshold value, if so, the verification is passed; otherwise, the data set acquisition unit is notified to perform data set acquisition.

[0022] In one embodiment, when the 3D stereo calibration model is fixed at any position of the target device corresponding to the medical imaging system coordinate system, and the model center point marked on the 3D stereo calibration model is located on the Z axis of the medical imaging system coordinate system, the fourth processing module uses the laser light on the medical imaging system or the ruler indicator arrow corresponding to the model center point on the 3D stereo calibration model to align with the ruler on the target device to locate the coordinates of the model center point in the medical imaging system coordinate system to obtain the initial coordinates; the fifth processing module controls the target device to move to a verification position, records the moving distance of the target device, and triggers the 3D camera to capture an image of the 3D stereo calibration model; the second calculation module calculates the coordinates of each feature point in the image in the medical imaging system coordinate system according to the initial coordinates of the model center point in the medical imaging system coordinate system and the moving distance of the target device to obtain the second calculated coordinates of each feature point.

[0023] In one embodiment, when the 3D stereo calibration model is fixed at any position of the target device corresponding to the medical imaging system coordinate system and the model center point marked on the 3D stereo calibration model is located on the Z axis of the medical imaging system coordinate system, the fourth processing module uses a laser light on the medical imaging system or aligns the scale indicator arrow corresponding to the model center point on the 3D stereo calibration model with the scale on the target device to locate the first coordinate of the model center point in the medical imaging system coordinate system; when the 3D stereo calibration model is fixed at another position of the target device corresponding to the medical imaging system coordinate system and the model center point marked on the 3D stereo calibration model is located on the Z axis of the medical imaging system coordinate system, the fifth processing module locates the second coordinate of the model center point in the medical imaging system coordinate system by aligning the scale indicator arrow corresponding to the model center point on the 3D stereo calibration model with the scale on the target device; the 3D camera is triggered to capture an image of the 3D stereo calibration model; and the second calculation module calculates the coordinates of each feature point in the image in the medical imaging system coordinate system according to the first coordinate and the second coordinate to obtain the second calculated coordinates of each feature point.

[0024] A 3D stereo calibration model is proposed in an embodiment of the present invention. The 3D stereo calibration model has a plurality of calibration patterns at different angles, and each calibration pattern has a plurality of feature points with known relative positional relationships.

[0025] In one embodiment, the structure of the 3D stereo calibration model is a triangular prism structure with a triangular cross-section, and the calibration pattern is provided on the cylindrical surface where two sides of the triangle are located, and the cylindrical surface where the other side of the triangle is located is a fixed surface; or, the structure of the 3D stereo calibration model is a four-sloped trapezoidal structure, and the calibration pattern is provided on each inclined surface, and the bottom surface where the long bottom side of the trapezoid is located is a fixed surface.

[0026] In one embodiment, a buckle is disposed on the fixing surface, and the buckle is configured to be buckled into a corresponding slot of the target device.

[0027] In one embodiment, the 3D calibration model has a model support skeleton capable of maintaining the flatness of the calibration pattern.

[0028] In one embodiment, the calibration pattern is an alternating black and white checkerboard pattern, or a dot pattern evenly distributed or distributed according to a set pattern, or a triangle pattern evenly distributed or distributed according to a set pattern, or other set graphic patterns evenly distributed or distributed according to a set pattern.

[0029] In one embodiment, the medical imaging system coordinate system is a bed coordinate system TBSC or a device coordinate system DCS.

[0030] Another calibration system for a 3D camera in a medical imaging system proposed in an embodiment of the present invention includes: at least one memory and at least one processor, wherein: the at least one memory is used to store a computer program; the at least one processor is used to call the computer program stored in the at least one memory to execute the calibration method for a 3D camera in a medical imaging system as described in any of the above embodiments.

[0031] The computer-readable storage medium proposed in the embodiment of the present invention stores a computer program thereon; the computer program can be executed by a processor and implements the calibration method of a 3D camera in a medical imaging system as described in any of the above embodiments.

[0032] It can be seen from the above scheme that, in the embodiment of the present invention, the calibration of the 3D camera is performed based on the 3D stereo calibration model, and the 3D stereo calibration model can simultaneously present multiple calibration images at different angles. Therefore, the movement of the 3D stereo calibration model in one horizontal direction can replace the movement of the handheld plane model in multiple degrees of freedom, thereby reducing the number of images of the calibration data set and reducing the data set acquisition time. In addition, by placing the 3D stereo calibration model in the medical imaging system coordinate system, the medical imaging system coordinates corresponding to the calibration pattern can be determined simultaneously when the image of the calibration pattern is acquired. In this way, after completing the calibration of the camera's internal and external parameters, the coordinates of the feature points in the calibration pattern in the camera coordinate system and in the medical imaging system coordinate system can be directly used to determine the conversion matrix from the camera coordinate system to the medical imaging system coordinate system, thereby completing the calibration of the medical imaging system coordinate system, that is, the coordinate mapping conversion process. It can be seen that one data acquisition can be calibrated twice at the same time, which further shortens the calibration process and improves the calibration efficiency; and, the seamless connection between the camera's internal and external parameter calibration process and the coordinate mapping conversion process is achieved. The integrated workflow greatly improves the work efficiency of the entire workflow and reduces the calibration complexity.

[0033] In addition, by providing two ways to collect data sets in the coordinate system of the medical imaging system, namely, the movement of the target device and the movement of the 3D stereo calibration model, the flexibility of data set collection is improved. Moreover, the data set collection based on the movement of the target device has a higher system automation performance. The data set collection based on the movement of the 3D stereo calibration model has a higher adaptability and versatility for different systems.

[0034] Furthermore, by providing a verification method for the calibration results, the accuracy of the calibration results can be improved; and the automated verification workflow can quickly verify the calibration results, saving time in the verification process.

[0035] Finally, the buckle design of the calibration model can fix the 3D calibration model to the target device such as the hospital bed, which can ensure that the center point of the model is located on the Z axis of the medical imaging system coordinate system. In addition, it can also prevent the relative movement of the 3D calibration model and the target device such as the hospital bed during the movement process, ensuring the accuracy of data collection. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings so that those skilled in the art can better understand the above and other features and advantages of the present invention. In the accompanying drawings:

[0037] 1A and Figure 1B Schematic diagram of the two current two-dimensional plane calibration models.

[0038] Figure 2 Schematic diagram of the relationship between the world coordinate system and the camera coordinate system.

[0039] Figure 3 Schematic diagram of the positional relationship between the camera coordinate system and the bed coordinate system (TBCS).

[0040] Figure 4 This is an exemplary flow chart of a calibration method for a 3D camera in a medical imaging system in an embodiment of the present invention.

[0041] FIG. 5A to FIG. 5C Detailed description of the invention is given in FIG. 5 , which is a schematic diagram of the structure of a 3D stereo calibration model in an embodiment of the present invention.

[0042] Figure 6 The following is an exemplary flow chart of the data set collection step in an example of the present invention.

[0043] Figure 7 The present invention is an exemplary flowchart of the internal and external parameter calibration steps in an example.

[0044] Figure 8 The present invention is an exemplary flowchart of the steps of calibrating the coordinate system of a medical imaging system in an example.

[0045] Fig. 9 An exemplary flow chart of the calibration result verification step in an example of the present invention.

[0046] Fig.10 4 is an exemplary structural diagram of a calibration system for a 3D camera in a medical imaging system in an embodiment of the present invention.

[0047] Fig.11 for Fig.10 A structural diagram of a data set acquisition unit in FIG.

[0048] Fig.12 for Fig.10 Another structural schematic diagram of the data set acquisition unit.

[0049] Fig.13 for Fig.10 Schematic diagram of the structure of the calibration result verification unit.

[0050] Fig.14 The figure is a schematic diagram of the structure of a calibration system for a 3D camera in a medical imaging system in another embodiment of the present invention.

[0051] The reference numerals are as follows:

[0052]

[0053] DETAILED DESCRIPTION

[0054] In the embodiment of the present invention, considering that the calibration of the camera requires a calibration model, the calibration of the camera's internal and external parameters requires collecting images of the calibration model at different positions and angles as a calibration data set. The commonly used calibration models are as follows: Figure 1A and Figure 1B The 2D plane calibration model shown in the figure. During the data set collection process of the 2D plane calibration model, the calibration model needs to be held in different positions and rotated at different angles to collect the data set, so as to ensure the completeness of the calibration data set in 3 translations and 3 rotations, a total of 6 degrees of freedom. Therefore, a large number of pictures need to be collected. For example, about 15 pictures, about 15*54 feature points. . Manual translation and rotation of the calibration model increases the interference of non-standardized human factors, and the data set acquisition time is long and the acquisition efficiency is low. To this end, in this embodiment, it is considered to provide a 3D stereo calibration model, which can simultaneously present multiple calibration images at different angles. Therefore, the movement of the 3D stereo calibration model in one horizontal direction can replace the movement of the handheld plane model in multiple degrees of freedom, thereby reducing the number of images of the calibration data set and reducing the data set acquisition time.

[0055] In addition, considering that the camera calibration and the conversion mapping of the medical imaging system coordinate system are currently performed independently in different steps based on separately collected data sets. That is:

[0056] 1) The calibration of the camera’s internal and external parameters is to obtain a calibration data set by collecting images of the calibration model at different positions and angles, and then perform camera calibration based on the calibration data set. According to the camera imaging model, the coordinates of the object in the image coordinate system (μ, v) and its coordinates in the camera coordinate system (X c , Y c , Z c) is shown in the following formula (1):

[0057]

[0058] Where K is called the internal parameter of the camera, f x , f y It is related to the focal length and pixel size of the camera.

[0059] The 3D camera can obtain the photographed object in the world coordinate system (Z W , Y W , Z W ) in the camera coordinate system (X c , Y c , Z c ), Figure 2 The relationship between the world coordinate system and the camera coordinate system is shown in the following equation (2):

[0060]

[0061] Where R represents the rotation matrix, t represents the translation matrix, and T is called the external parameters of the camera.

[0062] The intrinsic and extrinsic parameters of the above-mentioned cameras can be obtained through a calibration algorithm, such as Zhang's calibration algorithm.

[0063] 2) Taking the case where the coordinate system of the medical imaging system is the bed coordinate system (TBCS) as an example, the camera coordinate system (x c ,y c ,z c ) is mapped to the medical imaging system coordinate system such as the bed coordinate system (TBCS) (x TBCS ,y TBCS ,z TBCS ), it is necessary to calculate the conversion matrix from the camera coordinate system to the bed coordinate system, so as to determine the coordinates of the patient in the bed coordinate system for corresponding positioning. The process of calculating the conversion matrix from the camera coordinate system to the bed coordinate system is called bed coordinate system calibration. Figure 3 The schematic diagram of the positional relationship between the camera coordinate system and the bed coordinate system (TBCS) is shown in Figure 1. When calculating the transformation matrix, currently, the coordinates of the fixed common point in the two coordinate systems can be found, and then the coordinate mapping relationship of the two coordinate systems can be calculated by the least squares method, or the transformation relationship can be calculated by fixing the reference coordinate system rotation matrix.

[0064] Currently, the camera calibration and the conversion mapping of the bed coordinate system are performed separately in steps that are not closely related to each other, and separate data sets need to be collected twice, which is not conducive to the automation of the application, and the entire calibration process takes a long time.

[0065] To this end, in an embodiment of the present invention, it is considered to fix the calibration model to a device corresponding to the coordinate system of the medical imaging system. For example, when the coordinate system of the medical imaging system is a hospital bed, the calibration model can be fixed to the hospital bed. In this way, on the one hand, it can ensure that the center point of the model is located on the Z-axis of the hospital bed coordinate system, and can prevent the relative movement of the calibration model and the hospital bed during the movement of the hospital bed, thereby ensuring the accuracy of data acquisition; on the other hand, based on the movement of the calibration model in the hospital bed coordinate system (such as controlling the hospital bed to drive the calibration model to move), the data set can be automatically collected, and the obtained data set can be used for camera calibration and conversion mapping of the hospital bed coordinate system without the need to collect a separate data set twice, and can also seamlessly connect the camera internal and external parameter calibration process and the coordinate mapping conversion process. The integrated workflow greatly improves the work efficiency of the entire workflow and reduces the calibration complexity.

[0066] In addition, in the embodiment of the present invention, it is also possible to consider automatically verifying the calibration results to improve the accuracy of the calibration results and save time in the verification process.

[0067] In order to make the purpose, technical solutions and advantages of the present invention more clear, the present invention is further described in detail with reference to the following embodiments.

[0068] Figure 4 FIG. 1 is an exemplary flow chart of a calibration method for a 3D camera in a medical imaging system according to an embodiment of the present invention. Figure 4 As shown, the method may include the following steps:

[0069] Step S1, data set collection.

[0070] Step S2, internal and external parameter calibration.

[0071] Step S3, calibrating the coordinate system of the medical imaging system.

[0072] Step S4, calibration result verification. If the verification is successful, the process ends; otherwise, the process returns to step S1.

[0073] In some implementations, if the accuracy of each step in the calibration process is relatively high, step S4 may be omitted.

[0074] Each step is described in detail below.

[0075] Step S1, data set collection step.

[0076] Based on the horizontal movement of a 3D calibration model at different set positions along the Z axis in the coordinate system of the medical imaging system, a 3D camera is triggered to collect images of the 3D calibration model at each set position to obtain a first calibration data set; the coordinate information of the center point of the model in the coordinate system of the medical imaging system at each set position is recorded to obtain a second calibration data set. A plurality of calibration patterns at different angles are drawn on the 3D calibration model, and each calibration pattern has a plurality of feature points. The coordinate information may include the coordinate itself, or information related to the coordinate.

[0077] First, a detailed introduction to the calibration model used in this step is given.

[0078] In this embodiment, the calibration model used for data set collection is a 3D stereo calibration model, which can have multiple calibration patterns at different angles at the same time. The composition of each calibration pattern is the same, and each calibration pattern has multiple feature points with known relative positional relationships.

[0079] FIG. 5A to FIG. 5C A schematic diagram of the structure of a 3D stereo calibration model is shown in FIG. FIG. 5A to FIG. 5C As shown, the structure of the 3D stereo calibration model is a triangular prism structure with a triangular cross-section, and a calibration pattern 41 is provided on the cylindrical surface where two sides of the triangle are located, and the cylindrical surface where the other side of the triangle is located is the bottom surface, which is generally used as a fixed surface. The cross-section of the 3D stereo calibration model in this embodiment is an isosceles triangle, and in other embodiments, it can also be a non-isosceles triangle. In addition, the 3D stereo calibration model can also have other structural forms, for example, it can also be a four-slant trapezoidal structure, and a calibration pattern is provided on each inclined surface, and the bottom surface where the long bottom side of the trapezoid is located is the fixed surface.

[0080] like Figure 5A and Figure 5C As shown, the calibration pattern 41 on the 3D calibration model is a checkerboard pattern of alternating black and white. In other embodiments, the calibration pattern may also be a dot pattern that is evenly distributed or distributed according to a set rule, or a triangle pattern that is evenly distributed or distributed according to a set rule, or a pattern of other set graphics that is evenly distributed or distributed according to a set rule. In specific implementation, it can be determined according to actual conditions. Of course, different calibration patterns may have different detection difficulties and reliability for model feature points. For example, when the camera resolution is low, the reliability of feature points detected by using an evenly distributed dot pattern may be higher. Therefore, selecting a suitable calibration pattern in a medical imaging system can improve the accuracy of camera calibration or coordinate mapping.

[0081] The 3D calibration model is also marked with a model center point 42, so that the geometric relationship between the model center point 42 and each feature point in the calibration pattern can be determined based on the model center point 42. In specific applications, in order to realize the horizontal movement of the 3D calibration model along different set positions on the Z axis in the medical imaging system coordinate system, the 3D calibration model needs to be placed on the target device corresponding to the medical imaging system coordinate system, and the model center point 42 is located on the Z axis of the medical imaging system coordinate system. For example, taking the case where the medical imaging system coordinate system is a bed coordinate system and the target device is a bed as an example, the 3D calibration model can be placed on the bed, and the model center point 42 can be located on the Z axis of the bed coordinate system. After the bed coordinates of the model center point 42 are determined, the bed coordinates of the model center point 42 can be located, for example, by aiming the laser light of the medical imaging system at the model center point 42, and then the bed coordinates of each feature point can be calculated based on the bed coordinates of the model center point 42 and the geometric relationship between the model center point 42 and other feature points. In addition, in this embodiment, a scale indicator arrow 43 corresponding to the model center point 42 is further provided at the bottom edge of the calibration pattern, so that when the positioning accuracy of the laser light is not enough, the coordinates of the model center point 42 can be Figure 5C As shown, positioning is performed by the scale indicator arrow 43 pointing to the scale 45 on the bed 44.

[0082] In addition, in order to increase the service life of the 3D calibration model so that the calibration pattern can remain flat and does not shrink or collapse over time, a model support skeleton 46 capable of maintaining the flatness of the calibration pattern can be further provided in the 3D calibration model.

[0083] In order to achieve better fixation and ensure that the model center point 42 is located on the Z axis of the medical imaging system coordinate system, such as the bed coordinate system, in this embodiment, a plurality of pairs of buckles 47 ( Figure 5B In the figure, two pairs of buckles are provided as an example, and the buckles 47 are configured to be buckled into corresponding slots 48 on the hospital bed 44.

[0084] The specific implementation of this step is described in detail below.

[0085] In specific implementation, this step can be implemented in multiple specific ways, two of which are introduced below.

[0086] The first method: moving the target device: fix the 3D stereo calibration model on the target device corresponding to the medical imaging system coordinate system, locate the initial coordinates of the model center point in the medical imaging system coordinate system and determine the initial position of the target device, control the target device to move to various positions according to the set moving interval based on the initial position, and the initial position of the target device and the various positions where the target device moves are called the various set positions of the 3D stereo calibration model along the Z axis in the medical imaging system coordinate system, collect images of the 3D stereo calibration model at each set position, store the images and record each set position.

[0087] Still take the case where the medical imaging system coordinate system is the bed coordinate system and the target device is the bed as an example.

[0088] Figure 6 FIG. 1 is an exemplary flow chart of the data set collection step S1 in an example of the present invention. Figure 6 As shown, step S1 may include the following steps:

[0089] S11, fixing the 3D calibration model at the foot of the hospital bed.

[0090] S12, using the laser light on the medical imaging system or the ruler indicator arrow on the 3D calibration model to align with the ruler on the bed to locate the coordinates of the model center point 42 at the initial set position of the medical imaging system, and record the coordinates, and record the bed position at this time as P0, P0 = (x TBCS ,y TBCS ,z TBCS ).

[0091] S13, triggering the 3D camera to collect an image of the 3D calibration model, storing the image and recording the set position of the bed. Here, the set position of the bed is coordinate related information.

[0092] In this step, because the bed coordinates of the model center point at the initial setting position are available, and because the bed is only moved at equal intervals in the Z-axis direction of the bed coordinate system, the bed coordinates of each setting position can be obtained by accumulating the Z-axis increase data corresponding to each setting position on the basis of the bed coordinates of the initial setting position. Therefore, in this embodiment, only the coordinate-related information of each setting position of the bed needs to be recorded. Of course, it is also possible to record the moving distance of each setting position of the bed relative to the initial setting position.

[0093] S14, determine whether the last set position of the bed is reached? If yes, then end the collection of the data set. Otherwise, execute step S15.

[0094] S15, controlling the bed and the 3D calibration model fixed thereon to move according to the set movement interval d LMove along the Z axis of the bed coordinate system to the next set position P1, and return to execute step S13.

[0095] Among them, the moving step length d L =L / N, where L represents the total length of the model that can be moved on the bed, and N represents the number of images that need to be collected.

[0096] Among them, the images of the 3D stereo calibration model at each set position of the bed collected by the 3D camera constitute the first calibration data set; the bed coordinates of the center point of the model at the initial set position of the bed and the various set positions of the bed along the Z axis of the bed coordinate system constitute the coordinate information of the center point of the model at each set position of the bed (that is, each set position along the Z axis in the bed coordinate system), which constitutes the second calibration data set.

[0097] The second type: moving the 3D stereo calibration model: fix the 3D stereo calibration model at each set position on the target device in turn, and the various set positions of the 3D stereo calibration model on the target device are called the set positions of the 3D stereo calibration model along the Z axis in the medical imaging system coordinate system. Corresponding to each set position, the image of the 3D stereo calibration model is collected and the medical imaging system coordinates of the 3D stereo calibration model at each set position are determined.

[0098] Still take the case where the medical imaging system coordinate system is the bed coordinate system and the target device is the bed as an example.

[0099] At this time, step S1 may include the following steps: fixing the 3D stereo calibration model on each set position of the bed in turn; at each set position, using the scale indicator arrow on the 3D stereo calibration model to align with the scale on the target device bed to locate the bed coordinates of the center point of the model at the set position, and recording the coordinates to obtain the second calibration data set; at each set position, triggering the 3D camera to capture the image of the 3D stereo calibration model at the set position, storing the image, and obtaining the first calibration data set.

[0100] Step S2, internal and external parameter calibration step.

[0101] The internal and external parameters of a 3D camera are usually provided by the camera manufacturer. However, during use, the camera may undergo structural changes due to natural wear and tear or other external reasons, which may also change the camera parameters. Therefore, the 3D camera needs to be recalibrated to ensure that it can work correctly.

[0102] In this step, the coordinates of each feature point in each image can be determined based on the first calibration data set, and the internal and external parameters of the 3D camera can be calibrated based on the coordinates of each feature point in each image to obtain the calibrated internal and external parameters of the 3D camera.

[0103] Figure 7 FIG. 1 is an exemplary flow chart of the internal and external parameter calibration step S2 in an example of the present invention. Figure 7 As shown, step S2 may include:

[0104] S21, detecting feature points on each image in the first calibration data set collected in step S1 and the coordinates of each feature point in the image.

[0105] In this step, each feature point can be identified from each image, and the coordinates of each feature point in the image can be determined based on the identification result.

[0106] S22, constructing a model equation of the 3D camera according to the coordinates of each feature point in each image.

[0107] S23, using Zhang's calibration algorithm to solve the internal and external parameters of the 3D camera.

[0108] Step S3, medical imaging system coordinate system calibration step.

[0109] Figure 8 FIG. 1 is an exemplary flow chart of the medical imaging system coordinate system calibration step S3 in an example of the present invention. Figure 8 As shown, step S3 may include:

[0110] S31, based on the internal and external parameters calibrated in step S2 and the coordinates of each feature point in each image determined in step S2, obtaining the coordinates of each feature point in the camera coordinate system of the 3D camera.

[0111] S32, based on the second calibration data set collected in step S1 and the geometric relationship between the center point of the model and each feature point, obtain the coordinates of each feature point in the medical imaging system coordinate system such as the bed coordinate system.

[0112] S33, based on the coordinates of the same feature point in the camera coordinate system and the coordinates in the medical imaging system coordinate system such as the bed coordinate system, calculate the transformation relationship from the camera coordinate system to the medical imaging system coordinate system such as the bed coordinate system.

[0113] Step S4, calibration result verification step.

[0114] Still take the case where the medical imaging system coordinate system is the bed coordinate system and the target device is the bed as an example.

[0115] Fig. 9FIG. 4 is an exemplary flow chart of the calibration result verification step S4 in an example of the present invention. Fig. 9 As shown, step S4 may include the following steps:

[0116] S41, based on a first position of the 3D stereo calibration model on the Z axis of the bed coordinate system, determining the initial coordinates of the center point of the model at the first position in the bed coordinate system.

[0117] There are many ways to implement it:

[0118] The first type: mobile bed.

[0119] In specific implementation, the 3D calibration model can be fixed at any position of the bed, and the model center point of the 3D calibration model is located on the Z axis of the bed coordinate system. Afterwards, the coordinates of the model center point under the medical imaging system can be located by aligning the laser light on the medical imaging system or the scale indicator arrow corresponding to the model center point on the 3D calibration model with the scale on the bed, and the current position of the bed is recorded as the first set position P0.

[0120] The second method: mobile 3D stereo calibration model.

[0121] In specific implementation, the 3D calibration model can also be fixed at any position of the bed, and the model center point of the 3D calibration model is located on the Z axis of the bed coordinate system. Afterwards, the laser light on the medical imaging system or the ruler indicator arrow corresponding to the model center point on the 3D calibration model can be aligned with the ruler on the bed to locate the coordinates of the model center point under the medical imaging system. This process is similar to the process of the mobile bed solution.

[0122] S42, based on the second position of the 3D calibration model on the Z axis of the bed coordinate system, trigger the 3D camera to capture an image of the 3D calibration model, and determine the coordinate information of the bed coordinate system of the center point of the model at the second position. The coordinate information here can be the coordinate itself or coordinate related information.

[0123] For the first method, i.e., the method of moving the bed, in this step, the bed can be moved to a calibration position, such as the initial position (Home position) of the bed, and the moving distance of the target device, i.e., the coordinate-related information, is recorded. At this position, the 3D camera is triggered to capture the image of the 3D calibration model.

[0124] For the second method, i.e., the method of moving the 3D calibration model, in this step, the 3D calibration model can be fixed at another position of the bed, and the center point of the model is also located on the Z axis of the bed coordinate system. Afterwards, the ruler arrow on the 3D calibration model is aligned with the ruler on the bed to locate the bed coordinates of the center point of the model; the 3D camera is triggered to capture the image of the 3D calibration model.

[0125] S43: Based on the image, the coordinates of each feature point in the image in the camera coordinate system may be determined according to formula (1).

[0126] S44, according to the conversion relationship from the camera coordinate system to the medical imaging system coordinate system such as the bed coordinate system calculated in step S33, the coordinates of each feature point in the image in the bed coordinate system can be calculated to obtain the first calculated coordinates (x1 TBCS ,y1 TBCS ,z1 TBCS ).

[0127] S45, calculating the coordinates of each feature point in the image in the bed coordinate system according to the bed coordinates of the center point of the model at the first position and the coordinate information of the center point of the model at the second position in the bed coordinate system, and obtaining the second calculated coordinates ((x2 TBCS ,y2 TBCS ,z2 TBCS )).

[0128] For the first method, that is, the method of moving the bed, in this step, the coordinates of each feature point in the image in the bed coordinate system can be calculated based on the bed coordinates of the model center point at the first set position P0 of the bed and the moving distance of the bed, so as to obtain the second calculated coordinates of each feature point.

[0129] For the second method, that is, the method of moving the bed, in this step, the coordinates of each feature point in the image in the bed coordinate system can be calculated based on the bed coordinates of the model center point at two positions of the bed to obtain the second calculated coordinates of each feature point.

[0130] S46, for each feature point, calculating the Euclidean distance between the first calculated coordinate and the second calculated coordinate of the feature point, and obtaining an average Euclidean distance according to the Euclidean distance calculation of each feature point.

[0131] S47, determining whether the average Euclidean distance is less than a preset threshold, if yes, the verification is passed; otherwise, returning to execute the data set collection step S1.

[0132] In the above embodiments, the medical imaging system coordinate system is mainly used as a bed coordinate system, and the target device is a bed. The same is true for the case where the medical imaging system coordinate system is a device coordinate system DCS. The medical imaging system in the embodiment of the present invention can be a magnetic resonance imaging system or a CT system. For the MR system or CT system, there are corresponding device coordinate system definitions and coordinate system origins in the DICOM standard, which will not be repeated here.

[0133] The calibration method of the 3D camera in the medical imaging system in the embodiment of the present invention is described in detail above. The calibration system of the 3D camera in the medical imaging system in the embodiment of the present invention is described in detail below. The calibration system of the 3D camera in the medical imaging system in the embodiment of the present invention can be used to implement the calibration method of the 3D camera in the medical imaging system in the embodiment of the present invention. For details not disclosed in detail in the embodiment of the system of the present invention, please refer to the corresponding description in the embodiment of the method of the present invention, and will not be repeated here.

[0134] Fig.10 FIG. 1 is an exemplary structural diagram of a calibration system for a 3D camera in a medical imaging system according to an embodiment of the present invention. Fig.10 As shown, the system may include, as shown by the solid line part, a data set acquisition unit 1010 , an internal and external parameter calibration unit 1020 , and a medical imaging system coordinate system calibration unit 1030 .

[0135] Among them, the data set acquisition unit 1010 is used to trigger the 3D camera to acquire images of the 3D stereo calibration model at each set position based on the horizontal movement of a 3D stereo calibration model along different set positions on the Z axis in the medical imaging system coordinate system, so as to obtain a first calibration data set; record the coordinate information of the center point of the model in the medical imaging system coordinate system at each set position to obtain a second calibration data set; and draw a plurality of calibration patterns at different angles on the 3D stereo calibration model, each calibration pattern having a plurality of feature points.

[0136] The internal and external parameter calibration unit 1020 is used to determine the coordinates of each feature point in each image based on the first calibration data set, and calibrate the internal and external parameters of the 3D camera based on the coordinates of each feature point in each image to obtain the calibrated internal and external parameters of the 3D camera.

[0137] The medical imaging system coordinate system calibration unit 1030 is used to obtain the coordinates of each feature point in the camera coordinate system of the 3D camera based on the calibrated internal and external parameters; obtain the coordinates of each feature point in the medical imaging system coordinate system based on the second calibration data set and the geometric relationship between the model center point of the 3D stereo calibration model and each feature point; and calculate the conversion relationship from the camera coordinate system to the medical imaging system coordinate system based on the coordinates of the same feature point in the camera coordinate system and the coordinates in the medical imaging system coordinate system.

[0138] In specific implementation, the data set collection unit 1010 may be implemented in a variety of ways. For example, corresponding to the method embodiment, in one implementation, for the case of a mobile target device, the data set collection unit 1010 may be implemented as follows: Fig.11 As shown, it includes: a first processing module 1011, a second processing module 1012, a control module 1013 and a first storage module 1014.

[0139] Among them, the first processing module 1011 is used to locate the initial medical imaging system coordinates of the center point of the model by aligning the laser light on the medical imaging system or the scale indicator arrow on the 3D stereo calibration model corresponding to the center point of the model with the scale on the target device when the 3D stereo calibration model is fixed at one end of the target device corresponding to the medical imaging system coordinate system, store the coordinates in a first storage module 1014, and determine that the position of the target device is the initial set position.

[0140] The second processing module 1012 is used to trigger the 3D camera 1050 to collect an image of the 3D stereo calibration model, the image is stored in the first storage module 1014 , and the set position of the target device is stored in the first storage module 1014 .

[0141] The control module 1013 is used to control the target device and the 3D calibration model fixed thereon to move according to the set movement interval d when the set position is not the last set position of the target device. L Move along the Z axis of the medical imaging system coordinate system to the next set position, and instruct the second processing module 1012 to execute the operation of triggering the 3D camera to collect the image of the 3D stereo calibration model; wherein the moving step length d L =L / N, where L represents the total length of the model that can be moved on the bed, and N represents the number of images that need to be collected.

[0142] The first storage module 1014 is used to store all images of the 3D stereo calibration model captured by the 3D camera to obtain the first calibration data set; store the initial medical imaging system coordinates of the center point of the model and the various set positions of the target device on the Z-axis of the medical imaging system coordinate system, obtain the coordinate information of the center point of the model at each set position in the medical imaging system coordinate system, and constitute the second calibration data set.

[0143] In another embodiment, for the case of a mobile 3D stereo calibration model, the data set acquisition unit 1010 may be as follows: Fig.12 As shown, it includes: a third processing module 1015 and a second storage module 1016. Among them, the third processing module 1015 is used to, when the 3D stereo calibration model is fixed in sequence at each set position of the target device corresponding to the medical imaging system coordinate system, at each set position, by aligning the ruler indicating arrow corresponding to the model center point on the 3D stereo calibration model with the ruler on the target device to locate the coordinates of the model center point in the medical imaging system coordinate system at the set position, and store the coordinates in a second storage module 1016 to obtain the second calibration data set; and at each set position, trigger the 3D camera 1050 to capture the image of the 3D stereo calibration model at the set position, and the image is stored in the second storage module 1016 to obtain the first calibration data set.

[0144] Corresponding to the method embodiment, the system in the embodiment of the present invention can be as follows Fig.10 The dotted part in FIG. 1 further includes a calibration result verification unit 1040 for verifying the calibration result. When the verification is passed, the calibration result is adopted; otherwise, the data set acquisition unit 1010 is instructed to re-acquire the data set.

[0145] In specific implementation, the calibration result verification unit 1040 can be implemented in various forms. Fig.13 One of them is shown in FIG. Fig.13 As shown, the calibration result verification unit 1040 may specifically include: a fourth processing module 1041 , a fifth processing module 1042 , a first calculation module 1043 , a second calculation module 1044 , a third calculation module 1045 and a judgment unit 1046 .

[0146] The fourth processing module 1041 is used to determine the initial coordinates of the center point of the model at the first position in the medical imaging system coordinate system based on the first position of the 3D stereo calibration model on the Z axis of the medical imaging system coordinate system.

[0147] The fifth processing module 1042 is used to trigger the 3D camera 1050 to capture an image of the 3D stereo calibration model based on the second position of the 3D stereo calibration model on the Z axis of the medical imaging system coordinate system, and determine the coordinate information of the center point of the model in the medical imaging system coordinate system at the second position.

[0148] The first calculation module 1043 is used to determine the coordinates of each feature point in the image in the camera coordinate system according to the image and the camera internal and external parameters obtained by the internal and external parameter calibration unit 1020, and obtain the coordinates of each feature point in the image in the medical imaging system coordinate system according to the conversion relationship from the camera coordinate system to the medical imaging system coordinate system obtained by the medical imaging system coordinate system calibration unit 1030, and obtain the first calculated coordinates of each feature point.

[0149] The second calculation module 1044 is used to calculate the coordinates of each feature point in the image in the medical imaging system coordinate system according to the coordinate information of the center point of the model at the first position in the medical imaging system coordinate system and the coordinate information of the center point of the model at the second position in the medical imaging system coordinate system, so as to obtain the second calculated coordinates of each feature point.

[0150] The third calculation module 1045 is used to calculate the Euclidean distance between the first calculated coordinates and the second calculated coordinates of each feature point, and obtain an average Euclidean distance according to the Euclidean distance calculation of each feature point.

[0151] The judgment module 1046 is used to judge whether the average Euclidean distance is less than a preset threshold value. If so, the verification is passed; otherwise, the data set collection unit 1010 is notified to collect the data set.

[0152] In specific implementation, corresponding to the case of a moving target device, the fourth processing module 1041 can be used to fix the 3D stereo calibration model at any position of the target device corresponding to the medical imaging system coordinate system, and when the model center point marked on the 3D stereo calibration model is located on the Z-axis of the medical imaging system coordinate system, use the laser light on the medical imaging system or the ruler indicator arrow corresponding to the model center point on the 3D stereo calibration model to align with the ruler on the target device to locate the coordinates of the model center point in the medical imaging system coordinate system to obtain the initial coordinates.

[0153] The fifth processing module 1042 can control the target device to move to a verification position, and record the moving distance of the target device, and at the same time trigger the 3D camera to capture the image of the 3D stereo calibration model.

[0154] Accordingly, the second calculation module 1044 can calculate the coordinates of each feature point in the image in the medical imaging system coordinate system according to the initial coordinates of the model center point in the medical imaging system coordinate system and the moving distance of the target device to obtain the second calculated coordinates of each feature point.

[0155] Corresponding to the case of moving the 3D stereo calibration model, the fourth processing module 1041, when the 3D stereo calibration model is fixed at any position of the target device corresponding to the medical imaging system coordinate system, and the model center point marked on the 3D stereo calibration model is located on the Z-axis of the medical imaging system coordinate system, uses the laser light on the medical imaging system or aligns the scale indicator arrow corresponding to the model center point on the 3D stereo calibration model with the scale on the target device to locate the first coordinate of the model center point in the medical imaging system coordinate system.

[0156] The fifth processing module 1042 can locate the second coordinate of the model center point in the medical imaging system coordinate system by aligning the scale indicator arrow corresponding to the model center point on the 3D stereo calibration model with the scale on the target device when the 3D stereo calibration model is fixed at another position of the target device corresponding to the medical imaging system coordinate system and the model center point marked on the 3D stereo calibration model is located on the Z-axis of the medical imaging system coordinate system; and trigger the 3D camera to capture an image of the 3D stereo calibration model.

[0157] Correspondingly, the second calculation module 1044 may calculate the coordinates of each feature point in the image in the medical imaging system coordinate system according to the first coordinates and the second coordinates to obtain the second calculated coordinates of each feature point.

[0158] Fig.14 FIG. 1 is a schematic diagram of a structure of a calibration system for a 3D camera in a medical imaging system according to another embodiment of the present invention. Figure 4 As shown, the system may include: at least one memory 1401 and at least one processor 1402. In addition, some other components may be included, such as communication ports, etc. These components communicate via a bus 1403.

[0159] Among them, at least one memory 1401 is used to store a computer program. In one embodiment, the computer program can be understood to include Figures 10 to 13 The modules of the calibration system of the 3D camera in the medical imaging system are shown. In addition, at least one memory 1401 can also store an operating system, etc. The operating system includes but is not limited to: Android operating system, Symbian operating system, Windows operating system, Linux operating system, etc.

[0160] At least one processor 1402 is used to call the computer program stored in at least one memory 1401 to execute the calibration method of the 3D camera in the medical imaging system described in the embodiment of the present invention. The processor 1402 can be a CPU, a processing unit / module, an ASIC, a logic module or a programmable gate array, etc. It can receive and send data through the communication port.

[0161] It should be noted that not all steps and modules in the above processes and structure diagrams are necessary, and some steps or modules can be ignored according to actual needs. The execution order of each step is not fixed and can be adjusted as needed. The division of each module is only for the convenience of describing the functional division adopted. In actual implementation, a module can be implemented by multiple modules, and the functions of multiple modules can also be implemented by the same module. These modules can be located in the same device or in different devices.

[0162] It is understood that the hardware modules in the above-mentioned embodiments can be implemented mechanically or electronically. For example, a hardware module may include a specially designed permanent circuit or logic device (such as a dedicated processor, such as an FPGA or ASIC) for completing a specific operation. The hardware module may also include a programmable logic device or circuit (such as a general-purpose processor or other programmable processor) temporarily configured by software for performing a specific operation. As for whether to implement the hardware module in a mechanical manner, or using a dedicated permanent circuit, or using a temporarily configured circuit (such as configured by software), it can be determined based on cost and time considerations.

[0163] In addition, a computer-readable storage medium is provided in an embodiment of the present invention, on which a computer program is stored, and the computer program can be executed by a processor and implement the calibration method of a 3D camera in a medical imaging system described in an embodiment of the present invention. Specifically, a system or device equipped with a storage medium can be provided, on which a software program code for implementing the functions of any of the above-mentioned embodiments is stored, and the computer (or CPU or MPU) of the system or device reads out and executes the program code stored in the storage medium. In addition, the operating system operated on the computer can also be made to complete part or all of the actual operations through instructions based on the program code. The program code read from the storage medium can also be written to a memory provided in an expansion board inserted into the computer or to a memory provided in an expansion unit connected to the computer, and then the CPU installed on the expansion board or the expansion unit is made to perform part and all of the actual operations based on the instructions of the program code, thereby realizing the functions of any of the above-mentioned embodiments. The storage medium implementation for providing the program code includes a floppy disk, a hard disk, a magneto-optical disk, an optical disk (such as CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD+RW), a magnetic tape, a non-volatile memory card and a ROM. Alternatively, the program code may be downloaded from a server computer via a communications network.

[0164] It can be seen from the above scheme that, in the embodiment of the present invention, the calibration of the 3D camera is performed based on the 3D stereo calibration model, and the 3D stereo calibration model can simultaneously present multiple calibration images at different angles. Therefore, the movement of the 3D stereo calibration model in one horizontal direction can replace the movement of the handheld plane model in multiple degrees of freedom, thereby reducing the number of images of the calibration data set and reducing the data set acquisition time. In addition, by placing the 3D stereo calibration model in the medical imaging system coordinate system, the medical imaging system coordinates corresponding to the calibration pattern can be determined simultaneously when the image of the calibration pattern is acquired. In this way, after completing the calibration of the camera's internal and external parameters, the coordinates of the feature points in the calibration pattern in the camera coordinate system and in the medical imaging system coordinate system can be directly used to determine the conversion matrix from the camera coordinate system to the medical imaging system coordinate system, thereby completing the calibration of the medical imaging system coordinate system, that is, the coordinate mapping conversion process. It can be seen that one data acquisition can be calibrated twice at the same time, which further shortens the calibration process and improves the calibration efficiency; and, the seamless connection between the camera's internal and external parameter calibration process and the coordinate mapping conversion process is achieved. The integrated workflow greatly improves the work efficiency of the entire workflow and reduces the calibration complexity.

[0165] In addition, by providing two ways to collect data sets in the coordinate system of the medical imaging system, namely, the movement of the target device and the movement of the 3D stereo calibration model, the flexibility of data set collection is improved. Moreover, the data set collection based on the movement of the target device has a higher system automation performance. The data set collection based on the movement of the 3D stereo calibration model has a higher adaptability and versatility for different systems.

[0166] Furthermore, by providing a verification method for the calibration results, the accuracy of the calibration results can be improved; and the automated verification workflow can quickly verify the calibration results, saving time in the verification process.

[0167] Finally, the buckle design of the calibration model can fix the 3D calibration model to the target device such as the hospital bed, which can ensure that the center point of the model is located on the Z axis of the medical imaging system coordinate system. In addition, it can also prevent the relative movement of the 3D calibration model and the target device such as the hospital bed during the movement process, ensuring the accuracy of data collection.

[0168] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for calibrating a 3D camera in a medical imaging system, characterized in that: include: Data set acquisition step (S1): based on the horizontal movement of a 3D stereo calibration model at different set positions along the Z axis in the medical imaging system coordinate system, triggering a 3D camera to acquire images of the 3D stereo calibration model at each set position to obtain a first calibration data set; recording the coordinate information of the center point of the model in the medical imaging system coordinate system at each set position to obtain a second calibration data set; the 3D stereo calibration model has a plurality of calibration patterns at different angles, and each calibration pattern has a plurality of feature points with known relative positional relationships; Intrinsic and external parameter calibration step (S2): based on the first calibration data set, determining the coordinates of each feature point in each image, and based on the coordinates of each feature point in each image, calibrating the intrinsic and external parameters of the 3D camera to obtain the calibrated intrinsic and external parameters of the 3D camera; Medical imaging system coordinate system calibration step (S3): based on the calibrated internal and external parameters, obtaining the coordinates of each feature point in the camera coordinate system of the 3D camera; based on the second calibration data set and the geometric relationship between the model center point of the 3D stereo calibration model and each feature point, obtaining the coordinates of each feature point in the medical imaging system coordinate system; based on the coordinates of the same feature point in the camera coordinate system and the coordinates in the medical imaging system coordinate system, calculating the conversion relationship from the camera coordinate system to the medical imaging system coordinate system.

2. The method for calibrating a 3D camera in a medical imaging system according to claim 1, characterized in that: The method further comprises a calibration result verification step (S4): S41: Based on a first position of the 3D stereo calibration model on the Z axis of the medical imaging system coordinate system, determining an initial coordinate of the center point of the model at the first position in the medical imaging system coordinate system; S42: based on a second position of the 3D stereo calibration model on the Z axis of the medical imaging system coordinate system, triggering the 3D camera to capture an image of the 3D stereo calibration model, and determining coordinate information of the center point of the model at the second position in the medical imaging system coordinate system; S43: determining the coordinates of each feature point in the image in the camera coordinate system according to the image, S44: obtaining the coordinates of each feature point in the image in the medical imaging system coordinate system according to the conversion relationship from the camera coordinate system to the medical imaging system coordinate system, and obtaining the first calculated coordinates of each feature point; S45: Calculate the coordinates of each feature point in the image in the medical imaging system coordinate system according to the initial coordinates of the center point of the model at the first position in the medical imaging system coordinate system and the coordinate information of the center point of the model at the second position in the medical imaging system coordinate system to obtain second calculated coordinates of each feature point; S46: for each feature point, calculating the Euclidean distance between the first calculated coordinate and the second calculated coordinate of the feature point, and obtaining an average Euclidean distance according to the Euclidean distance calculation of each feature point; S47: Determine whether the average Euclidean distance is less than a preset threshold value. If so, the verification is passed; otherwise, return to execute the data set collection step.

3. The method for calibrating a 3D camera in a medical imaging system according to claim 2, characterized in that: The determining, based on the first position of the 3D stereo calibration model on the Z axis of the medical imaging system coordinate system, the initial coordinates of the center point of the model in the medical imaging system coordinate system at the first position comprises: when the 3D stereo calibration model is fixed at any position of the target device corresponding to the medical imaging system coordinate system, and the model center point marked on the 3D stereo calibration model is located on the Z axis of the medical imaging system coordinate system, aligning the laser light on the medical imaging system or the ruler indicating arrow on the 3D stereo calibration model corresponding to the model center point with the ruler on the target device to locate the coordinates of the model center point in the medical imaging system coordinate system, and obtaining the initial coordinates; The triggering of the 3D camera to acquire an image of the 3D calibration model based on the second position of the 3D calibration model on the Z axis of the medical imaging system coordinate system, and determining the coordinate information of the center point of the model under the medical imaging system at the second position includes: moving the target device to a verification position and recording the moving distance of the target device; triggering the 3D camera to acquire an image of the 3D calibration model; The method calculates the coordinates of each feature point in the image in the medical imaging system coordinate system according to the coordinate information of the center point of the model at the first position in the medical imaging system coordinate system and the coordinate information of the center point of the model at the second position in the medical imaging system coordinate system to obtain the second calculated coordinates of each feature point, including: calculating the coordinates of each feature point in the image in the medical imaging system coordinate system according to the initial coordinates of the center point of the model in the medical imaging system coordinate system and the moving distance of the target device to obtain the second calculated coordinates of each feature point.

4. The method for calibrating a 3D camera in a medical imaging system according to claim 2, characterized in that: The determining, based on the first position of the 3D stereo calibration model on the Z axis of the medical imaging system coordinate system, the initial coordinates of the center point of the model at the first position in the medical imaging system coordinate system comprises: when the 3D stereo calibration model is fixed at any position of the target device corresponding to the medical imaging system coordinate system, and the model center point marked on the 3D stereo calibration model is located on the Z axis of the medical imaging system coordinate system, the first coordinates of the center point of the model in the medical imaging system coordinate system are located by using a laser light on the medical imaging system or by aligning a ruler indicating arrow on the 3D stereo calibration model corresponding to the model center point with a ruler on the target device; The method of triggering the 3D camera to acquire an image of the 3D calibration model based on the second position of the 3D calibration model on the Z axis of the medical imaging system coordinate system, and determining the coordinate information of the center point of the model at the second position in the medical imaging system, includes: when the 3D calibration model is fixed at another position of the target device corresponding to the medical imaging system coordinate system, and the center point of the model marked on the 3D calibration model is located on the Z axis of the medical imaging system coordinate system, the second coordinate of the center point of the model in the medical imaging system coordinate system is located by aligning the scale indicator arrow on the 3D calibration model corresponding to the center point of the model with the scale on the target device; triggering the 3D camera to acquire an image of the 3D calibration model; The method calculates the coordinates of each feature point in the image in the medical imaging system coordinate system according to the coordinate information of the center point of the model at the first position in the medical imaging system coordinate system and the coordinate information of the center point of the model at the second position in the medical imaging system coordinate system to obtain the second calculated coordinates of each feature point, including: calculating the coordinates of each feature point in the image in the medical imaging system coordinate system according to the first coordinates and the second coordinates to obtain the second calculated coordinates of each feature point.

5. The method for calibrating a 3D camera in a medical imaging system according to claim 1, characterized in that: The data set acquisition step (S1) includes: S12: When the 3D stereo calibration model is fixed to one end of the target device corresponding to the medical imaging system coordinate system, the initial medical imaging system coordinates of the center point of the model are located by aligning the laser light on the medical imaging system or the ruler indicating arrow on the 3D stereo calibration model corresponding to the center point of the model with the ruler on the target device, recording the coordinates and determining the position of the target device as the initial set position; S13: triggering the 3D camera to capture an image of the 3D calibration model, storing the image and recording the set position of the target device; S15: When the set position is not the last set position of the target device, control the target device together with the 3D calibration model fixed thereon to move according to the set movement interval d L Move along the Z axis of the medical imaging system coordinate system to the next set position, and return to execute the operation of triggering the 3D camera to collect the image of the 3D stereo calibration model; wherein the moving step length d L =L / N ,in L Indicates the total length of the model that can be moved on the bed. N Indicates the number of images that need to be collected; Among them, all images of the 3D stereo calibration model captured by the 3D camera constitute the first calibration data set; the coordinate information of the center point of the model at each set position in the medical imaging system coordinate system composed of the initial medical imaging system coordinates of the center point of the model and the various set positions of the target device on the Z axis of the medical imaging system coordinate system constitutes the second calibration data set.

6. The method for calibrating a 3D camera in a medical imaging system according to claim 1, characterized in that: The data set acquisition step (S1) includes: When the 3D stereo calibration model is fixed in sequence on each set position of the target device corresponding to the medical imaging system coordinate system, at each set position, the coordinates of the center point of the model in the medical imaging system coordinate system at the set position are located by aligning the scale indicator arrow on the 3D stereo calibration model corresponding to the center point of the model with the scale on the target device, and the coordinates are recorded to obtain the second calibration data set; and at each set position, the 3D camera is triggered to capture an image of the 3D stereo calibration model at the set position, and the image is stored to obtain the first calibration data set.

7. The method for calibrating a 3D camera in a medical imaging system according to claim 1, characterized in that: The structure of the 3D calibration model is a triangular prism structure with a triangular cross section, and the calibration pattern (41) is provided on the prism surface where two sides of the triangle are located, and the prism surface where the other side of the triangle is located is a fixed surface; or The structure of the 3D stereo calibration model is a four-slant trapezoidal structure, and the calibration pattern is provided on each of the slopes, and the bottom surface where the long bottom side of the trapezoid is located is a fixed surface.

8. The method for calibrating a 3D camera in a medical imaging system according to claim 7, characterized in that: A buckle (47) is provided on the fixing surface, and the buckle (47) is configured to be able to be buckled into a corresponding buckle slot (48) of the target device (44).

9. The method for calibrating a 3D camera in a medical imaging system according to any one of claims 1 to 8, characterized in that: The 3D calibration model has a model support skeleton (46) capable of maintaining the flatness of the calibration pattern.

10. The method for calibrating a 3D camera in a medical imaging system according to any one of claims 1 to 8, characterized in that: The calibration pattern (41) is a black and white alternating checkerboard pattern, or a dot pattern evenly distributed or distributed according to a set rule, or a triangle pattern evenly distributed or distributed according to a set rule, or a pattern of other set shapes evenly distributed or distributed according to a set rule.

11. The method for calibrating a 3D camera in a medical imaging system according to any one of claims 1 to 8, characterized in that: The medical imaging system coordinate system is a bed coordinate system TBSC or a device coordinate system DCS.

12. The method for calibrating a 3D camera in a medical imaging system according to any one of claims 1 to 8, characterized in that: The medical imaging system is a magnetic resonance imaging system or a computer tomography imaging system.

13. A calibration system for a 3D camera in a medical imaging system, characterized in that: include: The data set acquisition unit (1010) is used to trigger a 3D camera to acquire images of the 3D stereo calibration model at different set positions based on the horizontal movement of the 3D stereo calibration model at different set positions on the Z axis in the medical imaging system coordinate system, thereby obtaining a first calibration data set; and to record the coordinate information of the center point of the model at each set position in the medical imaging system coordinate system, thereby obtaining a second calibration data set; the 3D stereo calibration model has a plurality of calibration patterns at different angles, and each calibration pattern has a plurality of feature points with known relative positional relationships; An internal and external parameter calibration unit (1020), configured to determine the coordinates of each feature point in each image based on the first calibration data set, and calibrate the internal and external parameters of the 3D camera based on the coordinates of each feature point in each image, so as to obtain the calibrated internal and external parameters of the 3D camera; The medical imaging system coordinate system calibration unit (1030) is used to obtain the coordinates of each feature point in the camera coordinate system of the 3D camera based on the calibrated internal and external parameters; obtain the coordinates of each feature point in the medical imaging system coordinate system based on the second calibration data set and the geometric relationship between the model center point of the 3D stereo calibration model and each feature point; and calculate the conversion relationship from the camera coordinate system to the medical imaging system coordinate system based on the coordinates of the same feature point in the camera coordinate system and the coordinates in the medical imaging system coordinate system.

14. The 3D camera calibration system in the medical imaging system according to claim 13, characterized in that: The data set acquisition unit (1010) comprises: A first processing module (1011) is used to locate the initial medical imaging system coordinates of the center point of the model by aligning the laser light on the medical imaging system or the scale indicator arrow on the 3D stereo calibration model corresponding to the center point of the model with the scale on the target device when the 3D stereo calibration model is fixed on one end of the target device corresponding to the medical imaging system coordinate system, store the coordinates in a first storage module, and determine the position of the target device as the initial set position; A second processing module (1012) is used to trigger the 3D camera to collect an image of the 3D stereo calibration model, the image is stored in the first storage module, and the set position of the target device is stored in the first storage module; A control module (1013) is used to control the target device and the 3D calibration model fixed thereon to move according to a set movement interval d when the set position is not the last set position of the target device. L Move along the Z axis of the medical imaging system coordinate system to the next set position, and instruct the second processing module to execute the operation of triggering the 3D camera to collect the image of the 3D stereo calibration model; wherein the moving step length d L =L / N ,in L Indicates the total length of the model that can be moved on the bed. N Indicates the number of images to be acquired; and The first storage module (1014) is used to store all images of the 3D stereo calibration model captured by the 3D camera to obtain the first calibration data set; store the initial medical imaging system coordinates of the center point of the model and each set position of the target device on the Z axis of the medical imaging system coordinate system, obtain the coordinate information of the center point of the model at each set position in the medical imaging system coordinate system, and form the second calibration data set.

15. The 3D camera calibration system in the medical imaging system according to claim 13, characterized in that: The data set acquisition unit (1010) comprises: a second storage module (1016), and The third processing module (1015) is used to locate the coordinates of the center point of the model in the medical imaging system coordinate system at each set position by aligning the scale indicator arrow on the 3D stereo calibration model corresponding to the center point of the model with the scale on the target device when the 3D stereo calibration model is fixed in sequence at each set position of the target device corresponding to the medical imaging system coordinate system, and store the coordinates in a second storage module (1016) to obtain the second calibration data set; and at each set position, trigger the 3D camera to capture an image of the 3D stereo calibration model at the set position, and the image is stored in the second storage module (1016) to obtain the first calibration data set.

16. The 3D camera calibration system in the medical imaging system according to claim 13, characterized in that: Further comprising a calibration result verification unit (1040), comprising: A fourth processing module (1041) is used to determine the initial coordinates of the center point of the model at the first position in the medical imaging system coordinate system based on the first position of the 3D stereo calibration model on the Z axis of the medical imaging system coordinate system; A fifth processing module (1042) is used to trigger the 3D camera to capture an image of the 3D calibration model based on a second position of the 3D calibration model on the Z axis of the medical imaging system coordinate system, and determine coordinate information of the center point of the model at the second position in the medical imaging system coordinate system; A first calculation module (1043) is used to determine the coordinates of each feature point in the image in the camera coordinate system according to the image, and obtain the coordinates of each feature point in the image in the medical imaging system coordinate system according to the conversion relationship from the camera coordinate system to the medical imaging system coordinate system, and obtain the first calculated coordinates of each feature point; A second calculation module (1044) is used to calculate the coordinates of each feature point in the image in the medical imaging system coordinate system according to the coordinate information of the center point of the model at the first position in the medical imaging system coordinate system and the coordinate information of the center point of the model at the second position in the medical imaging system coordinate system, so as to obtain second calculated coordinates of each feature point; A third calculation module (1045) is used to calculate, for each feature point, the Euclidean distance between the first calculated coordinate and the second calculated coordinate of the feature point, and obtain an average Euclidean distance according to the Euclidean distance calculation of each feature point; The judgment module (1046) is used to judge whether the average Euclidean distance is less than a preset threshold value. If so, the verification is passed; otherwise, the data set collection unit is notified to collect the data set.

17. The 3D camera calibration system in the medical imaging system according to claim 16, characterized in that: The fourth processing module (1041) uses a laser light on the medical imaging system or a ruler indicating arrow on the 3D stereo calibration model corresponding to the model center point to align with the ruler on the target device to locate the coordinates of the model center point in the medical imaging system coordinate system when the 3D stereo calibration model is fixed at any position of the target device corresponding to the medical imaging system coordinate system, and the model center point marked on the 3D stereo calibration model is located on the Z axis of the medical imaging system coordinate system, thereby obtaining the initial coordinates; The fifth processing module (1042) controls the target device to move to a calibration position, records the moving distance of the target device, and triggers the 3D camera to capture an image of the 3D calibration model; The second calculation module (1044) calculates the coordinates of each feature point in the image in the medical imaging system coordinate system according to the initial coordinates of the center point of the model in the medical imaging system coordinate system and the moving distance of the target device, thereby obtaining the second calculated coordinates of each feature point.

18. The 3D camera calibration system in the medical imaging system according to claim 16, characterized in that: The fourth processing module (1041) locates the first coordinate of the model center point in the medical imaging system coordinate system by using a laser light on the medical imaging system or by aligning a ruler indicating arrow on the 3D calibration model corresponding to the model center point with a ruler on the target device when the 3D calibration model is fixed at any position of the target device corresponding to the medical imaging system coordinate system and the model center point marked on the 3D calibration model is located on the Z axis of the medical imaging system coordinate system; The fifth processing module (1042) locates the second coordinate of the model center point in the medical imaging system coordinate system by aligning the scale indicator arrow corresponding to the model center point on the 3D stereo calibration model with the scale on the target device when the 3D stereo calibration model is fixed at another position of the target device corresponding to the medical imaging system coordinate system and the model center point marked on the 3D stereo calibration model is located on the Z axis of the medical imaging system coordinate system; triggers the 3D camera to capture an image of the 3D stereo calibration model; The second calculation module (1044) calculates the coordinates of each feature point in the image in the medical imaging system coordinate system according to the first coordinates and the second coordinates, and obtains second calculated coordinates of each feature point.

19. A 3D stereo calibration model for a medical imaging system, used in the calibration method of a 3D camera in a medical imaging system according to claim 1, characterized in that: The 3D calibration model has a plurality of calibration patterns (41) at different angles, and each calibration pattern (41) has a plurality of feature points with known relative positional relationships.

20. The 3D stereo calibration model according to claim 19, characterized in that: The structure of the 3D calibration model is a triangular prism structure with a triangular cross section, and the calibration pattern (41) is provided on the prism surface where two sides of the triangle are located, and the prism surface where the other side of the triangle is located is a fixed surface; or The structure of the 3D stereo calibration model is a four-slant trapezoidal structure, and the calibration pattern is provided on each of the slopes, and the bottom surface where the long bottom side of the trapezoid is located is a fixed surface.

21. The 3D calibration model according to claim 20, characterized in that: A buckle (47) is provided on the fixing surface, and the buckle (47) is configured to be able to be buckled into a corresponding buckle slot (48) of the target device (44).

22. The 3D stereo calibration model according to any one of claims 19 to 21, characterized in that: The 3D calibration model has a model support skeleton (46) capable of maintaining the flatness of the calibration pattern (41).

23. The 3D calibration model according to any one of claims 19 to 21, characterized in that: The calibration pattern (41) is a black and white alternating checkerboard pattern, or a dot pattern evenly distributed or distributed according to a set rule, or a triangle pattern evenly distributed or distributed according to a set rule, or a pattern of other set shapes evenly distributed or distributed according to a set rule.

24. The 3D stereo calibration model according to any one of claims 19 to 21, characterized in that: The coordinate system of the medical imaging system is a bed coordinate system TBSC or a device coordinate system DCS.

25. A 3D camera calibration system in a medical imaging system, characterized in that: include: At least one memory (1401) and at least one processor (1402), wherein: The at least one memory (1401) is used to store a computer program; The at least one processor (1402) is used to call the computer program stored in the at least one memory (1401) to execute the calibration method of a 3D camera in a medical imaging system according to any one of claims 1 to 12.

26. A computer-readable storage medium having a computer program stored thereon; characterized in that: The computer program can be executed by a processor and implements the calibration method of a 3D camera in a medical imaging system according to any one of claims 1 to 12.

Citation Information

Patent Citations

  • Optical, magnetic, electric composite navigational surgery positioning device and method

    CN101049248A

  • Calibrating method of binocular three-dimensional measuring system

    CN101231750A

  • X-ray CT (Computed Tomography) device

    CN104502378A

  • Single-image CT (computed tomography) machine room camera calibration method

    CN104794718A

  • Adjustable CBCT system calibration model

    CN105232069A