Image positioning and dynamic image generation method, device, system and storage medium
By accurately positioning and adjusting the position and posture of the imaging object in a three-dimensional coordinate system, and combining the alternating exposure technology of multiple imaging paths, three-dimensional dynamic images are generated, which solves the problem that the existing technology cannot collect dynamic images of joints and realizes bone joints The precise positioning and dynamic functional analysis improve the quality and accuracy of image acquisition.
Patent Information
- Application Number
- CN202210196748.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-01
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2042-03-01
AI Technical Summary
Existing orthopedic medical imaging equipment cannot collect and display dynamic images of joints under weight-bearing state, and cannot perform dynamic functional analysis.
By accurately positioning the imaging object in the three-dimensional coordinate system, a three-dimensional static model is generated, and the position and posture of the imaging object are adjusted using an optimization operator, combined with alternating exposure technology of multiple imaging paths, a three-dimensional dynamic image is generated, which reduces interference and improves positioning accuracy sex.
Accurate positioning of bone joints and dynamic image acquisition is achieved, the accuracy of dynamic functional analysis is improved, interference between imaging paths is reduced, and the quality and accuracy of image acquisition is improved.
Smart Images

Figure CN114445497B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of medical imaging technology, and more specifically, to an image positioning and dynamic image generation method, device, system and storage medium. Background Art
[0002] Currently, in the field of orthopedic medical imaging, most of the preoperative diagnosis relies on static X-ray imaging (including digital X-ray photography systems, DT, etc.), and preoperative MRI or ultrasound is often used for joint soft tissue imaging.
[0003] As mentioned above, the imaging equipment used in orthopedic surgery can currently only capture static images of the imaging subject when standing, and cannot capture and display the movement state of the joint under weight-bearing conditions, and thus cannot perform dynamic functional analysis of bone joints. Summary of the invention
[0004] In view of the problem that orthopedic medical imaging equipment can only capture static images of the imaging object when it is standing, and cannot capture images showing the motion state of the joint under weight-bearing state, the purpose of this application is to generate and determine the position of the imaging object in a set three-dimensional coordinate system based on the static image of the imaging object, which can accurately locate the imaging object in the three-dimensional reference space coordinate system. The second purpose of the application is to propose a three-dimensional dynamic image generation method, which generates a three-dimensional dynamic image of the imaging object based on the above positioning data and the three-dimensional static model data of the imaging object. The third purpose of this application is to propose a joint dynamic image generation method, which can accurately obtain the dynamic image of the imaging object (such as bone joint tissue, etc.), which is convenient for dynamic functional analysis of the imaging object; the fourth purpose is to provide a joint dynamic image acquisition device, which can accurately complete the acquisition of graphic data; the fifth purpose is to propose a joint dynamic image acquisition generation system, which can generate dynamic three-dimensional images based on the image data collected by the image acquisition device, which is convenient for dynamic functional analysis of bone joints. Finally, this application also proposes to protect a computer-readable storage medium, which is loaded with a computer program for implementing the joint dynamic image generation method.
[0005] The specific plan is as follows:
[0006] A method for generating and determining the position of an imaging object in a set three-dimensional coordinate system based on a static image of the imaging object,
[0007] Setting a plurality of imaging paths based on an imaging object, storing the relative position relationship of each imaging path, and obtaining actual image data corresponding to the imaging object captured by each imaging path;
[0008] Establishing a three-dimensional reference space coordinate system, generating a three-dimensional static model according to the imaging object, and placing the model at a set imaging position in the three-dimensional reference space coordinate system;
[0009] Setting a plurality of virtual imaging paths through the imaging sites and in the relative position relationship to obtain virtual image data corresponding to each virtual imaging path;
[0010] Calculate and compare the similarity between the virtual image data and the actual image data:
[0011] If it meets the expectation, the position coordinate data of the current imaging site is used as the position data;
[0012] If it does not meet expectations, the imaging site position of the imaging object in the three-dimensional reference space coordinate system is adjusted using an optimization operator, and new virtual image data is generated based on the new imaging site acquisition;
[0013] The newly generated virtual image data is compared with the actual image data until the similarity between the two meets expectations.
[0014] Through the above technical scheme, based on the three-dimensional static model of the imaging object, virtual image data is acquired from a set angle and compared with the actual image data. If the two are the same, it means that the position of the three-dimensional static model at this time is consistent with the position of the actual imaging object, thereby achieving precise positioning of the imaging object.
[0015] Furthermore, the imaging path is determined based on the positions of the ray source and the detector arranged in pairs;
[0016] The relative position relationship of each imaging path includes the angle relationship and the position distance relationship between the imaging paths;
[0017] The actual image data is acquired by alternately exposing ray sources and detectors located on multiple imaging paths.
[0018] Through the above technical solution, the radiation sources on each imaging path are exposed alternately, which can reduce the mutual interference between the imaging paths and improve the accuracy of positioning.
[0019] Furthermore, using the optimization operator to adjust the imaging site position of the imaging object in the three-dimensional reference space coordinate system also includes adjusting the posture of the imaging object in the three-dimensional reference space coordinate system.
[0020] Through the above technical solution, the position and posture of an imaging object with an irregular shape structure can be accurately positioned.
[0021] Further, calculating and comparing the similarity between the virtual image data and the actual image data includes:
[0022] Setting a set number of image feature parameters in the actual image data;
[0023] Establish an image feature parameter similarity comparison algorithm;
[0024] Searching for the image feature parameters in the virtual image data and performing comparison, and outputting similarity based on the comparison result and the comparison algorithm;
[0025] The image characteristic parameters include the shape and size of the image itself, or the shape and size of a local image selected from the image itself, or the shape, size and relative position relationship of several points in the image.
[0026] Based on the above imaging object positioning method, the present application also proposes a three-dimensional dynamic image generation method, including:
[0027] Acquire a three-dimensional static model of the imaging object;
[0028] Acquire actual image data of the imaging object captured on the set imaging path at the current moment;
[0029] Determine the position and posture of the imaging object in the three-dimensional reference space coordinate system at the current moment by using the method for generating and determining the position of the imaging object in the set three-dimensional coordinate system based on the three-dimensional static image of the imaging object as described above;
[0030] According to the control timing when the imaging object is being imaged, the position and posture of the imaging object are continuously generated and output to obtain a three-dimensional dynamic image of the imaging object.
[0031] Through the above technical solution, a three-dimensional dynamic image can be generated based on the actual two-dimensional image data obtained by continuous exposure sampling, which is convenient for dynamic analysis of the imaging object.
[0032] Based on the above three-dimensional dynamic image generation method, the present application also proposes a joint dynamic image generation method, comprising:
[0033] Setting an image acquisition site and setting at least two imaging paths through the image acquisition site;
[0034] Respectively acquiring image data corresponding to each of the imaging paths;
[0035] According to the angles between the imaging paths and the acquired image data, a three-dimensional image corresponding to the image acquisition site is generated based on a three-dimensional imaging algorithm,
[0036] Generate a three-dimensional dynamic image based on a dynamic imaging algorithm using three-dimensional images continuously acquired within a set time period; or
[0037] According to the image data captured by each of the imaging paths, a three-dimensional dynamic image is generated based on the three-dimensional dynamic image generation method as described above.
[0038] Through the above technical solution, images of the set image acquisition position are collected from multiple angles and then converted into three-dimensional images through a three-dimensional imaging algorithm, so as to achieve the upgrade of two-dimensional images to three-dimensional images, and then the three-dimensional images within the set time period are spliced to form a continuous three-dimensional dynamic image, thereby achieving dynamic tracking of the image acquisition position. In addition, the above method can also generate a three-dimensional dynamic image based on the existing three-dimensional static model combined with the image data corresponding to each imaging path obtained by actual sampling.
[0039] Furthermore, the method further comprises:
[0040] Setting at least one tracking point in association with the image acquisition point or its surroundings;
[0041] The spatial vector of each of the imaging paths is adjusted based on the tracking site to ensure that each of the imaging paths passes through the image acquisition site.
[0042] Through the above technical solution, it can be ensured that when the position of the image acquisition site is constantly changing, each imaging path can also obtain image data from a set angle, thereby ensuring the accuracy of subsequent three-dimensional imaging.
[0043] Furthermore, the method further comprises:
[0044] Calculate the time required for each imaging path to complete image acquisition and imaging;
[0045] Calculate and generate a time difference value for starting an imaging action of each imaging path based on the duration value;
[0046] The imaging action of each of the imaging paths within a set time period is controlled based on the time difference.
[0047] Through the above technical solution, the imaging action time of each imaging path can be arranged more accurately, avoiding mutual interference between the imaging paths during the imaging action, and ensuring the accuracy of the imaging result.
[0048] Furthermore, the method further comprises:
[0049] Adjusting the angles between the imaging paths to generate corresponding three-dimensional images under various angle conditions;
[0050] Determining and generating image quality data of the three-dimensional image, and determining the optimal imaging angle between each of the imaging paths according to the image quality data;
[0051] The three-dimensional image acquisition and generation actions required for the three-dimensional dynamic image are completed based on the optimal imaging angle.
[0052] Through the above technical solution, the optimal imaging path angle for different image acquisition sites can be quickly found, thereby ensuring the quality of subsequent static and dynamic three-dimensional images.
[0053] Furthermore, the method further comprises:
[0054] Collecting real-time location data of the tracking site;
[0055] Calculating and generating a position change rate of the tracking site within a set time period;
[0056] Establishing the correlation between the rate of change of the tracking site position and the image acquisition frequency of each imaging path;
[0057] Based on the association relationship and the position change rate of the tracking site, the image acquisition frequency of each imaging path is adjusted in real time.
[0058] Through the above technical solution, when the position change rate of the image acquisition site is set to be faster, the image acquisition frequency of each imaging path can also be increased accordingly, thereby ensuring the imaging accuracy when the position of the image acquisition site changes drastically.
[0059] Furthermore, the method further comprises:
[0060] Collect and store the motion trajectory data of the tracking site;
[0061] Generate a motion prediction algorithm for describing the motion law of the tracking site based on the motion trajectory data, and / or a motion relationship model for reflecting the corresponding relationship between various motion states of the tracking site;
[0062] Collecting the motion trajectory data of the tracking site at the current moment, and predicting and outputting the predicted site based on the motion prediction algorithm and / or the motion relationship model;
[0063] The spatial vector of each imaging path is adjusted based on the predicted site to ensure that each imaging path passes through the image acquisition site.
[0064] Through the above technical solution, based on the position and motion trajectory of the tracking site at the current moment, the position of the tracking site at the next moment can be predicted and output in advance, thereby outputting the control amount in advance to adjust the spatial vector of the imaging path, making the imaging more timely and accurate.
[0065] In order to realize the acquisition of joint dynamic images, the present application also proposes a joint dynamic image acquisition device, comprising:
[0066] An image acquisition component, including an image acquisition controller and multiple sets of ray sources and detectors arranged in pairs, each forming multiple imaging paths, and acquiring and outputting multiple sets of image data;
[0067] A position adjustment assembly, comprising a mounting bracket for mounting the ray source and the detector, and an adjustment member for adjusting the position of each group of ray sources and detectors;
[0068] A position control component, comprising a marking member disposed on an imaging object for marking an image acquisition position, a position detection member for detecting and outputting position information of the marking member, and a position control member for generating a position adjustment signal based on a position detection signal output by the position detection member;
[0069] Among them, the position detection component detects the position of the marking component and outputs the position detection signal, the position control component receives and generates a position adjustment signal in response to the position detection signal and outputs it to the position adjustment component, and the position adjustment component receives and controls the positions of each group of radiation sources and detectors in response to the position adjustment signal.
[0070] Through the above technical solution, image acquisition sites, i.e., joint bone tissue, can be imaged from different angles, and later three-dimensional images and three-dimensional dynamic images of the acquisition object can be generated based on the acquired image data, which facilitates dynamic functional analysis of bone joints.
[0071] Furthermore, the adjusting member includes:
[0072] The screw transmission parts are configured into multiple groups, and each group is arranged opposite to each other and surrounds a set imaging area. Each group of the screw transmission parts includes a column, a screw, a slider arranged on the screw, and a servo motor driving the screw to rotate. Each group of the radiation source and the detector are respectively installed on two sliders arranged opposite to each other; or
[0073] The mechanical arms are configured into a plurality of groups, each group being arranged opposite to each other in pairs and surrounding a set imaging area, and the ray source and the detector are respectively arranged on the clamping ends of the two oppositely arranged mechanical arms;
[0074] The motion control component is configured to be connected to the servo motor or the robotic arm control, receive and output a control signal in response to the position adjustment signal to control the movement of the servo motor or the robotic arm.
[0075] Through the above technical solution, the positions of the ray source and the detector, especially the horizontal height position, can be conveniently adjusted to form different imaging paths for different image acquisition sites.
[0076] Furthermore, the position adjustment component further includes an angle adjustment member for adjusting the angle between the imaging paths, and the angle adjustment member includes:
[0077] The circular base is configured in multiple configurations and is coaxially rotatable, and the columns of each group of mechanical arms or the screw transmission member are respectively fixedly mounted on each of the circular bases;
[0078] The rotating driving member is configured as a plurality of rotating motors and a rotating controller thereof for driving each annular base to rotate around its axis. Each rotating motor is transmission-connected to its corresponding annular base. The rotating controller receives and outputs a control signal in response to the position adjustment signal to control the movement of the rotating motor.
[0079] Through the above technical solution, the angles between the various imaging paths can be easily changed.
[0080] Further, the ray source is configured as an X-ray source, and the detector is configured as a dynamic flat panel detector matched with the X-ray source;
[0081] The image acquisition controller is respectively connected to the X-ray source and the detector and controls the imaging actions of the two.
[0082] Furthermore, the marking element includes a shielding element, an RFID positioning tag, a heat source element or a combination thereof located between the radiation source and the detector;
[0083] The position detection element includes the detector, RFID identifier or thermal imager, and outputs a position detection signal;
[0084] The position control element comprises:
[0085] A coordinate generating module, configured to be connected to the position detecting element signal, receive the position detecting signal and generate marking coordinate data of the marking element in a set imaging area;
[0086] An imaging path storage module, configured to store in association the spatial vector data of the imaging path corresponding to each marker coordinate data, and the position coordinate data of the image acquisition component corresponding to the spatial vector data;
[0087] The motion instruction generation module is configured to be signal-connected with the coordinate generation module and the imaging path storage module, receive the marking coordinate data and obtain the position coordinate data of the corresponding image acquisition component, and generate the position adjustment signal.
[0088] Through the above technical solution, the tracking site, that is, the position of the marker, can be captured quickly and accurately, and an accurate position adjustment signal can be generated to improve the accuracy of image acquisition.
[0089] Furthermore, the image acquisition controller is configured with:
[0090] A change rate calculation module is configured to be connected to the position detection element signal, receive the position detection signal, and calculate and output the position change rate data of the marking element;
[0091] A frequency storage module, configured to store each position change rate data and its corresponding image acquisition frequency data in association with each other;
[0092] A frequency control module, configured to be electrically connected to the change rate calculation module and the frequency storage module, receive the position change rate data of the marker, and search and output the corresponding image acquisition frequency data;
[0093] The trigger controller is configured to be connected to the ray source and the detector control and to be connected to the frequency control module signal, receives the image acquisition frequency data and outputs a trigger signal of a set frequency to trigger the ray source to operate.
[0094] Through the above technical solution, the image acquisition controller can change the trigger frequency of the radiation source according to the position change rate of the marker, and thus can effectively capture the image of the image acquisition site when the marker, i.e. the imaging object, is in motion, thereby ensuring the imaging quality.
[0095] Furthermore, the position control element is configured with:
[0096] A trajectory generation module is configured to be connected to the position detection member signal, receive the position detection signal, and generate and store the motion trajectory data of the marking member;
[0097] A trajectory prediction algorithm generation module is configured to be data-connected with the trajectory generation module, receive the motion trajectory data, and generate and store a motion prediction algorithm for describing the motion law of the marker;
[0098] A first trajectory prediction module is configured to be data-connected with the trajectory prediction algorithm generation module and the trajectory generation module, receive the motion trajectory data of the marker at the current moment, and calculate and output a predicted position signal of the marker at the next moment according to the motion prediction algorithm;
[0099] Among them, the position control component is data-connected with the first trajectory prediction module, receives the predicted position signal, and generates the position adjustment signal.
[0100] Through the above technical scheme, the motion trajectory of the marker can be generated based on the collected position detection signal of the marker, and the motion prediction algorithm for the imaging object can be calculated based on the above motion trajectory. Based on the above motion prediction algorithm and the motion trajectory at the current moment, the motion trajectory of the marker within the future set time can be predicted, so that the position adjustment signal output by the position control component has an advance amount, offsetting the response time of the position adjustment component, so that the imaging path can keep up with the movement of the marker and change its position, thereby improving the imaging quality of the image.
[0101] Furthermore, the position control element is configured with:
[0102] A trajectory generation module is configured to be connected to the position detection member signal, receive the position detection signal, and generate and store the motion trajectory data of the marking member;
[0103] A relationship model generation module is configured to be data-connected with the trajectory generation module, receive and generate and store a motion relationship model for reflecting the association relationship between various motion states of the marking parts based on the motion trajectory data;
[0104] A second trajectory prediction module is connected to the position detection element and / or the trajectory generation module by signal, receives the position detection signal and / or the motion trajectory data, and outputs a predicted position signal of the position of the marking element at the next moment according to the above motion relationship model;
[0105] Among them, the position control component is data-connected with the second trajectory prediction module, receives the predicted position signal, and generates the position adjustment signal.
[0106] Through the above technical scheme, a motion relationship model of the motion law of the marker is obtained based on the analysis of the motion trajectory data of the marker. Based on the above motion relationship model and the motion state of the marker at the current moment, the motion state of the marker at the next moment can be predicted. As a result, the position adjustment signal output by the position control component has an advance amount, so that the imaging path can change its position closely following the movement of the marker, thereby improving the imaging quality of the image.
[0107] Based on the joint dynamic image acquisition device described above, the present application also proposes a joint dynamic image acquisition and generation system, including the joint dynamic image acquisition device described above; and
[0108] a three-dimensional image generating unit, configured to receive a plurality of sets of image data output by the joint dynamic image acquisition device, and generate three-dimensional image data based on a three-dimensional imaging algorithm;
[0109] The dynamic image generation unit is configured to receive the three-dimensional image data and generate a three-dimensional dynamic image based on a dynamic imaging algorithm, and / or receive the image data and generate a three-dimensional dynamic image based on the above-mentioned three-dimensional dynamic image generation method.
[0110] Through the above technical solution, the image acquisition device acquires accurate two-dimensional image data, and then the three-dimensional image generation unit generates a corresponding three-dimensional image, and finally obtains a continuous three-dimensional dynamic image.
[0111] Furthermore, the joint dynamic image acquisition and generation system also includes an angle acquisition unit for acquiring the best imaging angle between each imaging path, including:
[0112] An imaging quality determination module, configured to be data-connected to the 3D image generation unit, receive the 3D image data, determine the image quality of the 3D image based on a set algorithm, and output image quality data;
[0113] A preset angle output module is configured to be connected to the position control component in the joint dynamic image acquisition device, and output preset imaging angle data to adjust the angle between each imaging path;
[0114] The imaging angle correction module is configured to be data-connected with the imaging quality determination module, obtain image quality data corresponding to each preset imaging angle, determine the best imaging angle data and output it to the position control component.
[0115] Through the above technical solution, the angle between the imaging paths can be adjusted according to the image quality of the imaging, and finally the optimal imaging angle can be obtained to ensure that the dynamic three-dimensional image generated later is more accurate.
[0116] A computer-readable storage medium is loaded with a computer program for implementing the joint dynamic image generation method as described above.
[0117] Through the above technical solution, the above method can be applied to the positioning operation of the imaging object in setting the three-dimensional reference space coordinate system, which is convenient for promotion and use.
[0118] A computer-readable storage medium is loaded with a computer program for implementing the joint dynamic image generation method as described above.
[0119] Through the above technical solution, the above joint dynamic image generation method can be applied to an image acquisition and generation system with relevant hardware conditions, which facilitates the promotion of the above method.
[0120] Compared with the prior art, the present invention has the following beneficial effects:
[0121] (1) By collecting actual image data of the imaging object from multiple imaging paths, virtual image data is generated based on the three-dimensional static model of the imaging object. The position and posture of the three-dimensional static model are determined by comparing the actual image data and the virtual image data. The positioning is convenient and efficient. The three-dimensional dynamic image can be generated later using the above position and posture data.
[0122] (2) By collecting image data of set image acquisition sites from multiple angles, the above images are transformed and spliced into continuous three-dimensional dynamic images through a three-dimensional imaging algorithm, thereby realizing dynamic tracking of the image acquisition sites, which is convenient for dynamic functional analysis of bone joints;
[0123] (3) By setting the working state of each imaging path to alternate triggering, the interference between two adjacent imaging paths is effectively reduced, thereby improving the imaging quality of the image acquisition site;
[0124] (4) By capturing and judging the speed of the motion of the imaging object, the image acquisition frequency of each imaging path is changed, so that the imaging device can capture the rapidly changing image, making the three-dimensional dynamic image generated later more accurate;
[0125] (5) By analyzing the motion state of the imaging object, the motion law of the imaging object is generated, so that the image acquisition device can predict the position of the set image acquisition point in advance, thereby ensuring that each imaging path can accurately pass through the set image acquisition point, thereby ensuring the accuracy of the image data. BRIEF DESCRIPTION OF THE DRAWINGS
[0126] Figure 1 It is a schematic diagram of the overall process of the imaging object positioning method of the present invention;
[0127] Figure 2 A schematic diagram of a flow chart of a method for calculating and comparing the similarity between virtual image data and actual image data according to the present invention;
[0128] Figure 3 It is a schematic diagram of the overall process of the method of the present invention;
[0129] Figure 4 A schematic diagram of a method for changing the image acquisition frequency based on the position change rate of the tracking site;
[0130] Figure 5 A schematic diagram of a method for pre-adjusting the position of an imaging path based on tracking site trajectories;
[0131] Figure 6 It is a schematic diagram of a method for time interleaving control during image acquisition;
[0132] Figure 7 A schematic diagram of a method for obtaining the best imaging angle between various imaging paths;
[0133] Figure 8 It is a schematic diagram of the overall functional module connection of the joint dynamic image acquisition device;
[0134] Fig. 9 It is a schematic diagram of the functional framework of the position control component and the position adjustment component;
[0135] Fig.10 A schematic diagram of a frame of a position control unit with a tracking position prediction function (I);
[0136] Fig.11 A schematic diagram of the framework of a position control unit with a tracking position prediction function (II);
[0137] Fig.12 It is a functional framework diagram of the image acquisition controller;
[0138] Fig.13 It is a structural schematic diagram of a joint dynamic image acquisition device;
[0139] Fig.14 It is a structural schematic diagram of a joint dynamic image acquisition device (partially omitted for clarity);
[0140] Fig.15 Schematic diagram of the functional framework of the joint dynamic image acquisition system (with angle acquisition unit).
[0141] Figure numerals: 100, image acquisition component; 110, image acquisition controller; 111, rate of change calculation module; 112, frequency storage module; 113, frequency control module; 114, trigger controller; 120, ray source; 130, detector; 200, position adjustment component; 210, screw transmission member; 211, column; 212, screw; 213, slider; 214, servo motor; 215, transmission rod; 220, mechanical arm; 230, motion control member; 240, angle adjustment member; 241, ring base; 242, rotation drive member; 300, position control component; 310, marking member; 320, position detection Component; 330, position control component; 331, coordinate generation module; 332, imaging path storage module; 333, motion instruction generation module; 334, trajectory generation module; 335, trajectory prediction algorithm generation module; 336, first trajectory prediction module; 337, relationship model generation module; 338, second trajectory prediction module; 400, system server; 410, system control module; 420, image processing module; 421, three-dimensional image generation unit; 422, dynamic image generation unit; 500, angle acquisition unit; 510, imaging quality determination module; 520, preset angle output module; 530, imaging angle correction module. DETAILED DESCRIPTION
[0142] The present invention will be further described in detail below in conjunction with embodiments and drawings, but the embodiments of the present invention are not limited thereto.
[0143] In the field of orthopedic medical imaging, current joint soft tissue imaging is usually static. In order to obtain more accurate dynamic and three-dimensional bone and joint images, so as to facilitate doctors to perform dynamic functional analysis of bone and joints, this application first proposes a method for generating and determining the position of an imaging object in a set three-dimensional coordinate system based on a static image of the imaging object. After the bone and joint are accurately positioned based on this method, a three-dimensional dynamic image of the bone and joint is generated based on the position and posture data of the bone and joint.
[0144] like Figure 1 As shown, a method for generating and determining the position of an imaging object in a set three-dimensional coordinate system based on a static image of the imaging object mainly includes the following steps:
[0145] A1, setting multiple imaging paths based on an imaging object, storing the relative position relationship of each imaging path, and obtaining actual image data corresponding to the imaging object captured by each imaging path;
[0146] A2, establishing a three-dimensional reference space coordinate system, generating a three-dimensional static model according to the imaging object, and placing it at a set imaging position in the three-dimensional reference space coordinate system;
[0147] A3, setting a plurality of virtual imaging paths through the imaging sites and in the relative position relationship, and acquiring virtual image data corresponding to each virtual imaging path;
[0148] A4, calculating and comparing the similarity between the virtual image data and the actual image data:
[0149] If it meets the expectation, the position coordinate data of the current imaging site is used as the position data;
[0150] If it does not meet expectations, the imaging site position of the imaging object in the three-dimensional reference space coordinate system is adjusted using an optimization operator, and new virtual image data is generated based on the new imaging site, and the newly generated virtual image data is compared with the actual image data until the similarity between the two meets expectations.
[0151] In the above step A1, the imaging path is determined based on the positions of the paired ray source 120 and the detector 130, and the relative position relationship of each imaging path includes the angle relationship and the position distance relationship between each imaging path. In the set three-dimensional reference space coordinate system, the above position relationship can be uniquely determined.
[0152] In step A1, actual image data is acquired by alternately exposing the ray sources 120 and detectors 130 located on multiple imaging paths. Since there is cross-interference between the ray sources 120 on each imaging path, alternate exposure can make the image data acquired by each imaging path clearer.
[0153] In step A2, a three-dimensional reference space coordinate system is established to clarify the position coordinates of the three-dimensional static model to be generated. The three-dimensional static model of the imaging object can be obtained by photoelectric scanning or other methods, or by fitting multiple two-dimensional images with clear imaging angles through a set algorithm.
[0154] In the above step A4, the similarity between the virtual image data and the actual image data is calculated and compared, such as Figure 2 As shown, including:
[0155] A41, setting a set number of image feature parameters in the actual image data;
[0156] A42, establish an image feature parameter similarity comparison algorithm;
[0157] A43, searching for the image feature parameters in the virtual image data and performing comparison, and outputting similarity based on the comparison result and the comparison algorithm.
[0158] The image characteristic parameters include the shape and size of the image itself, or the shape and size of a local image selected from the image itself, or the shape, size and relative position relationship of several points in the image.
[0159] In practice, the above step A42 may adopt an algorithm such as a pixel gray value comparison method to determine the similarity based on the comparison result.
[0160] In the above step A4, the optimization operator is used to adjust not only the imaging site position of the imaging object in the three-dimensional reference space coordinate system, but also the posture of the imaging object.
[0161] The above method obtains virtual image data taken from a set angle based on the three-dimensional static model of the imaging object, and compares it with the actual image data obtained from the actual imaging action. If the two are the same, it means that the position of the three-dimensional static model at this time is consistent with the position of the actual imaging object, thereby achieving precise positioning of the imaging object.
[0162] After obtaining the precise positioning of the imaging object, the present application also proposes a three-dimensional dynamic image generation method, which mainly includes:
[0163] B1, obtaining a three-dimensional static model of the imaging object;
[0164] B2, obtaining the actual image data captured by the imaging object on the set imaging path at the current moment;
[0165] B3, using the method described above to generate and determine the position of the imaging object in a set three-dimensional coordinate system based on the three-dimensional static image of the imaging object, determine the position and posture of the imaging object in the three-dimensional reference space coordinate system at the current moment;
[0166] B4, according to the control timing when the imaging object is being imaged, the position and posture of the imaging object are continuously generated and output, so as to obtain a three-dimensional dynamic image of the imaging object.
[0167] Based on the above technical solution, a three-dimensional dynamic image can be obtained according to the actual two-dimensional image data obtained by continuous exposure sampling, which is convenient for dynamic analysis of the imaging object.
[0168] Based on the above method, in order to obtain continuous dynamic three-dimensional images of bone joints, the present application also proposes a joint dynamic image generation method.
[0169] In the first embodiment, Figure 3 As shown, it mainly includes the following steps:
[0170] C1, setting an image acquisition site and setting at least two imaging paths through the image acquisition site;
[0171] C2, respectively acquiring image data corresponding to each of the imaging paths;
[0172] C3, generating a three-dimensional dynamic image of the imaging object according to the image data captured by each of the imaging paths and based on the three-dimensional dynamic image generation method as described above.
[0173] The above-mentioned joint dynamic image generation method is mainly based on the existing three-dimensional static model of the bone joint. By comparing the difference between the virtual image data and the actual image data, the position and posture of the bone joint are accurately located, and finally the three-dimensional dynamic image of the bone joint is obtained according to the exposure sequence.
[0174] In the second implementation mode, the following steps are mainly included:
[0175] D1, setting an image acquisition site and setting at least two imaging paths through the image acquisition site;
[0176] D2, respectively acquiring image data corresponding to each of the imaging paths;
[0177] D3, generating a three-dimensional image corresponding to the image acquisition site based on a three-dimensional imaging algorithm according to the angles between the imaging paths and the acquired image data;
[0178] D4, the three-dimensional images continuously collected and generated within a set time period are used to generate a three-dimensional dynamic image based on a dynamic imaging algorithm.
[0179] In the above steps C1 and D1, the image acquisition site generally refers to the position where the image is to be acquired. Depending on the imaging method, the image acquisition site may be an area or a site, such as a bone joint area of a human body.
[0180] The imaging path refers to the straight image acquisition path formed between the ray source 120 and the detector 130 during image acquisition. For example, the image acquisition of a bone joint in a single direction is realized by using the X-ray source 120 and the dynamic flat panel detector 130, and the acquired image is a two-dimensional plane image. In the embodiment of the present application, for the convenience of description and illustration, the number of the above imaging paths is preferably two, and in actual applications, it can be set to multiple as needed.
[0181] In step D3, the image data for the same image acquisition position acquired from multiple directions using multiple imaging paths can be converted into a three-dimensional image through three-dimensional modeling software.
[0182] In step D4, the three-dimensional images continuously acquired and generated within a set period of time are played at a set frame rate, so that a three-dimensional dynamic image of the image acquisition site can be obtained, thereby achieving dynamic tracking of the image acquisition site.
[0183] Since the position of the image acquisition site will change during the image acquisition process, in order to ensure that the imaging path always passes through the set image acquisition site, the following description will only be given by taking the second implementation mode as an example. It should be noted that the following method steps can also be used in the first implementation mode.
[0184] The joint dynamic image generation method also includes:
[0185] D11, setting at least one tracking point in association with the image acquisition point or its surroundings;
[0186] D12, adjusting the spatial vector of each imaging path based on the tracking site to ensure that each imaging path passes through the image acquisition site.
[0187] Since the position of the image acquisition site changes continuously during the image acquisition process, in order to ensure that the imaging path passes through the above-mentioned image acquisition site, it is necessary to adjust the spatial vector of the imaging path, that is, the direction, position and coordinates of the imaging path in the set imaging space. Since the image acquisition site is an area such as a bone joint, it is obviously not directly used as a site for positioning. For this reason, in the step D11, at least one tracking site is set at or around the image acquisition site. The above-mentioned tracking site is required to have good identifiability in practice so that the relevant detection equipment can quickly and accurately identify and locate the position of the tracking site. Specifically, a heat source, an RFID positioning tag, or a positioning guide wire similar to that used in tumor resection surgery can be used.
[0188] Through the above technical solution, it can be ensured that when the position of the image acquisition site is constantly changing, each imaging path can also obtain image data from a set angle, thereby ensuring the accuracy of subsequent three-dimensional imaging.
[0189] In the actual image acquisition process, since the object of image acquisition is bone joint tissue or other objects in motion, the intensity of motion of different objects is different, that is, the position change rate of the set image acquisition site in three-dimensional space is very different. In order to ensure the imaging accuracy of the image when the position of the image acquisition site changes drastically, in the embodiment of the present application, Figure 4 As shown, the joint dynamic image generation method also includes:
[0190] D120, collecting real-time location data of the tracking site;
[0191] D121, calculating and generating the position change rate of the tracking site within a set time period;
[0192] D122, establishing a correlation relationship between the tracking site position change rate and the image acquisition frequency of each imaging path;
[0193] D123, based on the association relationship and the position change rate of the tracking site, the image acquisition frequency of each imaging path is adjusted in real time.
[0194] In the above steps D120-D123, a three-dimensional coordinate system corresponding to the imaging space is first established in the processing system, and then the position data of the tracking site is converted into the marking coordinate data, and the position change rate of the tracking site can be obtained by analyzing the changes of the marking coordinate data at two adjacent moments. Then, a correlation relationship between the position change rate and the image acquisition frequency is established, and when the position change rate of the set image acquisition site is accelerated, the image acquisition frequency of each imaging path can also be correspondingly increased to the set frequency to ensure imaging accuracy.
[0195] In practice, since the position adjustment of the detectors 130 and the radiation source 120 at both ends of the imaging path requires response time, when the actual position of the image acquisition site changes, if the spatial vector change of the imaging path does not follow in time, the imaging quality of the image will obviously be reduced. Figure 5 As shown, the joint dynamic image generation method also includes:
[0196] D124, collects and stores the motion trajectory data of the tracking site;
[0197] D125, generating a motion prediction algorithm for describing the motion law of the tracking site and / or a motion relationship model for reflecting the corresponding relationship between various motion states of the tracking site based on the motion trajectory data;
[0198] D126, collecting motion trajectory data of the tracking location at the current moment, and predicting and outputting the predicted location based on the motion prediction algorithm and / or the motion relationship model;
[0199] D127, adjust the spatial vector of each imaging path based on the predicted site to ensure that each imaging path passes through the image acquisition site.
[0200] The above technical solution can predict and output in advance the position of the tracking site at the next moment based on the position and motion trajectory of the tracking site at the current moment, thereby outputting the control amount in advance to adjust the spatial vector of the imaging path, making the imaging more timely and accurate.
[0201] In practical applications, since multiple imaging paths are installed around a set imaging space, the detection results of each detector 130 are easily interfered by the radiation source 120 in the adjacent imaging path. In order to eliminate or reduce the above interference, in the embodiment of the present application, Figure 6 As shown, the joint dynamic image generation method further comprises:
[0202] D310, calculating the time required for each imaging path to complete image acquisition and imaging;
[0203] D311, based on the duration value, calculates and generates the time difference value for starting the imaging action of each imaging path;
[0204] D312, controlling the imaging action of each imaging path within a set time period based on the time difference.
[0205] Through the above technical solution, the imaging action time of each imaging path can be arranged more accurately, avoiding mutual interference between the imaging paths during the imaging action, and ensuring the accuracy of the imaging results.
[0206] In the above step D30, the imaging time required for each imaging path is determined according to the specific device. By calculating the response action time of the ray source 120 and the detector 130, the time value required for imaging path acquisition and imaging can be known.
[0207] In order to reduce interference, the imaging action time of each imaging path is set at intervals, for example, the imaging actions of the two imaging paths are set to be triggered alternately.
[0208] It should be pointed out that in general applications, the setting of the time difference in the above step D31 should further meet the requirements of image acquisition frequency, such as the requirements for image acquisition frequency in step D123, that is, there is an upper limit to the time difference between two acquisition and imaging actions of the same imaging path.
[0209] In practical applications, different imaging objects, such as the knee joints and cervical spine joints of different patients, have different corresponding optimal imaging angles. In order to obtain the best image data and generate more accurate three-dimensional images, Figure 7 As shown, the method described in this application also includes:
[0210] D320 adjusts the angles between the imaging paths to generate corresponding three-dimensional images under various angle conditions;
[0211] D321, determining and generating image quality data of the three-dimensional image, and determining the best imaging angle between each imaging path according to the image quality data;
[0212] D322 completes the 3D image acquisition and generation actions required for 3D dynamic images based on the optimal imaging angle.
[0213] In the embodiment of the present application, two imaging paths are used and the angle between the two imaging paths is 90° in the initial state, and then the angle between the two imaging paths is gradually adjusted according to the set angle. The image quality data in the above step D321 can be obtained by image recognition software, such as judging the image quality based on the clarity of some key image sites. Based on the above technical solution, the optimal imaging path angle for different image acquisition sites can be quickly found, thereby ensuring the quality of subsequent static and dynamic three-dimensional images.
[0214] In order to realize the acquisition of joint dynamic images, the present application also proposes a joint dynamic image acquisition device, such as Figure 8 As shown, it mainly includes: an image acquisition component 100, a position adjustment component 200 and a position control component 300.
[0215] The image acquisition component 100 includes an image acquisition controller 110 and a plurality of paired ray sources 120 and detectors 130. In this embodiment, the ray source 120 is configured as an X-ray source 120, and the detector 130 is configured as a dynamic flat panel detector 130 matched with the X-ray source 120, which can realize the imaging of bone and joint tissues. The image acquisition controller 110 is electrically connected to the control ends of the X-ray source 120 and the detector 130 respectively, and is used to control the imaging actions of the two, such as triggering, stopping, saving data, etc. The above-mentioned image acquisition controller 110 can be implemented by a single-chip microcomputer or an FPGA control module.
[0216] Multiple imaging paths are formed between each group of ray sources 120 and detectors 130 respectively, for collecting and outputting multiple groups of image data.
[0217] The position control component 300 is mainly used to control the real-time position of each group of ray sources 120 and detectors 130 to adjust the space vector data between each imaging path.
[0218] Detailed, such as Fig. 9 As shown, the position control component 300 includes a marking member 310 disposed on the imaging object for marking the image acquisition site, a position detection member 320 for detecting and outputting the position information of the marking member 310, and a position control member 330 for generating a position adjustment signal based on the position detection signal output by the position detection member 320. The position detection member 320 detects the position of the marking member 310 and outputs the position detection signal, the position control member 330 receives and generates a position adjustment signal in response to the position detection signal and outputs it to the position adjustment component 200, and the position adjustment component 200 receives and controls the positions of each group of radiation sources 120 and detectors 130 in response to the position adjustment signal.
[0219] In an embodiment of the present application, the marker 310 includes a shielding member, an RFID positioning tag or a heat source member located between the radiation source 120 and the detector 130. The shielding member can be implemented by a positioning guide wire similar to that used in tumor resection surgery, or the joint tissue of the imaging object itself can be directly used as the marker 310. The heat source member can be implemented by a heat patch with a specific shape that generates heat within a set time. In a specific embodiment, the marker 310 can be used in combination, such as the shielding member and the heat source member can be used in combination, using a patch with a specific shape that can block X-rays and generate heat, so as to facilitate the identification and tracking of the position detection member 320 at a later stage.
[0220] Corresponding to the arrangement of the above-mentioned marking element 310 , the position detection element 320 includes a detector 130 , an RFID identifier or a thermal imager corresponding to the radiation source 120 , and is used to output a position detection signal indicating the position of the marking element 310 .
[0221] In practical applications, the position control element 330 can be implemented by an FPGA control module or a single-chip microcomputer control module, including a coordinate generation module 331 , an imaging path storage module 332 and a motion instruction generation module 333 .
[0222] The coordinate generation module 331 is configured to be connected to the position detection element 320 signal, receive the position detection signal and generate the marking coordinate data of the marking element 310 in the set imaging area. In practical applications, the coordinate generation module 331 is configured as a positioning program, which first establishes a three-dimensional coordinate system based on the set imaging space, and then uses the position detection element 320, such as a thermal imager, to detect the position of the marking element 310 in the three-dimensional space, and finally outputs the marking coordinate data based on the three-dimensional coordinate system.
[0223] The imaging path storage module 332 is configured to store the spatial vector data of the imaging path corresponding to each marker coordinate data and the position coordinate data of the image acquisition component 100 corresponding to the spatial vector data. The imaging path storage module 332 can be implemented by a storage module based on a RAM storage chip.
[0224] The motion instruction generation module 333 is configured to be signal-connected with the coordinate generation module 331 and the imaging path storage module 332, receive the marking coordinate data and obtain the position coordinate data of the corresponding image acquisition component 100, and generate a corresponding position adjustment signal after obtaining the position coordinate data.
[0225] The position adjustment assembly 200 includes a mounting bracket for mounting the ray source 120 and the detector 130 and an adjustment member for adjusting the position of each group of ray source 120 and detector 130 .
[0226] like Fig.13 and Fig.14 As shown, in one embodiment, the adjustment member includes a screw transmission member 210 and a motion control member 230. The screw transmission members 210 are configured into multiple groups, and each group of screw transmission members 210 is arranged opposite to each other and surrounds a set imaging area. Fig.13 As shown, in the embodiment of the present application, the screw transmission member 210 is configured into two groups. When performing image acquisition, the imaging object is located in the above-mentioned set imaging area. Each group of the screw transmission member 210 includes a column 211, a screw 212, a slider 213 disposed on the screw 212, and a servo motor 214 for driving the screw 212 to rotate. Each group of the ray source 120 and the detector 130 are detachably mounted on two oppositely disposed sliders 213 by bolts. In actual applications, the column 211 and the mounting bracket can be functionally reused.
[0227] The motion control component 230 is configured to be in control connection with the servo motor 214 , receive and respond to the position adjustment signal output by the motion instruction generation module 333 , and output a control signal to control the action of the servo motor 214 .
[0228] In a specific embodiment, Fig.14 As shown, in order to realize the synchronous movement of the slider 213 in each group of screw transmission parts 210, the two pairs of screws 212 in the same group of screw transmission parts 210 are connected by a transmission rod 215 through a worm gear structure, and the output shaft of the servo motor 214 is connected to the transmission rod 215 after passing through a reduction gear set (simplified and omitted in the drawings). The transmission rod 215 transmits the rotation output by the servo motor 214 to the two screws 212 in equal amounts, thereby realizing the synchronous up and down movement of the radiation source 120 and the detector 130.
[0229] In another embodiment, the adjusting member includes multiple groups of robotic arms 220 and motion control members 230 thereof, each group of robotic arms 220 is arranged opposite to each other and surrounds a set imaging area, and the ray source 120 and the detector 130 are respectively arranged on the clamping ends of the two oppositely arranged robotic arms 220.
[0230] The motion control component 230 is configured to be in control connection with the robot arm 220 , receive and output a control signal in response to the position adjustment signal to control the movement of the robot arm 220 .
[0231] The above technical solution can more flexibly adjust the positions of the ray source 120 and the detector 130, especially the three-dimensional spatial positions, to form different imaging paths for different image acquisition sites.
[0232] In the embodiment of the present application, the position adjustment component 200 further includes an angle adjustment member 240 for adjusting the angle between the imaging paths. The angle adjustment member 240 includes a circular base 241 and a rotation driving member 242 .
[0233] In practical applications, the annular base 241 can be configured as multiple and coaxially rotatable as needed. In the embodiment of the present application, two are configured, such as Fig.14 Each set of mechanical arms 220 or the upright posts 211 of the screw transmission member 210 are respectively fixedly mounted on each of the circular bases 241 .
[0234] The rotating drive member 242 is configured as a plurality of rotating motors and their rotating controllers for driving each circular base 241 to rotate around its axis. The rotating motor adopts a servo motor 214 to achieve precise adjustment of the rotation angle. In a specific embodiment, a rotating gear is coaxially arranged under each disk, and the output shaft of each rotating motor is connected to its corresponding circular base 241 through a gear. The rotating controller receives and outputs a control signal in response to the position adjustment signal to control the action of the rotating motor. The number of teeth of the rotating gear can be set according to the required accuracy of the rotation angle. For example, if the minimum variable of the rotation angle is set to 0.5°, the number of teeth of the rotating gear can be set to 720, or the same effect can be achieved through multiple gear transmissions. Based on the above scheme, the angle between each imaging path can be easily changed.
[0235] Since the motion speeds of various imaging objects vary in actual applications, in order to ensure the imaging quality, further studies are needed, such as Fig.12 As shown, the image acquisition controller 110 is configured with a change rate calculation module 111, a frequency storage module 112, a frequency control module 113 and a trigger controller 114. The change rate calculation module 111 is configured to be connected to the position detection element 320 signal, receive the position detection signal output by the position detection element 320, and calculate and output the position change rate data of the marking element 310. The above position change rate can be set to the sum of the distances moved by the marking element 310 in a unit time. The larger the sum of the distances, the higher the speed of the marking element 310. The above position change rate can also be set to the sum of the number of changes in the movement direction of the marking element 310 in a unit time, etc.
[0236] The frequency storage module 112 is configured to store the position change rate data and the corresponding image acquisition frequency data in association, and the image acquisition frequency data and the position change rate data are stored in the corresponding memory via a one-dimensional data table, which is convenient for quick retrieval. The frequency control module 113 is configured to be connected to the change rate calculation module 111 and the frequency storage module 112, receive the position change rate data of the marking member 310, and search and output the corresponding image acquisition frequency data in the frequency storage module 112.
[0237] The trigger controller 114 is configured to be connected to the ray source 120 and the detector 130 and to be connected to the frequency control module 113 by signal, receives the image acquisition frequency data and outputs a trigger signal of a set frequency to trigger the ray source 120 to operate. The trigger controller 114 can be implemented by a single chip control module or a trigger circuit.
[0238] Based on the above technical solution, the image acquisition controller 110 can change the trigger frequency of the radiation source 120 according to the position change rate of the marking element 310, and thus can effectively capture the image of the image acquisition site when the marking element 310, i.e. the imaging object, is in motion. For example, the faster the imaging object moves, the higher the image acquisition frequency is, thereby ensuring the imaging quality.
[0239] In actual applications, after the position adjustment component 200 receives the position adjustment signal, it often takes a while to adjust the radiation source 120 and the detector 130 to the set position, that is, the entire control and adjustment process requires response time. Due to the existence of the above response time, when the imaging object, such as a bone joint, moves quickly in the set imaging space, the imaging path will not be able to keep up with the movement of the marker 310, resulting in a decrease in imaging quality.
[0240] To this end, in one embodiment, Fig.10 As shown, the position control component 330 is configured with a trajectory generation module 334 , a trajectory prediction algorithm generation module 335 , and a first trajectory prediction module 336 .
[0241] The trajectory generation module 334 is configured as a program module loaded into the position control component 330 , which is signal-connected to the position detection component 320 , receives the position detection signal, generates the motion trajectory data of the marking component 310 and sends it to the memory connected to the position control component 330 for storage.
[0242] The trajectory prediction algorithm generation module 335 is also configured as a program module loaded into the position control element 330, which is data-connected with the trajectory generation module 334, receives the motion trajectory data, and generates and stores a motion prediction algorithm for describing the motion law of the marking element 310. In practical applications, the motion trajectory data is actually a data series, and the fluctuation and change law of the data series can be obtained by using a specific fitting algorithm.
[0243] The first trajectory prediction module 336 is configured as a data processing program, which is data-connected to the trajectory prediction algorithm generation module 335 and the trajectory generation module 334, receives the motion trajectory data of the marker 310 at the current moment, and calculates and outputs the predicted position signal of the marker 310 at the next moment according to the above-mentioned motion prediction algorithm.
[0244] The position control element 330 is data-connected to the first trajectory prediction module 336, receives the predicted position signal, and generates a position adjustment signal. In this embodiment, the predicted position signal can be regarded as a position detection signal after data processing, which is output to the coordinate generation module 331 to finally obtain a position adjustment signal.
[0245] The above technical solution can generate a motion trajectory of the marker 310 based on the collected position detection signal of the marker 310, and generate a motion prediction algorithm for the imaging object based on the above motion trajectory calculation. Based on the above motion prediction algorithm and the motion trajectory at the current moment, the motion trajectory of the marker 310 within a set time in the future can be predicted, so that the position adjustment signal output by the position control component 330 has an advance amount, offsetting the response time of the position adjustment component 200, so that the imaging path can keep up with the movement of the marker 310 and change its position, thereby improving the imaging quality of the image.
[0246] In another embodiment, Fig.11 As shown, the position control component 330 is configured with a trajectory generation module 334 , a relationship model generation module 337 and a second trajectory prediction module 338 .
[0247] The trajectory generation module 334 is configured to be connected to the position detection member 320 by signal, receive the position detection signal, generate and store the motion trajectory data of the marking member 310. The relationship model generation module 337 is configured as an algorithm program, connected to the trajectory generation module 334 by data, receives and generates and stores a motion relationship model for reflecting the association relationship between various motion states of the marking member 310 based on the motion trajectory data, and the motion relationship model includes a plurality of data groups with related settings.
[0248] Since the above-mentioned motion relationship model can be a single site, that is, the association between the position detection signal and a certain motion trajectory data, or the association between a certain segment of motion trajectory data and a certain motion trajectory data, the first trajectory prediction module 336 and the second trajectory prediction module 338 are connected to the common signal of the position detection component 320 and the trajectory generation module 334, or are connected to the signal of one of them, receive the position detection signal and / or motion trajectory data, and output the predicted site signal of the next moment of the position of the marking component 310 according to the above-mentioned motion relationship model. Among them, the position control component 330 is connected to the first and second trajectory prediction modules 338, receives the predicted site signal and generates the position adjustment signal.
[0249] The above technical solution obtains a motion relationship model of the motion law of the marker 310 based on the analysis of the motion trajectory data of the marker 310. Based on the above motion relationship model and the motion state of the marker 310 at the current moment, the motion state of the marker 310 at the next moment can be predicted, thereby making the position adjustment signal output by the position control component 330 have an advance amount, so that the imaging path can change its position closely following the movement of the marker 310, thereby improving the imaging quality of the image.
[0250] Based on the above-mentioned joint dynamic image acquisition device, the present application also proposes a joint dynamic image acquisition and generation system, including the joint dynamic image acquisition device as described above and a system server 400, wherein the system server 400 is configured with a system control module 410, an image processing module 420, and an image or instruction algorithm storage module.
[0251] The image acquisition controller 110 and the position control component 300 configured in the joint dynamic image acquisition device together constitute a system control module 410, which respectively performs exposure control and motion control. The image processing module 420 includes a three-dimensional image generation unit 421 and a dynamic image generation unit 422.
[0252] The three-dimensional image generation unit 421 is configured to receive multiple sets of image data output by the joint dynamic image acquisition device, and generate three-dimensional image data based on a three-dimensional imaging algorithm. In practical applications, the three-dimensional image generation unit 421 includes a program module loaded in the system server 400. The dynamic image generation unit 422 is configured to receive the three-dimensional image data, generate a three-dimensional dynamic image based on a dynamic imaging algorithm, and / or receive multiple sets of image data, and generate a three-dimensional dynamic image based on the above three-dimensional dynamic image generation method.
[0253] During the image processing process, the imaging system in the embodiment of the present application will determine the image quality to ensure the accuracy of the three-dimensional dynamic image generated later. Fig.15 As shown, the joint dynamic image acquisition and generation system also includes an angle acquisition unit 500 for acquiring the optimal imaging angle between each imaging path, specifically including: an imaging quality determination module 510, a preset angle output module 520 and an imaging angle correction module 530.
[0254] The imaging quality determination module 510 is configured to be data-connected to the 3D image generation unit 421, receive the 3D image data, determine the image quality of the 3D image based on a set algorithm, and output image quality data. The above image quality determination may be to determine the clarity of some key image locations.
[0255] The preset angle output module 520 is configured to be controlled and connected with the position control component 300 in the joint dynamic image acquisition device, and outputs preset imaging angle data to adjust the angle between each imaging path.
[0256] The imaging angle correction module 530 is configured to be data-connected with the imaging quality determination module 510 , obtain image quality data corresponding to each preset imaging angle, determine the optimal imaging angle data and output it to the position control component 300 .
[0257] The preset imaging angles include stored imaging angles or imaging angles temporarily generated according to image quality. If there are two imaging paths, the preferred imaging angle range between the two imaging paths is 85-95°, and then the optimal imaging angle is searched in the above range according to a gradient of 0.5° to 1°.
[0258] Finally, in order to apply the above-mentioned method of generating and determining the position of the imaging object based on the static image of the imaging object in a set three-dimensional coordinate system to an image acquisition generation system or device with relevant hardware conditions, the present application also provides a computer-readable storage medium, in which a computer program is loaded. When the computer program is executed by a computer, it realizes the functions of the corresponding method embodiment as described above.
[0259] Likewise, the present application also protects a computer-readable storage medium loaded with a computer program for implementing the joint dynamic image generation method.
[0260] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program. The computer program includes one or more computer programs. When the computer program is loaded and executed on a computer, the process or function described in the embodiment of the present disclosure is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer program can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer program can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, DDL (Digital DubDriberLine, digital subscriber line)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a high-density DVD (Digital Video DiDD)), or a semiconductor medium (eg, a solid-state drive (SSD)).
[0261] It should be noted that, in the above-mentioned embodiments, the terms used herein are only for describing specific exemplary embodiments, and are not intended to be restrictive. As used herein, the singular forms "one", "an" and "the or described" may be intended to also include plural forms, unless the context clearly indicates otherwise. The terms "include", "comprise" and "have" are inclusive, and therefore specify the existence of stated features, wholes, steps, operations, elements and / or parts, but do not exclude the existence or addition of one or more other features, wholes, steps, operations, elements, parts and / or their groups. The method steps, processes and operations described herein should not be interpreted as necessarily requiring the method steps, processes and operations to be performed in the specific order discussed or shown, unless it is specifically indicated that the steps are to be performed in the set order. It should also be understood that additional or alternative steps may be adopted.
[0262] The above is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should also be regarded as the protection scope of the present invention.
Claims
1. A method for generating and determining the position of an imaging object in a set three-dimensional coordinate system based on a static image of the imaging object, characterized in that: Setting a plurality of imaging paths based on an imaging object, storing the relative position relationship of each imaging path, and obtaining actual image data corresponding to the imaging object captured by each imaging path; Establishing a three-dimensional reference space coordinate system, generating a three-dimensional static model according to the imaging object, and placing the model at a set imaging position in the three-dimensional reference space coordinate system; Setting a plurality of virtual imaging paths through the imaging sites and in the relative position relationship to obtain virtual image data corresponding to each virtual imaging path; Calculate and compare the similarity between the virtual image data and the actual image data: If it meets the expectation, the position coordinate data of the current imaging site is used as the position data; If it does not meet expectations, the imaging site position of the imaging object in the three-dimensional reference space coordinate system is adjusted using an optimization operator, and new virtual image data is generated based on the new imaging site acquisition; The newly generated virtual image data is compared with the actual image data until the similarity between the two meets expectations.
2. The method according to claim 1, characterized in that The imaging path is determined based on the positions of the ray source and the detector arranged in pairs; The relative position relationship of each imaging path includes the angle relationship and the position distance relationship between the imaging paths; The actual image data is acquired by alternately exposing ray sources and detectors located on multiple imaging paths.
3. The method according to claim 1, characterized in that Using the optimization operator to adjust the imaging site position of the imaging object in the three-dimensional reference space coordinate system also includes adjusting the posture of the imaging object in the three-dimensional reference space coordinate system.
4. The method according to claim 3, characterized in that Calculating and comparing the similarity between the virtual image data and the actual image data, including: Setting a set number of image feature parameters in the actual image data; Establish an image feature parameter similarity comparison algorithm; Searching for the image feature parameters in the virtual image data and performing comparison, and outputting similarity based on the comparison result and the comparison algorithm; The image characteristic parameters include the shape and size of the image itself, or the shape and size of a local image selected from the image itself, or the shape, size and relative position relationship of several points in the image.
5. A three-dimensional dynamic image generation method, characterized in that: include: Acquire a three-dimensional static model of the imaging object; Acquire actual image data of the imaging object captured on the set imaging path at the current moment; Determine the position and posture of the imaging object in the three-dimensional reference space coordinate system at the current moment by using the method for generating and determining the position of the imaging object in a set three-dimensional coordinate system based on the three-dimensional static image of the imaging object as described in any one of claims 1 to 4; According to the control timing when the imaging object is being imaged, the position and posture of the imaging object are continuously generated and output to obtain a three-dimensional dynamic image of the imaging object.
6. A method for generating a joint dynamic image, characterized in that: include: Setting an image acquisition site and setting at least two imaging paths through the image acquisition site; Respectively acquiring image data corresponding to each of the imaging paths; A three-dimensional dynamic image is generated based on the three-dimensional dynamic image generation method according to claim 5 according to the image data captured by each of the imaging paths.
7. The method according to claim 6, characterized in that Also includes: Setting at least one tracking point in association with the image acquisition point or its surroundings; The spatial vector of each of the imaging paths is adjusted based on the tracking site to ensure that each of the imaging paths passes through the image acquisition site.
8. The method according to claim 6, characterized in that Also includes: Calculate the time required for each imaging path to complete image acquisition and imaging; Calculate and generate a time difference value for starting an imaging action of each imaging path based on the duration value; The imaging action of each of the imaging paths within a set time period is controlled based on the time difference.
9. The method according to claim 6, characterized in that Also includes: Adjusting the angles between the imaging paths to generate corresponding three-dimensional images under various angle conditions; Determining and generating image quality data of the three-dimensional image, and determining the optimal imaging angle between each of the imaging paths according to the image quality data; The three-dimensional image acquisition and generation actions required for the three-dimensional dynamic image are completed based on the optimal imaging angle.
10. The method according to claim 7, characterized in that Also includes: Collecting real-time location data of the tracking site; Calculating and generating a position change rate of the tracking site within a set time period; Establishing the correlation between the rate of change of the tracking site position and the image acquisition frequency of each imaging path; Based on the association relationship and the position change rate of the tracking site, the image acquisition frequency of each imaging path is adjusted in real time.
11. The method according to claim 7, characterized in that Also includes: Collect and store the motion trajectory data of the tracking site; Generate a motion prediction algorithm for describing the motion law of the tracking site based on the motion trajectory data, and / or a motion relationship model for reflecting the corresponding relationship between various motion states of the tracking site; Collecting the motion trajectory data of the tracking site at the current moment, and predicting and outputting the predicted site based on the motion prediction algorithm and / or the motion relationship model; The spatial vector of each imaging path is adjusted based on the predicted site to ensure that each imaging path passes through the image acquisition site.
12. A joint dynamic image acquisition device, characterized in that: include: An image acquisition component (100) comprises an image acquisition controller (110) and a plurality of sets of ray sources (120) and detectors (130) arranged in pairs, each forming a plurality of imaging paths, and acquiring and outputting a plurality of sets of image data; A position adjustment component (200) comprising a mounting bracket for mounting the ray source (120) and the detector (130), and an adjustment member for adjusting the position of each group of the ray source (120) and the detector (130); A position control component (300) comprising a marking element (310) disposed on an imaging object for marking an image acquisition position, a position detection element (320) for detecting and outputting position information of the marking element (310), and a position control element (330) for generating a position adjustment signal based on a position detection signal output by the position detection element (320); The position detection component (320) detects the position of the marking component (310) and outputs the position detection signal, the position control component (330) receives and generates a position adjustment signal in response to the position detection signal and outputs the position adjustment signal to the position adjustment component (200), and the position adjustment component (200) receives and controls the positions of each group of radiation sources (120) and detectors (130) in response to the position adjustment signal.
13. The device according to claim 12, characterized in that The adjusting member comprises: The screw transmission components (210) are configured into a plurality of groups, each group being arranged opposite to each other and surrounding a set imaging area, each group of the screw transmission components (210) comprising a column (211), a screw (212), a slider (213) arranged on the screw (212), and a servo motor (214) driving the screw (212) to rotate, and each group of the radiation source (120) and the detector (130) are respectively mounted on two sliders (213) arranged opposite to each other; or The mechanical arms (220) are configured into a plurality of groups, each group being arranged opposite to each other in pairs and surrounding a set imaging area, and the ray source (120) and the detector (130) are respectively arranged on the clamping ends of the two oppositely arranged mechanical arms (220); The motion control component (230) is configured to be in control connection with the servo motor (214) or the mechanical arm (220), and to receive and output a control signal in response to the position adjustment signal to control the movement of the servo motor (214) or the mechanical arm (220).
14. The device according to claim 13, characterized in that The position adjustment component (200) further comprises an angle adjustment member (240) for adjusting the angle between the imaging paths, wherein the angle adjustment member (240) comprises: The circular base (241) is configured in multiple pieces and is coaxially rotatable, and the columns (211) of each group of mechanical arms (220) or the screw transmission member (210) are respectively fixedly mounted on each of the circular bases (241); The rotation driving member (242) is configured as a plurality of rotation motors and rotation controllers for driving each annular base (241) to rotate around its axis. Each of the rotation motors is transmission-connected to its corresponding annular base (241). The rotation controller receives and outputs a control signal in response to the position adjustment signal to control the movement of the rotation motor.
15. The device according to claim 12, characterized in that The ray source (120) is configured as an X-ray source (120), and the detector (130) is configured as a dynamic flat panel detector (130) matched with the X-ray source (120); The image acquisition controller (110) is respectively connected to the X-ray source (120) and the detector (130) and controls the imaging actions of the two.
16. The device according to claim 12, characterized in that The marking element (310) includes a shielding element, an RFID positioning tag, a heat source element, or a combination thereof, located between the ray source (120) and the detector (130); The position detection element (320) includes the detector (130), an RFID identifier or a thermal imager, and outputs a position detection signal; The position control member (330) comprises: A coordinate generating module (331) configured to be connected to the position detecting element (320) by signal, receive the position detecting signal and generate marking coordinate data of the marking element (310) in a set imaging area; An imaging path storage module (332) configured to associate and store the spatial vector data of the imaging path corresponding to each marker coordinate data, and the position coordinate data of the image acquisition component (100) corresponding to the spatial vector data; The motion instruction generation module (333) is configured to be signal-connected to the coordinate generation module (331) and the imaging path storage module (332), receive the marking coordinate data and obtain the position coordinate data of the corresponding image acquisition component (100), and generate the position adjustment signal.
17. The device according to claim 12, characterized in that The image acquisition controller (110) is configured with: A change rate calculation module (111) is configured to be connected to the position detection element (320) by signal, receive the position detection signal, and calculate and output position change rate data of the marking element (310); A frequency storage module (112) configured to store each position change rate data and its corresponding image acquisition frequency data in association with each other; A frequency control module (113) is configured to be electrically connected to the change rate calculation module (111) and the frequency storage module (112), receive the position change rate data of the marking element (310), and search and output the corresponding image acquisition frequency data; The trigger controller (114) is configured to be in control connection with the ray source (120) and the detector (130) and to be signal-connected with the frequency control module (113), to receive the image acquisition frequency data and output a trigger signal of a set frequency to trigger the ray source (120) to operate.
18. The device according to claim 12, characterized in that The position control member (330) is provided with: A trajectory generation module (334) is configured to be connected to the position detection element (320) by signal, receive the position detection signal, and generate and store motion trajectory data of the marking element (310); A trajectory prediction algorithm generation module (335) is configured to be data-connected to the trajectory generation module (334), receive the motion trajectory data, and generate and store a motion prediction algorithm for describing the motion law of the marking member (310); A first trajectory prediction module (336) is configured to be data-connected to the trajectory prediction algorithm generation module (335) and the trajectory generation module (334), receive the motion trajectory data of the marking element (310) at the current moment, and calculate and output a predicted position signal of the position of the marking element (310) at the next moment according to the motion prediction algorithm; Wherein, the position control component (330) is data-connected with the first trajectory prediction module (336), receives the predicted position signal, and generates the position adjustment signal.
19. The device according to claim 12, characterized in that The position control member (330) is provided with: A trajectory generation module (334) is configured to be connected to the position detection element (320) by signal, receive the position detection signal, and generate and store motion trajectory data of the marking element (310); A relationship model generation module (337) is configured to be data-connected to the trajectory generation module (334), receive and generate and store a motion relationship model for reflecting the association relationship between various motion states of the marking member (310) based on the motion trajectory data; A second trajectory prediction module (338) is connected to the position detection element (320) and / or the trajectory generation module (334) by signal, receives the position detection signal and / or the motion trajectory data, and outputs a predicted position signal of the position of the marking element (310) at the next moment according to the above-mentioned motion relationship model; Wherein, the position control component (330) is data-connected with the second trajectory prediction module (338), receives the predicted position signal, and generates the position adjustment signal.
20. A joint dynamic image acquisition and generation system, characterized in that: A joint dynamic image acquisition device comprising any one of claims 12 to 19; as well as A three-dimensional image generating unit (421), configured to receive a plurality of sets of image data output by the joint dynamic image acquisition device, and generate three-dimensional image data based on a three-dimensional imaging algorithm; The dynamic image generation unit (422) is configured to receive the three-dimensional image data, generate a three-dimensional dynamic image based on a dynamic imaging algorithm, and / or receive multiple sets of the image data, and generate a three-dimensional dynamic image based on the three-dimensional dynamic image generation method.
21. The system according to claim 20, characterized in that It also includes an angle acquisition unit (500) for acquiring the best imaging angle between the imaging paths, including: An imaging quality determination module (510) is configured to be data-connected to the three-dimensional image generation unit (421), receive the three-dimensional image data, determine the image quality of the three-dimensional image based on a set algorithm, and output image quality data; A preset angle output module (520) is configured to be connected to a position control component (300) in a joint dynamic image acquisition device, and output preset imaging angle data to adjust the angle between the imaging paths; The imaging angle correction module (530) is configured to be data-connected to the imaging quality determination module (510), obtain image quality data corresponding to each preset imaging angle, determine the optimal imaging angle data and output it to the position control component (300).
22. A computer-readable storage medium, characterized in that: The readable storage medium is loaded with a computer program for implementing the method of generating and determining the position of an imaging object in a set three-dimensional coordinate system based on a static image of the imaging object as described in any one of claims 1 to 4.
23. A computer-readable storage medium, characterized in that: The readable storage medium is loaded with a computer program for implementing the joint dynamic image generation method as described in any one of claims 6-11.
