Medical imaging method, device and system

By assisting the camera to acquire the camera image and reconstruct the medical image, display the location of the medical attachment in real time, solving the problem of difficulty in position confirmation in interventional operations and improving the accuracy and efficiency of the operation.

CN119074019APending Publication Date: 2024-12-06GE PRECISION HEALTHCARE LLC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310636115.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-31
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

During the interventional operation, the medical attachment cannot confirm its position inside the object in real time, causing the operator to rely on empirical adjustments, affecting accuracy and reliability, and increasing operating time.

Method used

Acquisition of the camera image, determine the position of the medical attachment in the reference coordinate system, and reconstruct the medical image in real time to show the position of the attachment in the image.

Benefits of technology

Improves operational ease, simplifies and shortens the positioning process of medical accessories, allowing them to move quickly and accurately to the target position.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119074019A_ABST
    Figure CN119074019A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a medical imaging method, device and system. The medical imaging method comprises the steps that the position of a medical accessory in a reference coordinate system is determined based on a shot image obtained by an auxiliary camera; rebuilding a medical image according to a scanning result by taking the reference coordinate system as a benchmark; and displaying the position of the medical accessory in the medical image in real time.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of medical equipment technology, and in particular, to a medical imaging method, device, and system. Background Art

[0002] During the interventional procedure, the medical accessory needs to be inserted into the object at the correct position and angle to ensure that the medical accessory can accurately reach the target position inside the object. Since the operator cannot directly observe the internal structure of the object, the operator cannot confirm the position of the medical accessory inside the object in real time.

[0003] In order to confirm the position of the medical attachment inside the object during the interventional operation, it is usually necessary to scan the object multiple times. The operator adjusts the position of the medical attachment inside the object multiple times according to the results of each scan, so that the medical attachment finally reaches the target position. Among them, each adjustment of the position of the medical attachment inside the object mainly depends on the operator's experience, so the accuracy and reliability of the interventional operation cannot be guaranteed; in addition, since multiple scans are required during the interventional operation, the entire interventional operation process has more links and takes a long time.

[0004] It should be noted that the above introduction to the background technology is only for the purpose of providing a clear and complete description of the technical solution of the present application and for facilitating the understanding of those skilled in the art. Summary of the invention

[0005] Embodiments of the present application provide a medical imaging method, device, and system.

[0006] According to one aspect of an embodiment of the present application, a medical imaging method is provided, the medical imaging method comprising:

[0007] Determining the position of the medical accessory in the reference coordinate system based on the camera image acquired by the auxiliary camera;

[0008] Reconstructing a medical image based on the scan result with the reference coordinate system as a reference; and

[0009] The position of the medical accessory in the medical image is displayed in real time.

[0010] According to one aspect of an embodiment of the present application, there is provided a medical imaging device, comprising:

[0011] a determination unit, which determines a position of the medical accessory in a reference coordinate system based on a camera image acquired by the auxiliary camera;

[0012] a reconstruction unit, which reconstructs the medical image according to the scanning result based on the reference coordinate system; and

[0013] A display unit displays the position of the medical accessory in the medical image in real time.

[0014] According to one aspect of an embodiment of the present application, a medical imaging system is provided, including:

[0015] a processor that determines the position of the medical accessory in a reference coordinate system based on the camera image acquired by the auxiliary camera, and reconstructs the medical image according to the scan result based on the reference coordinate system; and

[0016] A display that displays the position of the medical accessory in the medical image in real time.

[0017] One of the beneficial effects of the embodiments of the present application is that the position of the medical accessory in the reference coordinate system is determined based on the camera image acquired by the auxiliary camera, and the medical image is reconstructed according to the scanning result based on the reference coordinate system. As a result, the position of the medical accessory in the medical image can be displayed in real time, thereby improving the operational convenience, helping to simplify and shorten the positioning process of the medical accessory, and facilitating the operator to move the medical accessory to the target position quickly and accurately.

[0018] With reference to the following description and accompanying drawings, the specific implementation of the embodiment of the present application is disclosed in detail, indicating the way in which the principle of the embodiment of the present application can be adopted. It should be understood that the implementation of the present application is not limited in scope. Within the scope of the spirit and clauses of the attached claims, the implementation of the present application includes many changes, modifications and equivalents. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The included drawings are used to provide a further understanding of the embodiments of the present application, which constitute a part of the specification, are used to illustrate the implementation methods of the present application, and together with the text description, explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other implementation methods can be obtained based on these drawings without creative work. In the drawings:

[0020] Figure 1 is a schematic diagram of a CT imaging device according to an embodiment of the present application;

[0021] Figure 2 is a schematic diagram of a medical imaging method according to an embodiment of the present application;

[0022] Figure 3 is a schematic diagram of a medical imaging system according to an embodiment of the present application;

[0023] Figure 4 is a schematic diagram of an implementation method of 201 of an embodiment of the present application;

[0024] Figure 5 is a schematic diagram of an implementation method of 401 of an embodiment of the present application;

[0025] Figure 6 is a schematic diagram of a method for determining a first transformation matrix according to an embodiment of the present application;

[0026] Figure 7 is a schematic diagram of a calibration tool according to an embodiment of the present application;

[0027] Figure 8 is a schematic diagram of a scanning coordinate system and a world coordinate system according to an embodiment of the present application;

[0028] Fig. 9 is a schematic diagram of an image displayed in an embodiment of the present application;

[0029] Fig.10 is another schematic diagram of an image displayed in an embodiment of the present application;

[0030] Fig.11 is another schematic diagram of an image displayed in an embodiment of the present application;

[0031] Fig.12 is another schematic diagram of the medical imaging method according to an embodiment of the present application;

[0032] Fig.13 is a schematic diagram of a medical imaging device according to an embodiment of the present application;

[0033] Fig.14 is a schematic diagram of a computer device according to an embodiment of the present application;

[0034] Fig.15 is a schematic diagram of a medical imaging system according to an embodiment of the present application;

[0035] Fig.16 It is a schematic diagram of a CT system according to an embodiment of the present application. DETAILED DESCRIPTION

[0036] With reference to the accompanying drawings, the foregoing and other features of the embodiments of the present application will become apparent through the following description. In the description and the accompanying drawings, specific embodiments of the present application are specifically disclosed, which show some embodiments in which the principles of the embodiments of the present application can be adopted. It should be understood that the present application is not limited to the described embodiments. On the contrary, the embodiments of the present application include all modifications, variations and equivalents that fall within the scope of the attached claims.

[0037] In the embodiments of the present application, the terms "first", "second", etc. are used to distinguish different elements in terms of title, but do not indicate the spatial arrangement or temporal order of these elements, etc., and these elements should not be limited by these terms. The term "and / or" includes any one and all combinations of one or more of the associated listed terms. The terms "comprising", "including", "having", etc. refer to the presence of the stated features, elements, components or components, but do not exclude the presence or addition of one or more other features, elements, components or components.

[0038] In the embodiments of the present application, the singular forms "a", "the", etc. include plural forms and should be broadly understood as "a kind" or "a type" rather than being limited to the meaning of "one"; in addition, the term "said" should be understood to include both singular and plural forms, unless the context clearly indicates otherwise. In addition, the term "according to" should be understood as "at least in part according to...", and the term "based on" should be understood as "at least in part based on...", unless the context clearly indicates otherwise.

[0039] Features described and / or shown for one embodiment may be used in one or more other embodiments in the same or similar manner, combined with features in other embodiments, or replace features in other embodiments. The term "includes / comprising" when used herein refers to the presence of a feature, an entirety, a step, or a component, but does not exclude the presence or addition of one or more other features, entireties, steps, or components.

[0040] The device for obtaining medical imaging data (e.g., scanning results) described in this article can be applicable to various medical imaging modalities, including but not limited to computed tomography (CT) equipment, magnetic resonance imaging (MRI) equipment, ultrasound imaging (Ultrasound Imaging) equipment, positron emission tomography (PET) equipment, single photon emission computed tomography (SPECT) equipment, PET / CT, PET / MR or any other suitable medical imaging equipment.

[0041] For example, CT is a continuous cross-sectional scan using X-rays around a certain part of the scanned object. The detector receives the X-rays that pass through the cross-section and converts them into visible light, or directly converts the received photon signals and forms medical imaging data after a series of processing. Figure 1FIG. 1 is a schematic diagram of a CT imaging device according to an embodiment of the present application, schematically showing a CT imaging device 100. Figure 1 As shown, the CT imaging device 100 includes a scanning gantry 101 and a patient table 102; the scanning gantry 101 has an X-ray source 103, and the X-ray source 103 projects an X-ray beam toward a detector assembly or a collimator 104 on the opposite side of the scanning gantry 101. The test object 105 can lie flat on the patient table 102 and move into the scanning gantry opening 106 along with the patient table 102; through the scanning of the X-ray source 103, medical image data of the test object 105 can be obtained. The present application is not limited to this, and the CT imaging device 100 can also be other structures.

[0042] MRI is based on the principle of nuclear magnetic resonance of atomic nuclei. It transmits radio frequency pulses to the scanned object, receives electromagnetic signals released by the scanned object, and reconstructs images.

[0043] PET uses a cyclotron to accelerate charged particles to bombard target nuclei, produce positron-carrying radionuclides through nuclear reactions, and synthesize imaging agents, which are introduced into the body and located in target organs. They emit positively charged electrons during the decay process. After traveling a short distance in the tissue, these positrons interact with electrons in the surrounding matter, produce annihilation radiation, and emit two photons with equal energy in opposite directions. PET imaging uses a series of paired probes that are arranged 180 degrees from each other and connected to a matching circuit to detect the photons of annihilation radiation generated by the tracer in vitro. The collected information is processed by a computer to obtain a reconstructed image.

[0044] SPECT uses radioactive isotopes as tracers, which are injected into the human body to concentrate on the organ being tested, making the organ a source of gamma rays. A detector that rotates around the human body outside the body records the distribution of radioactivity in the organ tissue. A set of data can be obtained when the detector rotates one angle, and several sets of data can be obtained when the detector rotates one circle. Based on these data, a series of tomographic plane images can be established, and the computer reconstructs the image in a cross-sectional manner.

[0045] Starting from the molecular level, PET and SPECT extend the tissue pathology examination to the display of local tissue biochemistry. The images they provide are images of human physiological metabolism. They excel in functional imaging and can detect functional and metabolic changes in the occurrence and development of diseases. CT and MRI excel in accurately reflecting morphological and structural changes. In existing methods, CT or MRI can be used to perform attenuation correction on PET or SPECT images, that is, PET or SPECT and CT or MRI are integrated into one, realizing the complementarity of functional image and anatomical image information for better identification and diagnosis.

[0046] The system for obtaining medical imaging data may include the aforementioned medical imaging device, and / or a separate computer device connected to the medical imaging device, and / or a computer device connected to the Internet cloud, and the computer device may be connected to the medical imaging device or a storage device storing medical images via the Internet. The imaging method may be implemented independently or jointly by the aforementioned medical imaging device, the computer device connected to the medical imaging device, and the computer device connected to the Internet cloud.

[0047] In addition, the medical imaging workstation can be set up locally in the medical imaging device, that is, the medical imaging workstation is set up near the medical imaging device, and the medical imaging workstation and the medical imaging device can be co-located in the scanning room, imaging department or the same hospital. The medical image cloud platform analysis system can be located away from the medical imaging device, for example, in the cloud that communicates with the medical imaging device.

[0048] As an example, after a medical institution completes an imaging scan using medical imaging equipment, the scanned data is stored in a storage device; a medical imaging workstation can directly read the scanned data and perform image processing through its processor. As another example, a medical image cloud platform analysis system can read medical images in a storage device through remote communication to provide "Software as a Service" (SaaS). SaaS can exist between hospitals, between hospitals and imaging centers, or between hospitals and third-party online diagnosis and treatment service providers.

[0049] In the embodiments of the present application, the term "object" may be equivalently replaced by "scanning object", "object to be scanned", "scanned object", "detection object", "object to be detected", "detected object", which may include any object to be imaged. The terms "pixel" and "voxel" may be used interchangeably. The terms "layer" and "end face" may be used interchangeably.

[0050] The embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0051] The present application embodiment provides a method for medical imaging. Figure 2 is a schematic diagram of a medical imaging method according to an embodiment of the present application, such as Figure 2 As shown, the medical imaging method comprises:

[0052] 201, determining a position of the medical accessory in a reference coordinate system based on a camera image acquired by an auxiliary camera;

[0053] 202, reconstructing a medical image based on the scan result with the reference coordinate system as a reference; and

[0054] 203 : Display the position of the medical attachment in the medical image in real time.

[0055] According to the above embodiment, the position of the medical accessory in the reference coordinate system is determined based on the camera image acquired by the auxiliary camera, and the medical image is reconstructed based on the scanning result with the reference coordinate system as a reference. Thus, the position of the medical accessory in the medical image can be displayed in real time, thereby improving the operational convenience, helping to simplify and shorten the positioning process of the medical accessory, and facilitating the operator to move the medical accessory to the target position quickly and accurately.

[0056] In some embodiments, the medical imaging method may be performed in a medical imaging system. Figure 3 is a schematic diagram of a medical imaging system according to an embodiment of the present application. The medical imaging system may include a processor (not shown) and a display (not shown), wherein the processor may determine the position of the medical accessory in a reference coordinate system based on the camera image acquired by the auxiliary camera, and reconstruct the medical image according to the scanning result based on the reference coordinate system. The display may display the position of the medical accessory in the medical image in real time. Figure 3 As shown, the medical imaging system may also include a CT imaging device 100 and an auxiliary camera 200, wherein the CT imaging device 100 may be used to obtain scanning results, and its structure may refer to the aforementioned content, and will not be described in detail here; the auxiliary camera 200 may be used to obtain camera images. The present application is not limited thereto, and the medical imaging system may also include the aforementioned other medical imaging devices.

[0057] In some embodiments, the auxiliary camera 200 may be any component with a camera function. For example, the auxiliary camera may be a depth camera, a thermal imaging camera, etc. The auxiliary camera 200 may capture an image of a subject (e.g., a medical accessory 300, an object 400, etc.) that appears within the camera range of the auxiliary camera 200, and generate a camera image containing the subject based on the camera coordinate system (Xc, Yc, Zc).

[0058] In some embodiments, the origin Oc of the camera coordinate system (Xc, Yc, Zc) may be located at the optical center of the auxiliary camera, the Zc axis may be parallel to the optical axis of the auxiliary camera, and the Xc axis and the Yc axis are perpendicular to each other and respectively perpendicular to the Zc axis. The present application is not limited thereto, and the camera coordinate system may also be set in other forms.

[0059] In some implementations, in 201, the position of the medical accessory in the camera coordinate system may be determined based on the camera image, and then the position of the medical accessory in the reference coordinate system may be determined by performing coordinate transformation on the position of the medical accessory in the camera coordinate system. Figure 4 201 is a schematic diagram of an implementation method of the present application. Figure 4As shown, 201 may include:

[0060] 401, determining the position of the medical accessory in the imaging coordinate system according to the imaging image; and

[0061] 402 , determining the position of the medical accessory in the reference coordinate system according to the position of the medical accessory in the imaging coordinate system and a first transformation matrix between the imaging coordinate system and the reference coordinate system.

[0062] In some embodiments, the medical accessory 300 may be various components used in interventional procedures, for example, the medical accessory may be a puncture needle or a puncture needle assembly, a guide wire or a guide wire assembly, a catheter or a catheter assembly, etc. The number of the medical accessories may be one or more.

[0063] Taking the medical accessory 300 as a puncture needle assembly as an example, the medical accessory 300 may include a puncture needle and a marker. In 401, the position of the puncture needle in the camera image may be determined by determining the position of the marker in the camera image. Figure 5 401 is a schematic diagram of an implementation method of the present application. Figure 5 As shown, 401 may include:

[0064] 501, identifying a marker in a camera image, and determining an extension direction and position information of the marker in a camera coordinate system; and

[0065] 502, determining the position of the medical accessory in the imaging coordinate system according to the extension direction and position information, and the relative position relationship between the marker and the puncture needle.

[0066] In 501, the specific method of identifying the marker in the camera image and determining the extension direction and position information of the marker in the camera coordinate system can refer to the relevant technology and will not be described in detail here.

[0067] In some embodiments, the relative position relationship between the marker and the puncture needle (for example, the angle between their extension directions and / or the distance between them, etc.) can be pre-stored. Thus, after obtaining the extension direction and position information of the marker, the extension direction and position information of the puncture needle can be determined based on the known relative position relationship, thereby determining the position of the medical accessory in the camera coordinate system.

[0068] In some embodiments, the extending direction of the marker and the extending direction of the puncture needle may be at a preset angle. For example, the marker may be parallel or perpendicular to the puncture needle, and so on.

[0069] In some embodiments, the marker may be fixed at a preset position of the puncture needle, thereby enabling the distance between the marker and various positions of the puncture needle (eg, the needle tip) to be predetermined.

[0070] The present application is not limited to this. The marker may also carry information related to the medical accessory. For example, the marker may be a graphic that can carry information. By identifying the marker, information representing the relative position relationship between the marker and the puncture needle can be obtained. Therefore, there is no need to pre-store the relative position relationship.

[0071] In some embodiments, the marker may include at least one of the following: a component with a preset temperature, a component with a preset shape and / or pattern, or a component that emits light according to a preset rule. By setting the marker to the above form, the marker can be accurately and reliably identified in the camera image. The present application is not limited to this, and the marker may also be in other forms.

[0072] In some embodiments, the marker may be a sleeve sleeved on the outer circumference of the puncture needle. Arranging the marker in the above manner can ensure that the extension direction of the marker is parallel to the extension direction of the puncture needle, which helps to determine the extension direction and position information of the puncture needle based on the extension direction and position information of the marker. The present application is not limited to this, and the marker may also be in other forms.

[0073] In some embodiments, the sleeve can be a separate reusable accessory. The present application is not limited thereto, and the sleeve can also be a component formed integrally with the puncture needle.

[0074] Above Figure 5 The implementation of 401 of the embodiment of the present application is exemplarily described by taking the example as an example, and the present application is not limited thereto, and the position of the medical accessory in the camera coordinate system may also be determined in other ways. For example, a deep learning algorithm is used to detect the medical accessory and its position based on the camera depth and RGB data.

[0075] In some embodiments, the reference coordinate system may include a world coordinate system (X, Y, Z). The present application is not limited thereto, and the reference coordinate system may also include other coordinate systems.

[0076] In some embodiments, Figure 3 As shown, the origin O of the world coordinate system (X, Y, Z) can be located at the center of the scanning gantry (e.g., the scanning gantry of the CT imaging device 100). By setting the origin O of the world coordinate system (X, Y, Z) at the center of the scanning gantry, the processing of reconstructing medical images described later can be simplified and the amount of calculation of coordinate conversion can be reduced. The present application is not limited to this, and the origin O of the world coordinate system (X, Y, Z) can also be located at other positions.

[0077] In some embodiments, one coordinate axis (e.g., X axis) of the world coordinate system (X, Y, Z) may be parallel to the short side of the patient table 102, one coordinate axis (e.g., Z axis) may be parallel to the long side of the patient table 102, and one coordinate axis (e.g., Y axis) may be perpendicular to the patient table 102. Setting the coordinate axes of the world coordinate system in this way can further simplify the processing of reconstructing medical images described later and reduce the amount of coordinate conversion calculations. The present application is not limited thereto, and the three coordinate axes of the world coordinate system (X, Y, Z) may also be set in other ways.

[0078] In some embodiments, there may be various transformation relationships between the camera coordinate system (Xc, Yc, Zc) of the auxiliary camera and the world coordinate system (X, Y, Z), for example, an affine transformation, which converts a point (or position) in the camera coordinate system into a point (or position) in the world coordinate system by rotation and / or scaling and / or translation.

[0079] In some embodiments, the transformation relationship between the image pickup coordinate system (Xc, Yc, Zc) of the auxiliary camera and the world coordinate system (X, Y, Z) can be represented by a first transformation matrix, which can be determined in various ways. Figure 6 is a schematic diagram of a method for determining the first transformation matrix. Figure 6 As shown, the method for determining the first transformation matrix may include:

[0080] 601, measuring the coordinates of a first calibration point on a calibration tool placed on a surface of a workbench (eg, patient table 102, etc.) in a world coordinate system;

[0081] 602, keeping the position of the calibration tool unchanged, acquiring a first camera image of the calibration tool, and determining the coordinates of a second calibration point of the calibration point in the camera coordinate system according to the first camera image of the calibration tool; and

[0082] 603. Determine a first transformation matrix according to the first calibration point coordinates and the second calibration point coordinates.

[0083] In some embodiments, the calibration tool may be in various forms. Figure 7 Schematic diagram of a calibration tool according to an embodiment of the present application. Figure 7 As shown, the calibration tool can be a flat plate with a black and white pattern, and each point connected by the black and white grid can be used as a calibration point.

[0084] In some embodiments, the CT imaging device 100 can scan the object to be scanned and generate a scan result. The scan result can be represented in various forms, for example, the scan result can be represented by DICOM (Digital Imaging and Communications in Medicine) data, etc., thereby facilitating data processing and exchange.

[0085] In some embodiments, the scan result may include multiple voxels, and the position of each voxel may be represented by the coordinates (i, j, k) in the scan coordinate system (I, J, K). For example, the scan result may include multiple sections, the coordinate k may represent the section where the voxel is located, the coordinate i may represent the column where the voxel is located in the section, and the coordinate j may represent the row where the voxel is located in the section. The present application is not limited to this, and the coordinates (i, j, k) may also include other meanings.

[0086] In some embodiments, in 202, a medical image is reconstructed based on the scan results. Figure 8 FIG. 1 is a schematic diagram of the scanning coordinate system (I, J, K) and the world coordinate system (X, Y, Z) of the embodiment of the present application. Figure 8 As shown, in 202, the position of the scan result in the scan coordinate system may be transformed to obtain the position of the scan result in the reference coordinate system, that is, to reconstruct the medical image in the reference coordinate system.

[0087] In some embodiments, there may be various transformation relationships between the scanning coordinate system (I, J, K) and the world coordinate system (X, Y, Z), for example, an affine transformation, which converts pixels in the scanning coordinate system (I, J, K) into points (or positions) in the world coordinate system (X, Y, Z) by rotation and / or scaling and / or translation.

[0088] In some embodiments, the transformation relationship between the scanning coordinate system (I, J, K) and the world coordinate system (X, Y, Z) can be represented by a second transformation matrix. The parameters in the second transformation matrix can be obtained from the scanning result (e.g., DICOM data). Thus, each voxel can be mapped to the world coordinate system according to the scanning result (e.g., DICOM data).

[0089] For example, taking the pixel (i, j, 0) in the scanning coordinate system as an example, the pixel can be converted into the coordinate (P x ,P y ,P z ):

[0090]

[0091] Among them, (P x ,P y ,P z ) is the world coordinate of voxel (i, j) in the image plane, in millimeters (mm); (S x ,S y ,S z ) is the image position (object) relative to the origin O, in mm; (X x ,X y ,X z ) is the row (X) direction cosine value of the image direction (object); (Y x ,Y y ,Y z ) is the column (Y) direction cosine value of the image direction (object); i is the column index of the image plane, where the index of the first column is, for example, 0; Δi is the column pixel resolution of the pixel pitch, in mm; j is the row index of the image plane, where the index of the first row is, for example, 0; Δj is the row pixel resolution of the pixel pitch, in mm. The parameters in the second transformation matrix M (for example, (S x ,S y ,S z )、(X x ,X y ,X z )、(Y x ,Y y ,Y z ), Δi and Δj) can be obtained from DICOM data. For the specific determination method, reference can be made to the relevant technology and will not be elaborated here.

[0092] In some embodiments, the position of the object when the scan result is generated may be different from the position of the object during the interventional procedure. For example, when the object is scanned, the object may be located in the scanning gantry (e.g., a first position); when the object is subjected to the interventional procedure, the object may be moved outside the scanning gantry (e.g., a second position). For example, the object is held on the patient table 102, and when the scan is performed, the object is moved by the patient table 102 to the first position; after the scan is completed, the object is moved by the patient table 102 to the second position so that the interventional procedure is performed on the object at the second position.

[0093] In 202, when the object moves from the first position for scanning to the second position, the medical image can also be reconstructed according to the relative position relationship between the first position and the second position. For example, after the position of the scan result in the scanning coordinate system is transformed according to the second transformation matrix, the transformed coordinates are transformed again according to the relative position relationship to obtain the position of the scan result in the reference coordinate system.

[0094] The relative position relationship between the first position and the second position can be determined according to the displacement of the patient table 102. The present application is not limited thereto, and the relative position relationship between the first position and the second position can also be determined according to other methods. For example, at least three markers are set on the surface of the object, and the relative position relationship between the first position and the second position is determined according to the positions of the three markers when scanning the object and the positions of the three markers during the intervention operation. Thus, even if the object is displaced relative to the patient table 102, the above relative position relationship can be accurately determined.

[0095] In some embodiments, in 203, when the position of the medical accessory in the reference coordinate system and the position of the medical image in the reference coordinate system are determined, the position of the medical accessory in the medical image can be displayed in real time in the reference coordinate system according to the above position information. For the specific method of displaying according to the above position, reference can be made to the relevant technology, which will not be described in detail here.

[0096] In some embodiments, the position of the medical accessory may be the position of at least a portion of the medical accessory. For example, if the medical accessory includes a puncture needle, the position may be the position of the needle tip of the puncture needle, or the position may also be the position of the entire puncture needle, and so on.

[0097] In some embodiments, the medical image in the reference coordinate system may include a three-dimensional image, wherein the three-dimensional image is generated according to a scan result (eg, DICOM data) by, for example, a three-dimensional modeling algorithm. Fig. 9 is a schematic diagram of an image displayed in an embodiment of the present application. Fig. 9 As shown, in 203, the position of the medical attachment 300 can be displayed in real time in the three-dimensional medical image 901. The medical image 901 can include an area 902 corresponding to the scan result, thereby being able to display the relative position relationship between the medical attachment 300 and the area 902 in real time. Thus, it is helpful for the operator to adjust the angle and position of the medical attachment 300 in a timely manner according to the relative position relationship.

[0098] In some embodiments, other auxiliary information may be displayed in the three-dimensional image of the medical image, for example, a planned movement path of the medical accessory may be superimposed on the three-dimensional image, and / or information indicating the relative positional relationship between the medical accessory and the starting point and / or the target point of the movement path, and / or a predicted path determined based on the position and extension direction of the medical accessory, and / or a camera image.

[0099] For example, after obtaining the scan results, the moving path of the medical accessory can be planned according to the scan results, and it is expected that when performing an interventional operation, the medical accessory can be moved according to the planned moving path, thereby ensuring the safety and reliability of the interventional operation. Among them, the moving path may include a starting point, a target point, and a path between the starting point and the target point. The starting point may be, for example, the insertion point of the puncture needle, and the target point may be, for example, the target position to be reached by the puncture needle, such as the lesion position. By superimposing the moving path in the three-dimensional image, the operator can intuitively understand whether the current position of the medical accessory deviates from the moving path, so that the angle and position of the medical accessory 300 can be adjusted in time.

[0100] Alternatively, information indicating the relative positional relationship between the medical accessory and the starting point and / or target point of the moving path may be superimposed and displayed. This information may, for example, include angle information and / or distance information of the needle tip of the puncture needle relative to the starting point and / or target point, and may also include an icon pointing from the needle tip of the puncture needle to the starting point and / or target point, etc. This helps the operator to understand the position of the medical accessory more intuitively.

[0101] Alternatively, a predicted path determined based on the position and extension direction of the medical accessory may be superimposed and displayed, for example, by representing the predicted path with a line of a different color or shape from the icon of the medical accessory. This helps the operator understand the position where the medical accessory will reach when the medical accessory is advanced according to its current position and angle.

[0102] Alternatively, the camera image acquired by the auxiliary camera may be superimposed and displayed. The camera image acquired by the auxiliary camera may include an object, and superimposing and displaying the camera image in the three-dimensional image helps the operator understand the relative positional relationship between the medical attachment, the area 902 and the object.

[0103] In some embodiments, the medical image may also include a two-dimensional image displayed on one or more planes. Wherein, the two-dimensional image may be generated according to the scanning result (e.g., DICOM data) by a multi-planar reconstruction algorithm. For example, the two-dimensional image may include a sagittal plane, a coronal plane, and a transverse plane. The present application is not limited to this, and the two-dimensional image may also include a plane image in other directions.

[0104] In some embodiments, in addition to displaying the position of the medical accessory in the medical image in real time, a two-dimensional image corresponding to the position of the medical accessory can also be displayed in real time based on the position of the medical accessory, which helps the operator to understand the position of the medical accessory in the medical image more clearly.

[0105] In some embodiments, the two-dimensional image corresponding to the position of the medical attachment may include: a first two-dimensional image passing through the position of the medical attachment and / or a second two-dimensional image perpendicular to the first two-dimensional image passing through the position of the medical attachment and passing through a target point of the medical attachment. Thus, the first two-dimensional image can provide the operator with information related to tissues and / or structures near the position of the medical attachment, and the second two-dimensional image can provide the operator with information related to tissues and / or structures near the position of the lesion, thereby helping the operator understand the positions of the medical attachment and the target point.

[0106] In some embodiments, the two-dimensional image corresponding to the location of the medical attachment may also include: a first two-dimensional image passing through the location of the medical attachment, and a third two-dimensional image passing through the location of the medical attachment and perpendicular to the first two-dimensional image. Thus, more detailed information related to tissues and / or structures near the location of the medical attachment can be provided to the operator.

[0107] Fig.10 is another schematic diagram of an image displayed in an embodiment of the present application. Fig.10 As shown, according to the position of the medical accessory 300, for example, the needle tip position of the puncture needle, a sagittal plane 1001, a coronal plane 1002 and a transverse plane 1003 passing through the needle tip position of the puncture needle can be displayed.

[0108] In some embodiments, the first two-dimensional image and / or the second two-dimensional image and / or the third two-dimensional image may include marking information of the target point. The marking information may include information indicating the position of the target point, and / or information related to the relative positional relationship between the medical accessory and the target point. For example, the marking information may include the direction and distance that the medical accessory needs to move from the current position in order to reach the target point. This helps the operator to accurately adjust the position and angle of the medical accessory.

[0109] In some embodiments, Figure 2 As shown, the method may also include:

[0110] 204, generating a grid matrix according to the scanning result, wherein the grid matrix is ​​marked with a starting point and / or a target point of the planned moving path of the medical accessory; and

[0111] 205, superimposing a grid matrix on the camera image.

[0112] Thus, the position information of the starting point and / or the target point can be provided to the operator in the camera image, which helps the operator to intuitively understand the position of the starting point and / or the target point from the camera image. In addition, there is no need to use some external physical components to generate the grid matrix, which can simplify the operation.

[0113] Fig.11is another schematic diagram of an image displayed in an embodiment of the present application. Fig.11 As shown, the camera image 1100 may include a real image 1101 of the object 400, a grid matrix 1102 is superimposed on the camera image 1100, and a starting point A is marked on the grid matrix 1102. Thus, the operator can intuitively understand the position of the starting point A on the object 400, which helps the operator to quickly position the medical accessory 300 at the starting point A, thereby improving the efficiency and accuracy of the interventional operation.

[0114] In the past, in order to facilitate the operator to determine the starting point A, it is usually necessary to attach a metal mesh to the surface of the object 400, and scan the object 400 with the metal mesh attached to obtain a scanning result. According to the metal mesh image in the scanning result and the relative position information of the starting point A of the planned moving path, the position of the starting point A on the object 400 is determined. For example, according to the scanning result, it is determined that the starting point A is located in the grid of the nth row and the mth column of the metal mesh. The operator finds the grid of the nth row and the mth column on the metal mesh attached to the surface of the object 400, thereby determining the position of the starting point A on the object 400.

[0115] Compared with the prior art, by superimposing a grid matrix in the camera image, no additional disposable auxiliary consumables (eg, metal mesh) are required, and no additional hardware is required to assist in the positioning of medical accessories, thereby reducing the cost of interventional scanning.

[0116] In some embodiments, the grid matrix 1102 can be generated from the scan results. Taking DICOM data as an example, each pixel in the DICOM data can be mapped from the scan coordinate system to the world coordinate system, and then each pixel can be mapped to the camera coordinate system. Thus, the starting point and / or the target point of the planned path in the scan coordinate system can be mapped to the camera coordinate system to generate a grid matrix with the starting point and / or the target point marked.

[0117] In some embodiments, the position of the medical accessory and / or information indicating the relative positional relationship between the medical accessory and the starting point and / or the target point can also be displayed in real time on the grid matrix. Fig.11 As shown, the image of the medical accessory 300 can be displayed in the camera image 1100, thereby being able to more intuitively provide the operator with the position of the medical accessory 300 relative to the starting point A, and the operator can intuitively understand the distance between the current position of the medical accessory 300 and the starting point A using the grid matrix 1102 as a scale.

[0118] like Fig.11As shown, the information 1103 representing the relative position relationship between the medical accessory 300 and the starting point and / or the target point can be an arrow pointing from the current position of the medical accessory 300 to the starting point and / or the target point, or distance information, thereby helping the operator to quickly place the medical accessory 300 in the correct position.

[0119] Fig.12 This is another schematic diagram of the medical imaging method according to an embodiment of the present application. Fig.12 , taking the patient as the subject and the medical accessories including the puncture needle assembly as an example, the medical imaging method of the embodiment of the present application is exemplarily described. Fig.12 As shown, the medical imaging method may include:

[0120] 1201, scanning a patient to obtain a diagnostic scanning sequence;

[0121] 1202, determining a puncture path according to a diagnostic scanning sequence;

[0122] 1203, generating an MPR (MultiPlanar Reconstruction) and a 3D volume image model based on the diagnostic scanning sequence;

[0123] 1204, displaying the puncture path in the MPR and 3D volume image model;

[0124] 1205, generating a grid matrix according to the diagnostic scanning sequence, and marking the position of the puncture needle point in the grid matrix;

[0125] 1206, overlaying the grid matrix on the patient's video and displaying an arrow pointing from the puncture needle tip to the puncture point;

[0126] 1207, the auxiliary camera monitors the images of the puncture needle and the patient in real time so that the user can place the puncture needle at the needle insertion point according to the grid of the grid matrix in the camera video screen;

[0127] 1208. According to the angle and position of the puncture needle, the position of the puncture needle in the 3D volume image model is dynamically displayed, and the MPR image corresponding to the angle and position of the puncture needle is dynamically displayed, so that the user can move the puncture needle to the target point to complete the puncture.

[0128] It is worth noting that the above Figure 2 , 4 , 5, 6, and 12 are only schematic illustrations of the embodiments of the present application, but the present application is not limited thereto. For example, the execution order of each operation can be appropriately adjusted, and other operations can be added or some operations can be reduced. Those skilled in the art can make appropriate modifications based on the above content, and are not limited to the above appended Figure 2 , 4 , 5, 6, and 12.

[0129] It can be seen from the above embodiments that the position of the medical accessory in the reference coordinate system is determined based on the camera image acquired by the auxiliary camera, and the medical image is reconstructed based on the scanning result with the reference coordinate system as a reference. Thus, the position of the medical accessory in the medical image can be displayed in real time, thereby improving the operational convenience, helping to simplify and shorten the positioning process of the medical accessory, and facilitating the operator to move the medical accessory to the target position quickly and accurately.

[0130] The embodiment of the present application further provides a medical imaging device, and the parts repeated in the above-mentioned embodiment will not be repeated. Fig.13 is a schematic diagram of a medical imaging device according to an embodiment of the present application. Fig.13 As shown, the medical imaging device 1300 includes:

[0131] A determination unit 1301, which determines the position of the medical accessory in the reference coordinate system based on the camera image acquired by the auxiliary camera;

[0132] A reconstruction unit 1302, which reconstructs the medical image according to the scanning result based on the reference coordinate system; and

[0133] The display unit 1303 displays the position of the medical attachment in the medical image in real time.

[0134] In some embodiments, the reference coordinate system comprises a world coordinate system, and the origin of the world coordinate system is located at the center of the CT gantry.

[0135] In some embodiments, the medical imaging device may also include: a generation unit 1304, which generates a grid matrix based on the scanning results, and the grid matrix is ​​marked with a starting point and / or a target point of the planned moving path of the medical accessory; the display unit 1303 superimposes the grid matrix on the camera image.

[0136] In some embodiments, the display unit 1303 displays the position of the medical accessory and / or information indicating the relative positional relationship between the medical accessory and the starting point and / or the target point on the grid matrix in real time.

[0137] In some embodiments, the medical image comprises a three-dimensional image and / or a two-dimensional image displayed on one or more planes.

[0138] In some embodiments, the display unit 1303 displays the two-dimensional image corresponding to the position of the medical accessory in real time according to the position of the medical accessory.

[0139] In some embodiments, the two-dimensional image corresponding to the position of the medical accessory includes: a first two-dimensional image passing through the position of the medical accessory and / or a second two-dimensional image perpendicular to the first two-dimensional image passing through the position of the medical accessory and passing through a target point of the medical accessory.

[0140] In some embodiments, the two-dimensional image includes marking information of the target point.

[0141] In some embodiments, the marking information includes information related to a relative positional relationship between the medical accessory and the target point.

[0142] In some embodiments, the display unit 1303 superimposes and displays the planned movement path of the medical accessory in the three-dimensional image of the medical image, and / or information indicating the relative position relationship between the medical accessory and the starting point and / or target point of the movement path, and / or a predicted path determined based on the position and extension direction of the medical accessory, and / or the camera image.

[0143] In some embodiments, the determination unit 1301 determines the position of the medical accessory in the imaging coordinate system based on the camera image, and determines the position of the medical accessory in the reference coordinate system based on the position of the medical accessory in the imaging coordinate system and a first transformation matrix between the imaging coordinate system and the reference coordinate system.

[0144] In some embodiments, the medical accessory includes a puncture needle and a marker, and the determination unit 1301 identifies the marker in the camera image, determines the extension direction and position information of the marker in the camera coordinate system; and determines the position of the medical accessory in the camera coordinate system based on the extension direction and the position information, and the relative position relationship between the marker and the puncture needle.

[0145] In some embodiments, the extension direction of the marker forms a preset angle with the extension direction of the puncture needle, and / or the marker is fixed at a preset position of the puncture needle; and / or the marker carries information related to the medical accessory.

[0146] In some embodiments, the marker is a sleeve sleeved on the outer circumference of the puncture needle.

[0147] In some embodiments, the marker includes at least one of the following: a component having a preset temperature, a component having a preset shape and / or pattern, or a component that emits light according to a preset rule.

[0148] In some embodiments, the reconstruction unit 1302 reconstructs the medical image in the reference coordinate system according to the position of the scanning result in the scanning coordinate system and a second transformation matrix between the scanning coordinate system and the reference coordinate system.

[0149] In some embodiments, when the scanned object moves from a first position for CT scanning to a second position, the reconstruction unit 1302 further reconstructs the medical image according to the relative position relationship between the first position and the second position.

[0150] It can be seen from the above embodiments that the position of the medical accessory in the reference coordinate system is determined based on the camera image acquired by the auxiliary camera, and the medical image is reconstructed based on the scanning result with the reference coordinate system as a reference. Thus, the position of the medical accessory in the medical image can be displayed in real time, thereby improving the operational convenience, helping to simplify and shorten the positioning process of the medical accessory, and facilitating the operator to move the medical accessory to the target position quickly and accurately.

[0151] The present application also provides a computer device, Fig.14 Schematic diagram of the computer device in the embodiment of the present application. Fig.14 As shown, the computer device 1400 may include: one or more processors (e.g., central processing unit CPU) 1410 and one or more memories 1420; the memory 1420 is coupled to the processor 1410. The memory 1420 may store a program 1421 (e.g., a medical imaging program, etc.) and / or data (e.g., camera images, scan results, etc.), and the program 1421 is executed under the control of the processor 1410. The memory 1420 may include, for example, a ROM, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, or a non-volatile memory card.

[0152] In some embodiments, the functions of the medical imaging device 1300 may be integrated into the processor 1410. The processor 1410 is configured to implement the medical imaging method as described in the above embodiments. The implementation of the processor 1410 may refer to the above embodiments and will not be described in detail here.

[0153] In some embodiments, the medical imaging device 1300 and the processor 1410 are configured separately. For example, the medical imaging device 1300 can be configured as a chip connected to the processor 1410 , and the functions of the medical imaging device 1300 are realized through the control of the processor 1410 .

[0154] In addition, if Fig.14As shown, the computer device 1400 may also include: an input device 1430 and a display 1440, etc. The functions of the above components are similar to those of the prior art and are not described in detail here. It is worth noting that the computer device 1400 does not necessarily have to include Fig.14 In addition, the computer device 1400 may also include all components shown in Fig.14 For components not shown in the figure, reference may be made to the related art.

[0155] The processor 1410 can respond to the operation of the input device to communicate with the medical device, display, etc., and can also control the input action and / or state of the input device. The processor 1410 can also be called a microcontroller unit (MCU), a microprocessor or a microcontroller or other processor device and / or logic device. The processor 1410 can include a reset circuit, a clock circuit, a chip, a microcontroller, etc. The function of the processor 1410 can be integrated on the mainboard of the medical device (for example, the processor 1410 is configured as a chip connected to the mainboard processor (CPU)), or it can be set independently of the mainboard, and the embodiments of the present application are not limited to this.

[0156] In some embodiments, the computer device may be a computer server, a cloud platform, a workstation, etc., but the embodiments of the present application are not limited thereto.

[0157] The present application also provides a medical imaging system. Fig.15 is another schematic diagram of a medical imaging system according to an embodiment of the present application. Fig.15 The medical imaging system 110 shown includes suitable hardware, software, or a combination thereof for supporting medical imaging. For example, the medical imaging system 110 may be a CT system configured to generate and / or render CT images, or an ultrasound system configured to generate and / or render ultrasound images, or a magnetic resonance system configured to generate and / or render magnetic resonance images, etc. Fig.15 As shown, the medical imaging system 110 may include a processor 113 and a display 114. As described above, the processor 113 may determine the position of the medical accessory in the reference coordinate system based on the camera image acquired by the auxiliary camera, and reconstruct the medical image according to the scanning result based on the reference coordinate system. The display 114 may display the position of the medical accessory in the medical image in real time. The specific implementation is as described above and will not be repeated here.

[0158] The display 114 may be configured to display an image (e.g., via a screen). In some cases, the display 114 may also be configured to generate, at least in part, the displayed image. In addition, the display 114 may also support user input / output. For example, in addition to the image, the display 114 may also provide (e.g., via a screen) user feedback (e.g., information related to the system, its functions, its settings, etc.). The display 114 may also support user input (e.g., via user controls 118), such as to allow control of medical imaging. The user input may involve controlling the display of an image, selecting settings, specifying user preferences, requesting feedback, etc.

[0159] like Fig.15 As shown, the medical imaging system 110 may also include a scanning device 112, which may be fixed or movable. The scanning device 112 may be configured to generate and / or capture a specific type of imaging signal (and / or data corresponding thereto), such as by moving over an object to be examined (or a portion thereof), and may include suitable circuits for performing and / or supporting such functions. The scanning device 112 may be an ultrasound probe, an MRI scanner, a CT scanner, or any suitable imaging device.

[0160] In some embodiments, the medical imaging system 110 may further include an imaging device (not shown), which (eg, the aforementioned auxiliary camera) may acquire images of subjects (eg, medical accessories and objects) within its imaging range.

[0161] In some embodiments, the medical imaging system 110 may also incorporate additional and dedicated computing resources, such as one or more computing systems 120. In this regard, each computing system 120 may include suitable circuitry, interfaces, logic, and / or code for processing, storing, and / or communicating data. The computing system 120 may be a dedicated device configured for use specifically in conjunction with medical imaging, or it may be a general-purpose computing system (e.g., a personal computer, a server, etc.) that is configured and / or configured to perform the operations described below with respect to the computing system 120. The computing system 120 may be configured to support the operation of the medical imaging system 110, as described below. In this regard, various functions and / or operations may be offloaded from the imaging system. Doing so may simplify and / or centralize certain aspects of processing to reduce costs (by eliminating the need to increase processing resources in the imaging system).

[0162] The computing system 120 can be configured and / or arranged for use in different ways. For example, in some implementations, a single computing system 120 can be used; in other implementations, multiple computing systems 120 are configured to work together (e.g., based on a distributed processing configuration), or work separately, where each computing system 120 is configured to handle specific aspects and / or functions, and / or process data only for a specific medical imaging system 110.

[0163] In some embodiments, the computing system 120 may be local (e.g., co-located with one or more medical imaging systems 110, such as within the same facility and / or the same local network); in other implementations, the computing system 120 may be remote and thus accessible only via a remote connection (e.g., via the Internet or other available remote access technology). In certain implementations, the computing system 120 may be configured in a cloud-based manner and may be accessed and / or used in a manner substantially similar to accessing and using other cloud-based systems.

[0164] Once the data is generated and / or configured in the computing system 120, the data may be copied and / or loaded into the medical imaging system 110. For example, the data may be loaded via a directed connection or link between the medical imaging system 110 and the computing system 120. In this regard, the communication between the different elements in the setup may be performed using available wired and / or wireless connections and / or according to any suitable communication (and / or networking) standards or protocols. Alternatively or additionally, the data may be loaded into the medical imaging system 110 indirectly. For example, the data may be stored in a suitable machine-readable medium (e.g., a flash memory card, etc.), which may then be used to load the data into the medical imaging system 110 (on-site, such as by a user of the system (e.g., an imaging clinician) or authorized personnel); or the data may be downloaded to a local electronic device capable of communication (e.g., a laptop, etc.), which may then be used on-site (e.g., by a user of the system or authorized personnel) to upload the data into the medical imaging system 110 via a direct connection (e.g., a USB connector, etc.).

[0165] In operation, the medical imaging system 110 may be used to generate and present (e.g., render or display) images during a medical examination or treatment, and / or to support user input / output in conjunction therewith. The images may be 2D, 3D, and / or 4D images. The specific operations or functions performed in the medical imaging system 110 to facilitate generating and / or presenting the images depend on the type of system (i.e., the manner in which data corresponding to the images is obtained and / or generated).

[0166] The following is an example of a medical imaging system, which is a CT system. Fig.16 Schematic diagram of the CT system 10 of the embodiment of the present application. Fig.16 As shown, the system 10 includes a frame 12, on which an X-ray source 14 and a detector 18 are arranged opposite to each other. The detector 18 is composed of a plurality of detector modules 20 and a data acquisition system (DAS) 26. The DAS 26 is used to convert the sampled analog attenuation data received by the plurality of detector modules 20 into digital signals for subsequent processing. The system 10 may also include a camera device (not shown) for acquiring images of medical accessories.

[0167] In some embodiments, the system 10 is used to collect projection data of the object to be inspected at different angles, so the components on the gantry 12 are used to rotate around the rotation center 24 to collect projection data. During the rotation process, the X-ray radiation source 14 is used to project X-rays 16 that penetrate the object to be inspected toward the detector 18, and the attenuated X-ray beam data is pre-processed as the projection data of the target volume of the object. Based on the projection data, an image of the object to be inspected can be reconstructed, and the reconstructed image can show the internal features of the object to be inspected, such as lesions, size, shape, etc. of the body tissue structure. The rotation center 24 of the gantry also defines the center of the scanning field 80.

[0168] In some embodiments, the system 10 includes a control mechanism 30. The control mechanism 30 may include an X-ray controller 34, which is used to provide power and timing signals to the X-ray radiation source 14. The control mechanism 30 may also include a gantry controller 32, which is used to control the rotation speed and / or position of the gantry 12 based on imaging requirements. The control mechanism 30 may also include a carrier bed controller 36, which is used to drive the carrier bed 28 to move to a suitable position to position the object to be inspected in the gantry 12, perform positioning scanning or axis scanning or bolt scanning or other scanning methods, etc., to collect projection data of the target volume of the object to be inspected. Further, the carrier bed 28 includes a driving device, and the carrier bed controller 36 can control the carrier bed 28 by controlling the driving device.

[0169] The system 10 further includes an image reconstruction module 50. As described above, the DAS 26 samples and digitizes the projection data collected by the plurality of detector modules 20. Then, the image reconstruction module 50 performs high-speed image reconstruction based on the sampled and digitized projection data. In some embodiments, the image reconstruction module 50 stores the reconstructed image in a storage device or a large-capacity memory 46. Alternatively, the image reconstruction module 50 transmits the reconstructed image to the computer 40 to generate patient information for diagnosis and evaluation. For example, a first positioning image and a diagnostic cross-sectional image are generated based on the projection data collected by a positioning scan, an axis scan, a bolt scan, or other scanning methods.

[0170] although Fig.164 shows an image reconstruction module 50 as a separate entity, but in some embodiments, the image reconstruction module 50 may form part of the computer 40. Alternatively, the image reconstruction module 50 may not be present in the system 10, or the computer 40 may perform one or more functions of the image reconstruction module 50. In addition, the image reconstruction module 50 may be located at a local or remote location and may be connected to the system 10 using a wired or wireless network. In some embodiments, computing resources concentrated in a cloud network may be used for the image reconstruction module 50.

[0171] In some embodiments, the system 10 further includes a computer 40, and the data sampled and digitized by the DAS 26 and / or the images reconstructed by the image reconstruction module 50 are transmitted to the computer or computer 40 for processing. In some embodiments, the computer 40 stores the data and / or images in a storage device such as a mass storage 46. The mass storage 46 may include a hard drive, a floppy disk drive, a compact disk read / write (CD-R / W) drive, a digital versatile disk (DVD) drive, a flash drive, and / or a solid-state storage device, etc. The processor in the computer 40 determines the predicted cross-sectional image based on the first positioning image.

[0172] In some embodiments, the computer 40 transmits the reconstructed image and / or other information to a display 42, which is communicatively connected to the computer 40 and / or the image reconstruction module 50. In some embodiments, the computer 40 can be connected to a local or remote display, printer, workstation and / or similar device, for example, such equipment of a medical institution or hospital, or connected to a remote device via one or more configured wires or a wireless network such as the Internet and / or a virtual private network. For example, the display shows the predicted cross-sectional image and the corresponding scanning parameters.

[0173] In addition, the computer 40 can provide commands and parameters to the DAS 26, and the control mechanism 30 (including the gantry controller 32, the X-ray controller 34 and the carrier bed controller 36) based on user-provided and / or system-defined commands and parameters to control system operations, such as data acquisition and / or processing. In some embodiments, the computer 40 controls system operations based on user input. For example, the computer 40 can receive user input, including commands, scan protocols and / or scan parameters, through an operator console 48 connected thereto. The operator console 48 may include a keyboard (not shown) and / or a touch screen to allow the user to enter / select commands, scan protocols and / or scan parameters.

[0174] In some embodiments, the system 10 may include or be connected to a picture archiving and communication system (PACS) (not shown). In some embodiments, the PACS is further connected to a remote system such as a radiology department information system, a hospital information system, and / or an internal or external network (not shown) to allow operators located in different locations to provide commands and parameters, and / or access image data.

[0175] The methods or processes in the aforementioned embodiments may be stored as executable instructions in a non-volatile memory on a computing device of the storage system 10. For example, the computer 40 may include executable instructions in a non-volatile memory and may apply the medical imaging method in the embodiments of the present application.

[0176] The computer 40 may be configured and / or arranged to be used in different ways. For example, in some implementations, a single computer 40 may be used; in other implementations, multiple computers 40 are configured to work together (e.g., based on a distributed processing configuration) or individually, with each computer 40 configured to handle specific aspects and / or functions, and / or process data used to generate models that are only used for a specific system 10. In some implementations, the computer 40 may be local (e.g., co-located with one or more systems 10, such as within the same facility and / or the same local network); in other implementations, the computer 40 may be remote and therefore only accessible via a remote connection (e.g., via the Internet or other available remote access technology). In a particular implementation, the computer 40 may be configured in a cloud-like manner and may be accessed and / or used in a manner substantially similar to the manner in which other cloud-based systems are accessed and used.

[0177] Once the data is generated and / or configured, the data can be copied and / or loaded into the medical system 10, which can be done in different ways. For example, the model can be loaded via a directional connection or link between the system 10 and the computer 40. In this regard, the communication between the different elements can be completed using available wired and / or wireless connections and / or according to any suitable communication (and / or network) standards or protocols. Alternatively or additionally, the data can be loaded into the system 10 indirectly. For example, the data can be stored in a suitable machine-readable medium (e.g., a flash card, etc.), and then the medium is used to load the data into the system 10 (on-site, such as by a user or authorized personnel of the system), or the data can be downloaded to an electronic device capable of local communication (e.g., a laptop, etc.), and then the device is used on-site (e.g., by a user or authorized personnel of the system) to upload the data to the system 10 via a direct connection (e.g., a USB connector, etc.).

[0178] An embodiment of the present application also provides a computer-readable program, wherein when the program is executed, the program enables the computer to execute the medical imaging method described in the aforementioned embodiment in the apparatus or system or computer device.

[0179] An embodiment of the present application also provides a storage medium storing a computer-readable program, wherein the computer-readable program enables a computer to execute the medical imaging method described in the aforementioned embodiment in an apparatus, system, or computer device.

[0180] The above devices and methods of the present application can be implemented by hardware, or by hardware combined with software. The present application relates to such a computer-readable program, which, when executed by a logic component, enables the logic component to implement the above-mentioned devices or components, or enables the logic component to implement the various methods or steps described above. The present application also relates to a storage medium for storing the above program, such as a hard disk, a magnetic disk, an optical disk, a DVD, a flash memory, etc.

[0181] The method / device described in conjunction with the embodiments of the present application may be directly embodied as hardware, a software module executed by a processor, or a combination of the two. For example, one or more of the functional block diagrams shown in the figure and / or one or more combinations of the functional block diagrams may correspond to various software modules of the computer program flow or to various hardware modules. These software modules may correspond to the various steps shown in the figure, respectively. These hardware modules may be implemented by solidifying these software modules, for example, using a field programmable gate array (FPGA).

[0182] The software module may be located in a RAM memory, a flash memory, a ROM memory, an EPROM memory, an EEPROM memory, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. A storage medium may be coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium; or the storage medium may be an integral part of the processor. The processor and the storage medium may be located in an ASIC. The software module may be stored in a memory of a mobile terminal or in a memory card that can be inserted into the mobile terminal. For example, if a device (such as a mobile terminal) uses a large-capacity MEGA-SIM card or a large-capacity flash memory device, the software module may be stored in the MEGA-SIM card or the large-capacity flash memory device.

[0183] One or more of the functional blocks and / or one or more combinations of the functional blocks described in the drawings may be implemented as a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, or any appropriate combination thereof for performing the functions described in the present application. One or more of the functional blocks and / or one or more combinations of the functional blocks described in the drawings may also be implemented as a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, or any appropriate combination thereof.

[0184] It is a combination of computing devices, for example, a combination of a DSP and a microprocessor, multiple microprocessors, one or more microprocessors in communication with a DSP, or any other such configuration. The above embodiments are only exemplary descriptions of the embodiments of the present application, but the present application is not limited thereto, and appropriate modifications can be made on the basis of the above embodiments. For example, the above embodiments can be used alone, or one or more of the above embodiments can be combined.

[0185] The present application is described above in conjunction with specific implementation methods, but it should be clear to those skilled in the art that these descriptions are exemplary and are not intended to limit the scope of protection of the present application. Those skilled in the art can make various modifications and variations to the present application based on the spirit and principles of the present application, and these modifications and variations are also within the scope of the present application.

[0186] The preferred embodiments of the present application are described above with reference to the accompanying drawings. Many features and advantages of these embodiments are clear from this detailed description, and therefore the appended claims are intended to cover all such features and advantages of these embodiments that fall within their true spirit and scope. In addition, since many modifications and variations are easily conceivable to those skilled in the art, the embodiments of the present application are not intended to be limited to the precise structures and operations illustrated and described, but all suitable modifications, variations, and equivalents that fall within their scope may be covered.

Claims

1. A medical imaging method, It is characterized in that The method comprises: Determining the position of the medical accessory in the reference coordinate system based on the camera image acquired by the auxiliary camera; Reconstructing a medical image based on the scan result with the reference coordinate system as a reference; and The position of the medical accessory in the medical image is displayed in real time.

2. The method according to claim 1, It is characterized in that The reference coordinate system includes a world coordinate system, and the origin of the world coordinate system is located at the center of the scanning gantry.

3. The method according to claim 1, It is characterized in that The method further comprises: generating a grid matrix according to the scanning result, wherein the grid matrix is ​​marked with a starting point and / or a target point of the planned moving path of the medical accessory; and In the camera image, the grid matrix is ​​superimposed.

4. The method according to claim 3, It is characterized in that The method further comprises: On the grid matrix, the position of the medical accessory and / or information indicating the relative positional relationship between the medical accessory and the starting point and / or the target point are displayed in real time.

5. The method according to claim 1, It is characterized in that The medical image includes a three-dimensional image and / or a two-dimensional image displayed on one or more planes.

6. The method according to claim 5, It is characterized in that The method further comprises: According to the position of the medical accessory, the two-dimensional image corresponding to the position of the medical accessory is displayed in real time.

7. The method according to claim 6, It is characterized in that The two-dimensional image corresponding to the position of the medical accessory includes: A first two-dimensional image passing through the position of the medical accessory and / or a second two-dimensional image perpendicular to the first two-dimensional image passing through the position of the medical accessory and passing through a target point of the medical accessory.

8. The method according to claim 7, It is characterized in that The second two-dimensional image includes marking information of the target point.

9. The method according to claim 8, It is characterized in that The marking information includes information related to a relative positional relationship between the medical accessory and the target point.

10. The method according to claim 5, It is characterized in that The method further comprises: In the three-dimensional image of the medical image, superimposed display are: the planned movement path of the medical accessory, and / or information indicating the relative position relationship between the medical accessory and the starting point and / or target point of the movement path, and / or a predicted path determined based on the position and extension direction of the medical accessory, and / or the camera image.

11. The method according to claim 1, It is characterized in that Determining the position of the medical accessory in the reference coordinate system based on the camera image acquired by the auxiliary camera includes: Determining the position of the medical accessory in the imaging coordinate system according to the imaging image; and The position of the medical accessory in the reference coordinate system is determined according to the position of the medical accessory in the imaging coordinate system and a first transformation matrix between the imaging coordinate system and the reference coordinate system.

12. The method according to claim 11, It is characterized in that The medical accessories include a puncture needle and a marker. Determining the position of the medical accessory in the imaging coordinate system according to the imaging image includes: Identify the marker in the camera image, and determine the extension direction and position information of the marker in the camera coordinate system; The position of the puncture needle in the imaging coordinate system is determined according to the extending direction and the position information, and the relative positional relationship between the marker and the puncture needle.

13. The method according to claim 12, It is characterized in that The extending direction of the marker forms a preset angle with the extending direction of the puncture needle, and / or the marker is fixed at a preset position of the puncture needle; And / or, the marker carries information related to the medical accessory.

14. The method according to claim 13, It is characterized in that The marker is a sleeve sleeved on the outer peripheral side of the puncture needle.

15. The method according to claim 12, It is characterized in that The marker comprises at least one of the following: A component having a preset temperature, a component having a preset shape and / or pattern, or a component that emits light according to a preset rule.

16. The method according to claim 1, It is characterized in that Reconstructing a medical image based on the scan result with the reference coordinate system as a reference, including: The medical image is reconstructed in the reference coordinate system according to the position of the scan result in the scan coordinate system and a second transformation matrix between the scan coordinate system and the reference coordinate system.

17. The method according to claim 16, It is characterized in that In the case where the scanned object moves from a first position where scanning is performed to a second position, the medical image is also reconstructed according to a relative positional relationship between the first position and the second position.

18. A medical imaging device, It is characterized in that The device comprises: a determination unit, which determines a position of the medical accessory in a reference coordinate system based on a camera image acquired by the auxiliary camera; a reconstruction unit, which reconstructs the medical image according to the scanning result based on the reference coordinate system; and A display unit displays the position of the medical accessory in the medical image in real time.

19. The device according to claim 18, It is characterized in that The device also includes: A generating unit, which generates a grid matrix according to the scanning result, wherein the grid matrix is ​​marked with a starting point and / or a target point of the planned moving path of the medical accessory; The display unit superimposes the grid matrix in the camera image.

20. The device according to claim 18, It is characterized in that The medical image includes a three-dimensional image and / or a two-dimensional image displayed on one or more planes.

21. The device according to claim 20, It is characterized in that The display unit displays the two-dimensional image corresponding to the position of the medical accessory in real time according to the position of the medical accessory.

22. The device according to claim 20, It is characterized in that The display unit superimposes and displays in the three-dimensional image of the medical image: the planned movement path of the medical accessory, and / or information indicating the relative positional relationship between the medical accessory and the starting point and / or target point of the movement path, and / or a predicted path determined based on the position and extension direction of the medical accessory, and / or the camera image.

23. The device according to claim 18, It is characterized in that The medical accessory includes a puncture needle and a marker, wherein an extension direction of the marker forms a preset angle with an extension direction of the puncture needle, and / or the marker is fixed at a preset position of the puncture needle; and / or the marker carries information related to the medical accessory.

24. The device according to claim 23, It is characterized in that The marker is a sleeve sleeved on the outer peripheral side of the puncture needle.

25. A medical imaging system, It is characterized in that The system comprises: a processor that determines the position of the medical accessory in a reference coordinate system based on the camera image acquired by the auxiliary camera, and reconstructs the medical image according to the scan result based on the reference coordinate system; and A display that displays the position of the medical accessory in the medical image in real time.