Medical image processing method, device, computer equipment and storage medium

Abstract

The present application discloses a medical image processing method, device, computer equipment and storage medium, the medical image processing method comprising: obtaining the current image processing mode of the medical device; obtaining the medical image of the target object; and performing image processing on the medical image based on the current image processing mode. Since the image processing mode of the medical device includes an image diagnosis mode, a treatment plan formulation mode and a treatment mode, the same medical device can realize the functions of multiple medical devices in the prior art, such as diagnosis, designation of treatment plans, image-guided treatment, etc., thereby improving the utilization rate of the medical device, reducing the equipment procurement cost and patient treatment cost, and saving the patient's treatment time.

Description

Technical Field

[0001] The present application relates to medical technicians and fields, and in particular to a medical image processing method, apparatus, computer equipment and storage medium. Background Art

[0002] Computed Tomography (CT) has been widely used in the fields of human tissue imaging, industrial non-destructive testing, etc. In the medical field, CT uses precisely collimated X-ray beams, gamma rays, ultrasound, etc., together with highly sensitive detectors to perform cross-sectional scans around a certain part of the human body one by one. It has the characteristics of fast scanning time and clear images, and can be used for the examination and treatment of various diseases.

[0003] The related technologies include CT with multiple functions, such as: 1) diagnostic CT, 2) large-aperture CT for treatment planning and simulation positioning, and 3) cone-beam CT for image guidance during treatment. These three types of CT are multiple different devices, of which 1) and 2) are independent devices, and 3) is often combined with treatment equipment. For cancer patients, diagnostic scans, treatment plans and simulation positioning scans after diagnosis, and cone-beam CT image guidance and subsequent treatment are usually performed on the above three devices.

[0004] The above three functions belong to different devices, which causes inconvenience to patient treatment in terms of time and space (for example, separate appointments must be made and scans must be performed on different devices). More importantly, ensuring the consistency among the three devices is technically challenging and requires additional technical, economic and time costs. In addition, although the three devices are all rotary scanning devices, the frame, treatment bed and control system thereof essentially achieve similar functions, but because they belong to different devices, they are all designed, manufactured and processed separately. When purchasing the whole device, all three are indispensable, the cost is high, and it is ultimately passed on to the patient terminal, resulting in expensive diagnosis and treatment costs. Summary of the invention

[0005] The embodiments of the present application provide a medical image processing method, apparatus, computer equipment, and storage medium, which improve the utilization rate of medical equipment, reduce equipment procurement costs and patient treatment costs, and save patient treatment time.

[0006] In one aspect, the present application provides a medical image processing method, which is applied to a medical device, wherein the image processing mode of the medical device includes an image diagnosis mode, a treatment plan formulation mode, and a treatment mode, and the medical image processing method includes:

[0007] obtaining a current image processing mode of the medical device;

[0008] Acquiring a medical image of a target object;

[0009] Based on the current image processing mode, image processing is performed on the medical image.

[0010] In some embodiments of the present application, performing image processing on the medical image based on the current image processing mode includes:

[0011] If the current image processing mode is an image diagnosis mode, the medical image is identified to obtain a medical identification result of the medical image.

[0012] In some embodiments of the present application, if the current image processing mode is an image diagnosis mode, identifying the medical image to obtain a medical recognition result of the medical image includes:

[0013] If the current image processing mode is an image diagnosis mode, displaying the medical image to a target user;

[0014] Obtaining manual diagnosis information of the user for the medical image;

[0015] The artificial diagnosis information is used as the medical recognition result of the medical image.

[0016] In some embodiments of the present application, the step of acquiring a medical image of the target object includes:

[0017] Sequentially acquiring a plurality of positioning scan images of the target object at a plurality of positioning positions along the treatment bed direction, each positioning position corresponding to a positioning scan image;

[0018] The multiple positioning scan images are spliced ​​together to obtain a medical image of the target object.

[0019] In some embodiments of the present application, sequentially acquiring a plurality of positioning scan images of the target object at a plurality of positioning positions along the treatment bed direction includes:

[0020] At a first positioning position along the treatment bed direction, acquiring a single-circle scanning image of the target object;

[0021] According to a preset step length, determining the first positioning position at a target positioning position next to the treatment bed, and acquiring a single-circle scanning image of the target object at the target positioning position;

[0022] After the target object scan at multiple positioning positions is completed, multiple positioning scan images of the target object at multiple positioning positions along the treatment bed direction are obtained.

[0023] In some embodiments of the present application, performing image processing on the medical image based on the current image processing mode includes:

[0024] If the current image processing mode is a treatment planning mode, acquiring a simulated positioning image of the target object;

[0025] A first treatment plan for the target object is formulated according to the simulated positioning image.

[0026] In some embodiments of the present application, formulating a first treatment plan for the target object according to the simulated positioning image includes:

[0027] Delineating the simulated positioning image to determine the medical contour of the target object;

[0028] Based on the medical profile, a first treatment plan for the target subject is formulated.

[0029] In some embodiments of the present application, performing image processing on the medical image based on the current image processing mode includes:

[0030] If the current image processing mode is a treatment mode, obtaining a second treatment plan pre-formulated for the target object;

[0031] Based on the second treatment plan, image-guided and treated treatment is performed on the target object.

[0032] On the other hand, the present application provides a medical image processing device, which is applied to a medical device, wherein the image processing mode of the medical device includes an image diagnosis mode, a treatment plan formulation mode, and a treatment mode, and the medical image processing device includes:

[0033] A first acquisition module, used for acquiring a current image processing mode of the medical device;

[0034] A second acquisition module is used to acquire a medical image of the target object;

[0035] A processing module is used to perform image processing on the medical image based on the current image processing mode.

[0036] In some embodiments of the present application, the processing module is specifically used for:

[0037] If the current image processing mode is an image diagnosis mode, the medical image is identified to obtain a medical identification result of the medical image.

[0038] In some embodiments of the present application, the processing module is specifically used for:

[0039] If the current image processing mode is an image diagnosis mode, displaying the medical image to a target user;

[0040] Obtaining manual diagnosis information of the user for the medical image;

[0041] The artificial diagnosis information is used as the medical recognition result of the medical image.

[0042] In some implementations of the present application, the second acquisition module is specifically used to:

[0043] Sequentially acquiring a plurality of positioning scan images of the target object at a plurality of positioning positions along the treatment bed direction, each positioning position corresponding to a positioning scan image;

[0044] The multiple positioning scan images are spliced ​​together to obtain a medical image of the target object.

[0045] In some implementations of the present application, the second acquisition module is specifically used to:

[0046] At a first positioning position along the treatment bed direction, acquiring a single-circle scanning image of the target object;

[0047] According to a preset step length, determining the first positioning position at a target positioning position next to the treatment bed, and acquiring a single-circle scanning image of the target object at the target positioning position;

[0048] After the target object scan at multiple positioning positions is completed, multiple positioning scan images of the target object at multiple positioning positions along the treatment bed direction are obtained.

[0049] In some embodiments of the present application, the processing module is specifically used for:

[0050] If the current image processing mode is a treatment planning mode, acquiring a simulated positioning image of the target object;

[0051] A first treatment plan for the target object is formulated according to the simulated positioning image.

[0052] In some embodiments of the present application, the processing module is specifically used for:

[0053] Delineating the simulated positioning image to determine the medical contour of the target object;

[0054] Based on the medical profile, a first treatment plan for the target subject is formulated.

[0055] In some embodiments of the present application, the processing module is specifically used for:

[0056] If the current image processing mode is a treatment mode, obtaining a second treatment plan pre-formulated for the target object;

[0057] Based on the second treatment plan, image-guided and treated treatment is performed on the target object.

[0058] On the other hand, the present application also provides a computer device, the computer device comprising:

[0059] one or more processors;

[0060] Memory; and

[0061] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the medical image processing method according to any one of the first aspects.

[0062] On the other hand, the present application also provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program is loaded by a processor to execute the steps in the medical image processing method described in any one of the first aspects.

[0063] The present application obtains the current image processing mode of the medical device; obtains the medical image of the target object; and performs image processing on the medical image based on the current image processing mode. Since the image processing mode of the medical device includes an image diagnosis mode, a treatment plan formulation mode, and a treatment mode, the same medical device can realize the functions of multiple medical devices in the prior art, such as diagnosis, treatment plan specification, image-guided treatment, etc., thereby improving the utilization rate of the medical device, reducing the equipment procurement cost and patient treatment cost, and saving the patient's treatment time. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0065] Figure 1 is a schematic diagram of a scenario of a medical image reconstruction system provided in an embodiment of the present application;

[0066] Figure 2 is a schematic flow chart of an embodiment of a medical image processing method provided in an embodiment of the present application;

[0067] Figure 3 In the embodiment of the present application Figure 2 A schematic flow chart of another embodiment of a medical image processing method based on the illustrated embodiment;

[0068] Figure 4is a schematic diagram of the structure of an embodiment of a medical image processing device provided in an embodiment of the present application;

[0069] Figure 5 It is a schematic diagram of the structure of an embodiment of a computer device provided in the embodiments of the present application. DETAILED DESCRIPTION

[0070] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0071] In the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, which are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present application. In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the said features. In the description of the present application, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.

[0072] In this application, the word "exemplary" is used to mean "used as an example, illustration, or description." Any embodiment described in this application as "exemplary" is not necessarily to be construed as being preferred or advantageous over other embodiments. The following description is given to enable any technician in the field to implement and use the present application. In the following description, details are listed for the purpose of explanation. It should be understood that a person of ordinary skill in the art can recognize that the present application can be implemented without using these specific details. In other instances, well-known structures and processes will not be elaborated in detail to avoid obscuring the description of the present application with unnecessary details. Therefore, the present application is not intended to be limited to the embodiments shown, but is consistent with the widest scope consistent with the principles and features disclosed in the present application.

[0073] It should be noted that since the method of the embodiment of the present application is executed in a computer device, the processing objects of each computer device exist in the form of data or information. For example, time is actually time information. It can be understood that if size, quantity, position, etc. are mentioned in subsequent embodiments, they are all corresponding data for processing by the computer device. The details will not be repeated here.

[0074] The following first introduces some basic concepts involved in the embodiments of the present application:

[0075] Iterative reconstruction technology: Use a series of approximate calculations to gradually approach the image. Before the image reconstruction begins, it is assumed that the image is of uniform density. Each step of reconstructing the image is to compare the calculated projection of the reconstructed image in the previous step with the projection obtained by actual measurement, and use the difference between the actual projection and the calculated projection to correct the image. Each step makes the image closer to the original object, and a satisfactory image can be obtained after several corrections. Its disadvantage is that the computational workload is extremely large.

[0076] Electronic Portal Imaging System: Also known as Electronic Portal Imaging Device, or EPID, it is a tool that uses electronic technology to obtain images in the direction of the radiation emission when the radiation beam irradiates the target area. EPID based on amorphous silicon flat panel detectors can obtain better imaging with less dose, and has the advantages of small size, high resolution, high sensitivity, and wide range of influence. It is also a fast two-dimensional dose measurement system that can not only calibrate and verify the size, shape, position and patient positioning of the field offline, but also directly measure the dose in the field.

[0077] Image-guided Radiation Therapy: Image-guided Radiation Therapy (IGRT) is a four-dimensional radiotherapy technology that uses various advanced imaging devices to monitor tumors and normal organs in real time before and during treatment. It adds the concept of time factor to the three-dimensional radiotherapy technology, fully considering the movement of anatomical tissues during treatment and the displacement errors between fractionated treatments, such as breathing and peristalsis, daily positioning errors, target area shrinkage, etc., which cause changes in radiotherapy dose distribution and the impact on treatment plans. It can also adjust treatment conditions according to changes in organ position so that the irradiation field closely "follows" the target area.

[0078] Image Registration: Image Registration is the process of matching and superimposing two or more images acquired at different times, with different sensors (imaging equipment) or under different conditions (weather, illumination, camera position and angle, etc.). It is widely used in remote sensing data analysis, computer vision and image processing. Medical image registration refers to seeking a (or a series of) spatial transformations for a medical image so that it is spatially consistent with the corresponding points on another medical image. This consistency means that the same anatomical point on the human body has the same spatial position on the two matching images. The result of the registration should match all anatomical points on the two images, or at least all points of diagnostic significance and points of surgical interest.

[0079] Region Of Interest (ROI): In machine vision and image processing, the area to be processed is outlined in the image in the form of a box, circle, ellipse, irregular polygon, etc. This is called the ROI. Various operators and functions are often used in machine vision software such as Halcon, OpenCV, and Matlab to obtain the ROI and perform the next step of image processing.

[0080] The embodiments of the present application provide a medical image processing method, apparatus, computer device, and storage medium, which are described in detail below.

[0081] See also Figure 1 , Figure 1 This is a scene diagram of a medical image reconstruction system provided in an embodiment of the present application. The medical image reconstruction system may include a computer device 100 and a medical device 200. The computer device 100 is communicatively connected with the medical device 200. Medical data (such as actual projection data) collected by the medical device 200 may be transmitted to the computer device 100. A medical image processing device is integrated in the computer device 100.

[0082] In the embodiment of the present application, the computer device 100 is mainly used to obtain the current image processing mode of the medical device; obtain the medical image of the target object; and perform image processing on the medical image based on the current image processing mode.

[0083] In the embodiment of the present application, the computer device 100 may be an independent server, or a server network or server cluster composed of servers. For example, the computer device 100 described in the embodiment of the present application includes but is not limited to a computer, a network host, a single network server, a plurality of network server sets or a cloud server composed of a plurality of servers. The cloud server is composed of a large number of computers or network servers based on cloud computing.

[0084] It is understandable that in the embodiment of the present application, the computer device 100 may also be a terminal, and the terminal may be a device including both receiving and transmitting hardware, that is, a device having receiving and transmitting hardware capable of performing two-way communication on a two-way communication link. Such a device may include: a cellular or other communication device having a single-line display or a multi-line display or a cellular or other communication device without a multi-line display. The specific terminal may be a desktop terminal, such as a desktop computer, etc.

[0085] Those skilled in the art will understand that Figure 1 The application environment shown in the figure is only one application scenario of the present application solution and does not constitute a limitation on the application scenario of the present application solution. Other application environments may also include Figure 1 More or less computer equipment as shown in Figure 1 Only one computer device is shown in the figure. It can be understood that the medical image reconstruction system may also include one or more other computer devices, which are not specifically limited here.

[0086] In addition, if Figure 1 As shown, the medical image reconstruction system may further include a memory 300 for storing medical data, such as medical images.

[0087] In the embodiment of the present application, the medical device 200 may be a CT device, a CBCT device or other medical devices, such as a positron emission tomography (PET-CT) device, etc., which is not limited here. Correspondingly, in the embodiment of the present application, the medical image described may refer to a CT image.

[0088] It should be noted that Figure 1 The scene diagram of the medical image reconstruction system shown is merely an example. The medical image reconstruction system and scene described in the embodiment of the present application are intended to more clearly illustrate the technical solution of the embodiment of the present application, and do not constitute a limitation on the technical solution provided in the embodiment of the present application. A person of ordinary skill in the art can appreciate that with the evolution of the medical image reconstruction system and the emergence of new business scenarios, the technical solution provided in the embodiment of the present application is equally applicable to similar technical problems.

[0089] First, a medical image processing method is provided in an embodiment of the present application. The executor of the medical image processing method is a medical image processing device. The medical image processing device is applied to a computer device. The medical image processing method includes: obtaining a current image processing mode of the medical device; obtaining a medical image of a target object; and performing image processing on the medical image based on the current image processing mode.

[0090] like Figure 2 FIG. 2 is a flow chart of an embodiment of a medical image processing method in an embodiment of the present application. The medical image processing method is applied to medical equipment. The medical image processing method includes the following steps 201 to 203:

[0091] 201. Obtain a current image processing mode of the medical device.

[0092] Among them, the medical device includes multiple image processing modes, and the image processing modes of the medical device may include image diagnosis mode, treatment plan formulation mode and treatment mode. It can be understood that based on different functions, the medical device can also include more image processing modes, which are not specifically limited here.

[0093] Medical equipment can be imaging equipment, or it can be an imaging equipment configured on a radiotherapy device. Furthermore, due to the integrated technology of cone beam CT technology, it already has the function of image guidance for treatment. If CBCT covers the functions of diagnostic CT and large-aperture CT used for treatment planning and simulation positioning in the existing technology, the functions 1)-3) in the background technology can be realized in the same device, so that the situation that originally required three sets of racks, beds and control systems is improved to only one set, which directly reduces the cost of equipment; the patient's diagnostic scan, plan formulation and simulation positioning scan are shared with the treatment image guidance scan, which greatly ensures the consistency of the three-stage scan, improves the overall diagnosis and treatment accuracy, and also facilitates patients and saves medical costs. Therefore, the medical equipment in this embodiment can be CBCT, which covers the functions of diagnostic CT and large-aperture CT used for treatment planning and simulation positioning in the existing technology through algorithms on the basis of CBCT.

[0094] When the medical device may be an imaging device, the imaging device may be a megavolt CBCT (MV-CBCT) or a kilovolt CBCT (KV-CBCT), which is not specifically limited here.

[0095] In the embodiment of the present application, obtaining the current image processing mode of the medical device may be: displaying multiple image processing modes supported by the medical devices, and obtaining the current image processing mode selected from the multiple image processing modes supported by the medical devices. Obtaining the current image processing mode of the medical device may also be: obtaining the current image processing mode input by the user.

[0096] In other embodiments of the present application, obtaining the current image processing mode of the medical device may also be: obtaining the user information of the target object, and determining the current image processing mode of the medical device based on the user information of the user. The user information of the target object may be the user's current treatment stage information, the image information taken by the user, the user's disease status information, etc. Based on this user information, the user's current treatment stage can be determined. For example, if there is no diagnosis record, it means that the user is not currently undergoing a diagnosis, and the image diagnosis mode can be directly determined. It should be noted that in the embodiments of the present application, the user information mentioned may be desensitized personal information or personal information after personal authorization.

[0097] 202. Obtain a medical image of the target object.

[0098] Among them, the target object can be any living body, such as a human or an animal, or a model of a human or an animal, etc. In this embodiment, the human body is taken as an example for explanation. When the target object is a human body, it can be a part of the human body or the entire human body, for example, it can be a tissue or organ of the human body, such as the head, or organs such as the lungs and liver.

[0099] In the embodiment of the present application, a medical image of the target object may be acquired by a medical device when scanning the target object once or multiple times.

[0100] It should be noted that, in the embodiments of the present application, the timing between obtaining the current image processing mode of the medical device in step 201 and obtaining the medical image of the target object in step 202 may not be limited. Figure 2 As shown, the current image processing mode of the medical device is obtained before the medical image of the target object is obtained. It can be understood that in some other embodiments of the present application, the medical image of the target object can also be obtained before the current image processing mode of the medical device is obtained, or the current image processing mode of the medical device and the medical image of the target object can be obtained at the same time. The specific details are not limited here.

[0101] 203. Perform image processing on the medical image based on the current image processing mode.

[0102] In an embodiment of the present application, the medical image may be processed based on the current image processing mode. Since the current image processing mode may have different possibilities, different processing methods may be used to process the medical image based on different possible current image processing modes.

[0103] In the embodiment of the present application, the current image processing mode of the medical device is obtained; the medical image of the target object is obtained; and the medical image is processed based on the current image processing mode. Since the image processing mode of the medical device includes an image diagnosis mode, a treatment plan formulation mode, and a treatment mode, the same medical device can realize the functions of multiple medical devices in the prior art, such as diagnosis, treatment plan designation, image-guided treatment, etc., thereby improving the utilization rate of the medical device, reducing the equipment procurement cost and patient treatment cost, and saving the patient's treatment time.

[0104] In the embodiments of the present application, different processing methods are used to process the medical image based on different possible current image processing modes, which are described below with examples.

[0105] (1) The current image processing mode is image diagnosis mode

[0106] In some embodiments of the present application, the performing image processing on the medical image based on the current image processing mode includes: if the current image processing mode is an image diagnosis mode, identifying the medical image to obtain a medical identification result of the medical image.

[0107] Among them, if the current image processing mode is the image diagnosis mode, there are also multiple ways to identify the medical image and obtain the medical recognition result of the medical image. One is manual diagnosis, and the other is diagnosis by medical equipment based on deep learning technology.

[0108] In the manual diagnosis and identification method, if the current image processing mode is the image diagnosis mode, the medical image is identified to obtain the medical identification result of the medical image, which may include: if the current image processing mode is the image diagnosis mode, displaying the medical image to the target user; obtaining the user's manual diagnosis information for the medical image; and using the manual diagnosis information as the medical identification result of the medical image.

[0109] In the method in which medical equipment performs diagnostic identification based on deep learning technology, the identifying the medical image to obtain the medical identification result of the medical image may include: identifying the medical image through a preset network model to obtain the medical identification result of the medical image.

[0110] Among them, deep learning technology can be a deep learning model framework used in medical image processing, mainly including:

[0111] SAE (stack auto-encoder): an unsupervised learning scheme that trains layer by layer to obtain feature descriptions.

[0112] RBM (restricted Boltzmann machine): an unsupervised learning scheme similar to SAE.

[0113] CNN (convolutional neural network): Convolutional neural network is the most widely used and can be used to extract image features or directly complete tasks such as classification and detection.

[0114] RNN (recurrent neural network): a recurrent neural network used to obtain time series information and is used in line-by-line scanning images such as CT.

[0115] U-net (with a single downsampling stage): Similar to a fully convolutional network with a short-cut, it is used to fuse features of images of different scales.

[0116] FCNN (fully convolutional neural network): Fully convolutional network, which can obtain images with the same resolution as the original image, and is often used for tasks such as segmentation.

[0117] FRCNN (Faster Region-proposal based neural network): A fast deep learning detection network framework, divided into two layers, RPN and RCNN, for detecting various objects in medical images.

[0118] Specifically, the use of deep learning technology for image diagnosis is an existing technology, and the details will not be elaborated here.

[0119] In the embodiment of the present application, since image diagnosis and simulated positioning scanning require a larger scanning range in the head and feet direction, a step scan of the bed is implemented based on the original single-circle scanning of CBCT. The bed can be scanned and reconstructed while moving forward, similar to spiral cone-beam CT reconstruction; or the bed stops in the first section to perform a single-circle cone-beam scan and reconstruction, and then moves to another position to perform another single-circle cone-beam CT scan and reconstruction, and then the images reconstructed from the two cone-beam CT scans are spliced ​​together.

[0120] Specifically, Figure 3 As shown, the step of acquiring a medical image of the target object may further include:

[0121] 301. Sequentially obtain a plurality of positioning scan images of the target object at a plurality of positioning positions along a treatment bed direction.

[0122] The treatment bed is a treatment bed in medical equipment for placing a target object, and each positioning position corresponds to a positioning scan image, that is, a single-circle cone beam scanning reconstruction is performed at each positioning position to obtain a positioning scan image.

[0123] Further, the sequentially acquiring multiple positioning scanning images of the target object at multiple positioning positions along the treatment bed direction includes: acquiring a single-circle scanning image scanning the target object at a first positioning position along the treatment bed direction; determining the next target positioning position along the treatment bed direction from the first positioning position according to a preset step length, and acquiring a single-circle scanning image scanning the target object at the target positioning position; after completing the target object scanning at multiple positioning positions, obtaining multiple positioning scanning images of the target object at multiple positioning positions along the treatment bed direction. The preset step length may be the step length of the treatment bed.

[0124] 302. Stitch the multiple positioning scan images together to obtain a medical image of the target object.

[0125] Specifically, the multiple positioning scan images are spliced ​​together to obtain the medical image of the target object. The multiple positioning scan images can be spliced ​​together using a registration technology to obtain the medical image of the target object.

[0126] Medical image registration technology refers to seeking one or a series of spatial transformations so that the image to be registered can be consistent with the corresponding points on the reference image at the corresponding positions after the spatial transformation. In other words, the purpose of registration is to match the corresponding points on the floating image and the reference image, at least the points that are of diagnostic significance to clinical medicine, so that the advantages of each image in information expression can be complementary. In clinical practice, doctors need to combine the shooting effects of different medical images when making a diagnosis of a patient's condition. Medical image registration is a prerequisite for doctors to make a correct diagnosis.

[0127] Medical image rigid registration technology is mainly applicable to the registration objects of rigid parts of tissues and organs that hardly deform within different time intervals, such as images of the human brain and medical images of bones. Ignoring the subtle changes in the skin of the human head, it can be assumed that the distance between any two points in the human brain images collected at different time intervals is fixed. Therefore, the rigid registration method can achieve mutual registration between the images to be registered in space. The core idea of ​​rigid registration is as follows: one of the images to be registered is set as a reference, called the standard image; the other image is spatially transformed based on the standard image, called the floating image. The rigid registration process can be decomposed into a series of rotation and translation operation steps. The floating image undergoes a series of transformations to achieve consistency in spatial position with the corresponding pixel points on the standard image.

[0128] It should be noted that, in the embodiment of the present application, the method of splicing the multiple positioning scan images to obtain the medical image of the target object can be a rigid registration method. Specifically, rigid registration requires a certain overlap ratio between the two registered images (which can be a preset overlap ratio), for example, the overlap ratio is above 20%.

[0129] (2) The current image processing mode is the treatment planning mode

[0130] The current image processing mode is the treatment plan formulation mode, which can be completed in one step from the diagnosis stage to the treatment plan formulation stage. That is, if the target object has an abnormality, the plan formulation will continue to be completed. If the target object does not have an abnormality, only the diagnosis stage will be performed in the treatment plan formulation mode. It can also be pre-diagnosed that the target object has an abnormality, and only the treatment plan will be formulated this time.

[0131] In some embodiments of the present application, when the target object has been diagnosed with an abnormality in advance and only a treatment plan is formulated this time, the medical image is processed based on the current image processing mode, including: if the current image processing mode is a treatment plan formulation mode, acquiring a simulated positioning image of the target object; and formulating a first treatment plan for the target object based on the simulated positioning image.

[0132] Among them, the pre-diagnosis of the target object with an abnormality may be a pre-diagnosis of the target object to obtain an abnormal result, and the abnormal result may be a positive result for cancer, or an abnormal result that directly displays the diagnosis of the disease (such as a certain cancer, etc.), or an abnormal result that is directly replaced by letters or numbers (such as A represents a normal result, and B represents an abnormal result). The specific way of expressing the abnormal result is not limited here.

[0133] Furthermore, formulating a first treatment plan for the target object according to the simulated positioning image includes: outlining according to the simulated positioning image to determine a medical contour of the target object; and formulating the first treatment plan for the target object based on the medical contour.

[0134] Among them, the method of contouring can be AI contouring (contouring using a neural network model) or manual contouring, which is not limited here. The specific means of implementing contouring and formulating a treatment plan based on medical contours are existing technologies and will not be described in detail here.

[0135] (3) The current image processing mode is treatment mode

[0136] In treatment mode, you can choose to perform real-time image guidance on the target object during treatment or not, which can be determined according to the actual scenario.

[0137] In some embodiments of the present application, the image processing of the medical image is performed based on the current image processing mode, including: if the current image processing mode is a treatment mode, obtaining a second treatment plan pre-formulated for the target object; based on the second treatment plan, performing image guidance and treatment on the target object.

[0138] The second treatment plan may be a treatment plan that has been previously formulated, such as the first treatment plan, or a treatment plan formulated in real time, in which case the second treatment plan is different from the first treatment plan. The method for formulating the second treatment plan for the target object in real time may refer to the implementation method of formulating the first treatment plan for the target object according to the simulated positioning image in the above embodiment.

[0139] Similarly, when the current image processing mode is the treatment mode, the treatment plan formulation stage-image guidance can be performed, that is, if the treatment mode is in the treatment mode, the treatment plan formulation stage + treatment stage can be performed; or it can be pre-diagnosed that the target object has an abnormality, and a treatment plan has been formulated, and only the treatment stage is performed this time. Specifically, the second treatment plan pre-formulated for the target object can be obtained, which can be the second treatment plan that has been formulated, or the treatment plan formulated on site this time.

[0140] Specifically, if the current image processing mode is a treatment mode, obtaining a second treatment plan pre-formulated for the target object may be: if the current image processing mode is a treatment mode, determining whether there is a treatment plan formulated for the target object; if there is a treatment plan for the target object, acquiring the formulated treatment plan; if there is no treatment plan for the target object, determining whether there is a simulated positioning image of the target object; if so, formulating a second treatment plan based on the simulated positioning image of the target object; if there is no simulated positioning image of the target object, and if the diagnosis result of the target object is an abnormal result (such as the abnormal result expression form described in the above embodiment), acquiring a simulated positioning image of the target object, and formulating a second treatment plan based on the acquired simulated positioning image of the target object.

[0141] Among them, the method of formulating the second treatment plan for the target object based on the existing or real-time simulated positioning image can refer to the implementation method of formulating the first treatment plan for the target object based on the simulated positioning image in the above embodiment, and the details are not repeated here.

[0142] Furthermore, the image-guided and treated target object includes: acquiring a medical image of the target object, and comparing it with a preset planned image to implement image-guided radiotherapy. The specific image-guided method can refer to the prior art and will not be described in detail here.

[0143] In order to better implement the medical image processing method in the embodiment of the present application, on the basis of the medical image processing method, a medical image processing device is also provided in the embodiment of the present application, which is applied to medical equipment. The image processing mode of the medical equipment includes an image diagnosis mode, a treatment plan formulation mode and a treatment mode, such as Figure 4 As shown, the medical image processing device 400 includes a first acquisition module 401, a second acquisition module 402 and a processing module 403:

[0144] A first acquisition module 401 is used to acquire the current image processing mode of the medical device;

[0145] A second acquisition module 402 is used to acquire a medical image of a target object;

[0146] The processing module 403 is used to perform image processing on the medical image based on the current image processing mode.

[0147] In the embodiment of the present application, the current image processing mode of the medical device is acquired by the first acquisition module 401; the medical image of the target object is acquired by the second acquisition module 402; and the processing module 403 performs image processing on the medical image based on the current image processing mode. Since the image processing mode of the medical device includes an image diagnosis mode, a treatment plan formulation mode, and a treatment mode, the same medical device can realize the functions of multiple medical devices in the prior art, such as diagnosis, designation of treatment plans, image-guided treatment, etc., thereby improving the utilization rate of the medical device, reducing the equipment procurement cost and patient treatment cost, and saving the patient's treatment time.

[0148] In some implementations of the present application, the processing module 403 is specifically used to:

[0149] If the current image processing mode is an image diagnosis mode, the medical image is identified to obtain a medical identification result of the medical image.

[0150] In some implementations of the present application, the processing module 403 is specifically used to:

[0151] If the current image processing mode is an image diagnosis mode, displaying the medical image to a target user;

[0152] Obtaining manual diagnosis information of the user for the medical image;

[0153] The artificial diagnosis information is used as the medical recognition result of the medical image.

[0154] In some implementations of the present application, the second acquisition module 402 is specifically used to:

[0155] Sequentially acquiring a plurality of positioning scan images of the target object at a plurality of positioning positions along the treatment bed direction, each positioning position corresponding to a positioning scan image;

[0156] The multiple positioning scan images are spliced ​​together to obtain a medical image of the target object.

[0157] In some implementations of the present application, the second acquisition module 402 is specifically used to:

[0158] At a first positioning position along the treatment bed direction, acquiring a single-circle scanning image of the target object;

[0159] According to a preset step length, determining the first positioning position at a target positioning position next to the treatment bed, and acquiring a single-circle scanning image of the target object at the target positioning position;

[0160] After the target object scan at multiple positioning positions is completed, multiple positioning scan images of the target object at multiple positioning positions along the treatment bed direction are obtained.

[0161] In some implementations of the present application, the processing module 403 is specifically used to:

[0162] If the current image processing mode is a treatment planning mode, acquiring a simulated positioning image of the target object;

[0163] A first treatment plan for the target object is formulated according to the simulated positioning image.

[0164] In some implementations of the present application, the processing module 403 is specifically used to:

[0165] Delineating the simulated positioning image to determine the medical contour of the target object;

[0166] Based on the medical profile, a first treatment plan for the target subject is formulated.

[0167] In some implementations of the present application, the processing module 403 is specifically used to:

[0168] If the current image processing mode is a treatment mode, obtaining a second treatment plan pre-formulated for the target object;

[0169] Based on the second treatment plan, image-guided and treated treatment is performed on the target object.

[0170] The embodiment of the present application further provides a computer device, which integrates any one of the medical image processing devices provided in the embodiment of the present application, and the computer device includes:

[0171] one or more processors;

[0172] Memory; and

[0173] One or more applications, wherein the one or more applications are stored in the memory and are configured to be executed by the processor to perform the steps of the medical image processing method described in any of the above-mentioned medical image processing method embodiments.

[0174] The present application also provides a computer device that integrates any medical image processing device provided in the present application. Figure 5 As shown, it shows a schematic diagram of the structure of the computer device involved in the embodiment of the present application, specifically:

[0175] The computer device may include one or more processing core processors 501, one or more computer-readable storage media memories 502, a power supply 503, an input unit 504 and other components. Those skilled in the art will appreciate that Figure 5 The computer device structure shown in the figure does not constitute a limitation on the computer device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently. Among them:

[0176] The processor 501 is the control center of the computer device. It uses various interfaces and lines to connect various parts of the entire computer device. By running or executing software programs and / or modules stored in the memory 502 and calling data stored in the memory 502, it executes various functions of the computer device and processes data, thereby monitoring the computer device as a whole. Optionally, the processor 501 may include one or more processing cores; preferably, the processor 501 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 501.

[0177] The memory 502 can be used to store software programs and modules. The processor 501 executes various functional applications and data processing by running the software programs and modules stored in the memory 502. The memory 502 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 502 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 502 may also include a memory controller to provide the processor 501 with access to the memory 502.

[0178] The computer device also includes a power supply 503 for supplying power to various components. Preferably, the power supply 503 can be logically connected to the processor 501 through a power management system, so as to manage charging, discharging, power consumption and other functions through the power management system. The power supply 503 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators and other arbitrary components.

[0179] The computer device may further include an input unit 504, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0180] Although not shown, the computer device may further include a display unit, etc., which will not be described in detail herein. Specifically in this embodiment, the processor 501 in the computer device will load the executable files corresponding to the processes of one or more application programs into the memory 502 according to the following instructions, and the processor 501 will run the application programs stored in the memory 502, thereby realizing various functions, as follows:

[0181] Acquire a current image processing mode of the medical device; acquire a medical image of a target object; and perform image processing on the medical image based on the current image processing mode.

[0182] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0183] To this end, an embodiment of the present application provides a computer-readable storage medium, which may include: a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc. A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps in any medical image processing method provided in the embodiment of the present application. For example, the computer program can be loaded by a processor to execute the following steps:

[0184] Acquire a current image processing mode of the medical device; acquire a medical image of a target object; and perform image processing on the medical image based on the current image processing mode.

[0185] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the detailed description of other embodiments above, and will not be repeated here.

[0186] In specific implementation, the above units or structures can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation of the above units or structures can refer to the previous method embodiments, which will not be repeated here.

[0187] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0188] The above is a detailed introduction to a medical image processing method, device, computer equipment and storage medium provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the ideas of the present application, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A computer device, characterized in that: comprising one or more processors; a memory; and one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement a medical image processing method; The medical image processing method is applied to medical equipment, the medical equipment includes a kilovoltage cone beam CT, the image processing mode of the medical equipment includes an image diagnosis mode, a treatment plan formulation mode and a treatment mode, and the medical image processing method includes: obtaining a current image processing mode of the medical device; Acquiring a medical image of a target object using the kilovoltage cone-beam CT; Based on the current image processing mode, performing image processing on the medical image includes: If the current image processing mode is an image diagnosis mode, the medical image is identified to obtain a medical identification result of the medical image to determine whether the target object has an abnormality; If the current image processing mode is a treatment plan formulation mode, acquiring a simulated positioning image of the target object; and formulating a first treatment plan for the target object according to the simulated positioning image; If the current image processing mode is a treatment mode, obtaining a second treatment plan pre-formulated for the target object; performing image guidance and treatment on the target object based on the second treatment plan; wherein the second treatment plan is the first treatment plan or a treatment plan different from the first treatment plan formulated in real time; Wherein, acquiring the current image processing mode of the medical device comprises: acquiring user information of the target object, and determining the current image processing mode of the medical device based on the user information; If the current image processing mode is a treatment plan making mode, if the target object does not have an abnormality, only the diagnosis stage is performed in the treatment plan making mode; if the target object is pre-diagnosed to have an abnormality, only the treatment plan is made in the treatment plan making mode; Acquiring a second treatment plan pre-formulated for the target object includes: if there is a treatment plan formulated for the target object, acquiring the formulated treatment plan; if there is no formulated treatment plan but there is the simulated positioning image, formulating the second treatment plan according to the simulated positioning image; if there is no formulated treatment plan and the simulated positioning image, and the diagnosis result of the target object is abnormal, acquiring the simulated positioning image, and formulating the second treatment plan according to the simulated positioning image.

2. The computer device according to claim 1, characterized in that If the current image processing mode is an image diagnosis mode, identifying the medical image to obtain a medical identification result of the medical image includes: If the current image processing mode is an image diagnosis mode, displaying the medical image to a target user; Obtaining manual diagnosis information of the user for the medical image; The artificial diagnosis information is used as the medical recognition result of the medical image.

3. The computer device according to claim 2, characterized in that The step of acquiring a medical image of the target object comprises: Sequentially acquiring a plurality of positioning scan images of the target object at a plurality of positioning positions along the treatment bed direction, each positioning position corresponding to a positioning scan image; The multiple positioning scan images are spliced ​​together to obtain a medical image of the target object.

4. The computer device according to claim 3, characterized in that The step of sequentially acquiring a plurality of positioning scan images of the target object at a plurality of positioning positions along the treatment bed direction includes: At a first positioning position along the treatment bed direction, acquiring a single-circle scanning image of the target object; According to a preset step length, determining the first positioning position at a target positioning position next to the treatment bed, and acquiring a single-circle scanning image of the target object at the target positioning position; After the target object scan at multiple positioning positions is completed, multiple positioning scan images of the target object at multiple positioning positions along the treatment bed direction are obtained.

5. The computer device according to claim 1, characterized in that Formulating a first treatment plan for the target object according to the simulated positioning image includes: Delineating the simulated positioning image to determine the medical contour of the target object; Based on the medical profile, a first treatment plan for the target subject is formulated.

6. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps of the medical image processing method implemented when the processor in the computer device according to any one of claims 1 to 5 executes the computer program.

Images