Lesion morphology determination and medical image analysis method and system

Abstract

The disclosure provides a lesion shape determination and medical image analysis method and system, and relates to the technical field of medical image analysis. The lesion shape determination method comprises the following steps: determining a lesion mask processing image corresponding to each lesion in a lesion mask image of a medical image of a preset part; extracting a plurality of lesion mask position coordinates corresponding to a lesion mask line in the lesion mask processing image corresponding to each lesion respectively; fitting or reconstructing the plurality of lesion mask position coordinates corresponding to each lesion respectively to determine a lesion shape corresponding to each lesion. The embodiment of the disclosure can realize lesion shape determination and medical image analysis.

Description

Technical Field

[0001] This disclosure relates to the field of medical image analysis technology, and in particular to a method and system for determining lesion morphology and analyzing medical images. Background Technology

[0002] The description of lesion morphology in imaging is one of the core contents of imaging diagnostic reports. It is used to accurately depict the geometric shape and structural features of lesions, providing an important basis for clinical diagnosis.

[0003] Round / quasi-round lesions, with regular borders and an approximate spherical shape, are commonly seen in benign tumors and cysts. For example, liver cysts and kidney cysts often present as round or quasi-round lesions. Wedge-shaped lesions, triangular or wedge-shaped with the apex pointing in a certain direction, are often seen in ischemic lesions such as pulmonary infarction and hepatic infarction. Linear / linear lesions, long and narrow, resembling lines, are commonly seen in vascular lesions, scar tissue, or the pathways of inflammatory spread. For example, linear shadows in the lungs may indicate old inflammation. Reticulated lesions, composed of multiple small holes or lines interwoven into a grid pattern, are often seen in interstitial lung disease and liver fibrosis. Irregular lesions, with irregular borders and diverse shapes, are commonly seen in malignant tumors, inflammation, or complex lesions. For example, lung cancer often presents as an irregular mass. Lobulated lesions, with an uneven, multi-arc outline resembling lobes, are often seen in malignant tumors (such as lung cancer and liver cancer), suggesting uneven tumor growth. Spiculated lesions, with fine spiculations at the edges, indicate tumor cell infiltration into surrounding tissues and are commonly seen in malignant tumors such as lung cancer and breast cancer. Crab-like / creeping lesions, with protruding edges resembling crab legs or creeping lesions, are frequently seen in choroidal neovascularization and certain malignant tumors. Ring-shaped / circular lesions, with a dark center and a surrounding ring of fluorescence or increased density, are commonly seen in choroidal neovascularization and cystic edema. Patchy / patch-like lesions, covering a large area with indistinct borders, are often seen in inflammatory, exudative lesions, or interstitial lung diseases. Clustered / aggregated lesions, with multiple small lesions clustered together, are commonly seen in multifocal origins of infection, inflammation, or tumors. Conformal lesions, where lesions grow along certain anatomical structures (such as blood vessels, bronchi, and cerebral sulci), suggest the relationship between the lesion and surrounding tissues.

[0004] Therefore, based on the above analysis, determining the morphology of imaging lesions is particularly important for the diagnosis and treatment of diseases. However, the existing method of manually determining the morphology of lesions has at least one of the following technical problems: it is too subjective, lacks intelligence, results in a huge workload for doctors, and prevents further surgical procedures and prediction of lymph node metastasis in some solid lung adenocarcinomas. Summary of the Invention

[0005] This disclosure presents a technical solution for a method and system for determining lesion morphology and analyzing medical images.

[0006] According to one aspect of this disclosure, a method for determining lesion morphology is provided, comprising: determining a lesion mask processing image corresponding to each lesion in a lesion mask image of a medical image of a preset location; extracting multiple lesion mask position coordinates corresponding to lesion mask lines in the lesion mask processing image corresponding to each lesion; and fitting or reconstructing the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion.

[0007] Preferably, the step of fitting or reconstructing the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology includes: approximating multiple preset closed curve equations or multiple preset closed surface equations using the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion.

[0008] Preferably, the step of approximating a preset closed curve equation or a preset closed surface equation using the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion includes: under the optimal criterion, minimizing the error or absolute residual between the approximation equation and the multiple preset closed curve equation or multiple preset closed surface equation when the multiple lesion mask position coordinates corresponding to each lesion approximate the multiple preset closed curve equation or multiple preset closed surface equation, thereby determining the lesion morphology corresponding to each lesion.

[0009] Preferably, the step of approximating a preset closed curve equation or a preset closed surface equation using the multiple lesion mask position coordinates corresponding to each lesion under the optimal criterion to determine the lesion morphology corresponding to each lesion includes: if the preset site medical image is configured as a two-dimensional medical image, then under the optimal criterion, approximating multiple preset closed curve equations using the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion; if the preset site medical image is configured as a three-dimensional medical image, then under the optimal criterion, approximating multiple preset closed surface equations using the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion.

[0010] Preferably, determining the lesion masking image includes: performing an erosion operation on the lesion masking image to obtain a lesion mask erosion image; and subtracting the lesion mask erosion image from the lesion masking image to obtain the lesion masking image.

[0011] Preferably, before determining the lesion mask image corresponding to the lesion in the lesion mask image of the medical image of the preset location, the method includes: using a preset lesion segmentation model constructed based on a deep learning segmentation network to segment the lesion in the medical image of the preset location, and determining the lesion mask image of the medical image of the preset location.

[0012] Preferably, the lesion morphology determination method is characterized by further comprising: determining a lesion mask processing image corresponding to each lesion in a lesion mask image of a preset medical image; judging the lesion morphology in the lesion mask processing image corresponding to each lesion; if the lesion morphology is irregular, determining whether there are lesion lobes in the lesion mask processing image corresponding to each lesion.

[0013] Preferably, each lesion in the medical image of the preset location is subjected to target detection of lesion vacuolation sign, and the lesion corresponding to the detected lesion vacuolation sign is configured as having lesion vacuolation sign.

[0014] According to one aspect of this disclosure, a medical image analysis method is provided, comprising: acquiring multi-time dynamic chest X-ray images during the respiratory process corresponding to the medical image of the preset site; using the lesion morphology determination method described above, determining the nodule morphology corresponding to each lesion on the dynamic chest X-ray image at each time moment in the multi-time dynamic chest X-ray images; using the preset nodule regularity morphology and the nodule morphology corresponding to each lesion on the dynamic chest X-ray image at each time moment, determining irregular nodules on the dynamic chest X-ray image at each time moment that do not meet the preset nodule regularity morphology; and using the irregular nodules on the dynamic chest X-ray image at each time moment that do not meet the preset nodule regularity morphology, determining the nodule movement trajectory corresponding to each irregular nodule during the respiratory process.

[0015] According to one aspect of this disclosure, a medical image analysis method is provided, which uses the lesion morphology determination method described above to determine the lesion morphology corresponding to each lesion in the medical image of the preset location; and predicts preset chest diseases related to nodules based on the quantitative imaging features of the preset nodules to be selected, including the proportion of solid nodules.

[0016] Preferably, the step of predicting nodule-related preset chest diseases based on the quantitative imaging features of the preset nodules corresponding to the proportion of solid nodules includes: selecting the quantitative imaging features of the preset nodules corresponding to the proportion of solid nodules to obtain the quantitative imaging features of preset nodules corresponding to preset chest diseases; and predicting nodule-related preset chest diseases based on the quantitative imaging features of preset nodules corresponding to preset chest diseases.

[0017] Preferably, the selected preset quantitative imaging features of the nodule further include one or more of the following: nodule long diameter, whether the nodule edge is clear, the proportion of solid nodules, nodule spinous process sign, nodule lobulation sign, nodule air bronchus sign, and nodule cavitation sign.

[0018] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a first determination unit, configured to determine a lesion mask processing image corresponding to each lesion in a lesion mask image of a medical image of a preset location; an extraction unit, configured to extract multiple lesion mask position coordinates corresponding to lesion mask lines in the lesion mask processing image corresponding to each lesion; and a second determination unit, configured to fit or reconstruct the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion.

[0019] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a first determining unit, configured to determine a lesion mask processing image corresponding to each lesion in a lesion mask image of a medical image of a preset location; an extraction unit, configured to extract multiple lesion mask position coordinates corresponding to lesion mask lines in the lesion mask processing image corresponding to each lesion; a second determining unit, configured to fit or reconstruct the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion; a judging unit, configured to judge the lesion morphology in the lesion mask processing image corresponding to each lesion; and if the lesion morphology is irregular, a third determining unit, configured to determine whether lesion lobulation sign exists based on the lesion mask processing image corresponding to each lesion.

[0020] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a first determination unit, configured to determine a lesion mask processing image corresponding to each lesion in a lesion mask image of a medical image of a preset location; an extraction unit, configured to extract multiple lesion mask position coordinates corresponding to lesion mask lines in the lesion mask processing image corresponding to each lesion; a second determination unit, configured to fit or reconstruct the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion; and a detection unit, configured to perform lesion vacuolation target detection on each lesion in the medical image of the preset location, and configure lesions corresponding to detected lesion vacuolation as having lesion vacuolation.

[0021] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a first determining unit, configured to determine a lesion mask processing image corresponding to each lesion in a lesion mask image of a medical image of a preset location; an extraction unit, configured to extract multiple lesion mask position coordinates corresponding to lesion mask lines in the lesion mask processing image corresponding to each lesion; a second determining unit, configured to fit or reconstruct the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion; a judging unit, configured to judge the lesion morphology in the lesion mask processing image corresponding to each lesion; if the lesion morphology is irregular, a third determining unit, configured to determine whether there is a lesion lobulation sign based on the lesion mask processing image corresponding to each lesion; and a detection unit, configured to perform lesion vacuolation sign target detection on each lesion in the medical image of the preset location, and configure the lesions corresponding to the detected lesion vacuolation sign as having a lesion vacuolation sign.

[0022] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke the instructions stored in the memory to execute the lesion morphology determination method described above.

[0023] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a computer-readable storage medium having a computer program / instructions and a bit stream stored thereon, wherein the computer program / instructions, when executed by a processor, implement the above-described lesion morphology determination method to generate the bit stream.

[0024] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a computer program product configured with a computer program / instruction, which, when executed by a processor, implements the aforementioned lesion morphology determination method.

[0025] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a first determination unit, configured to determine a lesion mask processing image corresponding to each lesion in a lesion mask image of a preset medical image; an extraction unit, configured to extract multiple lesion mask position coordinates corresponding to lesion mask lines in the lesion mask processing image corresponding to each lesion; a second determination unit, configured to fit or reconstruct the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion; and a prediction unit, configured to predict preset chest diseases related to nodules based on quantitative imaging features of preset nodules to be selected, including the proportion of solid nodules.

[0026] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a first determination unit, configured to determine a lesion mask processing image corresponding to each lesion in a dynamic chest X-ray image at each time moment in a multi-time dynamic chest X-ray image; an extraction unit, configured to extract multiple lesion mask position coordinates corresponding to lesion mask lines in the lesion mask processing image corresponding to each lesion; a second determination unit, configured to fit or reconstruct the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion; a fourth determination unit, configured to determine irregular nodules on the dynamic chest X-ray image at each time moment that do not meet the preset nodule regularity morphology using a preset nodule regularity morphology and the nodule morphology corresponding to each lesion in the dynamic chest X-ray image at each time moment; and a fifth determination unit, configured to determine the nodule movement trajectory corresponding to each irregular nodule during the respiratory process using the irregular nodules on the dynamic chest X-ray image at each time moment that do not meet the preset nodule regularity morphology.

[0027] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke the instructions stored in the memory to execute the aforementioned medical image analysis method.

[0028] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a computer-readable storage medium having a computer program / instructions and a bit stream stored thereon, wherein the computer program / instructions, when executed by a processor, implement the above-described medical image analysis method to generate the bit stream.

[0029] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a computer program product configured with a computer program / instruction, which, when executed by a processor, implements the aforementioned medical image analysis method.

[0030] In this disclosure, a technical solution is proposed for a method and system for determining lesion morphology and analyzing medical images. This solution addresses at least one of the technical problems in existing methods, such as the need for manual determination of lesion morphology, which is too subjective, lacks intelligent determination of lesion morphology, results in a huge workload for doctors, and prevents further surgical procedures and prediction of lymph node metastasis in some solid lung adenocarcinomas.

[0031] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure.

[0032] Other features and aspects of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0033] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the specification, serve to illustrate the technical solutions of this disclosure.

[0034] Figure 1 A flowchart illustrating a method for determining lesion morphology according to an embodiment of the present disclosure is shown; Figure 2 A first flowchart of a chest medical image analysis method according to an embodiment of the present disclosure is shown; Figure 3 A second flowchart of a chest medical image analysis method according to an embodiment of the present disclosure is shown. Detailed Implementation

[0035] Various exemplary embodiments, features, and aspects of this disclosure will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.

[0036] The term “exemplary” as used herein means “serving as an example, embodiment, or illustration.” Any embodiment illustrated herein as “exemplary” is not necessarily to be construed as superior to or better than other embodiments.

[0037] In this document, the term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. Furthermore, the term "at least one" in this document means any combination of at least two of any one or more elements. For example, including at least one of A, B, and C can mean including any one or more elements selected from the set consisting of A, B, and C.

[0038] Furthermore, to better illustrate this disclosure, numerous specific details are set forth in the following detailed description. Those skilled in the art will understand that this disclosure can be practiced without certain specific details. In some instances, methods, means, components, and circuits well known to those skilled in the art have not been described in detail in order to highlight the main points of this disclosure.

[0039] It is understood that the various method embodiments mentioned above in this disclosure can be combined with each other to form combined embodiments without violating the principle and logic. Due to space limitations, this disclosure will not elaborate further.

[0040] In addition, this disclosure also provides a lesion morphology determination system and / or a chest medical image analysis system, electronic devices, computer-readable storage media, and program products, all of which can be used to implement any of the lesion morphology determination methods and / or chest medical image analysis methods provided in this disclosure. The corresponding technical solutions and descriptions are described in the relevant section on lesion morphology determination methods and / or chest medical image analysis methods, and will not be repeated here.

[0041] Figure 1 A flowchart illustrating a method for determining lesion morphology according to an embodiment of this disclosure is shown. Figure 1 As shown, the lesion morphology determination method includes: Step S1: Determining the lesion mask processing image corresponding to each lesion in the lesion mask image of a preset medical image; Step S2: Extracting multiple lesion mask position coordinates corresponding to the lesion mask lines in the lesion mask processing image corresponding to each lesion; Step S3: Fitting or reconstructing the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion. This addresses at least one of the technical problems of existing methods that require manual determination of lesion morphology, resulting in excessive subjectivity, a lack of intelligent lesion morphology determination leading to a huge workload for doctors, and the inability to further guide surgery or predict lymph node metastasis in some solid lung adenocarcinomas.

[0042] In the embodiments disclosed herein and other possible embodiments, the preset site medical image may be configured as one or more of the following medical images: chest X-ray image / chest CT image / chest PET image / chest MRI image, knee joint X-ray image / knee joint CT image / knee joint PET knee image / knee joint MRI image, spine X-ray image / spine CT image / spine PET image / spine MRI image, breast X-ray image / breast CT image / breast PET image / breast MRI image, abdomen X-ray image / abdomen CT image / abdomen PET image / abdomen MRI image, vertebral body X-ray / vertebral body CT abdominal / vertebral body PET abdominal / vertebral body MRI image, breast ultrasound image, and abdominal ultrasound image.

[0043] In the embodiments disclosed herein and other possible embodiments, the lesion corresponding to the preset site medical image is configured as one or more of the following lesions on the medical image: lung nodules, lung cancer, liver cancer, breast cancer, lipoma, fibroma, hamartoma, etc.

[0044] In this embodiment of the disclosure, the step of fitting or reconstructing the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology includes: under the optimal criterion, approximating multiple preset closed curve equations or multiple preset closed surface equations using the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion.

[0045] In this embodiment of the disclosure, the step of approximating a preset closed curve equation or a preset closed surface equation using the multiple lesion mask position coordinates corresponding to each lesion under the optimal criterion, and determining the lesion morphology corresponding to each lesion, includes: under the optimal criterion, minimizing the error or absolute residual between the approximation equations when the multiple lesion mask position coordinates corresponding to each lesion approximate the multiple preset closed curve equations or multiple preset closed surface equations and the multiple near-preset closed curve equations or multiple preset closed surface equations, and determining the lesion morphology corresponding to each lesion.

[0046] In this embodiment of the disclosure, the step of approximating a preset closed curve equation or a preset closed surface equation using the position coordinates of multiple lesion mask corresponding to each lesion under the optimal criterion to determine the lesion morphology corresponding to each lesion includes: if the medical image of the preset site is configured as a two-dimensional medical image, then under the optimal criterion, approximating multiple preset closed curve equations using the position coordinates of multiple lesion mask corresponding to each lesion to determine the lesion morphology corresponding to each lesion; if the medical image of the preset site is configured as a three-dimensional medical image, then under the optimal criterion, approximating multiple preset closed surface equations using the position coordinates of multiple lesion mask corresponding to each lesion to determine the lesion morphology corresponding to each lesion.

[0047] In the embodiments disclosed herein and other possible embodiments, the optimal criterion is configured as one or more of the least squares criterion, the minimum absolute residual criterion, etc.

[0048] In the embodiments of this disclosure and other possible embodiments, the optimal criterion is configured as the least squares method criterion. Then, after minimizing the error between the approximation equation and the lesion mask position coordinates of the multiple lesion mask position coordinates corresponding to each lesion when approximating multiple preset closed curve equations or multiple preset closed surface equations, the multiple lesion morphologies corresponding to each lesion are obtained. The lesion mask position coordinate errors corresponding to the multiple lesion morphologies are extracted respectively. The lesion morphology with the smallest error among the multiple lesion mask position coordinate errors is configured as the final lesion morphology corresponding to each lesion.

[0049] In the embodiments of this disclosure and other possible embodiments, the optimal criterion is configured as the least squares criterion. Then, after minimizing the absolute residuals of the lesion mask position coordinates between the approximation equations and the multiple near-preset closed curve equations or multiple preset closed surface equations when the multiple lesion mask position coordinates corresponding to each lesion are approximated, the multiple lesion morphologies corresponding to each lesion are obtained. The absolute residuals of the lesion mask position coordinates corresponding to the multiple lesion morphologies are extracted respectively. The lesion morphology corresponding to the lesion mask position coordinates with the smallest error in the absolute residuals of the multiple lesion morphologies is configured as the final lesion morphology corresponding to each lesion.

[0050] In the embodiments disclosed herein and other possible embodiments, the preset closed curve equation is configured as one or more of the two-dimensional closed curves corresponding to a first-order polynomial, a second-order polynomial, or a higher-order polynomial, which are used in polynomial fitting. For example, the preset closed curve equation is configured as a closed curve corresponding to a circle, ellipse, or conic section, a closed curve enclosed by line segments corresponding to a triangle, quadrilateral, pentagon, or hexagon, a spline curve, or a polyline closed curve, etc.

[0051] In the embodiments of this disclosure and other possible embodiments, the preset closed surface equation is configured as a bivariate polynomial or a multivariate polynomial. For example, the preset closed surface equation is configured as a closed surface formed by connecting the beginning and end of line segments, such as a circular surface, elliptical surface, conical surface, triangular surface, quadrilateral surface, pentagonal surface, hexagonal surface, etc., corresponding to a closed surface formed by basic geometric closed surfaces, or a closed surface composed of multiple surfaces.

[0052] In this embodiment of the disclosure, determining the lesion mask processing image includes: performing an erosion operation on the lesion mask image to obtain a lesion mask erosion image; and subtracting the lesion mask erosion image from the lesion mask image to obtain a lesion mask processing image. Prior to determining the lesion mask processing image corresponding to the lesion in the lesion mask image of the preset location medical image, the method includes: using a preset lesion segmentation model constructed based on a deep learning segmentation network to segment the lesion in the preset location medical image, thereby determining the lesion mask image of the preset location medical image.

[0053] In the embodiments of this disclosure and other possible embodiments, before segmenting lesions in medical images of preset locations using a preset segmentation model constructed based on a deep learning segmentation network, the method includes: training a preset deep learning segmentation network using a preset number of medical images of preset locations and their corresponding lesion mask training images to obtain a preset lesion segmentation model constructed based on the deep learning segmentation network. Specifically, before training the preset deep learning segmentation network using a preset number of medical images of preset locations and their corresponding lesion mask training images to obtain the preset lesion segmentation model constructed based on the deep learning segmentation network, the method includes: using segmentation annotation software to delineate lesions in a preset number of medical images of preset locations to obtain corresponding lesion mask training images.

[0054] In the embodiments of this disclosure and other possible embodiments, before training a preset deep learning segmentation network using a preset number of preset site medical images and their corresponding lesion mask training images to obtain a preset segmentation model constructed based on the deep learning segmentation network, the method includes: using segmentation annotation software CasiaLabeler or Labelme to delineate lesions on the preset number of preset site medical images to obtain corresponding lesion mask training images. Those skilled in the art can configure the preset number according to actual needs. For example, the preset number can be configured as 300-500.

[0055] In the embodiments disclosed herein and other possible embodiments, the preset deep learning segmentation network is configured as one or more deep learning segmentation networks such as Fully Convolutional Network (FCN), U-Net, DeepLab, and Pyramid Spatial Pooling Network (PSPNet).

[0056] In this embodiment of the disclosure, the lesion morphology determination method further includes: determining a lesion mask processing image corresponding to each lesion in a lesion mask image of a preset medical image; judging the lesion morphology in the lesion mask processing image corresponding to each lesion; if the lesion morphology is irregular, determining whether there is a lesion lobulation sign in the lesion mask processing image corresponding to each lesion.

[0057] In the embodiments of this disclosure and other possible embodiments, the step of judging the lesion morphology in the lesion mask processing image corresponding to each lesion includes: extracting multiple lesion mask position coordinates corresponding to the lesion mask lines in the lesion mask processing image corresponding to each lesion; fitting or reconstructing the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion; and determining whether the lesion morphology is regular based on the lesion morphology corresponding to each lesion.

[0058] In the embodiments of this disclosure and other possible embodiments, the step of processing the image based on the lesion mask corresponding to each lesion to determine whether there is lesion lobulation includes: extracting the lesion mask line corresponding to each lesion respectively; if the shape of the lesion mask line is an arc-shaped protrusion connected together, then the corresponding lesion has lesion lobulation; otherwise, there is no lesion lobulation.

[0059] In the embodiments of this disclosure and other possible embodiments, the step of processing the image based on the lesion mask corresponding to each lesion to determine whether there is a lobulation sign of the lesion further includes: segmenting the lesion mask line according to its concave part to obtain multiple arc-shaped convex line segments; determining whether the arc-shaped convex is a tip based on the slope corresponding to each pixel in the multiple arc-shaped convex line segments; if it is a tip, the corresponding lesion does not have a lobulation sign and the lesion has a spiky sign; if there is no tip, the corresponding lesion has a lobulation sign.

[0060] In the embodiments of this disclosure and other possible embodiments, determining whether the arc-shaped protrusion is a tip based on the slope corresponding to each pixel point in the multiple arc-shaped protrusion segments includes: mapping the multiple arc-shaped protrusion segments to a Cartesian coordinate system, wherein the coordinate point corresponding to the arc-shaped protrusion of the multiple arc-shaped protrusion segments is the highest pixel point of the arc-shaped protrusion segment in the Cartesian coordinate system; calculating the left derivative and right derivative corresponding to the highest pixel point; if the difference between the left derivative and the right derivative is less than or equal to a set difference, then the arc-shaped protrusion is determined to be a tip; otherwise, the arc-shaped protrusion is determined to be a non-tip.

[0061] In this embodiment of the disclosure, the lesion morphology determination method further includes: performing lesion vacuolation target detection on each lesion in a medical image of a preset location, and configuring the lesion corresponding to the detected lesion vacuolation as having lesion vacuolation.

[0062] Specifically, in the embodiments of this disclosure and other possible embodiments, after performing target detection of lesion vacuolation in each lesion in the medical image of the preset site, and configuring the lesion corresponding to the detected lesion vacuolation as having lesion vacuolation, the method further includes: extracting the lesion edge pixel values ​​corresponding to the lesions for which lesion vacuolation was not detected; and determining whether the lesions for which lesion vacuolation was not detected have lesion vacuolation based on the average pixel value corresponding to the lesions for which lesion vacuolation was not detected and the corresponding lesion edge pixel value.

[0063] In the embodiments of this disclosure and other possible embodiments, the step of performing lesion cavitation target detection on each lesion in the medical image of the preset location includes: using a lesion cavitation target detection model based on deep learning to perform lesion cavitation target detection on each lesion in the medical image of the preset location.

[0064] In the embodiments of this disclosure and other possible embodiments, before performing lesion cavitation target detection on each lesion in the preset site medical image using a deep learning-based lesion cavitation target detection model, the method includes: training a preset deep learning target detection network to obtain a deep learning-based lesion cavitation target detection model.

[0065] In the embodiments of this disclosure and other possible embodiments, training a preset deep learning target detection network to obtain a deep learning-based target detection model for lesion cavitation signs includes: training the preset deep learning target detection network using a preset number of preset medical training images of preset locations and their corresponding segmental cavitation sign target training images to obtain a deep learning-based target detection model for lesion cavitation signs.

[0066] In the embodiments of this disclosure and other possible embodiments, before extracting the lesion edge pixel values ​​corresponding to lesions for which no lesion cavitation sign was detected, the method includes: determining the total number of lesions corresponding to the medical image of the preset location; if the number of lesions corresponding to the detected lesion cavitation sign is less than the total number of lesions, then extracting the lesion edge pixel values ​​corresponding to lesions for which no lesion cavitation sign was detected.

[0067] In the embodiments of this disclosure and other possible embodiments, determining the total number of lesions corresponding to the medical image of the preset location includes: performing lesion segmentation or lesion target detection on the medical image of the preset location to determine the total number of lesions corresponding to the medical image of the preset location; and / or, performing lesion segmentation on the medical image of the preset location includes: performing lesion segmentation on the medical image of the preset location using a preset lesion segmentation model constructed based on a deep learning segmentation network; and / or, performing lesion target detection on the medical image of the preset location includes: performing lesion target detection on the medical image of the preset location using a lesion target detection model based on deep learning.

[0068] In the embodiments of this disclosure and other possible embodiments, determining whether a lesion without detected cavitation sign exists based on the average pixel value corresponding to the lesion without detected cavitation sign and the corresponding edge pixel value of the lesion includes: if the average pixel value corresponding to the lesion without detected cavitation sign is less than the corresponding edge pixel value of the lesion, then it is determined that the lesion without detected cavitation sign exists; otherwise, it is determined that the lesion without detected cavitation sign does not exist.

[0069] In the embodiments of this disclosure and other possible embodiments, the step of extracting the lesion edge pixel values ​​corresponding to lesions for which no cavitation sign was detected includes: performing edge detection on the lesion mask image corresponding to the lesion for which no cavitation sign was detected to obtain a lesion edge image; performing pixel-level multiplication on the lesion edge image and its corresponding preset site medical image to obtain a lesion edge image; and extracting the pixel values ​​corresponding to the lesion edge in the lesion edge image to obtain the corresponding lesion edge pixel values.

[0070] In the embodiments of this disclosure and other possible embodiments, the step of performing edge detection on the lesion mask image corresponding to the lesion for which no cavitation sign was detected, to obtain a lesion edge image, includes: performing an erosion operation on the lesion mask image corresponding to the lesion for which no cavitation sign was detected, to obtain a lesion mask erosion image; and subtracting the corresponding lesion mask erosion image from the lesion mask image to obtain a joint edge image.

[0071] In this disclosure and other possible embodiments, the method further includes: performing lesion vacuolation target detection on each lesion in a medical image of a preset location, configuring the lesion corresponding to the detected lesion vacuolation as having lesion vacuolation; extracting the average pixel value of the lesion edge corresponding to the lesion for which no lesion vacuolation was detected; and determining whether the lesion for which no lesion vacuolation was detected has lesion vacuolation based on the average pixel value corresponding to the lesion for which no lesion vacuolation was detected and the corresponding average pixel value of the lesion edge.

[0072] In the embodiments of this disclosure and other possible embodiments, the step of extracting the average pixel value of the lesion edge corresponding to the lesion for which no cavitation sign was detected includes: performing edge detection on the lesion mask image corresponding to the lesion for which no cavitation sign was detected to obtain the lesion edge image; performing pixel-level multiplication on the lesion edge image and its corresponding preset site medical image to obtain the lesion edge image; extracting the pixel value corresponding to the lesion edge in the lesion edge image to obtain the corresponding lesion edge pixel value; and calculating the average value of the lesion edge pixel value to obtain the average pixel value of the lesion edge.

[0073] In the embodiments of this disclosure and other possible embodiments, the step of performing edge detection on the lesion mask image corresponding to the lesion for which no cavitation sign was detected, to obtain a lesion edge image, includes: performing an erosion operation on the lesion mask image corresponding to the lesion for which no cavitation sign was detected, to obtain a lesion mask erosion image; and subtracting the corresponding lesion mask erosion image from the lesion mask image to obtain a joint edge image.

[0074] Figure 2 A first flowchart of a chest medical image analysis method according to an embodiment of this disclosure is shown. Figure 2As shown, the medical image analysis method includes: Step S4: acquiring multi-time dynamic chest X-ray images during the respiratory process corresponding to the medical image of the preset site; Step S5: using the lesion morphology determination method described above, determining the nodule morphology corresponding to each lesion on the dynamic chest X-ray image at each moment in the multi-time dynamic chest X-ray image; Step S6: using the preset nodule regular morphology and the nodule morphology corresponding to each lesion on the dynamic chest X-ray image at each moment, determining the irregular nodules on the dynamic chest X-ray image at each moment that do not meet the preset nodule regular morphology; Step S7: using the irregular nodules on the dynamic chest X-ray image at each moment that do not meet the preset nodule regular morphology, determining the nodule movement trajectory corresponding to each irregular nodule during the respiratory process.

[0075] In the embodiments disclosed herein and other possible embodiments, the preset nodule regularity can be configured as a regularity corresponding to a non-spinous sign that is approximately circular or approximately elliptical.

[0076] In the embodiments disclosed herein and other possible embodiments, the step of determining the nodule motion trajectory corresponding to each irregular nodule during the breathing process by utilizing the irregular nodules on the dynamic chest X-ray images at each moment that do not meet the preset nodule regularity includes: registering each irregular nodule on the dynamic chest X-ray images at each moment that does not meet the preset nodule regularity at adjacent moments or at a set adjacent moment to obtain the registration motion field of each irregular nodule corresponding to the breathing process; visualizing the registration motion field of each irregular nodule to obtain the motion arrows pointing from each irregular nodule at the first moment corresponding to the adjacent moment or at the set adjacent moment to the same irregular nodule at the second moment; and determining the nodule motion trajectory corresponding to each irregular nodule during the breathing process by pointing from the motion arrows pointing from the irregular nodules at the first moment corresponding to the adjacent moment or at the set adjacent moment to the same irregular nodule at the second moment.

[0077] In the embodiments of this disclosure and other possible embodiments, the adjacent time or the set adjacent time includes two time points, which are respectively configured as the first time point and the second time point.

[0078] In the embodiments of this disclosure and other possible embodiments, determining the spinous process sign includes: calculating the ratio of the long axis to the short axis of each lesion in the lesion mask image corresponding to the medical image of the preset location; wherein the medical image of the preset location is configured as a two-dimensional medical image; if the ratio of the long axis to the short axis is greater than or equal to a first preset ratio of the long axis to the short axis, then the corresponding lesion is determined to have a spinous process sign; or, calculating multiple ratios of the long axis to the short axis of each three-dimensional lesion in the lesion mask image corresponding to the medical image of the preset location; if any one of the ratios of the long axis to the short axis is greater than or equal to the first preset ratio of the long axis to the short axis, then the corresponding lesion is determined to have a spinous process sign; wherein the medical image of the preset location is configured as a three-dimensional medical image. This addresses at least one of the technical problems currently present, such as the need for manual determination of whether a spinous process sign exists at the lesion edge, which is too subjective, lacks intelligent determination of whether a spinous process sign exists at the lesion edge, resulting in a huge workload for doctors and preventing further effective evaluation of radiotherapy efficacy prediction.

[0079] In the embodiments of this disclosure and other possible embodiments, determining the spike sign includes: determining whether the medical image of the preset site is a two-dimensional medical image or a three-dimensional medical image; if the medical image of the preset site is a two-dimensional medical image, then calculating the ratio of the long axis to the short axis of each lesion in the lesion mask image corresponding to the medical image of the preset site based on the long axis and short axis of each lesion; if the ratio of the long axis to the short axis is greater than or equal to a first preset ratio of the long axis to the short axis, then determining that the corresponding lesion has a spike sign; otherwise, determining that the corresponding lesion does not have a spike sign; if the medical image of the preset site is a three-dimensional medical image, then calculating multiple ratios of the long axis to the short axis of each three-dimensional lesion in the lesion mask image corresponding to the medical image of the preset site; if any one of the ratios of the long axis to the short axis is greater than or equal to the first preset ratio of the long axis to the short axis, then determining that the corresponding lesion has a spike sign. To address at least one of the following technical problems: the current requirement to manually determine whether there is a spinous process at the edge of the lesion is too subjective, the lack of intelligent determination of whether there is a spinous process at the edge of the lesion results in a huge workload for doctors, and makes it impossible to further effectively evaluate the prediction of radiotherapy efficacy.

[0080] In the embodiments of this disclosure and other possible embodiments, determining the major axis corresponding to each three-dimensional lesion includes: performing three-dimensional reconstruction on each lesion mask in the first lesion mask image to obtain the three-dimensional mask lesion corresponding to each lesion mask; performing edge detection on the three-dimensional mask lesion of each lesion mask to obtain the three-dimensional lesion mask edge; selecting any three-dimensional edge pixel in the three-dimensional lesion mask edge; calculating multiple three-dimensional edge pixel distances between the arbitrary three-dimensional edge pixel and other three-dimensional edge pixel; selecting the maximum three-dimensional edge pixel distance from the multiple three-dimensional edge pixel distances; and configuring the maximum three-dimensional edge pixel distance as the major axis corresponding to each three-dimensional lesion.

[0081] In the embodiments of this disclosure and other possible embodiments, determining the short axis corresponding to each lesion includes: performing three-dimensional reconstruction on each lesion mask in the first lesion mask image to obtain a three-dimensional mask lesion corresponding to each lesion mask; performing edge detection on the three-dimensional mask lesion of each lesion mask to obtain the three-dimensional lesion mask edge; selecting any three-dimensional edge pixel in the three-dimensional lesion mask edge; calculating multiple three-dimensional edge pixel distances between the arbitrary three-dimensional edge pixel and other three-dimensional edge pixel; selecting the minimum three-dimensional edge pixel distance from the multiple three-dimensional edge pixel distances; configuring the minimum three-dimensional edge pixel distance as the long axis corresponding to each three-dimensional lesion; and / or, if the ratio of the long axis to the short axis is less than the first preset ratio of the long axis to the short axis, then it is determined that the corresponding lesion does not have a spike sign.

[0082] In the embodiments disclosed herein and other possible embodiments, if the lesion has a spinous process sign, then based on the lesion mask image and arterial mask image corresponding to the medical image of the preset location, it is determined whether the spinous process corresponding to the lesion is adjacent to an arterial vessel; if the spinous process corresponding to the lesion is adjacent to an arterial vessel, then the spinous process is determined to be a dangerous spinous process.

[0083] In the embodiments disclosed herein and other possible embodiments, if the lesion has a spinous process sign, then based on the lesion mask and arterial mask image corresponding to the preset site medical image, it is determined whether the spinous process corresponding to the lesion is adjacent to an arterial vessel; if the spinous process corresponding to the lesion is adjacent to an arterial vessel, then the spinous process is determined to be a dangerous spinous process.

[0084] In the embodiments disclosed herein and other possible embodiments, determining whether the spinous process corresponding to the lesion is adjacent to an artery based on the lesion mask image and artery mask image corresponding to the medical image of the preset location includes: extracting multiple spinous process position coordinates corresponding to multiple spinous processes in the lesion mask image and artery mask edge position coordinates corresponding to the artery mask edge in the artery mask image; calculating multiple distances between the multiple spinous process position coordinates and the artery mask edge position coordinates; if the minimum distance among the multiple distances is less than a preset distance, then it is determined that the spinous process corresponding to the lesion is adjacent to an artery.

[0085] In the embodiments of this disclosure and other possible embodiments, determining whether the spinous process corresponding to the lesion is adjacent to an artery based on the lesion mask and artery mask image corresponding to the medical image of the preset location includes: extracting multiple spinous process position coordinates corresponding to multiple spinous processes and artery mask edge position coordinates corresponding to the artery mask edge in the lesion mask and artery mask images; calculating multiple distances between the multiple spinous process position coordinates and the artery mask edge position coordinates respectively; if the minimum distance among the multiple distances is less than a preset distance, then it is determined that the spinous process corresponding to the lesion is adjacent to an artery.

[0086] Figure 3 A second flowchart of a chest medical image analysis method according to an embodiment of this disclosure is shown. Figure 3 As shown, the intelligent medical image analysis method is characterized by including: step S8: using the lesion morphology determination method described above, determining the lesion morphology corresponding to each lesion in the medical image of the preset location; step S9: based on the quantitative imaging features of the preset nodules to be selected, including the proportion of solid nodules, predicting preset chest diseases related to nodules.

[0087] In this embodiment of the disclosure, the step of predicting nodule-related preset chest diseases based on the quantitative imaging features of preset nodules corresponding to the proportion of solid nodules includes: selecting preset nodule quantitative imaging features corresponding to preset chest diseases by selecting the quantitative imaging features of preset nodules corresponding to the proportion of solid nodules; and predicting nodule-related preset chest diseases based on the quantitative imaging features of preset nodules corresponding to preset chest diseases. In this embodiment of the disclosure, the preset quantitative imaging features to be selected for nodules further include one or more of the following: nodule long diameter, whether the nodule edge is clear, the proportion of solid nodules, nodule spinous process sign, nodule lobulation sign, nodule air bronchus sign, and nodule cavitation sign.

[0088] In this disclosure and other possible embodiments, the preset chest disease is configured as lymph node metastasis in partially solid lung adenocarcinoma. Specifically, the prediction of the preset chest disease related to the preset nodule based on the quantitative imaging features of the preset nodule corresponding to the preset chest disease includes: training a preset predictor using the quantitative imaging features of the preset nodule corresponding to partially solid lung adenocarcinoma in the chest medical image at a first time and the pathological results of the lymph nodes in partially solid lung adenocarcinoma corresponding to metastasis or non-metastasis at a second time after the first time to construct a lymph node metastasis prediction model; and using the lymph node metastasis prediction model and the quantitative imaging features of the preset nodule corresponding to partially solid lung adenocarcinoma in the chest medical image to be predicted to predict lymph node metastasis in partially solid lung adenocarcinoma. This addresses the technical problem of the lack of accurate, effective, and non-invasive means to assess lymph node metastasis in partially solid lung adenocarcinoma nodules preoperatively.

[0089] In embodiments of this disclosure and other possible embodiments, the preset predictor may be configured as a prediction network based on deep learning (e.g., CNN, RNN, GCN, etc.) or a predictor based on machine learning (e.g., SVM, Random Forest, XGBoost, etc.).

[0090] In this embodiment of the disclosure, before training the preset predictor, the method includes: extracting quantitative imaging features of candidate nodules corresponding to partial solid lung adenocarcinoma in chest medical images; and selecting preset quantitative imaging features of nodules related to the pathological results of lymph nodes in the partial solid lung adenocarcinoma from the candidate nodule quantitative imaging features.

[0091] In this embodiment of the disclosure, determining the preset quantitative imaging features of nodules related to the pathological results of lymph nodes in the partial solid lung adenocarcinoma includes: using a univariate logistic regression analysis algorithm, the quantitative imaging features of the nodules to be selected and their corresponding pathological results of lymph nodes in the partial solid lung adenocarcinoma, performing univariate logistic regression on each of the quantitative imaging features of the nodules to be selected, and determining the preset quantitative imaging features of nodules related to the pathological results of lymph nodes in the partial solid lung adenocarcinoma.

[0092] In this embodiment of the disclosure, the quantitative imaging features of the nodule to be selected include one or more of the following: the long diameter of the nodule, the long diameter of the solid component of the nodule, the proportion of the solid component of the nodule to the nodule itself, the location of the nodule, whether the edge of the nodule is clear, the morphology of the nodule, the nodule spinous process sign, the nodule lobulation sign, the nodule pleural traction sign, the nodule cavitation sign, and the nodule air bronchus sign.

[0093] In this embodiment of the present disclosure, the step of extracting quantitative imaging features of candidate nodules corresponding to partial solid lung adenocarcinoma in chest medical images includes: segmenting the nodules corresponding to partial solid lung adenocarcinoma in the chest medical images to obtain a nodule mask image; and based on the nodule mask image, determining one or more of the following quantitative imaging features of the candidate nodules: nodule major diameter, whether the nodule edge is clear, nodule morphology, nodule spinous process sign, nodule lobulation sign, and nodule vacuolation sign.

[0094] In this embodiment of the disclosure, before training the preset predictor, the numerical quantitative imaging features of the candidate nodules are standardized or normalized, and the categorical quantitative imaging features of the candidate nodules are encoded.

[0095] In the embodiments of this disclosure and other possible embodiments, for example, before training the preset predictor, the quantitative imaging features of the nodule corresponding to the nodule major diameter, the nodule solid component major diameter, and the proportion of nodule solidity to the nodule are standardized or normalized to eliminate the influence of different dimensions on the training of the preset predictor.

[0096] In this disclosed embodiment and other possible embodiments, after determining one or more of the following quantitative imaging features of the nodule to be selected based on the nodule mask image: nodule location, clarity of nodule edges, nodule shape, presence of spinous process, presence of lobulation, presence of pleural traction, presence of cavitation, and presence of air bronchogram, respectively, the following features are encoded to obtain... The system uses one or more of the coding features corresponding to the quantitative imaging features of the nodule to be selected, such as nodule location, clarity of nodule edge, nodule shape, presence of spinous process, presence of lobulation, presence of pleural traction, presence of cavitation, and presence of air bronchus, to train a preset predictor and construct a lymph node metastasis prediction model.

[0097] In this embodiment and other possible embodiments, the nodule locations corresponding to the quantitative imaging features of the selected nodules are encoded to obtain different nodule location encoding features corresponding to a first numerical queue (0, 1, 2, ... or 0, 2, 4, ...) for different nodule locations; wherein, the different nodule location encoding features corresponding to the first numerical queue (0, 1, 2, ... or 0, 2, 4, ...) for different nodule locations are configured according to a predefined lung field anatomical region. Similarly, the nodule morphology corresponding to the quantitative imaging features of the selected nodules is encoded to obtain different nodule morphology encoding features corresponding to a second numerical queue (0, 1, 2, ... or 1, 3, 5, ...); wherein, the second numerical queue (0, 1, 2, ... or 1, 3, 5, ...) corresponding to the different nodule morphology encoding features are configured according to different types corresponding to the preset closed curve equation or the preset closed surface equation.

[0098] In this disclosure and other possible embodiments, one or more of the following features corresponding to the quantitative imaging features of the nodule to be selected are encoded: whether the nodule edge is clear, whether the nodule has a spiky sign, whether the nodule has a lobulated sign, whether the nodule has a pleural traction sign, whether the nodule has a cavitation sign, and whether the nodule has an air bronchus sign. This includes: if the features are present, the corresponding quantitative imaging feature of the nodule to be selected is configured with a first value (e.g., 1); otherwise, the corresponding quantitative imaging feature of the nodule to be selected is configured with a second value different from the first value (e.g., 0). For example, if the nodule edge is clear, then when encoding the clear nodule edge, the clear nodule edge is configured with a first value; if the nodule has a spiky sign, then when encoding the spiky nodule sign, the spiky nodule sign is configured with a first value.

[0099] In embodiments of this disclosure and other possible embodiments, determining whether the nodule edge corresponding to the quantitative imaging features of the selected nodule is clear based on the nodule mask image includes: performing an erosion operation on the nodule mask image to obtain a nodule mask eroded image; subtracting the nodule mask eroded image from the nodule mask image to obtain a nodule mask processed image; mapping the nodule position coordinates in the nodule mask processed image to the chest medical image; calculating multiple gradients corresponding to the nodule position coordinates in the chest medical image; if the gradient magnitude values ​​corresponding to the multiple nodules are greater than or equal to a preset gradient magnitude value, then the nodule boundary where the nodule position corresponding to the preset gradient magnitude value is located is determined to be clear; otherwise, the nodule boundary is determined to be unclear.

[0100] In embodiments of this disclosure and other possible embodiments, the step of calculating multiple gradients corresponding to the nodule location coordinates in the chest medical image includes: determining multiple first position coordinates and multiple second position coordinates corresponding to both sides of the nodule location coordinates in the chest medical image in the x-direction, and multiple third position coordinates and multiple fourth position coordinates corresponding to the y-direction, based on the nodule location coordinates; calculating the differences between the first pixel values ​​corresponding to the multiple first position coordinates and the second pixel values ​​corresponding to the multiple second position coordinates to obtain multiple x-direction gradients corresponding to the nodule location coordinates; calculating the differences between the third pixel values ​​corresponding to the multiple third position coordinates and the fourth pixel values ​​corresponding to the multiple fourth position coordinates to obtain multiple y-direction gradients corresponding to the nodule location coordinates; and configuring the multiple x-direction gradients and their corresponding multiple y-direction gradients as multiple gradients corresponding to the nodule location coordinates.

[0101] In the embodiments disclosed herein and other possible embodiments, determining multiple first position coordinates and multiple second position coordinates on both sides of the nodule position coordinates in the x-direction in the chest medical image based on the nodule position coordinates includes: using the nodule position coordinates, determining multiple first position coordinates and multiple second position coordinates on both sides in the x-direction according to a preset distance.

[0102] In the embodiments of this disclosure and other possible embodiments, determining multiple third position coordinates and multiple fourth position coordinates on both sides of the nodule position coordinates in the chest medical image in the y direction based on the nodule position coordinates includes: using the nodule position coordinates, determining multiple third position coordinates and multiple fourth position coordinates on both sides in the x direction according to a preset distance.

[0103] In the embodiments disclosed herein and other possible embodiments, determining the nodule morphology corresponding to the quantitative imaging features of the selected nodule based on the nodule mask image includes: determining a nodule mask processing image corresponding to each nodule in the nodule mask image of a chest medical image; extracting multiple nodule mask position coordinates corresponding to the nodule mask lines in the nodule mask processing image corresponding to each nodule; and fitting or reconstructing the multiple nodule mask position coordinates corresponding to each nodule to determine the nodule morphology corresponding to each nodule.

[0104] In the embodiments of this disclosure and other possible embodiments, the step of fitting or reconstructing the multiple nodule mask position coordinates corresponding to each nodule to determine the nodule morphology includes: under the optimal criterion, approximating multiple preset closed curve equations or multiple preset closed surface equations using the multiple nodule mask position coordinates corresponding to each nodule to determine the nodule morphology corresponding to each nodule.

[0105] In the embodiments disclosed herein and other possible embodiments, the step of approximating a preset closed curve equation or a preset closed surface equation using the multiple nodule mask position coordinates corresponding to each nodule under the optimal criterion to determine the nodule morphology corresponding to each nodule includes: under the optimal criterion, minimizing the error or absolute residual of the nodule mask position coordinates between the approximation equations and the multiple near-preset closed curve equations or multiple preset closed surface equations when the multiple nodule mask position coordinates corresponding to each nodule approximate the multiple preset closed curve equations or multiple preset closed surface equations, thereby determining the nodule morphology corresponding to each nodule.

[0106] In the embodiments disclosed herein and other possible embodiments, the step of approximating a preset closed curve equation or a preset closed surface equation using multiple nodule mask position coordinates corresponding to each nodule under the optimal criterion to determine the nodule morphology corresponding to each nodule includes: if the chest medical image is configured as a two-dimensional medical image, then under the optimal criterion, approximating multiple preset closed curve equations using multiple nodule mask position coordinates corresponding to each nodule to determine the nodule morphology corresponding to each nodule; if the chest medical image is configured as a three-dimensional medical image, then under the optimal criterion, approximating multiple preset closed surface equations using multiple nodule mask position coordinates corresponding to each nodule to determine the nodule morphology corresponding to each nodule.

[0107] In the embodiments disclosed herein and other possible embodiments, the optimal criterion is configured as one or more of the least squares criterion, the minimum absolute residual criterion, etc.

[0108] In the embodiments of this disclosure and other possible embodiments, the optimal criterion is configured as the least squares method criterion. Then, after minimizing the error between the approximation equation and the multiple near-preset closed curve equation or multiple preset closed surface equation when the multiple nodule mask position coordinates corresponding to each nodule are approximated to the multiple preset closed curve equation or multiple preset closed surface equation, multiple nodule shapes corresponding to each nodule are obtained. The nodule mask position coordinate errors corresponding to the multiple nodule shapes are extracted respectively. The nodule shape with the smallest error among the multiple nodule shape's corresponding nodule position coordinate errors is configured as the final nodule shape corresponding to each nodule.

[0109] In the embodiments of this disclosure and other possible embodiments, the optimal criterion is configured as the least squares criterion. Then, after minimizing the absolute residuals of the nodule mask position coordinates of the multiple nodule mask position coordinates that approximate multiple preset closed curve equations or multiple preset closed surface equations when approximating multiple nodule mask position coordinates of each nodule, multiple nodule shapes corresponding to each nodule are obtained. The absolute residuals of the nodule mask position coordinates corresponding to the multiple nodule shapes are extracted respectively. The nodule shape corresponding to the minimum error of the absolute residuals of the nodule mask position coordinates corresponding to the multiple nodule shapes is configured as the final nodule shape corresponding to each nodule.

[0110] In the embodiments disclosed herein and other possible embodiments, the preset closed curve equation is configured as one or more of the two-dimensional closed curves corresponding to a first-order polynomial, a second-order polynomial, or a higher-order polynomial, which are used in polynomial fitting. For example, the preset closed curve equation is configured as a closed curve corresponding to a circle, ellipse, or conic section, a closed curve enclosed by line segments corresponding to a triangle, quadrilateral, pentagon, or hexagon, a spline curve, or a polyline closed curve, etc.

[0111] In the embodiments of this disclosure and other possible embodiments, the preset closed surface equation is configured as a bivariate polynomial or a multivariate polynomial. For example, the preset closed surface equation is configured as a closed surface formed by connecting the beginning and end of line segments, such as a circular surface, elliptical surface, conical surface, triangular surface, quadrilateral surface, pentagonal surface, hexagonal surface, etc., corresponding to a closed surface formed by basic geometric closed surfaces, or a closed surface composed of multiple surfaces.

[0112] In embodiments of this disclosure and other possible embodiments, determining the nodule mask processing image includes: performing an erosion operation on the nodule mask image to obtain a nodule mask erosion image; and subtracting the nodule mask erosion image from the nodule mask image to obtain the nodule mask processing image.

[0113] In the embodiments of this disclosure and other possible embodiments, before determining the nodule mask processing image corresponding to the nodule in the nodule mask image of the chest medical image, the method includes: using a preset nodule segmentation model constructed based on a deep learning segmentation network to segment the chest medical image into nodules, and determining the nodule mask image of the chest medical image.

[0114] In the embodiments of this disclosure and other possible embodiments, before segmenting chest medical images into nodules using a preset segmentation model constructed based on a deep learning segmentation network, the method includes: training a preset deep learning segmentation network using a preset number of chest medical images and their corresponding nodule mask training images to obtain a preset nodule segmentation model constructed based on the deep learning segmentation network.

[0115] In the embodiments of this disclosure and other possible embodiments, before training a preset deep learning segmentation network using a preset number of chest medical images and their corresponding nodule mask training images to obtain a preset nodule segmentation model constructed based on the deep learning segmentation network, the method includes: using segmentation annotation software to delineate nodule lesions on a preset number of chest medical images to obtain corresponding nodule mask training images.

[0116] In the embodiments of this disclosure and other possible embodiments, before training a preset deep learning segmentation network using a preset number of chest medical images and their corresponding nodule mask training images to obtain a preset segmentation model constructed based on the deep learning segmentation network, the method includes: using segmentation annotation software CasiaLabeler or Labelme to delineate nodule lesions on the preset number of chest medical images to obtain corresponding nodule mask training images. Those skilled in the art can configure the preset number according to actual needs. For example, the preset number can be configured as 300-500.

[0117] In the embodiments disclosed herein and other possible embodiments, the preset deep learning segmentation network is configured as one or more deep learning segmentation networks such as Fully Convolutional Network (FCN), U-Net, DeepLab, and Pyramid Spatial Pooling Network (PSPNet).

[0118] In this embodiment of the disclosure, determining the major diameter of the nodule corresponding to the quantitative imaging features of the nodule to be selected includes: performing edge detection on each nodule in the nodule mask image corresponding to the chest medical image to obtain the edge line of each nodule mask; setting a reference mask point on each nodule mask edge line respectively; calculating multiple distances from the reference mask point to multiple mask points on each nodule mask edge line excluding the reference mask point; and configuring the maximum distance among the multiple distances as the major diameter of each nodule.

[0119] In this embodiment of the disclosure, determining the nodular pleural traction sign includes: detecting an image of a nodular pleural region between a nodule at a predetermined location in a lung field and the pleura adjacent to the nodule at the predetermined location in a chest medical image; and determining whether the nodular pleural traction sign exists in the chest medical image based on the nodular pleural region image. This addresses at least one of the technical problems of existing methods that require manual determination of the nodular pleural traction sign, such as excessive subjectivity, lack of intelligent determination of the nodular pleural traction sign leading to a huge workload for doctors, and inability to further predict lymph node metastasis in some solid lung adenocarcinomas.

[0120] In the embodiments of this disclosure and other possible embodiments, determining the nodule at a preset location in the lung field includes: segmenting the nodule in the chest medical image using a preset nodule segmentation model constructed based on a deep learning segmentation network to obtain a nodule mask image corresponding to the chest medical image; and determining the nodule at the preset location in the lung field based on the nodule position coordinates in the nodule mask image.

[0121] In the embodiments of this disclosure and other possible embodiments, determining the nodule at a preset position in the lung field based on the nodule position coordinates in the nodule mask image includes: dividing the chest medical image into lung field regions using a lung field dynamic region division method to obtain a lung field region division network corresponding to each nodule; locating the lung field anatomical region corresponding to each nodule based on its position and the corresponding lung field region division network; determining the nodule at a preset position in the lung field based on the lung field anatomical region corresponding to each nodule; and / or, determining the nodule at a preset position in the lung field based on the lung field anatomical region corresponding to each nodule includes: if the lung field anatomical region corresponding to the nodule is close to the lung field boundary, then the nodule close to the lung field boundary is determined as the nodule at the preset position in the lung field.

[0122] In the embodiments of this disclosure and other possible embodiments, determining whether the lung field anatomical region corresponding to the nodule is close to the lung field boundary includes: calculating multiple nodule lung field boundary distances for each nodule from the lung field boundary in the lung field mask image corresponding to the chest medical image; and determining whether the lung field anatomical region corresponding to the nodule is close to the lung field boundary based on the multiple nodule lung field boundary distances and a preset distance.

[0123] In the embodiments of this disclosure and other possible embodiments, determining whether the anatomical region of the lung field corresponding to the nodule is close to the lung field boundary based on the distances between the multiple nodule lung field boundaries and a preset distance includes: if the distances between the multiple nodule lung field boundaries are less than or equal to the preset distance, then the anatomical region of the lung field corresponding to the nodule is determined to be close to the lung field boundary; otherwise, the anatomical region of the lung field corresponding to the nodule is determined to be far from the lung field boundary. Those skilled in the art can determine the preset distance according to actual needs. For example, the preset distance can be configured as 1-10 pixels or other pixel values.

[0124] In the embodiments of this disclosure and other possible embodiments, before performing nodule segmentation on the chest medical image using the preset nodule segmentation model constructed based on a deep learning segmentation network, the method includes: training the preset deep learning segmentation network using a preset number of chest medical images and their corresponding nodule mask training images to obtain the preset nodule segmentation model constructed based on the deep learning segmentation network.

[0125] In the embodiments of this disclosure and other possible embodiments, before training the preset deep learning segmentation network, the method includes: using segmentation annotation software to delineate nodules on a preset number of chest medical images to obtain corresponding nodule mask training images.

[0126] In the embodiments of this disclosure and other possible embodiments, before training a preset deep learning segmentation network using a preset number of chest medical images and their corresponding nodule mask training images to obtain a preset segmentation model constructed based on the deep learning segmentation network, the method includes: using segmentation annotation software CasiaLabeler or Labelme to delineate nodules on the preset number of chest medical images to obtain corresponding nodule mask training images. Those skilled in the art can configure the preset number according to actual needs. For example, the preset number can be configured as 300-500.

[0127] In the embodiments disclosed herein and other possible embodiments, the preset deep learning segmentation network is configured as one or more deep learning segmentation networks such as Fully Convolutional Network (FCN), U-Net, DeepLab, and Pyramid Spatial Pooling Network (PSPNet).

[0128] In the embodiments of this disclosure and other possible embodiments, determining the nodules at preset locations in the lung field includes: segmenting the lung field in the chest medical image using a preset lung field segmentation model constructed based on a deep learning segmentation network to obtain a lung field mask image corresponding to the chest medical image; extracting the lung field from the lung field mask image by a first preset edge width to obtain a lung field image with a first preset edge width; segmenting the nodules in the first preset edge width lung field image using a preset nodule segmentation model constructed based on a deep learning segmentation network to obtain a nodule mask image with a first preset edge width; and determining the nodules in the first preset edge width nodule mask image as nodules at preset locations in the lung field. This addresses at least one of the technical problems, such as excessive subjectivity in nodule location positioning, the heavy workload for doctors due to the lack of intelligent nodule location positioning, and the inability to further predict lymph node metastasis in partially solid lung adenocarcinoma.

[0129] In the embodiments of this disclosure and other possible embodiments, the step of extracting the lung field from the lung field mask image by a first preset edge width to obtain a lung field image with a first preset edge width includes: performing an erosion operation on the lung field in the lung field mask image using the first preset edge width to obtain a lung field erosion mask image; performing a pixel-level subtraction operation on the lung field mask image and the lung field erosion mask image to obtain a lung field mask image with a first preset edge width; and performing a pixel-level multiplication operation on the lung field mask image with the chest medical image to obtain a lung field image with a first preset edge width.

[0130] In the embodiments disclosed herein and other possible embodiments, the mask value corresponding to the lung field in the lung field mask image can be configured to 1. Those skilled in the art can determine the first preset edge width according to actual needs. For example, the first preset edge width can be configured to 1-10 pixels or other pixel values.

[0131] In the embodiments of this disclosure and other possible embodiments, before segmenting the chest medical image using a preset lung field segmentation model constructed based on a deep learning segmentation network, the method includes: training a preset deep learning segmentation network using a preset number of chest medical images and their corresponding lung field mask training images to obtain a preset lung field segmentation model constructed based on the deep learning segmentation network.

[0132] In the embodiments of this disclosure and other possible embodiments, before training the preset deep learning segmentation network, the method includes: using segmentation annotation software to delineate the lung fields of a preset number of chest medical images to obtain corresponding lung field mask training images.

[0133] In the embodiments of this disclosure and other possible embodiments, before training a preset deep learning segmentation network using a preset number of chest medical images and their corresponding lung field mask training images to obtain a preset segmentation model constructed based on the deep learning segmentation network, the method includes: using segmentation annotation software CasiaLabeler or Labelme to delineate the lung fields of the preset number of chest medical images to obtain corresponding lung field mask training images. Those skilled in the art can configure the preset number according to actual needs.

[0134] In the embodiments of this disclosure and other possible embodiments, determining the pleural mask image corresponding to the pleura includes: expanding the lung field in the lung field mask image using a second preset edge width to obtain an expanded lung field mask image; performing pixel-level subtraction operations on the expanded lung field mask image and the lung field mask image to determine the pleural mask image corresponding to the pleura; and / or, to solve the technical problem that the pleura is not clearly displayed on the chest medical image, making it difficult to delineate the pleura, thus failing to obtain a preset pleural segmentation model based on a deep learning segmentation network with satisfactory performance.

[0135] In the embodiments disclosed herein and other possible embodiments, the detection of the nodular pleural region image between a nodule at a predetermined location in the lung field and the pleura adjacent to the nodule at the predetermined location in a chest medical image includes: drawing multiple rays corresponding to multiple predetermined directions from the nodule boundary line or nodule surface of the nodule at the predetermined location to the pleural mask boundary line or pleural mask surface adjacent to the pleura at the predetermined location; and determining the image area enclosed by the rays intersecting the multiple rays and the pleural mask boundary line or pleural mask surface, the nodule boundary line or nodule surface of the nodule at the predetermined location, and the pleural mask boundary line or pleural mask surface adjacent to the pleura at the predetermined location as the nodular pleural region image.

[0136] In the embodiments disclosed herein and other possible embodiments, determining the image area enclosed by the rays intersecting the multiple rays with the pleural mask boundary line or pleural mask surface, the nodule boundary line or nodule surface of the preset position nodule, and the pleural mask boundary line or pleural mask surface of the pleura adjacent to the preset position nodule as a nodular pleural region image includes: determining the image area enclosed by the rays intersecting the multiple rays with the pleural mask boundary line or pleural mask surface, the nodule boundary line or nodule surface of the preset position nodule, and the pleural mask boundary line or pleural mask surface of the pleura adjacent to the preset position nodule as a nodular pleural region mask image; and performing a pixel-level multiplication operation on the nodular pleural region mask image and the chest medical image to determine the nodular pleural region image.

[0137] In the embodiments disclosed herein and other possible embodiments, if the chest medical image is configured as a two-dimensional medical image, then detecting the nodular pleural region image between a nodule at a preset position in the lung field of the chest medical image and the pleura adjacent to the nodule at the preset position includes: drawing multiple rays corresponding to multiple preset directions from the nodule boundary line of the nodule at the preset position to the pleural mask boundary line adjacent to the pleura at the preset position; and determining the area enclosed by the rays intersecting the multiple rays and the pleural mask boundary line, the nodule boundary line of the nodule at the preset position, and the pleural mask boundary line adjacent to the pleura at the preset position as the nodular pleural region image.

[0138] In the embodiments disclosed herein and other possible embodiments, the step of drawing multiple rays corresponding to multiple predetermined directions from the nodule boundary line of the nodule at the preset location to the pleural mask boundary line adjacent to the nodule at the preset location includes: setting an initial radiation point on the nodule boundary line of the nodule at the preset location; determining multiple radiation points on the nodule boundary line based on the initial radiation point and a preset radiation point step distance; and drawing multiple rays corresponding to multiple predetermined two-dimensional directions starting from the multiple radiation points.

[0139] In this disclosure and other possible embodiments, if the chest medical image is configured as a three-dimensional medical image, then detecting the nodular pleural region image between a nodule at a predetermined location in the lung field and the pleura adjacent to the nodule at the predetermined location in the chest medical image includes: drawing multiple rays corresponding to multiple predetermined directions from the nodule surface of the nodule at the predetermined location to the pleural mask surface adjacent to the pleura at the predetermined location; determining the area enclosed by the rays intersecting the multiple rays and the pleural mask surface, the nodule surface of the nodule at the predetermined location, and the pleura or pleural mask surface adjacent to the nodule at the predetermined location as the nodular pleural region image; and / or, The step of casting multiple rays corresponding to multiple predetermined directions from the surface of the nodule at the predetermined location to the pleural mask surface adjacent to the pleura at the predetermined location includes: determining a side pleural mask surface corresponding to the lung field anatomical region adjacent to the nodule at the predetermined location; setting an initial radiation point on the side pleural mask surface; determining multiple radiation points on the side pleural mask surface based on the initial radiation point and the predetermined radiation point step distance; and casting multiple rays corresponding to multiple predetermined three-dimensional directions starting from the multiple radiation points.

[0140] In this disclosure and other possible embodiments, the corresponding pleural mask boundary line or pleural mask surface is determined based on the pleural mask image corresponding to the pleura. Specifically, determining the corresponding pleural mask boundary line or pleural mask surface based on the pleural mask image corresponding to the pleura includes: if the chest medical image is configured as a two-dimensional medical image, edge detection is performed on the pleural mask image corresponding to the pleura to determine the corresponding pleural mask boundary line; if the chest medical image is configured as a three-dimensional medical image, edge detection is performed on each layer of the pleural mask image corresponding to the pleura to obtain the edge image of each layer of the pleural mask; and three-dimensional reconstruction is performed on each layer of the pleural mask edge image to determine the corresponding pleural mask surface.

[0141] In this disclosure and other possible embodiments, determining the pleural mask surface corresponding to the lung field anatomical region adjacent to the preset position nodule includes: dividing the pleura into left lung pleura and right lung pleura according to the lung field anatomical region of the preset position nodule; wherein the left lung pleura and right lung pleura correspond to the left lung pleural mask surface and the right lung pleural mask surface, respectively. Therefore, before determining the pleural mask surface corresponding to the lung field anatomical region adjacent to the preset position nodule, the method includes: dividing the pleura into multiple lung field anatomical pleural mask surfaces according to the lung field anatomical region of the preset position nodule; determining the pleural mask surface corresponding to the lung field anatomical region adjacent to the preset position nodule according to the multiple lung field anatomical pleural mask surfaces; setting initial radiation points on the pleural mask surface; and determining multiple radiation points on the pleural mask surface using the initial radiation points and the preset radiation point step distance.

[0142] For example, based on the lung field anatomical region of the pre-defined nodule, the pleura is divided into left lung pleura and right lung pleura; a left lung pleura mask surface or a right lung pleura mask surface corresponding to the lung field anatomical region adjacent to the pre-defined nodule is determined; an initial radiation point is set on the left lung pleura mask surface or the right lung pleura mask surface; multiple radiation points on the pleura mask surface are determined based on the initial radiation point and the pre-defined radiation point step distance.

[0143] In this disclosure and other possible embodiments, if the lung field anatomical region of the pre-positioned nodule is close to the anterior side of the left lung pleura, then the left lung pleural mask surface corresponding to the anterior side of the left lung pleura is retained; if the lung field anatomical region of the pre-positioned nodule is close to the anterior side of the right lung pleura, then the right lung pleural mask surface corresponding to the anterior side of the left lung pleura is retained. Based on the above, those skilled in the art can determine the specific pleural mask surface according to the actual anatomical structure of the lung field. Therefore, the pleural mask surface can also be configured as a pleural mask surface corresponding to different lung lobes. For example, the pleural mask surface of any one side of the right lung lobe.

[0144] In the embodiments disclosed herein and other possible embodiments, those skilled in the art can determine the second preset edge width according to actual needs. For example, the second preset edge width can be configured to 1-5 pixels or other pixel values.

[0145] In the embodiments of this disclosure and other possible embodiments, determining whether there is a nodular pleural traction sign in the chest medical image based on the nodular pleural region image includes: detecting whether there are cord-like or linear features between the pleura adjacent to the nodule at the preset position in the nodular pleural region image; if so, determining that there is a nodular pleural traction sign in the chest medical image; otherwise, determining that there is no nodular pleural traction sign in the chest medical image.

[0146] In the embodiments of this disclosure and other possible embodiments, the step of detecting whether there are cord-like or linear features between the pleura adjacent to the nodule at the preset position in the nodular pleural region image includes: using a preset feature target detection model based on deep learning to perform feature target detection on the nodular pleural region image, and determining whether there are cord-like or linear features between the pleura adjacent to the nodule at the preset position in the nodular pleural region image.

[0147] In the embodiments of this disclosure and other possible embodiments, before performing feature target detection on the nodular pleural region image using a preset feature target detection model based on deep learning, the method includes: training feature point training images using a preset number of chest medical training images and their corresponding cord-like features and / or line-like features, training a preset deep learning target detection network, and obtaining a preset feature target detection model constructed based on the deep learning target detection network.

[0148] In the embodiments disclosed herein and other possible embodiments, before training the preset deep learning object detection network, the method includes: using segmentation and annotation software to delineate a preset number of chest medical images with linear and / or linear feature bounding boxes to obtain corresponding linear and / or linear feature training images. For example, annotation software such as CasiaLabeler or Labelme can be used to delineate linear and / or linear feature bounding boxes on the preset number of chest medical training images to obtain corresponding linear and / or linear feature training images. Those skilled in the art can configure the preset number according to actual needs. For example, the preset number can be configured as 300-500 or other possible values.

[0149] In the embodiments disclosed herein and other possible embodiments, the preset deep learning object detection network may be configured as a YOLO series or an object detection network based on YOLO.

[0150] In this embodiment of the disclosure, determining the proportion of solid nodules includes: segmenting the chest medical image using a deep learning-based solid nodule segmentation model to obtain a nodule segmentation mask image and a solid nodule segmentation mask image; and determining the proportion of solid nodules within the nodules based on the nodule segmentation mask image and the solid nodule segmentation mask image.

[0151] In the embodiments of this disclosure and other possible embodiments, the step of segmenting the chest medical image using a deep learning-based solid nodule segmentation model to obtain a nodule segmentation mask image and a solid nodule segmentation mask image includes: constructing training images of nodules in each set of chest medical training images in a chest medical training image set, and training images of binary mixed location masks corresponding to solid nodules within the nodules; training the preset deep learning segmentation network using the binary mixed location mask training images, the solid nodule edge mask training images corresponding to the solid nodules, and the corresponding chest medical training images to obtain a solid nodule segmentation model; and segmenting the chest medical image to be segmented based on the solid nodule segmentation model to obtain a nodule segmentation mask image and a solid nodule segmentation mask image. This addresses at least one of the technical problems of existing methods that require manual segmentation of solid nodules, resulting in a huge workload for doctors and hindering further surgical procedures and prediction of lymph node metastasis in some solid lung adenocarcinomas.

[0152] In the embodiments disclosed herein and other possible embodiments, unlike the prior art, a binary mixed location mask training image is constructed for each set of chest medical training images in the chest medical training image set, corresponding to nodules and solid nodules within the nodules. During the training of the preset deep learning segmentation network, the preset deep learning segmentation network pays more attention to the anatomical relationship between the nodules and solid nodules within the nodules, forming a collaborative learning and collaborative response to the nodules and solid nodules within the nodules. This enables effective anatomical segmentation of solid nodules within the nodules, creating anatomical constraints on the segmentation of solid nodules within the nodules.

[0153] In the embodiments disclosed herein and other possible embodiments, when each set of chest medical training images and the chest medical images to be segmented in the chest medical training image set can be configured as two-dimensional chest medical images, each set of chest medical training images may be one chest medical training image corresponding to a subject at a specific moment, or multiple chest medical training images corresponding to subjects at multiple specific moments. For example, when the two-dimensional chest medical images are configured as chest X-ray images or chest ultrasound images, each set of chest medical training images may be one chest medical training image corresponding to a subject at a specific moment corresponding to breath-holding, deep breathing, or deep inspiration, or multiple chest medical training images corresponding to subjects at multiple specific moments corresponding to the breathing process or breath-holding process.

[0154] In the embodiments disclosed herein and other possible embodiments, when each set of chest medical training images and the chest medical images to be segmented in the chest medical training image set can be configured as three-dimensional chest medical images, each set of chest medical training images may be multiple three-dimensional chest medical training images corresponding to the examinee at a specific time or multiple four-dimensional chest medical training images corresponding to the examinee at multiple specific times. For example, when the three-dimensional chest medical images can be configured as one or more of chest CT images, chest MRI images, chest PET images, chest CT-PET images, and chest MRI-PET images, each set of chest medical training images may be multiple three-dimensional chest medical training images corresponding to the examinee at a specific time corresponding to breath-holding or deep breathing or deep inspiration, or multiple four-dimensional chest medical training images corresponding to the examinee at multiple specific times corresponding to the breathing process or breath-holding process.

[0155] In the embodiments disclosed herein and other possible embodiments, the preset deep learning segmentation network is configured as one or more deep learning segmentation networks such as Fully Convolutional Network (FCN), U-Net, DeepLab, and Pyramid Spatial Pooling Network (PSPNet).

[0156] In the embodiments disclosed herein and other possible embodiments, each set of chest medical training images may include multiple nodules, and each nodule may include a solid nodule. That is, the multiple nodules in each set of chest medical training images may or may not contain solid nodules.

[0157] In the embodiments of this disclosure and other possible embodiments, the construction of nodules in each set of chest medical training images in the chest medical training image set and binary mixed position mask training images corresponding to solid nodules within the nodules includes: extracting nodule mask training images with first mask values ​​corresponding to nodules in each set of chest medical training images in the chest medical training image set and solid nodule mask training images with second mask values ​​corresponding to solid nodules within the nodules; mapping the second mask values ​​to the nodule positions in the solid nodule mask training images according to the positions of solid nodules in the solid nodule mask training images to construct binary mixed position mask training images.

[0158] In the embodiments of this disclosure and other possible embodiments, determining the solid nodule edge mask training image corresponding to the solid nodule includes: performing an erosion operation on the solid nodule mask training image corresponding to each set of chest medical training images in the chest medical training image set to obtain a solid nodule mask erosion training image; performing a pixel-level subtraction operation on the solid nodule mask training image and the solid nodule mask erosion training image to determine the solid nodule edge mask training image corresponding to the solid nodule.

[0159] In the embodiments disclosed herein and other possible embodiments, the second mask value is mapped to the nodule position in the nodule mask training image according to the position of the real nodule in the nodule mask training image, and the first mask value corresponding to the nodule is changed to the second mask value corresponding to the real nodule in the nodule.

[0160] In the embodiments of this disclosure and other possible embodiments, those skilled in the art can configure the first mask value and the second mask value according to actual needs. For example, the first mask value and the second mask value can be configured as 1 and 2, respectively. However, it is worth noting that, unlike the prior art where the preset mask value only represents a region corresponding to a lesion or area to be segmented, the second mask value in the embodiments of this disclosure represents both the first mask value corresponding to the nodule and the second mask value corresponding to the solid nodule within the nodule.

[0161] In the embodiments disclosed herein and other possible embodiments, if there is a solid nodule within the nodule, the binary mixed location mask training image includes a first numerical mask corresponding to the nodule and a second numerical mask corresponding to the solid nodule; if there is no solid nodule within the nodule, the binary mixed location mask training image includes a first numerical mask corresponding to the nodule.

[0162] In the embodiments of this disclosure and other possible embodiments, extracting the nodule mask training image with the first mask value corresponding to the nodules and the solid nodule mask training image with the second mask value corresponding to the solid nodules within the nodules for each set of chest medical training images in the chest medical training image set includes: using segmentation annotation software CasiaLabeler or Labelme to delineate nodules and solid nodules within the nodules for each set of chest medical training images in the chest medical training image set of a preset number of chest medical training images, to obtain the nodule mask training image with the first mask value corresponding to the nodules and the solid nodule mask training image with the second mask value corresponding to the solid nodules within the nodules for each set of chest medical training images.

[0163] In the embodiments of this disclosure and other possible embodiments, the step of training the preset deep learning segmentation network using the binary mixed location mask training image, the solid nodule edge mask training image corresponding to the solid nodule, and the corresponding chest medical training image to obtain a solid nodule segmentation model includes: obtaining a binary mixed location mask image during the training process of the preset deep learning segmentation network using the binary mixed location mask training image and its corresponding chest medical training image; using a preset solid nodule edge encoder to encode the solid nodule edge mask image corresponding to the solid nodule segmentation mask image in the binary mixed location mask image and the solid nodule edge mask training image, respectively, to obtain a first edge encoding feature map and a second edge encoding feature map; calculating a first loss of the binary mixed location mask image and its corresponding solid nodule edge mask training image and calculating a second loss of the first edge encoding feature map and the second edge encoding feature map to obtain a solid nodule segmentation model.

[0164] In the embodiments disclosed herein and other possible embodiments, those skilled in the art can configure the loss functions corresponding to the first loss and the second loss according to actual needs. For example, the loss functions corresponding to the first loss and the second loss can be configured as one or more of the loss functions selected from Cross-Entropy Loss, Dice Loss, Tversky Loss, and Focal Loss.

[0165] In embodiments of this disclosure and other possible embodiments, the binary mixed location mask image includes: a nodule and a mask image corresponding to a solid nodule within the nodule; wherein the mask values ​​of the nodule and the mask values ​​corresponding to the solid nodule within the nodule are different. Furthermore, the solid nodule segmentation mask image in the binary mixed location mask image can be determined based on the mask values ​​of the nodule and the mask values ​​corresponding to the solid nodule within the nodule.

[0166] Furthermore, in the embodiments of this disclosure and other possible embodiments, determining the solid nodule edge mask image includes: performing an erosion operation on the solid nodule segmentation mask image to obtain a solid nodule mask erosion image; performing a pixel-level subtraction operation on the solid nodule mask image and the solid nodule mask erosion image to determine the solid nodule edge mask image corresponding to the solid nodule.

[0167] In the embodiments of this disclosure and other possible embodiments, the construction of the preset solid nodule edge encoder includes: constructing the preset solid nodule edge encoder using the solid nodule edge mask training image corresponding to the solid nodule and its corresponding solid nodule edge training image.

[0168] In the embodiments of this disclosure and other possible embodiments, the step of constructing a preset solid nodule edge encoder using the solid nodule edge mask training image corresponding to the solid nodule and its corresponding solid nodule edge training image includes: extracting the solid nodule edge training image corresponding to each set of chest medical training images in the chest medical training image set; and training a preset downsampling convolutional network using the solid nodule edge training image and its corresponding solid nodule edge mask training image to obtain the preset solid nodule edge encoder.

[0169] In the embodiments disclosed herein and other possible embodiments, the step of extracting the solid nodule edge training image corresponding to each set of chest medical training images in the chest medical training image set includes: performing pixel-level multiplication operations on the solid nodule edge mask training image corresponding to each set of chest medical training images in the chest medical training image set and its corresponding chest medical training image to extract the solid nodule edge training image.

[0170] In the embodiments disclosed herein and other possible embodiments, unlike the prior art, the preset solid nodule edge encoder enables the edges corresponding to the solid nodules within the nodules to participate in the training process of the preset deep learning segmentation network using the training images of the two-class mixed position mask and their corresponding chest medical training images. This makes the edges corresponding to the solid nodules within the nodules controllable and more conducive to the edge segmentation of the solid nodules within the nodules.

[0171] In the embodiments disclosed herein and other possible embodiments, during the construction of the preset solid nodule edge encoder, a third loss is calculated between the solid nodule edge mask training image corresponding to the solid nodule and its corresponding solid nodule edge training image. Similarly, those skilled in the art can configure the loss function corresponding to the third loss according to actual needs. For example, the loss function corresponding to the third loss can be configured as one or more of the following loss functions: Cross-Entropy Loss, Dice Loss, Tversky Loss, and Focal Loss.

[0172] In the embodiments disclosed herein and other possible embodiments, the preset downsampling convolutional network can be configured as one or more of the downsampling convolutional networks corresponding to ResNet, EfficientNet, LeNet, AlexNet, YOLOv10, SRFD / DRFD modules, HWD modules, MobileNet, ShuffleNet, etc.; wherein, those skilled in the art can configure the kernel size, stride of the kernel, pooling and other conventional layers of the above-mentioned preset downsampling convolutional network according to actual needs.

[0173] In the embodiments disclosed herein and other possible embodiments, the preset solid nodule edge encoder corresponding to the preset downsampling convolutional network can encode the solid nodule edge mask image corresponding to the solid nodule segmentation mask image in the two-class mixed position mask image and the solid nodule edge mask training image, thereby achieving one or more objectives such as compressing the spatial size of the solid nodule edge mask image and the solid nodule edge mask training image, expanding the receptive field, and enhancing translation invariance. Specifically, the following features are considered: Compressing spatial dimensions: Reducing the height and width of the feature maps corresponding to the solid nodule edge mask image and the solid nodule edge mask training image reduces subsequent computational load, making the preset solid nodule edge encoder more efficient; Expanding the receptive field: As the size of the feature maps corresponding to the solid nodule edge mask image and the solid nodule edge mask training image decreases, neurons in subsequent layers can cover a wider input region, helping to capture the global features corresponding to the solid nodule edge mask image and the solid nodule edge mask training image; Enhancing translation invariance: The encoder is more robust to small displacements or deformations of the solid nodule edge mask image and the solid nodule edge mask training image, improving the generalization ability of the preset solid nodule edge encoder.

[0174] For example, the pre-defined downsampling convolutional network can be configured as a hierarchical feature extraction structure or a gradually expanding receptive field structure. For a hierarchical feature extraction structure, it typically consists of multiple convolutional layers and pooling layers stacked alternately. With each downsampling operation, the resolution of the feature maps corresponding to the solid nodule edge mask image and the training image decreases, but the number of channels may increase to retain richer semantic information. For a gradually expanding receptive field structure, with each downsampling operation on the solid nodule edge mask image and the training image, the input region that the deep neurons of the network can "see" becomes larger and larger, facilitating a gradual transition from local features corresponding to the solid nodule edge mask image and the training image to global semantic understanding.

[0175] For example, by setting the stride of the convolutional kernel to be greater than 1 (e.g., stride=2), the convolutional kernel slides in jumps across the input feature maps corresponding to the solid nodule edge mask image and the training image, directly reducing the size of the output feature maps corresponding to these images. For instance, if the input size is 5×5, the kernel size is 3×3, and the stride is 2, the output size of the solid nodule edge mask image and the training image will become 2×2. Common max pooling and average pooling downsample the feature maps corresponding to the solid nodule edge mask image and the training image by selecting the maximum or average value of the local regions corresponding to these images. For example, 2×2 max pooling will halve the size of the feature map corresponding to the above solid nodule edge mask image and the solid nodule edge mask training image.

[0176] In the embodiments of this disclosure and other possible embodiments, before segmenting the chest medical image using a deep learning-based solid nodule segmentation model, the process includes: constructing nodules for each set of chest medical training images in a chest medical training image set and binary mixed location mask training images corresponding to solid nodules within the nodules; training the preset deep learning segmentation network using the binary mixed location mask training images, the solid nodule edge mask training images corresponding to the solid nodules, and the corresponding chest medical training images to obtain a solid nodule segmentation model; and performing solid nodule segmentation on the chest medical image to be segmented (chest medical image) based on the solid nodule segmentation model.

[0177] In the embodiments of this disclosure and other possible embodiments, based on the nodule mask image corresponding to the chest medical image, the nodule image corresponding to the nodule mask image is extracted from the chest medical image; based on the nodule image, one or more of the following are determined: the long diameter of the solid component of the nodule, the proportion of solid component of the nodule to the nodule, and the nodule air bronchogram sign corresponding to the quantitative imaging features of the nodule to be selected.

[0178] In this disclosure and other possible embodiments, detecting the nodule spinous process sign includes: calculating the ratio of the major axis to the minor axis of each nodule in the nodule mask image corresponding to the chest medical image; wherein the chest medical image is configured as a two-dimensional medical image; if the ratio of the major axis to the minor axis is greater than or equal to a first preset ratio of the major axis to the minor axis, then it is determined that the corresponding nodule has a spinous process sign. This addresses at least one of the technical problems currently present, such as the need for manual determination of whether a nodule edge has a spinous process sign, which is too subjective, lacks intelligent determination of whether a nodule edge has a spinous process sign, resulting in a huge workload for doctors and preventing further effective evaluation of radiotherapy efficacy prediction.

[0179] This disclosure also proposes a method for detecting a spinous process sign, comprising: calculating multiple ratios of the major and minor axes of each three-dimensional nodule in a nodule mask image corresponding to the chest medical image; if any one of the major-minor axis ratios is greater than or equal to a first preset major-minor axis ratio, then the corresponding nodule is determined to have a spinous process sign; wherein the chest medical image is configured as a three-dimensional medical image. This addresses at least one of the technical problems currently present, such as the excessive subjectivity of manually determining whether a spinous process sign exists at the nodule edge, the lack of intelligent determination of whether a spinous process sign exists at the nodule edge leading to a huge workload for doctors, and the inability to effectively evaluate the subsequent prediction of radiotherapy efficacy.

[0180] This disclosure also proposes a method for detecting a spinous process sign, comprising: determining whether a chest medical image is a two-dimensional or three-dimensional medical image; if the chest medical image is a two-dimensional medical image, calculating the ratio of the major axis to the minor axis of each nodule in the nodule mask image corresponding to the chest medical image; if the ratio of the major axis to the minor axis is greater than or equal to a first preset ratio of the major axis to the minor axis, determining that the corresponding nodule has a spinous process sign; otherwise, determining that the corresponding nodule does not have a spinous process sign; if the chest medical image is a three-dimensional medical image, calculating multiple ratios of the major axis to the minor axis of each three-dimensional nodule in the nodule mask image corresponding to the chest medical image; if any one of the ratios of the major axis to the minor axis is greater than or equal to the first preset ratio of the major axis to the minor axis, determining that the corresponding nodule has a spinous process sign.

[0181] In this embodiment of the disclosure, determining the major axis corresponding to each three-dimensional nodule includes: performing three-dimensional reconstruction on each nodule mask in the first nodule mask image to obtain a three-dimensional mask nodule corresponding to each nodule mask; performing edge detection on the three-dimensional mask nodule of each nodule mask to obtain three-dimensional nodule mask edges; selecting any three-dimensional edge pixel point from the three-dimensional nodule mask edges; calculating multiple three-dimensional edge pixel point distances between the arbitrary three-dimensional edge pixel point and other three-dimensional edge pixel points; selecting the maximum three-dimensional edge pixel point distance from the multiple three-dimensional edge pixel point distances; and configuring the maximum three-dimensional edge pixel point distance as the major axis corresponding to each three-dimensional nodule.

[0182] In this embodiment of the disclosure, determining the short path corresponding to each nodule includes: performing three-dimensional reconstruction on each nodule mask in the first nodule mask image to obtain a three-dimensional mask nodule corresponding to each nodule mask; performing edge detection on the three-dimensional mask nodule of each nodule mask to obtain the three-dimensional nodule mask edge; selecting any three-dimensional edge pixel in the three-dimensional nodule mask edge; calculating multiple three-dimensional edge pixel distances between the arbitrary three-dimensional edge pixel and other three-dimensional edge pixel; selecting the minimum three-dimensional edge pixel distance from the multiple three-dimensional edge pixel distances; configuring the minimum three-dimensional edge pixel distance as the long path corresponding to each three-dimensional nodule; if the ratio of the long path to the short path is less than the first preset ratio of the long path to the short path, then it is determined that the corresponding nodule does not have a spur sign.

[0183] In this embodiment of the disclosure, determining the nodule mask image corresponding to the chest medical image includes: training a first preset deep learning segmentation network using a preset number of preset site medical training images and their corresponding nodule mask training images to obtain a preset nodule segmentation model; segmenting the nodules in the chest medical image using the preset nodule segmentation model to obtain the corresponding nodule mask image; segmenting the arteries using the preset artery segmentation model to obtain the corresponding artery mask image; and / or, the nodules in the chest medical image are configured as nodules to be treated with chemotherapy or nodules to be operated on.

[0184] In the embodiments disclosed herein and other possible embodiments, the mask value corresponding to each nodule region in the nodule mask image and the nodule mask training image is configured as 1, and the mask value corresponding to non-nodule regions is configured as 0.

[0185] In the embodiments of this disclosure and other possible embodiments, before training the first preset deep learning segmentation network using a preset number of preset site medical training images and their corresponding nodule mask training images, the method includes: using segmentation annotation software CasiaLabeler or Labelme to delineate nodules in the preset number of preset site medical training images to obtain corresponding nodule mask training images.

[0186] In this embodiment of the disclosure, if the nodule has a spinous process, it is determined whether the spinous process corresponding to the nodule is adjacent to an artery based on the nodule mask image and artery mask image corresponding to the chest medical image; if the spinous process corresponding to the nodule is adjacent to an artery, the spinous process is determined to be a dangerous spinous process.

[0187] In this embodiment of the disclosure, if the nodule has a spinous process, it is determined whether the spinous process corresponding to the nodule is adjacent to an artery based on the nodule mask and artery mask image corresponding to the chest medical image; if the spinous process corresponding to the nodule is adjacent to an artery, the spinous process is determined to be a dangerous spinous process.

[0188] In this embodiment of the disclosure, determining whether the spinous process corresponding to the nodule is adjacent to an artery based on the nodule mask image and the artery mask image corresponding to the chest medical image includes: extracting multiple spinous process position coordinates corresponding to multiple spinous processes in the nodule mask image and artery mask edge position coordinates corresponding to the artery mask edge in the artery mask image; calculating multiple distances between the multiple spinous process position coordinates and the artery mask edge position coordinates; if the minimum distance among the multiple distances is less than a preset distance, then it is determined that the spinous process corresponding to the nodule is adjacent to an artery.

[0189] In this embodiment of the disclosure, determining whether the spinous process corresponding to the nodule is adjacent to an artery based on the nodule mask and artery mask image corresponding to the chest medical image includes: extracting multiple spinous process position coordinates corresponding to multiple spinous processes and artery mask edge position coordinates corresponding to the artery mask edge in the nodule mask and artery mask image; calculating multiple distances between the multiple spinous process position coordinates and the artery mask edge position coordinates respectively; if the minimum distance among the multiple distances is less than a preset distance, then it is determined that the spinous process corresponding to the nodule is adjacent to an artery.

[0190] In the embodiments of this disclosure and other possible embodiments, determining the spike includes: detecting the edges of the nodule mask in the nodule mask image to obtain nodule mask edge lines; calculating a first pixel distance and a second pixel distance between any nodule mask edge pixel on the nodule mask edge line and its adjacent nodule mask edge pixels; if the first pixel distance and the second pixel distance are greater than a set pixel distance, then configuring the arbitrary nodule mask edge pixel as a spike.

[0191] In this disclosure and other possible embodiments, determining whether the location of the nodule corresponding to the nodule to be treated or the nodule to be operated on is adjacent to an artery based on the nodule mask image and the artery mask image includes: calculating multiple positional distances between the artery edge mask position coordinates corresponding to the artery mask image and the nodule edge mask position coordinates corresponding to the nodule mask image; if the minimum positional distance among the multiple positional distances is less than or equal to a preset positional distance, then the nodule location is determined to be adjacent to an artery; otherwise, the nodule location is determined to be far from an artery. The artery edge mask position coordinates and the nodule edge mask position coordinates corresponding to the nodule are respectively configured as the position coordinates of the artery edge in the artery edge mask image corresponding to the artery mask image and the position coordinates of the nodule edge mask in the nodule edge mask image corresponding to the nodule mask image.

[0192] In this embodiment and other possible embodiments, determining whether the location of the nodule corresponding to the nodule to be treated or the nodule to be operated on is adjacent to an artery based on the nodule mask and artery mask images includes: calculating multiple positional distances between the artery edge mask position coordinates corresponding to the nodule mask and the artery mask image and the nodule edge mask position coordinates; if the minimum positional distance among the multiple positional distances is less than or equal to a preset positional distance, then the nodule location is determined to be adjacent to an artery; otherwise, the nodule location is determined to be far from an artery. The artery edge mask position coordinates and the nodule edge mask position coordinates corresponding to the nodule are respectively configured as the position coordinates of the artery edge in the artery edge mask and the position coordinates of the nodule edge mask in the nodule mask and artery mask image.

[0193] In the embodiments disclosed herein and other possible embodiments, those skilled in the art can configure the preset position distance according to actual needs. For example, the preset position distance can be any value between 0 and 10 pixels or other values.

[0194] In the embodiments disclosed herein and other possible embodiments, the location of nodules and their proximity to arteries are of significant clinical importance for indicating disease type, assisting in differential diagnosis, and facilitating subsequent chemotherapy and surgery. It is necessary to propose a technical solution for nodule location determination and intelligent medical image processing system to address at least one of the following technical problems: the current reliance on manual determination of nodule location and proximity to arteries leads to excessive subjectivity; the lack of intelligent determination results in a heavy workload for doctors; and it prevents effective evaluation of subsequent radiotherapy efficacy prediction.

[0195] In the embodiments disclosed herein and other possible embodiments, the step of determining the nodule mask image and arterial mask image corresponding to the nodule to be treated or the nodule to be operated on using chest medical images includes: training a first preset deep learning segmentation network using a preset number of preset location medical training images and their corresponding nodule mask training images to obtain a preset nodule segmentation model; training a second preset deep learning segmentation network using a preset number of preset location medical training images and their corresponding arterial mask training images to obtain a preset arterial segmentation model; segmenting the nodule to be treated or the nodule to be operated on in the chest medical image using the preset nodule segmentation model to obtain the corresponding nodule mask image; and segmenting the arterial vessels using the preset arterial segmentation model to obtain the corresponding arterial mask image.

[0196] In the embodiments disclosed herein and other possible embodiments, the step of using chest medical images to determine the nodule mask and arterial vessel mask images corresponding to the nodules to be treated or the nodules to be operated on includes: training a preset deep learning segmentation network using a preset number of preset site medical training images and their corresponding nodule mask and arterial vessel mask training images to obtain a preset nodule and arterial vessel segmentation model; and segmenting the nodules to be treated or the nodules to be operated on and the arterial vessels using the preset nodule and arterial vessel segmentation model to obtain the corresponding nodule mask and arterial vessel mask images.

[0197] In the embodiments disclosed herein and other possible embodiments, the mask value corresponding to each nodule region in the nodule mask image and the nodule mask training image is configured as 1, and the mask value corresponding to the non-nodule region is configured as 0; similarly, the mask value corresponding to the artery in the artery mask image and the artery mask training image is configured as 1, and the mask value corresponding to the non-artery region is configured as 0.

[0198] In the embodiments disclosed herein and other possible embodiments, the mask value corresponding to each nodule region in the nodule mask and artery mask image and the nodule mask and artery mask training image is configured as 1, the mask value corresponding to the artery is configured as 2, and the mask value corresponding to the non-nodule region and non-artery region is configured as 0.

[0199] In the embodiments of this disclosure and other possible embodiments, before training the first preset deep learning segmentation network using a preset number of preset site medical training images and their corresponding nodule mask training images, the method includes: using segmentation annotation software CasiaLabeler or Labelme to delineate nodules in the preset number of preset site medical training images to obtain corresponding nodule mask training images.

[0200] In the embodiments of this disclosure and other possible embodiments, before training the second preset deep learning segmentation network using a preset number of preset site medical training images and their corresponding arterial blood vessel mask training images, the method includes: using segmentation annotation software CasiaLabeler or Labelme to delineate arteries and blood vessels in the preset number of preset site medical training images to obtain corresponding arterial blood vessel mask training images.

[0201] In the embodiments of this disclosure and other possible embodiments, before training the preset deep learning segmentation network using a preset number of preset site medical training images and their corresponding nodule masks and artery mask training images, the method includes: using segmentation annotation software CasiaLabeler or Labelme to delineate nodules and arteries in the preset number of preset site medical training images to obtain corresponding nodule masks and artery mask training images.

[0202] In the embodiments disclosed herein and other possible embodiments, the preset deep learning segmentation network, the first preset deep learning segmentation network and the second preset deep learning segmentation network are configured as one or more deep learning segmentation networks such as Fully Convolutional Network (FCN), U-Net, DeepLab, Pyramid Spatial Pooling Network (PSPNet).

[0203] In the embodiments of this disclosure and other possible embodiments, if the edge of the nodule has a spiky sign, determining whether the nodule in the chest medical image is a nodule to be treated with chemotherapy or a nodule to be operated on includes: detecting whether the nodule boundary in the nodule mask image corresponding to the chest medical image is blurred; if the nodule boundary in the nodule mask image is blurred, then the nodule is configured as a nodule to be treated with chemotherapy or a nodule to be operated on.

[0204] In the embodiments disclosed herein and other possible embodiments, if the nodule edge has a spiky sign, determining whether the nodule in the chest medical image is a nodule to be treated with chemotherapy or a nodule to be operated on includes: detecting whether the nodule boundary in the nodule and arterial mask image corresponding to the chest medical image is blurred and whether the nodule edge has a spiky sign; if the nodule boundary in the nodule and arterial mask image is blurred and the nodule edge has a spiky sign, then the nodule is configured as a nodule to be treated with chemotherapy or a nodule to be operated on.

[0205] In the embodiments of this disclosure and other possible embodiments, determining whether the nodule boundary is blurred includes: mapping the nodule location coordinates in the nodule masking image to a chest medical image; calculating multiple gradients corresponding to the nodule location coordinates in the chest medical image; if the gradient magnitude value corresponding to the multiple gradients is less than a preset gradient magnitude value, then the nodule boundary where the nodule location corresponding to the preset gradient magnitude value is located is determined to be blurred.

[0206] In the embodiments disclosed herein and other possible embodiments, if the gradient magnitude value corresponding to the plurality of gradients is greater than or equal to a preset gradient magnitude value, then the boundary of the nodule corresponding to the location of the nodule that is greater than or equal to the preset gradient magnitude value is determined to be clear.

[0207] In the embodiments of this disclosure and other possible embodiments, before mapping the nodule location coordinates in the nodule masking image to the chest medical image, the method includes: performing an erosion operation on the nodule mask in the nodule masking image corresponding to the chest medical image to obtain a nodule mask erosion image; and subtracting the nodule mask erosion image from the nodule masking image to obtain a nodule masking image.

[0208] In the embodiments disclosed herein and other possible embodiments, determining the gradient magnitude corresponding to the plurality of gradients includes: squaring the plurality of x-direction gradients corresponding to the nodule position coordinates to obtain a plurality of x-direction squared gradients; squaring the plurality of y-direction gradients corresponding to the nodule position coordinates to obtain a plurality of y-direction squared gradients; summing the plurality of x-direction squared gradients with their corresponding y-direction squared gradients to obtain a gradient sum corresponding to the plurality of nodule position coordinates; and taking the square root of the gradient sum corresponding to the plurality of nodule position coordinates to obtain the gradient magnitude corresponding to the plurality of gradients.

[0209] In the embodiments of this disclosure and other possible embodiments, the step of calculating multiple gradients corresponding to the nodule location coordinates in the chest medical image includes: determining multiple first position coordinates and multiple second position coordinates on both sides of the nodule location coordinates in the chest medical image in the x-direction, and multiple third position coordinates and multiple fourth position coordinates in the y-direction, based on the nodule location coordinates; calculating the differences between the first pixel values ​​corresponding to the multiple first position coordinates and the second pixel values ​​corresponding to the multiple second position coordinates to obtain multiple x-direction gradients corresponding to the nodule location coordinates; calculating the differences between the third pixel values ​​corresponding to the multiple third position coordinates and the fourth pixel values ​​corresponding to the multiple fourth position coordinates to obtain multiple y-direction gradients corresponding to the nodule location coordinates; and configuring the multiple x-direction gradients and their corresponding multiple y-direction gradients as multiple gradients corresponding to the nodule location coordinates.

[0210] In the embodiments disclosed herein and other possible embodiments, determining multiple first position coordinates and multiple second position coordinates corresponding to both sides of the nodule position coordinates in the x-direction in the chest medical image based on the nodule position coordinates includes: using the nodule position coordinates to determine multiple first position coordinates and multiple second position coordinates corresponding to both sides in the x-direction according to a preset distance; and / or, determining multiple third position coordinates and multiple fourth position coordinates corresponding to both sides of the nodule position coordinates in the y-direction in the chest medical image based on the nodule position coordinates includes: using the nodule position coordinates to determine multiple third position coordinates and multiple fourth position coordinates corresponding to both sides in the x-direction according to a preset distance.

[0211] In the embodiments disclosed herein and other possible embodiments, those skilled in the art can configure the preset distance according to actual needs. For example, the nodule location coordinates can be configured as (x1, y1), (x2, y2), ..., (x... n ,y n ), respectively determine the coordinates of multiple first positions (x1+1, y1), (x2+1, y2), ..., (x2+1, y2) in the x-direction on both sides according to the 1 pixel value corresponding to the preset distance. n +1,y n ) and multiple second position coordinates (x1-1, y1), (x2-1, y2), ..., (x n -1,y n For example, the nodule location coordinates are configured as (x1, y1), (x2, y2), ..., (x... n ,y n ), respectively determine the coordinates of multiple first positions (x1, y1+1), (x2, y2+1), ..., (x2, y2+1) in the x-direction on both sides according to the 1 pixel value corresponding to the preset distance. n ,yn +1) and multiple second position coordinates (x1, y1-1), (x2, y2-1), ..., (x n ,y n -1).

[0212] In the embodiments disclosed herein and other possible embodiments, those skilled in the art can configure the preset gradient magnitude value according to actual needs. For example, the preset gradient magnitude value can be configured as any value between 2 and 80 or other values.

[0213] In the embodiments of this disclosure and other possible embodiments, locating the location of the nodules includes: using a dynamic lung field region segmentation method to segment the lung field region of the chest medical image to obtain a lung field region segmentation network corresponding to each nodule; and locating the lung field anatomical region corresponding to each nodule based on the location of each nodule and its corresponding lung field region segmentation network.

[0214] In the embodiments of this disclosure and other possible embodiments, the method of using dynamic lung field region division to divide the lung field region of the chest medical image includes: Step S101: Constructing a set of nodule locations corresponding to all nodule regions using the nodule mask image corresponding to nodules in the lung field of the chest medical image; Step S102: Traversing the area or volume corresponding to each nodule location in the set of nodule locations to determine the minimum nodule area or minimum nodule volume of all nodule locations; Step S103: Dividing the lung field region in the lung field mask image using a preset grid corresponding to the minimum grid area or minimum grid volume of all nodule locations; Step S104: Deleting the nodule location corresponding to the minimum grid area or minimum grid volume in the set of nodule locations to update the set of nodule locations; Step S105: Repeating steps S102-S104 until the lung field region division is completed using all nodule locations in the set of nodule locations. To address at least one of the following technical problems: excessive subjectivity in nodule location, lack of intelligent nodule location, resulting in a huge workload for doctors and preventing further prediction of lymph node metastasis in partially solid lung adenocarcinoma.

[0215] In the embodiments disclosed herein and other possible embodiments, each grid in the preset grid predefines a lung field anatomical region; the location of each nodule is configured as the coordinate point corresponding to each nodule in a chest medical image.

[0216] For example, in the embodiments of this disclosure and other possible embodiments, if the chest medical image is configured as a two-dimensional chest medical image, then the coordinate point of each nodule in the chest medical image is a two-dimensional coordinate (x, y); if the chest medical image is configured as a three-dimensional chest medical image, then the coordinate point of each nodule in the chest medical image is a two-dimensional coordinate (x, y, z).

[0217] In the embodiments disclosed herein and other possible embodiments, the two-dimensional chest medical image can be configured as a chest X-ray image or a chest ultrasound image; the three-dimensional chest medical image can be configured as one or more of a chest CT image, a chest MRI image, a chest PET image, a chest CT-PET image, and a chest MRI-PET image. Furthermore, the two-dimensional chest medical image can also be configured as one or more corresponding chest projection images of a chest CT image, a chest MRI image, a chest PET image, a chest CT-PET image, and a chest MRI-PET image.

[0218] In the embodiments disclosed herein and other possible embodiments, if the chest medical image is configured as a two-dimensional chest medical image, the area corresponding to each nodule location in the nodule location set is traversed to determine the minimum nodule area of ​​all nodule locations; a preset grid corresponding to the minimum grid area of ​​all nodule locations is used to divide the lung field region in the lung field mask image; the nodule location corresponding to the minimum grid area in the nodule location set is deleted to update the nodule location set; and / or, if the chest medical image is configured as a three-dimensional chest medical image, the area or volume corresponding to each nodule location in the nodule location set is traversed to determine the minimum nodule volume of all nodule locations; a preset grid corresponding to the minimum grid volume of all nodule locations is used to divide the lung field region in the lung field mask image; the nodule location corresponding to the minimum grid volume in the nodule location set is deleted to update the nodule location set.

[0219] For example, in embodiments of this disclosure and other possible embodiments, the predefined lung field anatomical regions can be configured to longitudinally divide the lungs into upper, middle, and lower lung fields, with the lower borders of the 2nd and 4th anterior ribs as boundaries, and to transversely divide each lung field vertically into an inner zone (near the mediastinum), a middle zone, and an outer zone (near the chest wall). The lung field anatomical regions can also be configured as the apical region corresponding to the area surrounded by the outer border of the 1st rib, and the subclavian region corresponding to the area between the lower border of the clavicle and the lower border of the 2nd anterior rib. The predefined lung field anatomical regions can also be configured as the upper, middle, and lower lobes of the right lung and the upper and lower lobes of the left lung; wherein the upper lobe of the left lung may include the lingular segment. The predefined lung field anatomical regions can be configured as lung segments corresponding to independent distribution units of bronchi and blood vessels, each lung segment having independent bronchial and vascular bundles; the upper lobe corresponding to the right lung may include the apical segment, posterior segment, and anterior segment; the middle lobe corresponding to the right lung may include the lateral segment and medial segment; the lower lobe corresponding to the right lung may include the dorsal segment, medial basal segment, anterior basal segment, lateral basal segment, and posterior basal segment; the upper lobe corresponding to the left lung may include the apical-posterior segment, anterior segment, superior lingular segment, and inferior lingular segment; the lower lobe corresponding to the left lung may include the dorsal segment, medial anterior basal segment, lateral basal segment, and posterior basal segment.

[0220] In the embodiments disclosed herein and other possible embodiments, the predefined lung field anatomical regions can be arbitrarily combined without violating the anatomical structure of the lung field.

[0221] In the embodiments of this disclosure and other possible embodiments, determining the nodule mask image corresponding to nodules in the lung field of a chest medical image includes: performing nodule segmentation on the chest medical image using a preset nodule segmentation model constructed based on a deep learning segmentation network, and determining the nodule mask image of the chest medical image.

[0222] In the embodiments of this disclosure and other possible embodiments, before segmenting the chest medical image into nodules using the preset segmentation model constructed based on a deep learning segmentation network, the method includes: training the preset deep learning segmentation network using a preset number of chest medical images and their corresponding nodule mask training images to obtain the preset nodule segmentation model constructed based on the deep learning segmentation network.

[0223] In the embodiments of this disclosure and other possible embodiments, before training the preset deep learning segmentation network, the method includes: using segmentation annotation software to delineate nodules on a preset number of chest medical images to obtain corresponding nodule mask training images.

[0224] In the embodiments of this disclosure and other possible embodiments, before training a preset deep learning segmentation network using a preset number of chest medical images and their corresponding nodule mask training images to obtain a preset segmentation model constructed based on the deep learning segmentation network, the method includes: using segmentation annotation software CasiaLabeler or Labelme to delineate nodules on the preset number of chest medical images to obtain corresponding nodule mask training images. Those skilled in the art can configure the preset number according to actual needs. For example, the preset number can be configured as 300-500.

[0225] In the embodiments disclosed herein and other possible embodiments, the preset deep learning segmentation network is configured as one or more deep learning segmentation networks such as Fully Convolutional Network (FCN), U-Net, DeepLab, and Pyramid Spatial Pooling Network (PSPNet).

[0226] In this disclosure and other possible embodiments, the method further includes: determining whether each nodule is adjacent to a pulmonary artery.

[0227] In the embodiments disclosed herein and other possible embodiments, determining whether each nodule is adjacent to a pulmonary artery includes: calculating multiple positional distances between the pulmonary artery edge mask position coordinates corresponding to the pulmonary artery mask image of the chest medical image and the nodule edge mask position coordinates corresponding to the nodule mask image; if the minimum positional distance among the multiple positional distances is less than or equal to a preset positional distance, then the nodule position is determined to be adjacent to a pulmonary artery; otherwise, the nodule position is determined to be far from a pulmonary artery.

[0228] In the embodiments of this disclosure and other possible embodiments, determining the pulmonary artery mask image of the chest medical image includes: segmenting the chest medical image into pulmonary arteries using a preset pulmonary artery segmentation model constructed based on a deep learning segmentation network, and determining the pulmonary artery mask image of the chest medical image.

[0229] In the embodiments of this disclosure and other possible embodiments, before segmenting the chest medical image into pulmonary arteries using a preset segmentation model constructed based on a deep learning segmentation network, the method includes: training a preset deep learning segmentation network using a preset number of chest medical images and their corresponding pulmonary artery mask training images to obtain a preset pulmonary artery segmentation model constructed based on the deep learning segmentation network. In the embodiments of this disclosure and other possible embodiments, before training the preset deep learning segmentation network, the method includes: using segmentation annotation software to delineate the pulmonary artery vessels in a preset number of chest medical images to obtain corresponding pulmonary artery vessel mask training images.

[0230] In the embodiments disclosed herein and other possible embodiments, the pulmonary artery edge mask position coordinates and the nodule edge mask position coordinates corresponding to the nodule are respectively configured as the position coordinates of the pulmonary artery edge in the pulmonary artery edge mask image corresponding to the pulmonary artery mask image and the position coordinates of the nodule edge mask in the nodule edge mask image corresponding to the nodule mask image.

[0231] In the embodiments of this disclosure and other possible embodiments, before training a preset deep learning segmentation network using a preset number of chest medical images and their corresponding pulmonary artery vascular mask training images to obtain a preset segmentation model constructed based on the deep learning segmentation network, the method includes: using segmentation annotation software CasiaLabeler or Labelme to delineate the pulmonary arteries in the preset number of chest medical images to obtain corresponding pulmonary artery vascular mask training images. Those skilled in the art can configure the preset number according to actual needs. For example, the preset number can be configured as 300-500.

[0232] Similarly, in the embodiments disclosed herein and other possible embodiments, the preset deep learning segmentation network is configured as one or more deep learning segmentation networks such as Fully Convolutional Network (FCN), U-Net, DeepLab, and Pyramid Spatial Pooling Network (PSPNet).

[0233] In the embodiments disclosed herein and other possible embodiments, those skilled in the art can configure the preset position distance according to actual needs. For example, the preset position distance can be any value between 0 and 10 pixels or other values.

[0234] In the embodiments disclosed herein and other possible embodiments, the location of nodules and their proximity to pulmonary arteries are of significant clinical importance for indicating disease type, assisting in differential diagnosis, and subsequent chemotherapy and surgery. This addresses at least one of the technical problems currently present, such as the need for manual determination of nodule location and proximity to pulmonary arteries, which is too subjective, lacks intelligent determination of nodule location and proximity to pulmonary arteries, resulting in a huge workload for doctors and preventing further surgery, as well as the prediction of lymph node metastasis in some solid lung adenocarcinomas.

[0235] In this embodiment of the disclosure, determining the nodule lobulation sign includes: performing an erosion operation on the nodule mask image corresponding to each nodule in the chest medical image to obtain a nodule mask erosion image; subtracting the corresponding nodule mask erosion image from the nodule mask image of each nodule to obtain a nodule mask processing image corresponding to each nodule; judging the nodule morphology in the nodule mask processing image corresponding to each nodule; if the nodule morphology is irregular, determining whether the nodule lobulation sign exists based on the nodule mask processing image corresponding to each nodule.

[0236] In the embodiments of this disclosure and other possible embodiments, the method for determining the nodule lobulation sign includes: determining a nodule mask processing image corresponding to each nodule in a nodule mask image of a chest medical image; judging the nodule morphology in the nodule mask processing image corresponding to each nodule; if the nodule morphology is irregular, determining whether the nodule lobulation sign exists based on the nodule mask processing image corresponding to each nodule.

[0237] In the embodiments of this disclosure and other possible embodiments, the step of determining the nodule morphology in the nodule mask processing image corresponding to each nodule includes: extracting multiple nodule mask position coordinates corresponding to the nodule mask lines in the nodule mask processing image corresponding to each nodule; fitting or reconstructing the multiple nodule mask position coordinates corresponding to each nodule to determine the nodule morphology corresponding to each nodule; and determining whether the nodule morphology is regular based on the nodule morphology corresponding to each nodule.

[0238] In the embodiments of this disclosure and other possible embodiments, the step of processing the image based on the nodule mask corresponding to each nodule to determine whether there is nodule lobulation feature includes: extracting the nodule mask line corresponding to each nodule respectively; if the shape of the nodule mask line is an arc-shaped protrusion connected together, then the corresponding nodule has nodule lobulation feature; otherwise, nodule lobulation feature exists.

[0239] In the embodiments disclosed herein and other possible embodiments, the step of processing the image based on the nodule mask corresponding to each nodule to determine whether there is nodule lobulation feature further includes: segmenting the nodule mask line according to its concave part to obtain multiple arc-shaped convex line segments; determining whether the arc-shaped convex is a tip based on the slope corresponding to each pixel in the multiple arc-shaped convex line segments; if it is a tip, the corresponding nodule does not have nodule lobulation feature and the nodule has spur feature; if there is no tip, the corresponding nodule has nodule lobulation feature.

[0240] In the embodiments disclosed herein and other possible embodiments, determining whether the arc-shaped protrusion is a tip based on the slope corresponding to each pixel point in the multiple arc-shaped protrusion segments includes: mapping the multiple arc-shaped protrusion segments to a Cartesian coordinate system, wherein the coordinate point corresponding to the arc-shaped protrusion of the multiple arc-shaped protrusion segments is the highest pixel point of the arc-shaped protrusion segment in the Cartesian coordinate system; calculating the left derivative and right derivative corresponding to the highest pixel point; if the difference between the left derivative and the right derivative is less than or equal to a set difference, then the arc-shaped protrusion is determined to be a tip; otherwise, the arc-shaped protrusion is determined to be a non-tip.

[0241] In the embodiments disclosed herein and other possible embodiments, those skilled in the art can configure the set difference value as needed. For example, the set difference value can be configured as 1, 2, or other possible values.

[0242] In the embodiments of this disclosure and other possible embodiments, the step of fitting or reconstructing the multiple nodule mask position coordinates corresponding to each nodule to determine the nodule morphology includes: under the optimal criterion, approximating multiple preset closed curve equations or multiple preset closed surface equations using the multiple nodule mask position coordinates corresponding to each nodule to determine the nodule morphology corresponding to each nodule.

[0243] In the embodiments disclosed herein and other possible embodiments, the step of approximating a preset closed curve equation or a preset closed surface equation using the multiple nodule mask position coordinates corresponding to each nodule under the optimal criterion to determine the nodule morphology corresponding to each nodule includes: under the optimal criterion, minimizing the error or absolute residual of the nodule mask position coordinates between the approximation equations and the multiple near-preset closed curve equations or multiple preset closed surface equations when the multiple nodule mask position coordinates corresponding to each nodule approximate the multiple preset closed curve equations or multiple preset closed surface equations, thereby determining the nodule morphology corresponding to each nodule.

[0244] In the embodiments of this disclosure and other possible embodiments, before determining the nodule mask processing image corresponding to the nodule in the nodule mask image of the chest medical image, the method includes: using a preset nodule segmentation model constructed based on a deep learning segmentation network to segment the chest medical image into nodules, and determining the nodule mask image of the chest medical image.

[0245] In the embodiments of this disclosure and other possible embodiments, before segmenting chest medical images into nodules using a preset segmentation model constructed based on a deep learning segmentation network, the method includes: training a preset deep learning segmentation network using a preset number of chest medical images and their corresponding nodule mask training images to obtain a preset nodule segmentation model constructed based on the deep learning segmentation network.

[0246] In this embodiment, determining the nodule vacuolation sign includes: performing nodule vacuolation sign target detection on each nodule in a chest medical image, configuring the nodules corresponding to detected nodule vacuolation signs as having nodule vacuolation signs; extracting the average pixel value of the nodule edge corresponding to the nodule for which nodule vacuolation signs were not detected; if the average pixel value corresponding to the nodule for which nodule vacuolation signs were not detected is less than the corresponding average pixel value of the nodule edge, then it is determined that the nodule for which nodule vacuolation signs were not detected has nodule vacuolation signs; otherwise, it is determined that the nodule for which nodule vacuolation signs were not detected does not have nodule vacuolation signs. This addresses at least one of the technical problems in existing methods, such as the need for manual determination of nodule vacuolation, which is too subjective, lacks intelligent determination of nodule vacuolation, resulting in a huge workload for doctors, and prevents further surgical procedures and prediction of lymph node metastasis in some solid lung adenocarcinomas.

[0247] In the embodiments of this disclosure and other possible embodiments, unlike the prior art, the technical solution proposed in this disclosure, by performing target detection of nodule vacuolation sign on each nodule in chest medical images, and using the average pixel value of the nodule edge corresponding to the nodule where nodule vacuolation sign was not detected, further processing of the nodules where nodule vacuolation sign was not detected, can effectively solve the technical problem of missed detection of nodule vacuolation sign. By using the average pixel value of the nodule edge corresponding to the nodule where nodule vacuolation sign was not detected, the robustness of the method for determining whether nodule where nodule vacuolation sign was not detected is improved to a certain extent. At the same time, it avoids at least one of the technical problems of existing methods that require manual determination of the existence of nodule vacuolation, which is too subjective and lacks intelligent determination of nodule vacuolation, resulting in a huge workload for doctors and preventing further surgery, lymph node metastasis prediction in some solid lung adenocarcinomas.

[0248] In the embodiments of this disclosure and other possible embodiments, the nodule cavitation target detection for each nodule in the chest medical image includes: using a deep learning-based nodule cavitation target detection model to perform nodule cavitation target detection for each nodule in the chest medical image.

[0249] In the embodiments of this disclosure and other possible embodiments, before performing nodule cavitation target detection on each nodule in the chest medical image using a deep learning-based nodule cavitation target detection model, the method includes: training a preset deep learning target detection network to obtain a deep learning-based nodule cavitation target detection model.

[0250] In the embodiments of this disclosure and other possible embodiments, training a preset deep learning target detection network to obtain a deep learning-based target detection model for nodule cavitation includes: training the preset deep learning target detection network using a preset number of chest medical training images and their corresponding nodule cavitation target training images to obtain a deep learning-based target detection model for nodule cavitation.

[0251] In the embodiments disclosed herein and other possible embodiments, before training the preset deep learning target detection network, the method includes: using segmentation and annotation software to delineate nodular vacuolation sign bounding boxes on a preset number of chest medical images to obtain corresponding nodular vacuolation sign target training images. For example, annotation software such as CasiaLabeler or Labelme can be used to delineate nodular vacuolation sign bounding boxes on a preset number of chest medical images to obtain corresponding nodular vacuolation sign target training images. Those skilled in the art can configure the preset number according to actual needs. For example, the preset number can be configured as 300-500 or other possible values.

[0252] In the embodiments disclosed herein and other possible embodiments, the preset deep learning object detection network may be configured as a YOLO series or an object detection network based on YOLO.

[0253] In this disclosure and other possible embodiments, determining the total number of nodules corresponding to the chest medical image includes: performing nodule segmentation or nodule target detection on the chest medical image to determine the total number of nodules corresponding to the chest medical image; and / or, performing nodule segmentation on the chest medical image includes: performing nodule segmentation on the chest medical image using a preset nodule segmentation model constructed based on a deep learning segmentation network. Wherein, performing nodule target detection on the chest medical image includes: performing nodule target detection on the chest medical image using a deep learning-based nodule target detection model.

[0254] In the embodiments of this disclosure and other possible embodiments, a preset nodule segmentation model based on a deep learning segmentation network is used to segment the chest medical image into nodules to obtain corresponding nodule mask images; the number of nodule masks corresponding to the nodule mask images is counted to determine the total number of nodules corresponding to the chest medical image.

[0255] In the embodiments of this disclosure and other possible embodiments, a nodule target detection model based on deep learning is used to detect nodules in the chest medical image to obtain corresponding nodule detection images; the number of nodule detection boxes on the nodule detection images is counted to determine the total number of nodules corresponding to the chest medical image.

[0256] In the embodiments of this disclosure and other possible embodiments, before performing nodule segmentation on the chest medical image using a preset nodule segmentation model constructed based on a deep learning segmentation network, the process includes: training a preset deep learning segmentation network using a preset number of chest medical images and their corresponding nodule mask training images to obtain a preset nodule segmentation model constructed based on the deep learning segmentation network.

[0257] In the embodiments of this disclosure and other possible embodiments, before training the preset deep learning segmentation network, the method includes: using segmentation annotation software to delineate nodules on a preset number of chest medical images to obtain corresponding nodule mask training images.

[0258] In the embodiments of this disclosure and other possible embodiments, the step of extracting the pixel values ​​of the nodule edges corresponding to nodules for which nodule cavitation was not detected includes: performing edge detection on the nodule mask image corresponding to the nodule for which nodule cavitation was not detected to obtain a nodule edge image; performing pixel-level multiplication on the nodule edge image and its corresponding chest medical image to obtain a nodule edge image; and extracting the pixel values ​​corresponding to the nodule edges in the nodule edge image to obtain the corresponding nodule edge pixel values.

[0259] In the embodiments of this disclosure and other possible embodiments, the step of performing edge detection on the nodule mask image corresponding to the nodule where nodule cavitation was not detected to obtain a nodule edge image includes: performing an erosion operation on the nodule mask image corresponding to the nodule where nodule cavitation was not detected to obtain a nodule mask erosion image; and subtracting the corresponding nodule mask erosion image from the nodule mask image to obtain a nodule edge image.

[0260] In the embodiments of this disclosure and other possible embodiments, the step of extracting the average pixel value of the nodule edge corresponding to the nodule for which nodule cavitation was not detected includes: performing edge detection on the nodule mask image corresponding to the nodule for which nodule cavitation was not detected to obtain a nodule edge image; performing pixel-level multiplication on the nodule edge image and its corresponding chest medical image to obtain a nodule edge image; extracting the pixel value corresponding to the nodule edge in the nodule edge image to obtain the corresponding nodule edge pixel value; and calculating the average value of the nodule edge pixel value to obtain the average pixel value of the nodule edge.

[0261] In the embodiments of this disclosure and other possible embodiments, the step of performing edge detection on the nodule mask image corresponding to the nodule where nodule cavitation was not detected to obtain a nodule edge image includes: performing an erosion operation on the nodule mask image corresponding to the nodule where nodule cavitation was not detected to obtain a nodule mask erosion image; and subtracting the corresponding nodule mask erosion image from the nodule mask image to obtain a nodule edge image.

[0262] In the embodiments of this disclosure and other possible embodiments, determining whether a nodule without detected nodule cavitation exists based on the average pixel value corresponding to the nodule without detected nodule cavitation and the corresponding average pixel value of the nodule edge includes: if the average pixel value corresponding to the nodule without detected nodule cavitation is less than the corresponding average pixel value of the nodule edge, then it is determined that the nodule without detected nodule cavitation exists; otherwise, it is determined that the nodule without detected nodule cavitation does not exist.

[0263] In this embodiment of the disclosure, the method further includes: acquiring preset clinical information corresponding to the chest medical image at the first time point; using preset quantitative imaging features of nodules corresponding to partial solid lung adenocarcinoma in the chest medical image at the first time point, the preset clinical information, and the pathological results of lymph nodes in partial solid lung adenocarcinoma corresponding to metastasis or non-metastasis at the second time point after the first time point, training a preset predictor to construct a lymph node metastasis prediction model; and using the lymph node metastasis prediction model, the preset quantitative imaging features of nodules corresponding to partial solid lung adenocarcinoma in the chest medical image to be predicted, and the preset clinical information, predicting lymph node metastasis in partial solid lung adenocarcinoma.

[0264] In this embodiment of the disclosure, determining the preset clinical information corresponding to the chest medical image at the first moment includes: acquiring candidate clinical information corresponding to the chest medical image at the first moment; and using a univariate logistic regression analysis algorithm, the candidate clinical information and its corresponding lymph node pathology results in the partial solid lung adenocarcinoma, performing univariate logistic regression on each candidate clinical information feature to determine the preset clinical information related to the lymph node pathology results in the partial solid lung adenocarcinoma. In this embodiment of the disclosure, the clinical information to be selected is configured as one or more of age, gender, smoking history, and history of lung cancer. Prior to training the preset predictor, the process includes: standardizing or normalizing the numerical clinical information to be selected, and encoding the categorized clinical information to be selected.

[0265] In the embodiments of this disclosure and other possible embodiments, for example, before training the preset predictor, the age corresponding to the clinical information to be selected is standardized or normalized, and one or more of the gender, smoking history, and history of lung cancer corresponding to the categorized clinical information to be selected are encoded.

[0266] In this disclosure and other possible embodiments, for example, encoding processing is performed on one or more of the following clinical information to be selected by category: gender, smoking history, and presence or absence of a history of lung cancer. This includes: configuring a first value for males; configuring a second value for females; configuring a first value for those with a smoking history; configuring a second value for those without a smoking history; configuring a first value for those with a history of lung cancer; and configuring a second value for those with a history of lung cancer.

[0267] In the embodiments disclosed herein and other possible embodiments, those skilled in the art can configure the first value and the second value according to actual needs. For example, the first value and the second value can be configured as 1 and 0, respectively.

[0268] In the embodiments of this disclosure and other possible embodiments, determining whether the artery passes through the lesion to be treated or operated on, based on the lesion mask region corresponding to the lesion to be treated or operated on and the artery mask region corresponding to the artery, includes: extracting the lesion mask position coordinates corresponding to the lesion mask region of the lesion to be treated or operated on and the artery mask region of the artery to be treated, respectively; if the artery mask position coordinates and the lesion mask position coordinates overlap, it is determined that the artery passes through the lesion to be treated or operated on; otherwise, it is determined that the artery does not pass through the lesion to be treated or operated on.

[0269] In the embodiments disclosed herein and other possible embodiments, if the artery passes through the lesion to be treated with chemotherapy or the lesion to be operated on, radiotherapy is performed on the artery passing through the lesion under ultrasound image guidance at a first radiotherapy dose, and radiotherapy is performed on the lesion outside the artery under ultrasound image guidance at a second radiotherapy dose lower than the first radiotherapy dose. This addresses the issue that tumor cells corresponding to the lesion may be affected by blood flow in the blood vessels, and the concentration of chemotherapy drugs in the local tumor area may be easily diluted, leading to reduced efficacy and increased risk of residual cancer cells and recurrence.

[0270] In the embodiments of this disclosure and other possible embodiments, determining the imaging features used to distinguish the lesion type from the similar lesion type includes: extracting multiple first imaging parameters to be distinguished from lesions in multiple first preset locations to be distinguished corresponding to the lesion type, and multiple second imaging parameters to be distinguished from lesions in multiple second preset locations to be distinguished corresponding to the similar lesion type; determining corresponding quantitative imaging parameters and count imaging parameters based on the multiple first imaging parameters to be distinguished and the multiple second imaging parameters to be distinguished; and using a feature filtering algorithm to filter the risk factor imaging parameters constructed from the quantitative imaging parameters and the count imaging parameters to obtain imaging features used to distinguish the lesion type from the similar lesion type.

[0271] In the embodiments of this disclosure and other possible embodiments, the imaging features used to distinguish the lesion type from the similar lesion type include: one or more imaging features such as the average gray value corresponding to the lesion, the ratio of the long diameter to the short diameter corresponding to the lesion, whether the lesion is located near an artery, and whether there is a spike sign at the edge of the lesion.

[0272] In the embodiments of this disclosure and other possible embodiments, determining the average gray value corresponding to the lesion includes: performing a pixel-level multiplication operation on the medical image of the preset location and its corresponding lesion mask image to obtain a lesion medical image; calculating the average pixel value of the lesion medical image to obtain the average gray value corresponding to the lesion.

[0273] For example, if the lesion type in the CT scan of the vertebral body corresponding to the preset site medical image is configured as osteoblastic bone metastasis, then the similar lesion type is configured as bone island. If the lesion type in the CT scan of the chest or X-ray of the chest corresponding to the preset site medical image is configured as pneumonia (common pneumonia), then the similar lesion type is configured as pneumonia caused by novel coronavirus. If the lesion type in the CT scan of the chest or X-ray of the chest corresponding to the preset site medical image is configured as ground-glass nodule, then the similar lesion type is configured as solid nodule or mixed ground-glass nodule. If the lesion type in the CT scan of the chest or X-ray of the chest corresponding to the preset site medical image is ground-glass nodule corresponding to lung inflammation, then the similar lesion type is configured as ground-glass nodule corresponding to early lung cancer.

[0274] The executor of the lesion morphology determination method and / or chest medical image analysis method can be an image processing device. For example, the lesion morphology determination method and / or chest medical image analysis method can be executed by a terminal device, server, or other processing device. The terminal device can be a user equipment (UE), mobile device, user terminal, terminal, cellular phone, cordless phone, personal digital assistant (PDA), handheld device, computing device, vehicle-mounted device, wearable device, etc. In some possible implementations, the lesion morphology determination method and / or chest medical image analysis method can be implemented by a processor calling computer-readable instructions stored in memory.

[0275] Those skilled in the art will understand that in the above-described method for determining lesion morphology and / or method for analyzing chest medical images in specific embodiments, the order in which each step is written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined based on its function and possible internal logic.

[0276] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a first determination unit, configured to determine a lesion mask processing image corresponding to each lesion in a lesion mask image of a medical image of a preset location; an extraction unit, configured to extract multiple lesion mask position coordinates corresponding to lesion mask lines in the lesion mask processing image corresponding to each lesion; and a second determination unit, configured to fit or reconstruct the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion.

[0277] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a first determining unit, configured to determine a lesion mask processing image corresponding to each lesion in a lesion mask image of a medical image of a preset location; an extraction unit, configured to extract multiple lesion mask position coordinates corresponding to lesion mask lines in the lesion mask processing image corresponding to each lesion; a second determining unit, configured to fit or reconstruct the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion; a judging unit, configured to judge the lesion morphology in the lesion mask processing image corresponding to each lesion; and if the lesion morphology is irregular, a third determining unit, configured to determine whether lesion lobulation sign exists based on the lesion mask processing image corresponding to each lesion.

[0278] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a first determination unit, configured to determine a lesion mask processing image corresponding to each lesion in a lesion mask image of a medical image of a preset location; an extraction unit, configured to extract multiple lesion mask position coordinates corresponding to lesion mask lines in the lesion mask processing image corresponding to each lesion; a second determination unit, configured to fit or reconstruct the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion; and a detection unit, configured to perform lesion vacuolation target detection on each lesion in the medical image of the preset location, and configure lesions corresponding to detected lesion vacuolation as having lesion vacuolation.

[0279] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a first determining unit, configured to determine a lesion mask processing image corresponding to each lesion in a lesion mask image of a medical image of a preset location; an extraction unit, configured to extract multiple lesion mask position coordinates corresponding to lesion mask lines in the lesion mask processing image corresponding to each lesion; a second determining unit, configured to fit or reconstruct the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion; a judging unit, configured to judge the lesion morphology in the lesion mask processing image corresponding to each lesion; if the lesion morphology is irregular, a third determining unit, configured to determine whether there is a lesion lobulation sign based on the lesion mask processing image corresponding to each lesion; and a detection unit, configured to perform lesion vacuolation sign target detection on each lesion in the medical image of the preset location, and configure the lesions corresponding to the detected lesion vacuolation sign as having a lesion vacuolation sign.

[0280] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke the instructions stored in the memory to execute the lesion morphology determination method described above.

[0281] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a computer-readable storage medium having a computer program / instructions and a bit stream stored thereon, wherein the computer program / instructions, when executed by a processor, implement the above-described lesion morphology determination method to generate the bit stream.

[0282] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a computer program product configured with a computer program / instruction, which, when executed by a processor, implements the aforementioned lesion morphology determination method.

[0283] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a first determination unit, configured to determine a lesion mask processing image corresponding to each lesion in a lesion mask image of a preset medical image; an extraction unit, configured to extract multiple lesion mask position coordinates corresponding to lesion mask lines in the lesion mask processing image corresponding to each lesion; a second determination unit, configured to fit or reconstruct the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion; and a prediction unit, configured to predict preset chest diseases related to nodules based on quantitative imaging features of preset nodules to be selected, including the proportion of solid nodules.

[0284] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a first determination unit, configured to determine a lesion mask processing image corresponding to each lesion in a dynamic chest X-ray image at each time moment in a multi-time dynamic chest X-ray image; an extraction unit, configured to extract multiple lesion mask position coordinates corresponding to lesion mask lines in the lesion mask processing image corresponding to each lesion; a second determination unit, configured to fit or reconstruct the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion; a fourth determination unit, configured to determine irregular nodules on the dynamic chest X-ray image at each time moment that do not meet the preset nodule regularity morphology using a preset nodule regularity morphology and the nodule morphology corresponding to each lesion in the dynamic chest X-ray image at each time moment; and a fifth determination unit, configured to determine the nodule movement trajectory corresponding to each irregular nodule during the respiratory process using the irregular nodules on the dynamic chest X-ray image at each time moment that do not meet the preset nodule regularity morphology.

[0285] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke the instructions stored in the memory to execute the aforementioned medical image analysis method.

[0286] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a computer-readable storage medium having a computer program / instructions and a bit stream stored thereon, wherein the computer program / instructions, when executed by a processor, implement the above-described medical image analysis method to generate the bit stream.

[0287] According to one aspect of this disclosure, a lesion morphology determination system is provided, comprising: a computer program product configured with a computer program / instruction, which, when executed by a processor, implements the aforementioned medical image analysis method.

[0288] In some embodiments, the functions or modules of the apparatus provided in this disclosure can be used to perform the lesion morphology determination method and / or chest medical image analysis method described in the above method embodiments. The specific implementation can be referred to the description of the lesion morphology determination method and / or chest medical image analysis method embodiments above, which will not be repeated here for the sake of brevity.

[0289] This disclosure also proposes a computer-readable storage medium storing computer program instructions, which, when executed by a processor, implement the aforementioned lesion morphology determination method and / or chest medical image analysis method. The computer-readable storage medium may be a non-volatile computer-readable storage medium.

[0290] This disclosure also proposes an electronic device, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured for the aforementioned lesion morphology determination method and / or chest medical image analysis method. The electronic device may be provided as a terminal, a server, or other form of device.

[0291] This disclosure also proposes a computer program product, including a computer program / instruction, which, when executed by a processor, implements the above-described lesion morphology determination method and / or chest medical image analysis method.

[0292] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0293] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or technical improvements to the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. A method for determining the morphology of a lesion, characterized in that, include: Determine the lesion mask processing image corresponding to each lesion in the lesion mask image of the medical image of the preset site; Extract the multiple lesion mask position coordinates corresponding to the lesion mask line in the lesion mask processing image corresponding to each lesion; fit or reconstruct the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion.

2. The method for determining lesion morphology according to claim 1, characterized in that, The step of fitting or reconstructing the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology includes: approximating multiple preset closed curve equations or multiple preset closed surface equations using the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion; and / or, The step of approximating a preset closed curve equation or a preset closed surface equation with the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion includes: minimizing the error or absolute residual between the approximation equation and the multiple preset closed curve equation or multiple preset closed surface equation when the multiple lesion mask position coordinates corresponding to each lesion are approximated, thereby determining the lesion morphology corresponding to each lesion.

3. The method for determining lesion morphology according to any one of claims 1 or 2, characterized in that, The step of approximating a preset closed curve equation or a preset closed surface equation using the position coordinates of multiple lesion masks corresponding to each lesion to determine the lesion morphology corresponding to each lesion includes: if the medical image of the preset site is configured as a two-dimensional medical image, then approximating multiple preset closed curve equations using the position coordinates of multiple lesion masks corresponding to each lesion to determine the lesion morphology corresponding to each lesion; if the medical image of the preset site is configured as a three-dimensional medical image, then approximating multiple preset closed surface equations using the position coordinates of multiple lesion masks corresponding to each lesion to determine the lesion morphology corresponding to each lesion.

4. The method for determining lesion morphology according to any one of claims 1-3, characterized in that, Determining the lesion mask image includes: performing an erosion operation on the lesion mask image to obtain a lesion mask erosion image; subtracting the lesion mask erosion image from the lesion mask image to obtain a lesion mask image; and / or, before determining the lesion mask image corresponding to the lesion in the lesion mask image of the preset site medical image, it includes: using a preset lesion segmentation model constructed based on a deep learning segmentation network to segment the lesion in the preset site medical image, and determining the lesion mask image of the preset site medical image.

5. The method for determining lesion morphology according to any one of claims 1-4, characterized in that, Also includes: Determine the lesion mask processing image corresponding to each lesion in the lesion mask image of the medical image of the preset site; The morphology of the lesion in the lesion mask processing image corresponding to each lesion is judged; if the lesion morphology is irregular, the presence of lobulation sign of the lesion is determined based on the lesion mask processing image corresponding to each lesion. And / or, perform target detection of lesion vacuolation sign for each lesion in the medical image of the preset site, and configure the lesion corresponding to the detected lesion vacuolation sign as having lesion vacuolation sign.

6. A medical image analysis method, characterized in that, include: Using the lesion morphology determination method as described in any one of claims 1-5, the nodule morphology corresponding to each lesion in the dynamic chest X-ray image at each moment in the multi-moment dynamic chest X-ray image is determined; using the preset nodule regularity morphology and the nodule morphology corresponding to each lesion in the dynamic chest X-ray image at each moment, the irregular nodules that do not meet the preset nodule regularity morphology in the dynamic chest X-ray image at each moment are determined; using the irregular nodules that do not meet the preset nodule regularity morphology in the dynamic chest X-ray image at each moment, the nodule movement trajectory corresponding to each irregular nodule during the breathing process is determined.

7. A medical image analysis method, characterized in that, Using the lesion morphology determination method as described in any one of claims 1-5, the lesion morphology corresponding to each lesion in the medical image of the preset location is determined respectively; based on the quantitative imaging features of the preset nodules to be selected, including the proportion of solid nodules, preset chest diseases related to nodules are predicted.

8. The intelligent medical image analysis method according to claim 7, characterized in that, The method of predicting nodule-related preset chest diseases based on the quantitative imaging features of the selected preset nodules corresponding to the proportion of solid nodules includes: selecting the quantitative imaging features of the selected preset nodules corresponding to the proportion of solid nodules to obtain the preset nodule quantitative imaging features corresponding to the preset chest diseases; predicting nodule-related preset chest diseases based on the preset nodule quantitative imaging features corresponding to the preset chest diseases; and / or, the quantitative imaging features of the selected preset nodules further include one or more of the following: nodule long diameter, whether the nodule edge is clear, proportion of solid nodules, nodule spinous process sign, nodule lobulation sign, nodule air bronchus sign, and nodule cavitation sign.

9. A system for determining the morphology of a lesion, characterized in that, include: The first determining unit is used to determine the lesion mask processing image corresponding to each lesion in the lesion mask image of the preset site medical image; The extraction unit is used to extract the coordinates of multiple lesion mask positions corresponding to the lesion mask lines in the lesion mask processing image corresponding to each lesion. The second determining unit is used to fit or reconstruct the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion. And / or, The judgment unit judges the morphology of the lesion in the lesion mask processing image corresponding to each lesion; if the lesion morphology is irregular, the third determination unit is used to determine whether there is a lesion lobulation sign based on the lesion mask processing image corresponding to each lesion. And / or, The detection unit is used to perform target detection of lesion vacuolation sign for each lesion in the medical image of the preset site, and to configure the lesion corresponding to the detected lesion vacuolation sign as having lesion vacuolation sign. or, The method comprises: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke instructions stored in the memory to execute the lesion morphology determination method according to any one of claims 1-5; or, it comprises: a computer-readable storage medium having a computer program / instructions and a bit stream stored thereon, wherein the computer program / instructions, when executed by a processor, implement the lesion morphology determination method according to any one of claims 1-5 to generate the bit stream; or, it comprises: a computer program product having a computer program / instructions configured thereon, wherein the computer program / instructions, when executed by a processor, implement the lesion morphology determination method according to any one of claims 1-5.

10. A medical image analysis system, characterized in that, include: The first determining unit is used to determine the lesion mask processing image corresponding to each lesion in the lesion mask image of the preset site medical image; The extraction unit is used to extract the coordinates of multiple lesion mask positions corresponding to the lesion mask lines in the lesion mask processing image corresponding to each lesion. The second determining unit is used to fit or reconstruct the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion. The prediction unit is used to predict nodule-related preset chest diseases based on quantitative imaging features of the selected preset nodules corresponding to the proportion of solid nodules. or, The first determining unit is used to determine the lesion mask processing image corresponding to each lesion in the dynamic chest X-ray image at each time moment in the multi-time dynamic chest X-ray image; The extraction unit is used to extract the coordinates of multiple lesion mask positions corresponding to the lesion mask lines in the lesion mask processing image corresponding to each lesion. The second determining unit is used to fit or reconstruct the multiple lesion mask position coordinates corresponding to each lesion to determine the lesion morphology corresponding to each lesion. The fourth determining unit is used to determine irregular nodules that do not meet the preset nodule regularity on the dynamic chest X-ray image at each moment by using the preset nodule regularity and the nodule morphology corresponding to each lesion on the dynamic chest X-ray image at each moment; the fifth determining unit is used to determine the nodule movement trajectory corresponding to each irregular nodule during the breathing process by using the irregular nodules that do not meet the preset nodule regularity on the dynamic chest X-ray image at each moment. or, The method comprises: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke instructions stored in the memory to execute the medical image analysis method of any one of claims 6-8; or, a computer-readable storage medium having a computer program / instructions and a bit stream stored thereon, wherein the computer program / instructions, when executed by a processor, implement the medical image analysis method of any one of claims 6-8 to generate the bit stream; or, a computer program product having a computer program / instructions configured thereon, wherein the computer program / instructions, when executed by a processor, implement the medical image analysis method of any one of claims 6-8.

Images