Diaphragm movement detection, evaluation method and device, electronic equipment and storage medium

Abstract

The disclosure relates to a diaphragm movement detection and evaluation method and device, electronic equipment and a storage medium, and relates to the technical field of DR image processing. The diaphragm movement determination method comprises: acquiring two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments in the breathing process; determining a plurality of left lung movement vertexes and a plurality of right lung movement vertexes according to the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple moments respectively; determining a plurality of left lung diaphragm movement point sequences and a plurality of right lung diaphragm movement point sequences according to the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple moments respectively; determining the movement of the left lung diaphragm based on the plurality of left lung movement vertexes and the plurality of left lung diaphragm movement point sequences, and determining the movement of the right lung diaphragm based on the plurality of right lung movement vertexes and the plurality of right lung diaphragm movement point sequences. The embodiment of the disclosure can realize diaphragm movement determination and lung disease evaluation.

Description

Technical Field

[0001] This disclosure relates to the field of quantitative analysis technology of DR images, and in particular to a method and apparatus for detecting and evaluating diaphragmatic movement, an electronic device, and a storage medium. Background Technology

[0002] Digital X-ray (DR) imaging can provide high-resolution and real-time X-ray images and has been widely used in examinations of the skeletal system, chest, and dentistry, such as fracture diagnosis, lung disease screening, and dental X-rays.

[0003] Currently, DR imaging has become a commonly used imaging device for the diagnosis and assessment of respiratory diseases. The diaphragm is the primary respiratory muscle. When the diaphragm contracts, the central tendon pulls downwards towards the abdominal cavity. The diaphragmatic dome flattens, the volume of the thoracic cavity increases, and the intracavitary pressure decreases, allowing outside air to enter the lungs. When the intrathoracic pressure equals the intra-abdominal pressure, the intercostal muscles activate, and the thoracic cavity expands laterally and upwards, continuing inhalation. During quiet exhalation, the diaphragm passively rises, the dome returns to its original position, the volume of the thoracic cavity decreases, and exhalation is completed. Therefore, the movement of the diaphragm has a significant impact on the respiratory process.

[0004] Therefore, it is necessary to detect diaphragmatic movement based on DR images at multiple times during the respiratory process, thereby providing a reliable quantitative analysis method for diaphragmatic movement and improving the diagnostic level of respiratory diseases. Summary of the Invention

[0005] This disclosure presents a method and device for detecting and evaluating diaphragmatic movement, as well as an electronic device and a storage medium.

[0006] According to one aspect of this disclosure, a method for detecting and evaluating diaphragmatic movement is provided, comprising:

[0007] Acquire two-dimensional radiographs of the left and right lungs at multiple points during the respiratory process;

[0008] Multiple left lung motion vertices and multiple right lung motion vertices are determined based on the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points, respectively.

[0009] Based on the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points, multiple left lung diaphragm motion point sequences and multiple right lung diaphragm motion point sequences are determined respectively.

[0010] The movement of the left lung diaphragm is determined based on the multiple left lung movement vertices and the multiple left lung diaphragm movement point sequences, and the movement of the right lung diaphragm is determined based on the multiple right lung movement vertices and the multiple right lung diaphragm movement point sequences.

[0011] Preferably, before acquiring two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments during the breathing process, the two-dimensional DR lung images at multiple moments during the breathing process are segmented into left and right lungs to obtain two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments.

[0012] Preferably, the method for segmenting the left and right lungs of the two-dimensional DR lung images at multiple time points during the breathing process to obtain two-dimensional DR left lung images and two-dimensional DR right lung images at multiple time points includes:

[0013] The costal margin boundary, lung apex boundary, and mediastinal and diaphragmatic edges are detected in the left and right chest images of the two-dimensional DR lung images at multiple time points during the breathing process, respectively, to obtain the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points; or,

[0014] Obtain a segmentation model of a preset convolutional neural network and DR lung region label images used to train the segmentation model; wherein, the method for determining the DR lung region label images used to train the segmentation model includes: performing costal margin boundary, lung apex boundary, and mediastinal and transverse diaphragmatic edge detection on the left and right chest images of multiple DR lung region images respectively, to obtain DR lung region label images corresponding to the multiple DR lung region images.

[0015] The segmentation model is trained using the DR lung region labeled images used to train the segmentation model;

[0016] Based on the trained segmentation model, the left and right lungs of the two-dimensional DR lung images at multiple time points during the breathing process are segmented to obtain two-dimensional DR left lung images and two-dimensional DR right lung images at multiple time points.

[0017] Preferably, before determining the corresponding multiple left lung motion vertices and multiple right lung motion vertices based on the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple time points, and before determining multiple left lung diaphragm motion point sequences and multiple right lung diaphragm motion point sequences based on the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple time points, the method further includes:

[0018] Multiple left lung contour lines and multiple right lung contour lines corresponding to the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points are extracted respectively.

[0019] Based on the multiple left lung contour lines and the multiple right lung contour lines, the corresponding multiple left lung motion vertices, multiple right lung motion vertices, multiple left lung diaphragm motion point sequences, and multiple right lung diaphragm motion point sequences are determined respectively.

[0020] Preferably, the method for determining the corresponding multiple left lung motion vertices and multiple right lung motion vertices based on the multiple left lung contour lines and the multiple right lung contour lines includes:

[0021] Detect the multiple left lung contour lines and the multiple right lung contour lines respectively, and respectively configure the coordinates corresponding to the multiple left lung vertices and the multiple right lung vertices as the multiple left lung motion vertices and the multiple right lung motion vertices; and / or,

[0022] The method for detecting the plurality of left lung vertices and the plurality of right lung vertices corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively includes:

[0023] Establish coordinate systems for the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple moments during the respiratory process;

[0024] In the coordinate system, a plurality of first maximum ordinates and a plurality of second maximum ordinates corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines are determined respectively.

[0025] Based on the plurality of first maximum ordinates and the plurality of left lung contour lines, determine the plurality of first abscissas corresponding to the plurality of first maximum ordinates;

[0026] Based on the plurality of second maximum ordinates and the plurality of right lung contour lines, determine the plurality of second maximum ordinates corresponding to the plurality of second horizontal coordinates;

[0027] Each of the plurality of first maximum ordinates and their corresponding plurality of first abscissas is configured as a plurality of left lung vertices;

[0028] The plurality of second maximum ordinates and their corresponding plurality of second abscissas are respectively configured as plurality of right lung vertices; and / or,

[0029] The method for determining corresponding sequences of multiple left lung diaphragm motion points and multiple right lung diaphragm motion points based on the multiple left lung contour lines and the multiple right lung contour lines includes:

[0030] The lowest points of the left lung and the lowest points of the right lung corresponding to the multiple left lung contour lines and the multiple right lung contour lines are detected respectively, and the multiple lowest points of the left lung and the multiple lowest points of the right lung are respectively configured as the starting point of the multiple left lung diaphragm motion point sequence and the multiple right lung diaphragm motion point sequence.

[0031] The multiple left lung vertices and multiple right lung vertices corresponding to the multiple left lung contours and the multiple right lung contours are detected respectively, and the coordinates corresponding to the multiple left lung vertices and the multiple right lung vertices are respectively configured as candidate endpoints of the multiple left lung diaphragm motion point sequences and the multiple right lung diaphragm motion point sequences.

[0032] The plurality of left lung diaphragm motion point sequences are determined based on the starting points and candidate ending points of the plurality of left lung diaphragm motion point sequences, respectively; and the plurality of right lung diaphragm motion point sequences are determined based on the starting points and candidate ending points of the plurality of right lung diaphragm motion point sequences, respectively; and / or,

[0033] The method for determining the plurality of left lung diaphragm motion point sequences based on the starting points and candidate ending points of the plurality of left lung diaphragm motion point sequences includes: obtaining a first predetermined step size; calculating, based on the first predetermined step size, a plurality of first slope values ​​corresponding to the points from the starting points to the candidate ending points of the plurality of left lung diaphragm motion point sequences; determining the ending points of the plurality of left lung diaphragm motion point sequences based on the plurality of first slope values; or, determining, respectively, a left lung contour line between the starting points and the candidate ending points of the plurality of left lung diaphragm motion point sequences; and, on the left lung contour line between them, determining the ending points of the plurality of left lung diaphragm motion point sequences in an interactive manner; and / or,

[0034] The method for determining the endpoint of the plurality of left lung diaphragm motion point sequences based on the plurality of first slope values ​​includes: determining the candidate endpoints corresponding to the sign changes of the plurality of first slope values ​​from negative to positive as the endpoints of the plurality of left lung diaphragm motion point sequences; and / or,

[0035] The method for determining the plurality of right lung diaphragm motion point sequences based on the starting points and candidate ending points of the plurality of right lung diaphragm motion point sequences includes: obtaining a second predetermined step size; calculating, based on the second predetermined step size, a plurality of second slope values ​​corresponding to the points from the starting points to the candidate ending points of the plurality of right lung diaphragm motion point sequences; determining the ending points of the plurality of right lung diaphragm motion point sequences based on the plurality of second slope values; or, determining, respectively, a right lung contour line between the starting points and the candidate ending points of the plurality of right lung diaphragm motion point sequences; and, on the right lung contour line between them, determining the ending points of the plurality of right lung diaphragm motion point sequences in an interactive manner; and / or,

[0036] The method for determining the endpoint of the plurality of right lung diaphragm motion point sequences based on the plurality of second slope values ​​includes: determining the candidate endpoints corresponding to the changes in sign of the plurality of second slope values ​​from positive to negative as the endpoints of the plurality of right lung diaphragm motion point sequences.

[0037] According to one aspect of this disclosure, an assessment method is provided, comprising or utilizing the diaphragm motion detection method as described above to detect the diaphragm motion trajectory corresponding to the patient to be assessed, including:

[0038] Obtain the set movement trajectory for a healthy person;

[0039] Based on the diaphragmatic movement trajectory of the patient to be evaluated and the set movement trajectory, assess whether there is a functional disorder in the diaphragmatic movement of the patient to be evaluated; and / or,

[0040] The method for assessing whether there is a functional impairment of diaphragmatic movement in the patient under assessment based on the diaphragmatic movement trajectory corresponding to the patient under assessment and the set movement trajectory includes:

[0041] Calculate the similarity between the diaphragm movement trajectory and the set movement trajectory;

[0042] If the similarity is less than the set similarity, then the patient to be evaluated has a functional disorder in diaphragmatic movement; otherwise, the patient to be evaluated does not have a functional disorder in diaphragmatic movement.

[0043] According to one aspect of this disclosure, a device for detecting diaphragmatic movement is provided, comprising: a first acquisition unit for acquiring two-dimensional DR images of the left lung and two-dimensional DR images of the right lung at multiple moments during respiration;

[0044] The first determining unit is used to determine multiple left lung motion vertices and multiple right lung motion vertices based on the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points, respectively.

[0045] The second determining unit is used to determine multiple left lung diaphragm motion point sequences and multiple right lung diaphragm motion point sequences based on the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points, respectively.

[0046] The detection unit is configured to determine the movement of the left lung diaphragm based on the plurality of left lung motion vertices and the plurality of left lung diaphragm motion point sequences, and to determine the movement of the right lung diaphragm based on the plurality of right lung motion vertices and the plurality of right lung diaphragm motion point sequences; and / or,

[0047] It also includes: a segmentation unit; the segmentation unit being used to segment the two-dimensional DR lung images at multiple time points during the respiratory process into left and right lungs before acquiring the two-dimensional DR left lung images and two-dimensional DR right lung images at multiple time points during the respiratory process; and / or,

[0048] The segmentation unit includes: a detection unit;

[0049] The detection unit is used to detect the costal margin boundary, lung apex boundary, and mediastinal and transverse diaphragmatic edges of the left and right chest images of the two-dimensional DR lung images at multiple time points during the breathing process, respectively, to obtain the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points; or,

[0050] The segmentation unit includes: a model and data acquisition unit, a label determination unit, a training unit, and an output unit;

[0051] The model and data acquisition unit are used to acquire a segmentation model of a preset convolutional neural network and DR lung region label images used to train the segmentation model.

[0052] The label determination unit is used to detect the costal margin boundary, lung apex boundary, and mediastinal and transverse diaphragmatic edges of the left and right chest images of multiple DR lung area images, respectively, to obtain DR lung area label images corresponding to the multiple DR lung area images.

[0053] The training unit is used to train the segmentation model using the DR lung region label image used to train the segmentation model.

[0054] The output unit is used to segment the left and right lungs of the two-dimensional DR lung images at multiple time points during the breathing process based on the trained segmentation model, thereby obtaining two-dimensional DR left lung images and two-dimensional DR right lung images at multiple time points; and / or,

[0055] It also includes: a lung contour extraction unit and a motion point determination unit;

[0056] The lung contour extraction unit is used to extract multiple left lung contours and multiple right lung contours corresponding to the two-dimensional DR left lung images and two-dimensional DR right lung images at multiple time points, before determining multiple left lung motion vertices and multiple right lung motion vertices corresponding to the two-dimensional DR left lung images and two-dimensional DR right lung images at multiple time points, and before determining multiple left lung diaphragm motion point sequences and multiple right lung diaphragm motion point sequences based on the two-dimensional DR left lung images and two-dimensional DR right lung images at multiple time points.

[0057] The motion point determination unit is used to determine, based on the plurality of left lung contour lines and the plurality of right lung contour lines, corresponding to a plurality of left lung motion vertices, a plurality of right lung motion vertices, a plurality of left lung diaphragm motion point sequences, and a plurality of right lung diaphragm motion point sequences, respectively; and / or,

[0058] The motion point determination unit includes: a lung apex determination unit;

[0059] The lung vertex determination unit is used to detect, respectively, multiple left lung vertices and multiple right lung vertices corresponding to the multiple left lung contour lines and the multiple right lung contour lines, and configure the coordinates corresponding to the multiple left lung vertices and the multiple right lung vertices as the multiple left lung motion vertices and the multiple right lung motion vertices, respectively; and / or

[0060] The lung vertex determination unit includes: a coordinate system establishment unit, a coordinate determination unit, and a lung vertex configuration unit;

[0061] The coordinate system establishment unit is used to establish the coordinate systems corresponding to the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple moments during the breathing process.

[0062] The coordinate determining unit is configured to, in the coordinate system, respectively determine a plurality of first maximum ordinates and a plurality of second maximum ordinates corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines; respectively determine a plurality of first abscissas corresponding to the plurality of first maximum ordinates based on the plurality of first maximum ordinates and the plurality of left lung contour lines; and respectively determine a plurality of second abscissas corresponding to the plurality of second maximum ordinates based on the plurality of second maximum ordinates and the plurality of right lung contour lines.

[0063] The lung vertex configuration unit is used to configure the plurality of first maximum ordinates and their corresponding plurality of first abscissas as a plurality of left lung vertices; to configure the plurality of second maximum ordinates and their corresponding plurality of second abscissas as a plurality of right lung vertices; and / or,

[0064] The motion point determination unit further includes: a diaphragm motion origin determination unit, a diaphragm motion candidate endpoint determination unit, and a diaphragm motion endpoint determination unit;

[0065] The diaphragm movement origin determination unit is used to detect the multiple left lung contour lines and the multiple right lung contour lines corresponding to the multiple left lung lowest points and the multiple right lung lowest points, and respectively configure the multiple left lung lowest points and the multiple right lung lowest points as the starting points of the multiple left lung diaphragm movement point sequences and the multiple right lung diaphragm movement point sequences.

[0066] The diaphragm movement candidate endpoint determination unit is used to detect multiple left lung vertices and multiple right lung vertices corresponding to the multiple left lung contour lines and the multiple right lung contour lines respectively, and configure the coordinates corresponding to the multiple left lung vertices and the multiple right lung vertices as candidate endpoints of the multiple left lung diaphragm movement point sequences and the multiple right lung diaphragm movement point sequences respectively.

[0067] The diaphragm movement endpoint determination unit is used to determine the plurality of left lung diaphragm movement point sequences based on the starting points of the plurality of left lung diaphragm movement point sequences and the candidate endpoints of the plurality of left lung diaphragm movement point sequences, respectively; and to determine the plurality of right lung diaphragm movement point sequences based on the starting points of the plurality of right lung diaphragm movement point sequences and the candidate endpoints of the plurality of right lung diaphragm movement point sequences, respectively; and / or,

[0068] The diaphragm movement endpoint determination unit includes: a first step length acquisition unit and a first slope calculation unit; or, a left lung contour determination unit and a first interaction unit.

[0069] The first step length acquisition unit is used to acquire the first set step length;

[0070] The first slope calculation unit is used to calculate, based on the first set step size, multiple first slope values ​​corresponding to the starting point of the multiple left lung diaphragm motion point sequences and the candidate endpoints of the multiple left lung diaphragm motion point sequences; and determine the endpoints of the multiple left lung diaphragm motion point sequences based on the multiple first slope values; or,

[0071] The left lung contour determination unit is used to determine the left lung contour between the starting point of the plurality of left lung diaphragm motion point sequences and the candidate ending point of the plurality of left lung diaphragm motion point sequences, respectively.

[0072] The first interactive unit is configured to interactively determine the endpoints of the plurality of left lung diaphragm motion point sequences along the left lung contour line; and / or,

[0073] The first slope calculation unit includes: a first judgment unit;

[0074] The first determination unit is configured to determine the candidate endpoints corresponding to the change of the signs of the plurality of first slope values ​​from negative to positive as the endpoints of the plurality of left lung diaphragm motion point sequences; and / or,

[0075] The diaphragm movement endpoint determination unit further includes: a second step length acquisition unit and a second slope calculation unit; or, a right lung contour determination unit and a second interaction unit.

[0076] The second step size acquisition unit is used to acquire a second set step size;

[0077] The second slope calculation unit is used to calculate, based on the second set step size, multiple second slope values ​​corresponding to the starting point of the multiple right lung diaphragm motion point sequences and the candidate endpoints of the multiple right lung diaphragm motion point sequences; and determine the endpoints of the multiple right lung diaphragm motion point sequences based on the multiple second slope values; or,

[0078] The right lung contour determination unit is used to determine the right lung contour between the starting point of the plurality of right lung diaphragm motion point sequences and the candidate ending point of the plurality of right lung diaphragm motion point sequences, respectively.

[0079] The second interactive unit is configured to interactively determine the endpoints of the plurality of right lung diaphragm motion point sequences along the right lung contour line; and / or,

[0080] The second slope calculation unit includes: a second judgment unit;

[0081] The second judgment unit is used to determine the candidate endpoints corresponding to the change of the signs of the plurality of second slope values ​​from positive to negative as the endpoints of the plurality of right lung diaphragm motion point sequences.

[0082] According to one aspect of this disclosure, an assessment apparatus is provided, comprising: a diaphragm motion detection method as described above or a diaphragm motion detection apparatus as described above, wherein the diaphragm motion detection apparatus is used to detect the diaphragm motion trajectory corresponding to a patient to be assessed; and,

[0083] The second acquisition unit is used to acquire the set movement trajectory corresponding to a healthy person;

[0084] An assessment unit is used to assess whether there is a functional impairment in the diaphragm movement of the patient under assessment, based on the diaphragm movement trajectory corresponding to the patient under assessment and the set movement trajectory; and / or,

[0085] The evaluation unit includes: a similarity calculation unit and a similarity comparison unit;

[0086] The similarity calculation unit is used to calculate the similarity between the diaphragm movement trajectory and the set movement trajectory;

[0087] The similarity comparison unit is used to compare the similarity with a set similarity; if the similarity is less than the set similarity, then the diaphragm movement of the patient to be evaluated has a functional disorder; otherwise, the diaphragm movement of the patient to be evaluated does not have a functional disorder.

[0088] According to one aspect of this disclosure, an electronic device is provided, comprising:

[0089] processor;

[0090] Memory used to store processor-executable instructions;

[0091] The processor is configured to execute the above-described diaphragm motion detection method and / or the above-described evaluation method.

[0092] According to one aspect of this disclosure, a computer-readable storage medium is provided that stores computer program instructions thereon, which, when executed by a processor, implement the above-described diaphragm movement detection method and / or the above-described evaluation method.

[0093] In this disclosure, a method and device for detecting and evaluating diaphragmatic movement, an electronic device, and a storage medium are proposed. The method detects diaphragmatic movement based on DR images at multiple times during the respiratory process, providing a quantitative analysis index for the respiratory process. This addresses the current problem that the diaphragm cannot be effectively quantitatively analyzed, which affects the diagnostic level of respiratory diseases.

[0094] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure.

[0095] Other features and aspects of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0096] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the specification, serve to illustrate the technical solutions of this disclosure.

[0097] Figure 1 A flowchart of a diaphragm movement detection method according to an embodiment of the present disclosure is shown;

[0098] Figure 2 This is a block diagram illustrating an electronic device 800 according to an exemplary embodiment;

[0099] Figure 3 This is a block diagram illustrating an electronic device 1900 according to an exemplary embodiment. Detailed Implementation

[0100] Various exemplary embodiments, features, and aspects of this disclosure will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.

[0101] The term “exemplary” as used herein means “serving as an example, embodiment, or illustration.” Any embodiment illustrated herein as “exemplary” is not necessarily to be construed as superior to or better than other embodiments.

[0102] In this document, the term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. Furthermore, the term "at least one" in this document means any combination of at least two of any one or more elements. For example, including at least one of A, B, and C can mean including any one or more elements selected from the set consisting of A, B, and C.

[0103] Furthermore, to better illustrate this disclosure, numerous specific details are set forth in the following detailed description. Those skilled in the art will understand that this disclosure can be practiced without certain specific details. In some instances, methods, means, components, and circuits well known to those skilled in the art have not been described in detail in order to highlight the main points of this disclosure.

[0104] It is understood that the various method embodiments mentioned above in this disclosure can be combined with each other to form combined embodiments without violating the principle and logic. Due to space limitations, this disclosure will not elaborate further.

[0105] In addition, this disclosure also provides a device for detecting and evaluating diaphragmatic motion in DR images, an electronic device, a computer-readable storage medium, and a program. All of the above can be used to implement any of the diaphragmatic motion detection and evaluation methods provided in this disclosure. The corresponding technical solutions and descriptions are described in the corresponding section of the method and will not be repeated here.

[0106] Figure 1 A flowchart of a diaphragm movement detection method according to an embodiment of the present disclosure is shown, such as... Figure 1 As shown, the diaphragm movement detection method includes: Step S101: acquiring two-dimensional DR images of the left lung and the right lung at multiple moments during respiration; Step S102: determining multiple left lung movement vertices and multiple right lung movement vertices based on the two-dimensional DR images of the left lung and the right lung at multiple moments; Step S103: determining multiple left lung diaphragm movement point sequences and multiple right lung diaphragm movement point sequences based on the two-dimensional DR images of the left lung and the right lung at multiple moments; Step S104: determining the movement of the left lung diaphragm based on the multiple left lung movement vertices and the multiple left lung diaphragm movement point sequences, and determining the movement of the right lung diaphragm based on the multiple right lung movement vertices and the multiple right lung diaphragm movement point sequences.

[0107] Step S101: Acquire two-dimensional DR images of the left lung and the right lung at multiple moments during the breathing process.

[0108] In the embodiments of this disclosure and other possible embodiments, digital X-ray (DR) imaging equipment can provide high-resolution and real-time X-ray images and has been widely used in examinations of the skeletal system, chest, dentistry, etc., such as fracture diagnosis, lung disease screening, and dental X-rays. Therefore, DR imaging equipment can be used to image the skeletal system, chest, dentistry, etc.

[0109] In the embodiments of this disclosure, before acquiring two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments during the breathing process, the two-dimensional DR lung images at multiple moments during the breathing process are segmented into left and right lungs to obtain two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments.

[0110] In an embodiment of this disclosure, the method of segmenting the left and right lungs of the two-dimensional DR lung images at multiple moments during the breathing process to obtain two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments includes: performing costal margin boundary, lung apex boundary, and mediastinal and transverse diaphragm edge detection on the left and right chest images of the two-dimensional DR lung images at multiple moments during the breathing process, respectively, to obtain two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments.

[0111] Alternatively, in an embodiment of this disclosure, the method for segmenting the left and right lungs of the two-dimensional DR lung images at multiple moments during the breathing process to obtain two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments includes: acquiring a segmentation model of a preset convolutional neural network and DR lung region label images for training the segmentation model; wherein, the method for determining the DR lung region label images for training the segmentation model includes: performing costal margin boundary, lung apex boundary, and mediastinal and transverse diaphragmatic edge detection on the left and right chest images of the multiple DR lung region images respectively to obtain DR lung region label images corresponding to the multiple DR lung region images; training the segmentation model using the DR lung region label images used to train the segmentation model; and completing the segmentation of the left and right lungs of the two-dimensional DR lung images at multiple moments during the breathing process based on the trained segmentation model to obtain two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments.

[0112] In embodiments of this disclosure and other possible embodiments, a DR image to be processed (a two-dimensional DR image of the left lung at multiple moments during breathing or breath-holding) is acquired, and it is determined whether the DR image to be processed is a lung image; wherein the lung image is configured as a two-dimensional DR lung image at multiple moments during breathing; if it is the lung image, a thoracic cavity detection is performed on the DR image to be processed to remove information outside the thoracic cavity from the DR image to be processed.

[0113] In embodiments of this disclosure and other possible embodiments, the method for determining whether a DR image to be processed is a lung image includes: calculating the average grayscale value corresponding to the DR image to be processed, and determining whether it is a lung image based on the average grayscale value and a set grayscale value. Those skilled in the art can configure the set grayscale value according to actual needs. For example, the set grayscale value can be configured to any value or range between -1000HU and 0HU. Alternatively, in embodiments of this disclosure and other possible embodiments, the determination of whether a DR image to be processed is a lung image can also be made by manual judgment of the DR image to be processed.

[0114] In the embodiments of this disclosure and other possible embodiments, the method for determining whether an image is a lung image based on the average gray value and a set gray value includes: if the DR image to be processed has not undergone inversion processing, then if the average gray value is less than or equal to the set gray value, the DR image to be processed is determined to be a lung image; if the DR image to be processed has undergone inversion processing, then if the average gray value is greater than or equal to the set gray value, the DR image to be processed is determined to be a lung image. The principle is that if it is a lung image, the lungs in the lung image will generally be filled with or contain a certain amount of air, and air corresponds to a relatively small gray value (CT value), generally configured as -1000 HU; while the gray value (CT value) of water is generally configured as 0 HU, and the gray value (CT value) of bone is generally configured as 1000 HU or higher; therefore, the above technical solution is used to determine whether the DR image to be processed is a lung image.

[0115] In embodiments of this disclosure and other possible embodiments, if the image is a lung image, then a thoracic cavity detection is performed on the DR image to be processed to remove information outside the thoracic cavity from the DR image to be processed. In embodiments of this disclosure and other possible embodiments, the information outside the thoracic cavity includes: removing unnecessary information such as arms, heads, and blank backgrounds.

[0116] In the embodiments of this disclosure, before performing thoracic cavity detection on the DR image to be processed (the lung image to be segmented or the two-dimensional DR lung image at multiple moments during breathing or breath-holding), the DR image to be processed is filtered, and the filtered lung image to be segmented is downsampled to a set size.

[0117] In embodiments of this disclosure, image enhancement is performed on the logarithmic transformation of the DR image to be processed, which is of a set size, to obtain an enhanced DR image to be processed.

[0118] (1) Image preprocessing of DR images to be processed (lung images to be segmented or two-dimensional DR lung images at multiple moments during the breathing process).

[0119] In the embodiments of this disclosure and other possible embodiments, a. a DR image (lung image to be segmented) is processed, and a low-pass filter is applied to the DR image (lung image to be segmented). The filtered lung image to be segmented is then downsampled to a set size to speed up image processing. A logarithmic transformation is performed on the downsampled lung image to enhance the image, resulting in an enhanced lung image to be segmented. The low-pass template used is Gaussian filtering or mean filtering, and the set size value can be configured as 3×3 or 5×5. The downsampling range can be configured to 2-6 times. Those skilled in the art can configure the set size value and / or the downsampling range according to actual needs.

[0120] In the embodiments of this disclosure and other possible embodiments, b. the technical solution for detecting the thoracic cavity in the DR image to be processed adopts adaptive determination of the thoracic cavity contour based on the characteristics of the lung image to be segmented, and removes unnecessary information such as arms, head and blank background.

[0121] In the embodiments of this disclosure, step 1) of the method for performing DR image processing on the DR image to be processed includes: calculating a plurality of first gradient magnitudes corresponding to the horizontal direction of each pixel in the DR image to be processed and a plurality of second gradient magnitudes corresponding to the vertical direction of each pixel; determining a plurality of total gradient magnitudes based on the plurality of first gradient magnitudes and the plurality of second gradient magnitudes; integrating the plurality of first gradient magnitudes corresponding to the horizontal direction and the plurality of second gradient magnitudes corresponding to the vertical direction along a direction perpendicular to them to obtain a plurality of first integral values ​​and a plurality of second integral values; and integrating the plurality of total gradient magnitudes. The integral is divided into two directions corresponding to the longitudinal and transverse directions to obtain multiple third integral values ​​and multiple fourth integral values; multiple first local maxima corresponding to the multiple first ratios are calculated, and multiple first local minima and multiple second local minima corresponding to the multiple first ratios and multiple second ratios are calculated; the thoracic profile corresponding to the DR image to be processed is determined based on the multiple first local maxima, the multiple first local minima, the multiple second local minima, and the thoracic profile features; wherein, the thoracic profile features can be configured with a first segmentation position of the neck or shoulder corresponding to the thoracic profile and a second segmentation position on both sides of the thoracic profile.

[0122] In embodiments of this disclosure, the method for calculating multiple first gradient magnitudes in the horizontal direction and multiple second gradient magnitudes in the vertical direction of each pixel in the DR image to be processed includes: obtaining a gradient operator; and using the gradient operator to calculate multiple first gradient magnitudes in the horizontal direction and multiple second gradient magnitudes in the vertical direction of each pixel in the DR image to be processed.

[0123] In embodiments of this disclosure, the method for determining multiple total gradient magnitudes based on the plurality of first gradient magnitudes and the plurality of second gradient magnitudes includes: calculating a plurality of first sums of squares corresponding to the plurality of first gradient magnitudes and a plurality of second sums of squares corresponding to the plurality of second gradient magnitudes, and determining the plurality of total gradient magnitudes based on the plurality of first sums of squares and the plurality of second sums of squares; and / or, the method for determining the plurality of total gradient magnitudes based on the plurality of first sums of squares and the plurality of second sums of squares includes: summing the plurality of first sums of squares and the plurality of second sums of squares, and taking the square root of the sums to obtain the plurality of total gradient magnitudes.

[0124] In embodiments of this disclosure and other possible embodiments, a plurality of first gradient magnitudes corresponding to the horizontal direction of each pixel in the lung image to be segmented and a plurality of second gradient magnitudes corresponding to the vertical direction of each pixel are calculated respectively; and a plurality of total gradient magnitudes are determined based on the plurality of first gradient magnitudes and the plurality of second gradient magnitudes; wherein, the method of determining the plurality of total gradient magnitudes based on the plurality of first gradient magnitudes and the plurality of second gradient magnitudes includes: calculating a plurality of first sums of squares corresponding to the plurality of first gradient magnitudes and a plurality of second sums of squares corresponding to the plurality of second gradient magnitudes respectively, and determining the plurality of total gradient magnitudes based on the plurality of first sums of squares and the plurality of second sums of squares. The method of determining the plurality of total gradient magnitudes based on the plurality of first sums of squares and the plurality of second sums of squares includes: summing the plurality of first sums of squares and the plurality of second sums of squares respectively, and taking the square root of the sums to obtain the plurality of total gradient magnitudes.

[0125] For example, each pixel e in the lung image to be segmented and its eight-neighbor matrix are: Using the Sobel gradient operator Calculate the magnitudes of the first gradient (c + 2*f + ia - 2*dg) in the horizontal direction for each pixel e in the lung image to be segmented, and then use the transpose of the Sobel gradient operator. Calculate the magnitudes of the second gradient in the vertical direction (g + 2*h + ia - 2*bc) for each pixel e in the lung image to be segmented. Additionally, those skilled in the art may choose other gradient operators, such as the Roberts gradient operator or the Laplace gradient operator, depending on the specific needs.

[0126] For example, based on the plurality of first gradient magnitudes (h1, h2, ..., h... n and the plurality of second gradient magnitudes (k1,k2,...,k n Determine multiple total gradient magnitudes.

[0127] Step 2). Integrate the multiple first gradient magnitudes corresponding to the horizontal direction and the multiple second gradient magnitudes corresponding to the vertical direction along the direction perpendicular to them to obtain multiple first integral values ​​and multiple second integral values;

[0128] Specifically, multiple first gradient magnitudes corresponding to the horizontal direction are integrated in the vertical direction to obtain multiple first integral values; and multiple second integral values ​​are obtained by integrating multiple first gradient magnitudes corresponding to the vertical direction in the horizontal direction.

[0129] Step 3). Integrate the multiple total gradient magnitude integrals in the two corresponding directions, the vertical and horizontal directions, respectively, to obtain multiple third integral values ​​and multiple fourth integral values; wherein, integrating the multiple total gradient magnitude integrals in the vertical direction yields multiple third integral values; and integrating the multiple total gradient magnitude integrals in the horizontal direction yields multiple fourth integral values.

[0130] Step 4). (a) When determining multiple first local maxima, calculate the ratio based on the results of Step 2 and Step 3. When the ratio is less than a preset value, the image information at this location is considered noise and needs to be discarded. The noise can be configured to be image information corresponding to unnecessary information such as arms, heads, and blank backgrounds.

[0131] Specifically, based on the plurality of first integral values ​​and the plurality of third integral values, it is determined whether each of the plurality of first ratios corresponding to the plurality of first integral values ​​and the plurality of third integral values ​​in the horizontal direction should be retained.

[0132] The method for determining whether to retain each of the plurality of first ratios corresponding to the plurality of first integral values ​​and the plurality of third integral values ​​in the horizontal direction, based on the plurality of first integral values ​​and the plurality of third integral values, includes: obtaining a first preset value; calculating the plurality of first ratios between the plurality of first integral values ​​and the corresponding plurality of third integral values ​​in the horizontal direction; and discarding the first ratio if it is less than the first preset value. In embodiments of this disclosure and other possible embodiments, those skilled in the art may configure the first preset value as needed.

[0133] (b) When determining multiple first local minima, calculate the ratio based on the results of step 2 and step 3. When the ratio is greater than a preset value, the image information at this location is considered noise and needs to be discarded. The noise can be configured to include image information corresponding to unnecessary information such as arms, heads, and blank backgrounds.

[0134] Specifically, based on the plurality of first integral values ​​and the plurality of third integral values, it is determined whether each of the plurality of first ratios corresponding to the plurality of first integral values ​​and the plurality of third integral values ​​in the horizontal direction should be retained.

[0135] The method for determining whether to retain each of the plurality of first ratios corresponding to the plurality of first integral values ​​and the plurality of third integral values ​​in the horizontal direction, based on the plurality of first integral values ​​and the plurality of third integral values, includes: obtaining a first preset value; calculating the plurality of first ratios between the plurality of first integral values ​​and the corresponding plurality of third integral values ​​in the horizontal direction; and discarding the first ratio if one of the plurality of first ratios is greater than the first preset value.

[0136] Specifically, based on the plurality of second integral values ​​and the plurality of fourth integral values, it is determined whether each of the plurality of second ratios corresponding to the plurality of second integral values ​​and the plurality of fourth integral values ​​in the longitudinal direction should be retained.

[0137] The method for determining whether to retain each of the plurality of second ratios corresponding to the plurality of second integral values ​​and the plurality of fourth integral values ​​in the longitudinal direction, based on the plurality of second integral values ​​and the plurality of fourth integral values, includes: obtaining a second preset value; calculating the plurality of second ratios between the plurality of second integral values ​​and the corresponding plurality of fourth integral values ​​in the longitudinal direction; and discarding a certain second ratio if it is greater than the second preset value. In embodiments of this disclosure and other possible embodiments, those skilled in the art may configure the second preset value as needed.

[0138] In embodiments of this disclosure, before calculating the plurality of first local maxima corresponding to the plurality of first ratios, and calculating the plurality of first local minima and the plurality of second local minima corresponding to the plurality of first ratios and the plurality of second ratios, it is determined, based on the plurality of first integral values ​​and the plurality of third integral values, whether each of the plurality of first ratios corresponding to the plurality of first integral values ​​and the plurality of third integral values ​​in the horizontal direction should be retained; and, based on the plurality of second integral values ​​and the plurality of fourth integral values, it is determined whether each of the plurality of second ratios corresponding to the plurality of second integral values ​​and the plurality of fourth integral values ​​in the vertical direction should be retained; then, the plurality of first local maxima corresponding to the retained plurality of first ratios are calculated, and the plurality of first local minima and the plurality of second local minima corresponding to the retained plurality of first ratios and the retained plurality of second ratios are calculated.

[0139] In embodiments of this disclosure, the differential derivatives of the first curves corresponding to the plurality of first ratios are calculated to obtain the plurality of first local maxima and the plurality of first local minima; and the differential derivatives of the second curves corresponding to the plurality of second ratios are calculated to obtain the plurality of second local minima.

[0140] In embodiments of this disclosure, the method for determining the thoracic map corresponding to the lung image to be segmented based on a plurality of first local maxima, a plurality of first local minima, a plurality of second local minima, and thoracic features includes: determining second segmentation positions on both sides of the thoracic cavity based on the plurality of first local maxima and the thoracic features; determining first segmentation positions of the neck or shoulder based on the plurality of second local minima and the thoracic features; and determining the thoracic map corresponding to the lung image to be segmented based on the first segmentation positions and the first segmentation positions.

[0141] In the embodiments of this disclosure and other possible embodiments, 5) calculate the plurality of first local maxima corresponding to the plurality of first ratios discarded in step 4(a). Similarly, calculate the plurality of first local minima and the plurality of second local minima corresponding to the plurality of first ratios and the plurality of second ratios discarded in step 4(b). Wherein, the plurality of first ratios discarded are the plurality of first ratios retained after discarding; similarly, the plurality of second ratios discarded are the plurality of second ratios retained after discarding.

[0142] The thoracic profile corresponding to the lung image to be segmented is determined based on multiple first local maxima, multiple first local minima, multiple second local minima, and thoracic profile features, removing unnecessary information such as arms, head, and blank background. The thoracic profile features can be configured with a first segmentation position corresponding to the neck or shoulder and second segmentation positions on both sides of the thoracic profile.

[0143] The method for determining the thoracic map corresponding to the lung image to be segmented based on multiple first local maxima, multiple first local minima, multiple second local minima, and thoracic features includes: determining second segmentation positions on both sides of the thoracic cavity based on the multiple first local maxima and the thoracic features; determining first segmentation positions of the neck or shoulder based on the multiple second local minima and the thoracic features; and determining the thoracic map corresponding to the lung image to be segmented based on the first segmentation positions.

[0144] The plurality of first local maxima are obtained by calculating the differential derivatives of the first curves corresponding to the plurality of discarded first ratios; wherein the differential derivatives can be configured as first-order, second-order, or other multi-order differential derivatives. Similarly, the plurality of first local minima are obtained by calculating the differential derivatives of the first curves corresponding to the plurality of discarded first ratios; wherein the differential derivatives can be configured as first-order, second-order, or other multi-order differential derivatives. Similarly, the plurality of second local minima are obtained by calculating the differential derivatives of the second curves corresponding to the plurality of discarded second ratios; wherein the differential derivatives can be configured as first-order, second-order, or other multi-order differential derivatives.

[0145] In embodiments of this disclosure, the method for determining the second segmentation positions on both sides of the thorax based on the plurality of first local maxima and the thorax features includes: determining the maximum value among all the plurality of first local maxima on one side of the centerline of the DR image to be processed, and configuring the position information corresponding to the maximum value as the segmentation position point of the side to be determined corresponding to the side of the thorax; determining the minimum value among all the plurality of first local minima on the other side of the centerline of the DR image to be processed, and configuring the position information corresponding to the minimum value as the segmentation position point of the other side to be determined corresponding to the other side of the thorax.

[0146] In embodiments of this disclosure, a method for determining the first segmentation position of the neck or shoulder based on the plurality of second local minima and the thoracic features includes: configuring the position information corresponding to the minimum value of the plurality of second local minima as the first segmentation position of the neck or shoulder.

[0147] In embodiments of this disclosure and other possible embodiments, the method for determining the second segmentation positions on both sides of the thorax based on the plurality of first local maxima and the thorax features includes: determining the maximum value among all the plurality of first local maxima on one side (right side) of the center line of the image to be segmented, and configuring the position information corresponding to the maximum value as the segmentation position point of the side to be determined corresponding to the side of the thorax; determining the minimum value among all the plurality of first local minima on the other side (left side) of the center line of the image to be segmented, and configuring the position information corresponding to the minimum value as the segmentation position point of the other side to be determined corresponding to the other side of the thorax.

[0148] For example, determine all of the plurality of first local maxima (a1, a2, ..., a) on one side (right side) of the centerline. n The maximum value a in ) mWhere m is less than or equal to n; m is the location information corresponding to the maximum value (e.g., a certain horizontal coordinate), that is, the segmentation point of the side to be determined corresponding to one side of the thorax. Similarly, determine all the plurality of first local minima (b1, b2, ..., b) on the other side (left side) of the centerline. n The minimum value b in ) r , where r is less than or equal to n; r is the location information (e.g., a certain horizontal coordinate) corresponding to the minimum value.

[0149] In embodiments of this disclosure and other possible embodiments, a method for determining a first segmentation position of the neck or shoulder based on the plurality of second local minima and the thoracic features includes: configuring the position information (e.g., a certain ordinate) corresponding to the minimum value of the plurality of second local minima as the first segmentation position of the neck or shoulder.

[0150] (2) Lung field segmentation.

[0151] In the embodiments of this disclosure, the thoracic image obtained by thoracic cavity detection of the DR image to be processed is configured as the lung image to be segmented; and the left and right lungs are segmented based on the lung image to be segmented.

[0152] In embodiments of this disclosure, the lung image to be segmented is segmented into a left chest image and a right chest image; the left lung and right lung are segmented based on the left chest image and the right chest image, respectively.

[0153] In embodiments of this disclosure, the lung image to be segmented is segmented into a left chest image and a right chest image; the left lung and right lung are segmented based on the left chest image and the right chest image, respectively; or, a segmentation model of a preset convolutional neural network, DR lung region label images used to train the segmentation model, and multiple DR lung images (lung images to be segmented) at multiple times during breathing or breath-holding; wherein, the method for determining the DR lung region label images used to train the segmentation model includes: performing costal margin boundary, lung apex boundary, and mediastinal and transverse diaphragmatic edge detection on the left chest image and right chest image of the multiple DR lung region images, respectively, to obtain DR lung region label images corresponding to the multiple DR lung region images; training the segmentation model using the DR lung region label images used to train the segmentation model; and completing the left lung and / or right lung segmentation of the multiple DR lung images to be segmented based on the trained segmentation model.

[0154] In embodiments of this disclosure and other possible embodiments, the segmentation model of the preset convolutional neural network is configured as a Unet convolutional neural network, an nnUnet convolutional neural network, or a convolutional neural network improved based on the Unet convolutional neural network, or a convolutional neural network improved based on the nnUnet convolutional neural network. For example, the convolutional neural network improved based on the Unet convolutional neural network can be configured as a ResUnet convolutional neural network with a residual structure.

[0155] In embodiments of this disclosure and other possible embodiments, the Unet convolutional neural network or nnUnet convolutional neural network or a convolutional neural network improved based on Unet convolutional neural network or a convolutional neural network improved based on nnUnet convolutional neural network includes at least: a downsampling shrinking path, an upsampling expanding path, and a final classification layer.

[0156] In embodiments of this disclosure and other possible embodiments, the multiple DR lung area images are configured to be acquired during deep inspiration or breath-holding.

[0157] In embodiments of this disclosure and other possible embodiments, before training the segmentation model using the DR lung region label image used to train the segmentation model, the DR lung region label image is data augmented to obtain an augmented DR lung region label image; and the segmentation model is trained using the augmented DR lung region label image.

[0158] In embodiments of this disclosure and other possible embodiments, the method for data augmentation of the DR lung region label image to obtain an enhanced DR lung region label image includes: performing spatial geometric transformation and / or flipping and / or rotating and / or cropping and / or scaling and / or image shifting and / or edge filling and / or random erasing and / or random occlusion operations on the DR lung region label image to obtain the enhanced DR lung region label image.

[0159] In embodiments of this disclosure and other possible embodiments, the method for data augmentation of the DR lung region label image to obtain an enhanced DR lung region label image further includes: randomly selecting any two DR lung region label images from the DR lung region label images; performing a configuration operation on the arbitrary two DR lung region label images to obtain a corresponding DR lung region label registration image; and performing a fusion operation on the DR lung region label registration image to obtain the enhanced DR lung region label image.

[0160] In the embodiments of this disclosure and other possible embodiments, the method of performing a fusion operation on the DR lung region label registration image to obtain an enhanced DR lung region label image includes: performing a minimum, maximum, or average operation on the pixel values ​​corresponding to the DR lung region label registration image to obtain the enhanced DR lung region label image.

[0161] In the embodiments and other possible embodiments of this disclosure, the registration method used in this disclosure can employ existing registration algorithms or models, such as one or more of SIFT (Scale-invariant feature transform), SURF (Speeded Up Robust Features), and ORB (Oriented FAST and Rotated BRIEF) registration algorithms or models, or other registration algorithms or models based on convolutional neural networks. For example, a registration algorithm or model based on convolutional neural networks can be configured as a registration algorithm or model based on VGG networks.

[0162] c. Based on the chest image corresponding to the lung image to be segmented, the chest image is divided into two parts: a left chest image and a right chest image. Based on this, the left lung field of the left chest image is segmented and the right lung field of the right chest image is segmented.

[0163] In embodiments of this disclosure, a method for segmenting the left and right lungs based on the left chest image and the right chest image respectively includes: detecting the costal margin boundary, lung apex boundary, and mediastinal and transverse diaphragmatic edges of the left chest image and the right chest image respectively; obtaining a segmented image of the left lung based on the costal margin boundary, lung apex boundary, and mediastinal and transverse diaphragmatic edges corresponding to the left chest image; and obtaining a segmented image of the right lung based on the costal margin boundary, lung apex boundary, and mediastinal and transverse diaphragmatic edges corresponding to the right chest image.

[0164] In an embodiment of this disclosure, the method for determining the rib edge boundary of the left chest image includes: constructing a directional derivative template for the left chest image using directional derivatives, and setting a predetermined weighting depth for the directional derivative template; performing template traversal of the directional derivatives on the left chest image using the directional derivative template corresponding to the predetermined weighting depth, and superimposing the result of the template traversal onto the left chest image to obtain a superimposed left chest image; performing binarization processing on the superimposed left chest image to obtain a binary map of the left rib edge; obtaining a rib edge angle map of the left side to be filtered based on the binary map of the left rib edge and the superimposed left chest image; obtaining a filtered left rib edge angle map based on the rib edge angle map of the left side to be filtered and a first predetermined rib edge angle; and performing connected component selection on the left rib edge angle map to obtain the rib edge boundary corresponding to the largest connected component.

[0165] In an embodiment of this disclosure, the method for obtaining the left rib angle map to be screened based on the left rib edge binary image and the overlay image of the left chest includes: performing morphological opening and closing operations and thinning processing on the left rib edge binary image to obtain a morphologically processed left rib edge binary image; performing a bitwise AND operation on the gradient direction angle of each pixel in the morphologically processed left rib edge binary image and the overlay image of the left chest to obtain the left rib angle map to be screened.

[0166] In the embodiments of this disclosure, before constructing the directional derivative template of the left chest image using the directional derivative, the left chest image is subjected to Gaussian blurring at a set scale to obtain a corresponding Gaussian blurred image of the left chest; then, the directional derivative template of the Gaussian blurred image of the left chest is constructed using the directional derivative; during the process of defining the rib edge boundary of the left chest image, the template of the directional derivative corresponding to the set weighted depth is used to perform template traversal of the directional derivative of the Gaussian blurred image of the left chest, and the result of the template traversal is superimposed on the left chest image to obtain a Gaussian blurred superimposed image of the left chest; the Gaussian blurred superimposed image of the left chest is binarized to obtain a binary map of the left rib edge; based on the binary map of the left rib edge and the Gaussian blurred superimposed image of the left chest, the rib edge angle map of the left side to be screened is obtained.

[0167] a. In embodiments of this disclosure and other possible embodiments, the lung field segmentation steps are as follows, taking a left chest image as an example. For example, rib border detection in a left chest image.

[0168] 1) Apply a Gaussian blur of a predetermined scale to the left chest region (image) to reduce the detail information of this left chest region (image), resulting in a processed Gaussian blurred image of the left chest. The predetermined scale can be configured as 7×7 or 9×9, and those skilled in the art can configure the predetermined scale according to actual needs. The root mean square error of the Gaussian blur algorithm can be configured as a value such as 2, 2.5, or 3, and those skilled in the art can configure the root mean square error σ of the Gaussian blur algorithm according to actual needs.

[0169] 2) Construct a directional derivative template for the processed Gaussian blurred image f(x0,y0) of the left chest using the directional derivative, and set a weighted depth for the directional derivative template. Here, (x0,y0) represent the x-coordinate x0 and y-coordinate y0 of the coordinate point corresponding to the left chest image f(x0,y0), respectively.

[0170] The formula for calculating the directional derivative is as follows:

[0171]

[0172] Where l is a unit vector in the direction, and cosα and cosβ are the cosines of the l direction. The direction can be configured as a horizontal direction, α is the angle formed by the l direction and the horizontal direction, and β is the angle formed by the l direction and the vertical direction.

[0173] The method for constructing a directional derivative template of the processed Gaussian blurred image f(x0, y0) of the left chest using the directional derivative includes: obtaining the first radius in the x0 direction corresponding to the set template radius r. and the second radius in the y0 direction Based on the first radius and the second radius The directional derivative template of the processed Gaussian blurred image f(x0, y0) of the left chest is constructed using the directional derivative.

[0174]

[0175] in,

[0176]

[0177] For example, the set template radius can be configured to 1, 2, 3, 4, 5, etc. Those skilled in the art can configure the set template radius according to actual needs.

[0178] For example, the first radius in the x0 direction When configured as -1, 0, or 1, the second radius in the y0 direction The value range is -1, 0, and 1.

[0179] Those skilled in the art can configure the set weighted depth according to actual needs; for example, the set weighted depth can be configured to 6. Furthermore, the method for setting the set weighted depth of the directional derivative template includes: obtaining the set weighted depth; multiplying the set weighted depth by the directional derivative template to obtain the directional derivative template corresponding to the set weighted depth; and, based on the structural characteristics of the rib region, reasonably setting a range of directional angles and substituting it into the directional derivative calculation formula to obtain a template array.

[0180] 3) Using the directional derivative template corresponding to the weighted depth, perform directional derivative template traversal on the Gaussian blurred image of the left chest after step a.1, and superimpose the result of the template traversal (add the corresponding pixels) onto the Gaussian blurred image of the left chest in step 1 to obtain the Gaussian blurred superimposed image of the left chest.

[0181] For example, in the Gaussian blurred image of the left chest, each pixel e and its eight-neighbor matrix are: Using the directional derivative template corresponding to the weighted depth Calculate the superposition value of e for each pixel (e+w*(c+2*f+ia-2*dg)).

[0182] 4) Perform maximum inter-class variance binarization on the result of step a.3 (the Gaussian blurred image of the left chest) to obtain the rib edge binary image.

[0183] 5) Perform morphological opening and closing operations and thinning on the result of step a.4 (rib edge binary image) to obtain the morphologically processed rib edge binary image.

[0184] 6) Calculate the horizontal and vertical gradients of the results from step a.3 (the Gaussian blurred overlay image of the left chest) to obtain the horizontal gradient map and the vertical gradient map; based on the horizontal gradient map and the vertical gradient map, calculate the gradient direction angle of each pixel in the Gaussian blurred overlay image of the left chest.

[0185] 7) Perform a bitwise AND operation between the result of step a.5 (the morphologically processed binary image of the rib margin) and the result of step a.6 (the gradient direction angle of each pixel in the Gaussian blurred superimposed image of the left chest) to obtain the rib margin angle image to be screened.

[0186] 8) Based on the characteristics of the rib edge tissue, set a reasonable angle range (first set rib edge angle range), and perform angle filtering on the results obtained in step a.7 (rib edge angle diagram to be filtered) to obtain the filtered rib edge angle diagram.

[0187] 9) Based on the results in step a.8 (the filtered rib angle diagram), select the connected components to obtain the largest connected component, which is the rib portion (rib boundary).

[0188] Similarly, in the embodiments of this disclosure, the method for determining the rib edge boundary of the right chest image includes: constructing a directional derivative template of the right chest image using directional derivatives, and setting a predetermined weighting depth for the directional derivative template; performing template traversal of the directional derivatives of the right chest image using the directional derivative template corresponding to the predetermined weighting depth, and superimposing the result of the template traversal onto the right chest image to obtain a right chest overlay image; performing binarization processing on the right chest overlay image to obtain a right rib edge binary image; obtaining a rib edge angle image of the right side to be filtered based on the right rib edge binary image and the right chest overlay image; obtaining a filtered right rib edge angle image based on the rib edge angle image of the right side to be filtered and a second predetermined rib edge angle; and performing connected component selection on the right rib edge angle image to obtain the rib edge boundary corresponding to the largest connected component.

[0189] Similarly, in the embodiments of this disclosure, the method for obtaining the right rib angle map to be screened based on the right rib edge binary image and the right chest superimposed image includes: performing morphological opening and closing operations and thinning processing on the right rib edge binary image to obtain a morphologically processed right rib edge binary image; performing a bitwise AND operation on the gradient direction angle of each pixel in the morphologically processed right rib edge binary image and the right chest superimposed image to obtain the right rib angle map to be screened.

[0190] Similarly, in the embodiments of this disclosure, before constructing the directional derivative template of the right chest image using the directional derivative, the right chest image is subjected to Gaussian blurring at a set scale to obtain a corresponding right chest Gaussian blurred image; then, the directional derivative template of the right chest Gaussian blurred image is constructed using the directional derivative; during the process of defining the rib edge boundary of the right chest image, the directional derivative template corresponding to the set weighted depth is used to perform template traversal of the directional derivative of the right chest Gaussian blurred image, and the result of the template traversal is superimposed on the right chest image to obtain a right chest Gaussian blurred superimposed image; the right chest Gaussian blurred superimposed image is binarized to obtain a right rib edge binary image; based on the right rib edge binary image and the right chest Gaussian blurred superimposed image, the rib edge angle map of the right side to be screened is obtained.

[0191] b. Lung apex boundary detection. In an embodiment of this disclosure, the method for detecting the left lung apex boundary of the left chest image includes: determining a left lung apex detection region based on the left chest image; determining a left lung apex edge binary map based on the left lung apex detection region; and obtaining the fitted left lung apex boundary by fitting a quadratic function based on the left lung apex edge binary map.

[0192] In an embodiment of this disclosure, the method for determining the detection region of the left lung apex based on the left chest image includes: detecting a first coordinate corresponding to the uppermost coordinate point of the costal margin in the left chest image; the region formed by the first coordinate and the coordinate point of the uppermost right corner of the left chest image as the left lung apex detection region.

[0193] In the embodiments of this disclosure and other possible embodiments, 1) the coordinates of the uppermost coordinate point of the costal margin portion of the detected left chest image are used. 2) The rectangular area formed by the hypotenuse of this coordinate point and the coordinate point of the upper right corner of the left chest image is the lung apex detection area. For the lung apex detection area corresponding to the right lung, the rectangular area formed by the hypotenuse of the coordinate point of the uppermost coordinate point of the costal margin portion and the coordinate point of the upper left corner of the right chest image is the lung apex detection area corresponding to the right lung. 3) The lung apex area obtained in step b.2 is subjected to a set-scale Gaussian filter and contrast enhancement to obtain a filtered and enhanced lung apex area image. 4) Based on the angular characteristics of the lung apex edge, the binary image of the left lung apex edge is determined using the same method as steps a.2 to a.5 based on the filtered and enhanced lung apex area image. The angular characteristics of the lung apex edge are configured as a set angle range. 5) Based on the features of the lung apex edge and the binary image of the left lung apex edge, the Hough space parameters of a quadratic function are used for fitting to obtain the fitted lung apex edge (line). The edge of the lung apex is characterized as a quadratic function that opens downwards.

[0194] Similarly, in the embodiments of this disclosure, the method for detecting the right lung apex boundary of the right chest image includes: determining the right lung apex detection region based on the right chest image; determining the right lung apex edge binary map based on the right lung apex detection region; and obtaining the fitted right lung apex boundary by fitting a quadratic function based on the right lung apex edge binary map.

[0195] Similarly, in the embodiments of this disclosure, the method for determining the right lung apex detection region based on the right chest image includes: detecting the second coordinate corresponding to the uppermost coordinate point of the costal margin in the right chest image; the region formed by the second coordinate and the coordinate point of the upper left corner of the left chest image as the right lung apex detection region.

[0196] c. Mediastinal and diaphragmatic edge detection. In embodiments of this disclosure, a method for detecting the left lung mediastinal and diaphragmatic edges on the left chest image includes: binarizing the left chest image to obtain a left chest binary image; performing edge detection on the left chest binary image to obtain a left chest edge binary map; obtaining a left chest edge angle map based on the gradient direction angle of each pixel in the left chest binary image and the left chest edge binary map; obtaining selected left diaphragmatic and mediastinal edge angle maps based on the obtained left chest edge angle maps and setting the edge angle ranges of the diaphragm and mediastinum; and performing connected component selection processing based on the selected left diaphragmatic and mediastinal edge angle maps to obtain the left lung mediastinal and diaphragmatic edges corresponding to the largest connected component.

[0197] In an embodiment of this disclosure, the method for binarizing the left chest image to obtain a left chest binary image includes: performing contrast enhancement processing and maximum inter-class variance processing on the left chest Gaussian blurred image corresponding to the left chest image to obtain a left chest binary image.

[0198] In an embodiment of this disclosure, the method for determining the gradient direction angle of each pixel in the binary image of the left chest edge includes: calculating the horizontal and vertical gradients of the Gaussian blurred image of the left chest corresponding to the left chest image to obtain the horizontal gradient map and the vertical gradient map of the left chest; and obtaining the gradient direction angle of each pixel in the Gaussian blurred image of the left chest based on the horizontal gradient map and the vertical gradient map of the left chest.

[0199] In embodiments of this disclosure and other possible embodiments, a method for detecting the left lung mediastinum and diaphragm edges in the left chest image includes: 1) performing contrast enhancement processing and maximum inter-class variance processing on the processed left chest Gaussian blurred image obtained in step a.1 to obtain a left chest binary image; 2) performing morphological opening and closing operations and Canny edge detection sequentially on the result of step c.1 (left chest binary image) to obtain a left chest edge binary map; 3) calculating the horizontal and vertical gradients of the processed left chest Gaussian blurred image obtained in step a.1 to obtain a horizontal gradient map and a vertical gradient map; and calculating based on the horizontal and vertical gradient maps... 4) Perform an AND operation on the left chest binary image obtained in step c.1 and the left chest edge binary image obtained in step c.2, retaining the angles at the edge pixels to obtain the left chest edge angle map; 5) Select an appropriate angle range based on the edge characteristics of the diaphragm and diaphragm (set the edge angle range of the diaphragm and diaphragm), remove stray tissue edge information in the left chest edge angle map, and obtain the selected left diaphragm and diaphragm edge angle map; 6) Perform connected component selection processing based on the result of c.5 (the selected left diaphragm and diaphragm edge angle map) to obtain the largest connected component, which is the edge region of the diaphragm and diaphragm.

[0200] Similarly, in the embodiments of this disclosure, the method for detecting the right lung mediastinal and diaphragmatic edges of the right chest image includes: binarizing the right chest image to obtain a right chest binary image; performing edge detection on the right chest binary image to obtain a right chest edge binary map; obtaining a right chest edge angle map based on the gradient direction angle of each pixel in the right chest binary image and the right chest edge binary map; obtaining selected right diaphragmatic and mediastinal edge angle maps based on the obtained right chest edge angle maps and setting the edge angle range of the diaphragm and mediastinum; and performing connected component selection processing based on the selected right diaphragmatic and mediastinal edge angle maps to obtain the right lung mediastinal and diaphragmatic edges corresponding to the largest connected component.

[0201] Similarly, in the embodiments of this disclosure, the method of binarizing the right chest image to obtain a right chest binary image includes: performing contrast enhancement processing and maximum inter-class variance processing on the right chest Gaussian blurred image corresponding to the right chest image to obtain a right chest binary image.

[0202] Similarly, in the embodiments of this disclosure, the method for determining the gradient direction angle of each pixel in the binary image of the right chest edge includes: calculating the horizontal and vertical gradients of the right chest Gaussian blurred image corresponding to the right chest image to obtain the horizontal gradient map and the vertical gradient map of the right chest; and obtaining the gradient direction angle of each pixel in the right chest Gaussian blurred image based on the horizontal gradient map and the vertical gradient map of the right chest.

[0203] (3) Connection of the transverse and mediastinal edges, the lung apex and the costal margin. In the embodiments of this disclosure, the method for obtaining a segmented image of the left lung based on the costal margin boundary, lung apex boundary and mediastinal and transverse edges corresponding to the left chest image includes: calculating the first left lung apex edge point and the left lung mediastinal edge point corresponding to the shortest distance between the lung apex boundary and the mediastinal edge in the left chest image; calculating the second left lung apex edge point and the first left lung costal edge point corresponding to the shortest distance between the lung apex boundary and the costal margin edge in the left chest image; calculating the second costal edge point and the diaphragmatic edge point corresponding to the shortest distance between the costal margin boundary and the transverse edge in the left chest image; and obtaining a segmented image of the left lung based on the first left lung apex edge point, the left lung mediastinal edge point, the second left lung apex edge point, the first left lung costal edge point, the second costal edge point and the diaphragmatic edge point.

[0204] Similarly, in the embodiments of this disclosure, the method for obtaining a segmented image of the right lung based on the costal margin boundary, lung apex boundary, and mediastinal and transverse margins corresponding to the right chest image includes: calculating the first right lung apex edge point and the right lung mediastinal edge point corresponding to the shortest distance between the lung apex boundary and the mediastinal margin in the right chest image; calculating the second right lung apex edge point and the first right lung costal margin edge point corresponding to the shortest distance between the lung apex boundary and the costal margin boundary in the right chest image; calculating the second costal margin edge point and the diaphragmatic edge point corresponding to the shortest distance between the costal margin boundary and the transverse margin in the right chest image; and obtaining a segmented image of the right lung based on the first right lung apex edge point, the right lung mediastinal edge point, the second right lung apex edge point, the first right lung costal margin edge point, the second costal margin edge point, and the diaphragmatic edge point.

[0205] In embodiments of this disclosure and other possible embodiments, the method for connecting the transverse and mediastinal edges, the lung apex, and the costal margin includes: a. calculating the two points (the first lung apex edge point and the mediastinal edge point) with the shortest Euclidean distance between the lung apex edge (line) and the mediastinal edge (line), these two points being one of the endpoints of the lung apex and the transverse and mediastinal boundaries, respectively; b. calculating and obtaining the two points (the second lung apex edge point and the first costal edge edge point) with the shortest Euclidean distance between the lung apex edge (line) and the costal margin edge (line), these two points being one of the endpoints of the lung apex and the costal margin, respectively, and the lung apex region boundary can be obtained based on the other lung apex point obtained in step a; c. calculating and obtaining the costal margin (line) and the transverse and mediastinal edges... The two points with the shortest Euclidean distance between the edges (lines) of the diaphragm (the edge of the second costal margin and the edge of the transverse diaphragm) are respectively one of the endpoints of the costal margin and the transverse and mediastinal margins. The transverse and mediastinal margin boundary region can be obtained based on the other endpoint of the transverse and mediastinal margin boundary obtained in step a. The costal margin boundary region can be obtained based on the other endpoint of the costal margin obtained in step b. d. Connect the edge regions of the three parts obtained in steps a, b, and c above to obtain the closed lung field contour. The lung field region can be segmented based on the difference between the tissues inside and outside the contour boundary. e. The right lung field region is processed in the same way as above. Finally, the lung field region is mapped onto the original image to obtain the lung field segmentation of the original image.

[0206] Step S102: Determine the corresponding multiple left lung motion vertices and multiple right lung motion vertices based on the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points.

[0207] In embodiments of this disclosure, before determining the corresponding multiple left lung motion vertices and multiple right lung motion vertices based on the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points, and before determining the multiple left lung diaphragm motion point sequences and multiple right lung diaphragm motion point sequences based on the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points, the method further includes: extracting multiple left lung contour lines and multiple right lung contour lines corresponding to the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points; and determining the corresponding multiple left lung motion vertices, multiple right lung motion vertices, multiple left lung diaphragm motion point sequences and multiple right lung diaphragm motion point sequences based on the multiple left lung contour lines and the multiple right lung contour lines.

[0208] In embodiments of this disclosure and other possible embodiments, the method for extracting multiple left lung contour lines and multiple right lung contour lines corresponding to the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points includes: obtaining an edge detection algorithm or an edge detection model; and using the edge detection algorithm or the edge detection model to extract multiple left lung contour lines and multiple right lung contour lines corresponding to the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points.

[0209] In embodiments of this disclosure and other possible embodiments, the edge detection algorithm or edge detection model may be configured as one or more edge detection algorithms or edge detection models based on the Sobel operator, Prewitt operator, Roberts operator, Canny operator, Marr-Hildreth operator.

[0210] In an embodiment of this disclosure, the method for determining a plurality of left lung motion vertices and a plurality of right lung motion vertices based on the plurality of left lung contour lines and the plurality of right lung contour lines includes: detecting a plurality of left lung vertices and a plurality of right lung vertices corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively, and configuring the coordinates corresponding to the plurality of left lung vertices and the plurality of right lung vertices as the plurality of left lung motion vertices and the plurality of right lung motion vertices respectively.

[0211] In embodiments of this disclosure, the method for detecting multiple left lung vertices and multiple right lung vertices corresponding to the multiple left lung contour lines and the multiple right lung contour lines includes: determining multiple first maximum ordinates and multiple second maximum ordinates corresponding to the multiple left lung contour lines and the multiple right lung contour lines; determining multiple first abscissas corresponding to the multiple first maximum ordinates based on the multiple first maximum ordinates and the multiple left lung contour lines; determining multiple second abscissas corresponding to the multiple second maximum ordinates based on the multiple second maximum ordinates and the multiple right lung contour lines; configuring the multiple first maximum ordinates and their corresponding multiple first abscissas as multiple left lung vertices; and configuring the multiple second maximum ordinates and their corresponding multiple second abscissas as multiple right lung vertices.

[0212] In embodiments of this disclosure and other possible embodiments, the method for determining multiple first maximum ordinates and multiple second maximum ordinates corresponding to the multiple left lung contours and the multiple right lung contours includes: establishing a coordinate system corresponding to the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple moments during the breathing process; and determining multiple first maximum ordinates and multiple second maximum ordinates corresponding to the multiple left lung contours and the multiple right lung contours in the coordinate system.

[0213] Step S103: Based on the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points, determine multiple left lung diaphragm motion point sequences and multiple right lung diaphragm motion point sequences respectively.

[0214] In embodiments of this disclosure, the method for determining corresponding sequences of multiple left-lung diaphragm motion points and multiple right-lung diaphragm motion points based on the multiple left-lung contour lines and the multiple right-lung contour lines includes: detecting multiple lowest points of the left lung and multiple lowest points of the right lung corresponding to the multiple left-lung contour lines and the multiple right-lung contour lines, and configuring the multiple lowest points of the left lung and the multiple lowest points of the right lung as the starting points of the multiple left-lung diaphragm motion point sequences and the multiple right-lung diaphragm motion point sequences, respectively; detecting the multiple lowest points of the left lung and the multiple right-lung contour lines corresponding to the multiple left-lung contour lines and the multiple right-lung contour lines respectively. The system identifies multiple left lung vertices and multiple right lung vertices, and configures the coordinates corresponding to the multiple left lung vertices and the multiple right lung vertices as candidate endpoints for the multiple left lung diaphragm motion point sequences and the multiple right lung diaphragm motion point sequences, respectively. The system determines the multiple left lung diaphragm motion point sequences based on the starting points of the multiple left lung diaphragm motion point sequences and the candidate endpoints of the multiple left lung diaphragm motion point sequences, respectively. The system also determines the multiple right lung diaphragm motion point sequences based on the starting points of the multiple right lung diaphragm motion point sequences and the candidate endpoints of the multiple right lung diaphragm motion point sequences, respectively.

[0215] Similarly, in embodiments of this disclosure and other possible embodiments, in the coordinate system, the plurality of left lung diaphragm motion point sequences are determined based on the starting point of the plurality of left lung diaphragm motion point sequences and the candidate ending point of the plurality of left lung diaphragm motion point sequences, respectively.

[0216] In embodiments of this disclosure, the method for determining the plurality of left lung diaphragm motion point sequences based on the starting points and candidate endpoints of the plurality of left lung diaphragm motion point sequences includes: obtaining a first set step size; calculating, based on the first set step size, a plurality of first slope values ​​corresponding to the points from the starting points to the candidate endpoints of the plurality of left lung diaphragm motion point sequences; determining the endpoints of the plurality of left lung diaphragm motion point sequences based on the plurality of first slope values; or, determining, respectively, a left lung contour line between the starting points and the candidate endpoints of the plurality of left lung diaphragm motion point sequences; and, on the left lung contour line between them, determining the endpoints of the plurality of left lung diaphragm motion point sequences in an interactive manner.

[0217] In the embodiments of this disclosure and other possible embodiments, those skilled in the art can configure the first set step size according to actual needs. For example, the first set step size can be configured to any value between 1 and 10 or other values.

[0218] For example, in the first starting point (x1, y1) of multiple left lung diaphragm motion point sequences, if the first set step size is configured as n, then the first slope values ​​corresponding to the multiple first slope values ​​are respectively (y1, y1, y2, y3, y4 ...1+n -y1) / [x 1+n -x1), (y 1+2*n -y 1+n ) / [x 1+2*n -x 1+n ), ...

[0219] In an embodiment of this disclosure, the method for determining the endpoint of the plurality of left lung diaphragm motion point sequences based on the plurality of first slope values ​​includes: determining the candidate endpoint corresponding to the change of the sign of the plurality of first slope values ​​from negative to positive as the endpoint of the plurality of left lung diaphragm motion point sequences.

[0220] In embodiments of this disclosure and other possible embodiments, the method for interactively determining the endpoints of the plurality of left lung diaphragm motion point sequences along the left lung contour line includes:

[0221] The multiple left lung contour lines are configured with colors respectively, and the multiple left lung contour lines after the color configuration are displayed respectively;

[0222] On the multiple left lung contour lines shown, click the endpoints of the multiple left lung diaphragm motion point sequences to determine the endpoints of the multiple left lung diaphragm motion point sequences.

[0223] In embodiments of this disclosure, the method for determining the plurality of right lung diaphragm motion point sequences based on the starting points and candidate ending points of the plurality of right lung diaphragm motion point sequences includes: obtaining a second set step size; calculating a plurality of second slope values ​​corresponding to the starting points and candidate ending points of the plurality of right lung diaphragm motion point sequences based on the second set step size; determining the ending points of the plurality of right lung diaphragm motion point sequences based on the plurality of second slope values; or, determining a right lung contour line between the starting points and candidate ending points of the plurality of right lung diaphragm motion point sequences; and determining the ending points of the plurality of right lung diaphragm motion point sequences in an interactive manner along the right lung contour line between them.

[0224] In the embodiments of this disclosure and other possible embodiments, those skilled in the art can configure the second set step size according to actual needs. For example, the second set step size can be configured as any value between 1 and 10 or other values.

[0225] For example, in the first starting point (x2, y2) of multiple right lung diaphragm motion point sequences, if the second set step size is configured as m, then the corresponding second slope values ​​among the multiple second slope values ​​are (y2, ... 2+m -y2) / [x 2+m -x2), (y2+2*m -y 2+m ) / [x 2+2*m -x 2+m ), ...

[0226] In an embodiment of this disclosure, the method for determining the endpoint of the plurality of right lung diaphragm motion point sequences based on the plurality of second slope values ​​includes: determining the candidate endpoints corresponding to the change of the signs of the plurality of second slope values ​​from positive to negative as the endpoints of the plurality of right lung diaphragm motion point sequences.

[0227] In embodiments of this disclosure and other possible embodiments, the method for interactively determining the endpoints of the plurality of right lung diaphragm motion point sequences on the right lung contour lines includes: configuring the colors of the plurality of right lung contour lines respectively, and displaying the plurality of right lung contour lines after the color configuration respectively; clicking the endpoints of the plurality of right lung diaphragm motion point sequences on the displayed plurality of right lung contour lines respectively, thereby determining the endpoints of the plurality of right lung diaphragm motion point sequences respectively.

[0228] Step S104: Determine the movement of the left lung diaphragm based on the multiple left lung movement vertices and the multiple left lung diaphragm movement point sequences, and determine the movement of the right lung diaphragm based on the multiple right lung movement vertices and the multiple right lung diaphragm movement point sequences.

[0229] In embodiments of this disclosure and other possible embodiments, the method for determining the motion of the left lung diaphragm based on the plurality of left lung motion vertices and the plurality of left lung diaphragm motion point sequences includes: configuring the plurality of left lung motion vertices as left lung motion reference points respectively; calculating a plurality of first distances between each motion point in the plurality of left lung diaphragm motion point sequences and the left lung motion reference points based on the left lung motion reference points; or, displaying the plurality of left lung motion vertices with lines of a first color and displaying the plurality of left lung diaphragm motion point sequences with lines of a second color respectively.

[0230] In embodiments of this disclosure and other possible embodiments, the method for determining the motion of the right lung diaphragm based on the plurality of right lung motion vertices and the plurality of right lung diaphragm motion point sequences includes: configuring the plurality of right lung motion vertices as right lung motion reference points respectively; calculating a plurality of second distances between each motion point in the plurality of right lung diaphragm motion point sequences and the right lung motion reference points based on the right lung motion reference points; or, displaying the plurality of right lung motion vertices with lines of a first color and the plurality of right lung diaphragm motion point sequences with lines of a second color respectively.

[0231] In embodiments of this disclosure and other possible embodiments, the method of displaying the plurality of left lung motion vertices and the plurality of right lung motion vertices with a first-colored line, and displaying the plurality of left lung diaphragm motion point sequences and the plurality of right lung diaphragm motion point sequences with a second-colored line, includes: acquiring DR left lung images and DR right lung images corresponding to DR images at multiple moments during the breathing process; displaying the DR left lung images and DR right lung images corresponding to DR images at multiple moments during the breathing process; and displaying the plurality of left lung motion vertices and the plurality of right lung motion vertices with a first-colored line, and displaying the plurality of left lung diaphragm motion point sequences and the plurality of right lung diaphragm motion point sequences with a second-colored line on the DR left lung images and DR right lung images corresponding to DR images at multiple moments during the breathing process.

[0232] In embodiments of this disclosure and other possible embodiments, the method of displaying multiple left lung diaphragm motion point sequences and multiple right lung diaphragm motion point sequences with a second-colored line further includes: constructing multiple left lung diaphragm motion curves corresponding to the multiple left lung diaphragm motion point sequences, and configuring the motion point with the smallest slope of each left lung diaphragm motion curve in the multiple left lung diaphragm motion curves as the left lung diaphragm motion point to be displayed at multiple moments during the breathing process; displaying the left lung diaphragm motion point to be displayed with the second-colored line; constructing multiple right lung diaphragm motion curves corresponding to the multiple right lung diaphragm motion point sequences, and configuring the motion point with the smallest slope of each right lung diaphragm motion curve in the multiple right lung diaphragm motion curves as the right lung diaphragm motion point to be displayed at multiple moments during the breathing process; and displaying the right lung diaphragm motion point to be displayed with the second-colored line.

[0233] In embodiments of this disclosure and other possible embodiments, a method for correcting the left lung diaphragm movement points to be displayed at multiple moments during the breathing process includes: acquiring multiple left lung areas during the breathing process; calculating multiple first coordinate points corresponding to a first predetermined slope value of each left lung diaphragm movement curve in the multiple left lung diaphragm movement curves; sorting the multiple first coordinate points corresponding to the first predetermined slope value of each left lung diaphragm movement curve from smallest to largest; and correcting the left lung diaphragm movement points to be displayed at multiple moments based on the multiple left lung areas and the sorted multiple first coordinate points.

[0234] In the embodiments disclosed herein and other possible embodiments, those skilled in the art can configure the first set slope value according to actual needs. For example, the first set slope value can be configured as any value between -0.2 and 0 or other values.

[0235] In embodiments of this disclosure and other possible embodiments, the method for correcting the left lung diaphragm movement points to be displayed at multiple time moments based on the plurality of left lung areas and the plurality of sorted first coordinate points includes: determining the plurality of sorted first coordinate points corresponding to the plurality of left lung areas from the largest area to the smallest area; wherein, the ordinate values ​​of the plurality of sorted first coordinate points corresponding to the plurality of left lung areas from the largest area to the smallest area increase sequentially; if the ordinate values ​​of the left lung diaphragm movement points to be displayed at multiple time moments corresponding to the plurality of left lung areas from the largest area to the smallest area increase sequentially, then the left lung diaphragm movement points to be displayed at multiple time moments are not corrected; otherwise, the non-increasing movement points among the left lung diaphragm movement points to be displayed at multiple time moments are corrected.

[0236] In the embodiments disclosed herein and other possible embodiments, the method for correcting non-increasing motion points among the multiple time-series left lung diaphragm motion points to be displayed includes: extracting the first ordinate corresponding to the non-increasing motion point among the multiple time-series left lung diaphragm motion points to be displayed, and the second and third ordinates corresponding to two adjacent time-series left lung diaphragm motion points on both sides of the non-increasing motion point; determining, among the sorted multiple first coordinate points, a first ordinate to be configured corresponding to a coordinate greater than the third ordinate and less than the second ordinate (or, greater than the second ordinate and less than the third ordinate); and configuring the first ordinate to be configured and its corresponding abscissa as the non-increasing motion point among the multiple time-series left lung diaphragm motion points to be displayed.

[0237] In embodiments of this disclosure and other possible embodiments, a method for correcting the right lung diaphragm movement points to be displayed at multiple moments during the breathing process includes: acquiring multiple right lung areas during the breathing process; calculating multiple second coordinate points corresponding to a second predetermined slope value of each right lung diaphragm movement curve in the multiple right lung diaphragm movement curves; sorting the multiple second coordinate points corresponding to the second predetermined slope value of each right lung diaphragm movement curve in ascending order of their ordinate; and correcting the multiple right lung diaphragm movement points to be displayed at multiple moments based on the multiple right lung areas and the sorted multiple second coordinate points.

[0238] In the embodiments disclosed herein and other possible embodiments, those skilled in the art can configure the second set slope value according to actual needs. For example, the second set slope value can be configured as any value between 0 and 0.2 or other values.

[0239] In embodiments of this disclosure and other possible embodiments, the method for correcting the right lung diaphragm motion points to be displayed at multiple time moments based on the plurality of right lung areas and the plurality of sorted second coordinate points includes: determining the plurality of sorted second coordinate points corresponding to the plurality of right lung areas from the largest area to the smallest area; wherein, the ordinate values ​​of the plurality of sorted second coordinate points corresponding to the plurality of right lung areas from the largest area to the smallest area increase sequentially; if the ordinate values ​​of the plurality of sorted second coordinate points corresponding to the plurality of right lung areas from the largest area to the smallest area increase sequentially with the ordinate values ​​of the right lung diaphragm motion points to be displayed at multiple time moments, then no correction is made to the right lung diaphragm motion points to be displayed at multiple time moments; otherwise, the non-increasing motion points among the right lung diaphragm motion points to be displayed at multiple time moments are corrected.

[0240] In the embodiments disclosed herein and other possible embodiments, the method for correcting non-increasing motion points among the multiple time-series right lung diaphragm motion points to be displayed includes: extracting the first ordinate corresponding to the non-increasing motion point among the multiple time-series right lung diaphragm motion points to be displayed, and the second and third ordinates corresponding to two adjacent time-series right lung diaphragm motion points on both sides of the non-increasing motion point; determining, among the sorted multiple first coordinate points, a second ordinate to be configured corresponding to a coordinate greater than the third ordinate and less than the second ordinate (or, greater than the second ordinate and less than the third ordinate); and configuring the second ordinate to be configured and its corresponding abscissa as the non-increasing motion point among the multiple time-series right lung diaphragm motion points to be displayed.

[0241] In embodiments of this disclosure and other possible embodiments, the method of displaying the plurality of left lung motion vertices and the plurality of right lung motion vertices with a first-colored line, and displaying the plurality of left lung diaphragm motion point sequences and the plurality of right lung diaphragm motion point sequences with a second-colored line, further includes: obtaining a first configuration parameter corresponding to the first-colored line; wherein the first configuration parameter includes: a first line length and a first line width; displaying the plurality of left lung motion vertices and the plurality of right lung motion vertices with the first configuration parameter configured for the first-colored line; obtaining a first configuration parameter corresponding to the second-colored line; wherein the second configuration parameter includes: a second line length and a second line width; displaying the plurality of left lung diaphragm motion point sequences and the plurality of right lung diaphragm motion point sequences with the second configuration parameter configured for the second-colored line. The first color is configured as red and the second color is configured as blue. Alternatively, the first color configuration and the second color configuration can be configured as lines of the same color, such as red, blue, or other colors.

[0242] In addition, embodiments of this disclosure also propose an assessment method that uses the above-described diaphragm movement detection method to detect the diaphragm movement trajectory of the patient to be assessed, including: obtaining a set movement trajectory corresponding to a healthy person; and assessing whether there is a functional disorder in the diaphragm movement of the patient to be assessed based on the diaphragm movement trajectory of the patient to be assessed and the set movement trajectory.

[0243] In embodiments of this disclosure and other possible embodiments, the method for determining the diaphragm movement trajectory corresponding to the patient to be evaluated and the set movement trajectory includes: drawing a first diaphragm movement trajectory corresponding to a plurality of left lung diaphragm movement point sequences corresponding to the patient to be evaluated; and / or drawing a second diaphragm movement trajectory corresponding to a plurality of right lung diaphragm movement point sequences corresponding to the patient to be evaluated; and then determining the diaphragm movement trajectory corresponding to the patient to be evaluated and the set movement trajectory.

[0244] In the embodiments of this disclosure and other possible embodiments, the method for determining the set motion trajectory corresponding to the healthy person before obtaining the set motion trajectory corresponding to the healthy person includes: obtaining a preset number of multiple diaphragm motion trajectories corresponding to the healthy person.

[0245] By fitting the multiple diaphragm movement trajectories, the set movement trajectory corresponding to the healthy person is obtained.

[0246] Similarly, in the embodiments of this disclosure and other possible embodiments, the preset motion trajectory corresponding to the healthy person includes: drawing a first preset motion trajectory corresponding to the left lung and / or a second preset motion trajectory corresponding to the right lung of the healthy person.

[0247] In embodiments of this disclosure and other possible embodiments, before obtaining the set motion trajectory corresponding to a healthy person, the method for determining the set motion trajectory corresponding to the healthy person includes: obtaining a preset number of left lung diaphragm motion trajectories and right lung diaphragm motion trajectories corresponding to the healthy person; fitting the multiple left lung diaphragm motion trajectories to obtain a first set motion trajectory corresponding to the left lung of the healthy person; and fitting the multiple right diaphragm motion trajectories to obtain a second set motion trajectory corresponding to the left lung of the healthy person.

[0248] In the embodiments of this disclosure and other possible embodiments, those skilled in the art can configure the preset number according to actual needs. Meanwhile, the similarity calculation method can be configured as one or more of the following: cosine similarity, adjusted cosine similarity, Pearson correlation coefficient, Jaccard similarity coefficient, Tanimoto coefficient (generalized Jaccard similarity coefficient), log-likelihood similarity / log-likelihood similarity rate, mutual information / information gain, relative entropy / KL divergence, and information retrieval-term frequency-inverse document frequency (TF-IDF).

[0249] In embodiments of this disclosure and other possible embodiments, the method for assessing whether there is a functional disorder in the diaphragm movement of the patient to be assessed based on the diaphragm movement trajectory corresponding to the patient to be assessed and the set movement trajectory includes: assessing whether there is a functional disorder in the left lung diaphragm movement of the patient to be assessed based on the first diaphragm movement trajectory and the first set movement trajectory; and / or, assessing whether there is a functional disorder in the right lung diaphragm movement of the patient to be assessed based on the second diaphragm movement trajectory and the second set movement trajectory.

[0250] In embodiments of this disclosure, the method for assessing whether there is a functional disorder in the diaphragm movement of the patient to be assessed based on the diaphragm movement trajectory corresponding to the patient to be assessed and the set movement trajectory includes: calculating the similarity between the diaphragm movement trajectory and the set movement trajectory; if the similarity is less than the set similarity, then the diaphragm movement of the patient to be assessed has a functional disorder; otherwise, the diaphragm movement of the patient to be assessed does not have a functional disorder.

[0251] In the embodiments of this disclosure and other possible embodiments, those skilled in the art can configure the similarity of the set motion trajectory according to actual needs. For example, the similarity of the set motion trajectory can be configured to 0.8 or other values.

[0252] In embodiments of this disclosure and other possible embodiments, the method of calculating the similarity between the diaphragm movement trajectory and the set movement trajectory; if the similarity is less than the set similarity, then the diaphragm movement of the patient to be evaluated has a functional disorder; otherwise, the diaphragm movement of the patient to be evaluated does not have a functional disorder, includes: calculating a first similarity between the first diaphragm movement trajectory and the first set movement trajectory; if the first similarity is less than the set similarity, then the left lung diaphragm movement of the patient to be evaluated has a functional disorder; otherwise, the left lung diaphragm movement of the patient to be evaluated does not have a functional disorder; and / or, calculating a second similarity between the second diaphragm movement trajectory and the second set movement trajectory; if the second similarity is less than the set similarity, then the right lung diaphragm movement of the patient to be evaluated has a functional disorder; otherwise, the right lung diaphragm movement of the patient to be evaluated does not have a functional disorder.

[0253] In the embodiments of this disclosure and other possible embodiments, the evaluation method further includes: obtaining left lung and right lung images corresponding to the left and right lungs as described above by the lung segmentation method, and extracting features from the left lung images and / or right lung images respectively to obtain left lung features and right lung features; wherein, the left lung features and right lung features include: lung field area during breathing and / or lung ventilation and / or lung blood flow during breath-holding, one or more of these; and performing lung disease evaluation based on the left lung features and / or right lung features.

[0254] In embodiments of this disclosure and other possible embodiments, the method for extracting features from the left and / or right lung images to obtain lung field areas during the respiratory process includes: acquiring two-dimensional DR left and / or two-dimensional DR right lung images at multiple moments during the respiratory process; determining the left and / or right lung areas during the respiratory process based on the two-dimensional DR left and / or right lung images at multiple moments during the respiratory process; acquiring the patient's age, height, and gender information corresponding to the left and / or right lung areas during the respiratory process, and determining a set left and right lung field area during the respiratory process based on the age, height, and gender information; and assessing the patient's lung development based on the left and right lung field areas, the set left and right lung field areas, and the set right lung field areas during the respiratory process. This improves the intelligent assessment level of DR lung images, addressing the current problem that DR lung images are not widely used in lung development assessment.

[0255] In embodiments of this disclosure, the method for determining the area of ​​the left lung and / or the area of ​​the right lung during the breathing process based on two-dimensional DR left lung images and / or two-dimensional DR right lung images at multiple moments during the breathing process includes: obtaining a set area corresponding to a single pixel; counting the number of left lung pixels in the two-dimensional DR left lung images and / or the number of right lung pixels in the two-dimensional DR right lung images at multiple moments during the breathing process; and calculating the area of ​​the left lung and / or the area of ​​the right lung corresponding to the number of left lung pixels in the two-dimensional DR left lung images and / or the number of right lung pixels in the two-dimensional DR right lung images at multiple moments during the breathing process based on the set area.

[0256] In the embodiments of this disclosure and other possible embodiments, those skilled in the art can configure the set area corresponding to the individual pixel according to actual needs.

[0257] In embodiments of this disclosure, the method for calculating the left lung area and / or right lung area corresponding to the number of left lung pixels in a two-dimensional DR left lung image and / or the number of right lung pixels in a two-dimensional DR right lung image at multiple moments during the breathing process, based on the set area, includes: multiplying the set area by the number of left lung pixels in a two-dimensional DR left lung image at multiple moments during the breathing process to obtain the left lung area corresponding to the breathing process; and / or multiplying the set area by the number of right lung pixels in a two-dimensional DR right lung image at multiple moments during the breathing process to obtain the right lung area corresponding to the breathing process.

[0258] In the embodiments of this disclosure and other possible embodiments, those skilled in the art can configure the set left lung field area and set right lung field area according to actual needs. For example, the age, height, and gender information corresponding to the patient for the lung development assessment should be consistent with or substantially consistent with the age, height, and gender information corresponding to the set left lung field area and set right lung field area.

[0259] For example, in the embodiments of this disclosure and other possible embodiments, the method for determining the set left lung field area and / or set right lung field area includes: acquiring the left lung field area and right lung field area corresponding to multiple age information, height information and gender information of normal lung development, respectively; calculating the average left lung field area and / or average right lung field area corresponding to height within the same gender and within a first set deviation range and age within a second set deviation range, respectively; and configuring the average left lung field area and / or the average right lung field area as the set left lung field area and / or set right lung field area, respectively.

[0260] In the embodiments of this disclosure and other possible embodiments, those skilled in the art can configure the first and second set deviation ranges according to actual needs. For example, the first set deviation range can be configured as 1-2 cm, and the second set deviation range as 1-3 years. That is, when separately calculating the average left lung field area and / or average right lung field area corresponding to height within the first set deviation range and age within the second set deviation range for the same sex, the age difference of the samples with normal lung development corresponding to the average left lung field area and / or average right lung field area is within 1-3 years, and the height difference is within 1-2 cm.

[0261] In embodiments of this disclosure, the method for assessing lung development in a patient based on the left lung field area, right lung field area, a predetermined left lung field area, and a predetermined right lung field area during the patient's breathing process includes: if the left lung field area during the breathing process is smaller than the corresponding predetermined left lung field area during the breathing process, then the patient's left lung development is abnormal; otherwise, the patient's left lung development is normal; or, calculating the average left lung area corresponding to the left lung field area during the breathing process and calculating the predetermined average left lung area corresponding to the predetermined left lung field area during the breathing process; if the average left lung area is smaller than the predetermined average left lung area, then the patient's left lung development is abnormal; otherwise, the patient's left lung development is normal.

[0262] In embodiments of this disclosure, if the area of ​​the right lung field during respiration is smaller than the corresponding set area of ​​the right lung field during respiration, then the patient's right lung development is abnormal; otherwise, the patient's right lung development is normal; or, the average area of ​​the right lung corresponding to the area of ​​the right lung field during respiration and the set average area of ​​the right lung corresponding to the set area of ​​the right lung field during respiration are calculated respectively; if the average area of ​​the right lung is smaller than the set average area of ​​the right lung, then the patient's right lung development is abnormal; otherwise, the patient's right lung development is normal.

[0263] In embodiments of this disclosure, the method further includes: under the condition that the lung development assessment of the patient is based on the left lung field area, right lung field area, and a set left lung field area and a set right lung field area during the patient's breathing process, and the result is that the right lung development is normal and / or the right lung development is normal, obtaining the left lung area and / or right lung area corresponding to the patient's deep inspiration and deep expiration during the breathing process, and determining the corresponding set value of the left lung area and / or the set value of the right lung area based on the age information, height information, and gender information; and performing a lung development assessment of the patient based on the left lung area and the set value of the left lung area during deep inspiration and deep expiration and / or based on the right lung area and the set value of the right lung area.

[0264] In the embodiments of this disclosure and other possible embodiments, the method for determining the set left lung field area and / or set right lung field area corresponding to deep inspiration and deep exhalation includes: acquiring the left lung field area and / or right lung field area corresponding to multiple age information, height information and gender information of normal lung development under deep inspiration and deep exhalation; calculating the average left lung field area and / or average right lung field area corresponding to height within a first set deviation range and age within a second set deviation range for the same gender; and configuring the average left lung field area and / or the average right lung field area as the set left lung field area and / or set right lung field area corresponding to deep inspiration and deep exhalation.

[0265] Similarly, in the embodiments of this disclosure and other possible embodiments, those skilled in the art can configure the first set deviation range and the second set deviation range according to actual needs. For example, the first set deviation range can be configured as 1-2 cm, and the second set deviation range can be configured as 1-3 years. That is, when separately calculating the average left lung field area and / or average right lung field area corresponding to height within the first set deviation range and age within the second set deviation range for the same sex under deep inspiration and deep expiration, the age difference of the samples with normal lung development corresponding to the average left lung field area and / or average right lung field area under deep inspiration and deep expiration is within 1-3 years, and the height difference is within 1-2 cm.

[0266] In embodiments of this disclosure, the method based on the left lung area and a set value for the left lung area includes: calculating a first difference between the left lung area during deep inspiration and the left lung area during deep expiration; and using the first difference and the set value for the left lung area to assess the patient's lung development. The method for assessing the patient's lung development using the first difference and the set value for the left lung area includes: if the first difference is greater than or equal to the set value for the left lung area, then the patient's left lung development is abnormal; otherwise, the patient's left lung development is normal.

[0267] In embodiments of this disclosure, the method based on the right lung area and a set value for the right lung area includes: calculating a second difference between the right lung area during deep inspiration and the right lung area during deep expiration; and using the second difference and the set value for the right lung area to assess the patient's lung development. The method of assessing the patient's lung development using the second difference and the set value for the right lung area includes: if the second difference is greater than or equal to the set value for the right lung area, then the patient's right lung development is abnormal; otherwise, the patient's right lung development is normal.

[0268] In embodiments of this disclosure and other possible embodiments, the method for determining the set value of the left lung area includes: calculating the difference between the average left lung field area (set left lung field area) during deep inspiration and deep expiration to obtain the set value of the left lung area. Similarly, the method for determining the set value of the right lung area includes: calculating the difference between the average right lung field area (set right lung field area) during deep inspiration and deep expiration to obtain the set value of the right lung area.

[0269] In an embodiment of this disclosure, the method for assessing pulmonary blood flow under breath-holding conditions includes: acquiring left and right lung images corresponding to multiple first DR lung images at multiple times under breath-holding conditions; determining pulmonary vascular region images corresponding to the multiple left and right lung images respectively; and performing silhouette processing on the multiple pulmonary vascular region images corresponding to the multiple left and right lung images to obtain pulmonary blood flow images corresponding to heartbeats.

[0270] In the embodiments of this disclosure and other possible embodiments, before acquiring the two-dimensional DR left lung image and / or two-dimensional DR right lung image at multiple moments during the breathing process or breath-holding state, the two-dimensional DR lung image at multiple moments during the breathing process or breath-holding state is acquired, and the two-dimensional DR lung image at multiple moments during the breathing process or breath-holding state is segmented into the left and right lungs to obtain the two-dimensional DR left lung image and two-dimensional DR right lung image at multiple moments.

[0271] In the embodiments of this disclosure, pulmonary vascular region images corresponding to multiple left lung images and right lung images are determined respectively.

[0272] In embodiments of this disclosure, the method for determining the pulmonary vascular region images corresponding to multiple left lung images and right lung images includes: obtaining a maximum density projection algorithm or a maximum density projection model; and using the maximum density projection algorithm or the maximum density projection model to determine the pulmonary vascular region images corresponding to multiple left lung images and right lung images.

[0273] In the embodiments of this disclosure, before determining the pulmonary vascular region images corresponding to the multiple left and right lung images using the maximum density projection algorithm or the maximum density projection model, a Gaussian blur algorithm or Gaussian blur model is obtained; the Gaussian blur algorithm or Gaussian blur model is used to perform Gaussian blur processing on the left and right lung images corresponding to the multiple first DR lung images to obtain multiple Gaussian blurred left lung images and multiple Gaussian blurred right lung images; the pulmonary vascular region images corresponding to the multiple Gaussian blurred left lung images and multiple Gaussian blurred right lung images are determined using the maximum density projection algorithm or the maximum density projection model.

[0274] In the embodiments of this disclosure and other possible embodiments, Maximum Intensity Projection (MIP) measures the maximum value of pixels at the same location in multiple first DR lung images at multiple time points under breath-holding conditions across different frames. The set of maximum pixel values ​​from all the multiple first DR lung images can determine the pulmonary vascular region images corresponding to the multiple left and right lung images. Therefore, after determining the pulmonary vascular region images corresponding to the multiple left and right lung images, pulmonary blood flow analysis can be further performed based on the blood vessels in the pulmonary vascular region images.

[0275] In embodiments of this disclosure and other possible embodiments, silhouette processing is performed on the pulmonary vascular region images corresponding to the plurality of left and right lung images to obtain pulmonary blood flow images corresponding to heartbeats. The pulmonary blood flow images corresponding to heartbeats include one or more of the following: pulmonary blood flow distribution images and / or flow velocity images.

[0276] In the embodiments of this disclosure and other possible embodiments, since multiple first DR lung images are acquired at multiple times during the breath-holding state, it is assumed that the left and right lung areas corresponding to the multiple first DR lung images at multiple times will not change, and the airflow in the left and right lungs corresponding to the multiple first DR lung images at multiple times will not change accordingly. During the breath-holding process, the heart will beat, and the distribution image and / or flow velocity image of the lung blood flow corresponding to the heartbeat can be obtained.

[0277] In embodiments of this disclosure and other possible embodiments, when it is difficult to assess these changes by observing images, image subtraction is a method for identifying minute changes in pixel values. By subtracting images between frames and between specific images from multiple first DR lung images at multiple times, distribution images and / or velocity images of pulmonary blood flow corresponding to heartbeats can be obtained.

[0278] In an embodiment of this disclosure, the method of performing silhouette processing on the pulmonary vascular region images corresponding to the plurality of left lung images and right lung images to obtain pulmonary blood flow images corresponding to heartbeats includes: configuring the pulmonary vascular region image corresponding to the start of diastole after cardiac systole in the plurality of time moments as a first base image, and configuring the pulmonary vascular region images corresponding to other time moments other than the aforementioned time moment as a plurality of first images to be processed; subtracting the first base image from the plurality of first images to be processed to obtain pulmonary blood flow distribution images corresponding to heartbeats.

[0279] In embodiments of this disclosure, the method of performing silhouette processing on the pulmonary vascular region images corresponding to the plurality of left and right lung images to obtain pulmonary blood flow images corresponding to heartbeats further includes: performing silhouette processing on pulmonary vascular region images at adjacent times in the left and right lung images corresponding to the plurality of first DR lung images at multiple times to obtain pulmonary blood flow velocity maps corresponding to heartbeats. Specifically, the method of performing silhouette processing on pulmonary vascular region images at adjacent times in the left and right lung images corresponding to the plurality of first DR lung images at multiple times to obtain pulmonary blood flow velocity maps corresponding to heartbeats includes: subtracting adjacent pulmonary vascular region images in the plurality of left and right lung images to obtain pulmonary blood flow velocity maps corresponding to heartbeats.

[0280] In embodiments of this disclosure, the method of performing silhouette processing on the pulmonary vascular region images corresponding to the plurality of left and right lung images to obtain pulmonary blood flow images corresponding to heartbeats further includes: configuring the pulmonary vascular region image corresponding to any one moment within the cardiac systole or diastole of the plurality of moments as a second base image, and configuring the pulmonary vascular region images corresponding to other moments within the cardiac systole or diastole outside of the arbitrary moment as a plurality of second images to be processed; subtracting the second base image from the plurality of second images to be processed to obtain a pulmonary blood flow distribution image during cardiac systole or a pulmonary blood flow distribution image during cardiac diastole corresponding to heartbeats. The plurality of moments are configured as a complete cardiac cycle formed by the cardiac systole and systole.

[0281] In embodiments of this disclosure, the method further includes: before acquiring the left lung image and right lung image corresponding to multiple first DR lung images at multiple times under the breath-holding state, the method further includes: performing rib suppression or rib reduction on the left lung image and right lung image corresponding to the multiple first DR lung images under the breath-holding state, respectively.

[0282] In embodiments of this disclosure, the method further includes: displaying the blood flow in the pulmonary blood flow image corresponding to the heartbeat with a set color. The method for displaying the blood flow in the pulmonary blood flow image corresponding to the heartbeat with a set color includes: obtaining a configuration corresponding to the set color; and displaying the blood flow in the pulmonary blood flow image corresponding to the heartbeat with the set color based on the configuration corresponding to the set color.

[0283] In the embodiments of this disclosure, the configuration corresponding to the set color includes one or more of hue, saturation, and brightness; and / or, wherein the set color or the hue configuration is in the red family.

[0284] In the embodiments and other possible embodiments disclosed herein, hue refers to the appearance of a color, which is what we usually refer to as various colors, such as red, orange, yellow, green, cyan, blue, and purple. Hue is the best standard for distinguishing different colors. It is unrelated to the intensity or brightness of a color; it simply represents the difference in the appearance of the hue. Saturation, on the other hand, refers to the vividness of a color. It is one of the important attributes affecting the final effect of a color. Saturation is also called the purity of a color, which is the ratio of chromatic components to achromatic components (i.e., gray) in a color. This ratio determines the saturation and vividness of the color. Brightness (or lightness) refers to the lightness or darkness of a color. Brightness depends not only on the intensity of the light source but also on the reflectance of the object's surface.

[0285] In embodiments of this disclosure, the lung ventilation assessment method during respiration includes: acquiring left and right lung images corresponding to multiple DR lung images during respiration, multiple registration transformation matrices during respiration, and a preset air threshold interval; using the multiple registration transformation matrices during respiration, performing registration operations on the left and right lung images corresponding to the multiple DR lung images respectively to obtain left and right lung registration images corresponding to the multiple DR lung images; and determining the lung ventilation regions corresponding to the multiple DR lung images at multiple times during respiration based on the preset air threshold interval and the left and right lung registration images corresponding to the multiple DR lung images respectively.

[0286] In embodiments of this disclosure, left and right lung images corresponding to multiple DR lung images during respiration, multiple registration transformation matrices during respiration, and a preset air threshold range are acquired. The multiple DR lung images during respiration are multiple DR lung images; the left and right lung images corresponding to the multiple DR lung images during respiration are two-dimensional DR left lung images and two-dimensional DR right lung images.

[0287] In the embodiments of this disclosure and other possible embodiments, before acquiring the two-dimensional DR left lung images and / or two-dimensional DR right lung images at multiple moments during breathing or breath-holding, the two-dimensional DR lung images at multiple moments during breathing or breath-holding are acquired, and the left and right lungs are segmented into the two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments to obtain the two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments. For example, the two-dimensional DR lung images at multiple moments during breath-holding can be configured as multiple first DR lung images, and the two-dimensional DR left lung images at multiple moments during breathing can be configured as multiple second DR lung images.

[0288] In the embodiments of this disclosure, before acquiring the left and right lung images corresponding to multiple DR lung images during the breathing process, rib suppression or rib reduction is performed on the left and right lung images corresponding to the multiple DR lung images during the breathing process.

[0289] In the embodiments of this disclosure and other possible embodiments, those skilled in the art can configure the preset air threshold range according to actual needs. Meanwhile, this disclosure proposes a method for determining the preset air threshold range. Before obtaining the preset air threshold range, the method for determining the preset air threshold range includes: determining the minimum preset air threshold corresponding to the left and right lung images of multiple DR lung images during the breathing process, respectively; and determining the maximum preset air threshold corresponding to the left and right lung images of multiple DR lung images during the breathing process based on the minimum preset air threshold and a set threshold step size.

[0290] In the embodiments of this disclosure and other possible embodiments, those skilled in the art can configure the set threshold step size according to actual needs. For example, 2, 3, 5, 10, etc. Simultaneously, the minimum pixel threshold corresponding to the left and right lung images corresponding to multiple DR lung images during the breathing process is configured as the minimum preset air threshold.

[0291] In embodiments of this disclosure, the method for determining the maximum preset air threshold corresponding to the left and right lung images of multiple DR lung images during the breathing process based on the minimum preset air threshold and a set threshold step size includes: displaying the left and right lung images of multiple DR lung images during the breathing process respectively; marking the displayed left and right lung images of multiple DR lung images with air based on the minimum preset air threshold and a set threshold step size; and determining the maximum preset air threshold corresponding to the left and right lung images of multiple DR lung images during the breathing process based on the air markings of the left and right lung images of multiple DR lung images.

[0292] In embodiments of this disclosure and other possible embodiments, the method for marking the left and right lung images corresponding to the multiple displayed DR lung images based on the minimum preset air threshold and the set threshold step size includes: obtaining the cumulative number K; wherein the cumulative number K ≥ 1; adding K * the set threshold step size to the minimum preset air threshold to obtain the left and right lung images corresponding to the multiple DR lung images with different cumulative numbers K; so as to mark the left and right lung images corresponding to the multiple displayed DR lung images.

[0293] In an embodiment of this disclosure, the method for marking air in the left and right lung images corresponding to the multiple displayed DR lung images based on the minimum preset air threshold and the set threshold step size includes: determining an air threshold range to be displayed based on the minimum preset air threshold and the set threshold step size; and marking air in the left and right lung images corresponding to the multiple displayed DR lung images based on the air threshold range to be displayed.

[0294] In embodiments of this disclosure and other possible embodiments, the method for determining the air threshold interval to be displayed based on the minimum preset air threshold and the set threshold step size includes: obtaining the number of accumulations K; wherein the number of accumulations K≥1; adding K*the set threshold step size to the minimum preset air threshold to obtain the air threshold interval to be displayed corresponding to different number of accumulations K; and then, based on the air threshold interval to be displayed, marking the left lung image and right lung image corresponding to the multiple DR lung images to be displayed.

[0295] In embodiments of this disclosure, the method for determining an air threshold range to be displayed based on the minimum preset air threshold and a set threshold step size includes: determining the maximum pixel threshold corresponding to the left and right lung images of multiple DR lung images during the breathing process; displaying a threshold slider corresponding to the minimum preset air threshold and the maximum pixel threshold; and adjusting the threshold value on the threshold slider based on the set threshold step size to determine the air threshold range to be displayed. The air threshold range to be displayed is configured as the threshold range between the minimum preset air threshold and the air threshold on the threshold slider after adjustment.

[0296] In embodiments of this disclosure, the method for marking the left and right lung images corresponding to the displayed multiple DR lung images with air marking includes: obtaining a first configuration color and / or a first configuration transparency corresponding to the air marking; and marking the left and right lung images corresponding to the displayed multiple DR lung images with air marking based on the first configuration color and / or the first configuration transparency.

[0297] Using multiple registration transformation matrices during the breathing process, registration operations are performed on the left and right lung images corresponding to the multiple DR lung images to obtain the left and right lung registration images corresponding to the multiple DR lung images.

[0298] In embodiments of this disclosure, the method of using multiple registration transformation matrices during the breathing process to perform registration operations on the left and right lung images corresponding to the multiple DR lung images to obtain the left and right lung registration images corresponding to the multiple DR lung images includes: configuring the DR lung image at a first moment during the breathing process as a fixed image, and configuring the DR lung image at a second moment corresponding to the next moment adjacent to the first moment as a floating image; using the multiple registration transformation matrices during the breathing process to perform registration operations on the fixed image and the floating image, or the left and right lung images corresponding to the fixed image and the left and right lung images corresponding to the floating image, to obtain the left and right lung registration images corresponding to the multiple DR lung images.

[0299] In embodiments of this disclosure, a method for determining the multiple registration transformation matrices before acquiring them during the breathing process includes: registering adjacent DR lung images of multiple DR lung images during the breathing process to obtain corresponding multiple registration transformation matrices during the breathing process. Alternatively, a method for determining the multiple registration transformation matrices before acquiring them during the breathing process includes: registering adjacent left and right lung images corresponding to the multiple DR lung images during the breathing process to obtain multiple registration transformation matrices corresponding to the left lung image and multiple registration transformation matrices corresponding to the right lung image during the breathing process. Then, using the multiple registration transformation matrices corresponding to the left lung image and the multiple registration transformation matrices corresponding to the right lung image during the breathing process, registration operations are performed on the left and right lung images corresponding to the multiple DR lung images to obtain the left and right lung registered images corresponding to the multiple DR lung images.

[0300] In the embodiments and other possible embodiments of this disclosure, the registration method used in this disclosure can employ existing registration algorithms or models, such as one or more of SIFT (Scale-invariant feature transform), SURF (Speeded Up Robust Features), and ORB (Oriented FAST and Rotated BRIEF) registration algorithms or models, or other registration algorithms or models based on convolutional neural networks. For example, a registration algorithm or model based on convolutional neural networks can be configured as a registration algorithm or model based on VGG networks.

[0301] In the embodiments of this disclosure, the lung ventilation region corresponding to the multiple DR lung images at multiple moments during the breathing process is determined based on the preset air threshold range and the left lung registration image and right lung registration image corresponding to the multiple DR lung images.

[0302] In embodiments of this disclosure, the method for determining the lung ventilation region corresponding to multiple DR lung images at multiple moments during the breathing process based on the preset air threshold interval and the left and right lung registration images corresponding to the multiple DR lung images includes: determining the air identification region corresponding to the multiple DR lung images based on the preset air threshold interval; and determining the lung ventilation region corresponding to the multiple DR lung images at multiple moments during the breathing process based on the air identification region corresponding to the multiple DR lung images.

[0303] In embodiments of this disclosure and other possible embodiments, the method for determining the air identification regions corresponding to the multiple DR lung images based on the preset air threshold range includes: if the pixel values ​​corresponding to the multiple DR lung images are within the preset air threshold range, then the region where the pixel values ​​are located within the preset air threshold range is determined as the air identification region corresponding to the multiple DR lung images.

[0304] In embodiments of this disclosure, the method for displaying the lung ventilation regions corresponding to multiple DR lung images at multiple moments during the breathing process includes: obtaining a first configuration color and / or a first configuration transparency corresponding to the air identification region; and displaying the air identification regions in the left lung image and right lung image corresponding to the displayed multiple DR lung images based on the first configuration color and / or the first configuration transparency, respectively.

[0305] In the embodiments of this disclosure and other possible embodiments, those skilled in the art can configure the first configuration color and / or the first configuration transparency according to actual needs. For example, the first configuration color can be configured as a blue tone; and the first configuration transparency can be configured as 50%.

[0306] In addition, embodiments of this disclosure also include or apply the lung ventilation region corresponding to multiple DR lung images at multiple times during the breathing process obtained by the lung ventilation determination method described above; based on the left and right lung images corresponding to the multiple DR lung images during the breathing process and the lung ventilation region corresponding to the multiple DR lung images at multiple times during the breathing process, the air retention region of the left and right lung images corresponding to the multiple DR lung images during the breathing process is determined.

[0307] In embodiments of this disclosure, the method for determining the air retention areas of the left and right lung images corresponding to multiple DR lung images during the breathing process, based on the left and right lung images corresponding to multiple DR lung images at multiple times during the breathing process and the lung ventilation areas corresponding to multiple DR lung images at multiple times during the breathing process, includes: determining the lung non-ventilation areas corresponding to multiple DR lung images at multiple times during the breathing process based on the left and right lung images corresponding to multiple DR lung images during the breathing process and the lung ventilation areas corresponding to multiple DR lung images at multiple times during the breathing process; and determining the air retention areas of the left and right lung images corresponding to multiple DR lung images during the breathing process based on the preset air threshold interval and the lung non-ventilation areas.

[0308] In embodiments of this disclosure, the method for determining the non-ventilated lung regions corresponding to multiple DR lung images at multiple moments during the breathing process, based on the left and right lung images corresponding to multiple DR lung images during the breathing process and the ventilation regions corresponding to multiple DR lung images at multiple moments during the breathing process, includes: subtracting the ventilation regions corresponding to the left and right lung images corresponding to the multiple DR lung images during the breathing process from the ventilation regions corresponding to ...

[0309] In embodiments of this disclosure, the method further includes: displaying the air retention areas of the left and right lung images corresponding to multiple DR lung images during the breathing process, including: obtaining a second configuration color and / or a second configuration transparency corresponding to the air retention areas; and displaying the air retention areas of the left and right lung images corresponding to the displayed multiple DR lung images based on the second configuration color and / or the second configuration transparency.

[0310] In the embodiments of this disclosure and other possible embodiments, those skilled in the art can configure the second configuration color and / or the second configuration transparency according to actual needs. For example, the second configuration color can be configured as a yellow tone; and the second configuration transparency can be configured as 50%.

[0311] In embodiments of this disclosure, the method further includes: obtaining pulmonary blood flow images corresponding to heartbeats using the detection method described above; acquiring left and right lung images corresponding to multiple first DR lung images at multiple times during the breath-holding state, multiple registration transformation matrices during the breathing process, and a preset air threshold range; using the multiple registration transformation matrices during the breathing process, performing registration operations on the left and right lung images corresponding to the multiple second DR lung images to obtain left and right lung registration images corresponding to the multiple first DR lung images; determining pulmonary ventilation images corresponding to the multiple second DR lung images at multiple times during the breathing process based on the preset air threshold range and the left and right lung registration images corresponding to the multiple second DR lung images; and determining the ventilation-perfusion ratio of the patient at multiple times based on the pulmonary blood flow images and the pulmonary ventilation images at multiple times.

[0312] In the embodiments of this disclosure and other possible embodiments, the direction of segmenting the left and right lungs of multiple second DR lung images at multiple moments during the breathing process can be found in the detailed description of the left and right lung segmentation method described above.

[0313] In embodiments of this disclosure, the method for determining the ventilation-perfusion ratio of a patient at multiple time points based on the multiple time-series pulmonary blood flow images and the multiple time-series pulmonary ventilation images includes: determining multiple pulmonary blood flow areas corresponding to the multiple time-series pulmonary blood flow images and multiple pulmonary ventilation areas corresponding to the multiple time-series pulmonary ventilation images; and calculating the ratios of the multiple pulmonary blood flow areas to the corresponding multiple pulmonary ventilation areas to obtain the ventilation-perfusion ratio of the patient at multiple time points.

[0314] In embodiments of this disclosure, the method of calculating the ratios of the plurality of pulmonary blood flow areas to the corresponding plurality of pulmonary ventilation areas to obtain the ventilation-perfusion ratio of the patient at multiple time points includes: determining the cardiac systolic time point and cardiac diastolic time point corresponding to the multiple time points; and calculating the ratios of pulmonary blood flow area to pulmonary ventilation area at the same cardiac systolic time point or cardiac diastolic time point to obtain the ventilation-perfusion ratio of the patient at multiple time points.

[0315] In embodiments of this disclosure, a method for determining the multiple registration transformation matrices before obtaining the multiple registration transformation matrices during the breathing process includes: registering adjacent DR lung images of multiple second DR lung images during the breathing process to obtain corresponding multiple registration transformation matrices during the breathing process; or, registering adjacent left and right lung images corresponding to multiple second DR lung images during the breathing process to obtain multiple registration transformation matrices corresponding to the left lung image and multiple registration transformation matrices corresponding to the right lung image during the breathing process; and then, using the multiple registration transformation matrices corresponding to the left lung image and the multiple registration transformation matrices corresponding to the right lung image during the breathing process, performing registration operations on the left and right lung images corresponding to the multiple second DR lung images to obtain the left lung registered image and right lung registered image corresponding to the multiple second DR lung images.

[0316] The execution entity for the diaphragm movement detection and evaluation method can be a diaphragm movement detection device or an evaluation device. For example, the diaphragm movement detection and evaluation method can be executed by a terminal device, a server, or other processing equipment. The terminal device can be a user equipment (UE), mobile device, user terminal, terminal, cellular phone, cordless phone, personal digital assistant (PDA), handheld device, computing device, in-vehicle device, wearable device, etc. In some possible implementations, the diaphragm movement detection and evaluation method can be implemented by a processor calling computer-readable instructions stored in memory.

[0317] Those skilled in the art will understand that in the above-described method for detecting and evaluating diaphragmatic movement in specific embodiments, the order in which each step is written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0318] In addition, this disclosure also proposes a diaphragm motion detection device, which includes: a first acquisition unit for acquiring two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments during respiration; a first determination unit for determining multiple left lung motion vertices and multiple right lung motion vertices based on the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple moments; a second determination unit for determining multiple left lung diaphragm motion point sequences and multiple right lung diaphragm motion point sequences based on the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple moments; and a detection unit for determining the motion of the left lung diaphragm based on the multiple left lung motion vertices and the multiple left lung diaphragm motion point sequences, and determining the motion of the right lung diaphragm based on the multiple right lung motion vertices and the multiple right lung diaphragm motion point sequences.

[0319] In embodiments of this disclosure, the system further includes a segmentation unit; the segmentation unit is configured to segment the two-dimensional DR lung images at multiple moments during the breathing process into left and right lungs before acquiring the two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments during the breathing process, thereby obtaining the two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments.

[0320] In embodiments of this disclosure, the segmentation unit includes: a detection unit; the detection unit is used to detect the costal margin boundary, lung apex boundary, and mediastinal and transverse diaphragmatic edges of the left and right chest images of the two-dimensional DR lung images at multiple time points during the breathing process, respectively, to obtain two-dimensional DR left lung images and two-dimensional DR right lung images at multiple time points; or, the segmentation unit includes: a model and data acquisition unit, a label determination unit, a training unit, and an output unit; the model and data acquisition unit is used to acquire a segmentation model of a preset convolutional neural network and DR lung region label images for training the segmentation model. The label determination unit is used to detect the costal margin boundary, lung apex boundary, and mediastinal and transverse diaphragmatic edges of the left and right chest images of multiple DR lung region images, respectively, to obtain DR lung region label images corresponding to the multiple DR lung region images; the training unit is used to train the segmentation model using the DR lung region label images used to train the segmentation model; the output unit is used to complete the left and right lung segmentation of the two-dimensional DR lung images at multiple time points during the breathing process based on the trained segmentation model, to obtain two-dimensional DR left lung images and two-dimensional DR right lung images at multiple time points.

[0321] In embodiments of this disclosure, the system further includes: a lung contour extraction unit and a motion point determination unit; the lung contour extraction unit is used to extract multiple left lung contours and multiple right lung contours corresponding to the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple time points, respectively, before determining multiple left lung motion vertices and multiple right lung motion vertices based on the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple time points, and before determining multiple left lung diaphragm motion point sequences and multiple right lung diaphragm motion point sequences based on the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple time points; the motion point determination unit is used to determine multiple left lung motion vertices, multiple right lung motion vertices, multiple left lung diaphragm motion point sequences and multiple right lung diaphragm motion point sequences based on the multiple left lung contours and the multiple right lung contours.

[0322] In an embodiment of this disclosure, the motion point determination unit includes: a lung vertex determination unit; the lung vertex determination unit is used to detect a plurality of left lung vertices and a plurality of right lung vertices corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively, and configure the coordinates corresponding to the plurality of left lung vertices and the plurality of right lung vertices as the plurality of left lung motion vertices and the plurality of right lung motion vertices respectively.

[0323] In embodiments of this disclosure, the lung vertex determination unit includes: a coordinate system establishment unit, a coordinate determination unit, and a lung vertex configuration unit; the coordinate system establishment unit is used to establish a coordinate system corresponding to the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple moments during the breathing process; the coordinate determination unit is used to determine, in the coordinate system, a plurality of first maximum ordinates and a plurality of second maximum ordinates corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively; determine, according to the plurality of first maximum ordinates and the plurality of left lung contour lines respectively, a plurality of first abscissas corresponding to the plurality of first maximum ordinates; and determine, according to the plurality of second maximum ordinates and the plurality of right lung contour lines respectively, a plurality of second abscissas corresponding to the plurality of second maximum ordinates; the lung vertex configuration unit is used to configure the plurality of first maximum ordinates and their corresponding plurality of first abscissas as a plurality of left lung vertices respectively; and configure the plurality of second maximum ordinates and their corresponding plurality of second abscissas as a plurality of right lung vertices respectively.

[0324] In embodiments of this disclosure, the motion point determination unit further includes: a diaphragm motion origin determination unit, a diaphragm motion candidate endpoint determination unit, and a diaphragm motion endpoint determination unit; the diaphragm motion origin determination unit is used to detect, respectively, multiple lowest points of the left lung and multiple lowest points of the right lung corresponding to the multiple left lung contour lines and the multiple right lung contour lines, and respectively configure the multiple lowest points of the left lung and the multiple lowest points of the right lung as the starting point of the multiple left lung diaphragm motion point sequence and the multiple right lung diaphragm motion point sequence; the diaphragm motion candidate endpoint determination unit is used to detect, respectively, the multiple left lung contour lines and the multiple right lung contour lines. The system defines multiple left lung vertices and multiple right lung vertices corresponding to the lines, and configures the coordinates corresponding to the multiple left lung vertices and the multiple right lung vertices as candidate endpoints for the multiple left lung diaphragm motion point sequences and the multiple right lung diaphragm motion point sequences, respectively. The diaphragm motion endpoint determination unit is used to determine the multiple left lung diaphragm motion point sequences based on the starting points of the multiple left lung diaphragm motion point sequences and the candidate endpoints of the multiple left lung diaphragm motion point sequences, respectively; and to determine the multiple right lung diaphragm motion point sequences based on the starting points of the multiple right lung diaphragm motion point sequences and the candidate endpoints of the multiple right lung diaphragm motion point sequences, respectively.

[0325] In embodiments of this disclosure, the diaphragm movement endpoint determination unit includes: a first step length acquisition unit and a first slope calculation unit; or, a left lung contour determination unit and a first interaction unit; the first step length acquisition unit is used to acquire a first set step length; the first slope calculation unit is used to calculate, based on the first set step length, a plurality of first slope values ​​corresponding to the starting point of the plurality of left lung diaphragm movement point sequences to the candidate endpoints of the plurality of left lung diaphragm movement point sequences; and determine the endpoints of the plurality of left lung diaphragm movement point sequences according to the plurality of first slope values; or, the left lung contour determination unit is used to determine the left lung contour line between the starting point of the plurality of left lung diaphragm movement point sequences and the candidate endpoints of the plurality of left lung diaphragm movement point sequences; the first interaction unit is used to determine the endpoints of the plurality of left lung diaphragm movement point sequences in an interactive manner on the left lung contour line.

[0326] In an embodiment of this disclosure, the first slope calculation unit includes: a first judgment unit; the first judgment unit is used to determine the candidate endpoints corresponding to the change of the signs of the plurality of first slope values ​​from negative to positive as the endpoints of the plurality of left lung diaphragm motion point sequences.

[0327] In embodiments of this disclosure, the diaphragm movement endpoint determination unit further includes: a second step length acquisition unit and a second slope calculation unit; or, a right lung contour determination unit and a second interaction unit; the second step length acquisition unit is used to acquire a second set step length; the second slope calculation unit is used to calculate, based on the second set step length, a plurality of second slope values ​​corresponding to the starting point of the plurality of right lung diaphragm movement point sequences to the candidate endpoints of the plurality of right lung diaphragm movement point sequences; and determine the endpoints of the plurality of right lung diaphragm movement point sequences according to the plurality of second slope values; or, the right lung contour determination unit is used to determine the right lung contour line between the starting point of the plurality of right lung diaphragm movement point sequences and the candidate endpoints of the plurality of right lung diaphragm movement point sequences; the second interaction unit is used to determine the endpoints of the plurality of right lung diaphragm movement point sequences in an interactive manner on the right lung contour line.

[0328] In an embodiment of this disclosure, the second slope calculation unit includes: a second judgment unit; the second judgment unit is used to determine the candidate endpoints corresponding to the change of the signs of the plurality of second slope values ​​from positive to negative as the endpoints of the plurality of right lung diaphragm motion point sequences.

[0329] Meanwhile, this disclosure also proposes an assessment device, characterized in that it includes: a diaphragm movement detection device as described above, the diaphragm movement detection device being used to detect the diaphragm movement trajectory corresponding to the patient to be assessed; a second acquisition unit being used to acquire a set movement trajectory corresponding to a healthy person; and an assessment unit being used to assess whether there is a functional disorder in the diaphragm movement of the patient to be assessed based on the diaphragm movement trajectory corresponding to the patient to be assessed and the set movement trajectory.

[0330] In embodiments of this disclosure, the evaluation unit includes: a similarity calculation unit and a similarity comparison unit; the similarity calculation unit is used to calculate the similarity between the diaphragm movement trajectory and the set movement trajectory; the similarity comparison unit is used to compare the similarity with the set similarity; if the similarity is less than the set similarity, then the diaphragm movement of the patient to be evaluated has a functional disorder; otherwise, the diaphragm movement of the patient to be evaluated does not have a functional disorder.

[0331] In some embodiments, the functions or modules of the apparatus provided in this disclosure can be used to perform the diaphragm movement detection and evaluation method described in the above method embodiments. The specific implementation can be referred to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0332] This disclosure also proposes a computer-readable storage medium storing computer program instructions that, when executed by a processor, implement the aforementioned diaphragm movement detection method and / or the aforementioned evaluation method. The computer-readable storage medium may be a non-volatile computer-readable storage medium.

[0333] This disclosure also proposes an electronic device, including: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured for the above-described diaphragm movement detection method and / or the above-described evaluation method. The electronic device may be provided as a terminal, a server, or other type of device.

[0334] Figure 2 This is a block diagram illustrating an electronic device 800 according to an exemplary embodiment. For example, the electronic device 800 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, or other terminal.

[0335] Reference Figure 2 The electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0336] Processing component 802 typically controls the overall operation of electronic device 800, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the methods described above. Furthermore, processing component 802 may include one or more modules to facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

[0337] Memory 804 is configured to store various types of data to support the operation of electronic device 800. Examples of this data include instructions for any application or method operating on electronic device 800, contact data, phonebook data, messages, pictures, videos, etc. Memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0338] Power supply component 806 provides power to various components of electronic device 800. Power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 800.

[0339] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the multimedia component 808 includes a front-facing camera and / or a rear-facing camera. When the electronic device 800 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera can receive external multimedia data. Each front-facing camera and rear-facing camera can be a fixed optical lens system or have focal length and optical zoom capabilities.

[0340] Audio component 810 is configured to output and / or input audio signals. For example, audio component 810 includes a microphone (MIC) configured to receive external audio signals when electronic device 800 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 804 or transmitted via communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals. I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, which may be a keyboard, click wheel, buttons, etc. These buttons may include, but are not limited to, a home button, volume buttons, a power button, and a lock button.

[0341] Sensor assembly 814 includes one or more sensors for providing state assessments of various aspects of electronic device 800. For example, sensor assembly 814 can detect the on / off state of electronic device 800, the relative positioning of components such as the display and keypad of electronic device 800, changes in position of electronic device 800 or a component of electronic device 800, the presence or absence of user contact with electronic device 800, orientation or acceleration / deceleration of electronic device 800, and temperature changes of electronic device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 814 may also include an accelerometer, gyroscope, magnetometer, pressure sensor, or temperature sensor.

[0342] Communication component 816 is configured to facilitate wired or wireless communication between electronic device 800 and other devices. Electronic device 800 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 816 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0343] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0344] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 804 including computer program instructions that can be executed by a processor 820 of an electronic device 800 to perform the above-described method.

[0345] Figure 3 This is a block diagram illustrating an electronic device 1900 according to an exemplary embodiment. For example, the electronic device 1900 may be provided as a server. (Refer to...) Figure 3 The electronic device 1900 includes a processing component 1922, which further includes one or more processors, and memory resources represented by memory 1932 for storing instructions, such as application programs, that can be executed by the processing component 1922. The application programs stored in memory 1932 may include one or more modules, each corresponding to a set of instructions. Furthermore, the processing component 1922 is configured to execute instructions to perform the methods described above.

[0346] Electronic device 1900 may also include a power supply component 1926 configured to perform power management of electronic device 1900, a wired or wireless network interface 1950 configured to connect electronic device 1900 to a network, and an input / output (I / O) interface 1958. Electronic device 1900 can operate on an operating system stored in memory 1932, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, or similar.

[0347] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 1932 including computer program instructions that can be executed by a processing component 1922 of an electronic device 1900 to perform the above-described method.

[0348] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or technical improvements to the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. A method for detecting diaphragmatic movement, characterized in that, include: Acquire two-dimensional radiographs of the left and right lungs at multiple points during the respiratory process; The method involves determining multiple left lung motion vertices and multiple right lung motion vertices based on the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points, including: extracting multiple left lung contour lines and multiple right lung contour lines corresponding to the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points; and determining multiple left lung motion vertices and multiple right lung motion vertices based on the multiple left lung contour lines and the multiple right lung contour lines. Based on the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points, multiple sequences of left lung diaphragm motion points and multiple sequences of right lung diaphragm motion points are determined, including: detecting multiple lowest points of the left lung and multiple lowest points of the right lung corresponding to the multiple left lung contour lines and the multiple right lung contour lines, respectively; configuring the multiple lowest points of the left lung and the multiple lowest points of the right lung as the starting points of the multiple sequences of left lung diaphragm motion points and the multiple sequences of right lung diaphragm motion points, respectively; detecting multiple left lung contour lines and multiple sequences of right lung diaphragm motion points corresponding to the multiple left lung contour lines and the multiple right lung contour lines, respectively. Vertices and multiple right lung vertices; the coordinates corresponding to the multiple left lung vertices and the multiple right lung vertices are respectively configured as candidate endpoints for the multiple left lung diaphragm motion point sequences and the multiple right lung diaphragm motion point sequences; the multiple left lung diaphragm motion point sequences are determined according to the starting points of the multiple left lung diaphragm motion point sequences and the candidate endpoints of the multiple left lung diaphragm motion point sequences; the multiple right lung diaphragm motion point sequences are determined according to the starting points of the multiple right lung diaphragm motion point sequences and the candidate endpoints of the multiple right lung diaphragm motion point sequences. The movement of the left lung diaphragm is determined based on the multiple left lung movement vertices and the multiple left lung diaphragm movement point sequences, and the movement of the right lung diaphragm is determined based on the multiple right lung movement vertices and the multiple right lung diaphragm movement point sequences.

2. The detection method according to claim 1, characterized in that, Before acquiring two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments during the breathing process, the two-dimensional DR lung images at multiple moments during the breathing process are segmented into left and right lungs to obtain two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments.

3. The detection method according to claim 2, characterized in that, The step of segmenting the left and right lungs in the multi-time 2D DR lung images during the respiratory process to obtain multi-time 2D DR left lung images and 2D DR right lung images includes: Edge detection was performed on the left and right chest images of the two-dimensional DR lung images at multiple time points during the breathing process, including the costal margin boundary, lung apex boundary, and mediastinum and diaphragm boundaries, to obtain the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points; or, Obtain a pre-defined convolutional neural network segmentation model and DR lung region label images used to train the segmentation model; wherein, determining the DR lung region label images used to train the segmentation model includes: performing edge detection on the left and right chest images of multiple DR lung region images, respectively, for the costal margin boundary, lung apex boundary, mediastinum, and diaphragm, to obtain DR lung region label images corresponding to the multiple DR lung region images; using the DR lung region label images used to train the segmentation model, training the segmentation model; based on the trained segmentation model, completing the segmentation of the left and right lungs of the two-dimensional DR lung images at multiple time points during the breathing process, to obtain two-dimensional DR left lung images and two-dimensional DR right lung images at multiple time points.

4. The detection method according to any one of claims 1-3, characterized in that, The step of detecting the multiple left lung contour lines and the multiple right lung contour lines corresponding to the multiple left lung vertices and the multiple right lung vertices includes: Determine the first maximum ordinate and the second maximum ordinate corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively; Based on the plurality of first maximum ordinates and the plurality of left lung contour lines, determine the plurality of first abscissas corresponding to the plurality of first maximum ordinates; Based on the plurality of second maximum ordinates and the plurality of right lung contour lines, determine the plurality of second maximum ordinates corresponding to the plurality of second horizontal coordinates; Each of the plurality of first maximum ordinates and their corresponding plurality of first abscissas is configured as a plurality of left lung vertices; Each of the multiple second maximum ordinates and their corresponding multiple second abscissas is configured as a multiple right lung vertices.

5. The detection method according to any one of claims 1-3, characterized in that, The step of determining the plurality of left lung diaphragm motion point sequences based on the starting points and candidate ending points of the plurality of left lung diaphragm motion point sequences includes: Obtain a first set step size; based on the first set step size, calculate multiple first slope values ​​corresponding to the starting points of the multiple left lung diaphragm motion point sequences and the candidate endpoints of the multiple left lung diaphragm motion point sequences; determine the endpoints of the multiple left lung diaphragm motion point sequences based on the multiple first slope values; or, The left lung contour line between the starting point of the plurality of left lung diaphragm motion point sequences and the candidate endpoint of the plurality of left lung diaphragm motion point sequences is determined respectively; on the left lung contour line, the endpoint of the plurality of left lung diaphragm motion point sequences is determined respectively in an interactive manner.

6. The detection method according to claim 4, characterized in that, The step of determining the multiple left lung diaphragm motion point sequences based on the starting points and candidate ending points of the multiple left lung diaphragm motion point sequences includes: Obtain a first set step size; based on the first set step size, calculate multiple first slope values ​​corresponding to the starting points of the multiple left lung diaphragm motion point sequences and the candidate endpoints of the multiple left lung diaphragm motion point sequences; determine the endpoints of the multiple left lung diaphragm motion point sequences based on the multiple first slope values; or, The left lung contour line between the starting point of the plurality of left lung diaphragm motion point sequences and the candidate endpoint of the plurality of left lung diaphragm motion point sequences is determined respectively; on the left lung contour line, the endpoint of the plurality of left lung diaphragm motion point sequences is determined respectively in an interactive manner.

7. The detection method according to claim 5, characterized in that, In the process of determining the multiple left lung diaphragm motion point sequences based on the starting points and candidate endpoints of the multiple left lung diaphragm motion point sequences, determining the endpoints of the multiple left lung diaphragm motion point sequences based on the multiple first slope values ​​includes: determining the candidate endpoints corresponding to the changes in the signs of the multiple first slope values ​​from negative to positive as the endpoints of the multiple left lung diaphragm motion point sequences.

8. The detection method according to claim 6, characterized in that, In the process of determining the multiple left lung diaphragm motion point sequences based on the starting points and candidate endpoints of the multiple left lung diaphragm motion point sequences, determining the endpoints of the multiple left lung diaphragm motion point sequences based on the multiple first slope values ​​includes: determining the candidate endpoints corresponding to the changes in the signs of the multiple first slope values ​​from negative to positive as the endpoints of the multiple left lung diaphragm motion point sequences.

9. The detection method according to any one of claims 1-3 and 6-8, characterized in that, The step of determining the plurality of right lung diaphragm motion point sequences based on the starting points and candidate ending points of the plurality of right lung diaphragm motion point sequences includes: Obtain a second set step size; based on the second set step size, calculate multiple second slope values ​​corresponding to the starting points of the multiple right lung diaphragm motion point sequences and the candidate endpoints of the multiple right lung diaphragm motion point sequences; determine the endpoints of the multiple right lung diaphragm motion point sequences based on the multiple second slope values; or, The starting point of the plurality of right lung diaphragm motion point sequences and the right lung contour line between the candidate endpoints of the plurality of right lung diaphragm motion point sequences are determined respectively; on the right lung contour line, the endpoints of the plurality of right lung diaphragm motion point sequences are determined respectively in an interactive manner.

10. The detection method according to claim 4, characterized in that, The step of determining the plurality of right lung diaphragm motion point sequences based on the starting points and candidate ending points of the plurality of right lung diaphragm motion point sequences includes: Obtain a second set step size; based on the second set step size, calculate multiple second slope values ​​corresponding to the starting points of the multiple right lung diaphragm motion point sequences and the candidate endpoints of the multiple right lung diaphragm motion point sequences; determine the endpoints of the multiple right lung diaphragm motion point sequences based on the multiple second slope values; or, The starting point of the plurality of right lung diaphragm motion point sequences and the right lung contour line between the candidate endpoints of the plurality of right lung diaphragm motion point sequences are determined respectively; on the right lung contour line, the endpoints of the plurality of right lung diaphragm motion point sequences are determined respectively in an interactive manner.

11. The detection method according to claim 5, characterized in that, The step of determining the plurality of right lung diaphragm motion point sequences based on the starting points and candidate ending points of the plurality of right lung diaphragm motion point sequences includes: Obtain a second set step size; based on the second set step size, calculate multiple second slope values ​​corresponding to the starting points of the multiple right lung diaphragm motion point sequences and the candidate endpoints of the multiple right lung diaphragm motion point sequences; determine the endpoints of the multiple right lung diaphragm motion point sequences based on the multiple second slope values; or, The starting point of the plurality of right lung diaphragm motion point sequences and the right lung contour line between the candidate endpoints of the plurality of right lung diaphragm motion point sequences are determined respectively; on the right lung contour line, the endpoints of the plurality of right lung diaphragm motion point sequences are determined respectively in an interactive manner.

12. The detection method according to claim 9, characterized in that, In the process of determining the multiple right lung diaphragm motion point sequences based on the starting point of the multiple right lung diaphragm motion point sequences and the candidate endpoints of the multiple right lung diaphragm motion point sequences, determining the endpoints of the multiple right lung diaphragm motion point sequences based on the multiple second slope values ​​includes: determining the candidate endpoints corresponding to the change of the signs of the multiple second slope values ​​from positive to negative as the endpoints of the multiple right lung diaphragm motion point sequences.

13. The detection method according to any one of claims 10 or 11, characterized in that, In the process of determining the multiple right lung diaphragm motion point sequences based on the starting point of the multiple right lung diaphragm motion point sequences and the candidate endpoints of the multiple right lung diaphragm motion point sequences, determining the endpoints of the multiple right lung diaphragm motion point sequences based on the multiple second slope values ​​includes: determining the candidate endpoints corresponding to the change of the signs of the multiple second slope values ​​from positive to negative as the endpoints of the multiple right lung diaphragm motion point sequences.

14. An assessment method, comprising detecting the diaphragmatic movement trajectory of a patient to be assessed using the diaphragmatic movement detection method as described in any one of claims 1 to 13, characterized in that, include: Obtain the set movement trajectory for a healthy person; Based on the diaphragm movement trajectory of the patient to be evaluated and the set movement trajectory, assess whether there is a functional disorder in the diaphragm movement of the patient to be evaluated.

15. The evaluation method according to claim 14, characterized in that, The assessment of whether there is a functional impairment of diaphragmatic movement in the patient under assessment, based on the diaphragmatic movement trajectory corresponding to the patient under assessment and the set movement trajectory, includes: Calculate the similarity between the diaphragm movement trajectory and the set movement trajectory; If the similarity is less than the set similarity, then the patient to be evaluated has a functional disorder in diaphragmatic movement; otherwise, the patient to be evaluated does not have a functional disorder in diaphragmatic movement.

16. A diaphragm movement detection device, characterized in that, include: The first acquisition unit is used to acquire two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments during the breathing process; The first determining unit is configured to determine a plurality of left lung motion vertices and a plurality of right lung motion vertices based on the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points, including: extracting a plurality of left lung contour lines and a plurality of right lung contour lines corresponding to the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points; and determining a plurality of left lung motion vertices and a plurality of right lung motion vertices based on the plurality of left lung contour lines and the plurality of right lung contour lines. The second determining unit is configured to determine multiple left lung diaphragm motion point sequences and multiple right lung diaphragm motion point sequences based on the two-dimensional DR left lung image and the two-dimensional DR right lung image at multiple time points, including: detecting multiple left lung lowest points and multiple right lung lowest points corresponding to the multiple left lung contour lines and the multiple right lung contour lines, respectively; configuring the multiple left lung lowest points and multiple right lung lowest points as the starting points of the multiple left lung diaphragm motion point sequences and the multiple right lung diaphragm motion point sequences, respectively; and detecting multiple left lung lowest points and multiple right lung lowest points corresponding to the multiple left lung contour lines and the multiple right lung contour lines, respectively. Multiple left lung vertices and multiple right lung vertices; the coordinates corresponding to the multiple left lung vertices and the multiple right lung vertices are respectively configured as candidate endpoints of the multiple left lung diaphragm motion point sequences and the multiple right lung diaphragm motion point sequences; the multiple left lung diaphragm motion point sequences are determined according to the starting points of the multiple left lung diaphragm motion point sequences and the candidate endpoints of the multiple left lung diaphragm motion point sequences; the multiple right lung diaphragm motion point sequences are determined according to the starting points of the multiple right lung diaphragm motion point sequences and the candidate endpoints of the multiple right lung diaphragm motion point sequences. The detection unit is used to determine the movement of the left lung diaphragm based on the plurality of left lung movement vertices and the plurality of left lung diaphragm movement point sequences, and to determine the movement of the right lung diaphragm based on the plurality of right lung movement vertices and the plurality of right lung diaphragm movement point sequences.

17. The detection device according to claim 16, characterized in that, Also includes: Segmentation unit; The segmentation unit is used to segment the two-dimensional DR lung images at multiple moments during the breathing process into the left and right lungs before acquiring the two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments, so as to obtain the two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments.

18. The detection device according to claim 17, characterized in that, The segmentation unit is used to perform edge detection on the left and right chest images of the two-dimensional DR lung images at multiple moments during the breathing process, respectively, to obtain two-dimensional DR left lung images and two-dimensional DR right lung images at multiple moments. or, The segmentation unit includes: a model and data acquisition unit, a label determination unit, a training unit, and an output unit. The model and data acquisition unit is used to acquire a segmentation model of a preset convolutional neural network and DR lung region label images for training the segmentation model. The label determination unit is used to perform edge detection on the left and right chest images of multiple DR lung region images, respectively, by measuring the costal margin boundary, lung apex boundary, and mediastinum and diaphragm, to obtain DR lung region label images corresponding to the multiple DR lung region images. The training unit is used to train the segmentation model using the DR lung region label images used to train the segmentation model. The output unit is used to perform left and right lung segmentation of two-dimensional DR lung images at multiple time points during the breathing process based on the trained segmentation model, to obtain two-dimensional DR left lung images and two-dimensional DR right lung images at multiple time points.

19. An evaluation device, characterized in that, Includes the diaphragm motion detection device as described in any one of claims 16-18; wherein the diaphragm motion detection device is used to detect the diaphragm motion trajectory corresponding to the patient to be evaluated; and, The second acquisition unit is used to acquire the set movement trajectory corresponding to a healthy person; The assessment unit is used to assess whether there is a functional disorder in the diaphragm movement of the patient under assessment, based on the diaphragm movement trajectory corresponding to the patient under assessment and the set movement trajectory.

20. The evaluation apparatus according to claim 19, characterized in that, The evaluation unit includes: a similarity calculation unit and a similarity comparison unit; The similarity calculation unit is used to calculate the similarity between the diaphragm movement trajectory and the set movement trajectory; The similarity comparison unit is used to compare the similarity with a set similarity; if the similarity is less than the set similarity, then the diaphragm movement of the patient to be evaluated has a functional disorder; otherwise, the diaphragm movement of the patient to be evaluated does not have a functional disorder.

21. An electronic device, characterized in that, include: processor; A memory for storing processor-executable instructions; wherein the processor is configured to invoke the instructions stored in the memory to execute the diaphragm movement detection method according to any one of claims 1 to 13.

22. An electronic device, characterized in that, include: processor; A memory for storing processor-executable instructions; wherein the processor is configured to invoke the instructions stored in the memory to perform the evaluation method of any one of claims 14 or 15.

23. A computer-readable storage medium having computer program instructions stored thereon, characterized in that, When the computer program instructions are executed by the processor, they implement the diaphragm movement detection method according to any one of claims 1 to 13.

24. A computer-readable storage medium having computer program instructions stored thereon, characterized in that, When the computer program instructions are executed by the processor, they implement the evaluation method of any one of claims 14 or 15.

Images