Diaphragm movement display method and device, electronic equipment and storage medium

Abstract

The disclosure relates to a diaphragm movement display method and device, electronic equipment and storage medium, and relates to the technical field of DR image processing. The diaphragm movement display method comprises the following steps: acquiring a plurality of left lung movement apices and a plurality of right lung movement apices corresponding to DR left lung images and DR right lung images at multiple moments in a breathing process, and a plurality of left lung diaphragm movement point sequences and a plurality of right lung diaphragm movement point sequences corresponding to the DR left lung images and the DR right lung images at multiple moments in the breathing process; and displaying the plurality of left lung movement apices and the plurality of right lung movement apices by using first color lines, and displaying the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences by using second color lines. The embodiment of the disclosure can realize visual display of diaphragm movement.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of DR image processing, and particularly relates to a diaphragm movement display method and device, electronic equipment and storage medium. BACKGROUND

[0002] Digital X-ray (DR) images can provide high-resolution and real-time X-ray images, and have been widely used in bone system, chest, dental and other examinations, such as fracture diagnosis, lung disease screening, dental radiography, etc.

[0003] At present, DR images have become a commonly used imaging device for diagnosing and evaluating respiratory diseases. The diaphragm is the main respiratory muscle. When the diaphragm contracts, the central tendon is pulled downward to the abdominal cavity. The diaphragmatic dome flattens, the volume of the thoracic cavity increases, and the intracavity pressure decreases, so that external air enters the lungs. When the intrathoracic pressure is the same as the intraperitoneal pressure, the intercostal muscles play a role, the thoracic cavity is expanded to both sides and upward, and the inspiration continues. During quiet expiration, the diaphragm is passively raised, the dome is restored, the volume of the thoracic cavity is reduced, and the expiration is completed. Therefore, the movement of the diaphragm has an important influence on the respiratory process.

[0004] The movement of the diaphragm during the respiratory process is a dynamic process, so it is necessary to visualize the movement of the diaphragm during the respiratory process based on the lung images at multiple moments during the respiratory process, which is helpful for the doctor to effectively evaluate the diaphragm at multiple moments during the respiratory process based on the visualization, and obtain more accurate diagnosis. SUMMARY

[0005] The present disclosure provides a diaphragm movement display method and device, electronic equipment and storage medium.

[0006] According to an aspect of the present disclosure, a diaphragm movement display method is provided, comprising:

[0007] obtaining a plurality of left lung movement vertices and a plurality of right lung movement vertices corresponding to DR left lung images and DR right lung images at multiple moments during the respiratory process, and a plurality of left lung diaphragm movement point sequences and a plurality of right lung diaphragm movement point sequences corresponding to the DR left lung images and the DR right lung images at multiple moments during the respiratory process;

[0008] displaying the plurality of left lung movement vertices and the plurality of right lung movement vertices with first color lines, and displaying the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences with second color lines.

[0009] Preferably, the method of displaying the plurality of left lung movement vertices and the plurality of right lung movement vertices with first color lines, and displaying the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences with second color lines, comprises:

[0010] acquire DR lung images corresponding to the DR left lung images and the DR right lung images at multiple moments in the breathing process;

[0011] display the DR lung images corresponding to the DR left lung images and the DR right lung images at multiple moments in the breathing process;

[0012] display, on the DR lung images corresponding to the DR left lung images and the DR right lung images at multiple moments in the breathing process, the multiple left lung motion vertexes and the multiple right lung motion vertexes in first color lines, and the multiple left diaphragm motion point sequences and the multiple right diaphragm motion point sequences in second color lines; and / or,

[0013] The method of displaying the multiple left diaphragm motion point sequences and the multiple right diaphragm motion point sequences in second color lines further includes:

[0014] construct multiple left diaphragm motion curves corresponding to the multiple left diaphragm motion point sequences respectively, and configure a motion point with the smallest slope in each left diaphragm motion curve as a left diaphragm motion point to be displayed at multiple moments in the breathing process;

[0015] display the left diaphragm motion point to be displayed in second color lines;

[0016] construct multiple right diaphragm motion curves corresponding to the multiple right diaphragm motion point sequences respectively, and configure a motion point with the smallest slope in each right diaphragm motion curve as a right diaphragm motion point to be displayed at multiple moments in the breathing process;

[0017] display the right diaphragm motion point to be displayed in second color lines; and / or,

[0018] The method of correcting the left diaphragm motion points to be displayed at multiple moments in the breathing process includes: acquiring multiple left lung areas in the breathing process; obtaining multiple first coordinate points corresponding to a first set slope value of each left diaphragm motion curve; sorting the multiple first coordinate points corresponding to the first set slope value of each left diaphragm motion curve in ascending order of the ordinate; and correcting the left diaphragm motion points to be displayed at multiple moments in the breathing process according to the multiple left lung areas and the sorted multiple first coordinate points; and / or,

[0019] The method for correcting the to-be-displayed left lung diaphragm movement points at the plurality of time points according to the plurality of left lung areas and the plurality of first coordinate points sorted, comprises: determining the plurality of first coordinate points sorted corresponding to the plurality of left lung areas from the maximum area to the minimum area; wherein the vertical coordinate values of the plurality of first coordinate points sorted corresponding to the plurality of left lung areas from the maximum area to the minimum area are sequentially increased;

[0020] If the vertical coordinates of the to-be-displayed left lung diaphragm movement points at the plurality of time points corresponding to the plurality of left lung areas from the maximum area to the minimum area are sequentially increased, the to-be-displayed left lung diaphragm movement points at the plurality of time points are not corrected; otherwise, the movement points that are not increased among the to-be-displayed left lung diaphragm movement points at the plurality of time points are corrected; and / or,

[0021] The method for correcting the to-be-displayed right lung diaphragm movement points at the plurality of time points in the breathing process, comprises: obtaining a plurality of right lung areas in the breathing process; obtaining a plurality of second coordinate points corresponding to a second set slope value of each right lung diaphragm movement curve in the plurality of right lung diaphragm movement curves; sorting the plurality of second coordinate points corresponding to the second set slope value of each right lung diaphragm movement curve in ascending order of vertical coordinates; correcting the to-be-displayed right lung diaphragm movement points at the plurality of time points according to the plurality of right lung areas and the plurality of second coordinate points sorted; and / or,

[0022] The method for correcting the to-be-displayed right lung diaphragm movement points at the plurality of time points according to the plurality of right lung areas and the plurality of second coordinate points sorted, comprises: determining the plurality of second coordinate points sorted corresponding to the plurality of right lung areas from the maximum area to the minimum area; wherein the vertical coordinate values of the plurality of second coordinate points sorted corresponding to the plurality of right lung areas from the maximum area to the minimum area are sequentially increased; if the plurality of second coordinate points sorted corresponding to the plurality of right lung areas from the maximum area to the minimum area and the vertical coordinates of the to-be-displayed right lung diaphragm movement points at the plurality of time points are sequentially increased, the to-be-displayed right lung diaphragm movement points at the plurality of time points are not corrected; otherwise, the movement points that are not increased among the to-be-displayed right lung diaphragm movement points at the plurality of time points are corrected.

[0023] Preferably, before obtaining the plurality of left lung movement vertices and the plurality of right lung movement vertices corresponding to the DR left lung images and the DR right lung images at the plurality of time points in the breathing process, and the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences corresponding to the DR left lung images and the DR right lung images at the plurality of time points in the breathing process, a DR lung image at the plurality of time points in the breathing process is obtained, the DR lung image is segmented into left lung and right lung to obtain the DR left lung images and the DR right lung images at the plurality of time points; and / or,

[0024] The method for left lung and right lung segmentation of the DR lung images comprises: detecting rib edge boundaries, lung apex boundaries, and mediastinal and diaphragmatic edge boundaries of left chest images and right chest images of the DR lung images at multiple time points in the breathing process, to obtain DR left lung images and DR right lung images at multiple time points; or,

[0025] obtaining a segmentation model of a preset convolutional neural network and DR lung region label images used for training the segmentation model; training the segmentation model by using the DR lung region label images used for training the segmentation model; completing left lung and right lung segmentation of the DR lung images at multiple time points in the breathing process based on the trained segmentation model, to obtain DR left lung images and DR right lung images at multiple time points; and / or,

[0026] The determination method of the DR lung region label images used for training the segmentation model comprises: detecting rib edge boundaries, lung apex boundaries, and mediastinal and diaphragmatic edge boundaries of left chest images and right chest images of multiple DR lung region images, to obtain DR lung region label images corresponding to the multiple DR lung region images.

[0027] Preferably, before the rib edge boundaries, lung apex boundaries, and mediastinal and diaphragmatic edge boundaries of the left chest images and the right chest images of the DR lung images at multiple time points in the breathing process are detected, chest cavity detection is performed on the DR lung images at multiple time points, to obtain corresponding multiple chest cavity images; the chest cavity images are divided into left lung regions and right lung regions, to obtain the left chest images and the right chest images of the DR lung images at multiple time points in the breathing process; and / or,

[0028] The method for detecting the chest cavity of the DR lung images at the plurality of time points respectively, to obtain a plurality of chest cavity images, comprises: calculating a plurality of first gradient amplitudes corresponding to the horizontal direction of each pixel point and a plurality of second gradient amplitudes of the vertical direction of each pixel point in the DR lung images at the plurality of time points respectively; determining a plurality of total gradient amplitudes based on the plurality of first gradient amplitudes and the plurality of second gradient amplitudes; integrating the plurality of first gradient amplitudes corresponding to the horizontal direction and the plurality of second gradient amplitudes of the vertical direction along the direction perpendicular thereto to obtain a plurality of first integral values and a plurality of second integral values; integrating the plurality of total gradient amplitudes in the two directions corresponding to the vertical direction and the horizontal direction to obtain a plurality of third integral values and a plurality of fourth integral values; calculating a plurality of first local maximum values corresponding to the plurality of first ratios, and calculating a plurality of first local minimum values and a plurality of second local minimum values corresponding to the plurality of first ratios and the plurality of second ratios; determining the thoracic profile corresponding to the DR image to be processed according to the plurality of first local maximum values, the plurality of first local minimum values, the plurality of second local minimum values, and the thoracic feature; wherein the thoracic feature can configure the first segmentation position of the neck or the shoulder corresponding to the thoracic profile and the second segmentation position of the two sides of the thoracic profile.

[0029] Preferably, before the plurality of left lung movement peaks and the plurality of right lung movement peaks corresponding to the DR left lung images and the DR right lung images at the plurality of time points in the respiratory process, and the plurality of left diaphragm movement point sequences and the plurality of right diaphragm movement point sequences corresponding to the DR left lung images and the DR right lung images at the plurality of time points in the respiratory process, a method for determining the plurality of left lung movement peaks, the plurality of right lung movement peaks, the plurality of left diaphragm movement point sequences and the plurality of right diaphragm movement point sequences corresponding to the DR left lung images and the DR right lung images at the plurality of time points respectively, comprises:

[0030] Extracting a plurality of left lung contour lines and a plurality of right lung contour lines corresponding to the two-dimensional DR left lung images and the two-dimensional DR right lung images at the plurality of time points respectively;

[0031] According to the plurality of left lung contour lines and the plurality of right lung contour lines, a plurality of left lung movement peaks, a plurality of right lung movement peaks, a plurality of left diaphragm movement point sequences and a plurality of right diaphragm movement point sequences are determined respectively.

[0032] Preferably, the method for detecting a plurality of left lung top points and a plurality of right lung top points corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively comprises: determining a plurality of first maximum vertical coordinates and a plurality of second maximum vertical coordinates corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively; determining a plurality of first horizontal coordinates corresponding to the plurality of first maximum vertical coordinates according to the plurality of first maximum vertical coordinates and the plurality of left lung contour lines respectively; determining a plurality of second horizontal coordinates corresponding to the plurality of second maximum vertical coordinates according to the plurality of second maximum vertical coordinates and the plurality of right lung contour lines respectively; configuring the plurality of first maximum vertical coordinates and the plurality of first horizontal coordinates corresponding thereto as a plurality of left lung top points respectively; configuring the plurality of second maximum vertical coordinates and the plurality of second horizontal coordinates corresponding thereto as a plurality of right lung top points respectively; and / or,

[0033] The method for determining a plurality of left diaphragm movement point sequences and a plurality of right diaphragm movement point sequences corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively comprises:

[0034] Detecting a plurality of left lung lowest points and a plurality of right lung lowest points corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively, and configuring the plurality of left lung lowest points and the plurality of right lung lowest points as starting points of the plurality of left diaphragm movement point sequences and starting points of the plurality of right diaphragm movement point sequences respectively;

[0035] Detecting a plurality of left lung top points and a plurality of right lung top points corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively, and configuring coordinates of the plurality of left lung top points and the plurality of right lung top points as candidate end points of the plurality of left diaphragm movement point sequences and candidate end points of the plurality of right diaphragm movement point sequences respectively;

[0036] Determining the plurality of left diaphragm movement point sequences according to the starting points of the plurality of left diaphragm movement point sequences and the candidate end points of the plurality of left diaphragm movement point sequences respectively, and determining the plurality of right diaphragm movement point sequences according to the starting points of the plurality of right diaphragm movement point sequences and the candidate end points of the plurality of right diaphragm movement point sequences respectively; and / or,

[0037] The method for determining the plurality of left lung diaphragm motion point sequences according to the starting points and the candidate ending points of the plurality of left lung diaphragm motion point sequences respectively comprises: obtaining a first set step; calculating a plurality of first slope values corresponding to the starting points to the candidate ending points of the plurality of left lung diaphragm motion point sequences based on the first set step; determining the ending points of the plurality of left lung diaphragm motion point sequences according to the plurality of first slope values; or, determining the left lung contour lines between the starting points and the candidate ending points of the plurality of left lung diaphragm motion point sequences respectively; determining the ending points of the plurality of left lung diaphragm motion point sequences on the left lung contour lines in an interactive manner; and / or,

[0038] The method for determining the ending points of the plurality of left lung diaphragm motion point sequences according to the plurality of first slope values comprises: determining the candidate ending points corresponding to the sign change from negative to positive of the plurality of first slope values as the ending points of the plurality of left lung diaphragm motion point sequences; and / or,

[0039] The method for determining the plurality of right lung diaphragm motion point sequences according to the starting points and the candidate ending points of the plurality of right lung diaphragm motion point sequences respectively comprises: obtaining a second set step; calculating a plurality of second slope values corresponding to the starting points to the candidate ending points of the plurality of right lung diaphragm motion point sequences based on the second set step; determining the ending points of the plurality of right lung diaphragm motion point sequences according to the plurality of second slope values; or, determining the right lung contour lines between the starting points and the candidate ending points of the plurality of right lung diaphragm motion point sequences respectively; determining the ending points of the plurality of right lung diaphragm motion point sequences on the right lung contour lines in an interactive manner; and / or,

[0040] The method for determining the ending points of the plurality of right lung diaphragm motion point sequences according to the plurality of second slope values comprises: determining the candidate ending points corresponding to the sign change from positive to negative of the plurality of second slope values as the ending points of the plurality of right lung diaphragm motion point sequences.

[0041] Preferably, the method for displaying the plurality of left lung motion apexes and the plurality of right lung motion apexes in first color lines and the plurality of left lung diaphragm motion point sequences and the plurality of right lung diaphragm motion point sequences in second color lines further comprises: obtaining first configuration parameters corresponding to the first color lines; wherein the first configuration parameters comprise a first line length and a first line width; displaying the plurality of left lung motion apexes and the plurality of right lung motion apexes in the first color lines configured with the first configuration parameters; and / or,

[0042] acquire first configuration parameters corresponding to the second color lines; wherein the second configuration parameters include: a second line length and a second line width; display the plurality of left diaphragm motion point sequences and the plurality of right diaphragm motion point sequences in the second color lines configured with the second configuration parameters; and / or,

[0043] The first color is red and the second color is blue.

[0044] According to an aspect of the present disclosure, a diaphragm motion display device is provided, comprising:

[0045] The acquisition unit is configured to acquire a plurality of left lung motion vertices and a plurality of right lung motion vertices corresponding to DR left lung images and DR right lung images at multiple moments in a breathing process, and a plurality of left diaphragm motion point sequences and a plurality of right diaphragm motion point sequences corresponding to the DR left lung images and the DR right lung images at multiple moments in the breathing process;

[0046] The display unit is configured to display the plurality of left lung motion vertices and the plurality of right lung motion vertices in first color lines, and display the plurality of left diaphragm motion point sequences and the plurality of right diaphragm motion point sequences in second color lines; and / or,

[0047] The display unit comprises a DR lung image acquisition unit, a DR lung image display unit, and a line display unit.

[0048] The DR lung image acquisition unit is configured to acquire DR lung images corresponding to DR left lung images and DR right lung images at multiple moments in a breathing process.

[0049] The DR lung image display unit is configured to display the DR lung images corresponding to the DR left lung images and the DR right lung images at multiple moments in the breathing process.

[0050] The line display unit is configured to display the plurality of left lung motion vertices and the plurality of right lung motion vertices in first color lines, and display the plurality of left diaphragm motion point sequences and the plurality of right diaphragm motion point sequences in second color lines on the DR lung images corresponding to the DR left lung images and the DR right lung images at multiple moments in the breathing process; and / or,

[0051] The line display unit comprises a first slope determination unit, a left lung line display unit, a second slope determination unit, and a right lung line display unit.

[0052] The first slope determination unit is configured to construct a plurality of left diaphragm motion curves corresponding to the plurality of left diaphragm motion point sequences respectively, and configure a motion point with the smallest slope in each left diaphragm motion curve in the plurality of left diaphragm motion curves as a left diaphragm motion point to be displayed in the breathing process.

[0053] The left lung line display unit is configured to display the to-be-displayed left diaphragm movement point in the second color line.

[0054] The second slope determination unit is configured to construct a plurality of right diaphragm movement curves corresponding to a plurality of right diaphragm movement point sequences respectively, and configure a movement point with the smallest slope of each right diaphragm movement curve in the plurality of right diaphragm movement curves as a to-be-displayed right diaphragm movement point at a plurality of moments in the breathing process.

[0055] The right lung line display unit is configured to display the to-be-displayed right diaphragm movement point in the second color line; and / or,

[0056] The system further comprises a correction unit, which comprises a left lung area acquisition unit, a third slope determination unit, a first sorting unit, and a left diaphragm movement point correction unit.

[0057] The left lung area acquisition unit is configured to acquire a plurality of left lung areas in the breathing process.

[0058] The third slope determination unit is configured to respectively obtain a plurality of first coordinate points corresponding to a first set slope value of each left diaphragm movement curve in the plurality of left diaphragm movement curves.

[0059] The first sorting unit is configured to sort the plurality of first coordinate points corresponding to the first set slope value of each left diaphragm movement curve in ascending order of the ordinate.

[0060] The left diaphragm movement point correction unit is configured to correct the to-be-displayed left diaphragm movement point at the plurality of moments according to the plurality of left lung areas and the sorted plurality of first coordinate points; and / or,

[0061] The left diaphragm movement point correction unit comprises a first determination unit and a first coordinate correction unit.

[0062] The first determination unit is configured to determine the sorted plurality of first coordinate points corresponding to the plurality of left lung areas from the largest area to the smallest area; wherein the ordinate values of the sorted plurality of first coordinate points corresponding to the plurality of left lung areas from the largest area to the smallest area are sequentially increased.

[0063] The first coordinate correction unit is configured to, if the ordinate of the to-be-displayed left diaphragm movement point at the plurality of moments corresponding to the plurality of left lung areas from the largest area to the smallest area is sequentially increased, not correct the to-be-displayed left diaphragm movement point at the plurality of moments; otherwise, correct the movement point that is not increased among the to-be-displayed left diaphragm movement point at the plurality of moments; and / or,

[0064] The correction unit further comprises a right lung area acquisition unit, a fourth slope determination unit, a second sorting unit, and a right lung diaphragm movement point correction unit.

[0065] The right lung area acquisition unit is configured to acquire a plurality of right lung areas in a breathing process.

[0066] The fourth slope determination unit is configured to respectively obtain a plurality of second coordinate points corresponding to a second set slope value of each right lung diaphragm movement curve in the plurality of right lung diaphragm movement curves.

[0067] The second sorting unit is configured to sort the plurality of second coordinate points corresponding to the second set slope value of each right lung diaphragm movement curve in ascending order of the ordinate.

[0068] The right lung diaphragm movement point correction unit is configured to correct the right lung diaphragm movement points to be displayed at the plurality of time points according to the plurality of right lung areas and the plurality of sorted second coordinate points; and / or,

[0069] The right lung diaphragm movement point correction unit comprises a second determination unit and a second coordinate correction unit.

[0070] The second determination unit is configured to determine the plurality of sorted second coordinate points corresponding to the plurality of right lung areas from a maximum area to a minimum area; wherein the ordinate values of the plurality of sorted second coordinate points corresponding to the plurality of right lung areas from the maximum area to the minimum area are sequentially increased.

[0071] The second coordinate correction unit is configured to, if the plurality of sorted second coordinate points corresponding to the plurality of right lung areas from the maximum area to the minimum area and the ordinate of the right lung diaphragm movement points to be displayed at the plurality of time points are sequentially increased, not correct the right lung diaphragm movement points to be displayed at the plurality of time points; otherwise, correct the movement points that are not increased among the right lung diaphragm movement points to be displayed at the plurality of time points; and / or,

[0072] Further comprising a segmentation unit.

[0073] The segmentation unit is configured to, before acquiring a plurality of left lung movement vertices and a plurality of right lung movement vertices corresponding to a plurality of DR left lung images and a plurality of DR right lung images at a plurality of time points in a breathing process, and a plurality of left lung diaphragm movement point sequences and a plurality of right lung diaphragm movement point sequences corresponding to the plurality of DR left lung images and the plurality of DR right lung images at the plurality of time points in the breathing process, acquire a DR lung image at the plurality of time points in the breathing process, segment the DR lung image to obtain the plurality of DR left lung images and the plurality of DR right lung images; and / or,

[0074] The segmentation unit comprises a detection unit.

[0075] The detection unit is configured to perform left lung and right lung segmentation on the DR lung images to obtain DR left lung images and DR right lung images at multiple time points, and the method comprises: performing rib boundary, lung apex boundary, and mediastinum and diaphragm edge detection on left chest images and right chest images of the DR lung images at multiple time points in the breathing process respectively to obtain DR left lung images and DR right lung images at multiple time points; or,

[0076] The segmentation unit comprises a segmentation model acquisition unit, a training unit, and an output unit.

[0077] The segmentation model acquisition unit is configured to acquire a segmentation model of a preset convolutional neural network and DR lung region label images used for training the segmentation model.

[0078] The training unit is configured to train the segmentation model by using the DR lung region label images used for training the segmentation model.

[0079] The output unit is configured to perform left lung and right lung segmentation on the DR lung images at multiple time points in the breathing process based on the trained segmentation model to obtain DR left lung images and DR right lung images at multiple time points; and / or,

[0080] The segmentation unit further comprises a label image determination unit.

[0081] The label image determination unit is configured to determine the DR lung region label images used for training the segmentation model by: performing rib boundary, lung apex boundary, and mediastinum and diaphragm edge detection on left chest images and right chest images of multiple DR lung region images respectively to obtain DR lung region label images corresponding to the multiple DR lung region images; and / or,

[0082] Further comprising a third determination unit configured to determine, before the multiple left lung motion peaks and the multiple right lung motion peaks corresponding to the DR left lung images and the DR right lung images at multiple time points in the breathing process and the multiple left diaphragm motion point sequences and the multiple right diaphragm motion point sequences corresponding to the DR left lung images and the DR right lung images at multiple time points in the breathing process, the multiple left lung motion peaks, the multiple right lung motion peaks, the multiple left diaphragm motion point sequences, and the multiple right diaphragm motion point sequences corresponding to the DR left lung images and the DR right lung images at multiple time points; and / or,

[0083] The third determination unit comprises a lung contour extraction unit and a motion point determination unit.

[0084] The lung contour extraction unit is configured to extract multiple left lung contour lines and multiple right lung contour lines corresponding to the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple time points respectively.

[0085] the motion point determination unit is configured to determine, according to the plurality of left lung contour lines and the plurality of right lung contour lines, a plurality of left lung motion apices, a plurality of right lung motion apices, a plurality of left lung diaphragm motion point sequences, and a plurality of right lung diaphragm motion point sequences, respectively; and / or,

[0086] the motion point determination unit comprises a lung apex determination unit;

[0087] the lung apex determination unit is configured to detect a plurality of left lung apices and a plurality of right lung apices corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines, respectively, and configure coordinates corresponding to the plurality of left lung apices and the plurality of right lung apices as the plurality of left lung motion apices and the plurality of right lung motion apices, respectively; and / or,

[0088] the lung apex determination unit comprises a coordinate determination unit and a lung apex configuration unit;

[0089] the coordinate determination unit is configured to determine a plurality of first maximum vertical coordinates and a plurality of second maximum vertical coordinates corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines, respectively; determine a plurality of first horizontal coordinates corresponding to the plurality of first maximum vertical coordinates according to the plurality of first maximum vertical coordinates and the plurality of left lung contour lines, respectively; and determine a plurality of second horizontal coordinates corresponding to the plurality of second maximum vertical coordinates according to the plurality of second maximum vertical coordinates and the plurality of right lung contour lines, respectively;

[0090] the lung apex configuration unit is configured to configure the plurality of first maximum vertical coordinates and the plurality of first horizontal coordinates corresponding thereto as a plurality of left lung apices, respectively; and configure the plurality of second maximum vertical coordinates and the plurality of second horizontal coordinates corresponding thereto as a plurality of right lung apices, respectively; and / or,

[0091] the motion point determination unit further comprises a diaphragm motion starting point determination unit, a diaphragm motion candidate ending point determination unit, and a diaphragm motion ending point determination unit;

[0092] the diaphragm motion starting point determination unit is configured to detect a plurality of left lung nadirs and a plurality of right lung nadirs corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines, respectively, and configure the plurality of left lung nadirs and the plurality of right lung nadirs as starting points of the plurality of left lung diaphragm motion point sequences and starting points of the plurality of right lung diaphragm motion point sequences, respectively;

[0093] the diaphragm motion candidate ending point determination unit is configured to detect a plurality of left lung apices and a plurality of right lung apices corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines, respectively, and configure coordinates corresponding to the plurality of left lung apices and the plurality of right lung apices as candidate ending points of the plurality of left lung diaphragm motion point sequences and candidate ending points of the plurality of right lung diaphragm motion point sequences, respectively;

[0094] The diaphragm movement endpoint determination unit is configured to determine the plurality of left lung diaphragm movement point sequences according to the starting points of the plurality of left lung diaphragm movement point sequences and the candidate endpoints of the plurality of left lung diaphragm movement point sequences respectively, and determine the plurality of right lung diaphragm movement point sequences according to the starting points of the plurality of right lung diaphragm movement point sequences and the candidate endpoints of the plurality of right lung diaphragm movement point sequences respectively; and / or,

[0095] The diaphragm movement endpoint determination unit comprises a first step length acquisition unit and a first slope calculation unit, or a left lung contour line determination unit and a first interaction unit.

[0096] The first step length acquisition unit is configured to acquire a first set step length.

[0097] The first slope calculation unit is configured to calculate a plurality of first slope values corresponding to the starting points of the plurality of left lung diaphragm movement point sequences to the candidate endpoints of the plurality of left lung diaphragm movement point sequences respectively based on the first set step length, and determine the endpoints of the plurality of left lung diaphragm movement point sequences according to the plurality of first slope values; or,

[0098] The left lung contour line determination unit is configured to determine a left lung contour line between the starting points of the plurality of left lung diaphragm movement point sequences and the candidate endpoints of the plurality of left lung diaphragm movement point sequences respectively.

[0099] The first interaction unit is configured to determine the endpoints of the plurality of left lung diaphragm movement point sequences on the left lung contour line in an interactive manner respectively; and / or,

[0100] The first slope calculation unit comprises a first judgment unit.

[0101] The first judgment unit is configured to determine the candidate endpoints corresponding to the sign of the plurality of first slope values changing from negative to positive as the endpoints of the plurality of left lung diaphragm movement point sequences; and / or,

[0102] The diaphragm movement endpoint determination unit further comprises a second step length acquisition unit and a second slope calculation unit, or a right lung contour line determination unit and a second interaction unit.

[0103] The second step length acquisition unit is configured to acquire a second set step length.

[0104] The second slope calculation unit is configured to calculate a plurality of second slope values corresponding to the starting points of the plurality of right lung diaphragm movement point sequences to the candidate endpoints of the plurality of right lung diaphragm movement point sequences respectively based on the second set step length, and determine the endpoints of the plurality of right lung diaphragm movement point sequences according to the plurality of second slope values; or,

[0105] The right lung contour line determination unit is configured to determine right lung contour lines between the start points of the plurality of right diaphragm movement point sequences and candidate end points of the plurality of right diaphragm movement point sequences, respectively.

[0106] The second interaction unit is configured to determine end points of the plurality of right diaphragm movement point sequences on the right lung contour lines in an interactive manner; and / or,

[0107] The second slope calculation unit comprises a second judgment unit.

[0108] The second judgment unit is configured to determine the candidate end points corresponding to a change of a sign of the plurality of second slope values from positive to negative as the end points of the plurality of right diaphragm movement point sequences; and / or,

[0109] The system further comprises a first configuration unit and a second configuration unit.

[0110] The first configuration unit is configured to obtain first configuration parameters corresponding to the first color lines; wherein the first configuration parameters comprise a first line length and a first line width.

[0111] The display unit is configured to display the plurality of left lung movement apexes and the plurality of right lung movement apexes in the first color lines configured with the first configuration parameters.

[0112] The second configuration unit is configured to obtain first configuration parameters corresponding to the second color lines; wherein the second configuration parameters comprise a second line length and a second line width.

[0113] The display unit is configured to display the plurality of left diaphragm movement point sequences and the plurality of right diaphragm movement point sequences in the second color lines configured with the second configuration parameters; and / or,

[0114] The first color is configured as red and the second color is configured as blue.

[0115] According to an aspect of the present disclosure, an electronic device is provided, comprising:

[0116] a processor;

[0117] a memory for storing processor-executable instructions;

[0118] wherein the processor is configured to execute the diaphragm movement display method.

[0119] According to an aspect of the present disclosure, a computer-readable storage medium having stored thereon computer program instructions, which, when executed by a processor, implement the diaphragm movement display method.

[0120] In the embodiments of the present disclosure, the present disclosure provides a diaphragm movement display method and device, an electronic device and a storage medium, which can realize visual display of lung images at multiple moments in the breathing process on diaphragm movement in the breathing process, so as to solve the problem that a diagnostic physician cannot effectively evaluate the visual display of diaphragm movement at multiple moments in the breathing process.

[0121] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, but not limiting the present disclosure.

[0122] Other features and aspects of the present disclosure will become apparent from the following detailed description of example embodiments with reference to the drawings. BRIEF DESCRIPTION OF DRAWINGS

[0123] The accompanying drawings, which are incorporated herein and constitute part of the specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0124] Figure 1 A flow chart of a diaphragm movement display method according to an embodiment of the present disclosure is shown;

[0125] Figure 2 A block diagram of a diaphragm movement display device according to an embodiment of the present disclosure is shown;

[0126] Figure 3 A block diagram of an electronic device 800 according to an example embodiment is shown;

[0127] Figure 4 A block diagram of an electronic device 1900 according to an example embodiment is shown. DETAILED DESCRIPTION

[0128] Various example embodiments, features and aspects of the present disclosure will be explained in detail below with reference to the accompanying drawings. The same reference numbers in different drawings denote the same or similar elements unless otherwise described in detail.

[0129] The word "exemplary" is used herein to mean "serving as an example, instance, or illustration." Any implementation described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other implementations.

[0130] The term "and / or", as used herein, merely describes association between associated objects, and can indicate that three cases, for example, A and / or B, can mean that A exists alone, A and B exist together, and B exists alone. In addition, the term "at least one of", as used herein, means any one of a plurality or at least two of a plurality in any combination, for example, includes at least one of A, B, and C, can mean any one or more elements selected from the set consisting of A, B, and C.

[0131] In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following specific embodiments. Those skilled in the art should understand that the present disclosure can also be implemented without certain specific details. In some examples, methods, means, elements and circuits well known to those skilled in the art are not described in detail, in order to highlight the main idea of the present disclosure.

[0132] It can be understood that the above-mentioned various diaphragm movement display method embodiments mentioned in the present disclosure can be combined with each other to form combined embodiments without deviating from the principle logic. Due to the limited space, the present disclosure will not be described again.

[0133] In addition, the present disclosure also provides a diaphragm movement display device, an electronic device, a computer readable storage medium, and a program, which can be used to implement any one of the diaphragm movement display methods provided by the present disclosure. The corresponding technical solutions and descriptions are referred to the corresponding description in the method part, and will not be described again.

[0134] Figure 1 A flowchart of a diaphragm movement display method according to an embodiment of the present disclosure is shown as follows. Figure 1 As shown, the diaphragm movement display method comprises: step S101: acquiring a plurality of left lung movement apices and a plurality of right lung movement apices corresponding to DR left lung images and DR right lung images at multiple moments in a breathing process, and a plurality of left lung diaphragm movement point sequences and a plurality of right lung diaphragm movement point sequences corresponding to the DR left lung images and the DR right lung images at multiple moments in the breathing process; step S102: displaying the plurality of left lung movement apices and the plurality of right lung movement apices with first color lines, and displaying the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences with second color lines.

[0135] Step S101: acquiring a plurality of left lung movement apices and a plurality of right lung movement apices corresponding to DR left lung images and DR right lung images at multiple moments in a breathing process, and a plurality of left lung diaphragm movement point sequences and a plurality of right lung diaphragm movement point sequences corresponding to the DR left lung images and the DR right lung images at multiple moments in the breathing process.

[0136] In the embodiments and other possible embodiments of the present disclosure, a digital X-ray (DR) imaging device can provide high-resolution and real-time X-ray images, and has been widely applied to examinations of skeletal systems, chests, dentistry, etc., such as fracture diagnosis, lung disease screening, dental radiography, etc. Therefore, the DR imaging device can be used to image the skeletal systems, the chests, the dentistry, etc.

[0137] In the embodiments of the present disclosure, before the multiple left lung motion peaks and the multiple right lung motion peaks corresponding to the DR left lung images and the DR right lung images at multiple moments in the breathing process, and the multiple left diaphragm motion point sequences and the multiple right diaphragm motion point sequences corresponding to the DR left lung images and the DR right lung images at multiple moments in the breathing process are obtained, the DR lung images at multiple moments in the breathing process are obtained, the DR lung images are segmented into left lung and right lung, and the DR left lung images and the DR right lung images at multiple moments are obtained.

[0138] In the embodiments of the present disclosure, the method for segmenting the DR lung images into left lung and right lung to obtain the DR left lung images and the DR right lung images at multiple moments includes: detecting the costal margin boundary, the lung apex boundary, and the mediastinal and diaphragmatic edge of the left chest image and the right chest image of the DR lung images at multiple moments in the breathing process respectively, to obtain the DR left lung images and the DR right lung images at multiple moments.

[0139] Alternatively, in the embodiments of the present disclosure, the method for segmenting the DR lung images into left lung and right lung to obtain the DR left lung images and the DR right lung images at multiple moments includes: obtaining a segmentation model of a preset convolutional neural network and a DR lung region label image used for training the segmentation model; training the segmentation model by using the DR lung region label image used for training the segmentation model; and based on the trained segmentation model, completing the left lung and right lung segmentation of the DR lung images at multiple moments in the breathing process to obtain the DR left lung images and the DR right lung images at multiple moments.

[0140] In the embodiments of the present disclosure, the determination method of the DR lung region label image used for training the segmentation model includes: detecting the costal margin boundary, the lung apex boundary, and the mediastinal and diaphragmatic edge of the left chest image and the right chest image of multiple DR lung region images respectively, to obtain the DR lung region label images corresponding to the multiple DR lung region images.

[0141] In the embodiments of the present disclosure, before the rib edge boundary, lung apex boundary and mediastinum and diaphragm edge detection of the left chest image and the right chest image of the DR lung image at multiple moments in the breathing process are performed, chest cavity detection is performed on the DR lung image at multiple moments to obtain a plurality of corresponding chest cavity images; the chest cavity image is divided into a left lung region and a right lung region to obtain the left chest image and the right chest image of the DR lung image at multiple moments in the breathing process.

[0142] In the embodiments of the present disclosure, the method for performing chest cavity detection on the DR lung image at multiple moments to obtain a plurality of corresponding chest cavity images comprises: calculating a plurality of first gradient amplitudes corresponding to the horizontal direction of each pixel point and a plurality of second gradient amplitudes of the vertical direction of each pixel point in the DR lung image at multiple moments; determining a plurality of total gradient amplitudes based on the plurality of first gradient amplitudes and the plurality of second gradient amplitudes; integrating the plurality of first gradient amplitudes corresponding to the horizontal direction and the plurality of second gradient amplitudes of the vertical direction along the direction perpendicular thereto to obtain a plurality of first integral values and a plurality of second integral values; integrating the plurality of total gradient amplitudes in two directions corresponding to the vertical direction and the horizontal direction to obtain a plurality of third integral values and a plurality of fourth integral values; calculating a plurality of first local maximum values corresponding to the plurality of first ratios, and calculating a plurality of first local minimum values and a plurality of second local minimum values corresponding to the plurality of first ratios and the plurality of second ratios; determining a thoracic outline image corresponding to the DR image to be processed according to the plurality of first local maximum values, the plurality of first local minimum values, the plurality of second local minimum values and thoracic outline features; wherein the thoracic outline features comprise a first segmentation position of the neck or shoulder corresponding to the thoracic outline and a second segmentation position on both sides of the thoracic outline.

[0143] In the embodiments of the present disclosure and other possible embodiments, a DR image to be processed (a two-dimensional DR left lung image at multiple moments in the breathing process or in the breath-holding state) is obtained, and it is determined whether the DR image to be processed is a lung image according to the DR image to be processed; wherein the lung image is configured as a two-dimensional DR lung image at multiple moments in the breathing process; if the DR image to be processed is the lung image, chest cavity detection is performed on the DR image to be processed to remove information outside the chest cavity in the DR image to be processed.

[0144] In embodiments of the present disclosure and other possible embodiments, the method for determining whether the to-be-processed DR image is a lung image according to the to-be-processed DR image comprises: calculating an average gray value corresponding to the to-be-processed DR image, and determining whether the to-be-processed DR image is a lung image according to the average gray value and a set gray value. The set gray value can be configured by a person skilled in the art according to actual needs. For example, the set gray value can be configured as any one value or range between -1000HU and 0HU. Meanwhile, in embodiments of the present disclosure and other possible embodiments, the to-be-processed DR image can also be determined whether it is a lung image by manual judgment.

[0145] In embodiments of the present disclosure and other possible embodiments, the method for determining whether the to-be-processed DR image is a lung image according to the average gray value and the set gray value comprises: if the to-be-processed DR image has not been processed by taking the inverse, if the average gray value is less than or equal to the set gray value, it is determined that the to-be-processed DR image is a lung image; if the to-be-processed DR image has been processed by taking the inverse, if the average gray value is greater than or equal to the set gray value, it is determined that the to-be-processed DR image is a lung image. The principle is that if it is a lung image, the lung in the lung image is generally full of air or contains a certain amount of air, and the air corresponds to a small gray value (CT value), which is generally configured as -1000HU; the gray value (CT value) of water is generally configured as 0HU, and the gray value (CT value) of bone is generally configured as 1000HU or above; therefore, the above technical solution is used to determine whether the to-be-processed DR image is a lung image.

[0146] In embodiments of the present disclosure and other possible embodiments, if it is a lung image, the to-be-processed DR image is subjected to chest detection to remove information outside the chest in the to-be-processed DR image. In embodiments of the present disclosure and other possible embodiments, the information outside the chest comprises: removing unnecessary information such as arms, head, and blank background.

[0147] In embodiments of the present disclosure, before the to-be-processed DR image (to-be-segmented lung image or two-dimensional DR lung image at multiple times during respiration or in a breath-hold state) is subjected to chest detection, the to-be-processed DR image is subjected to filtering, and the filtered to-be-segmented lung image is subjected to down-sampling to a set size.

[0148] In embodiments of the present disclosure, the to-be-processed DR image of the set size is subjected to logarithmic transformation for image enhancement to obtain an enhanced to-be-processed DR image.

[0149] (1) Image preprocessing of the to-be-processed DR image (to-be-segmented lung image or two-dimensional DR lung image at multiple times during respiration).

[0150] In embodiments and other possible embodiments of the present disclosure, a. the DR image to be processed (the lung image to be segmented) is processed, and low-pass filtering is performed on the DR image to be processed (the lung image to be segmented). The filtered lung image to be segmented is reduced (down-sampled) to a set size to speed up the processing speed of the image. Logarithmic transformation is performed on the down-sampled lung image to be segmented for image enhancement, and an enhanced lung to be segmented is obtained. The low-pass template Gaussian filter or mean filter of the set size value can be configured as 3x3 or 5x5. The range of the reduction (down-sampling) can be configured as 2-6 times. Those skilled in the art can configure the set size value and / or the range of the reduction (down-sampling) according to actual needs.

[0151] In embodiments and other possible embodiments of the present disclosure, b. the technical solution of the chest detection of the DR image to be processed adopts self-adaptive judgment of the chest contour according to the characteristics of the lung image to be segmented, and removes unnecessary information such as arm head and blank background.

[0152] In embodiments of the present disclosure, step 1). The method for processing the DR image to be processed includes: calculating a plurality of first gradient amplitudes corresponding to the horizontal direction of each pixel point in the DR image to be processed and a plurality of second gradient amplitudes of each pixel point in the vertical direction, respectively; determining a plurality of total gradient amplitudes based on the plurality of first gradient amplitudes and the plurality of second gradient amplitudes; integrating the plurality of first gradient amplitudes corresponding to the horizontal direction and the plurality of second gradient amplitudes in the vertical direction along the direction perpendicular to the direction, to obtain a plurality of first integral values and a plurality of second integral values; integrating the plurality of total gradient amplitudes in the vertical direction and the horizontal direction corresponding to the two directions, to obtain a plurality of third integral values and a plurality of fourth integral values; calculating a plurality of first local maximum values corresponding to the plurality of first ratios, and calculating a plurality of first local minimum values and a plurality of second local minimum values corresponding to the plurality of first ratios and the plurality of second ratios; determining the chest contour graph corresponding to the DR image to be processed according to the plurality of first local maximum values, the plurality of first local minimum values, the plurality of second local minimum values, and the chest contour characteristics. The chest contour characteristics can be configured as a first segmentation position of the neck or shoulder corresponding to the chest contour and a second segmentation position on both sides of the chest contour.

[0153] In embodiments of the present disclosure, the method for calculating a plurality of first gradient amplitudes corresponding to the horizontal direction of each pixel point in the DR image to be processed and a plurality of second gradient amplitudes of each pixel point in the vertical direction, respectively, includes: obtaining a gradient operator; using the gradient operator, calculating a plurality of first gradient amplitudes corresponding to the horizontal direction of each pixel point in the DR image to be processed and a plurality of second gradient amplitudes of each pixel point in the vertical direction, respectively.

[0154] In embodiments of the present disclosure, the method for determining the plurality of total gradient magnitudes based on the plurality of first gradient magnitudes and the plurality of second gradient magnitudes comprises: calculating a plurality of first sum of squares corresponding to the plurality of first gradient magnitudes and a plurality of second sum of squares corresponding to the plurality of second gradient magnitudes, respectively, and determining the plurality of total gradient magnitudes based on the plurality of first sum of squares and the plurality of second sum of squares; and / or the method for determining the plurality of total gradient magnitudes based on the plurality of first sum of squares and the plurality of second sum of squares comprises: summing the plurality of first sum of squares and the plurality of second sum of squares, respectively, and square rooting the sum to obtain the plurality of total gradient magnitudes.

[0155] In embodiments of the present disclosure and other possible embodiments, the plurality of first gradient magnitudes corresponding to the horizontal direction of each pixel point in the lung image to be segmented and the plurality of second gradient magnitudes corresponding to the vertical direction of each pixel point are calculated, respectively; and the plurality of total gradient magnitudes are determined based on the plurality of first gradient magnitudes and the plurality of second gradient magnitudes; wherein the method for determining the plurality of total gradient magnitudes based on the plurality of first gradient magnitudes and the plurality of second gradient magnitudes comprises: calculating a plurality of first sum of squares corresponding to the plurality of first gradient magnitudes and a plurality of second sum of squares corresponding to the plurality of second gradient magnitudes, respectively, and determining the plurality of total gradient magnitudes based on the plurality of first sum of squares and the plurality of second sum of squares. Wherein the method for determining the plurality of total gradient magnitudes based on the plurality of first sum of squares and the plurality of second sum of squares comprises: summing the plurality of first sum of squares and the plurality of second sum of squares, respectively, and square rooting the sum to obtain the plurality of total gradient magnitudes.

[0156] For example, the matrix of each pixel point e in the lung image to be segmented and its eight adjacent areas is Using the sobel gradient operator The plurality of first gradient magnitudes (c+2*f+i-a-2*d-g) corresponding to the horizontal direction of each pixel point e in the lung image to be segmented and the transpose of the sobel gradient operator are calculated, respectively. The plurality of second gradient magnitudes (g+2*h+i-a-2*b-c) corresponding to the vertical direction of each pixel point e in the lung image to be segmented are calculated, respectively. Meanwhile, other gradient operators such as Roberts gradient operator or Laplace gradient operator can also be selected as needed by those skilled in the art.

[0157] For another example, the plurality of total gradient magnitudes are determined based on the plurality of first gradient magnitudes (h1, h2,..., h n ) and the plurality of second gradient magnitudes (k1, k2,..., k n ).

[0158] Step 2). Integrating the plurality of first gradient magnitudes corresponding to the horizontal direction and the plurality of second gradient magnitudes corresponding to the vertical direction along the direction perpendicular thereto to obtain a plurality of first integral values and a plurality of second integral values.

[0159] wherein the plurality of first gradient magnitudes corresponding to the horizontal direction are integrated in the vertical direction to obtain the plurality of first integral values, and the plurality of first gradient magnitudes corresponding to the vertical direction are integrated in the horizontal direction to obtain the plurality of second integral values.

[0160] Step 3). Integrating the plurality of total gradient magnitudes in the vertical direction and the horizontal direction corresponding thereto to obtain a plurality of third integral values and a plurality of fourth integral values; wherein the plurality of total gradient magnitudes are integrated in the vertical direction to obtain the plurality of third integral values, and the plurality of total gradient magnitudes are integrated in the horizontal direction to obtain the plurality of fourth integral values.

[0161] Step 4). (a) When a plurality of first local maximum values are determined, a ratio is calculated according to the results of Step 2 and Step 3, and when the ratio is less than a preset value, the image information at this position is regarded as noise and needs to be discarded. Wherein the noise can be configured as image information corresponding to unnecessary information such as arm head and blank background.

[0162] wherein, based on the plurality of first integral values and the plurality of third integral values, it is determined whether each of a plurality of first ratios corresponding to the plurality of first integral values and the plurality of third integral values in the horizontal direction is retained.

[0163] wherein, based on the plurality of first integral values and the plurality of third integral values, it is determined whether each of a plurality of first ratios corresponding to the plurality of first integral values and the plurality of third integral values in the horizontal direction is retained.

[0164] (b) When a plurality of first local minimum values are determined, a ratio is calculated according to the results of Step 2 and Step 3, and when the ratio is greater than a preset value, the image information at this position is regarded as noise and needs to be discarded. Wherein the noise can be configured as image information corresponding to unnecessary information such as arm head and blank background.

[0165] wherein, based on the plurality of first integral values and the plurality of third integral values, it is determined whether each of a plurality of first ratios corresponding to the plurality of first integral values and the plurality of third integral values in the horizontal direction is retained.

[0166] wherein, based on the plurality of first integral values and the plurality of third integral values, it is determined whether each of a plurality of first ratios corresponding to the plurality of first integral values and the plurality of third integral values in the horizontal direction is retained.

[0167] wherein, based on the plurality of second integral values and the plurality of fourth integral values, it is determined whether each of a plurality of second ratios corresponding to the plurality of second integral values and the plurality of fourth integral values in the vertical direction is retained.

[0168] wherein, based on the plurality of second integral values and the plurality of fourth integral values, it is determined whether each of a plurality of second ratios corresponding to the plurality of second integral values and the plurality of fourth integral values in the vertical direction is retained.

[0169] In an embodiment of the present disclosure, before the calculating the plurality of first local maximum values corresponding to the plurality of first ratios, and the calculating the plurality of first local minimum values and the plurality of second local minimum values corresponding to the plurality of first ratios and the plurality of second ratios, based on the plurality of first integral values and the plurality of third integral values, it is determined whether each of a plurality of first ratios corresponding to the plurality of first integral values and the plurality of third integral values in the horizontal direction is retained; and, based on the plurality of second integral values and the plurality of fourth integral values, it is determined whether each of a plurality of second ratios corresponding to the plurality of second integral values and the plurality of fourth integral values in the vertical direction is retained; and then, the plurality of first local maximum values corresponding to the retained plurality of first ratios are calculated, and the plurality of first local minimum values and the plurality of second local minimum values corresponding to the retained plurality of first ratios and the retained plurality of second ratios are calculated.

[0170] In embodiments of the present disclosure, the differential derivatives of the first curve corresponding to the plurality of first ratios are calculated to obtain the plurality of first local maximum values and the plurality of first local minimum values; and the differential derivatives of the second curve corresponding to the plurality of second ratios are calculated to obtain the plurality of second local minimum values.

[0171] In embodiments of the present disclosure, the method for determining the thoracic profile corresponding to the lung image to be segmented according to the plurality of first local maximum values, the plurality of first local minimum values, the plurality of second local minimum values, and the thoracic feature includes: determining the second segmentation positions on both sides of the thoracic profile based on the plurality of first local maximum values and the thoracic feature; determining the first segmentation positions of the neck or shoulder based on the plurality of second local minimum values and the thoracic feature; and determining the thoracic profile corresponding to the lung image to be segmented according to the first segmentation positions and the first segmentation positions.

[0172] In embodiments of the present disclosure and other possible embodiments, 5). The plurality of first local maximum values and the plurality of first local minimum values corresponding to the plurality of first ratios after the discard of step 4(a) are calculated respectively. Similarly, the plurality of first local minimum values and the plurality of second local minimum values corresponding to the plurality of first ratios and the plurality of second ratios after the discard of step 4(b) are calculated respectively. Wherein, the plurality of first ratios after the discard are the plurality of first ratios retained after the discard; similarly, the plurality of second ratios after the discard are the plurality of second ratios retained after the discard.

[0173] According to the plurality of first local maximum values, the plurality of first local minimum values, the plurality of second local minimum values, and the thoracic feature, the thoracic profile corresponding to the lung image to be segmented is determined, and unnecessary information such as arms, heads, and blank backgrounds is removed. Wherein, the thoracic feature can configure the first segmentation positions of the neck or shoulder corresponding to the thoracic profile and the second segmentation positions on both sides of the thoracic profile.

[0174] Wherein, the method for determining the thoracic profile corresponding to the lung image to be segmented according to the plurality of first local maximum values, the plurality of first local minimum values, the plurality of second local minimum values, and the thoracic feature includes: determining the second segmentation positions on both sides of the thoracic profile based on the plurality of first local maximum values and the thoracic feature; determining the first segmentation positions of the neck or shoulder based on the plurality of second local minimum values and the thoracic feature; and determining the thoracic profile corresponding to the lung image to be segmented according to the first segmentation positions and the first segmentation positions.

[0175] The first local maximum values are obtained by calculating the differential derivative of the first curve corresponding to the discarded first ratios, and the first local minimum values are obtained by calculating the differential derivative of the first curve corresponding to the discarded first ratios. The differential derivative can be configured as a first-order, second-order or other multi-order differential derivative. Similarly, the second local minimum values are obtained by calculating the differential derivative of the second curve corresponding to the discarded second ratios, and the differential derivative can be configured as a first-order, second-order or other multi-order differential derivative.

[0176] In an embodiment of the present disclosure, the method for determining the second segmentation position of the two sides of the thoracic cavity based on the plurality of first local maximum values and the thoracic cavity features comprises: determining the maximum value of all the plurality of first local maximum values on one side of the center line of the to-be-processed DR image, and configuring the position information corresponding to the maximum value as the to-be-determined one-side segmentation position point corresponding to the one side of the thoracic cavity; determining the minimum value of all the plurality of first local minimum values on the other side of the center line of the to-be-processed DR image, and configuring the position information corresponding to the minimum value as the to-be-determined other-side segmentation position point corresponding to the other side of the thoracic cavity.

[0177] In an embodiment of the present disclosure, the method for determining the first segmentation position of the neck or shoulder based on the plurality of second local minimum values and the thoracic cavity features comprises: configuring the position information corresponding to the minimum value of the plurality of second local minimum values as the first segmentation position of the neck or shoulder.

[0178] In an embodiment of the present disclosure and other possible embodiments, the method for determining the second segmentation position of the two sides of the thoracic cavity based on the plurality of first local maximum values and the thoracic cavity features comprises: determining the maximum value of all the plurality of first local maximum values on one side (right side) of the center line of the to-be-processed DR image, and configuring the position information corresponding to the maximum value as the to-be-determined one-side segmentation position point corresponding to the one side of the thoracic cavity; determining the minimum value of all the plurality of first local minimum values on the other side (left side) of the center line of the to-be-processed DR image, and configuring the position information corresponding to the minimum value as the to-be-determined other-side segmentation position point corresponding to the other side of the thoracic cavity.

[0179] For example, the maximum value a n ) of all the plurality of first local maximum values on one side (right side) of the center line is determined, and the position information corresponding to the maximum value a m; wherein, m is less than or equal to n; m is the position information (for example, a certain abscissa) corresponding to the maximum value, that is, the side corresponding to the thoracic side to be determined. Similarly, the minimum value b n of all the first local minimum values (b1, b2,..., b r on the other side (left side) of the center line is determined, wherein r is less than or equal to n; r is the position information (for example, a certain abscissa) corresponding to the minimum value.

[0180] In the embodiments and other possible embodiments of the present disclosure, the method for determining the first segmentation position of the neck or shoulder based on the plurality of second local minimum values and the thoracic features includes: configuring the position information (for example, a certain ordinate) corresponding to the minimum value corresponding to the plurality of second local minimum values as the first segmentation position of the neck or shoulder.

[0181] (2) Lung field segmentation.

[0182] In the embodiments of the present disclosure, the thoracic profile obtained by detecting the chest in the DR image to be processed is configured as a lung image to be segmented; and based on the lung image to be segmented, the left lung and the right lung are segmented.

[0183] In the embodiments of the present disclosure, the lung image to be segmented is segmented into a left thoracic image and a right thoracic image; and based on the left thoracic image and the right thoracic image respectively, the left lung and the right lung are segmented.

[0184] In the embodiments of the present disclosure, the lung image to be segmented is segmented into a left thoracic image and a right thoracic image; and based on the left thoracic image and the right thoracic image respectively, the left lung and the right lung are segmented; or, a segmentation model of a preset convolutional neural network, a DR lung area label image used for training the segmentation model, and a plurality of DR lung images to be segmented (lung images to be segmented) at multiple times in a breathing process or in a breath-holding state are obtained; wherein the method for determining the DR lung area label image used for training the segmentation model includes: respectively detecting the costophrenic boundary, the apical boundary, and the mediastinal and diaphragmatic boundary of the left thoracic image and the right thoracic image of a plurality of DR lung area images to obtain the DR lung area label image corresponding to the plurality of DR lung area images; training the segmentation model by using the DR lung area label image used for training the segmentation model; and based on the trained segmentation model, completing the left lung and / or right lung segmentation of the plurality of DR lung images to be segmented.

[0185] In embodiments and other possible embodiments of the present disclosure, the segmentation model of the preset convolutional neural network is configured as a Unet convolutional neural network or an nnUnet convolutional neural network or a convolutional neural network improved based on the Unet convolutional neural network or a convolutional neural network improved based on the nnUnet convolutional neural network. For example, the convolutional neural network improved based on the Unet convolutional neural network can be configured as a ResUnet convolutional neural network with a residual structure.

[0186] In embodiments and other possible embodiments of the present disclosure, the Unet convolutional neural network or the nnUnet convolutional neural network or the convolutional neural network improved based on the Unet convolutional neural network or the convolutional neural network improved based on the nnUnet convolutional neural network at least includes a down-sampling contraction path, an up-sampling expansion path, and a final classification layer.

[0187] In embodiments and other possible embodiments of the present disclosure, the plurality of DR lung region images are configured as a plurality of DR lung region images acquired in a deep inhalation state or a breath-hold state.

[0188] In embodiments and other possible embodiments of the present disclosure, before training the segmentation model using the DR lung region label images for training the segmentation model, the DR lung region label images are subjected to data augmentation to obtain augmented DR lung region label images; and the augmented DR lung region label images are used to train the segmentation model.

[0189] In embodiments and other possible embodiments of the present disclosure, the method of performing data augmentation on the DR lung region label images to obtain augmented DR lung region label images includes: performing spatial geometric transformation and / or flipping and / or rotation and / or cropping and / or scaling and / or image shifting and / or edge padding and / or random erasing and / or random occlusion operation on the DR lung region label images to obtain the augmented DR lung region label images.

[0190] In embodiments and other possible embodiments of the present disclosure, the method of performing data augmentation on the DR lung region label images to obtain augmented DR lung region label images further includes: randomly extracting any two DR lung region label images from the DR lung region label images; performing configuration operation on the any two DR lung region label images to obtain corresponding DR lung region label registration images; and performing fusion operation on the DR lung region label registration images to obtain the augmented DR lung region label images.

[0191] In embodiments of the present disclosure and other possible embodiments, the method for performing the fusion operation on the DR lung region label registration image to obtain an enhanced DR lung region label image includes: performing a minimum value operation, a maximum value operation or a mean value operation on pixel values corresponding to the DR lung region label registration image respectively to obtain an enhanced DR lung region label image.

[0192] In embodiments of the present disclosure and other possible embodiments, the registration method used by the present disclosure can adopt an existing registration algorithm or model, such as one or several of SIFT (Scale-invariant feature transform) registration algorithm or model, SURF (Speeded Up Robust Features) registration algorithm or model, ORB (Oriented FAST and Rotated BRIEF) registration algorithm or model, or other registration algorithm or model based on convolutional neural network. For example, the registration algorithm or model based on convolutional neural network can be configured as a registration algorithm or model based on VGG network.

[0193] c. According to the thoracic outline corresponding to the lung image to be segmented, the thoracic outline is divided into a left thoracic image and a right thoracic image, and based on this, the left lung field is segmented from the left thoracic image and the right lung field is segmented from the right thoracic image.

[0194] In embodiments of the present disclosure, the method for segmenting the left lung and the right lung based on the left thoracic image and the right thoracic image respectively includes: performing rib edge boundary, lung apex boundary and mediastinum and diaphragm edge detection on the left thoracic image and the right thoracic image respectively; obtaining a left lung segmentation image according to the rib edge boundary, the lung apex boundary and the mediastinum and diaphragm edge corresponding to the left thoracic image; and obtaining a right lung segmentation image according to the rib edge boundary, the lung apex boundary and the mediastinum and diaphragm edge corresponding to the right thoracic image.

[0195] In the embodiments of the present disclosure, the method for detecting the costophrenic angle boundary of the left chest image comprises: constructing a directional derivative template of the left chest image by using a directional derivative, and setting a set weighting depth of the directional derivative template; performing template traversal of the directional derivative on the left chest image by using the directional derivative template corresponding to the set weighting depth, superimposing a result of the template traversal into the left chest image to obtain a left chest superimposed image; performing binaryzation processing on the left chest superimposed image to obtain a left costophrenic angle binary image; obtaining a left costophrenic angle angle image to be screened according to the left costophrenic angle binary image and the left chest superimposed image; obtaining a screened left costophrenic angle angle image based on the left costophrenic angle angle image to be screened and a first set costophrenic angle; and performing connected domain selection on the left costophrenic angle angle image to obtain a costophrenic angle boundary corresponding to a maximum connected domain.

[0196] In the embodiments of the present disclosure, the method for obtaining the left costophrenic angle angle image to be screened according to the left costophrenic angle binary image and the left chest superimposed image comprises: performing morphological opening and closing operation and thinning processing on the left costophrenic angle binary image to obtain a morphologically processed left costophrenic angle binary image; and performing AND operation on a gradient direction angle of each pixel in the morphologically processed left costophrenic angle binary image and the left chest superimposed image to obtain the left costophrenic angle angle image to be screened.

[0197] In the embodiments of the present disclosure, before the directional derivative template of the left chest image is constructed by using the directional derivative, a set scale Gaussian blur is performed on the left chest image to obtain a corresponding left chest Gaussian blur image; then, the directional derivative template of the left chest Gaussian blur image is constructed by using the directional derivative; in the process of detecting the costophrenic angle boundary of the left chest image, the directional derivative template traversal is performed on the left chest Gaussian blur image by using the directional derivative template corresponding to the set weighting depth, and a result of the template traversal is superimposed into the left chest image to obtain a left chest Gaussian blur superimposed image; the binaryzation processing is performed on the left chest Gaussian blur superimposed image to obtain a left costophrenic angle binary image; and the left costophrenic angle angle image to be screened is obtained according to the left costophrenic angle binary image and the left chest Gaussian blur superimposed image.

[0198] a.In the embodiments of the present disclosure and other possible embodiments, the lung field segmentation step is as follows by taking the left chest image as an example. For example, the costophrenic angle boundary detection of the left chest image.

[0199] 1). Set a scale of Gaussian blur to the left chest region (image), reduce the details of the left chest region (image), and obtain a corresponding processed left chest Gaussian blur image. The set scale can be configured as 7*7 or 9*9, and the set scale can be configured by the person skilled in the art according to actual needs. The mean square deviation of the Gaussian blur algorithm can be configured as 2, 2.5, 3, etc., and the mean square deviation σ of the Gaussian blur algorithm can be configured by the person skilled in the art according to actual needs.

[0200] 2). Construct a directional derivative template of the processed left chest Gaussian blur image f(x0, y0) by using a directional derivative, and set a set weighting depth of the directional derivative template. Wherein (x0, y0) are the horizontal coordinate x0 and the vertical coordinate y0 in the coordinate point corresponding to the left chest image f(x0, y0).

[0201] The calculation formula of the directional derivative is as follows:

[0202]

[0203] Wherein, l is a unit vector in the direction, and cosα and cosβ are the cosine of the l direction. The direction can be configured as the horizontal direction, α is the angle formed by the l direction and the horizontal direction, and β is the angle formed by the l direction and the vertical direction.

[0204] The method for constructing the directional derivative template of the processed left chest Gaussian blur image f(x0, y0) by using a directional derivative includes: obtaining a first radius r in the x0 direction corresponding to a set template radius r and a second radius r in the y0 direction Based on the first radius r and the second radius r Construct a directional derivative template of the processed left chest Gaussian blur image f(x0, y0) by using a directional derivative.

[0205]

[0206] Wherein,

[0207]

[0208] For example, the set template radius can be configured as 1, 2, 3, 4, 5, etc. The set template radius can be configured by the person skilled in the art according to actual needs.

[0209] For another example, when the first radius r in the x0 direction is configured as -1 or 0 or 1, the second radius r in the y0 direction is ​The value range of the set weighted depth is -1, 0 and 1.

[0210] Among them, the skilled person in the art can configure the set weighted depth according to actual needs, for example, the set weighted depth can be configured as 6. In addition, the method for setting the set weighted depth of the directional derivative template comprises: obtaining a set weighted depth, multiplying the set weighted depth by the directional derivative template to obtain a directional derivative template corresponding to the set weighted depth. According to the structural characteristics of the costal margin region, a reasonable directional angle range is set and brought into the directional derivative calculation formula to obtain a template array.

[0211] 3). Using the directional derivative template corresponding to the set weighted depth, the left chest Gaussian blur image processed in step a.1 is subjected to template traversal of the directional derivative, and the result of the template traversal is superimposed (the corresponding pixels are added) into the left chest Gaussian blur image in step 1 to obtain a left chest Gaussian blur superimposed image.

[0212] For example, each pixel point e of the left chest Gaussian blur image and its eight-neighbor matrix are Using the directional derivative template corresponding to the set weighted depth The superimposed value (e+w*(c+2*f+i-a-2*d-g)) of each pixel point e is calculated respectively.

[0213] 4). The result (left chest Gaussian blur superimposed image) of step a.3 is subjected to a maximum inter-class variance binarization process to obtain a costal margin binary image.

[0214] 5). The result (costal margin binary image) of step a.4 is subjected to a morphological opening-closing operation and thinning process to obtain a morphologically processed costal margin binary image.

[0215] 6). The result (left chest Gaussian blur superimposed image) of step a.3 is subjected to horizontal gradient and vertical gradient calculation to obtain a horizontal gradient image and a vertical gradient image; based on the horizontal gradient image and the vertical gradient image, the gradient direction angle of each pixel in the left chest Gaussian blur superimposed image is calculated.

[0216] 7). The result (morphologically processed costal margin binary image) of step a.5 is subjected to an AND operation with the result (gradient direction angle of each pixel in the left chest Gaussian blur superimposed image) of step a.6 to obtain a to-be-screened costal margin angle image.

[0217] 8). A reasonable angle range (first set costal margin angle range) is set according to the characteristics of the costal margin tissue, and the result (to-be-screened costal margin angle image) obtained in step a.7 is subjected to angle screening to obtain a screened costal margin angle image.

[0218] 9). According to the result in step a.8 (the rib edge angle graph after screening), a connected domain selection is performed to obtain a maximum connected domain, and the connected domain is the rib edge part (rib edge boundary).

[0219] Similarly, in the embodiments of the present disclosure, the method for performing rib edge boundary on the right chest image comprises: constructing a direction derivative template of the right chest image by using a direction derivative, and setting a set weighting depth of the direction derivative template; performing template traversal of the direction derivative on the right chest image by using the direction derivative template corresponding to the set weighting depth, superimposing the result of the template traversal into the right chest image to obtain a right chest superimposed image; performing binaryzation processing on the right chest superimposed image to obtain a right rib edge binary image; obtaining a right rib edge angle graph to be screened according to the right rib edge binary image and the right chest superimposed image; obtaining a screened right rib edge angle graph based on the right rib edge angle graph to be screened and a second set rib edge angle; and performing connected domain selection on the right rib edge angle graph to obtain a rib edge boundary corresponding to a maximum connected domain.

[0220] Similarly, in the embodiments of the present disclosure, the method for obtaining a right rib edge angle graph to be screened according to the right rib edge binary image and the right chest superimposed image comprises: performing morphological opening-closing operation and thinning processing on the right rib edge binary image to obtain a right rib edge binary image after morphological processing; and performing AND operation on the gradient direction angle of each pixel in the right rib edge binary image after morphological processing and the right chest superimposed image to obtain a right rib edge angle graph to be screened.

[0221] Similarly, in the embodiments of the present disclosure, before the direction derivative template of the right chest image is constructed by using the direction derivative, a right chest Gaussian blur image corresponding to a set scale Gaussian blur is obtained by performing set scale Gaussian blur on the right chest image; then, the direction derivative template of the right chest Gaussian blur image is constructed by using the direction derivative; in the process of performing rib edge boundary on the right chest image, the direction derivative template corresponding to the set weighting depth is used to perform template traversal of the direction derivative on the right chest Gaussian blur image, the result of the template traversal is superimposed into the right chest image to obtain a right chest Gaussian blur superimposed image; the right chest Gaussian blur superimposed image is binaryzated to obtain a right rib edge binary image; and a right rib edge angle graph to be screened is obtained according to the right rib edge binary image and the right chest Gaussian blur superimposed image.

[0222] b. Lung apex boundary detection. In embodiments of the present disclosure, the method of performing left lung apex boundary detection on the left chest image comprises: determining a left lung apex detection region according to the left chest image; determining a left lung apex edge binary image according to the left lung apex detection region; and obtaining a fitted left lung apex boundary by using a quadratic function fitting according to the left lung apex edge binary image.

[0223] In embodiments of the present disclosure, the method of determining a left lung apex detection region according to the left chest image comprises: detecting a first coordinate corresponding to the uppermost coordinate point of the rib margin of the left chest image; and configuring a region with a hypotenuse formed by the first coordinate and the uppermost coordinate point of the rightmost corner of the left chest image as the left lung apex detection region.

[0224] In embodiments of the present disclosure and other possible embodiments, 1). The coordinate corresponding to the uppermost coordinate point of the rib margin of the detected left chest image. 2). The coordinate point and the uppermost coordinate point of the leftmost corner of the left chest image form a rectangular region with a hypotenuse as the lung apex detection region. As for the lung apex detection region corresponding to the right lung, the coordinate corresponding to the uppermost coordinate point of the rib margin and the uppermost coordinate point of the leftmost corner of the right chest image form a rectangular region with a hypotenuse as the lung apex detection region corresponding to the right lung. 3). Perform scale Gaussian filtering and contrast enhancement on the lung apex region obtained in step b.2 to obtain a filtered and enhanced lung apex region image. 4). Based on the filtered and enhanced lung apex region image, the same method as steps a.2 to a.5 is used to determine the left lung apex edge binary image according to the angle characteristics of the lung apex edge. Wherein, the angle characteristics of the lung apex edge are configured to set an angle range. 5). According to the characteristics of the lung apex edge and the left lung apex edge binary image, a quadratic function Hough space parameter fitting is used to obtain a fitted lung apex edge (line). Wherein, the characteristics of the lung apex edge are a quadratic function with an opening downward.

[0225] Similarly, in embodiments of the present disclosure, the method of performing right lung apex boundary detection on the right chest image comprises: determining a right lung apex detection region according to the right chest image; determining a right lung apex edge binary image according to the right lung apex detection region; and obtaining a fitted right lung apex boundary by using a quadratic function fitting according to the right lung apex edge binary image.

[0226] Similarly, in embodiments of the present disclosure, the method of determining a right lung apex detection region according to the right chest image comprises: detecting a second coordinate corresponding to the uppermost coordinate point of the rib margin of the right chest image; and configuring a region with a hypotenuse formed by the second coordinate and the uppermost coordinate point of the leftmost corner of the left chest image as the right lung apex detection region.

[0227] c. mediastinal and diaphragmatic edge detection. In embodiments of the present disclosure, a method for left lung mediastinal and diaphragmatic edge detection on the left chest image respectively, comprises: performing binaryzation on the left chest image to obtain a left chest binary image; performing edge detection on the left chest binary image to obtain a left chest edge binary image; obtaining a left chest edge angle image according to the gradient direction angle of each pixel in the left chest binary image and the left chest edge binary image; obtaining a selected left diaphragmatic and mediastinal edge angle image according to the obtained left chest edge angle image and the edge angle range of the set diaphragm and mediastinum; performing connected domain selection processing according to the selected left diaphragmatic and mediastinal edge angle image to obtain the left lung mediastinal and diaphragmatic edge corresponding to the maximum connected domain.

[0228] In embodiments of the present disclosure, the method for performing binaryzation on the left chest image to obtain a left chest binary image comprises: performing contrast enhancement processing and maximum inter-class variance processing on the left chest Gaussian blur image corresponding to the left chest image to obtain a left chest binary image.

[0229] In embodiments of the present disclosure, the method for determining the gradient direction angle of each pixel in the left chest edge binary image comprises: performing horizontal gradient and vertical gradient calculation on the left chest Gaussian blur image corresponding to the left chest image to obtain a horizontal gradient image and a vertical gradient image of the left chest; and obtaining the gradient direction angle of each pixel in the left chest Gaussian blur image based on the horizontal gradient image and the vertical gradient image of the left chest.

[0230] In the embodiments and other possible embodiments of the present disclosure, the left lung mediastinum and transverse septum edge detection method for the left chest image includes: 1) performing contrast enhancement processing and maximum inter-class variance processing on the processed left chest Gaussian blur image obtained in step a.1 to obtain a left chest binary image; 2) sequentially performing morphological opening and closing operations and canny edge detection on the result of step c.1 (left chest binary image) to obtain a left chest edge binary image; 3) performing horizontal gradient and vertical gradient calculation on the processed left chest Gaussian blur image obtained in step a.1 to obtain a horizontal gradient image and a vertical gradient image; based on the horizontal gradient image and the vertical gradient image, the gradient direction angle of each pixel in the left chest Gaussian blur image is calculated; 4) performing AND operation on the left chest binary image obtained in step c.1 and the left chest edge binary image obtained in c.2 to retain the angle on the edge pixel point, to obtain a left chest edge angle image; 5) selecting a suitable angle range according to the edge characteristics of the transverse septum and the mediastinum (setting the edge angle range of the transverse septum and the mediastinum), removing the stray tissue edge information in the left chest edge angle image, to obtain a selected left transverse septum and mediastinum edge angle image; 6) performing connected domain selection processing according to the result of c.5 (selected left transverse septum and mediastinum edge angle image) to obtain the maximum connected domain, which is the transverse septum and mediastinum edge region.

[0231] Similarly, in the embodiments of the present disclosure, the right lung mediastinum and transverse septum edge detection method for the right chest image respectively includes: performing binaryzation processing on the right chest image to obtain a right chest binary image; performing edge detection on the right chest binary image to obtain a right chest edge binary image; obtaining a right chest edge angle image according to the gradient direction angle of each pixel in the right chest binary image and the right chest edge binary image; obtaining a selected right transverse septum and mediastinum edge angle image according to the right chest edge angle image and the set edge angle range of the transverse septum and the mediastinum; and performing connected domain selection processing according to the selected right transverse septum and mediastinum edge angle image to obtain the right lung mediastinum and transverse septum edge corresponding to the maximum connected domain.

[0232] Similarly, in the embodiments of the present disclosure, the method of performing binaryzation processing on the right chest image to obtain a right chest binary image includes: performing contrast enhancement processing and maximum inter-class variance processing on the right chest Gaussian blur image corresponding to the right chest image to obtain a right chest binary image.

[0233] Similarly, in the embodiments of the present disclosure, the method for determining the gradient direction angle of each pixel in the right chest edge binary image comprises: performing transverse gradient and longitudinal gradient calculation on the right chest Gaussian blur image corresponding to the right chest image to obtain the transverse gradient image and the longitudinal gradient image of the right chest; and obtaining the gradient direction angle of each pixel in the right chest Gaussian blur image based on the transverse gradient image and the longitudinal gradient image of the right chest.

[0234] (3) The connection of the transverse diaphragm edge, the lung apex and the rib edge. In the embodiments of the present disclosure, the method for obtaining the left lung segmentation image according to the rib edge boundary, the lung apex boundary and the longitudinal and transverse diaphragm edges corresponding to the left chest image comprises: calculating a first left lung apex edge point and a left lung longitudinal diaphragm edge point corresponding to the shortest distance between the lung apex boundary and the longitudinal diaphragm edge in the left chest image; calculating a second left lung apex edge point and a first left lung rib edge point corresponding to the shortest distance between the lung apex boundary and the rib edge in the left chest image; calculating a second rib edge point and a transverse diaphragm edge point corresponding to the shortest distance between the rib edge boundary and the transverse diaphragm edge in the left chest image; and obtaining the left lung segmentation image based on the first left lung apex edge point, the left lung longitudinal diaphragm edge point, the second left lung apex edge point, the first left lung rib edge point, the second rib edge point and the transverse diaphragm edge point.

[0235] Similarly, in the embodiments of the present disclosure, the method for obtaining the right lung segmentation image according to the rib edge boundary, the lung apex boundary and the longitudinal and transverse diaphragm edges corresponding to the right chest image comprises: calculating a first right lung apex edge point and a right lung longitudinal diaphragm edge point corresponding to the shortest distance between the lung apex boundary and the longitudinal diaphragm edge in the right chest image; calculating a second right lung apex edge point and a first right lung rib edge point corresponding to the shortest distance between the lung apex boundary and the rib edge in the right chest image; calculating a second rib edge point and a transverse diaphragm edge point corresponding to the shortest distance between the rib edge boundary and the transverse diaphragm edge in the right chest image; and obtaining the right lung segmentation image based on the first right lung apex edge point, the right lung longitudinal diaphragm edge point, the second right lung apex edge point, the first right lung rib edge point, the second rib edge point and the transverse diaphragm edge point.

[0236] In embodiments of the present disclosure and other possible embodiments, the method for connecting the edges of the transverse diaphragm, the lung apex, and the rib margin comprises: a. calculating the two points (a first lung apex edge point and a diaphragm edge point) between which the Euclidean distance between the lung apex edge (line) and the diaphragm edge (line) is the shortest, and the two points are respectively one of the end points of the lung apex and the transverse diaphragm boundary; b. calculating the two points (a second lung apex edge point and a first rib margin edge point) between which the Euclidean distance between the lung apex edge (line) and the rib margin edge (line) is the shortest, and the two points are respectively one of the end points of the lung apex and the rib margin, and the other lung apex end point obtained according to step a can obtain the lung apex boundary region; c. calculating the two points (a second rib margin edge point and a diaphragm edge point) between which the Euclidean distance between the rib margin (line) and the diaphragm edge (line) is the shortest, and the two points are respectively one of the end points of the rib margin and the transverse diaphragm, and the other end point of the transverse diaphragm boundary obtained according to step a can obtain the transverse diaphragm boundary region, and the other rib margin end point obtained according to step b can obtain the rib margin boundary region; d. connecting the three edge regions obtained in steps abc to obtain a closed lung field contour, and according to the difference between the tissues inside and outside the contour boundary, the lung field region can be segmented; e. the right lung field region is processed in the same way as described above, and finally the lung field region is mapped to the original image to obtain the lung field segmentation of the original image.

[0237] In embodiments of the present disclosure, a plurality of left lung motion apices and a plurality of right lung motion apices are respectively determined according to the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple time points.

[0238] In embodiments of the present disclosure, before the steps of respectively determining a plurality of left lung motion apices and a plurality of right lung motion apices according to the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple time points, and respectively determining a plurality of left lung diaphragm motion point sequences and a plurality of right lung diaphragm motion point sequences according to the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple time points, the method further comprises: respectively extracting a plurality of left lung contour lines and a plurality of right lung contour lines corresponding to the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple time points; and respectively determining a plurality of left lung motion apices, a plurality of right lung motion apices, a plurality of left lung diaphragm motion point sequences, and a plurality of right lung diaphragm motion point sequences according to the plurality of left lung contour lines and the plurality of right lung contour lines.

[0239] In embodiments of the present disclosure and other possible embodiments, the method for respectively extracting a plurality of left lung contour lines and a plurality of right lung contour lines corresponding to the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple time points comprises: obtaining an edge detection algorithm or an edge detection model; and respectively extracting a plurality of left lung contour lines and a plurality of right lung contour lines corresponding to the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple time points by using the edge detection algorithm or the edge detection model.

[0240] In embodiments of the present disclosure and other possible embodiments, the edge detection algorithm or the edge detection model can be configured as an edge detection algorithm or an edge detection model based on one or more of a Sobel operator, a Prewitt operator, a Roberts operator, a Canny operator, and a Marr-Hildreth operator.

[0241] In embodiments of the present disclosure, the method of determining a plurality of left lung motion apexes and a plurality of right lung motion apexes according to the plurality of left lung contour lines and the plurality of right lung contour lines comprises: respectively detecting a plurality of left lung apexes and a plurality of right lung apexes corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines, and configuring coordinates corresponding to the plurality of left lung apexes and the plurality of right lung apexes as the plurality of left lung motion apexes and the plurality of right lung motion apexes, respectively.

[0242] In embodiments of the present disclosure, the method of respectively detecting a plurality of left lung apexes and a plurality of right lung apexes corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines comprises: respectively determining a plurality of first maximum vertical coordinates and a plurality of second maximum vertical coordinates corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines; respectively determining a plurality of first horizontal coordinates corresponding to the plurality of first maximum vertical coordinates according to the plurality of first maximum vertical coordinates and the plurality of left lung contour lines; respectively determining a plurality of second horizontal coordinates corresponding to the plurality of second maximum vertical coordinates according to the plurality of second maximum vertical coordinates and the plurality of right lung contour lines; and respectively configuring the plurality of first maximum vertical coordinates and the plurality of first horizontal coordinates corresponding thereto as a plurality of left lung apexes, and respectively configuring the plurality of second maximum vertical coordinates and the plurality of second horizontal coordinates corresponding thereto as a plurality of right lung apexes.

[0243] In embodiments of the present disclosure and other possible embodiments, the method of respectively determining a plurality of first maximum vertical coordinates and a plurality of second maximum vertical coordinates corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines comprises: establishing a coordinate system corresponding to the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple moments in the breathing process; and respectively determining a plurality of first maximum vertical coordinates and a plurality of second maximum vertical coordinates corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines in the coordinate system.

[0244] Step S103: respectively determining a plurality of left diaphragm motion point sequences and a plurality of right diaphragm motion point sequences according to the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple moments.

[0245] In embodiments of the present disclosure, the method of determining a plurality of left lung diaphragm motion point sequences and a plurality of right lung diaphragm motion point sequences respectively according to the plurality of left lung contour lines and the plurality of right lung contour lines comprises: detecting a plurality of left lung lowest points and a plurality of right lung lowest points corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively, and configuring the plurality of left lung lowest points and the plurality of right lung lowest points as starting points of the plurality of left lung diaphragm motion point sequences and starting points of the plurality of right lung diaphragm motion point sequences respectively; detecting a plurality of left lung top points and a plurality of right lung top points corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively, and configuring coordinates of the plurality of left lung top points and the plurality of right lung top points as candidate end points of the plurality of left lung diaphragm motion point sequences and candidate end points of the plurality of right lung diaphragm motion point sequences respectively; determining the plurality of left lung diaphragm motion point sequences according to the starting points of the plurality of left lung diaphragm motion point sequences and the candidate end points of the plurality of left lung diaphragm motion point sequences respectively; and determining the plurality of right lung diaphragm motion point sequences according to the starting points of the plurality of right lung diaphragm motion point sequences and the candidate end points of the plurality of right lung diaphragm motion point sequences respectively.

[0246] Similarly, in embodiments of the present disclosure and other possible embodiments, in the coordinate system, the plurality of left lung diaphragm motion point sequences are determined according to the starting points of the plurality of left lung diaphragm motion point sequences and the candidate end points of the plurality of left lung diaphragm motion point sequences respectively.

[0247] In embodiments of the present disclosure, the method of determining the plurality of left lung diaphragm motion point sequences according to the starting points of the plurality of left lung diaphragm motion point sequences and the candidate end points of the plurality of left lung diaphragm motion point sequences respectively comprises: obtaining a first set step length; calculating a plurality of first slope values corresponding to the starting points of the plurality of left lung diaphragm motion point sequences to the candidate end points of the plurality of left lung diaphragm motion point sequences respectively based on the first set step length; determining end points of the plurality of left lung diaphragm motion point sequences according to the plurality of first slope values; or determining a left lung contour line between the starting points of the plurality of left lung diaphragm motion point sequences and the candidate end points of the plurality of left lung diaphragm motion point sequences respectively; and determining the end points of the plurality of left lung diaphragm motion point sequences on the left lung contour line in an interactive manner.

[0248] In embodiments of the present disclosure and other possible embodiments, a person skilled in the art can configure the first set step length according to actual needs. For example, the first set step length can be configured as any value or other value between 1-10.

[0249] For example, in a first starting point (x1, y1) of the plurality of starting points corresponding to the plurality of left lung diaphragm motion point sequences, the first set step length is configured as n, and the corresponding first slope value in the plurality of first slope values is (y1+n - y1) / [x 1+n - x1), (y 1+2*n - y 1+n ) / [x 1+2*n - x 1+n ), ….

[0250] In embodiments of the present disclosure, the method of determining the endpoints of the plurality of left diaphragm movement point sequences according to the plurality of first slope values comprises: determining the candidate endpoints corresponding to the change of the sign of the plurality of first slope values from negative to positive as the endpoints of the plurality of left diaphragm movement point sequences.

[0251] In embodiments of the present disclosure and other possible embodiments, the method of determining the endpoints of the plurality of left diaphragm movement point sequences in an interactive manner on the left lung contour line between comprises:

[0252] Coloring the plurality of left lung contour lines between in a respective manner, and displaying the plurality of left lung contour lines after coloring in a respective manner;

[0253] Clicking the endpoints of the plurality of left diaphragm movement point sequences on the displayed plurality of left lung contour lines in a respective manner, and determining the endpoints of the plurality of left diaphragm movement point sequences in a respective manner.

[0254] In embodiments of the present disclosure, the method of determining the plurality of right diaphragm movement point sequences according to the starting points of the plurality of right diaphragm movement point sequences and the candidate endpoints of the plurality of right diaphragm movement point sequences comprises: obtaining a second set step; calculating a plurality of second slope values corresponding to the starting points of the plurality of right diaphragm movement point sequences to the candidate endpoints of the plurality of right diaphragm movement point sequences based on the second set step; determining the endpoints of the plurality of right diaphragm movement point sequences according to the plurality of second slope values; or, determining the right lung contour line between the starting points of the plurality of right diaphragm movement point sequences and the candidate endpoints of the plurality of right diaphragm movement point sequences in a respective manner; and determining the endpoints of the plurality of right diaphragm movement point sequences in an interactive manner on the right lung contour line between.

[0255] In embodiments of the present disclosure and other possible embodiments, a person skilled in the art can configure the second set step according to actual needs. For example, the second set step can be configured as any value or other value between 1-10.

[0256] For example, in a first starting point (x2, y2) of the plurality of starting points corresponding to the plurality of right diaphragm movement point sequences, the second set step is configured as m, and the plurality of second slope values corresponding to the plurality of right diaphragm movement point sequences are respectively (y 2+m - y2) / [x 2+m - x2), (y2+2*m - y 2+m ) / [x 2+2*m - x 2+m ), ….

[0257] In embodiments of the present disclosure, the method of determining the endpoints of the plurality of right diaphragm movement point sequences according to the plurality of second slope values comprises: determining a candidate endpoint corresponding to a change in sign of the plurality of second slope values from positive to negative as the endpoint of the plurality of right diaphragm movement point sequences.

[0258] In embodiments of the present disclosure and other possible embodiments, the method of determining the endpoints of the plurality of right diaphragm movement point sequences respectively on the right lung profile lines in an interactive manner comprises: respectively configuring a plurality of the right lung profile lines between and displaying the plurality of right lung profile lines after the color configuration; and clicking the endpoints of the plurality of right diaphragm movement point sequences respectively on the displayed plurality of right lung profile lines to determine the endpoints of the plurality of right diaphragm movement point sequences respectively.

[0259] Step S104: determining the movement of the left diaphragm based on the plurality of left lung movement vertices and the plurality of left diaphragm movement point sequences, and determining the movement of the right diaphragm based on the plurality of right lung movement vertices and the plurality of right diaphragm movement point sequences.

[0260] In embodiments of the present disclosure and other possible embodiments, the method of determining the movement of the left diaphragm based on the plurality of left lung movement vertices and the plurality of left diaphragm movement point sequences comprises: respectively configuring the plurality of left lung movement vertices as left lung movement reference points; respectively calculating a plurality of first distances between each movement point in the plurality of left diaphragm movement point sequences and the left lung movement reference points based on the left lung movement reference points; or respectively displaying the plurality of left lung movement vertices in a first color line and the plurality of left diaphragm movement point sequences in a second color line.

[0261] In embodiments of the present disclosure and other possible embodiments, the method of determining the movement of the right diaphragm based on the plurality of right lung movement vertices and the plurality of right diaphragm movement point sequences comprises: respectively configuring the plurality of right lung movement vertices as right lung movement reference points; respectively calculating a plurality of second distances between each movement point in the plurality of right diaphragm movement point sequences and the right lung movement reference points based on the right lung movement reference points; or respectively displaying the plurality of right lung movement vertices in a first color line and the plurality of right diaphragm movement point sequences in a second color line.

[0262] In embodiments of the present disclosure and other possible embodiments, the method of displaying the plurality of left lung movement apices and the plurality of right lung movement apices in first color lines and displaying the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences in second color lines comprises: acquiring DR lung images corresponding to DR left lung images and DR right lung images at multiple moments in a breathing process; displaying the DR lung images corresponding to the DR left lung images and the DR right lung images at the multiple moments in the breathing process; and displaying the plurality of left lung movement apices and the plurality of right lung movement apices in first color lines and the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences in second color lines on the DR lung images corresponding to the DR left lung images and the DR right lung images at the multiple moments in the breathing process.

[0263] In embodiments of the present disclosure and other possible embodiments, the method of displaying the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences in second color lines further comprises: constructing a plurality of left lung diaphragm movement curves corresponding to the plurality of left lung diaphragm movement point sequences respectively, and configuring a movement point with the smallest slope of each left lung diaphragm movement curve in the plurality of left lung diaphragm movement curves as a left lung diaphragm movement point to be displayed at multiple moments in a breathing process; displaying the left lung diaphragm movement point to be displayed in second color lines; constructing a plurality of right lung diaphragm movement curves corresponding to the plurality of right lung diaphragm movement point sequences respectively, and configuring a movement point with the smallest slope of each right lung diaphragm movement curve in the plurality of right lung diaphragm movement curves as a right lung diaphragm movement point to be displayed at multiple moments in a breathing process; and displaying the right lung diaphragm movement point to be displayed in second color lines.

[0264] In embodiments of the present disclosure and other possible embodiments, the method of correcting the left lung diaphragm movement points to be displayed at multiple moments in a breathing process comprises: acquiring a plurality of left lung areas in the breathing process; obtaining a plurality of first coordinate points corresponding to a first set slope value of each left lung diaphragm movement curve in the plurality of left lung diaphragm movement curves respectively; sorting the plurality of first coordinate points corresponding to the first set slope value of each left lung diaphragm movement curve in ascending order of the ordinate; and correcting the left lung diaphragm movement points to be displayed at the multiple moments according to the plurality of left lung areas and the sorted plurality of first coordinate points.

[0265] In embodiments of the present disclosure and other possible embodiments, the method for correcting the to-be-displayed left lung diaphragm movement points at the multiple time points according to the multiple left lung areas and the sorted multiple first coordinate points comprises: determining the sorted multiple first coordinate points corresponding to the multiple left lung areas from the maximum area to the minimum area; wherein the vertical coordinate values of the sorted multiple first coordinate points corresponding to the multiple left lung areas from the maximum area to the minimum area are sequentially increased; if the vertical coordinates of the to-be-displayed left lung diaphragm movement points at the multiple time points corresponding to the multiple left lung areas from the maximum area to the minimum area are sequentially increased, the to-be-displayed left lung diaphragm movement points at the multiple time points are not corrected; otherwise, the movement points that are not increased among the to-be-displayed left lung diaphragm movement points at the multiple time points are corrected.

[0266] In embodiments of the present disclosure and other possible embodiments, the method for correcting the to-be-displayed right lung diaphragm movement points at the multiple time points in the breathing process comprises: acquiring multiple right lung areas in the breathing process; respectively determining multiple second coordinate points corresponding to a second set slope value of each right lung diaphragm movement curve in the multiple right lung diaphragm movement curves; sorting the multiple second coordinate points corresponding to the second set slope value of each right lung diaphragm movement curve in ascending order of vertical coordinates; and correcting the to-be-displayed right lung diaphragm movement points at the multiple time points according to the multiple right lung areas and the sorted multiple second coordinate points.

[0267] In embodiments of the present disclosure and other possible embodiments, the method for correcting the to-be-displayed right lung diaphragm movement points at the multiple time points according to the multiple right lung areas and the sorted multiple second coordinate points comprises: determining the sorted multiple second coordinate points corresponding to the multiple right lung areas from the maximum area to the minimum area; wherein the vertical coordinate values of the sorted multiple second coordinate points corresponding to the multiple right lung areas from the maximum area to the minimum area are sequentially increased; if the vertical coordinates of the to-be-displayed right lung diaphragm movement points at the multiple time points corresponding to the sorted multiple second coordinate points corresponding to the multiple right lung areas from the maximum area to the minimum area are sequentially increased, the to-be-displayed right lung diaphragm movement points at the multiple time points are not corrected; otherwise, the movement points that are not increased among the to-be-displayed right lung diaphragm movement points at the multiple time points are corrected.

[0268] In embodiments of the present disclosure and other possible embodiments, the method of displaying the plurality of left lung movement apices and the plurality of right lung movement apices in first color lines and displaying the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences in second color lines further includes: obtaining first configuration parameters corresponding to the first color lines; wherein the first configuration parameters include a first line length and a first line width; displaying the plurality of left lung movement apices and the plurality of right lung movement apices in the first color lines configured with the first configuration parameters; obtaining first configuration parameters corresponding to the second color lines; wherein the second configuration parameters include a second line length and a second line width; displaying the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences in the second color lines configured with the second configuration parameters. In the embodiments of the present disclosure, the first color is configured as red and the second color is configured as blue. In addition, the first color and the second color can be configured as lines of the same color. For example, the first color and the second color are configured as red, blue, or other colors.

[0269] Step S102: displaying the plurality of left lung movement apices and the plurality of right lung movement apices in first color lines and displaying the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences in second color lines.

[0270] In the embodiments of the present disclosure, the first color is configured as red and the second color is configured as blue. In the embodiments of the present disclosure and other possible embodiments, the first color and the second color can be configured as the same color. For example, the first color and the second color are configured as red, blue, or other colors.

[0271] In the embodiments of the present disclosure, the method of displaying the plurality of left lung movement apices and the plurality of right lung movement apices in first color lines and displaying the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences in second color lines includes: obtaining DR lung images corresponding to DR left lung images and DR right lung images at multiple moments in a breathing process; displaying the DR lung images corresponding to the DR left lung images and the DR right lung images at the multiple moments in the breathing process; displaying the plurality of left lung movement apices and the plurality of right lung movement apices in first color lines and displaying the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences in second color lines on the DR lung images corresponding to the DR left lung images and the DR right lung images at the multiple moments in the breathing process.

[0272] In the method for displaying the plurality of left diaphragm movement point sequences and the plurality of right diaphragm movement point sequences in the second color lines in the embodiments of the present disclosure, the method further comprises: constructing a plurality of left diaphragm movement curves corresponding to the plurality of left diaphragm movement point sequences respectively, and configuring a movement point with the smallest slope of each left diaphragm movement curve in the plurality of left diaphragm movement curves as a left diaphragm movement point to be displayed at a plurality of moments in the breathing process respectively; displaying the left diaphragm movement point to be displayed in the second color lines; constructing a plurality of right diaphragm movement curves corresponding to the plurality of right diaphragm movement point sequences respectively, and configuring a movement point with the smallest slope of each right diaphragm movement curve in the plurality of right diaphragm movement curves as a right diaphragm movement point to be displayed at a plurality of moments in the breathing process respectively; and displaying the right diaphragm movement point to be displayed in the second color lines.

[0273] In the embodiments of the present disclosure and other possible embodiments, the method for constructing the plurality of left diaphragm movement curves corresponding to the plurality of left diaphragm movement point sequences respectively comprises: acquiring the plurality of left diaphragm movement point sequences respectively; and performing curve fitting on the plurality of left diaphragm movement point sequences respectively to construct the plurality of left diaphragm movement curves corresponding to the plurality of left diaphragm movement point sequences. Meanwhile, in the embodiments of the present disclosure and other possible embodiments, the method for constructing the plurality of right diaphragm movement curves corresponding to the plurality of right diaphragm movement point sequences respectively comprises: acquiring the plurality of right diaphragm movement point sequences respectively; and performing curve fitting on the plurality of right diaphragm movement point sequences respectively to construct the plurality of right diaphragm movement curves corresponding to the plurality of right diaphragm movement point sequences.

[0274] In the embodiments of the present disclosure, the method for correcting the left diaphragm movement points to be displayed at the plurality of moments in the breathing process comprises: acquiring a plurality of left lung areas in the breathing process; obtaining a plurality of first coordinate points corresponding to a first set slope value of each left diaphragm movement curve in the plurality of left diaphragm movement curves respectively; sorting the plurality of first coordinate points corresponding to the first set slope value of each left diaphragm movement curve in ascending order of the ordinate; and correcting the left diaphragm movement points to be displayed at the plurality of moments according to the plurality of left lung areas and the plurality of first coordinate points sorted.

[0275] In the embodiments of the present disclosure and other possible embodiments, the first set slope value can be configured by a person skilled in the art according to actual needs. For example, the first set slope value can be configured as any value or other value between -0.2 and 0.

[0276] In the embodiments of the present disclosure, the method for correcting the to-be-displayed left lung diaphragm movement points at the plurality of time points according to the plurality of left lung areas and the plurality of first coordinate points in sequence comprises: determining the plurality of first coordinate points in sequence corresponding to the plurality of left lung areas from the maximum area to the minimum area; wherein the vertical coordinate values of the plurality of first coordinate points in sequence corresponding to the plurality of left lung areas from the maximum area to the minimum area are sequentially increased; if the vertical coordinates of the to-be-displayed left lung diaphragm movement points at the plurality of time points corresponding to the plurality of left lung areas from the maximum area to the minimum area are sequentially increased, the to-be-displayed left lung diaphragm movement points at the plurality of time points are not corrected; otherwise, the movement points that do not increase among the to-be-displayed left lung diaphragm movement points at the plurality of time points are corrected.

[0277] In the embodiments of the present disclosure and other possible embodiments, the method for correcting the movement points that do not increase among the to-be-displayed left lung diaphragm movement points at the plurality of time points comprises: extracting a first vertical coordinate corresponding to the movement points that do not increase among the plurality of to-be-displayed left lung diaphragm movement points at the plurality of time points, and second and third vertical coordinates corresponding to 2 adjacent to-be-displayed left lung diaphragm movement points at adjacent time points on both sides of the movement points that do not increase; in the plurality of first coordinate points in sequence, determining a first to-be-configured vertical coordinate corresponding to a vertical coordinate greater than the third vertical coordinate and less than the second vertical coordinate (or, a vertical coordinate greater than the second vertical coordinate and less than the third vertical coordinate); and configuring the first to-be-configured vertical coordinate and a horizontal coordinate corresponding thereto as the movement points that do not increase among the to-be-displayed left lung diaphragm movement points at the plurality of time points.

[0278] In the embodiments of the present disclosure, the method for correcting the to-be-displayed right lung diaphragm movement points at the plurality of time points in the breathing process comprises: obtaining a plurality of right lung areas in the breathing process; respectively determining a plurality of second coordinate points corresponding to a second set slope value of each right lung diaphragm movement curve in the plurality of right lung diaphragm movement curves; sorting the plurality of second coordinate points corresponding to the second set slope value of each right lung diaphragm movement curve in ascending order of vertical coordinates; and correcting the to-be-displayed right lung diaphragm movement points at the plurality of time points according to the plurality of right lung areas and the plurality of second coordinate points in sequence.

[0279] In the embodiments of the present disclosure and other possible embodiments, a person skilled in the art can configure the second set slope value according to actual needs. For example, the second set slope value can be configured as any value or other value between 0 and 0.2.

[0280] In the embodiments of the present disclosure, the method for correcting the to-be-displayed right lung diaphragm movement points at the plurality of time points according to the plurality of right lung areas and the plurality of second coordinate points in sequence comprises: determining the plurality of second coordinate points in sequence corresponding to the plurality of right lung areas from the maximum area to the minimum area; wherein the vertical coordinate values of the plurality of second coordinate points in sequence corresponding to the plurality of right lung areas from the maximum area to the minimum area are sequentially increased; if the vertical coordinates of the plurality of second coordinate points in sequence corresponding to the plurality of right lung areas from the maximum area to the minimum area are sequentially increased, the to-be-displayed right lung diaphragm movement points at the plurality of time points are not corrected; otherwise, the movement points that do not increase among the to-be-displayed right lung diaphragm movement points at the plurality of time points are corrected.

[0281] In the embodiments of the present disclosure and other possible embodiments, the method for correcting the movement points that do not increase among the to-be-displayed right lung diaphragm movement points at the plurality of time points comprises: extracting a first vertical coordinate corresponding to the movement points that do not increase among the plurality of to-be-displayed right lung diaphragm movement points at the plurality of time points, and second and third vertical coordinates corresponding to 2 adjacent to-be-displayed right lung diaphragm movement points at adjacent time points on both sides of the movement points that do not increase; in the plurality of first coordinate points in sequence, determining a second to-be-configured vertical coordinate greater than the third vertical coordinate and less than the second vertical coordinate (or greater than the second vertical coordinate and less than the third vertical coordinate); and configuring the second to-be-configured vertical coordinate and a horizontal coordinate corresponding thereto as the movement points that do not increase among the to-be-displayed right lung diaphragm movement points at the plurality of time points.

[0282] In the embodiments of the present disclosure, the method for displaying the plurality of left lung movement vertices and the plurality of right lung movement vertices in a first color line and displaying the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences in a second color line further comprises: obtaining first configuration parameters corresponding to the first color line; wherein the first configuration parameters comprise a first line length and a first line width; displaying the plurality of left lung movement vertices and the plurality of right lung movement vertices in the first color line configured with the first configuration parameters; obtaining first configuration parameters corresponding to the second color line; wherein the second configuration parameters comprise a second line length and a second line width; and displaying the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences in the second color line configured with the second configuration parameters.

[0283] In the embodiments of the present disclosure and other possible embodiments, a person skilled in the art can configure the first line length and the first line width, the second line length and the second line width according to actual needs.

[0284] In the embodiments and other possible embodiments of the present disclosure, the method for determining the lung field area of the DR image comprises: acquiring two-dimensional DR left lung images and / or two-dimensional DR right lung images at multiple moments in the breathing process; and determining left lung areas and / or right lung areas in the breathing process based on the two-dimensional DR left lung images and / or the two-dimensional DR right lung images at the multiple moments in the breathing process, respectively.

[0285] In the embodiments of the present disclosure, the method for determining the left lung areas and / or the right lung areas in the breathing process based on the two-dimensional DR left lung images and / or the two-dimensional DR right lung images at the multiple moments in the breathing process, respectively, comprises: acquiring a set area corresponding to a single pixel; counting the number of left lung pixels in the two-dimensional DR left lung images and / or the number of right lung pixels in the two-dimensional DR right lung images at the multiple moments in the breathing process, respectively; and calculating the left lung areas and / or the right lung areas corresponding to the number of left lung pixels in the two-dimensional DR left lung images and / or the number of right lung pixels in the two-dimensional DR right lung images at the multiple moments in the breathing process based on the set area, respectively.

[0286] In the embodiments and other possible embodiments of the present disclosure, the set area corresponding to a single pixel can be configured by a person skilled in the art according to actual needs.

[0287] In the embodiments of the present disclosure, the method for calculating the left lung areas and / or the right lung areas corresponding to the number of left lung pixels in the two-dimensional DR left lung images and / or the number of right lung pixels in the two-dimensional DR right lung images at the multiple moments in the breathing process based on the set area, respectively, comprises: multiplying the set area by the number of left lung pixels in the two-dimensional DR left lung images at the multiple moments in the breathing process to obtain the corresponding left lung areas in the breathing process; and / or multiplying the set area by the number of right lung pixels in the two-dimensional DR right lung images at the multiple moments in the breathing process to obtain the corresponding right lung areas in the breathing process.

[0288] The execution subject of the diaphragm movement display method can be a diaphragm movement display device, for example, the diaphragm movement display method can be executed by a terminal device or a server or other processing device, wherein the terminal device can be a user equipment (User Equipment, UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (Personal Digital Assistant, PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, etc. In some possible implementation manners, the diaphragm movement display method can be realized by a processor calling computer readable instructions stored in a memory.

[0289] Those skilled in the art can understand that, in the above diaphragm movement display method of the specific embodiment, the writing order of each step does not mean a strict execution order and does not constitute any limitation on the implementation process, and the specific execution order of each step should be determined according to its function and possible internal logic.

[0290] Figure 2 A block diagram of a diaphragm movement display device according to an embodiment of the present disclosure is shown as follows, Figure 2 As shown, the diaphragm movement display device comprises: an acquisition unit 101 configured to acquire a plurality of left lung movement apices and a plurality of right lung movement apices corresponding to DR left lung images and DR right lung images at multiple moments in a breathing process, and a plurality of left lung diaphragm movement point sequences and a plurality of right lung diaphragm movement point sequences corresponding to the DR left lung images and the DR right lung images at multiple moments in the breathing process; and a display unit 102 configured to display the plurality of left lung movement apices and the plurality of right lung movement apices in a first color line, and display the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences in a second color line.

[0291] In an embodiment of the present disclosure, the display unit comprises: a DR lung image acquisition unit, a DR lung image display unit, and a line display unit; the DR lung image acquisition unit is configured to acquire DR lung images corresponding to DR left lung images and DR right lung images at multiple moments in a breathing process; the DR lung image display unit is configured to display the DR lung images corresponding to the DR left lung images and the DR right lung images at multiple moments in the breathing process; and the line display unit is configured to display the plurality of left lung movement apices and the plurality of right lung movement apices in a first color line, and display a plurality of left lung diaphragm movement point sequences and a plurality of right lung diaphragm movement point sequences in a second color line on the DR lung images corresponding to the DR left lung images and the DR right lung images at multiple moments in the breathing process.

[0292] In an embodiment of the present disclosure, the line display unit comprises: a first slope determination unit, a left lung line display unit, a second slope determination unit, and a right lung line display unit; the first slope determination unit is configured to construct a plurality of left lung diaphragm movement curves corresponding to a plurality of left lung diaphragm movement point sequences respectively, and configure a movement point with the smallest slope of each left lung diaphragm movement curve in the plurality of left lung diaphragm movement curves as a to-be-displayed left lung diaphragm movement point at multiple moments in a breathing process; the left lung line display unit is configured to display the to-be-displayed left lung diaphragm movement point in the second color line; the second slope determination unit is configured to construct a plurality of right lung diaphragm movement curves corresponding to a plurality of right lung diaphragm movement point sequences respectively, and configure a movement point with the smallest slope of each right lung diaphragm movement curve in the plurality of right lung diaphragm movement curves as a to-be-displayed right lung diaphragm movement point at multiple moments in a breathing process; and the right lung line display unit is configured to display the to-be-displayed right lung diaphragm movement point in the second color line.

[0293] In the embodiments of the present disclosure, the correction unit also includes: a left lung area acquisition unit, a third slope determination unit, a first sorting unit, and a left diaphragm movement point correction unit; the left lung area acquisition unit is configured to acquire a plurality of left lung areas in a breathing process; the third slope determination unit is configured to respectively obtain a plurality of first coordinate points corresponding to a first set slope value of each left diaphragm movement curve in the plurality of left diaphragm movement curves; the first sorting unit is configured to sort the plurality of first coordinate points corresponding to the first set slope value of each left diaphragm movement curve in ascending order of the ordinate; and the left diaphragm movement point correction unit is configured to correct the left diaphragm movement points to be displayed at the plurality of time points according to the plurality of left lung areas and the plurality of sorted first coordinate points.

[0294] In the embodiments of the present disclosure, the left diaphragm movement point correction unit includes: a first determination unit and a first coordinate correction unit; the first determination unit is configured to determine the plurality of sorted first coordinate points corresponding to the plurality of left lung areas from the maximum area to the minimum area; wherein the ordinate values of the plurality of sorted first coordinate points corresponding to the plurality of left lung areas from the maximum area to the minimum area are sequentially increased; and the first coordinate correction unit is configured to, if the ordinate of the left diaphragm movement points to be displayed at the plurality of time points corresponding to the plurality of left lung areas from the maximum area to the minimum area is sequentially increased, not correct the left diaphragm movement points to be displayed at the plurality of time points; otherwise, correct the non-increasing movement points among the left diaphragm movement points to be displayed at the plurality of time points.

[0295] In the embodiments of the present disclosure, the correction unit also includes: a right lung area acquisition unit, a fourth slope determination unit, a second sorting unit, and a right diaphragm movement point correction unit; the right lung area acquisition unit is configured to acquire a plurality of right lung areas in a breathing process;

[0296] the fourth slope determination unit is configured to respectively obtain a plurality of second coordinate points corresponding to a second set slope value of each right diaphragm movement curve in the plurality of right diaphragm movement curves; the second sorting unit is configured to sort the plurality of second coordinate points corresponding to the second set slope value of each right diaphragm movement curve in ascending order of the ordinate; and the right diaphragm movement point correction unit is configured to correct the right diaphragm movement points to be displayed at the plurality of time points according to the plurality of right lung areas and the plurality of sorted second coordinate points.

[0297] In the embodiment of the present disclosure, the right lung diaphragm movement point correction unit comprises a second determination unit and a second coordinate correction unit; the second determination unit is configured to determine a plurality of second coordinate points corresponding to the plurality of right lung areas in order from the maximum area to the minimum area; the vertical coordinate values of the plurality of second coordinate points corresponding to the plurality of right lung areas in order from the maximum area to the minimum area are sequentially increased; the second coordinate correction unit is configured to, if the vertical coordinates of the plurality of right lung diaphragm movement points to be displayed at the plurality of moments are sequentially increased, not correct the plurality of right lung diaphragm movement points to be displayed at the plurality of moments; otherwise, correct the movement points that do not increase among the plurality of right lung diaphragm movement points to be displayed at the plurality of moments.

[0298] In the embodiment of the present disclosure, further comprising a segmentation unit; the segmentation unit is configured to, before obtaining the plurality of left lung movement vertices and the plurality of right lung movement vertices corresponding to the DR left lung images and the DR right lung images at the plurality of moments in the breathing process, and the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences corresponding to the DR left lung images and the DR right lung images at the plurality of moments in the breathing process, obtain the DR lung images at the plurality of moments in the breathing process, and segment the left lung and the right lung of the DR lung images to obtain the DR left lung images and the DR right lung images at the plurality of moments.

[0299] In the embodiment of the present disclosure, the segmentation unit comprises a detection unit; the detection unit is configured to, in the method of segmenting the left lung and the right lung of the DR lung images to obtain the DR left lung images and the DR right lung images, comprising: detecting the rib boundary, the lung apex boundary, and the mediastinum and transverse septum edge of the left chest image and the right chest image of the DR lung images at the plurality of moments in the breathing process respectively to obtain the DR left lung images and the DR right lung images at the plurality of moments; or, the segmentation unit comprises a segmentation model acquisition unit, a training unit, and an output unit; the segmentation model acquisition unit is configured to obtain a segmentation model of a preset convolutional neural network and a DR lung area label image used for training the segmentation model; the training unit is configured to train the segmentation model by using the DR lung area label image used for training the segmentation model; and the output unit is configured to complete the left lung and right lung segmentation of the DR lung images at the plurality of moments in the breathing process based on the trained segmentation model to obtain the DR left lung images and the DR right lung images at the plurality of moments.

[0300] In embodiments of the present disclosure, the segmentation unit further comprises a label image determination unit; the method for determining the DR lung region label image for training the segmentation model comprises: performing rib boundary, lung apex boundary, and mediastinum and diaphragm edge detection on left chest images and right chest images of a plurality of DR lung region images respectively to obtain DR lung region label images corresponding to the plurality of DR lung region images.

[0301] In embodiments of the present disclosure, further comprising: a third determination unit configured to determine, before the plurality of left lung motion peaks and the plurality of right lung motion peaks corresponding to the plurality of DR left lung images and the plurality of DR right lung images in the respiratory process and the plurality of left diaphragm motion point sequences and the plurality of right diaphragm motion point sequences corresponding to the plurality of DR left lung images and the plurality of DR right lung images in the respiratory process, a plurality of left lung motion peaks, a plurality of right lung motion peaks, a plurality of left diaphragm motion point sequences, and a plurality of right diaphragm motion point sequences corresponding to the plurality of DR left lung images and the plurality of DR right lung images in the respiratory process respectively.

[0302] In embodiments of the present disclosure, the third determination unit comprises a lung contour extraction unit and a motion point determination unit; the lung contour extraction unit is configured to extract a plurality of left lung contour lines and a plurality of right lung contour lines corresponding to the plurality of two-dimensional DR left lung images and the plurality of two-dimensional DR right lung images respectively; and the motion point determination unit is configured to determine a plurality of left lung motion peaks, a plurality of right lung motion peaks, a plurality of left diaphragm motion point sequences, and a plurality of right diaphragm motion point sequences corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively.

[0303] In embodiments of the present disclosure, the motion point determination unit comprises a lung apex determination unit; the lung apex determination unit is configured to detect a plurality of left lung apexes and a plurality of right lung apexes corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively, and configure coordinates of the plurality of left lung apexes and the plurality of right lung apexes as the plurality of left lung motion peaks and the plurality of right lung motion peaks respectively.

[0304] In embodiments of the present disclosure, the lung apex determination unit comprises a coordinate determination unit and a lung apex configuration unit. The coordinate determination unit determines a plurality of first maximum vertical coordinates and a plurality of second maximum vertical coordinates corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines, respectively. According to the plurality of first maximum vertical coordinates and the plurality of left lung contour lines, a plurality of first horizontal coordinates corresponding to the plurality of first maximum vertical coordinates are determined, respectively. According to the plurality of second maximum vertical coordinates and the plurality of right lung contour lines, a plurality of second horizontal coordinates corresponding to the plurality of second maximum vertical coordinates are determined, respectively. The lung apex configuration unit configures the plurality of first maximum vertical coordinates and the plurality of first horizontal coordinates corresponding thereto as a plurality of left lung apexes, respectively, and configures the plurality of second maximum vertical coordinates and the plurality of second horizontal coordinates corresponding thereto as a plurality of right lung apexes, respectively.

[0305] In embodiments of the present disclosure, the motion point determination unit further comprises a diaphragm motion starting point determination unit, a diaphragm motion candidate ending point determination unit, and a diaphragm motion ending point determination unit. The diaphragm motion starting point determination unit detects a plurality of left lung lowest points and a plurality of right lung lowest points corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines, respectively, and configures the plurality of left lung lowest points and the plurality of right lung lowest points as starting points of a plurality of left lung diaphragm motion point sequences and starting points of a plurality of right lung diaphragm motion point sequences, respectively. The diaphragm motion candidate ending point determination unit detects a plurality of left lung apexes and a plurality of right lung apexes corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines, respectively, and configures coordinates corresponding to the plurality of left lung apexes and the plurality of right lung apexes as candidate ending points of the plurality of left lung diaphragm motion point sequences and candidate ending points of the plurality of right lung diaphragm motion point sequences, respectively. The diaphragm motion ending point determination unit determines the plurality of left lung diaphragm motion point sequences according to the starting points of the plurality of left lung diaphragm motion point sequences and the candidate ending points of the plurality of left lung diaphragm motion point sequences, respectively, and determines the plurality of right lung diaphragm motion point sequences according to the starting points of the plurality of right lung diaphragm motion point sequences and the candidate ending points of the plurality of right lung diaphragm motion point sequences, respectively.

[0306] In embodiments of the present disclosure, the diaphragm movement endpoint determination unit comprises: a first step length acquisition unit and a first slope calculation unit; or, a left lung contour line determination unit and a first interaction unit; the first step length acquisition unit is configured to acquire a first set step length; the first slope calculation unit is configured to calculate a plurality of first slope values corresponding to the starting points of the plurality of left lung diaphragm movement point sequences to the candidate endpoints of the plurality of left lung diaphragm movement point sequences based on the first set step length; and determine the endpoints of the plurality of left lung diaphragm movement point sequences according to the plurality of first slope values; or, the left lung contour line determination unit is configured to determine the left lung contour line between the starting points of the plurality of left lung diaphragm movement point sequences and the candidate endpoints of the plurality of left lung diaphragm movement point sequences respectively; and the first interaction unit is configured to determine the endpoints of the plurality of left lung diaphragm movement point sequences on the left lung contour line in an interactive manner.

[0307] In embodiments of the present disclosure, the first slope calculation unit comprises a first judgment unit; the first judgment unit is configured to determine the candidate endpoints corresponding to the change of the sign of the plurality of first slope values from negative to positive as the endpoints of the plurality of left lung diaphragm movement point sequences.

[0308] In embodiments of the present disclosure, the diaphragm movement endpoint determination unit further comprises: a second step length acquisition unit and a second slope calculation unit; or, a right lung contour line determination unit and a second interaction unit; the second step length acquisition unit is configured to acquire a second set step length; the second slope calculation unit is configured to calculate a plurality of second slope values corresponding to the starting points of the plurality of right lung diaphragm movement point sequences to the candidate endpoints of the plurality of right lung diaphragm movement point sequences based on the second set step length; and determine the endpoints of the plurality of right lung diaphragm movement point sequences according to the plurality of second slope values; or, the right lung contour line determination unit is configured to determine the right lung contour line between the starting points of the plurality of right lung diaphragm movement point sequences and the candidate endpoints of the plurality of right lung diaphragm movement point sequences respectively; and the second interaction unit is configured to determine the endpoints of the plurality of right lung diaphragm movement point sequences on the right lung contour line in an interactive manner.

[0309] In embodiments of the present disclosure, the second slope calculation unit comprises a second judgment unit; the second judgment unit is configured to determine the candidate endpoints corresponding to the change of the sign of the plurality of second slope values from positive to negative as the endpoints of the plurality of right lung diaphragm movement point sequences.

[0310] In embodiments of the present disclosure, further comprising: a first configuration unit and a second configuration unit; the first configuration unit is configured to obtain first configuration parameters corresponding to the first color line; wherein the first configuration parameters comprise a first line length and a first line width; the display unit is configured to display the plurality of left lung movement apices and the plurality of right lung movement apices with the first configuration parameters configured by the first color line; the second configuration unit is configured to obtain first configuration parameters corresponding to the second color line; wherein the second configuration parameters comprise a second line length and a second line width; the display unit is configured to display the plurality of left diaphragm movement point sequences and the plurality of right diaphragm movement point sequences with the second configuration parameters configured by the second color line.

[0311] In embodiments of the present disclosure, the first color is configured as red and the second color is configured as blue.

[0312] In some embodiments, the apparatus provided by the embodiments of the present disclosure has functions or includes modules that can be used to perform the diaphragm movement display method described in the above diaphragm movement display method embodiments, and specific implementations can refer to the descriptions of the diaphragm movement display method embodiments above. For brevity, they will not be repeated here.

[0313] The embodiments of the present disclosure also propose a computer-readable storage medium having computer program instructions stored thereon, wherein the computer program instructions are executed by a processor to implement the above diaphragm movement display method. The computer-readable storage medium can be a non-volatile computer-readable storage medium.

[0314] The embodiments of the present disclosure also propose an electronic device, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the above diaphragm movement display method. Wherein the electronic device can be provided as a terminal, a server or other forms of equipment.

[0315] Figure 3 is a block diagram of an electronic device 800 according to an exemplary embodiment. For example, the electronic device 800 can be a terminal such as a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0316] Referring to Figure 3 , the electronic device 800 can include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0317] The processing component 802 generally controls the overall operations of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 can include one or more processors 820 to execute instructions to complete the steps of the methods described above, in whole or in part. Moreover, the processing component 802 can include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0318] The memory 804 is configured to store various types of data to support the operations of the electronic device 800. Examples of these data include instructions to operate any applications or methods on the electronic device 800, contact data, phonebook data, messages, pictures, videos, and the like. The memory 804 can be realized by any type of volatile or non-volatile storage devices or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disc, or optical disc.

[0319] The power component 806 provides power to the various components of the electronic device 800. The power component 806 can include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 800.

[0320] The multimedia component 808 includes a screen to provide an output interface between the electronic device 800 and a user. In some embodiments, the screen can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes the touch panel, the screen can be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense a touch, a slide, and a gesture on the touch panel. The touch sensor can not only sense a boundary of a touching or a sliding action, but also detect duration and pressure related to the touching or sliding action. In some embodiments, the multimedia component 808 includes a front camera and / or a back camera. The front camera and / or the back camera can receive external multimedia data when the electronic device 800 is in an operating mode, such as a shooting mode or a video mode. Each of the front camera and the back camera can be a fixed optical lens system or have a focal length and optical zoom capability.

[0321] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC) that is configured to receive an external audio signal when the electronic device 800 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0322] The I / O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which can include a keypad, a click wheel, buttons, and so on. The buttons can include, but are not limited to, a home button, a volume button, a start button, and a lock button.

[0323] The sensor component 814 includes one or more sensors for providing status assessments of various aspects of the electronic device 800. For example, the sensor component 814 can detect an open / closed position of the electronic device 800, relative positioning of components, such as a display and a keypad of the electronic device 800, a change of position of the electronic device 800 or a component of the electronic device 800, presence or absence of user contact with the electronic device 800, orientation or acceleration / deceleration of the electronic device 800, and temperature changes of the electronic device 800. The sensor component 814 can include an orientation sensor, an acceleration sensor, a proximity sensor, a gesture sensor, a gravity sensor, a biometric sensor, a temperature / humidity sensor, a light sensor, and an ultraviolet (UV) sensor, an electrical-nose (EN) sensor, or an infrared (IR) sensor. The sensor component 814 can also include an electronic nose (EN) sensor for measuring and identifying a particular odor, and an infrared (IR) sensor for measuring and identifying a particular heat pattern.

[0324] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as WiFi, 2G, or 3G, or a combination thereof. In an example embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcasting management system via a broadcast channel. In an example embodiment, the communication component 816 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technology.

[0325] In exemplary embodiments, the electronic device 800 can be implemented with one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic elements, for performing the above-described methods.

[0326] In exemplary embodiments, a non-transitory computer readable storage medium, such as the memory 804 including computer program instructions, is also provided, which can be executed by the processor 820 of the electronic device 800 to complete the above-described methods.

[0327] Figure 4 is a block diagram of an electronic device 1900 according to an exemplary embodiment. For example, the electronic device 1900 can be provided as a server. Referring to Figure 4 , the electronic device 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource represented by a memory 1932, for storing instructions, such as application programs, executable by the processing component 1922. The application programs stored in the memory 1932 can include one or more than one module each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute the instructions to perform the above-described methods.

[0328] The electronic device 1900 can also include a power supply component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input / output (I / O) interface 1958. The electronic device 1900 can operate based on an operating system stored in the memory 1932, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, or the like.

[0329] In exemplary embodiments, a non-transitory computer readable storage medium, such as the memory 1932 including computer program instructions, is also provided, which can be executed by the processing component 1922 of the electronic device 1900 to complete the above-described methods.

[0330] The present disclosure can be a system, a method, and / or a computer program product. The computer program product can include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present disclosure.

[0331] A computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. The computer readable program instructions described herein can be downloaded to your computer readable storage medium from a computer system or other device stored in a computer readable storage medium located elsewhere, through an network, for example, the Internet, a local area network, a wide area network and / or a wireless network. The network can comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and / or edge servers. A network adapter card or network interface in each computing / processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing / processing device.

[0332] Computer readable program instructions for carrying out operations of the present disclosure can be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer readable program instructions can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) can execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present disclosure.

[0333] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0334] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0335] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0336] The above-described embodiments of the present disclosure can be modified and changed many ways by those skilled in the art without departing from the scope and spirit of the described embodiments. The selection of terms to be used herein is intended to best explain the principles of the embodiments, practical application, or technical improvement over the technology found in the market, or to enable other ordinary skilled in the art to understand the embodiments disclosed herein.

Claims

1. A diaphragm motion display method characterized by comprising: The method comprises the following steps: acquiring a plurality of left lung movement peaks and a plurality of right lung movement peaks corresponding to DR left lung images and DR right lung images at multiple moments in a breathing process, and a plurality of left lung diaphragm movement point sequences and a plurality of right lung diaphragm movement point sequences corresponding to the DR left lung images and the DR right lung images at multiple moments in the breathing process; displaying the plurality of left lung movement peaks and the plurality of right lung movement peaks in a first color line, and displaying the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences in a second color line, which comprises the following steps: acquiring DR lung images corresponding to the DR left lung images and the DR right lung images at multiple moments in the breathing process; 2. The display method according to claim 1, wherein displaying the DR lung images corresponding to the DR left lung images and the DR right lung images at multiple moments in the breathing process; displaying the plurality of left lung movement peaks and the plurality of right lung movement peaks in a first color line, and displaying the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences in a second color line on the DR lung images corresponding to the DR left lung images and the DR right lung images at multiple moments in the breathing process; correcting the to-be-displayed left lung diaphragm movement points at multiple moments in the breathing process, which comprises the following steps: acquiring a plurality of left lung areas in the breathing process; acquiring a plurality of first coordinate points corresponding to a first set slope value of each left lung diaphragm movement curve in the plurality of left lung diaphragm movement curves corresponding to the plurality of left lung diaphragm movement point sequences; 3. The display method according to any one of claims 1 or 2, characterized by, sorting the plurality of first coordinate points corresponding to the first set slope value of each left lung diaphragm movement curve in ascending order of the ordinate; determining the plurality of first coordinate points in the sorted order corresponding to the plurality of left lung areas from the largest area to the smallest area; if the ordinate of the to-be-displayed left lung diaphragm movement points at multiple moments corresponding to the plurality of left lung areas from the largest area to the smallest area is sequentially increased, the to-be-displayed left lung diaphragm movement points at multiple moments are not corrected; otherwise, the movement points that do not increase among the to-be-displayed left lung diaphragm movement points at multiple moments are corrected. The method for displaying the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences in a second color line further comprises the following steps: respectively constructing a plurality of left lung diaphragm movement curves corresponding to the plurality of left lung diaphragm movement point sequences, and respectively configuring the movement point with the smallest slope in each left lung diaphragm movement curve as a to-be-displayed left lung diaphragm movement point at multiple moments in the breathing process; displaying the to-be-displayed left lung diaphragm movement points in the second color line; respectively constructing a plurality of right lung diaphragm movement curves corresponding to the plurality of right lung diaphragm movement point sequences, and respectively configuring the movement point with the smallest slope in each right lung diaphragm movement curve as a to-be-displayed right lung diaphragm movement point at multiple moments in the breathing process; displaying the to-be-displayed right lung diaphragm movement points in the second color line. The method for correcting the to-be-displayed right lung diaphragm movement points at multiple moments in the breathing process comprises the following steps: acquiring a plurality of right lung areas in the breathing process; acquiring a plurality of second coordinate points corresponding to a second set slope value of each right lung diaphragm movement curve in the plurality of right lung diaphragm movement curves corresponding to the plurality of right lung diaphragm movement point sequences; The second coordinate points corresponding to the second set slope value of each right diaphragm movement curve are sorted in ascending order according to the longitudinal coordinate; The right lung diaphragm movement points to be displayed at the plurality of time points are corrected according to the plurality of right lung areas and the sorted second coordinate points.

4. The display method according to claim 3, wherein The right lung diaphragm movement points to be displayed at the plurality of time points are corrected according to the plurality of right lung areas and the sorted second coordinate points, including: The sorted second coordinate points corresponding to the plurality of right lung areas from the largest area to the smallest area are determined; wherein the longitudinal coordinate values of the sorted second coordinate points corresponding to the plurality of right lung areas from the largest area to the smallest area are sequentially increased; If the longitudinal coordinates of the sorted second coordinate points corresponding to the plurality of right lung areas from the largest area to the smallest area are sequentially increased, the right lung diaphragm movement points to be displayed at the plurality of time points are not corrected; otherwise, the movement points that are not sequentially increased among the right lung diaphragm movement points to be displayed at the plurality of time points are corrected.

5. The display method according to any one of claims 1, 2, 4, wherein Before acquiring the plurality of left lung movement vertices and the plurality of right lung movement vertices corresponding to the DR left lung images and the DR right lung images at the plurality of time points in the breathing process, and the plurality of left diaphragm movement point sequences and the plurality of right diaphragm movement point sequences corresponding to the DR left lung images and the DR right lung images at the plurality of time points in the breathing process, the DR lung images at the plurality of time points in the breathing process are acquired, the left lung and the right lung of the DR lung images are segmented to obtain the DR left lung images and the DR right lung images at the plurality of time points.

6. The display method according to claim 5, wherein The left lung and the right lung of the DR lung images are segmented to obtain the DR left lung images and the DR right lung images at the plurality of time points, including: respectively detecting the costal margin boundary, the lung apex boundary, and the mediastinum and diaphragm edge of the left chest image and the right chest image of the DR lung images at the plurality of time points in the breathing process to obtain the DR left lung images and the DR right lung images at the plurality of time points; or, A segmentation model of a preset convolutional neural network and a DR lung region label image used for training the segmentation model are acquired; the segmentation model is trained by using the DR lung region label image used for training the segmentation model; and the left lung and the right lung of the DR lung images at the plurality of time points in the breathing process are segmented based on the trained segmentation model to obtain the DR left lung images and the DR right lung images at the plurality of time points.

7. The display method according to claim 6, wherein Before respectively detecting the costal margin boundary, the lung apex boundary, and the mediastinum and diaphragm edge of the left chest image and the right chest image of the DR lung images at the plurality of time points in the breathing process in the left lung and the right lung segmentation of the DR lung images to obtain the DR left lung images and the DR right lung images at the plurality of time points, the plurality of DR lung images at the plurality of time points are respectively subjected to chest cavity detection to obtain a plurality of corresponding chest cavity images. The left lung region and the right lung region of the chest cavity image are divided to obtain the left chest image and the right chest image of the DR lung images at the plurality of time points in the breathing process.

8. The display method according to claim 7, wherein The plurality of DR lung images at the plurality of time points are respectively subjected to chest cavity detection to obtain a plurality of corresponding chest cavity images, including: Calculate a plurality of first gradient amplitudes corresponding to a horizontal direction of each pixel point and a plurality of second gradient amplitudes of a vertical direction of each pixel point in the DR lung images at the plurality of time points respectively; Determine a plurality of total gradient amplitudes based on the plurality of first gradient amplitudes and the plurality of second gradient amplitudes; Integrate the plurality of first gradient amplitudes corresponding to the horizontal direction and the plurality of second gradient amplitudes of the vertical direction along the direction perpendicular to the direction, to obtain a plurality of first integral values and a plurality of second integral values; Integrate the plurality of total gradient amplitudes in two directions corresponding to the vertical direction and the horizontal direction, to obtain a plurality of third integral values and a plurality of fourth integral values; Calculate a plurality of first local maximum values corresponding to a plurality of first ratios, and calculate a plurality of first local minimum values and a plurality of second local minimum values corresponding to the plurality of first ratios and a plurality of second ratios; Determine a thoracic contour corresponding to a DR image to be processed according to the plurality of first local maximum values, the plurality of first local minimum values, the plurality of second local minimum values, and a thoracic feature; wherein the thoracic feature can configure a first segmentation position of a neck or a shoulder corresponding to a thoracic contour and a second segmentation position of both sides of the thoracic contour.

9. The display method according to any one of claims 1, 2, 4, 6-8, wherein, Before the plurality of left lung movement peaks and the plurality of right lung movement peaks corresponding to the DR left lung images and the DR right lung images at the plurality of time points in the respiratory process, and the plurality of left diaphragm movement point sequences and the plurality of right diaphragm movement point sequences corresponding to the DR left lung images and the DR right lung images at the plurality of time points in the respiratory process, respectively determine the plurality of left lung movement peaks, the plurality of right lung movement peaks, the plurality of left diaphragm movement point sequences and the plurality of right diaphragm movement point sequences corresponding to the DR left lung images and the DR right lung images at the plurality of time points, including: Extract a plurality of left lung contour lines and a plurality of right lung contour lines corresponding to the two-dimensional DR left lung images and the two-dimensional DR right lung images at the plurality of time points respectively; Determine a plurality of left lung movement peaks, a plurality of right lung movement peaks, a plurality of left diaphragm movement point sequences and a plurality of right diaphragm movement point sequences corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively.

10. The display method according to claim 9, wherein Determine a plurality of left lung movement peaks and a plurality of right lung movement peaks corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively, including: Determine a plurality of first maximum vertical coordinates and a plurality of second maximum vertical coordinates corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively; Determine a plurality of first horizontal coordinates corresponding to the plurality of first maximum vertical coordinates according to the plurality of first maximum vertical coordinates and the plurality of left lung contour lines respectively; Determine a plurality of second horizontal coordinates corresponding to the plurality of second maximum vertical coordinates according to the plurality of second maximum vertical coordinates and the plurality of right lung contour lines respectively; Configure the plurality of first maximum vertical coordinates and the plurality of first horizontal coordinates corresponding thereto as a plurality of left lung movement peaks respectively; Configure the plurality of second maximum vertical coordinates and the plurality of second horizontal coordinates corresponding thereto as a plurality of right lung movement peaks respectively.

11. The display method according to claim 9, wherein Determine a plurality of left diaphragm movement point sequences and a plurality of right diaphragm movement point sequences corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively, including: respectively, and the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences are respectively determined according to the starting points and the candidate terminal points of the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences. respectively, and the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences are respectively determined according to the starting points and the candidate terminal points of the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences. respectively, and the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences are respectively determined according to the starting points and the candidate terminal points of the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences.

12. The display method according to claim 11, wherein The method further comprises: obtaining a first preset step length; calculating a plurality of first slope values corresponding to the starting points of the plurality of left lung diaphragm movement point sequences to the candidate terminal points of the plurality of left lung diaphragm movement point sequences based on the first preset step length; determining the terminal points of the plurality of left lung diaphragm movement point sequences according to the plurality of first slope values; or determining a left lung contour line between the starting points of the plurality of left lung diaphragm movement point sequences and the candidate terminal points of the plurality of left lung diaphragm movement point sequences respectively; and determining the terminal points of the plurality of left lung diaphragm movement point sequences on the left lung contour line in an interactive manner respectively.

13. The display method according to claim 12, wherein The method further comprises: determining the candidate terminal points of the plurality of left lung diaphragm movement point sequences as the terminal points of the plurality of left lung diaphragm movement point sequences when the signs of the plurality of first slope values change from negative to positive.

14. The display method according to claim 11, wherein The method further comprises: obtaining a second preset step length; calculating a plurality of second slope values corresponding to the starting points of the plurality of right lung diaphragm movement point sequences to the candidate terminal points of the plurality of right lung diaphragm movement point sequences based on the second preset step length; determining the terminal points of the plurality of right lung diaphragm movement point sequences according to the plurality of second slope values; or determining a right lung contour line between the starting points of the plurality of right lung diaphragm movement point sequences and the candidate terminal points of the plurality of right lung diaphragm movement point sequences respectively; and determining the terminal points of the plurality of right lung diaphragm movement point sequences on the right lung contour line in an interactive manner respectively.

15. The display method according to claim 14, wherein The method further comprises: determining the candidate terminal points of the plurality of right lung diaphragm movement point sequences as the terminal points of the plurality of right lung diaphragm movement point sequences when the signs of the plurality of second slope values change from positive to negative.

16. The display method according to any one of claims 1, 2, 4, 6-8, 11-15, wherein, The first color line displays the plurality of left lung movement peaks and the plurality of right lung movement peaks, and the second color line displays the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences, and the method further comprises: obtaining first configuration parameters corresponding to the first color line; wherein the first configuration parameters comprise a first line length and a first line width; and displaying the plurality of left lung movement peaks and the plurality of right lung movement peaks by configuring the first color line with the first configuration parameters; and / or obtaining second configuration parameters corresponding to the second color line; wherein the second configuration parameters comprise a second line length and a second line width; and displaying the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences by configuring the second color line with the second configuration parameters; and / or the first color is red and the second color is blue.

17. A diaphragm movement display device, characterized by comprising: The method further comprises: obtaining a plurality of left lung movement peaks and a plurality of right lung movement peaks corresponding to DR left lung images and DR right lung images at multiple moments in a breathing process, and a plurality of left lung diaphragm movement point sequences and a plurality of right lung diaphragm movement point sequences corresponding to the DR left lung images and the DR right lung images at the multiple moments in the breathing process; displaying the plurality of left lung movement peaks and the plurality of right lung movement peaks by a first color line, and displaying the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences by a second color line; wherein the display unit comprises a DR lung image obtaining unit, a DR lung image display unit, and a line display unit; the DR lung image obtaining unit is configured to obtain DR lung images corresponding to DR left lung images and DR right lung images at multiple moments in a breathing process; the DR lung image display unit is configured to display the DR lung images corresponding to the DR left lung images and the DR right lung images at the multiple moments in the breathing process; and the line display unit is configured to display the plurality of left lung movement peaks and the plurality of right lung movement peaks by a first color line, and display the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences by a second color line on the DR lung images corresponding to the DR left lung images and the DR right lung images at the multiple moments in the breathing process. The line display unit comprises a first slope determination unit, a left lung line display unit, a second slope determination unit and a right lung line display unit; the first slope determination unit is configured to construct a plurality of left lung diaphragm movement curves corresponding to a plurality of left lung diaphragm movement point sequences respectively, and configure a movement point with the smallest slope of each left lung diaphragm movement curve in the plurality of left lung diaphragm movement curves as a left lung diaphragm movement point to be displayed at a plurality of moments in the breathing process; the left lung line display unit is configured to display the left lung diaphragm movement point to be displayed by using the second color line; the second slope determination unit is configured to construct a plurality of right lung diaphragm movement curves corresponding to a plurality of right lung diaphragm movement point sequences respectively, and configure a movement point with the smallest slope of each right lung diaphragm movement curve in the plurality of right lung diaphragm movement curves as a right lung diaphragm movement point to be displayed at a plurality of moments in the breathing process; and the right lung line display unit is configured to display the right lung diaphragm movement point to be displayed by using the second color line. The correction unit further comprises a left lung area acquisition unit, a third slope determination unit, a first sorting unit and a left lung diaphragm movement point correction unit; the left lung area acquisition unit is configured to acquire a plurality of left lung areas in the breathing process; the third slope determination unit is configured to obtain a plurality of first coordinate points corresponding to a first set slope value of each left lung diaphragm movement curve in the plurality of left lung diaphragm movement curves; the first sorting unit is configured to sort the plurality of first coordinate points corresponding to the first set slope value of each left lung diaphragm movement curve in ascending order of the ordinate; and the left lung diaphragm movement point correction unit is configured to correct the left lung diaphragm movement points to be displayed at the plurality of moments according to the plurality of left lung areas and the sorted plurality of first coordinate points. The left lung diaphragm movement point correction unit comprises a first determination unit and a first coordinate correction unit; the first determination unit is configured to determine the sorted plurality of first coordinate points corresponding to the plurality of left lung areas from the largest area to the smallest area; and the first coordinate correction unit is configured to not correct the left lung diaphragm movement points to be displayed at the plurality of moments if the ordinate of the left lung diaphragm movement points to be displayed at the plurality of moments corresponding to the plurality of left lung areas from the largest area to the smallest area increases in turn, or to correct the movement points not increasing among the left lung diaphragm movement points to be displayed at the plurality of moments.

18. The display device of claim 17, wherein, The correction unit further comprises a right lung area acquisition unit, a fourth slope determination unit, a second sorting unit and a right lung diaphragm movement point correction unit; The right lung area acquisition unit is configured to acquire a plurality of right lung areas in the breathing process; The fourth slope determination unit is configured to obtain a plurality of second coordinate points corresponding to a second set slope value of each right lung diaphragm movement curve in the plurality of right lung diaphragm movement curves; The second sorting unit is configured to sort the plurality of second coordinate points corresponding to the second set slope value of each right lung diaphragm movement curve in ascending order of the ordinate; and The right lung diaphragm movement point correction unit is configured to correct the right lung diaphragm movement points to be displayed at the plurality of moments according to the plurality of right lung areas and the sorted plurality of second coordinate points. The right lung diaphragm movement point correction unit is configured to correct the to-be-displayed right lung diaphragm movement points at the plurality of time points according to the plurality of right lung areas and the plurality of second coordinate points in sequence.

19. The display device of claim 18, wherein, The right lung diaphragm movement point correction unit comprises a second determination unit and a second coordinate correction unit. The second determination unit is configured to determine the plurality of second coordinate points in sequence corresponding to the plurality of right lung areas from the maximum area to the minimum area, wherein the vertical coordinate values of the plurality of second coordinate points in sequence corresponding to the plurality of right lung areas from the maximum area to the minimum area are sequentially increased. The second coordinate correction unit is configured to, if the vertical coordinates of the plurality of right lung diaphragm movement points at the plurality of time points are sequentially increased respectively according to the plurality of second coordinate points in sequence corresponding to the plurality of right lung areas from the maximum area to the minimum area, not correct the plurality of right lung diaphragm movement points at the plurality of time points; otherwise, correct the movement points that do not increase among the plurality of right lung diaphragm movement points at the plurality of time points.

20. A display device according to any one of claims 17-19, characterized in that Further comprising: a segmentation unit; The segmentation unit is configured to, before obtaining the plurality of left lung movement vertices and the plurality of right lung movement vertices corresponding to the DR left lung images and the DR right lung images at the plurality of time points in the breathing process and the plurality of left lung diaphragm movement point sequences and the plurality of right lung diaphragm movement point sequences corresponding to the DR left lung images and the DR right lung images at the plurality of time points in the breathing process, obtain the DR lung images at the plurality of time points in the breathing process, and segment the DR lung images to obtain the DR left lung images and the DR right lung images at the plurality of time points.

21. The display device of claim 20, wherein, The segmentation unit comprises a detection unit, and the detection unit is configured to, in the method of segmenting the DR lung images to obtain the DR left lung images and the DR right lung images at the plurality of time points, perform rib boundary, lung apex boundary, and mediastinum and transverse septum edge detection on left chest images and right chest images of the DR lung images at the plurality of time points in the breathing process respectively to obtain the DR left lung images and the DR right lung images at the plurality of time points; or, The segmentation unit comprises a segmentation model acquisition unit, a training unit, and an output unit; the segmentation model acquisition unit is configured to obtain a segmentation model of a preset convolutional neural network and a DR lung area label image used for training the segmentation model; the training unit is configured to train the segmentation model by using the DR lung area label image used for training the segmentation model; and the output unit is configured to complete left lung and right lung segmentation of the DR lung images at the plurality of time points in the breathing process based on the trained segmentation model to obtain the DR left lung images and the DR right lung images at the plurality of time points.

22. A display device according to any of claims 17-19, 21, characterized in that Further comprising: The third determination unit is configured to determine a plurality of left lung motion peaks, a plurality of right lung motion peaks, a plurality of left lung diaphragm motion point sequences and a plurality of right lung diaphragm motion point sequences corresponding to the DR left lung images and the DR right lung images at multiple time points respectively before the plurality of left lung motion peaks and the plurality of right lung motion peaks corresponding to the DR left lung images and the DR right lung images at multiple time points during the respiratory process and the plurality of left lung diaphragm motion point sequences and the plurality of right lung diaphragm motion point sequences corresponding to the DR left lung images and the DR right lung images at multiple time points during the respiratory process.

23. The display device of claim 22, wherein, The third determination unit comprises a lung contour extraction unit and a motion point determination unit. The lung contour extraction unit is configured to extract a plurality of left lung contour lines and a plurality of right lung contour lines corresponding to the two-dimensional DR left lung images and the two-dimensional DR right lung images at multiple time points respectively. The motion point determination unit is configured to determine a plurality of left lung motion peaks, a plurality of right lung motion peaks, a plurality of left lung diaphragm motion point sequences and a plurality of right lung diaphragm motion point sequences corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively.

24. The display device of claim 23, wherein, The motion point determination unit comprises a lung peak determination unit. The lung peak determination unit is configured to detect a plurality of left lung motion peaks and a plurality of right lung motion peaks corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively, and configure coordinates of the plurality of left lung motion peaks and the plurality of right lung motion peaks as the plurality of left lung motion peaks and the plurality of right lung motion peaks respectively.

25. The display device of claim 24, wherein, The lung peak determination unit comprises a coordinate determination unit and a lung peak configuration unit. The coordinate determination unit determines a plurality of first maximum longitudinal coordinates and a plurality of second maximum longitudinal coordinates corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively, determines a plurality of first transverse coordinates corresponding to the plurality of first maximum longitudinal coordinates according to the plurality of first maximum longitudinal coordinates and the plurality of left lung contour lines respectively, and determines a plurality of second transverse coordinates corresponding to the plurality of second maximum longitudinal coordinates according to the plurality of second maximum longitudinal coordinates and the plurality of right lung contour lines respectively. The lung peak configuration unit is configured to configure the plurality of first maximum longitudinal coordinates and the plurality of first transverse coordinates corresponding thereto as a plurality of left lung motion peaks respectively, and configure the plurality of second maximum longitudinal coordinates and the plurality of second transverse coordinates corresponding thereto as a plurality of right lung motion peaks respectively.

26. The display device of claim 24, wherein, The motion point determination unit further comprises a diaphragm motion starting point determination unit, a diaphragm motion candidate ending point determination unit and a diaphragm motion ending point determination unit. The diaphragm motion starting point determination unit is configured to detect a plurality of left lung lowest points and a plurality of right lung lowest points corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively, and configure the plurality of left lung lowest points and the plurality of right lung lowest points as starting points of the plurality of left lung diaphragm motion point sequences and starting points of the plurality of right lung diaphragm motion point sequences respectively. The diaphragm movement candidate endpoint determination unit is configured to detect a plurality of left lung movement peaks and a plurality of right lung movement peaks corresponding to the plurality of left lung contour lines and the plurality of right lung contour lines respectively, and configure coordinates corresponding to the plurality of left lung movement peaks and the plurality of right lung movement peaks as candidate endpoints of a plurality of left lung diaphragm movement point sequences and a plurality of right lung diaphragm movement point sequences respectively. The diaphragm movement endpoint determination unit is configured to determine the plurality of left lung diaphragm movement point sequences according to the start points of the plurality of left lung diaphragm movement point sequences and the candidate endpoints of the plurality of left lung diaphragm movement point sequences respectively, and determine the plurality of right lung diaphragm movement point sequences according to the start points of the plurality of right lung diaphragm movement point sequences and the candidate endpoints of the plurality of right lung diaphragm movement point sequences respectively.

27. The display device of claim 26, wherein, The diaphragm movement endpoint determination unit comprises a first step length acquisition unit and a first slope calculation unit, or a left lung contour line determination unit and a first interaction unit. The first step length acquisition unit is configured to acquire a first set step length, and the first slope calculation unit is configured to calculate a plurality of first slope values corresponding to the start points of the plurality of left lung diaphragm movement point sequences to the candidate endpoints of the plurality of left lung diaphragm movement point sequences respectively based on the first set step length, and determine the endpoints of the plurality of left lung diaphragm movement point sequences according to the plurality of first slope values, or The left lung contour line determination unit is configured to determine left lung contour lines between the start points of the plurality of left lung diaphragm movement point sequences and the candidate endpoints of the plurality of left lung diaphragm movement point sequences respectively, and the first interaction unit is configured to determine the endpoints of the plurality of left lung diaphragm movement point sequences on the left lung contour lines in an interactive manner.

28. The display device of claim 27, wherein, The first slope calculation unit comprises a first judgment unit. The first judgment unit is configured to determine the candidate endpoints corresponding to the sign of the plurality of first slope values changing from negative to positive as the endpoints of the plurality of left lung diaphragm movement point sequences.

29. The display device of claim 27, wherein, The diaphragm movement endpoint determination unit further comprises a second step length acquisition unit and a second slope calculation unit, or a right lung contour line determination unit and a second interaction unit. The second step length acquisition unit is configured to acquire a second set step length, and the second slope calculation unit is configured to calculate a plurality of second slope values corresponding to the start points of the plurality of right lung diaphragm movement point sequences to the candidate endpoints of the plurality of right lung diaphragm movement point sequences respectively based on the second set step length, and determine the endpoints of the plurality of right lung diaphragm movement point sequences according to the plurality of second slope values, or The right lung contour line determination unit is configured to determine right lung contour lines between the start points of the plurality of right lung diaphragm movement point sequences and the candidate endpoints of the plurality of right lung diaphragm movement point sequences respectively, and the second interaction unit is configured to determine the endpoints of the plurality of right lung diaphragm movement point sequences on the right lung contour lines in an interactive manner.

30. The display device of claim 29, wherein, The second slope calculation unit comprises a second judgment unit. The second judgment unit is configured to determine the candidate endpoints corresponding to the sign of the plurality of second slope values changing from positive to negative as the endpoints of the plurality of right lung diaphragm movement point sequences.

31. The display device of any one of claims 17-19, 21, 23-30, wherein, Further comprising The first configuration unit and / or the second configuration unit; The first configuration unit is configured to acquire first configuration parameters corresponding to the first color lines; the first configuration parameters include a first line length and a first line width; the display unit is configured to display the plurality of left lung movement apices and the plurality of right lung movement apices in the first color lines configured with the first configuration parameters; and / or The second configuration unit is configured to acquire second configuration parameters corresponding to the second color lines; the second configuration parameters include a second line length and a second line width; the display unit is configured to display the plurality of left diaphragm movement point sequences and the plurality of right diaphragm movement point sequences in the second color lines configured with the second configuration parameters; and / or The first color is red and the second color is blue.

32. An electronic device, comprising: The computer program instructions are executed by the processor to implement the diaphragm movement display method in any one of claims 1 to 16. The computer program instructions are executed by the processor to implement the diaphragm movement display method in any one of claims 1 to 16. ​ 33. A computer-readable storage medium having stored thereon computer program instructions, wherein, ​

Images