Middle sperm morphological defect analysis method, electronic equipment and storage medium

Abstract

The invention provides a sperm midsection morphological defect analysis method, electronic equipment and a storage medium, and the method comprises the following steps: carrying out the semantic segmentation of a dyeing image containing a sperm head and a midsection through a semantic segmentation network, and obtaining a binary segmentation result marked with the sperm head and the sperm midsection; fitting the sperm head into an ellipse according to the obtained binary segmentation result of the sperm head, and solving a long axis endpoint connected with the middle section of the sperm; refining the obtained binary segmentation result of the middle section of the sperm to obtain a middle section center line; and calculating sperm midsection morphological characteristics, and identifying sperm midsection morphological defects. The method can quantitatively calculate the characteristic result, is high in interpretability, does not need to depend on professional knowledge and experience of doctors or researchers, and improves the accuracy and efficiency of sperm midsection morphological defect recognition.

Description

Technical Field

[0001] The present invention relates to the technical field of image recognition, and in particular to a sperm mid-section morphological defect analysis method, electronic equipment and storage medium. Background Art

[0002] Up to 15% of couples of childbearing age face infertility problems worldwide, and male infertility accounts for more than half of infertility cases. Sperm problems, including insufficient or low sperm count, and abnormal sperm morphology and motility, are one of the most common causes of male infertility. Sperm morphology analysis is a key examination that evaluates sperm quality by evaluating the number, morphology, and motility of sperm through a detailed analysis of semen. In this process, the midsection of sperm plays a vital role. The midsection of sperm is rich in mitochondria, which can provide energy by metabolizing nutrients. They are actually one of the "engines" of sperm movement. Therefore, the accurate identification of sperm midsection morphology plays a vital role in male fertility assessment and reproductive health.

[0003] At present, the identification of sperm midsection morphology in the medical field mainly relies on manual interpretation by doctors. However, due to the different experiences and subjective judgments of different doctors, there are often certain differences in the results, which makes the reproducibility of the interpretation results poor. In addition, manual interpretation is time-consuming and expensive. Current research literature mainly focuses on automatic assisted analysis of sperm heads, while the automatic identification of sperm midsection morphological defects is still an urgent problem to be solved. Therefore, it is urgent to research and develop automated methods to improve the accuracy and efficiency of sperm midsection morphological defects identification. Summary of the invention

[0004] In order to achieve the above-mentioned purpose and other advantages of the present invention, the first purpose of the present invention is to provide a method for analyzing sperm midpiece morphological defects, comprising the following steps:

[0005] The stained image containing the sperm head and the mid-segment is semantically segmented through a semantic segmentation network to obtain a binary segmentation result marked with the sperm head and the sperm mid-segment;

[0006] The sperm head is fitted into an ellipse by using the binary segmentation result of the sperm head, and the endpoint of the long axis connected to the sperm midsection is obtained;

[0007] The binary segmentation result of the sperm midsection is refined to obtain the midsection centerline;

[0008] Calculate sperm midpiece morphological characteristics and identify sperm midpiece morphological defects.

[0009] Furthermore, the semantic segmentation of the stained image containing the sperm head and midsection by the semantic segmentation network includes overall segmentation of the entire sperm in the stained image, and then finally obtaining the segmentation result of the sperm midsection area by subtracting the pixels of the head segmentation result.

[0010] Furthermore, the method of obtaining the endpoint of the long axis connected to the midsection of the sperm includes obtaining the two endpoints of the long axis of the fitted ellipse, taking each endpoint as the center of the circle and n times the long axis of the ellipse as the radius, drawing a circle in the binary segmentation result of the midsection of the sperm, calculating the sum of the values ​​inside the circle that are 1, and the center of the circle where the larger value is located is the connection point between the long axis of the fitted ellipse of the sperm head and the midsection.

[0011] Furthermore, the calculation of sperm mid-piece morphological characteristics and identification of sperm mid-piece morphological defects comprises the following steps:

[0012] Obtain the linear fitting coefficient based on the center line of the middle section to determine whether it is a sharp bend;

[0013] Based on the up and down translation of the major axis position of the fitted ellipse, calculate the area ratio of the overlapping area between the middle section and the parallel line after the up and down translation of the major axis, determine whether the center line of the middle section close to the end point of the head is within the range of the parallel lines, and determine whether there is asymmetry or angled insertion;

[0014] The ratio of the average width of the midsection to the length of the minor axis of the head fitting ellipse was calculated to determine whether it was abnormally thick or thin.

[0015] Further, obtaining a linear fitting coefficient based on the center line of the middle section and determining whether there is a sharp bend comprises the following steps:

[0016] Based on the center line of the middle section, a linear fitting is performed using a first-order polynomial fitting method to obtain a linear fitting coefficient;

[0017] If the linear fitting coefficient is less than the first preset value, it is determined that the sperm midsection is not sharply bent;

[0018] If the linear fitting coefficient is greater than the second preset value, it is determined that the midsection of the sperm is sharply bent.

[0019] Furthermore, the up and down translation of the major axis position based on the fitted ellipse includes translating the position of the major axis of the sperm head fitted ellipse upward and downward by preset pixel positions respectively to produce two parallel lines.

[0020] Furthermore, the calculation of the ratio of the overlapping area between the middle section and the parallel lines after the long axis is translated up and down includes calculating the ratio of the overlapping area between the two parallel lines and the middle section to the area of ​​the entire middle section;

[0021] The determining whether the endpoint of the middle section center line close to the head is within the range of parallel lines includes calculating the endpoint of the center line close to the head based on the middle section center line, and determining whether it is in the middle of the parallel lines translated up and down;

[0022] The calculation of the centerline endpoint close to the head includes obtaining each endpoint of the centerline of the middle section, and calculating the distance from the point closer to the middle section with the major axis of the sperm head fitting ellipse. The smaller the calculated distance is, the closer the endpoint of the centerline of the middle section is to the head.

[0023] The determination of whether there is asymmetry or angled insertion comprises the following steps:

[0024] If the ratio of the overlapping area of ​​the middle section within the two parallel lines to the overall middle section area is less than a third preset value, it is determined that there is an asymmetric or angled insertion;

[0025] If the ratio of the overlapping area of ​​the middle section within the two parallel lines to the overall middle section area is greater than a fourth preset value, it is determined that there is no asymmetry or angled insertion;

[0026] If the calculated endpoint of the center line near the head is outside the parallel lines of the upper and lower translations, it is determined that there is an asymmetric or angled insertion;

[0027] If the calculated endpoint of the center line near the head is in the middle of the parallel lines translated up and down, it is determined that there is no asymmetry or angled insertion.

[0028] Further, the calculating the ratio of the average width of the middle section to the length of the minor axis of the head fitting ellipse includes calculating the length of the center line based on the center line of the middle section, calculating the area of ​​the result of dividing the middle section, obtaining the average width of the middle section, and finally calculating the ratio of the average width of the middle section to the length of the minor axis of the head fitting ellipse;

[0029] The determination of whether the sample is abnormally thick or abnormally thin comprises the following steps:

[0030] If the ratio of the calculated average width of the midsection to the length of the minor axis of the head fitting ellipse is greater than a fifth preset value, the sperm midsection is determined to be abnormally thick;

[0031] If the ratio of the calculated average width of the midsection to the length of the minor axis of the head fitting ellipse is less than a sixth preset value, it is determined that the sperm midsection is abnormally thin.

[0032] The second object of the present invention is to provide an electronic device, comprising: a memory on which a program code is stored; a processor, which is connected to the memory and implements a method for analyzing sperm midsection morphological defects when the program code is executed by the processor.

[0033] The third object of the present invention is to provide a computer-readable storage medium having program instructions stored thereon, which implement a method for analyzing sperm midpiece morphological defects when the program instructions are executed.

[0034] Compared with the prior art, the present invention has the following beneficial effects:

[0035] The present invention provides a sperm midsection morphological defect analysis method, electronic device and storage medium, which can quantitatively calculate characteristic results, have strong interpretability, do not need to rely on the professional knowledge and experience of doctors or researchers, and improve the accuracy and efficiency of sperm midsection morphological defect identification.

[0036] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention and implement it according to the contents of the specification, the following is a detailed description of the preferred embodiments of the present invention in conjunction with the accompanying drawings. The specific implementation of the present invention is given in detail by the following embodiments and their accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0038] Figure 1 A flow chart of a sperm midpiece morphological defect analysis method according to Example 1;

[0039] Figure 2 The flowchart of sperm mid-piece morphological characteristics calculation in Example 1;

[0040] Figure 3 This is a diagram showing the effect of the long axis moving up and down in Example 1;

[0041] Figure 4 is a schematic diagram of an electronic device of Example 2;

[0042] Figure 5 This is a schematic diagram of the storage medium of Example 3. DETAILED DESCRIPTION

[0043] The present invention is further described below in conjunction with the accompanying drawings and specific implementation methods. It should be noted that, under the premise of no conflict, the various embodiments or technical features described below can be arbitrarily combined to form a new embodiment.

[0044] Example 1

[0045] A method for analyzing sperm midsection morphological defects, by quantitatively calculating the midsection morphological characteristics, determines whether there is a morphological defect in the sperm midsection, such as Figure 1 As shown, the following steps are included:

[0046] S1. Perform semantic segmentation on the stained image containing the sperm head and the middle section through the semantic segmentation network to obtain a binary segmentation result marked with the sperm head and the sperm middle section. In order to solve the problem of target segmentation under multi-scale, this embodiment uses the trained DeeplabV3+ network to perform semantic segmentation on the stained image containing the sperm head and the middle section.

[0047] In order to ensure the integrity of the segmentation result of the connection between the sperm midsection and the head, the entire sperm is first segmented as a whole, and then the pixels of the head segmentation result are subtracted to finally obtain the segmentation result of the sperm midsection area.

[0048] S2. Fit the sperm head into an ellipse by the binary segmentation result of the sperm head, and find the endpoint of the long axis connected to the sperm midsection; specifically, find the two endpoints of the long axis of the fitted ellipse, take each endpoint as the center of the circle, and n times the long axis of the ellipse as the radius, draw a circle in the binary segmentation result of the sperm midsection, calculate the sum of the values ​​in the circle that are 1, and the center of the circle where the larger value is located is the connection point between the long axis of the sperm head fitting ellipse and the midsection. In practical applications, n can be 1 / 3.

[0049] S3, refining the binary segmentation result of the sperm midsection to obtain the midsection centerline;

[0050] S4. Calculate the morphological characteristics of the sperm midpiece and identify sperm midpiece morphological defects, including abnormal thickness, abnormal thinness, asymmetric or angled insertion or sharp bending in the head.

[0051] This embodiment provides four features for quantitatively describing the above problems, namely, the linear fitting coefficient of the middle section centerline, the proportion of the overlapping area between the parallel lines after the major axis of the head fitting ellipse is translated up and down, the position judgment of the endpoint of the middle section centerline close to the head, and the ratio of the middle section width to the minor axis length of the head fitting ellipse.

[0052] like Figure 2 As shown, calculating sperm midpiece morphological characteristics and identifying sperm midpiece morphological defects include the following steps:

[0053] Calculate the linear fitting coefficient based on the center line of the middle section to determine whether it is a sharp bend; specifically, the following steps are included:

[0054] Based on the center line of the middle section, a linear fitting is performed using a first-order polynomial fitting method to obtain a linear fitting coefficient;

[0055] If the linear fitting coefficient is less than the first preset value (in this embodiment, the linear fitting coefficient is very small), it is determined that the sperm midsection is not sharply bent;

[0056] If the linear fitting coefficient is greater than the second preset value (in this embodiment, the linear fitting coefficient is very large), it is determined that the midsection of the sperm is sharply bent.

[0057] Based on the up and down translation of the major axis position of the fitted ellipse, calculate the area ratio of the overlapping area between the middle section and the parallel line after the up and down translation of the major axis, determine whether the center line of the middle section close to the end point of the head is within the range of the parallel lines, and determine whether there is asymmetry or angled insertion;

[0058] The upward and downward translation based on the long axis position of the fitted ellipse includes translating the long axis position of the sperm head fitted ellipse upward and downward by preset pixel (Δ pixel) positions to produce two parallel lines.

[0059] Calculating the ratio of the overlapping area between the middle section and the parallel lines after the long axis is translated up and down includes calculating the ratio of the overlapping area between the two parallel lines and the middle section to the overall area of ​​the middle section; Figure 3 As shown, the overall width between parallel lines is 2×Δ. In practical applications, Δ can be 0.2 times the width of the minor axis of the fitted ellipse.

[0060] Determining whether the endpoint of the middle section center line close to the head is within the range of parallel lines includes calculating the endpoint of the center line close to the head based on the middle section center line, and determining whether it is in the middle of the parallel lines translated up and down;

[0061] The calculation of the centerline endpoint close to the head includes obtaining the endpoints of the centerline of the middle section, and calculating the distance from the point closer to the middle section to the major axis of the sperm head fitting ellipse. The smaller the calculated distance is, the closer the endpoint of the centerline of the middle section is to the head.

[0062] The above-mentioned determination of whether there is asymmetry or angled insertion comprises the following steps:

[0063] If the ratio of the overlapping area of ​​the middle section within the two parallel lines to the overall area of ​​the middle section is less than a third preset value (in this embodiment, the ratio of the overlapping area of ​​the middle section within the two parallel lines to the overall area of ​​the middle section is small), it is determined that there is an asymmetric or angled insertion;

[0064] If the ratio of the overlapping area with the middle section within the two parallel lines to the overall area of ​​the middle section is greater than a fourth preset value (in this embodiment, the ratio of the overlapping area with the middle section within the two parallel lines to the overall area of ​​the middle section is greater), it is determined that there is no asymmetry or angled insertion;

[0065] If the calculated endpoint of the center line near the head is outside the parallel lines translated up and down, it is determined that there is an asymmetric or angled insertion;

[0066] If the calculated endpoint of the center line near the head is in the middle of the parallel lines translated up and down, it is determined that there is no asymmetry or angled insertion.

[0067] Calculate the ratio of the average width of the middle section to the length of the minor axis of the head fitting ellipse to determine whether it is abnormally thick or abnormally thin. Specifically, the following steps are included:

[0068] The length of the centerline is calculated based on the centerline of the middle section, the area of ​​the segmented middle section is calculated, the average width of the middle section is obtained, and finally the ratio of the average width of the middle section to the length of the minor axis of the head fitting ellipse is calculated;

[0069] If the ratio of the calculated average width of the middle section to the length of the minor axis of the head fitting ellipse is greater than a fifth preset value (in this embodiment, the ratio of the calculated average width of the middle section to the length of the minor axis of the head fitting ellipse is larger), it is determined that the sperm middle section is abnormally thick;

[0070] If the ratio of the calculated average width of the middle section to the length of the minor axis of the head fitting ellipse is less than the sixth preset value (in this embodiment, the ratio of the calculated average width of the middle section to the length of the minor axis of the head fitting ellipse is smaller), it is determined that the sperm midsection is abnormally thin.

[0071] In clinical applications, the linear fitting coefficient of the middle section center line, the area ratio of the overlapping area between parallel lines after the long axis of the head fitting ellipse is translated up and down, and the ratio of the middle section width to the short axis length of the head fitting ellipse can be combined and quantitatively analyzed by setting specific thresholds based on the actual collected data, which has strong interpretability.

[0072] The present invention provides a method for analyzing sperm midsection morphological defects, which can quantitatively calculate characteristic results, has strong interpretability, does not need to rely on the professional knowledge and experience of doctors or researchers, and improves the accuracy and efficiency of sperm midsection morphological defect identification.

[0073] Example 2

[0074] An electronic device, such as Figure 4 As shown, it includes: a memory on which program codes are stored; a processor connected to the memory, and when the program codes are executed by the processor, a method for analyzing sperm mid-segment morphological defects is implemented. For a detailed description of the method, reference can be made to the corresponding description in the above method embodiment, which will not be repeated here.

[0075] Example 3

[0076] A computer readable storage medium such as Figure 5 As shown, program instructions are stored thereon, and when the program instructions are executed, a method for analyzing sperm mid-section morphological defects is implemented. For a detailed description of the method, reference may be made to the corresponding description in the above method embodiment, and no further description is given here.

[0077] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0078] The various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referenced to each other, and each embodiment focuses on the differences from other embodiments.

[0079] The above are only embodiments of this specification and are not intended to limit one or more embodiments of this specification. For those skilled in the art, one or more embodiments of this specification may have various changes and modifications. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of one or more embodiments of this specification shall be included in the scope of the claims of one or more embodiments of this specification.

Claims

1. A method for analyzing sperm midpiece morphological defects, characterized in that: The following steps are involved: The stained image containing the sperm head and the mid-segment is semantically segmented through a semantic segmentation network to obtain a binary segmentation result marked with the sperm head and the sperm mid-segment; The sperm head is fitted into an ellipse by using the binary segmentation result of the sperm head, and the endpoint of the long axis connected to the sperm midsection is obtained; The binary segmentation result of the sperm midsection is refined to obtain the midsection centerline; Calculate sperm midpiece morphological characteristics and identify sperm midpiece morphological defects.

2. A method for analyzing sperm midpiece morphological defects as claimed in claim 1, characterized in that: The semantic segmentation of the stained image containing the sperm head and midsection by using a semantic segmentation network includes overall segmentation of the entire sperm in the stained image, and then finally obtaining the segmentation result of the sperm midsection area by subtracting the pixels of the head segmentation result.

3. A method for analyzing sperm midpiece morphological defects as claimed in claim 1, characterized in that: The method of obtaining the endpoint of the long axis connected to the midsection of the sperm includes obtaining the two endpoints of the long axis of the fitted ellipse, taking each endpoint as the center of the circle and n times the long axis of the ellipse as the radius, drawing a circle in the binary segmentation result of the midsection of the sperm, calculating the sum of the values ​​in the circle that are 1, and the center of the circle where the larger value is located is the connection point between the long axis of the fitted ellipse of the sperm head and the midsection.

4. A method for analyzing sperm midpiece morphological defects as claimed in claim 1 or 3, characterized in that: The method of calculating the sperm mid-piece morphological characteristics and identifying the sperm mid-piece morphological defects comprises the following steps: Obtain the linear fitting coefficient based on the center line of the middle section to determine whether it is a sharp bend; Based on the up and down translation of the major axis position of the fitted ellipse, calculate the area ratio of the overlapping area between the middle section and the parallel line after the up and down translation of the major axis, determine whether the center line of the middle section close to the end point of the head is within the range of the parallel lines, and determine whether there is asymmetry or angled insertion; The ratio of the average width of the midsection to the length of the minor axis of the head fitting ellipse was calculated to determine whether it was abnormally thick or thin.

5. A method for analyzing sperm midpiece morphological defects as claimed in claim 4, characterized in that: The method of obtaining a linear fitting coefficient based on the center line of the middle section and determining whether there is a sharp bend comprises the following steps: Based on the center line of the middle section, a linear fitting is performed using a first-order polynomial fitting method to obtain a linear fitting coefficient; If the linear fitting coefficient is less than the first preset value, it is determined that the sperm midsection is not sharply bent; If the linear fitting coefficient is greater than the second preset value, it is determined that the midsection of the sperm is sharply bent.

6. A method for analyzing sperm midpiece morphological defects as claimed in claim 4, characterized in that: The upward and downward translation of the major axis position based on the fitted ellipse includes translating the position of the major axis of the sperm head fitting ellipse upward and downward respectively by preset pixel positions to produce two parallel lines.

7. A method for analyzing sperm midpiece morphological defects as claimed in claim 6, characterized in that: The calculation of the ratio of the overlapping area between the middle section and the parallel lines after the long axis is translated up and down includes calculating the ratio of the overlapping area between the two parallel lines and the middle section to the overall area of ​​the middle section; The determining whether the endpoint of the middle section center line close to the head is within the range of parallel lines includes calculating the endpoint of the center line close to the head based on the middle section center line, and determining whether it is in the middle of the parallel lines translated up and down; The step of calculating the endpoints of the center line close to the head includes obtaining the endpoints of the center line of the middle section, and calculating the distance from the point closer to the middle section to the major axis of the sperm head fitting ellipse. The smaller the calculated distance is, the closer the endpoint of the center line of the middle section is to the head. The determination of whether there is asymmetry or angled insertion comprises the following steps: If the ratio of the overlapping area of ​​the middle section within the two parallel lines to the overall middle section area is less than a third preset value, it is determined that there is an asymmetric or angled insertion; If the ratio of the overlapping area of ​​the middle section within the two parallel lines to the overall middle section area is greater than a fourth preset value, it is determined that there is no asymmetry or angled insertion; If the calculated endpoint of the center line near the head is outside the parallel lines translated up and down, it is determined that there is an asymmetric or angled insertion; If the calculated endpoint of the center line near the head is in the middle of the parallel lines translated up and down, it is determined that there is no asymmetry or angled insertion.

8. A method for analyzing sperm midpiece morphological defects as claimed in claim 4, characterized in that: The calculating of the ratio of the average width of the middle section to the length of the minor axis of the head fitting ellipse comprises calculating the length of the center line based on the center line of the middle section, calculating the area of ​​the result of dividing the middle section, obtaining the average width of the middle section, and finally calculating the ratio of the average width of the middle section to the length of the minor axis of the head fitting ellipse; The determination of whether the sample is abnormally thick or abnormally thin comprises the following steps: If the ratio of the calculated average width of the midsection to the length of the minor axis of the head fitting ellipse is greater than a fifth preset value, the sperm midsection is determined to be abnormally thick; If the ratio of the calculated average width of the midsection to the length of the minor axis of the head fitting ellipse is less than a sixth preset value, it is determined that the sperm midsection is abnormally thin.

9. An electronic device, characterized in that: include: A memory having program code stored therein; A processor is connected to the memory, and when the program code is executed by the processor, the method according to any one of claims 1 to 8 is implemented.

10. A computer-readable storage medium, characterized in that: Program instructions are stored thereon, and when the program instructions are executed, the method according to any one of claims 1 to 8 is implemented.

Images