Deep learning image recognition-based pregnancy preparation guidance method and system

Abstract

The invention provides a pregnancy preparation guidance method and system based on deep learning image recognition. The method comprises the following steps: acquiring acquisition environment data through a preset test paper acquisition module, starting a focusing auxiliary function after the acquisition environment data judges that the environment is qualified, acquiring test paper image data, uploading the test paper image data to a cloud, and processing the test paper image data by a cloud server to obtain effective test paper image data; a test paper result quantized value is obtained through weighted calculation according to the test paper quantized parameters; performing threshold comparison on the test paper result quantized value to obtain a test paper detection state; therefore, the technology of improving the test paper detection state evaluation accuracy is realized through judgment of the collected environment state, calculation of the test paper result quantized value and threshold comparison.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of image recognition, in particular, to a method and system for fertility guidance based on deep learning image recognition. BACKGROUND

[0002] With the digital development of fertility health management, users often take fertility test paper through mobile phones and other devices and send it to the fertility instructor for remote interpretation. This method is widely used due to its convenience, but the existing technology has many shortcomings in actual application, and it is difficult to meet the individualized and precise fertility guidance needs. First, the test paper collection environment lacks effective control. The environmental factors such as light intensity, light uniformity, and image tilt degree are different when the user takes the picture, and the existing collection tools do not make pre-judgment and correction on the environmental state, which directly leads to problems in the collected test paper images, causing serious interference for subsequent interpretation. Second, the image preprocessing scheme lacks pertinence. The existing technology mostly uses general image processing algorithms, without designing a special preprocessing process for the structural characteristics of the fertility test paper, which leads to inaccurate extraction of the effective area of the test paper, and further affects the extraction accuracy of the quantitative parameters. Third, the detection threshold is fixed, and the existing interpretation method uses a unified detection result evaluation threshold, ignoring the differences in hormone levels of users in different fertility stages. The above factors lead to low efficiency of fertility instructor guidance and high cost of repeated collection for users.

[0003] In view of the above problems, there is an urgent need for effective technical solutions. SUMMARY

[0004] The purpose of the present application is to provide a method and system for fertility guidance based on deep learning image recognition, which realizes the improvement of the accuracy of test paper detection state evaluation through the judgment of the collection environment state, the calculation of the test paper result quantitative value, and the threshold comparison.

[0005] The present application also provides a method for fertility guidance based on deep learning image recognition, comprising the following steps: Obtain collection environment data through a pre-set test paper collection module, and judge the image collection environment state; According to the image collection environment state, collect test paper image data and upload it to a cloud server; The cloud server pre-processes the test paper image data to obtain effective test paper image data; According to the effective test paper image data, extract the test paper quantitative parameters, and obtain the test paper result quantitative value according to the test paper quantitative parameter processing; Compare the test paper result quantitative value with the pre-set test paper detection result evaluation threshold, obtain the test paper detection state, and display it on the client.

[0006] Optionally, in the pre-pregnancy guidance method based on deep learning image recognition provided in the present application, the acquisition environment data is obtained through the preset test paper acquisition module, and the image acquisition environment state is judged, specifically including: The acquisition environment data is obtained through the preset test paper acquisition module, including illumination intensity data, light brightness uniformity data, and image levelness data; The illumination intensity data, light brightness uniformity data, and image levelness data are compared with corresponding threshold values respectively to obtain illumination intensity state data, light brightness uniformity state data, and image levelness state data; The illumination intensity state data, light brightness uniformity state data, and image levelness state data are subjected to AND operation to obtain the image acquisition environment state, including an environment qualified state or an environment unqualified state.

[0007] Optionally, in the pre-pregnancy guidance method based on deep learning image recognition provided in the present application, the test paper image data is collected according to the image acquisition environment state and uploaded to the cloud server, specifically including: If the image acquisition environment state is the environment unqualified state, the problem acquisition environment data is obtained through preset rule matching; The difference value is obtained by comparing the value corresponding to the problem acquisition environment data with the preset threshold value and displayed on the user end; If the image acquisition environment state is the environment qualified state, the user end starts the focusing auxiliary function, and the test paper image data is collected after judging that the definition meets the standard; The test paper image data is uploaded to the cloud server.

[0008] Optionally, in the pre-pregnancy guidance method based on deep learning image recognition provided in the present application, the cloud server pre-processes the test paper image data to obtain effective test paper image data, specifically including: The test paper image data is subjected to pixel-level segmentation and background removal through a preset U-Net semantic segmentation model to obtain a test paper region image; The test paper region image is subjected to local illumination compensation and horizontal correction through a preset deep learning brightness equalization algorithm and perspective transformation matrix to obtain the effective test paper image data.

[0009] Optionally, in the pre-pregnancy guidance method based on deep learning image recognition provided in the present application, the test paper quantitative parameters are extracted according to the effective test paper image data, and the test paper result quantitative value is obtained by processing the test paper quantitative parameters, specifically including: The test paper quantitative parameters are extracted according to the effective test paper image data, including C-line continuity data, T-line continuity data, line color concentration data, and line width data; The validity of the test strip is determined by comparing the C-line continuity data with the preset C-line continuity threshold, including whether the test strip is valid or invalid. If the test strip is invalid, an invalid test strip message will be displayed on the client side; If the test strip is effective, the quantitative value of the test strip result is obtained by weighted calculation based on the preset weighting coefficient, T-line continuity data, line color concentration data, and line width data.

[0010] Optionally, in the method for providing pre-pregnancy guidance based on deep learning image recognition described in this application, the step of comparing the quantitative value of the test strip result with a preset test strip detection result evaluation threshold to obtain the test strip detection status and display it on the client specifically includes: The test strip's quantitative result is compared with a preset test result evaluation threshold to obtain the test strip's test status; The first threshold and the second threshold are extracted based on the preset detection results, and the first threshold is greater than the second threshold. If the quantitative value of the test strip result is greater than or equal to the first threshold, the test strip detection status is positive; If the quantitative value of the test strip result is greater than or equal to the second threshold and less than the first threshold, the test strip detection status is weakly positive. If the quantitative value of the test strip result is less than the second threshold, the test strip test status is negative.

[0011] Optionally, in the method for guiding conception based on deep learning image recognition described in this application, before comparing the quantitative value of the test strip result with a preset test strip detection result evaluation threshold, the method further includes: Obtain user data on their fertility preparation cycle, including the date of last menstrual period, ovulation monitoring records, or basal body temperature data; The system verifies the validity of data from the preconception period and obtains the data status, including whether the data is valid or invalid. If the data is invalid, the general threshold will be used as the preset threshold for evaluating the test strip results; If the data is valid, the preset threshold is obtained by querying the current time and the preparation period data, and the dynamic threshold is obtained by dynamically adjusting the rule base. The dynamic threshold is then used as the preset threshold for evaluating the test results of the test strip.

[0012] Optionally, the method for providing pre-pregnancy guidance based on deep learning image recognition described in this application further includes: If the test strip shows a weak positive result, the preliminary retest time and corresponding preliminary retest collection guidelines can be obtained by querying the preset retest time rule library based on the current time and the data of the pregnancy preparation period. Send the initial retest time and initial retest collection guidelines to your dedicated fertility consultant; After the dedicated fertility specialist reviews and improves the initial retest time and the initial retest collection guidelines, a recommended retest time and recommended retest guidelines are obtained. Send the recommended retest time and recommended retest data collection guidelines to the client and set a retest reminder.

[0013] Secondly, this application provides a pregnancy preparation guidance system based on deep learning image recognition. The system includes a memory and a processor. The memory stores a program for a pregnancy preparation guidance method based on deep learning image recognition. When the program for the pregnancy preparation guidance method based on deep learning image recognition is executed by the processor, it performs the following steps: The system obtains environmental data through a preset test strip acquisition module and determines the environmental status of the image acquisition. Based on the image acquisition environment, collect test strip image data and upload it to the cloud server; The cloud server preprocesses the test strip image data to obtain valid test strip image data; Extract test strip quantification parameters from valid test strip image data, and process the test strip quantification parameters to obtain the quantification value of the test strip result; The quantitative value of the test strip result is compared with the preset test strip detection result evaluation threshold to obtain the test strip detection status and display it on the client.

[0014] Optionally, in the deep learning-based image recognition-based pregnancy guidance system described in this application, the step of obtaining the acquisition environment data through the preset test strip acquisition module and determining the image acquisition environment status specifically includes: The data collected by the preset test strip acquisition module includes light intensity data, light uniformity data, and image levelness data. The illumination intensity data, light brightness uniformity data, and image levelness data are compared with their respective thresholds to obtain illumination intensity state data, light brightness uniformity state data, and image levelness state data. The image acquisition environment status is obtained by performing a bitwise AND operation on the illumination intensity status data, the light uniformity status data, and the image horizontal status data, including whether the environment is qualified or unqualified.

[0015] As described above, this application provides a method and system for pre-pregnancy guidance based on deep learning image recognition. This method acquires environmental data through a pre-set test strip acquisition module. After determining that the environment is suitable, the focus assist function is activated to obtain test strip image data and upload it to the cloud. The cloud server processes the test strip image data to obtain valid test strip image data. Based on the test strip quantification parameters, a weighted calculation is performed to obtain the quantified value of the test strip result. The quantified value of the test strip result is compared with a threshold to obtain the test strip detection status. Thus, by judging the environmental status, calculating the quantified value of the test strip result, and comparing thresholds, the method improves the accuracy of test strip detection status assessment.

[0016] Other features and advantages of this application will be set forth in the following description and will be apparent in part from the description or may be learned by practicing the application. The objectives and other advantages of this application may be realized and obtained by means of the structures particularly pointed out in the written description and the accompanying drawings. Attached Figure Description

[0017] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 A flowchart of a method for providing pre-pregnancy guidance based on deep learning image recognition, provided in an embodiment of this application; Figure 2 A flowchart illustrating the process of obtaining the image acquisition environment state in the deep learning-based image recognition-based pregnancy preparation guidance method provided in this application embodiment; Figure 3 A flowchart illustrating the method for obtaining test strip image data in the pre-pregnancy guidance method based on deep learning image recognition provided in this application embodiment; Figure 4 This is a schematic diagram of a pre-pregnancy guidance system based on deep learning image recognition provided in an embodiment of this application. Detailed Implementation

[0019] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of the embodiments. The components of the embodiments of this application described and shown in the accompanying drawings can generally be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely represents selected embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0020] It should be noted that similar reference numerals and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures. Furthermore, in the description of this application, terms such as "first," "second," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0021] Please refer to Figure 1 ,Figure 1 This is a flowchart of a method for providing fertility guidance based on deep learning image recognition, as described in some embodiments of this application. This method is used in terminal devices such as computers and mobile phones. The method includes the following steps: S11. Obtain environmental data through the preset test strip acquisition module and determine the environmental status of the image acquisition. S12. Based on the image acquisition environment, acquire test strip image data and upload it to the cloud server; S13. The cloud server preprocesses the test strip image data to obtain valid test strip image data. S14. Extract the test strip quantification parameters based on the valid test strip image data, and process the test strip quantification parameters to obtain the test strip result quantification value; S15. Compare the quantitative value of the test strip result with the preset test strip detection result evaluation threshold to obtain the test strip detection status and display it on the client.

[0022] Understandably, the first step in image recognition is to obtain images of acceptable quality. Therefore, in this embodiment, the image acquisition environment is first assessed. Only when the image acquisition environment is acceptable can high-quality images be acquired. To facilitate subsequent queries and reduce the operational burden on the user end, the acquired images are uploaded to a cloud server for analysis. The cloud server has a pre-set image preprocessing algorithm that can further optimize high-quality images and obtain valid test strip image data. After extracting parameters that can quantify the test strip results from the valid test strip image data, the quantitative value of the test strip result is obtained through weighted calculation. The test strip detection result can be evaluated through threshold comparison to obtain the test strip detection status.

[0023] Please refer to Figure 2 , Figure 2 This is a flowchart illustrating the process of obtaining the image acquisition environment status in the pre-pregnancy guidance method based on deep learning image recognition provided in this application embodiment. According to this embodiment, the step of obtaining acquisition environment data through a preset test strip acquisition module and determining the obtained image acquisition environment status specifically includes: S21. Obtain environmental data through the preset test strip acquisition module, including light intensity data, light brightness uniformity data, and image levelness data; S22. Compare the light intensity data, light brightness uniformity data, and image levelness data with the corresponding thresholds to obtain the light intensity state data, light brightness uniformity state data, and image levelness state data. S23. Perform an AND operation on the illumination intensity status data, the light brightness uniformity status data, and the image horizontal status data to obtain the image acquisition environment status, including whether the environment is qualified or unqualified.

[0024] Understandably, the preset test strip acquisition module is a program module set on the mobile phone or device, which can collect environmental data. In this example, the environmental data are all normalized data. The light intensity data refers to the quantitative data of the intensity of light illuminating the image area in the environment during the acquisition of the fertility test strip image. The light uniformity data refers to the quantitative data of the degree of difference in light intensity distribution at different sampling points in the acquired image area of ​​the fertility test strip image. Its core is to measure whether the light is "uniformly covered" on the surface of the test strip, rather than the intensity of a single light source. The calculation method is the variance of the light intensity of a preset number of sampling points within the image area. The image levelness data refers to the quantitative data of the degree of inclination between the reference edge of the test strip and the horizontal baseline of the image in the image collected by the fertility test strip. The thresholds corresponding to the light intensity data, light brightness uniformity data, and image levelness data are the light intensity threshold, light brightness uniformity threshold, and image levelness threshold, respectively. The light intensity state data, light brightness uniformity state data, and image levelness state data all have two states, including qualified or unqualified. In this embodiment, qualified is recorded as 1 and unqualified is recorded as 0. After performing a bitwise AND operation by the computer, the image acquisition environment state can be obtained.

[0025] Please refer to Figure 3 , Figure 3 This is a flowchart illustrating the acquisition of test strip image data in the pre-pregnancy guidance method based on deep learning image recognition provided in this application embodiment. According to this embodiment, the step of acquiring test strip image data and uploading it to a cloud server based on the image acquisition environment specifically includes: S31. If the image acquisition environment is in an unqualified state, the problem acquisition environment data is obtained by matching according to preset rules. S32. Compare the value corresponding to the problem collection environment data with the preset threshold to obtain the difference value and display it on the user terminal; S33. If the image acquisition environment is in a qualified state, the user terminal will enable the focus assist function and acquire the test strip image data after determining that the clarity meets the standard. S34. Upload the test strip image data to the cloud server.

[0026] It is understandable that if the image acquisition environment is in an unqualified state, it means that at least one of the data points of light intensity, uniformity of light intensity, and horizontal image is unqualified. The preset rule is to select data points of 0 from the data points of light intensity, uniformity of light intensity, and horizontal image, that is, to select unqualified data points and record them as problematic acquisition environment data. The environmental data corresponding to the problematic environmental data is compared with the corresponding preset threshold. For example, if the problematic environmental data is light intensity data, the difference value is obtained by subtracting the corresponding light intensity data from the preset light intensity data threshold.

[0027] According to an embodiment of the present invention, the cloud server preprocesses the test strip image data to obtain valid test strip image data, specifically including: The test strip image data is segmented at the pixel level and the background is removed by using the preset U-Net semantic segmentation model to obtain the test strip area image; After performing local illumination compensation and horizontal correction on the test strip area image using a preset deep learning brightness equalization algorithm and perspective transformation matrix, valid test strip image data is obtained.

[0028] It is understood that in this embodiment, the preset U-Net semantic segmentation model, the preset deep learning brightness equalization algorithm, and the perspective transformation matrix are all obtained after training with historical data, and can achieve the corresponding functions. The test strip area image is an image obtained by performing pixel-level segmentation and background removal on the test strip image data.

[0029] According to an embodiment of the present invention, the step of extracting test strip quantification parameters from valid test strip image data and processing the test strip quantification parameters to obtain the test strip result quantification value specifically includes: Based on the valid test strip image data, quantitative parameters of the test strip are extracted, including C-line continuity data, T-line continuity data, line color density data, and line width data; The validity of the test strip is determined by comparing the C-line continuity data with the preset C-line continuity threshold, including whether the test strip is valid or invalid. If the test strip is invalid, an invalid test strip message will be displayed on the client side; If the test strip is effective, the quantitative value of the test strip result is obtained by weighted calculation based on the preset weighting coefficient, T-line continuity data, line color concentration data, and line width data.

[0030] It is understandable that the quantitative parameters of the test strip refer to the parameters that affect the evaluation of the test strip results. The C-line continuity data, T-line continuity data, line color intensity data, and line width data are all normalized data. The C-line continuity data is a quantitative measure of the integrity and unbrokenness of the C-line on the pregnancy test strip, which can be expressed as the total length of the continuous line divided by the total designed line length. The T-line continuity data is a quantitative measure of the integrity and unbrokenness of the T-line on the pregnancy test strip. The line color intensity data quantifies the color depth of the C / T lines on the pregnancy test strip, reflecting the signal intensity of the lines after the chemical reaction. The line width data quantifies the thickness of the C / T lines on the pregnancy test strip in the direction perpendicular to the line direction, reflecting the "signal coverage range" of the lines. In this embodiment, the weighted calculation formula is: ; in, Here, T represents the quantitative value of the test strip result, N represents the continuity data of the T-line, and K represents the line width data. The preset weighting coefficients (preset feature coefficients are obtained by querying a pre-pregnancy guidance platform based on deep learning image recognition) are used. In this embodiment, the C-line continuity data, T-line continuity data, line color density data, and line width data can eliminate the influence of shooting distance on the detection results through a dual mechanism to ensure data stability. First, distance adaptation during the acquisition stage: the preset test strip acquisition module has built-in automatic distance measurement and focus assistance functions. When the user takes a picture, the system detects the distance between the lens and the test strip in real time and automatically adjusts the focal length and shooting parameters (such as exposure and sharpness threshold) through an algorithm to ensure that standard test strip images can be acquired at different distances. Second, scale normalization during the preprocessing stage: when the cloud server preprocesses the acquired test strip images, it will automatically perform scale calibration based on the test strip region features extracted by the U-Net semantic segmentation model. Using the inherent size of the test strip as a reference, the images taken at different distances are scaled to a uniform pixel scale, completely eliminating the interference of image size differences caused by distance on subsequent parameter extraction. The C-line continuity data and T-line continuity data are based on the preprocessed effective test strip images and use a pixel connected component analysis algorithm to automatically identify C-line continuity data. For the pixel distribution areas of the C and T lines, the ratio of the total length of continuous pixels to the standard length of the test strip is used to obtain the continuity data. The line color concentration data uses a grayscale quantization model—the test strip image is converted into a grayscale image, and the average grayscale value of the C and T line areas is extracted (normalized to the 0-1 range). The lower the grayscale value (the darker the color), the higher the concentration data. This process is automatically completed by a preset deep learning algorithm without manual intervention. The line width data is obtained by identifying the two sides of the C and T lines through an edge detection algorithm, calculating the pixel span perpendicular to the line direction, and then combining it with the pixel-actual size mapping relationship after scale normalization to convert it into standardized line width data.

[0031] According to an embodiment of the present invention, the step of comparing the quantitative value of the test strip result with a preset test strip detection result evaluation threshold to obtain the test strip detection status and display it on the client specifically includes: The test strip's quantitative result is compared with a preset test result evaluation threshold to obtain the test strip's test status; The first threshold and the second threshold are extracted based on the preset detection results, and the first threshold is greater than the second threshold. If the quantitative value of the test strip result is greater than or equal to the first threshold, the test strip detection status is positive; If the quantitative value of the test strip result is greater than or equal to the second threshold and less than the first threshold, the test strip detection status is weakly positive. If the quantitative value of the test strip result is less than the second threshold, the test strip test status is negative.

[0032] Understandably, the preset test result evaluation threshold is obtained through the summary and analysis of a large amount of historical data. Different situations will have different differences, so the threshold is also dynamic and can be adjusted according to the user's actual situation. The test strip test status is the test strip test result.

[0033] According to an embodiment of the present invention, before comparing the quantitative value of the test strip result with a preset test strip detection result evaluation threshold, the method further includes: Obtain user data on their fertility preparation cycle, including the date of last menstrual period, ovulation monitoring records, or basal body temperature data; The system verifies the validity of data from the preconception period and obtains the data status, including whether the data is valid or invalid. If the data is invalid, the general threshold will be used as the preset threshold for evaluating the test strip results; If the data is valid, the preset threshold is obtained by querying the current time and the preparation period data, and the dynamic threshold is obtained by dynamically adjusting the rule base. The dynamic threshold is then used as the preset threshold for evaluating the test results of the test strip.

[0034] Understandably, the last menstrual period date is used to calculate the number of days remaining until the last menstrual period and to estimate whether menstruation is delayed; ovulation monitoring records, i.e., the precise ovulation date or number of days after ovulation, can be obtained through manual recording by the user or by linking ovulation test strip results; basal body temperature data is used to help verify the ovulation stage, such as a sustained increase in basal body temperature for ≥14 days suggesting that the woman may be in the post-conception stage; due to the special nature of a woman's pregnancy preparation cycle, the preset threshold values ​​for evaluating test results differ at different stages, which will affect the test results. Therefore, dynamic adjustments are needed based on the user's situation. In this embodiment, the preset threshold dynamic adjustment rule base is shown in Table 1 below: Table 1. Preset Threshold Dynamic Adjustment Rule Base

[0035] The preset threshold dynamic adjustment rule base was established by combining a large amount of historical data with the analysis of female characteristics.

[0036] According to an embodiment of the present invention, it further includes: If the test strip shows a weak positive result, the preliminary retest time and corresponding preliminary retest collection guidelines can be obtained by querying the preset retest time rule library based on the current time and the data of the pregnancy preparation period. Send the initial retest time and initial retest collection guidelines to your dedicated fertility consultant; After the dedicated fertility specialist reviews and improves the initial retest time and the initial retest collection guidelines, a recommended retest time and recommended retest guidelines are obtained. Send the recommended retest time and recommended retest data collection guidelines to the client and set a retest reminder.

[0037] Understandably, based on the real-time time of obtaining the test results, and combined with data from the user's last menstrual period, accurate ovulation monitoring records, basal body temperature curves, and other data from the pre-conception cycle, a pre-defined retesting time rule base is consulted. This rule base is built upon clinical HCG hormone secretion patterns and common knowledge about pre-conception, including suggested retesting intervals and timeframes for different cycle stages. For example, for a weak positive result 7-10 days after ovulation, a retest with morning urine is recommended 48-72 hours later; for a weak positive result more than 3 days after a missed period, a retest is recommended within 12-24 hours. A preliminary retesting collection guide is also provided. The system provides requirements for urine collection, such as "no water for 2 hours before collection, midstream urine," and generates a preliminary retest time and preliminary retest collection guidelines. The system then synchronizes this preliminary information to the user's dedicated fertility consultant, who reviews and refines the information based on the user's individual circumstances (such as lifestyle habits and underlying medical history) to create a recommended retest time and guidelines. Finally, the system sends the recommendations to the client via a "pop-up reminder + structured page" format, with default settings for push notifications and SMS reminders "24 hours, 2 hours, and 30 minutes before retest" (users can customize these settings).

[0038] Please refer to Figure 4 , Figure 4 This is a schematic diagram of a fertility preparation guidance system based on deep learning image recognition provided in an embodiment of this application.

[0039] This invention also discloses a fertility preparation guidance system 4 based on deep learning image recognition, including a memory 401 and a processor 402. The memory stores a fertility preparation guidance method program based on deep learning image recognition. When the processor executes the fertility preparation guidance method program based on deep learning image recognition, it performs the following steps: The system obtains environmental data through a preset test strip acquisition module and determines the environmental status of the image acquisition. Based on the image acquisition environment, collect test strip image data and upload it to the cloud server; The cloud server preprocesses the test strip image data to obtain valid test strip image data; Extract test strip quantification parameters from valid test strip image data, and process the test strip quantification parameters to obtain the quantification value of the test strip result; The quantitative value of the test strip result is compared with the preset test strip detection result evaluation threshold to obtain the test strip detection status and display it on the client.

[0040] Understandably, the first step in image recognition is to obtain images of acceptable quality. Therefore, in this embodiment, the image acquisition environment is first assessed. Only when the image acquisition environment is acceptable can high-quality images be acquired. To facilitate subsequent queries and reduce the operational burden on the user end, the acquired images are uploaded to a cloud server for analysis. The cloud server has a pre-set image preprocessing algorithm that can further optimize high-quality images and obtain valid test strip image data. After extracting parameters that can quantify the test strip results from the valid test strip image data, the quantitative value of the test strip result is obtained through weighted calculation. The test strip detection result can be evaluated through threshold comparison to obtain the test strip detection status.

[0041] According to an embodiment of the present invention, the step of obtaining the acquisition environment data through the preset test strip acquisition module and determining the acquisition environment status of the image specifically includes: The data collected by the preset test strip acquisition module includes light intensity data, light uniformity data, and image levelness data. The illumination intensity data, light brightness uniformity data, and image levelness data are compared with their respective thresholds to obtain illumination intensity state data, light brightness uniformity state data, and image levelness state data. The image acquisition environment status is obtained by performing a bitwise AND operation on the illumination intensity status data, the light uniformity status data, and the image horizontal status data, including whether the environment is qualified or unqualified.

[0042] Understandably, the preset test strip acquisition module is a program module set on the mobile phone or device, which can collect environmental data. In this example, the environmental data are all normalized data. The light intensity data refers to the quantitative data of the intensity of light illuminating the image area in the environment during the acquisition of the fertility test strip image. The light uniformity data refers to the quantitative data of the degree of difference in light intensity distribution at different sampling points in the acquired image area of ​​the fertility test strip image. Its core is to measure whether the light is "uniformly covered" on the surface of the test strip, rather than the intensity of a single light source. The calculation method is the variance of the light intensity of a preset number of sampling points within the image area. The image levelness data refers to the quantitative data of the degree of inclination between the reference edge of the test strip and the horizontal baseline of the image in the image collected by the fertility test strip. The thresholds corresponding to the light intensity data, light brightness uniformity data, and image levelness data are the light intensity threshold, light brightness uniformity threshold, and image levelness threshold, respectively. The light intensity state data, light brightness uniformity state data, and image levelness state data all have two states, including qualified or unqualified. In this embodiment, qualified is recorded as 1 and unqualified is recorded as 0. After performing a bitwise AND operation by the computer, the image acquisition environment state can be obtained.

[0043] According to an embodiment of the present invention, the step of acquiring test strip image data and uploading it to a cloud server based on the image acquisition environment specifically includes: If the image acquisition environment is in an unqualified state, the problematic acquisition environment data will be obtained by matching according to preset rules. The difference value is obtained by comparing the value corresponding to the environmental data of the problem collection with the preset threshold and then displaying it on the user's end. If the image acquisition environment is in a qualified state, the user terminal will enable the focus assist function, and after determining that the clarity meets the standard, the test strip image data will be acquired. The test strip image data is uploaded to the cloud server.

[0044] It is understandable that if the image acquisition environment is in an unqualified state, it means that at least one of the data points of light intensity, uniformity of light intensity, and horizontal image is unqualified. The preset rule is to select data points of 0 from the data points of light intensity, uniformity of light intensity, and horizontal image, that is, to select unqualified data points and record them as problematic acquisition environment data. The environmental data corresponding to the problematic environmental data is compared with the corresponding preset threshold. For example, if the problematic environmental data is light intensity data, the difference value is obtained by subtracting the corresponding light intensity data from the preset light intensity data threshold.

[0045] According to an embodiment of the present invention, the cloud server preprocesses the test strip image data to obtain valid test strip image data, specifically including: The test strip image data is segmented at the pixel level and the background is removed by using the preset U-Net semantic segmentation model to obtain the test strip area image; After performing local illumination compensation and horizontal correction on the test strip area image using a preset deep learning brightness equalization algorithm and perspective transformation matrix, valid test strip image data is obtained.

[0046] It is understood that in this embodiment, the preset U-Net semantic segmentation model, the preset deep learning brightness equalization algorithm, and the perspective transformation matrix are all obtained after training with historical data, and can achieve the corresponding functions. The test strip area image is an image obtained by performing pixel-level segmentation and background removal on the test strip image data.

[0047] According to an embodiment of the present invention, the step of extracting test strip quantification parameters from valid test strip image data and processing the test strip quantification parameters to obtain the test strip result quantification value specifically includes: Based on the valid test strip image data, quantitative parameters of the test strip are extracted, including C-line continuity data, T-line continuity data, line color density data, and line width data; The validity of the test strip is determined by comparing the C-line continuity data with the preset C-line continuity threshold, including whether the test strip is valid or invalid. If the test strip is invalid, an invalid test strip message will be displayed on the client side; If the test strip is effective, the quantitative value of the test strip result is obtained by weighted calculation based on the preset weighting coefficient, T-line continuity data, line color concentration data, and line width data.

[0048] It is understandable that the quantitative parameters of the test strip refer to the parameters that affect the evaluation of the test strip results. The C-line continuity data, T-line continuity data, line color intensity data, and line width data are all normalized data. The C-line continuity data is a quantitative measure of the integrity and unbrokenness of the C-line on the pregnancy test strip, which can be expressed as the total length of the continuous line divided by the total designed line length. The T-line continuity data is a quantitative measure of the integrity and unbrokenness of the T-line on the pregnancy test strip. The line color intensity data quantifies the color depth of the C / T lines on the pregnancy test strip, reflecting the signal intensity of the lines after the chemical reaction. The line width data quantifies the thickness of the C / T lines on the pregnancy test strip in the direction perpendicular to the line direction, reflecting the "signal coverage range" of the lines. In this embodiment, the weighted calculation formula is: ; in, Here, T represents the quantitative value of the test strip result, N represents the continuity data of the T-line, and K represents the line width data. The preset weighting coefficients (preset feature coefficients are obtained by querying a pre-pregnancy guidance platform based on deep learning image recognition) are used. In this embodiment, the C-line continuity data, T-line continuity data, line color density data, and line width data can eliminate the influence of shooting distance on the detection results through a dual mechanism to ensure data stability. First, distance adaptation during the acquisition stage: the preset test strip acquisition module has built-in automatic distance measurement and focus assistance functions. When the user takes a picture, the system detects the distance between the lens and the test strip in real time and automatically adjusts the focal length and shooting parameters (such as exposure and sharpness threshold) through an algorithm to ensure that standard test strip images can be acquired at different distances. Second, scale normalization during the preprocessing stage: when the cloud server preprocesses the acquired test strip images, it will automatically perform scale calibration based on the test strip region features extracted by the U-Net semantic segmentation model. Using the inherent size of the test strip as a reference, the images taken at different distances are scaled to a uniform pixel scale, completely eliminating the interference of image size differences caused by distance on subsequent parameter extraction. The C-line continuity data and T-line continuity data are based on the preprocessed effective test strip images and use a pixel connected component analysis algorithm to automatically identify C-line continuity data. For the pixel distribution areas of the C and T lines, the ratio of the total length of continuous pixels to the standard length of the test strip is used to obtain the continuity data. The line color concentration data uses a grayscale quantization model—the test strip image is converted into a grayscale image, and the average grayscale value of the C and T line areas is extracted (normalized to the 0-1 range). The lower the grayscale value (the darker the color), the higher the concentration data. This process is automatically completed by a preset deep learning algorithm without manual intervention. The line width data is obtained by identifying the two sides of the C and T lines through an edge detection algorithm, calculating the pixel span perpendicular to the line direction, and then combining it with the pixel-actual size mapping relationship after scale normalization to convert it into standardized line width data.

[0049] According to an embodiment of the present invention, the step of comparing the quantitative value of the test strip result with a preset test strip detection result evaluation threshold to obtain the test strip detection status and display it on the client specifically includes: The test strip's quantitative result is compared with a preset test result evaluation threshold to obtain the test strip's test status; The first threshold and the second threshold are extracted based on the preset detection results, and the first threshold is greater than the second threshold. If the quantitative value of the test strip result is greater than or equal to the first threshold, the test strip detection status is positive; If the quantitative value of the test strip result is greater than or equal to the second threshold and less than the first threshold, the test strip detection status is weakly positive. If the quantitative value of the test strip result is less than the second threshold, the test strip test status is negative.

[0050] Understandably, the preset test result evaluation threshold is obtained through the summary and analysis of a large amount of historical data. Different situations will have different differences, so the threshold is also dynamic and can be adjusted according to the user's actual situation. The test strip test status is the test strip test result.

[0051] According to an embodiment of the present invention, before comparing the quantitative value of the test strip result with a preset test strip detection result evaluation threshold, the method further includes: Obtain user data on their fertility preparation cycle, including the date of last menstrual period, ovulation monitoring records, or basal body temperature data; The system verifies the validity of data from the preconception period and obtains the data status, including whether the data is valid or invalid. If the data is invalid, the general threshold will be used as the preset threshold for evaluating the test strip results; If the data is valid, the preset threshold is obtained by querying the current time and the preparation period data, and the dynamic threshold is obtained by dynamically adjusting the rule base. The dynamic threshold is then used as the preset threshold for evaluating the test results of the test strip.

[0052] Understandably, the last menstrual period date is used to calculate the number of days remaining until the last menstrual period and to estimate whether menstruation is delayed; ovulation monitoring records, i.e., the precise ovulation date or number of days after ovulation, can be obtained through manual recording by the user or by linking ovulation test strip results; basal body temperature data is used to help verify the ovulation stage, such as a sustained increase in basal body temperature for ≥14 days, indicating that the woman may be in the post-conception stage; due to the special nature of a woman's pregnancy preparation cycle, the preset test result evaluation threshold values ​​are different at different stages, which will affect the test results. Therefore, dynamic adjustments are needed based on the user's situation. In this embodiment, the preset threshold dynamic adjustment rule library is shown in Table 1.

[0053] The preset threshold dynamic adjustment rule base was established by combining a large amount of historical data with the analysis of female characteristics.

[0054] According to an embodiment of the present invention, it further includes: If the test strip shows a weak positive result, the preliminary retest time and corresponding preliminary retest collection guidelines can be obtained by querying the preset retest time rule library based on the current time and the data of the pregnancy preparation period. Send the initial retest time and initial retest collection guidelines to your dedicated fertility consultant; After the dedicated fertility specialist reviews and improves the initial retest time and the initial retest collection guidelines, a recommended retest time and recommended retest guidelines are obtained. Send the recommended retest time and recommended retest data collection guidelines to the client and set a retest reminder.

[0055] Understandably, based on the real-time time of obtaining the test results, and combined with data from the user's last menstrual period, accurate ovulation monitoring records, basal body temperature curves, and other data from the pre-conception cycle, a pre-defined retesting time rule base is consulted. This rule base is built upon clinical HCG hormone secretion patterns and common knowledge about pre-conception, including suggested retesting intervals and timeframes for different cycle stages. For example, for a weak positive result 7-10 days after ovulation, a retest with morning urine is recommended 48-72 hours later; for a weak positive result more than 3 days after a missed period, a retest is recommended within 12-24 hours. A preliminary retesting collection guide is also provided. The system provides requirements for urine collection, such as "no water for 2 hours before collection, midstream urine," and generates a preliminary retest time and preliminary retest collection guidelines. The system then synchronizes this preliminary information to the user's dedicated fertility consultant, who reviews and refines the information based on the user's individual circumstances (such as lifestyle habits and underlying medical history) to create a recommended retest time and guidelines. Finally, the system sends the recommendations to the client via a "pop-up reminder + structured page" format, with default settings for push notifications and SMS reminders "24 hours, 2 hours, and 30 minutes before retest" (users can customize these settings).

[0056] This invention discloses a method and system for pre-pregnancy guidance based on deep learning image recognition. It acquires environmental data through a pre-set test strip acquisition module. After determining the environment is suitable, it activates the focus assist function to obtain test strip image data and uploads it to the cloud. The cloud server processes the test strip image data to obtain valid test strip image data. Based on the test strip's quantitative parameters, a weighted calculation is performed to obtain the quantitative value of the test strip result. The quantitative value of the test strip result is then compared with a threshold to obtain the test strip's detection status. Thus, by judging the environmental status, calculating the quantitative value of the test strip result, and comparing thresholds, the accuracy of test strip detection status assessment is improved.

[0057] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods, such as: multiple units or components can be combined, or integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the various components shown or discussed can be through some interfaces, and the indirect coupling or communication connection between devices or units can be electrical, mechanical, or other forms.

[0058] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units. They may be located in one place or distributed across multiple network units. Some or all of the units may be selected to achieve the purpose of this embodiment according to actual needs.

[0059] In addition, in the various embodiments of the present invention, each functional unit can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the integrated unit can be implemented in hardware or in the form of hardware plus software functional units.

[0060] Those skilled in the art will understand that all or part of the steps of the above method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a readable storage medium. When the program is executed, it performs the steps of the above method embodiments. The aforementioned storage medium includes various media that can store program code, such as mobile storage devices, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0061] Alternatively, if the integrated units of this invention are implemented as software functional modules and sold or used as independent products, they can also be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the methods described in the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as mobile storage devices, ROM, RAM, magnetic disks, or optical disks.

Claims

1. A method for providing guidance on preparing for pregnancy based on deep learning image recognition, characterized in that, include: The system obtains environmental data through a preset test strip acquisition module and determines the environmental status of the image acquisition. Based on the image acquisition environment, collect test strip image data and upload it to the cloud server; The cloud server preprocesses the test strip image data to obtain valid test strip image data; Extract test strip quantification parameters from valid test strip image data, and process the test strip quantification parameters to obtain the quantification value of the test strip result; The quantitative value of the test strip result is compared with the preset test strip detection result evaluation threshold to obtain the test strip detection status and display it on the client.

2. The method for providing pre-pregnancy guidance based on deep learning image recognition according to claim 1, characterized in that, The process of obtaining environmental data through a preset test strip acquisition module and determining the environmental status of the acquired image specifically includes: The data collected by the preset test strip acquisition module includes light intensity data, light uniformity data, and image levelness data. The illumination intensity data, light brightness uniformity data, and image levelness data are compared with their respective thresholds to obtain illumination intensity state data, light brightness uniformity state data, and image levelness state data. The image acquisition environment status is obtained by performing a bitwise AND operation on the illumination intensity status data, the light uniformity status data, and the image horizontal status data, including whether the environment is qualified or unqualified.

3. The method for providing pre-pregnancy guidance based on deep learning image recognition according to claim 2, characterized in that, The step of acquiring test strip image data and uploading it to the cloud server based on the image acquisition environment includes: If the image acquisition environment is in an unqualified state, the problematic acquisition environment data will be obtained by matching according to preset rules. The difference value is obtained by comparing the value corresponding to the environmental data of the problem collection with the preset threshold and then displaying it on the user's end. If the image acquisition environment is in a qualified state, the user terminal will enable the focus assist function, and after determining that the clarity meets the standard, the test strip image data will be acquired. The test strip image data is uploaded to the cloud server.

4. The method for providing pre-pregnancy guidance based on deep learning image recognition according to claim 3, characterized in that, The cloud server preprocesses the test strip image data to obtain valid test strip image data, specifically including: The test strip image data is segmented at the pixel level and the background is removed by using the preset U-Net semantic segmentation model to obtain the test strip area image; After performing local illumination compensation and horizontal correction on the test strip area image using a preset deep learning brightness equalization algorithm and perspective transformation matrix, valid test strip image data is obtained.

5. The method for providing pre-pregnancy guidance based on deep learning image recognition according to claim 4, characterized in that, The step of extracting test strip quantification parameters from valid test strip image data and processing the test strip quantification parameters to obtain the quantification value of the test strip result specifically includes: Based on the valid test strip image data, quantitative parameters of the test strip are extracted, including C-line continuity data, T-line continuity data, line color density data, and line width data; The validity of the test strip is determined by comparing the C-line continuity data with the preset C-line continuity threshold, including whether the test strip is valid or invalid. If the test strip is invalid, an invalid test strip message will be displayed on the client side; If the test strip is effective, the quantitative value of the test strip result is obtained by weighted calculation based on the preset weighting coefficient, T-line continuity data, line color concentration data, and line width data.

6. The method for providing pre-pregnancy guidance based on deep learning image recognition according to claim 5, characterized in that, The step of comparing the quantitative value of the test strip result with a preset test strip detection result evaluation threshold to obtain the test strip detection status and display it on the client specifically includes: The test strip's quantitative result is compared with a preset test result evaluation threshold to obtain the test strip's test status; The first threshold and the second threshold are extracted based on the preset detection results, and the first threshold is greater than the second threshold. If the quantitative value of the test strip result is greater than or equal to the first threshold, the test strip detection status is positive; If the quantitative value of the test strip result is greater than or equal to the second threshold and less than the first threshold, the test strip detection status is weakly positive. If the quantitative value of the test strip result is less than the second threshold, the test strip test status is negative.

7. The method for providing pre-pregnancy guidance based on deep learning image recognition according to claim 6, characterized in that, Before comparing the quantitative value of the test strip result with the preset test strip detection result evaluation threshold, the following steps are also included: Obtain user data on their fertility preparation cycle, including the date of last menstrual period, ovulation monitoring records, or basal body temperature data; The system verifies the validity of data from the preconception period and obtains the data status, including whether the data is valid or invalid. If the data is invalid, the general threshold will be used as the preset threshold for evaluating the test strip results; If the data is valid, the preset threshold is obtained by querying the current time and the preparation period data, and the dynamic threshold is obtained by dynamically adjusting the rule base. The dynamic threshold is then used as the preset threshold for evaluating the test results of the test strip.

8. The method for providing pre-pregnancy guidance based on deep learning image recognition according to claim 7, characterized in that, Also includes: If the test strip shows a weak positive result, the preliminary retest time and corresponding preliminary retest collection guidelines can be obtained by querying the preset retest time rule library based on the current time and the data of the pregnancy preparation period. Send the initial retest time and initial retest collection guidelines to your dedicated fertility consultant; After the dedicated fertility specialist reviews and improves the initial retest time and the initial retest collection guidelines, a recommended retest time and recommended retest guidelines are obtained. Send the recommended retest time and recommended retest data collection guidelines to the client and set a retest reminder.

9. A pre-pregnancy guidance system based on deep learning image recognition, characterized in that, The system includes a memory and a processor. The memory contains a program for a method of guiding fertility based on deep learning image recognition. When executed by the processor, the method program performs the following steps: The system obtains environmental data through a preset test strip acquisition module and determines the environmental status of the image acquisition. Based on the image acquisition environment, collect test strip image data and upload it to the cloud server; The cloud server preprocesses the test strip image data to obtain valid test strip image data; Extract test strip quantification parameters from valid test strip image data, and process the test strip quantification parameters to obtain the quantification value of the test strip result; The quantitative value of the test strip result is compared with the preset test strip detection result evaluation threshold to obtain the test strip detection status and display it on the client.

10. The pre-pregnancy guidance system based on deep learning image recognition according to claim 9, characterized in that, The process of obtaining environmental data through a preset test strip acquisition module and determining the environmental status of the acquired image specifically includes: The data collected by the preset test strip acquisition module includes light intensity data, light uniformity data, and image levelness data. The illumination intensity data, light brightness uniformity data, and image levelness data are compared with their respective thresholds to obtain illumination intensity state data, light brightness uniformity state data, and image levelness state data. The image acquisition environment status is obtained by performing a bitwise AND operation on the illumination intensity status data, the light uniformity status data, and the image horizontal status data, including whether the environment is qualified or unqualified.

Images