Aquatic organism diversity monitoring system and method based on image recognition
By extracting the color texture features and contour features in underwater images and combining spatial distribution entropy, the problem of distinguishing mimicry aquatic organisms from water bases is solved, and the accuracy and dynamicity of aquatic biodiversity monitoring is improved.
Patent Information
- Application Number
- CN202510677417.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-05-26
- Publication Date
- 2025-06-24
- Estimated Expiration
- 2045-05-26
AI Technical Summary
The prior art is difficult to accurately distinguish mimic aquatic organisms from the bottom of waters, resulting in the impact of the accuracy of aquatic biodiversity monitoring.
By acquiring underwater images, the base area and potential biological regions are determined, the color texture characteristics of the texture structure are extracted using color spatial distance and grayscale symbiosis moment, and the biological candidate areas are further extracted in combination with outline features, and the spatial distribution entropy of texture breakpoints is calculated to determine the mimicry label.
The accurate distinction between mimicry aquatic organisms and water base materials is achieved, the accuracy and dynamic nature of aquatic biodiversity monitoring is improved, and a dynamic map with strong interpretability is generated.
Smart Images

Figure CN120198788A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of underwater image recognition technology. More specifically, this application relates to a monitoring system and method for aquatic biodiversity based on image recognition. Background Art
[0002] Underwater image recognition, as an important research direction in the interdisciplinary field of computer vision and marine science, with the help of high-resolution underwater camera equipment and deep learning algorithms, enables scientific researchers to efficiently and automatically identify and classify targets in the water environment, thereby improving the intelligent level of tasks such as water environment ecological monitoring and water resource assessment. In terms of aquatic biodiversity monitoring, underwater image recognition can make up for the deficiencies brought by the low efficiency of traditional observation methods and large sample interference, and provide data support for ecological protection and biological population research. With the introduction of methods such as edge computing, image enhancement, and multimodal fusion, underwater image recognition is developing towards high precision, real-time performance, and environmental adaptability.
[0003] Underwater image recognition is mainly realized through processes such as image segmentation, feature extraction, and target detection. Typical methods include structure segmentation technology based on edge detection, feature extraction algorithms based on texture and color space, and underwater target recognition models trained using convolutional neural networks. These methods can relatively effectively cope with the interference of factors such as light changes, water turbidity, and complex backgrounds, and improve the recognition accuracy and robustness of the target area. However, when identifying mimic aquatic organisms, existing methods still face significant challenges. Mimic aquatic organisms simulate the surrounding bottom substrate environment by changing appearance characteristics such as color, texture, and contour, resulting in traditional image recognition technologies being difficult to accurately distinguish mimic organisms from the natural background, thus interfering with the accuracy of aquatic biodiversity monitoring. Therefore, how to distinguish mimic aquatic organisms from the water bottom substrate based on the extraction of appearance visual features has become a difficult problem faced by the industry. Summary of the Invention
[0004] This application provides a monitoring system and method for aquatic biodiversity based on image recognition, which can distinguish mimic aquatic organisms from the water bottom substrate based on the extraction of appearance visual features.
[0005] In a first aspect, this application provides an image recognition method for aquatic biodiversity monitoring, which is applied to an aquatic biodiversity monitoring system. The method includes the following steps: Obtain an underwater image of the monitored water area, and determine the bottom substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image; Respectively determine the color space distance between each potential biological area and the bottom substrate area, and based on the color space distance, combine the gray-level co-occurrence matrix of each potential biological area to determine the color texture features of the texture structure of each potential biological area; Further extract a plurality of biological candidate regions from all potential biological regions according to the color texture features and the contour features of each potential biological region, and determine the spatial distribution entropy of all texture breakpoints in each biological candidate region; Based on the spatial distribution entropy of all texture breakpoints in each biological candidate region and the texture structure, determine the mimicry label of the mimicry aquatic organisms in each biological candidate region, and generate a dynamic map for monitoring aquatic biodiversity according to all the mimicry labels.
[0006] In some embodiments, determining the substrate regions without aquatic organisms and the multiple potential biological regions to be verified in the underwater image specifically includes: Extract a plurality of characteristic edge pixels of the substrate of the monitoring water area from the underwater image; Determine the edge curvature of each characteristic edge pixel; Based on all the edge curvatures and the texture gradient field of the substrate of the underwater image, divide the substrate regions without aquatic organisms and the multiple potential biological regions to be verified in the underwater image.
[0007] In some embodiments, extracting a plurality of characteristic edge pixels of the substrate of the monitoring water area from the underwater image specifically includes: Preprocess the underwater image to obtain a standardized image without color offset; Determine the vertical texture gradient and the horizontal texture gradient of each substrate pixel in the standardized image; Based on the vertical texture gradient and the horizontal texture gradient, determine the substrate characteristic value of each substrate pixel; Extract a plurality of characteristic edge pixels of the substrate of the monitoring water area from all the substrate pixels according to the substrate characteristic value of each substrate pixel.
[0008] In some embodiments, determining the edge curvature of each characteristic edge pixel specifically includes: Construct a plurality of texture edge segments of the substrate of the monitoring water area based on all the characteristic edge pixels; Select a texture edge segment as the selected texture edge segment, and determine the adjacent pixel pairs of each characteristic edge pixel in the selected texture edge segment; Determine the edge curvature of each characteristic edge pixel in the selected texture edge segment according to the coordinate information of the adjacent pixel pairs; Continue to determine the edge curvature of each characteristic edge pixel in the remaining texture edge segments.
[0009] In some embodiments, dividing the substrate regions without aquatic organisms and the multiple potential biological regions to be verified in the underwater image based on all the edge curvatures and the texture gradient field of the substrate of the underwater image specifically includes: Obtain the vertical texture gradient and horizontal texture gradient of each substrate pixel; Construct a texture gradient field of the underwater image substrate based on the vertical texture gradient and horizontal texture gradient of each substrate pixel; Obtain all texture edge segments of the substrate in the monitored water area, and determine the texture uniformity index of each texture edge segment based on the texture gradient field; Divide the substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image according to the texture uniformity index of each texture edge segment and all edge curvatures.
[0010] In some embodiments, dividing the substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image according to the texture uniformity index of each texture edge segment and all edge curvatures specifically includes: Select a texture edge segment and extract all feature edge pixels in the texture edge segment; Obtain the edge curvature corresponding to each feature edge pixel; Determine the edge label of the texture edge segment based on the texture uniformity index of the texture edge segment and all edge curvatures corresponding to the texture edge segment; Continue to determine the edge labels of the remaining texture edge segments; Divide the substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image according to the edge labels of all texture edge segments.
[0011] In some embodiments, determining the color texture feature of the texture structure of each potential biological area based on the color space distance in combination with the gray-level co-occurrence matrix of each potential biological area specifically includes: Obtain the standardized image of the underwater image and convert the standardized image into a grayscale processed image; Intercept the grayscale sub-image corresponding to each potential biological area in the grayscale processed image; Determine the gray-level co-occurrence matrix of each grayscale sub-image; Extract the texture feature parameters of each potential biological area from the gray-level co-occurrence matrix; Construct the color texture feature of the texture structure of each potential biological area based on the texture feature parameters and the color space distance.
[0012] In some embodiments, further extracting multiple biological candidate areas from all potential biological areas according to the color texture feature and the contour feature of each potential biological area specifically includes: Determine the contour feature of each potential biological area; Invoke a pre-trained classifier model; Based on the classifier model, multiple biological candidate regions are extracted from all potential biological regions by combining the color texture features and contour features of each potential biological region.
[0013] In some embodiments, determining the spatial distribution entropy of all texture breakpoints in each biological candidate region specifically includes: Select a biological candidate region as the selected biological candidate region, and obtain the gradient feature sequence of each pixel point in the selected biological candidate region; Extract multiple texture breakpoints from all pixel points according to the gradient feature sequence of each pixel point; Determine the spatial distribution entropy of all texture breakpoints in the selected biological candidate region; Continue to determine the spatial distribution entropy of all texture breakpoints in the remaining biological candidate regions.
[0014] In a second aspect, the present application provides an aquatic biodiversity monitoring system based on image recognition, which includes an image recognition unit, and the image recognition unit includes: An acquisition module, configured to acquire an underwater image of a monitoring water area, and determine a bottom substrate area without aquatic organisms and multiple potential biological regions to be verified in the underwater image; A processing module, configured to respectively determine the color space distance between each potential biological region and the bottom substrate area, and determine the color texture features of the texture structure of each potential biological region based on the color space distance in combination with the gray-level co-occurrence matrix of each potential biological region; The processing module is further configured to further extract multiple biological candidate regions from all potential biological regions according to the color texture features and the contour features of each potential biological region, and determine the spatial distribution entropy of all texture breakpoints in each biological candidate region; An execution module, configured to determine the mimicry label of the mimicry aquatic organisms in each biological candidate region based on the spatial distribution entropy and texture structure of all texture breakpoints in each biological candidate region, and generate a dynamic map for aquatic biodiversity monitoring according to all the mimicry labels.
[0015] In a third aspect, the present application provides a computer device, which includes a memory and a processor, the memory stores code, and the processor is configured to obtain the code and execute the above-mentioned aquatic biodiversity monitoring method based on image recognition.
[0016] In a fourth aspect, the present application provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, it implements the above-mentioned aquatic biodiversity monitoring method based on image recognition.
[0017] The technical solutions provided by the disclosed embodiments of the present application have the following beneficial effects: In the aquatic biodiversity monitoring system and method based on image recognition provided by this application, first, an underwater image of the monitored water area is obtained, and a substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image are determined; secondly, the color space distances between each potential biological area and the substrate area are respectively determined, and based on the color space distances and the gray-level co-occurrence matrix of each potential biological area, the color texture features of the texture structure of each potential biological area are determined; then, multiple biological candidate areas are further extracted from all the potential biological areas according to the color texture features and the contour features of each potential biological area, and the spatial distribution entropy of all texture breakpoints in each biological candidate area is determined; finally, based on the spatial distribution entropy and the texture structure of all texture breakpoints in each biological candidate area, the mimicry label of the mimic aquatic organisms in each biological candidate area is determined, and a dynamic map of aquatic biodiversity monitoring is generated according to all the mimicry labels.
[0018] It can be seen from this that this application can distinguish mimic aquatic organisms from the water area substrate based on the extraction of appearance visual features; first, a substrate area without aquatic organisms and potential biological areas to be verified are divided in the underwater image to identify the surrounding substrate environment and the image areas that may contain aquatic organisms, which is conducive to subsequent area comparison, increasing the efficiency of mimic organism recognition, and then improving the accuracy of aquatic biodiversity monitoring; secondly, based on the color space distance combined with the gray-level co-occurrence matrix of the potential biological area, the color texture features of the texture structure of the potential biological area are determined, which reflects the overall color structure and texture organization complexity of the potential biological area, so as to improve the description accuracy of the potential biological area, thereby increasing the accuracy of mimic organism recognition; then, biological candidate areas are further extracted from all the potential biological areas according to the color texture features and the contour features of the potential biological area to determine the real position where the mimic aquatic organisms exist and track and describe them, so as to enhance the accuracy of aquatic biodiversity monitoring; further, based on the spatial distribution entropy and the texture structure of all texture breakpoints in the biological candidate area, the mimicry label of the mimic aquatic organisms in the biological candidate area is determined to measure the mimicry degree of the mimic organisms, which is conducive to the behavior analysis and tracking of the mimic organisms, thereby increasing the dynamics and timeliness of diversity detection; finally, a dynamic map of aquatic biodiversity monitoring is generated according to the mimicry labels to dynamically display the structural evolution of the aquatic biological community in the time and space dimensions, so as to provide strongly interpretable data support for the long-term monitoring, protection and management of the water ecosystem; in summary, the technical solution provided by this application can distinguish mimic aquatic organisms from the water area substrate based on the extraction of appearance visual features. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] Figure 1 is an exemplary flowchart of an aquatic biodiversity monitoring method based on image recognition shown in some embodiments of this application; Figure 2 is an exemplary flowchart for determining color texture features as shown in some embodiments of the present application; Figure 3 is an exemplary flowchart for determining mimicry tags as shown in some embodiments of the present application; Figure 4 is a schematic structural diagram of an image recognition unit as shown in some embodiments of the present application; Figure 5 is a schematic structural diagram of a computer device for implementing an aquatic biodiversity monitoring method based on image recognition as shown in some embodiments of the present application. Detailed implementation manners
[0020] To better understand the technical solutions of the present application, the technical solutions of the present application will be described in detail below in conjunction with the accompanying drawings of the specification and specific implementation manners.
[0021] Refer to Figure 1 , this figure is an exemplary flowchart of an aquatic biodiversity monitoring method based on image recognition as shown in some embodiments of the present application. The aquatic biodiversity monitoring method 100 based on image recognition mainly includes the following steps: In step 101, an underwater image of the monitoring water area is acquired, and a substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image are determined.
[0022] Specifically, when implementing, an underwater image of the monitoring water area is acquired, that is: an underwater image of the monitoring water area is acquired by deploying an underwater camera with high-definition imaging capabilities in combination with an unmanned underwater platform. Specifically, in this embodiment, an underwater camera equipped with a low-light enhancement sensor and a wide-angle lens is used, and the underwater camera is carried by a remotely operated underwater vehicle for shooting, so as to acquire an underwater image of the monitoring water area. Then, the underwater image is uploaded to a local storage device as the basic data source for subsequent aquatic organism image recognition. The underwater image represents the image data obtained by shooting with an underwater camera in the monitoring water area. By acquiring the underwater image, the visual information of the underwater environment and the target objects therein (such as substrate and mimicry organisms) can be reflected.
[0023] In some embodiments, the substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image can be determined in the following manner, that is: Extract multiple feature edge pixels of the substrate of the monitoring water area from the underwater image; Determine the edge curvature of each feature edge pixel; Based on all the edge curvatures and the texture gradient field of the substrate of the underwater image, divide the substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image.
[0024] Among them, in some embodiments, multiple feature edge pixels of the bottom sediment in the monitored water area can be extracted from the underwater image in the following manner, that is: Preprocess the underwater image to obtain a standardized image without color offset; Determine the vertical texture gradient and horizontal texture gradient of each bottom sediment pixel in the standardized image; Determine the bottom sediment feature value of each bottom sediment pixel based on the vertical texture gradient and the horizontal texture gradient; Extract multiple feature edge pixels of the bottom sediment in the monitored water area from all bottom sediment pixels according to the bottom sediment feature values of each bottom sediment pixel.
[0025] In specific implementation, preprocess the underwater image to obtain a standardized image without color offset, that is: The underwater image often has problems of uneven illumination and color offset. Therefore, it is necessary to preprocess the underwater image through the image processing software OpenCV (Open Source Computer Vision Library, OpenCV) to obtain a standardized image without color offset. Specifically, the preprocessing process in this embodiment includes denoising, contrast enhancement, and color correction. In addition, in other embodiments, other image processing software can also be used for processing, which is not limited here.
[0026] In specific implementation, determine the vertical texture gradient and horizontal texture gradient of each bottom sediment pixel in the standardized image, that is: Before identifying the mimic organisms, it is considered that the pixel points in the image all reflect the visual information of the underwater bottom sediment and its texture structure. Therefore, the pixel points in the standardized image are regarded as bottom sediment pixels, and then the sobel gradient operator is used to calculate the vertical texture gradient and horizontal texture gradient of each bottom sediment pixel. The vertical texture gradient and horizontal texture gradient represent the quantization values of the local changes in the bottom sediment texture color. In addition, in other embodiments, other gradient operators can also be used for gradient calculation, which is not limited here.
[0027] In specific implementation, determine the bottom sediment feature value of each bottom sediment pixel based on the vertical texture gradient and the horizontal texture gradient, that is: Determine the gradient amplitude of each bottom sediment pixel based on the vertical texture gradient and the horizontal texture gradient, and use the gradient amplitude as the bottom sediment feature value of each bottom sediment pixel. Specifically, directly substitute the vertical texture gradient and the horizontal texture gradient into the gradient amplitude calculation formula to obtain the gradient amplitude. The bottom sediment feature value represents the measure of the gradient size, and the color change amplitude of the bottom sediment pixels in the image can be reflected through the bottom sediment feature value.
[0028] In specific implementation, multiple characteristic edge pixels of the sediment in the monitored water area are extracted from all sediment pixels according to the sediment characteristic values of each sediment pixel, that is: a characteristic threshold is preset in combination with historical experimental experience, the sediment characteristic values of all sediment pixels are compared with the characteristic threshold, and the sediment pixels with sediment characteristic values greater than the characteristic threshold are extracted. The obtained sediment pixels are used as characteristic edge pixels, and then multiple characteristic edge pixels of the sediment in the monitored water area are obtained. The characteristic edge pixels represent pixel points at the edge position in the image. These characteristic edge pixels are in an area with a large color change amplitude, and this area is usually the edge position of the recognition target in the image, which needs to be further monitored and verified.
[0029] Among them, in some embodiments, the edge curvature of each characteristic edge pixel can be determined in the following manner, that is: Construct multiple texture edge segments of the sediment in the monitored water area based on all the characteristic edge pixels; Select a texture edge segment as the selected texture edge segment, and determine the adjacent pixel pairs of each characteristic edge pixel in the selected texture edge segment; Determine the edge curvature of each characteristic edge pixel in the selected texture edge segment according to the coordinate information of the adjacent pixel pairs; Continue to determine the edge curvature of each characteristic edge pixel in the remaining texture edge segments.
[0030] In specific implementation, multiple texture edge segments of the sediment in the monitored water area are constructed based on all the characteristic edge pixels, that is: edge tracking is performed on all the characteristic edge pixels to obtain multiple texture edge segments of the sediment in the monitored water area. Specifically, in this embodiment, the texture edge segments are constructed by the method of constructing line segments by point-by-point tracking in the 8-neighborhood direction of the characteristic edge pixels. During the edge tracking process, the starting point and ending point of the edge segment of the texture edge segment also need to be marked, and the texture edge segment is output in the form of a point sequence for subsequent processing. The remaining specific edge construction process will not be elaborated here. In addition, in other embodiments, other methods can also be used for edge construction, such as the findContours function, connected component analysis, etc., which are not limited here. The texture edge segment represents the edge line segment in the image caused by texture changes, reflecting the organizational structure of the image texture pattern. By extracting the texture edge segment, it is beneficial to analyze the surface differences under the non-significant shape boundary, thereby providing data support for the distinction between the mimetic organism and the sediment area.
[0031] In specific implementation, the adjacent pixel pairs of each characteristic edge pixel in the selected texture edge segment are determined, that is: obtain the starting point and ending point of the edge segment of the selected texture edge segment, and traverse the point sequence corresponding to the selected texture edge segment from the starting point to the ending point of the edge segment, and then obtain the adjacent pixel pairs of each characteristic edge pixel in the selected texture edge segment.
[0032] In specific implementation, the edge curvature of each feature edge pixel in the selected texture edge segment is determined according to the coordinate information of the adjacent pixel pairs, that is: select a feature edge pixel, obtain the coordinate information of the feature edge pixel and its corresponding adjacent pixel pairs through OpenCV, and calculate the edge curvature of the feature edge pixel based on the coordinate information combined with the three-point method, so as to obtain the edge curvature of each feature edge pixel in the selected texture edge segment. In addition, in other embodiments, other methods can also be used to calculate the edge curvature, which is not limited here. The edge curvature represents the degree of bending of the texture edge segment at the feature edge pixel. The larger the edge curvature, the greater the degree of bending of the edge segment, and the greater the probability of representing the edge of rock / gravel. The smaller the edge curvature, the smaller the degree of bending of the edge segment, and the greater the probability of representing the contour of an animal. Determining the edge curvature can be used as a shape description feature for substrate area classification.
[0033] Among them, in some embodiments, the substrate area without aquatic organisms and multiple potential biological areas to be verified can be divided in the underwater image based on all the edge curvatures and the texture gradient field of the substrate of the underwater image by the following method, that is: Obtain the vertical texture gradient and horizontal texture gradient of each substrate pixel; Construct the texture gradient field of the substrate of the underwater image based on the vertical texture gradient and horizontal texture gradient of each substrate pixel; Obtain all texture edge segments of the substrate of the monitoring water area, and determine the texture uniformity index of each texture edge segment based on the texture gradient field; Divide the substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image according to the texture uniformity index of each texture edge segment and all the edge curvatures.
[0034] In specific implementation, the texture gradient field of the substrate of the underwater image is constructed based on the vertical texture gradient and horizontal texture gradient of each substrate pixel, that is: select a substrate pixel, calculate the quotient of the vertical texture gradient and horizontal texture gradient of the substrate pixel, substitute the quotient result into the arctangent function to obtain the gradient direction angle of the substrate pixel, and obtain the gradient amplitude of the substrate pixel. Combine the coordinate information, gradient amplitude, and gradient direction angle of the substrate pixel into a gradient feature sequence, and then obtain the gradient feature sequences corresponding to all substrate pixels. Combine all the gradient feature sequences according to the corresponding positions of the coordinate information to form the texture gradient field of the substrate of the underwater image. The texture gradient field represents a data field describing the distribution pattern and directional characteristics of the substrate texture in the image in space. Constructing the texture gradient field is beneficial to substrate classification, thereby improving the accuracy of mimetic organism identification.
[0035] In specific implementation, a texture uniformity index of each texture edge segment is determined based on the texture gradient field, that is: select a texture edge segment, extract the gradient feature sequence corresponding to all feature edge pixels on the texture edge segment from the texture gradient field, and calculate the standard deviation of the direction angle and the coefficient of variation of the amplitude of the texture edge segment according to all the gradient feature sequences through the numpy component in Python. Take the mean of the standard deviation of the direction angle and the coefficient of variation of the amplitude as the texture uniformity index of the texture edge segment, and then obtain the texture uniformity index of each texture edge segment. The specific calculation process is not elaborated here. The texture uniformity index represents an index for measuring whether the texture edge segment is located in the texture transition region. By determining the texture uniformity index, the consistency of the texture around the edge segment can be reflected.
[0036] Among them, in some embodiments, the bottom substrate area without aquatic organisms and multiple potential biological areas to be verified can be divided in the underwater image according to the texture uniformity index of each texture edge segment and all the edge curvatures, that is: Select a texture edge segment and extract all feature edge pixels in the texture edge segment; Obtain the edge curvature corresponding to each feature edge pixel; Determine the edge label of the texture edge segment based on the texture uniformity index of the texture edge segment and all the edge curvatures corresponding to the texture edge segment; Continue to determine the edge labels of the remaining texture edge segments; Divide the bottom substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image according to the edge labels of all texture edge segments.
[0037] In specific implementation, the edge label of the texture edge segment is determined based on the texture uniformity index of the texture edge segment and all the edge curvatures corresponding to the texture edge segment, that is: obtain the mean curvature of all the edge curvatures corresponding to the texture edge segment, and then assign an edge label to the texture edge segment by combining the texture uniformity index of the texture edge segment and the mean curvature using the double-threshold method. Specifically, set a uniformity threshold and a curvature threshold in combination with historical experimental experience. When the texture uniformity index is less than the uniformity threshold and the mean curvature is greater than the curvature threshold, the corresponding texture edge segment is used as the bottom substrate edge. Otherwise, the corresponding texture edge segment is used as the potential biological edge. Take the above determination result as the edge label of the texture edge segment. By determining the edge label, the classification of the edge segment can be justified.
[0038] In specific implementation, the substrate area without aquatic organisms and multiple potential biological areas to be verified are divided in the underwater image according to the edge labels of all texture edge segments, that is: the texture edge segments of the same class are connected by an edge connection algorithm based on region growing to form multiple closed regions. The closed region formed by the connection of substrate edges is used as the substrate area, and the remaining closed regions are used as potential biological areas. Furthermore, the substrate area without aquatic organisms and multiple potential biological areas to be verified are divided in the underwater image.
[0039] It should be noted that in this application, the substrate area refers to the area in the image that is confirmed not to contain aquatic organisms. The surface of this area is mainly bare substrate, for example, sandy land, muddy land, rocks, shell fragments, etc. In addition, in this application, the potential biological area refers to the image area that may contain aquatic organisms detected by preliminary image processing means, but it has not been finally confirmed whether it is a biological organism and needs to be further verified. Dividing the substrate area and the potential biological area is beneficial for subsequent area comparison, increasing the efficiency of mimicry organism recognition, and further improving the accuracy of aquatic biodiversity monitoring.
[0040] In step 102, the color space distance between each potential biological area and the substrate area is determined respectively, and the color texture feature of the texture structure of each potential biological area is determined based on the color space distance and the gray-level co-occurrence matrix of each potential biological area.
[0041] In some embodiments, the color space distance between each potential biological area and the substrate area can be determined by the following method, that is: Select a potential biological area as the selected potential biological area; Perform color space transformation on the selected potential biological area to obtain the color attribute information of each pixel point in the selected potential biological area; Determine the first color representation value of each pixel point in the selected potential biological area based on the color attribute information; Determine the second color representation value of each pixel point in the substrate area; Determine the color space distance between the selected potential biological area and the substrate area according to the first color representation value of each pixel point in the selected potential biological area and the second color representation value of each pixel point in the substrate area; Continue to determine the color space distance between the remaining potential biological areas and the substrate area.
[0042] In specific implementation, color space transformation is performed on the selected potential biological area to obtain the color attribute information of each pixel point in the selected potential biological area, that is: the selected potential biological area is converted from the RGB color space to the Lab color space through OpenCV, and then the L value, a value, and b value of each pixel point in the selected potential biological area are obtained. The L value, a value, and b value are combined into color attribute information, so as to obtain the color attribute information of each pixel point in the selected potential biological area.
[0043] In specific implementation, based on the color attribute information, the first color representation value of each pixel point in the selected potential biological area is determined, that is: a pixel point in the selected potential biological area is selected, and the average value of the L value, a value, and b value in the color attribute information corresponding to the pixel point is used as the first color representation value of the pixel point, and then the first color representation value of each pixel point in the selected potential biological area is obtained. The first color representation value represents the average expression of the brightness and color tendency of the pixel point in the image area. Determining the first color representation value is beneficial to subsequent color texture feature extraction and comparative analysis work.
[0044] In specific implementation, the second color representation value of each pixel point in the substrate area is determined, that is: the substrate area is processed in the same way as above, and the average value of the L value, a value, and b value of each pixel point in the substrate area is used as the second color representation value of each pixel point in the substrate area.
[0045] In specific implementation, based on the first color representation value of each pixel point in the selected potential biological area and the second color representation value of each pixel point in the substrate area, the color space distance between the selected potential biological area and the substrate area is determined, that is: the average value of the first color representation values of all pixel points in the selected potential biological area and the average value of the second color representation values of all pixel points in the substrate area are calculated respectively. Calculating the average value can represent the average Lab color perception situation of the area, and then the Euclidean distance between the two average values is obtained as the color space distance between the selected potential biological area and the substrate area.
[0046] It should be noted that in this application, the color space distance represents the degree of color difference between two areas. The larger the color space distance, the more obvious the color difference between the two areas. On the contrary, the closer the colors of the two areas are. Determining the color space distance is beneficial to subsequent extraction of color texture features and optimization of area comparison work, thereby improving the efficiency of mimicry biological recognition and enhancing the reliability of aquatic biodiversity monitoring.
[0047] In some embodiments, based on the color space distance and combined with the gray-level co-occurrence matrix of each potential biological area, the color texture features of the texture structure of each potential biological area can be determined in the following manner, that is: Obtain the normalized image of the underwater image and convert the normalized image into a grayscale processed image; Intercept the grayscale sub-image corresponding to each potential biological region in the grayscale processed image; Determine the gray-level co-occurrence matrix of each grayscale sub-image; Extract the texture feature parameters of each potential biological region from the gray-level co-occurrence matrix; Construct the color texture feature of the texture structure of each potential biological region based on the texture feature parameters and the color space distance.
[0048] In specific implementation, convert the normalized image into a grayscale processed image through OpenCV. The specific process is not elaborated here. In addition, in other embodiments, other methods can also be used for grayscale conversion, which is not limited here.
[0049] In specific implementation, intercept the grayscale sub-image corresponding to each potential biological region in the grayscale processed image through region masking operation. The region masking operation is an existing technique in image processing. In this embodiment, only its call is made, so the specific implementation process is not elaborated here. In addition, in other embodiments, other methods can also be used for intercepting grayscale sub-images, which is not limited here.
[0050] In specific implementation, determine the gray-level co-occurrence matrix of each grayscale sub-image, that is: determine the gray-level co-occurrence matrix of each grayscale sub-image through Python. Specifically, in this embodiment, the skimage.feature.greycomatrix() function is called through Python to calculate the gray-level co-occurrence matrix, and then the gray-level co-occurrence matrix of each grayscale sub-image is determined. In addition, in other embodiments, other methods can also be used to determine the gray-level co-occurrence matrix, which is not limited here.
[0051] In specific implementation, extract the texture feature parameters of each potential biological region from the gray-level co-occurrence matrix, that is: extract the contrast, energy, entropy, and homogeneity of the potential biological region from the gray-level co-occurrence matrix, and use the above-extracted parameters as the texture feature parameters of the potential biological region, so as to obtain the texture feature parameters of each potential biological region. The texture feature parameters refer to the quantitative representation of the pixel gray-level spatial relationship and repeated pattern in the image. By extracting the texture feature parameters, the roughness, complexity, directionality, and uniformity of the image region can be reflected, so as to quantitatively describe the texture structure and spatial distribution law of the image region.
[0052] In specific implementation, a color texture feature of each potential biological region texture structure is constructed based on the texture feature parameter and the color space distance, that is: the texture feature parameter and the color space distance are fused into a composite feature vector, and the composite feature vector is used as the color texture feature of each potential biological region texture structure.
[0053] It should be noted that in this application, the color texture feature represents the comprehensive expression of the potential biological region texture structure and color. Refer to Figure 2 As shown, this figure is an exemplary flowchart for determining the color texture feature according to some embodiments of this application. The color texture feature not only reflects the overall color structure of the potential biological region, but also describes the texture organization complexity of the potential biological region. By determining the color texture feature, the description accuracy of the potential biological region can be improved, thereby increasing the accuracy of mimicry biometric recognition, and further improving the efficiency and reliability of diversity monitoring.
[0054] In step 103, according to the color texture feature and the contour feature of each potential biological region, a plurality of biological candidate regions are further extracted from all potential biological regions, and the spatial distribution entropy of all texture breakpoints in each biological candidate region is determined.
[0055] In some embodiments, the method of further extracting a plurality of biological candidate regions from all potential biological regions according to the color texture feature and the contour feature of each potential biological region can be as follows: Determine the contour feature of each potential biological region; Call a pre-trained classifier model; Based on the classifier model, a plurality of biological candidate regions are extracted from all potential biological regions by combining the color texture feature and the contour feature of each potential biological region.
[0056] In specific implementation, to determine the contour feature of each potential biological region, that is: the contour smoothness of each potential biological region is determined by Fourier descriptors, and the obtained contour smoothness is used as the contour feature of each potential biological region. Specifically, Fourier descriptors are used to perform frequency domain representation on the region contour of each potential biological region, and the proportion of high-frequency components after frequency domain representation is evaluated. The low-frequency components describe the general shape of the region contour, and the high-frequency components describe the details, burrs, and noises of the region contour edge. Therefore, the proportion of high-frequency components is used as the contour smoothness, and then the contour feature of each potential biological region is obtained. In addition, in other embodiments, other methods can also be used to determine the contour feature, such as boundary coherence scoring, etc., which are not limited here.
[0057] It should be noted that in this application, the contour feature is a comprehensive measurement index for the complexity and smoothness of the regional contour. The larger the contour feature, the more uneven the contour of the potential biological area, and the greater the probability of representing the substrate (gravel, sand), and vice versa, the greater the probability of representing aquatic organisms. By determining the contour feature, the smoothness and complexity of the contour can be judged, and further data support can be provided for the identification and judgment of mimetic organisms.
[0058] In specific implementation, a pre-trained classifier model is called, that is: a classifier model pre-trained with a large number of samples of real mimetic aquatic biological areas and non-biological substrate areas is called. Specifically, in this embodiment, a support vector machines (SVM) classifier model is called. The SVM model can identify whether the monitored object is a mimetic biological area. In addition, in other embodiments, other classifier models can also be called, for example, a random forest model, etc., which is not limited here.
[0059] In specific implementation, based on the classifier model, multiple biological candidate areas are extracted from all potential biological areas by combining the color texture features and contour features of each potential biological area, that is: the color texture features and contour features of each potential biological area are used as the input features of the classifier model. After being identified by the classifier model, it can be identified whether the potential biological area corresponding to the input features is a mimetic biological area and the biological species can be identified, and then multiple biological candidate areas are extracted. The biological candidate area represents the real location where mimetic aquatic organisms exist. However, due to the difference in the degree of mimicry, the extracted biological candidate areas need to be further described to enhance the accuracy of aquatic biodiversity monitoring.
[0060] In some embodiments, the spatial distribution entropy of all texture breakpoints in each biological candidate area can be determined in the following manner, that is: Select a biological candidate area as the selected biological candidate area, and obtain the gradient feature sequence of each pixel point in the selected biological candidate area; Extract multiple texture breakpoints from all pixel points according to the gradient feature sequence of each pixel point; Determine the spatial distribution entropy of all texture breakpoints in the selected biological candidate area; Continue to determine the spatial distribution entropy of all texture breakpoints in the remaining biological candidate areas.
[0061] In specific implementation, a plurality of texture breakpoints are extracted from all pixel points according to the gradient feature sequence of each pixel point, that is: First, a direction angle threshold is set in combination with historical experimental experience; then, the gradient direction angle of each pixel point is extracted from the gradient feature sequence, all the gradient direction angles are compared with the direction angle threshold, and the pixel points corresponding to all the gradient direction angles greater than the direction angle threshold are extracted, and the extracted pixel points are used as texture breakpoints, thereby obtaining a plurality of texture breakpoints.
[0062] It should be noted that in this application, the texture breakpoint represents the position of texture mutation and the edge break point in the image area. By extracting the texture breakpoint, it is beneficial to enrich the description of the mimicry biological appearance texture characteristics, thereby improving the accuracy of diversity monitoring.
[0063] Among them, in some embodiments, the spatial distribution entropy of all texture breakpoints in the selected biological candidate area can be determined by the following method, that is: Divide the selected biological candidate area into a plurality of grids with uniform size; Count the number of texture breakpoints in each grid; Respectively take the quotient of the number of texture breakpoints in each grid and the total number of all texture breakpoints as the spatial distribution probability of the texture breakpoints in each grid; Based on the spatial distribution probability of the texture breakpoints in each grid and combined with the Shannon entropy formula, determine the spatial distribution entropy of all texture breakpoints in the selected biological candidate area.
[0064] It should be noted that in this application, the spatial distribution entropy represents an index for measuring the uniformity and complexity of the spatial coordinate distribution of texture breakpoints in the biological candidate area. By determining the spatial distribution entropy, the appearance visual characteristics of the mimicry organisms in the biological candidate area during camouflage can be further described, thereby improving the credibility of aquatic biological diversity monitoring.
[0065] In step 104, based on the spatial distribution entropy and texture structure of all texture breakpoints in each biological candidate area, determine the mimicry label of the mimicry aquatic organisms in each biological candidate area, and generate a dynamic map for aquatic biological diversity monitoring according to all the mimicry labels.
[0066] In some embodiments, refer to Figure 3 As shown, this figure is an exemplary flowchart for determining the mimicry label according to some embodiments of the present application. In this embodiment, the mimicry label of the mimicry aquatic organisms in each biological candidate area can be determined based on the spatial distribution entropy and texture structure of all texture breakpoints in each biological candidate area by the following steps: First, in step 1041, set a detection window for texture structure difference detection in each biological candidate area; Secondly, in step 1042, obtain the gray-level co-occurrence matrix corresponding to each biological candidate region; Then, in step 1043, determine the local variation characteristics of the texture structure in each biological candidate region based on the detection window and the gray-level co-occurrence matrix; Furthermore, in step 1044, determine the mimicry score of the mimetic organism in each biological candidate region based on the spatial distribution entropy of all texture breakpoints and the local variation characteristics of the texture structure in each biological candidate region; Finally, in step 1045, determine the mimicry label of the mimetic aquatic organism in each biological candidate region according to the mimicry score of the mimetic organism in each biological candidate region.
[0067] It should be noted that in this embodiment, the size of the detection window is selected as 5*5 pixel units. In addition, in other embodiments, the size of the detection window can be set according to specific application requirements, which is not limited here.
[0068] When specifically implemented, determine the local variation characteristics of the texture structure in each biological candidate region based on the detection window and the gray-level co-occurrence matrix, that is: select a biological candidate region, slide and traverse the gray-level co-occurrence matrix corresponding to the biological candidate region through the detection window corresponding to the biological candidate region, record the contrast in each sliding detection area, and then calculate the variance of all contrasts as the local variation characteristics of the texture structure in the biological candidate region, and then obtain the local variation characteristics of the texture structure in each biological candidate region. The local variation characteristics represent an index to measure the local texture inconsistency in the biological candidate region. By determining the local variation characteristics, the mimicry ability of the mimetic organism can be reflected.
[0069] When specifically implemented, determine the mimicry score of the mimetic organism in each biological candidate region based on the spatial distribution entropy of all texture breakpoints and the local variation characteristics of the texture structure in each biological candidate region, that is: select a biological candidate region, calculate the mean value of the spatial distribution entropy and the local variation characteristics corresponding to the biological candidate region, and use the calculated mean value as the mimicry score of the mimetic organism in the biological candidate region, and then obtain the mimicry score of the mimetic organism in each biological candidate region. The mimicry score is a comprehensive measure of the mimicry ability of the mimetic organism in the region. It should be noted that the spatial distribution entropy and the local variation characteristics need to be normalized before calculating the mean value to ensure the consistency of the data scale.
[0070] In specific implementation, the mimicry label of the mimetic aquatic organisms in each biological candidate area is determined according to the mimicry score of the mimetic organisms in each biological candidate area, that is: two score thresholds are set according to historical practice experience, denoted as the first score threshold and the second score threshold (the first score threshold is less than the second score threshold), and the mimicry score of the mimetic organisms in each biological candidate area is compared with the first score threshold and the second score threshold. When the mimicry score is less than the first score threshold, it is determined that the mimetic organisms in the corresponding biological candidate area are low-degree mimetic organisms. When the mimicry score is between the first score threshold and the second score threshold, it is determined that the mimetic organisms in the corresponding biological candidate area are medium-degree mimetic organisms. When the mimicry score is greater than the second score threshold, it is determined that the mimetic organisms in the corresponding biological candidate area are high-degree mimetic organisms. Furthermore, the determination result is used as the mimicry label of the mimetic aquatic organisms in each biological candidate area. The mimicry label can measure the mimicry degree of the mimetic organisms. By determining the mimicry label, the additional attributes of the biological candidate areas can be increased, which is conducive to the behavior analysis and tracking of the mimetic organisms, and further increases the dynamics and timeliness of the diversity detection.
[0071] In specific implementation, a dynamic map for monitoring the diversity of aquatic organisms is generated according to all the mimicry labels, that is: First, the mimetic organisms in the biological candidate areas are tracked through an object tracking algorithm based on deep learning to obtain the time-series data for monitoring the diversity of aquatic organisms; Then, the time-series data and all the mimicry labels are bound to coordinates with a geographic information system to generate a dynamic map including the distribution density of mimetic organism species and the heat map of spatial aggregation of mimetic organisms, and the biological contours of the mimetic organisms are marked in real time through an augmented reality device. The dynamic map can dynamically display the structural evolution of the aquatic organism community in the time and space dimensions, reflect the time-series changes in the distribution positions of the mimetic organisms, and also reveal the ecological diversity and camouflage strategies of the mimetic organisms, thus providing strongly interpretable data support for the long-term monitoring, protection and management of the water ecosystem.
[0072] In addition, on the other hand of the present application, in some embodiments, the present application provides an aquatic organism diversity monitoring system based on image recognition. The system includes an image recognition unit. Refer to Figure 4 , this figure is a schematic structural diagram of the image recognition unit shown according to some embodiments of the present application. The image recognition unit 200 includes: an acquisition module 201, a processing module 202 and an execution module 203, which are described as follows: The acquisition module 201. In the present application, the acquisition module 201 is mainly used to acquire the underwater image of the monitored water area, and determine the bottom substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image; The processing module 202. In this application, the processing module 202 is mainly used to respectively determine the color space distance between each potential biological area and the substrate area, and determine the color texture features of the texture structure of each potential biological area based on the color space distance in combination with the gray-level co-occurrence matrix of each potential biological area; The processing module 202 is further used to further extract a plurality of biological candidate areas from all potential biological areas according to the color texture features and the contour features of each potential biological area, and determine the spatial distribution entropy of all texture breakpoints in each biological candidate area; The execution module 203. In this application, the execution module 203 is mainly used to determine the mimicry label of the mimic aquatic organisms in each biological candidate area based on the spatial distribution entropy and texture structure of all texture breakpoints in each biological candidate area, and generate a dynamic map for monitoring aquatic biodiversity according to all the mimicry labels.
[0073] In addition, this application also provides a computer device, which includes a memory and a processor. The memory stores code, and the processor is configured to obtain the code and execute the above-mentioned method for monitoring aquatic biodiversity based on image recognition.
[0074] In some embodiments, refer to Figure 5 , this figure is a schematic structural diagram of a computer device for implementing the method for monitoring aquatic biodiversity based on image recognition according to some embodiments of this application. The method for monitoring aquatic biodiversity based on image recognition in the above embodiments can be implemented by Figure 5 the computer device shown. The computer device 300 includes at least one processor 301, a communication bus 302, a memory 303, and at least one communication interface 304.
[0075] The processor 301 can be a general-purpose central processing unit (CPU), or an application-specific integrated circuit (ASIC), or one or more for controlling the execution of the method for monitoring aquatic biodiversity based on image recognition in this application.
[0076] The communication bus 302 can be used to transmit information between the above components.
[0077] The memory 303 can be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM), or other types of dynamic storage devices that can store information and instructions. It can also be an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM), or other optical disc storage, optical disc storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disks, or other magnetic storage devices, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 303 can exist independently and be connected to the processor 301 through the communication bus 302. The memory 303 can also be integrated with the processor 301.
[0078] Among them, the memory 303 is used to store the program code for executing the solution of this application and is controlled by the processor 301 to execute. The processor 301 is used to execute the program code stored in the memory 303. The program code can include one or more software modules. The determination of the method for monitoring aquatic biodiversity based on image recognition in the above embodiments can be implemented by one or more software modules in the program code in the processor 301 and the memory 303.
[0079] The communication interface 304 uses any device such as a transceiver to communicate with other devices or communication networks, such as Ethernet, radio access network (RAN), wireless local area networks (WLAN), etc.
[0080] In a specific implementation, as an embodiment, the computer device can include multiple processors, and each of these processors can be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. Here, the processor can refer to one or more devices, circuits, and / or processing cores for processing data (such as computer program instructions).
[0081] The computer device described above may be a general-purpose computer device or a special-purpose computer device. In specific implementations, the computer device may be a desktop computer, a laptop computer, a network server, a personal digital assistant (PDA), a mobile phone, a tablet computer, a wireless terminal device, a communication device, or an embedded device. The embodiments of the present application do not limit the type of the computer device.
[0082] In addition, the present application also provides a computer-readable storage medium storing a computer program, and when the computer program is executed by a processor, the above-mentioned method for monitoring aquatic biodiversity based on image recognition is implemented.
[0083] Although the preferred embodiments of the present application have been described, those skilled in the art can make additional changes and modifications once they know the basic creative concept. Therefore, the appended claims are intended to be construed as including the preferred embodiments and all changes and modifications falling within the scope of the present application.
[0084] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application is also intended to include these modifications and variations.
Claims
1. An image recognition method for aquatic biodiversity monitoring, applied to an aquatic biodiversity monitoring system, characterized in that, The method includes the following steps: Obtain an underwater image of the monitored water area, and determine a substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image; Respectively determine the color space distance between each potential biological area and the substrate area, and determine the color texture features of the texture structure of each potential biological area based on the color space distance and the gray-level co-occurrence matrix of each potential biological area; Further extract multiple biological candidate areas from all potential biological areas according to the color texture features and the contour features of each potential biological area, and determine the spatial distribution entropy of all texture breakpoints in each biological candidate area; Determine the mimicry label of the mimicry aquatic organisms in each biological candidate area based on the spatial distribution entropy and texture structure of all texture breakpoints in each biological candidate area, and generate a dynamic map for monitoring aquatic biodiversity according to all the mimicry labels.
2. The method according to claim 1, wherein Determining the substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image specifically includes: Extract multiple characteristic edge pixels of the substrate of the monitored water area from the underwater image; Determine the edge curvature of each characteristic edge pixel; Based on all the edge curvatures and the texture gradient field of the substrate of the underwater image, divide the substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image.
3. The method according to claim 2, wherein Extracting multiple characteristic edge pixels of the substrate of the monitored water area from the underwater image specifically includes: Preprocess the underwater image to obtain a standardized image without color offset; Determine the vertical texture gradient and horizontal texture gradient of each substrate pixel in the standardized image; Determine the substrate characteristic value of each substrate pixel based on the vertical texture gradient and the horizontal texture gradient; Extract multiple characteristic edge pixels of the substrate of the monitored water area from all substrate pixels according to the substrate characteristic value of each substrate pixel.
4. The method according to claim 2, characterized in that, Determining the edge curvature of each characteristic edge pixel specifically includes: Construct multiple texture edge segments of the substrate of the monitored water area based on all the characteristic edge pixels; Select a texture edge segment as the selected texture edge segment, and determine the adjacent pixel pairs of each characteristic edge pixel in the selected texture edge segment; Determine the edge curvature of each characteristic edge pixel in the selected texture edge segment according to the coordinate information of the adjacent pixel pairs; Continue to determine the edge curvature of each characteristic edge pixel in the remaining texture edge segments.
5. The method according to claim 2, characterized in that, Based on all the edge curvatures and the texture gradient field of the substrate of the underwater image, dividing the substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image specifically includes: Obtain the vertical texture gradient and horizontal texture gradient of each substrate pixel; Construct the texture gradient field of the substrate of the underwater image based on the vertical texture gradient and horizontal texture gradient of each substrate pixel; Obtain all texture edge segments of the substrate of the monitored water area, and determine the texture uniformity index of each texture edge segment based on the texture gradient field; Divide the substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image according to the texture uniformity index of each texture edge segment and all the edge curvatures.
6. The method according to claim 5, characterized in that Dividing the substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image according to the texture uniformity index of each texture edge segment and all edge curvatures specifically includes: Select a texture edge segment and extract all feature edge pixels in the texture edge segment; Obtain the edge curvature corresponding to each feature edge pixel; Determine the edge label of the texture edge segment based on the texture uniformity index of the texture edge segment and all edge curvatures corresponding to the texture edge segment; Continue to determine the edge labels of the remaining texture edge segments; Divide the substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image according to the edge labels of all texture edge segments.
7. The method according to claim 1, characterized in that, Determining the color texture features of the texture structure of each potential biological area based on the color space distance and the gray-level co-occurrence matrix of each potential biological area specifically includes: Obtain the normalized image of the underwater image and convert the normalized image into a grayscale processed image; Intercept the grayscale sub-image corresponding to each potential biological area in the grayscale processed image; Determine the gray-level co-occurrence matrix of each grayscale sub-image; Extract the texture feature parameters of each potential biological area from the gray-level co-occurrence matrix; Construct the color texture features of the texture structure of each potential biological area based on the texture feature parameters and the color space distance.
8. The method according to claim 1, wherein Further extracting multiple biological candidate areas from all potential biological areas according to the color texture features and the contour features of each potential biological area specifically includes: Determine the contour features of each potential biological area; Call the pre-trained classifier model; Based on the classifier model, extract multiple biological candidate areas from all potential biological areas by combining the color texture features and the contour features of each potential biological area.
9. The method according to claim 1, characterized in that, Determining the spatial distribution entropy of all texture breakpoints in each biological candidate area specifically includes: Select a biological candidate area as the selected biological candidate area and obtain the gradient feature sequence of each pixel point in the selected biological candidate area; Extract multiple texture breakpoints from all pixel points according to the gradient feature sequence of each pixel point; Determine the spatial distribution entropy of all texture breakpoints in the selected biological candidate area; Continue to determine the spatial distribution entropy of all texture breakpoints in the remaining biological candidate areas.
10. An aquatic biodiversity monitoring system based on image recognition, the system includes an image recognition unit, characterized in that, The image recognition unit includes: An acquisition module for acquiring the underwater image of the monitored water area and determining the substrate area without aquatic organisms and multiple potential biological areas to be verified in the underwater image; A processing module for respectively determining the color space distance between each potential biological area and the substrate area, and determining the color texture features of the texture structure of each potential biological area based on the color space distance and the gray-level co-occurrence matrix of each potential biological area; The processing module is further configured to further extract multiple biological candidate areas from all potential biological areas according to the color texture features and the contour features of each potential biological area, and determine the spatial distribution entropy of all texture breakpoints in each biological candidate area. An execution module, configured to determine the mimicry labels of mimic aquatic organisms in each biological candidate region based on the spatial distribution entropy and texture structure of all texture breakpoints in each biological candidate region, and generate a dynamic map for monitoring aquatic biodiversity according to all the mimicry labels.
Citation Information
Patent Citations
Method for quantitatively analyzing correlation between terrain diversity and climate diversity
CN118643476A
Vehicle-mounted smoke alarm method, system and device and storage medium
CN118711163A
Multi-source data fusion-based water body extraction method under mountainous complex terrain condition
CN118941969A
Ecological agriculture management and control method and system based on deep learning and image recognition technology
CN119693882A
A method and system for monitoring and sampling aquatic biodiversity
CN119756925A