Marine organism classification method and system based on graph neural network

Through the graph neural network combined with three-dimensional modeling technology, the three-dimensional structural characteristics and multi-source information of marine organisms are used to solve the problem of failure to effectively integrate three-dimensional structural and molecular information in the existing technology, and the accuracy and efficiency of marine organism classification are improved. , enhances the ability to distinguish species of morphologically similar.

CN119027749AActive Publication Date: 2024-11-26SHANDONG MARINE RESOURCE AND ENVIRONMENT RESEARCH INSTITUTE (SHANDONG MARINE ENVIRONMENTAL MONITORING CENTER SHANDONG AQUATIC PRODUCTS QUALITY INSPECTION CENTER)

Patent Information

Application Number
CN202411513749.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-29
Publication Date
2024-11-26
Estimated Expiration
2044-10-29

AI Technical Summary

Technical Problem

The existing marine organism classification methods have not fully utilized the three-dimensional structural characteristics, lack the integration of morphological and molecular biological information, and the generalization ability and interpretability of classification models need to be improved, making it difficult to effectively distinguish species with similar morphology but different structures. .

Method used

Graph neural network combined with three-dimensional modeling technology, the point cloud data of marine organisms is obtained through underwater 3D laser scanning, a three-dimensional grid model is constructed, key morphological features are extracted, and the graph convolutional neural network and multi-head attention mechanism training classification is used. Model, fuses three-dimensional morphology, DNA sequences and ecological environment information for classification.

Benefits of technology

It significantly improves the accuracy and efficiency of marine organism classification, enhances the ability to generalize unknown or rare species, realizes the integration of multi-dimensional information, and improves the reliability and scientific nature of classification.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119027749A_ABST
    Figure CN119027749A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of neural networks, in particular to a marine organism classification method and system based on a graph neural network. The method comprises the steps of obtaining point cloud data of marine organisms; constructing a three-dimensional grid model based on the obtained point cloud data, and extracting key morphological features by using the three-dimensional grid model; training a graph neural network by using the extracted key morphological features; and performing classification prediction based on the trained graph neural network. By combining high-precision three-dimensional modeling and an advanced graph neural network technology, fine three-dimensional structural features of marine organisms can be captured, and the classification accuracy is remarkably improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of neural network technology, and in particular to a method and system for classifying marine organisms based on graph neural network. Background Art

[0002] Marine biological classification is of great significance for marine ecological research, resource management and biodiversity conservation. However, due to the large number of marine biological species and diverse morphologies, and the difficulty in obtaining complete samples of some organisms, traditional classification methods face many challenges. Currently, the widely used classification techniques include morphological classification, DNA barcoding technology and 2D image-based recognition methods. Although morphological classification is intuitive, it relies too much on expert experience, is highly subjective, and is difficult to deal with species with similar morphology; although DNA barcoding technology has high accuracy, it is expensive and difficult to promote and apply in large-scale classification; although 2D image-based recognition methods are efficient, they often ignore the three-dimensional structural information of organisms, resulting in limited classification accuracy. In recent years, the application of three-dimensional modeling technology in the field of biology has become increasingly widespread, providing new possibilities for capturing the three-dimensional structural characteristics of organisms. At the same time, graph neural networks (GNNs) have shown superior performance in classification tasks, especially when processing data with complex relational structures. However, existing marine biological classification methods still have many shortcomings, mainly manifested in: failure to fully utilize the three-dimensional structural characteristics of marine organisms, lack of effective integration of morphological and molecular biological information, and the generalization ability and interpretability of classification models need to be improved. In view of this, the development of a new marine organism classification method that combines three-dimensional modeling and GNN has important theoretical significance and application value, and is expected to break through the limitations of existing technologies and improve the accuracy, efficiency and scalability of marine organism classification. Summary of the invention

[0003] In order to solve the above-mentioned problems, the present invention provides a marine organism classification method and system based on graph neural network.

[0004] In the first aspect, the present invention provides a method for classifying marine organisms based on a graph neural network, which adopts the following technical solution: A marine organism classification method based on graph neural network, comprising: Obtain point cloud data of marine life; A three-dimensional mesh model is constructed based on the acquired point cloud data, and key morphological features are extracted using the three-dimensional mesh model; Train the graph neural network using the extracted key morphological features; Perform classification prediction based on the trained graph neural network.

[0005] Furthermore, the acquisition of point cloud data of marine organisms includes using an underwater 3D laser scanner to collect point cloud data of marine organisms from multiple angles. To ensure data quality, an iterative closest point ICP algorithm is used to align the multi-angle point clouds. Each collected point is represented as: Among them, (x i ,y i ,z i ) represents the three-dimensional coordinates of the point, I i Indicates the reflection intensity of a point; The minimization error function is expressed as: Among them, R is the rotation matrix, t is the translation vector, q i are the corresponding points in the target point cloud.

[0006] Furthermore, the three-dimensional mesh model is constructed based on the acquired point cloud data, including applying a Poisson surface reconstruction algorithm to generate an initial mesh model M = (V, F), where V is a vertex set, F is a face set, and the zero isosurface obtained by solving a partial differential equation in Poisson surface reconstruction is the reconstructed surface, and Laplace smoothing is used to optimize the model surface.

[0007] Furthermore, the method of extracting key morphological features using a three-dimensional mesh model includes generating required shape indexes and shape descriptors by calculating curvature information of the model surface, and fusing the shape indexes and shape descriptors with biological data to construct a comprehensive feature vector.

[0008] Furthermore, the method of training the graph neural network using the extracted key morphological features includes using the graph neural network to synthesize the graph structure and train the classification model, wherein a similarity matrix is ​​constructed, and based on the similarity matrix, a k-nearest neighbor algorithm is used to determine the edge set of the graph, and a graph convolutional neural network GCN is used to complete the training. The operation of GCN is expressed as: in, is the degree matrix, is the adjacency matrix, is the node feature of the lth layer, is a learnable parameter, is the ReLU activation function.

[0009] Furthermore, the method of training the graph neural network using the extracted key morphological features also includes introducing a multi-head attention mechanism to optimize the graph convolutional neural network in order to improve the expressive power of the model, which is specifically expressed as follows: Where k represents the number of attention heads, a k and W k is a learnable parameter; The loss function is: in, is the cross entropy loss, is the L2 regularization term, which is used to prevent the model from overfitting. It is a contrast loss, which is used to enhance the discriminability of features; and is the balance coefficient, which is determined by cross-validation.

[0010] Furthermore, the classification prediction based on the trained graph neural network includes performing classification prediction through a trained GNN model: Evaluate the confidence of the prediction: When C < threshold1 (threshold1=0.75) or Entropy > threshold2 (hreshold2=0.6), the expert review mechanism is triggered.

[0011] The second aspect is a marine biological classification system based on graph neural network, including: The data acquisition module is configured to acquire point cloud data of marine organisms; A three-dimensional construction module is configured to construct a three-dimensional mesh model based on the acquired point cloud data, and extract key morphological features using the three-dimensional mesh model; The model training module is configured to train the graph neural network using the extracted key morphological features; The classification prediction module is configured to perform classification prediction based on the trained graph neural network.

[0012] In a third aspect, the present invention provides a computer-readable storage medium storing a plurality of instructions, wherein the instructions are suitable for being loaded and executed by a processor of a terminal device for a method of classifying marine organisms based on a graph neural network.

[0013] In a fourth aspect, the present invention provides a terminal device including a processor and a computer-readable storage medium, wherein the processor is used to implement various instructions; the computer-readable storage medium is used to store multiple instructions, wherein the instructions are suitable for being loaded by the processor and executing the method for classifying marine organisms based on graph neural networks.

[0014] In summary, the present invention has the following beneficial technical effects: (1) Improve classification accuracy: By combining high-precision 3D modeling and advanced graph neural network technology, the present invention can capture the fine 3D structural features of marine organisms, significantly improving classification accuracy. Compared with traditional 2D image classification methods, the present invention can better distinguish species with similar morphology but different 3D structures, reducing misclassification.

[0015] (2) Enhanced generalization ability: The use of the GNN model and multi-head attention mechanism enables the present invention to have stronger generalization ability when facing unknown or rare species. This feature is of great significance for marine biodiversity research and new species discovery.

[0016] (3) Improve classification efficiency: This invention realizes an automated process from data collection to classification prediction, greatly improving the efficiency of marine biological classification. Especially when dealing with large-scale samples, it can significantly save time and labor costs compared to traditional methods that rely on expert experience.

[0017] (4) Integration of multi-source information: By integrating three-dimensional morphological features, DNA sequence information and ecological environment parameters, the present invention provides a comprehensive classification basis. This multi-dimensional information integration helps to improve the reliability and scientificity of classification. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 This is a schematic diagram of a marine organism classification method based on a graph neural network according to Example 1 of the present invention. DETAILED DESCRIPTION

[0019] The present invention is further described in detail below in conjunction with the accompanying drawings.

[0020] Example 1 Reference Figure 1 , a method for classifying marine organisms based on a graph neural network in this embodiment includes: Obtain point cloud data of marine life; A three-dimensional mesh model is constructed based on the acquired point cloud data, and key morphological features are extracted using the three-dimensional mesh model; Train the graph neural network using the extracted key morphological features; Perform classification prediction based on the trained graph neural network.

[0021] Specifically, the following steps are included: S1 Data Collection, A high-precision underwater 3D laser scanner is used to collect point cloud data of marine life from multiple angles. Each collected point is represented as:

[0022] Among them, (x i ,y i ,z i ) represents the three-dimensional coordinates of the point, I i Represents the reflection intensity of the point. To ensure data quality, the iterative closest point (ICP) algorithm is used to align the multi-angle point cloud to minimize the error function: Among them, R is the rotation matrix, t is the translation vector, q i are the corresponding points in the target point cloud.

[0023] The aligned point cloud data is processed through a bilateral filtering algorithm to process the data noise. At the same time, biological data D is collected, including DNA sequence S and ecological environment parameters E = {temperature T, salinity S a , depth D, pH value} to ensure the accuracy and timeliness of the data.

[0024] S2 3D modeling, Based on the collected high-quality point cloud data, this step aims to construct an accurate three-dimensional mesh model and extract key morphological features.

[0025] First, the Poisson surface reconstruction algorithm is applied to generate the initial mesh model M = (V, F), where V is the vertex set and F is the face set. Poisson reconstruction solves the partial differential equation: V, where X is the indicator function, and V is the normal vector field of the oriented point cloud. The zero isosurface of X obtained by solving the equation is the reconstructed surface. The model surface is optimized using Laplace smoothing, which can be specifically expressed as: in, is the smoothing coefficient, in the present invention The value of is 0.3, is the edge weight, for The first-order neighborhood vertex set of .

[0026] Then, the key morphological features are extracted, the principal curvatures k1 and k2 are calculated, and then the Gaussian curvature K and the mean curvature H are obtained: About extracting key morphological features: The main curvatures k1 and k2 are calculated using the formula, which can be expressed as: in, and is the vertex position after optimization by the Laplace smoothing optimization model, Represents an operation that computes eigenvalues.

[0027] Then the Gaussian curvature K and mean curvature H calculated using k1 and k2 are used as key morphological features.

[0028] Based on the curvature information, generate the required shape index S I And the shape descriptor SHOT, which can be described as: The SHOT descriptor is a statistical representation of local surface geometry, and a 364-dimensional vector is selected in the present invention.

[0029] The choice of vector dimension is arbitrary, and the choice of 364-dimensional vector can be removed. The purpose of calculating SI and shape descriptors is to fuse all the calculated results to construct a comprehensive vector, so that we can use different information to get a better result during training.

[0030] Finally, the morphological features are fused with the biological data to construct a comprehensive feature vector: The process of feature fusion is shown in the following formula F: Is a feature fusion function. Using this function, Variables are fused into one.

[0031] in, It is a feature fusion function, which is implemented through a neural network and maps features of different dimensions and scales into a unified feature space.

[0032] S3 GNN model training, This step uses the powerful expression ability of graph neural networks to construct a graph structure G = (V, E) based on the feature vector F obtained by three-dimensional modeling and train the classification model. First, construct a similarity matrix: in, is the Gaussian kernel width, set to the median of the Euclidean distance of the eigenvector F. Based on the similarity matrix , use the k nearest neighbor algorithm to determine the edge set E of the graph, k is set to log(N) + 1, and N is the total number of samples.

[0033] The training is completed using a graph convolutional neural network (GCN). The core operations of GCN are: in, is the degree matrix, is the adjacency matrix, is the node feature of the lth layer, is a learnable parameter, is the ReLU activation function.

[0034] In order to better improve the expressiveness of the model, the present invention introduces a multi-head attention mechanism to optimize the graph convolutional neural network, which can be specifically expressed as: Where k represents the number of attention heads, a k and W k are learnable parameters.

[0035] The loss function can be designed as: in, is the cross entropy loss, is the L2 regularization term, which is used to prevent the model from overfitting. It is a contrast loss that can enhance the discriminability of features. and is the balance coefficient, which is determined by cross-validation.

[0036] S4 Classification prediction, Classify and predict new marine biological samples. First, repeat steps S1-S2 to obtain the feature vector F of the new sample. x . x Embedded into the trained graph structure: Among them, sim is the cosine similarity function, and TopK returns the K nodes with the highest similarity.

[0037] Classification prediction is performed through the trained GNN model G: Evaluate the confidence of the prediction: When C < threshold1 (threshold1=0.75) or Entropy > threshold2 (hreshold2=0.6), the expert review mechanism is triggered.

[0038] Every time 5%-10% of the original training set size is accumulated, the graph structure is rebuilt to reflect the change in data distribution. Classification accuracy, F1 score, confusion matrix and other indicators are calculated for every 1,000 new samples, and model hyperparameters or structures are adjusted based on the evaluation results.

[0039] Example 2 This embodiment provides a marine life classification system based on a graph neural network, including: The data acquisition module is configured to acquire point cloud data of marine organisms; A three-dimensional construction module is configured to construct a three-dimensional mesh model based on the acquired point cloud data, and extract key morphological features using the three-dimensional mesh model; The model training module is configured to train the graph neural network using the extracted key morphological features; The classification prediction module is configured to perform classification prediction based on the trained graph neural network.

[0040] A computer-readable storage medium stores a plurality of instructions, wherein the instructions are suitable for being loaded and executed by a processor of a terminal device, a method for classifying marine organisms based on a graph neural network.

[0041] A terminal device includes a processor and a computer-readable storage medium, wherein the processor is used to implement various instructions; the computer-readable storage medium is used to store multiple instructions, wherein the instructions are suitable for being loaded by the processor and executing the marine life classification method based on graph neural network.

[0042] The above are all preferred embodiments of the present invention, and are not intended to limit the protection scope of the present invention. Therefore, any equivalent changes made based on the structure, shape, and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A marine organism classification method based on graph neural network, characterized in that: include: Obtain point cloud data of marine life; A three-dimensional mesh model is constructed based on the acquired point cloud data, and key morphological features are extracted using the three-dimensional mesh model; Train the graph neural network using the extracted key morphological features; Perform classification prediction based on the trained graph neural network.

2. A method for classifying marine organisms based on graph neural network according to claim 1, characterized in that: The acquisition of point cloud data of marine organisms includes using an underwater 3D laser scanner to collect point cloud data of marine organisms from multiple angles. To ensure data quality, an iterative closest point ICP algorithm is used to align the multi-angle point clouds. Each collected point is represented as: Among them, (x i ,y i ,z i ) represents the three-dimensional coordinates of the point, I i Indicates the reflection intensity of a point; The minimization error function is expressed as: Among them, R is the rotation matrix, t is the translation vector, q i are the corresponding points in the target point cloud.

3. A method for classifying marine organisms based on graph neural network according to claim 2, characterized in that: The method of constructing a three-dimensional mesh model based on the acquired point cloud data includes applying a Poisson surface reconstruction algorithm to generate an initial mesh model M= (V, F), where V is a vertex set and F is a face set. The zero isosurface obtained by solving a partial differential equation in Poisson surface reconstruction is the reconstructed surface, and Laplace smoothing is used to optimize the model surface.

4. A method for classifying marine organisms based on graph neural network according to claim 3, characterized in that: The method of extracting key morphological features using a three-dimensional mesh model includes generating required shape indexes and shape descriptors by calculating curvature information of the model surface, and fusing the shape indexes and shape descriptors with biological data to construct a comprehensive feature vector.

5. A method for classifying marine organisms based on graph neural network according to claim 4, characterized in that: The method of training a graph neural network using the extracted key morphological features includes using the graph neural network to synthesize the graph structure and train the classification model, wherein a similarity matrix is ​​constructed, and based on the similarity matrix, a k-nearest neighbor algorithm is used to determine the edge set of the graph, and a graph convolutional neural network GCN is used to complete the training. The operation of GCN is expressed as: in, is the degree matrix, is the adjacency matrix, is the node feature of the lth layer, is a learnable parameter, is the ReLU activation function.

6. A method for classifying marine organisms based on graph neural network according to claim 5, characterized in that: The method of training the graph neural network by using the extracted key morphological features also includes introducing a multi-head attention mechanism to optimize the graph convolutional neural network in order to improve the expressive power of the model, which is specifically expressed as follows: Where k represents the number of attention heads, a k and W k is a learnable parameter; The loss function is: in, is the cross entropy loss, is the L2 regularization term, which is used to prevent the model from overfitting. It is a contrast loss, which is used to enhance the discriminability of features; and is the balance coefficient, which is determined by cross-validation.

7. A method for classifying marine organisms based on graph neural network according to claim 6, characterized in that: The classification prediction based on the trained graph neural network includes classification prediction through the trained GNN model: Evaluate the confidence of the prediction: When C < threshold1 (threshold1=0.75) or Entropy > threshold2 (hreshold2=0.6), the expert review mechanism is triggered.

8. A marine biological classification system based on graph neural network, characterized in that: include: The data acquisition module is configured to acquire point cloud data of marine organisms; A three-dimensional construction module is configured to construct a three-dimensional mesh model based on the acquired point cloud data, and extract key morphological features using the three-dimensional mesh model; The model training module is configured to train the graph neural network using the extracted key morphological features; The classification prediction module is configured to perform classification prediction based on the trained graph neural network.

9. A computer-readable storage medium storing a plurality of instructions, characterized in that: The instructions are suitable for being loaded by a processor of a terminal device and executing the method according to claim 1 .

10. A terminal device, comprising a processor and a computer-readable storage medium, wherein the processor is used to implement each instruction; and the computer-readable storage medium is used to store multiple instructions, characterized in that: The instructions are suitable for being loaded by a processor and executing the method as claimed in claim 1 .

Citation Information

Patent Citations

  • High-precision three-dimensional face reconstruction method based on graph neural network

    CN114882197A

  • Three-dimensional point cloud target detection algorithm based on graph neural network

    CN114998890A

  • Three-dimensional model classification method based on point cloud and local shape features

    CN115546538A

  • Heterogeneous power grid data fusion method and system based on enhanced data security

    CN118260709A

  • Three-dimensional space point cloud data detection method and system

    CN118505667A

Cited By

  • Transform-based marine organism population anomaly monitoring method and system

    CN119399572A

  • Noctilucent algae separation equipment control method and system based on neural network

    CN122648629A