Deep learning-based plant profile and species retrieval table generation method and system

Abstract

The invention discloses a method and a system for generating a plant profile and species retrieval table based on deep learning, and relates to the technical field of atlas construction. Sample data are collected, feature extraction is performed on the sample data, and a corresponding sample feature set is obtained; training a deep learning model according to the obtained sample feature set, generating plant content according to a training result, and constructing a plant information base; a species retrieval table is constructed, and the plants needing to be recognized are recognized through the species retrieval table; the plant content and the species retrieval table are automatically generated, new plant data can be continuously learned through the model, the plant content and the retrieval table are updated in real time, and along with discovery of new species and updating of data sample data, the model can automatically adapt to new features, update the retrieval table and expand the plant content. The function ensures that the plant species and the retrieval table can follow the progress of scientific research, so that botany researchers can remarkably improve the identification efficiency of the plant species.

Description

Technical Field

[0001] The present invention relates to the technical field of atlas construction, and specifically to a method and system for generating a flora and a species checklist based on deep learning. Background Art

[0002] As an important tool for botanical research, the flora has long been used to record and describe the morphological characteristics, distribution, ecological habits, and other relevant information of various plants. The flora not only provides systematic data for plant taxonomy but also provides a large amount of basic research data for botanists, environmentalists, ecologists, etc. However, the current compilation and update of the flora still rely on a large amount of manual work, including the collection, classification, morphological description of plant specimens, and the compilation of plant checklists. This process is not only time-consuming and laborious but also easily affected by human factors, resulting in errors and inconsistent results. Therefore, how to improve the efficiency of flora compilation and species identification and reduce human errors is a problem that needs to be solved. For this purpose, a method and system for generating a flora and a species checklist based on deep learning are provided. Summary of the Invention

[0003] The purpose of the present invention is to provide a method and system for generating a flora and a species checklist based on deep learning.

[0004] The purpose of the present invention can be achieved by the following technical solutions: A method for generating a flora and a species checklist based on deep learning includes the following steps:

[0005] Step S1: Collect sample data, extract features from the sample data, and obtain a corresponding sample feature set;

[0006] Step S2: Train a deep learning model according to the obtained sample feature set, generate flora content according to the training results, and construct a plant information database;

[0007] Step S3: Construct a species checklist and identify the plants to be identified through the species checklist.

[0008] Further, the process of collecting sample data, extracting features from the sample data, and obtaining a corresponding sample feature set includes:

[0009] Collect plant information of different plants based on existing public materials; wherein, the existing public materials include public databases, research institutions, floras, and other literatures;

[0010] The plant information includes plant image information and plant text information, and the plant text information includes morphological feature description information, ecological habit information, and growth distribution information;

[0011] Summarize the plant information of each plant respectively to obtain a set of plant information corresponding to each plant;

[0012] Annotate the plant image information and plant text information in each obtained set of plant information, and summarize the annotated parts to obtain a corresponding sample feature set.

[0013] Furthermore, the process of training a deep learning model based on the obtained sample feature set includes:

[0014] Construct an image sample training set and a text sample training set respectively according to the obtained sample feature set;

[0015] Obtain several batches of data pairs based on the image samples in the image sample training set and the text samples in the text sample training set;

[0016] Input the obtained data pairs into the deep learning model batch by batch;

[0017] The deep learning model extracts the image feature vectors and text feature vectors corresponding to the image samples and text samples in the data pair respectively, as well as the predicted correlation coefficient between the image feature vectors and text feature vectors, and then obtains the corresponding contrast loss function;

[0018] Perform iterative training on the deep learning model until the contrast loss function of the deep learning is lower than the preset value or the number of iterations reaches the preset number, thereby completing the training of the deep learning model;

[0019] Construct a validation set and a test set, input the constructed validation set and test set into the trained deep learning model, evaluate the performance of the deep learning model according to the output of the deep learning model, and after passing the evaluation, output the corresponding recognition features and generate the corresponding flora content.

[0020] Furthermore, the specific process of generating the flora content is:

[0021] Generate corresponding plant labels for the names of each plant, associate the corresponding recognition features with the plant labels, generate flora content corresponding to the plant labels according to the plant labels and the associated recognition features, and output the flora content in natural language text;

[0022] Associate the output flora content with the corresponding plant image information and generate corresponding plant information entries;

[0023] Summarize the plant information entries of all plants to complete the construction of the plant information database.

[0024] Furthermore, the process of constructing a species key includes:

[0025] For each plant information entry, obtain all the features corresponding to the plant information entry, and create corresponding retrieval nodes for each of the obtained features;

[0026] Classify each retrieval node into a judgment node and a selection node according to the type of the feature;

[0027] Connect each retrieval node to obtain a corresponding retrieval path;

[0028] Summarize the retrieval paths corresponding to all plant information entries, match the retrieval nodes on each retrieval path, merge the retrieval nodes of the same type, and record the merged retrieval nodes as set nodes;

[0029] Summarize the plants that meet each set node to obtain a corresponding plant species set;

[0030] Obtain the number of retrieval nodes merged by each set node, set the retrieval priority of the set node according to the number of merged retrieval nodes, and juxtapose the set nodes with the same priority, thus completing the construction of the species retrieval table.

[0031] Furthermore, the process of identifying a plant to be identified through the species retrieval table includes:

[0032] The user retrieves the plant to be identified according to the constructed species retrieval table, traverses each set node in the species retrieval table in turn, and determines the retrieval path of the plant to be identified;

[0033] Mark the plant species sets corresponding to all set nodes on the retrieval path, and obtain the intersection of the plants within all set nodes;

[0034] Then the plants within the intersection are the plants to be identified, and retrieve the plant flora content corresponding to the plant, thus completing the user's retrieval of the plant to be identified.

[0035] Furthermore, a plant flora and species retrieval table generation system includes a management center, and the management center is communicatively connected to a data input module, a deep learning module, and a user retrieval module;

[0036] The data input module is used to input the plant information of different plants in existing public materials, and use the input plant information as sample data;

[0037] The deep learning module is used to perform model training according to the sample data, generate plant flora content according to the training results, and construct a plant information database;

[0038] The user retrieval module is used to construct a corresponding species retrieval table according to the plant information database. The user retrieves the plants to be identified and the corresponding plant flora content according to the constructed species retrieval table.

[0039] Compared with the prior art, the beneficial effects of the present invention are as follows:

[0040] The present invention can not only automatically generate plant flora content and species retrieval tables, but also continuously learn new plant data through the model to update the plant flora content and retrieval tables in real time. With the discovery of new species and the update of sample data, the model will automatically adapt to new features, update the retrieval table and expand the content of the plant flora. This function ensures that the plant flora and retrieval tables can follow the progress of scientific research, enabling botanists to significantly improve the efficiency of plant species identification. Description of the Drawings

[0041] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments recorded in the present invention. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings.

[0042] Figure 1 It is the schematic diagram of the present invention. Detailed Embodiments

[0043] As Figure 1 shown, the method for generating a plant flora and species retrieval table based on deep learning includes the following steps:

[0044] Step S1: Collect sample data, extract features from the sample data, and obtain the corresponding sample feature set;

[0045] Step S2: Train a deep learning model according to the obtained sample feature set, generate plant flora content according to the training results, and construct a plant information database;

[0046] Step S3: Construct a species retrieval table, and identify the plants to be identified through the species retrieval table.

[0047] It should be further noted that, in the specific implementation process, the process of collecting sample data, extracting features from the sample data, and obtaining the corresponding sample feature set includes:

[0048] Based on existing public materials, collect plant information of different plants; among them, the existing public materials include public databases, scientific research institutions, plant floras, and other literatures;

[0049] The plant information includes plant image information and plant text information, and the plant text information includes morphological feature description information, ecological habit information, and growth distribution information;

[0050] The plant image information includes pictures of each plant from different angles and at different growth stages, such as pictures of leaves, flowers, and fruits;

[0051] The morphological feature description information includes morphological descriptions of each plant at different growth stages, such as leaf shape, flower color, shape, fruit type, etc.

[0052] The ecological habit information includes the growth environment of the plant, such as climate, soil, altitude;

[0053] The growth distribution information includes global or regional distribution;

[0054] Summarize the plant information of each plant respectively to obtain a plant information set corresponding to each plant;

[0055] Label the plant image information and plant text information in each obtained plant information set, and summarize the labeled parts to obtain a corresponding sample feature set.

[0056] It should be further noted that in the specific implementation process, the process of training the deep learning model according to the obtained sample feature set includes:

[0057] According to the obtained sample feature set, construct an image sample training set and a text sample training set respectively;

[0058] Obtain several batches of data pairs according to the image samples in the image sample training set and the text samples in the text sample training set;

[0059] Input the obtained data pairs into the deep learning model batch by batch;

[0060] The deep learning model extracts the image feature vectors and text feature vectors corresponding to the image samples and text samples in the data pair respectively, as well as the predicted correlation coefficients between the image feature vectors and text feature vectors;

[0061] Denote the obtained image feature vectors as i, i = 1, 2, ……, n;

[0062] Denote the obtained text feature vectors as j, j = 1, 2, ……, n;

[0063] Then the corresponding contrast loss function is obtained as:

[0064] ;

[0065] Among them, is a boundary value, and > 0, is the predicted correlation coefficient between the image feature vector labeled i and the text feature vector labeled j;

[0066] Iteratively train the deep learning model until the contrast loss function of the deep learning is lower than the preset value or the number of iterations reaches the preset number, thereby completing the training of the deep learning model;

[0067] Construct a validation set and a test set, input the constructed validation set and test set into the trained deep learning model, evaluate the performance of the deep learning model according to the output of the deep learning model, and after passing the evaluation, output the corresponding recognition features and generate the corresponding flora content.

[0068] It should be further noted that in the specific implementation process, the specific process of generating the flora content is as follows:

[0069] Generate corresponding plant labels for the names of each plant, associate the corresponding recognition features with the plant labels, generate flora content corresponding to the plant labels according to the plant labels and the associated recognition features, and output the flora content according to natural language text;

[0070] Illustrate with examples:

[0071] Set the plant label as A, and the associated recognition features are respectively:

[0072] Morphological features: oval leaves, white flowers, five-petaled flowers, and the fruit is a round berry;

[0073] Ecological features: moist soil environment, warm climate;

[0074] Distribution features: southeastern Asia, Southeast Asian region, forest edge;

[0075] Then the corresponding flora content generated is: "This plant has oval leaves, white five-petaled flowers, and the fruit is a round berry. It usually grows at the forest edge in a warm climate, adapts to a moist soil environment, and is distributed in southeastern Asia, especially common in southern China and the Southeast Asian region;

[0076] Associate the output flora content with the corresponding plant image information and generate corresponding plant information entries;

[0077] Summarize the plant information entries of all plants to complete the construction of the plant information database.

[0078] It should be further noted that in the specific implementation process, the process of constructing a species key and identifying the plants to be identified through the species key includes:

[0079] For each plant information entry, obtain all the characteristics corresponding to the plant information entry, and establish corresponding retrieval nodes respectively according to each obtained characteristic;

[0080] Classify each retrieval node into a judgment node and a selection node according to the type of the characteristic; it should be further noted that in the specific implementation process, the judgment node is specifically a "yes" or "no" judgment, such as whether the plant has fruits; the selection node is specifically an "either-or selection", such as the number of petals of the plant being "1", "2", "3",..., and select the selection node that conforms to the number of petals of the plant;

[0081] Connect each retrieval node to obtain a corresponding retrieval path;

[0082] Summarize the retrieval paths corresponding to all plant information entries, match the retrieval nodes on each retrieval path, merge the retrieval nodes of the same type, and record the merged retrieval nodes as set nodes, where the set nodes include at least one retrieval node;

[0083] Summarize the plants that meet each set node to obtain a corresponding plant species set;

[0084] Obtain the number of retrieval nodes merged by each set node, set the retrieval priority of the set node according to the number of merged retrieval nodes, where the more the number of merged retrieval nodes, the higher the retrieval priority of the set node, and juxtapose the set nodes with the same priority, thus completing the construction of the species retrieval table;

[0085] The user retrieves the plant to be identified according to the constructed species retrieval table, traverses each set node in the species retrieval table in turn, and determines the retrieval path of the plant to be identified;

[0086] Mark the plant species sets corresponding to all set nodes on the retrieval path, and obtain the intersection of the plants within all set nodes;

[0087] Then the plants within the intersection are the plants to be identified, and retrieve the plant flora content corresponding to the plant, thus completing the user's retrieval of the plant to be identified.

[0088] In another embodiment of the present invention, a plant flora and species retrieval table generation system is also disclosed, including a management center, and the management center is communicatively connected to a data input module, a deep learning module, and a user retrieval module;

[0089] The data input module is used to input the plant information of different plants in the existing public materials, and use the input plant information as sample data;

[0090] The deep learning module is used to perform model training based on sample data, generate flora content according to the training results, and construct a plant information database;

[0091] The user retrieval module is used to construct a corresponding species retrieval table according to the plant information database, and the user retrieves the plant to be identified and the corresponding flora content according to the constructed species retrieval table.

[0092] The above is only a preferred embodiment of the present invention, and does not impose any form of limitation on the present invention. Although the present invention has been disclosed above with a preferred embodiment, it is not intended to limit the present invention. Any person skilled in the art can make some changes or modifications to equivalent embodiments by using the above-disclosed technical content within the scope of the technical solution of the present invention. However, as long as the content of the technical solution of the present invention is not departed from, any modification or equivalent replacement made to the above embodiments based on the technical essence of the present invention still falls within the scope of the technical solution of the present invention.

Claims

1. A method for generating a flora and species checklist based on deep learning, characterized in that, It includes the following steps: Step S1: Collect sample data, extract features from the sample data, and obtain the corresponding sample feature set; Step S2: Train the deep learning model according to the obtained sample feature set, generate flora content according to the training results, and construct a plant information database; Step S3: Construct a species key, and identify the plants to be identified through the species key.

2. The method for generating a flora and a species checklist based on deep learning according to claim 1, wherein The process of collecting sample data, extracting features from the sample data, and obtaining the corresponding sample feature set includes: Based on existing public materials, collect plant information of different plants; among them, the existing public materials include public databases, scientific research institutions, floras, and other literatures; The plant information includes plant image information and plant text information, and the plant text information includes morphological feature description information, ecological habit information, and growth distribution information; Summarize the plant information of each plant respectively to obtain a plant information set corresponding to each plant; Label the plant image information and plant text information in each obtained plant information set, and summarize the labeled parts to obtain the corresponding sample feature set.

3. The method for generating a flora and a species checklist based on deep learning according to claim 2, wherein, The process of training the deep learning model according to the obtained sample feature set includes: According to the obtained sample feature set, construct an image sample training set and a text sample training set respectively; Obtain several batches of data pairs according to the image samples in the image sample training set and the text samples in the text sample training set; Input the obtained data pairs into the deep learning model batch by batch; The deep learning model extracts the corresponding image feature vectors and text feature vectors for the image samples and text samples in the data pair respectively, as well as the predicted correlation coefficients between the image feature vectors and the text feature vectors, and then obtains the corresponding contrast loss function; Perform iterative training on the deep learning model until the contrast loss function of the deep learning is lower than the preset value or the number of iterations reaches the preset number, so as to complete the training of the deep learning model; Construct a validation set and a test set, input the constructed validation set and test set into the trained deep learning model, evaluate the performance of the deep learning model according to the output of the deep learning model, and after passing the evaluation, output the corresponding recognition features and generate the corresponding flora content.

4. The method for generating a flora and a species checklist based on deep learning according to claim 3, wherein, The specific process of generating flora content is: Generate corresponding plant labels with the names of each plant, associate the corresponding recognition features with the plant labels, generate flora content corresponding to the plant labels according to the plant labels and the associated recognition features, and output the flora content according to natural language text; Associate the output flora content with the corresponding plant image information, and generate the corresponding plant information entries; Summarize the plant information entries of all plants to complete the construction of the plant information database.

5. The method for generating a flora and a species checklist based on deep learning according to claim 4, wherein The process of constructing a species key includes: According to each plant information entry, obtain all the features corresponding to the plant information entry, and establish corresponding retrieval nodes according to the obtained features respectively; Classify each retrieval node into a judgment node and a selection node according to the type of the feature; Connect each retrieval node to obtain the corresponding retrieval path; Summarize the retrieval paths corresponding to all plant information entries, match the retrieval nodes on each retrieval path, merge the retrieval nodes of the same type, and record the merged retrieval nodes as set nodes; Summarize the plants that meet each set node to obtain the corresponding plant species set; Obtain the number of retrieval nodes merged by each set node, set the retrieval priority of the set node according to the number of merged retrieval nodes, and juxtapose the set nodes with the same priority to complete the construction of the species retrieval table.

6. The method for generating a flora and a species checklist based on deep learning according to claim 5, wherein, The process of identifying the plants to be identified through the species retrieval table includes: The user retrieves the plants to be identified according to the constructed species retrieval table, traverses each set node in the species retrieval table in turn, and determines the retrieval path of the plants to be identified; Mark the plant species sets corresponding to all set nodes on the retrieval path, and obtain the intersection of the plants within all set nodes; Then the plants within the intersection are the plants to be identified, and the plant flora content corresponding to the plants is retrieved to complete the user's retrieval of the plants to be identified.

7. A flora and species checklist generation system applied to the method for generating a flora and species checklist based on deep learning according to any one of claims 1 to 6, including a management center, characterized in that, The management center is communicatively connected to a data input module, a deep learning module, and a user retrieval module; The data input module is used to input the plant information of different plants in the existing public materials and use the input plant information as sample data; The deep learning module is used to perform model training according to the sample data, generate plant flora content according to the training results, and construct a plant information database; The user retrieval module is used to construct a corresponding species retrieval table according to the plant information database, and the user retrieves the plants to be identified and the corresponding plant flora content according to the constructed species retrieval table.

Images