Hyperspectral image instance segmentation method and system based on deep learning prediction probability

Abstract

The invention provides a hyperspectral image instance segmentation method and system based on a deep learning prediction probability, and the method comprises the steps: obtaining a spectral data set, inputting the spectral data set into a spectral classification model for training and verification, obtaining a pre-training weight, obtaining a hyperspectral original data result graph, processing the hyperspectral original data result graph to obtain a reflectivity and wavelength data curve of an end member, and carrying out the segmentation of a hyperspectral image instance. Inputting a pre-training weight to obtain a type value of the end member and a type prediction probability of the end member, generating an end member type result graph based on the type value of the end member, processing the type prediction probability of the end member to obtain a probability gray value, and generating a type prediction probability graph, and combining the end member type result graph with the type prediction probability graph to obtain hyperspectral instance segmentation data, and processing the hyperspectral instance segmentation data to obtain an instance segmentation result. According to the method, the relatively simple and efficient one-dimensional spectrum labeling is used for replacing two-dimensional image manual labeling, effective information of the hyperspectral data is fully explored and utilized, the influence of human subjectivity is reduced, and the hyperspectral data processing and analysis efficiency and performance are improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of hyperspectral data processing, and in particular relates to a hyperspectral image instance segmentation method and system based on deep learning prediction probability. Background Art

[0002] Hyperspectral imaging technology can perform static or dynamic scanning imaging on hundreds of bands, and has the advantages of high spectral resolution, a large number of bands, and unified maps. In the three-dimensional data cube obtained by hyperspectral imaging technology, the one-dimensional spectral information and two-dimensional spatial information of the target object are contained at the same time, and the amount of information far exceeds the single-channel grayscale image and the three-channel color image. Therefore, based on a variety of platforms such as satellites, aircraft, ground vehicles and submarines, hyperspectral imaging technology has been widely used in industrial inspection, medical health and agricultural management. At present, hyperspectral imaging technology has the ability to obtain spectral information with nanometer-level resolution, and the introduction of artificial intelligence methods such as deep learning has given computers the ability to quickly process and analyze large quantities of hyperspectral data, greatly improving the accuracy of target classification, target detection and semantic segmentation, but its instance segmentation performance and efficiency are limited by manual data annotation.

[0003] In the field of hyperspectral imaging, instance segmentation is mainly achieved through deep learning methods based on 2D images. However, the feature extraction process of 2D images is highly dependent on manually annotated image datasets. Not only is the annotation process complex and inefficient, but it is also affected by human subjectivity, which inevitably leads to instability in segmentation results and accuracy. The method for segmenting farmland blocks in satellite remote sensing images based on the improved Mask R-CNN model, with publication number CN113870278A, implements instance segmentation of farmland blocks through a deep learning method based on manual annotation, and obtains the boundaries and positions of farmland block instances. The hyperspectral image instance segmentation method and building instance segmentation method, with publication number CN116188774A, use hyperspectral image datasets annotated with instances for deep learning model training and instance segmentation. The instance segmentation effect of this method is better than that of existing methods, but no efficient or complete alternative method for data annotation has been proposed. Summary of the invention

[0004] In view of the shortcomings of the prior art, the purpose of the present invention is to provide a hyperspectral image instance segmentation method and system based on deep learning prediction probability, using relatively simple and efficient one-dimensional spectrum annotation instead of two-dimensional image manual annotation, fully exploring and utilizing the effective information of hyperspectral data, reducing the influence of human subjectivity, and improving the efficiency and performance of hyperspectral data processing and analysis.

[0005] In order to solve the above technical problems, the technical solution adopted by the present invention is:

[0006] A hyperspectral image instance segmentation method based on deep learning prediction probability, comprising:

[0007] Acquire a spectral data set, the spectral data set comprising a plurality of groups of input variables and a plurality of groups of corresponding output variables, the input variables at least comprising a standard reflectance and wavelength data curve, the output variables at least comprising a type value;

[0008] Input the spectral data set into the spectral classification model for training and verification to obtain pre-trained weights;

[0009] Obtain the hyperspectral raw data result graph and process it to obtain the reflectance and wavelength data curve of the end member, then input the reflectance and wavelength data curve of the end member into the pre-trained weight to obtain the type value of the end member and the type prediction probability of the end member;

[0010] Convert the type value of the end member into the end member color and generate the end member type result map;

[0011] Process the type prediction probability of the end member to obtain a probability gray value and generate a type prediction probability map;

[0012] The endmember type result map is combined with the type prediction probability map to obtain hyperspectral instance segmentation data, and the hyperspectral instance segmentation data is processed to obtain instance segmentation results.

[0013] Furthermore, the method for obtaining the standard reflectivity and wavelength data curve is:

[0014] Obtain standard reflectance and wavelength data curves through the spectral database, or

[0015] A standard light intensity and wavelength data curve is obtained through a spectral database, and a baseline correction and reflectivity calibration are performed on the standard light intensity and wavelength data curve to obtain a standard reflectivity and wavelength data curve;

[0016] The method for processing the hyperspectral raw data result graph and obtaining the reflectivity and wavelength data curve of the end member is:

[0017] The hyperspectral raw data result graph is standardized to obtain the light intensity and wavelength data curve, and the light intensity and wavelength data curve is baseline corrected and reflectance calibrated to obtain the reflectance and wavelength data curve.

[0018] Furthermore, the spectral dataset is randomly divided into a spectral training set and a spectral validation set according to the validation ratio and input into the spectral classification model for training and validation. The validation ratio ranges from 0.05 to 0.30, and hyperparameters are set. The hyperparameters include learning rate, batch size and number of iterations. The spectral classification model is a one-dimensional deep learning network model.

[0019] Furthermore, the method of processing the type prediction probability of the end member to obtain the probability gray value and generate the type prediction probability map is specifically as follows:

[0020] The type prediction probabilities are linearly stretched and rounded in sequence to obtain probability grayscale values, and a type prediction probability map is generated based on the probability grayscale values. The size of the type prediction probability map is the same as the size of the end member type result map.

[0021] Furthermore, the overlapping particle instance segmentation method processes the hyperspectral instance segmentation data to obtain an instance segmentation result, specifically comprising the following steps:

[0022] A region growing algorithm is used to process the hyperspectral instance segmentation data to obtain a class instance segmentation result, wherein the class instance segmentation result includes a plurality of class instance masks, and the class instance masks include a class instance boundary and a class instance color;

[0023] Determine the probability threshold, map all class instance boundaries into the probability layer and take the union to obtain the class instance region;

[0024] Run the watershed algorithm on the class instance area to obtain the instance segmentation result.

[0025] Furthermore, the method of using the region growing algorithm to process the hyperspectral instance segmentation data to obtain the class instance segmentation result is as follows:

[0026] Determine the seed point selection method, growth criteria and stop condition for hyperspectral instance segmentation data;

[0027] According to the seed point selection method, growth criteria and stopping conditions, a regional growing algorithm is run in the end member type result map, a seed point is selected as the initial end member, and an end member that meets the growth criteria is searched until the stopping condition is met to obtain a class instance segmentation result.

[0028] Furthermore, the method of running the watershed algorithm on the class instance region to obtain the instance segmentation result is as follows:

[0029] The end members that meet the overlapping grain boundary condition in the class instance region are classified as overlapping grain boundaries. The overlapping grain boundary condition is that the end member type value is equal to the standard type value and the probability gray value is less than or equal to the probability threshold.

[0030] A hyperspectral image instance segmentation system based on deep learning prediction probability, comprising:

[0031] A first acquisition module is used to acquire a spectral data set, wherein the spectral data set includes multiple groups of input variables and multiple groups of corresponding output variables, wherein the input variables at least include a standard reflectance and wavelength data curve, and the output variables at least include a type value;

[0032] A training module is used to input the spectral data set into the spectral classification model for training and verification to obtain pre-trained weights;

[0033] The second acquisition module is used to obtain the hyperspectral raw data result map and process it to obtain the reflectance and wavelength data curve of the end member, and then input the reflectance and wavelength data curve of the end member into the pre-trained weight to obtain the type value of the end member and the type prediction probability of the end member;

[0034] A third acquisition module is used to convert the type value of the endmember into the endmember color and generate an endmember type result map;

[0035] A fourth acquisition module, used for processing the type prediction probability of the end member to obtain a probability gray value and generate a type prediction probability map;

[0036] The fifth acquisition module is used to combine the end member type result map with the type prediction probability map to obtain hyperspectral instance segmentation data, and process the hyperspectral instance segmentation data to obtain the instance segmentation result.

[0037] An electronic device comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method for instance segmentation of hyperspectral images based on deep learning prediction probability is implemented.

[0038] A non-transitory computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the method for instance segmentation of a hyperspectral image based on deep learning prediction probability is implemented.

[0039] Compared with the prior art, the present invention has the following advantages and beneficial effects:

[0040] (1) The present invention uses relatively simple and efficient one-dimensional spectrum annotation instead of two-dimensional image annotation, and uses deep learning technology to accelerate and expand the recognition and supervised classification of one-dimensional spectral information, thereby improving data processing efficiency, quality and stability.

[0041] (2) The endmember type result map generated by the computer algorithm is used for instance segmentation, removing unfavorable factors such as blur and noise that may exist in the original image data.

[0042] (3) By combining the region growing algorithm and the watershed algorithm, we can effectively distinguish multiple spatially overlapping individuals of the same type under one-dimensional annotation conditions and obtain complete instance segmentation results. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The illustrative embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0044] Figure 1 It is a flow chart of a hyperspectral image instance segmentation method based on deep learning prediction probability of the present invention;

[0045] Figure 2 It is a schematic diagram of the process flow of the overlapping particle instance segmentation method of the present invention;

[0046] Figure 3 This is a hyperspectral raw data result diagram of a specific embodiment of the present invention;

[0047] Figure 4 It is a result diagram of end member type of a specific embodiment of the present invention;

[0048] Figure 5 This is a diagram of the segmentation result of an example of a specific embodiment of the present invention;

[0049] Figure 6 Schematic diagram of a hyperspectral image instance segmentation system based on deep learning prediction probability of the present invention. DETAILED DESCRIPTION

[0050] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the accompanying drawings in the embodiments of the present invention.

[0051] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first", "second", and the like are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first", "second", and the like may explicitly or implicitly include one or more of the features. In the description of the present invention, unless otherwise specified, "multiple" means two or more.

[0052] Example 1

[0053] Embodiment 1 provides a hyperspectral image instance segmentation method based on deep learning prediction probability, such as Figure 1 As shown, including:

[0054] Step S1: Acquire a spectral data set, the spectral data set includes multiple groups of input variables and multiple groups of corresponding output variables, the input variables at least include spectral curves obtained by processing the hyperspectral raw data result graph, and the output variables at least include type values;

[0055] Step S2: inputting the spectral data set into the spectral classification model for training and verification to obtain pre-trained weights;

[0056] Step S3: obtaining a new hyperspectral raw data result graph and processing it to obtain the spectral curve of the end member, and then inputting the spectral curve of the end member into the pre-trained weight to obtain the type value of the end member and the type prediction probability of the end member;

[0057] Step S4: converting the type value of the end member into the end member color and generating an end member type result graph;

[0058] Step S5: Processing the type prediction probability of the end member to obtain a probability gray value and generating a type prediction probability map;

[0059] Step S6: combining the endmember type result map with the type prediction probability map to obtain hyperspectral instance segmentation data, and processing the hyperspectral instance segmentation data to obtain instance segmentation results.

[0060] In step S1 and step S3 of this embodiment, the method of the reflectivity and wavelength data curve is:

[0061] The hyperspectral raw data result graph is standardized to obtain a light intensity and wavelength data curve, wherein the data size (i.e., the number of bands) of the light intensity and wavelength data curve is N, wherein N is a positive integer, the wavelength range of the light intensity and wavelength data curve is [SW, EW], the unit is nm, and the light intensity and wavelength data curve is one-dimensional data;

[0062] The light intensity and wavelength data curve is baseline corrected and reflectance calibrated to obtain a reflectance and wavelength data curve, and the reflectance and wavelength data curve is used as a spectral curve, wherein the data size (i.e., the number of bands) of the reflectance and wavelength data curve is N, the wavelength range is [SW, EW], the unit is nm, the reflectance range is [0, 1], and the reflectance and wavelength data curve is one-dimensional data.

[0063] Reference for existing standardized methods: GB / T6040-2019 General rules for infrared spectroscopy analysis methods.

[0064] In step S1 of this embodiment, the type value is a non-negative number, and the type value generally includes the type value corresponding to the sample and the type value corresponding to the background in the hyperspectral raw data result graph. For example, when the sample is dolomite or quartz, the type value corresponding to the background can be set to 0, the type value corresponding to the dolomite can be set to 1, and the type value corresponding to the quartz can be set to 2.

[0065] In step S2 of this embodiment, the spectral data set is randomly divided into a spectral training set and a spectral validation set according to the validation ratio, and input into the spectral classification model for training and validation. The validation ratio ranges from 0.05 to 0.30, and hyperparameters are set. The hyperparameters include learning rate, batch size and number of iterations. The spectral classification model is a one-dimensional deep learning network model.

[0066] In step S3 of this embodiment, the type value of the end member is a non-negative integer, and the range of the type prediction probability of the end member is [0, 1].

[0067] In step S4 of this embodiment, the color space is an RGB color space, the end member type result image is an RGB color image, and the size of the end member type result image is W*H, in units of px, where W represents the width size value in pixels; H represents the height size value in pixels.

[0068] In step S5 of this embodiment, the method of processing the type prediction probability of the end member to obtain the probability gray value and generate the type prediction probability map is specifically as follows:

[0069] The type prediction probabilities are linearly stretched and rounded in sequence to obtain probability grayscale values, and a type prediction probability map is generated based on the probability grayscale values. The size of the type prediction probability map is the same as that of the end member type result map.

[0070] Specifically, the probability grayscale value = [type prediction probability * 255].

[0071] The probability grayscale value is a non-negative integer in the range [0, 255].

[0072] The type prediction probability map is a grayscale image.

[0073] The size of the type prediction probability map is W*H, in px, which is the same as the size of the endmember type result map.

[0074] In step S6 of this embodiment, Figure 2 As shown, the overlapping particle instance segmentation method is used to process the hyperspectral instance segmentation data to obtain the instance segmentation result, which specifically includes the following steps:

[0075] Step S601: using a region growing algorithm to process the hyperspectral instance segmentation data to obtain a class instance segmentation result, the class instance segmentation result includes a number of class instance masks, and the class instance masks include class instance boundaries and class instance colors;

[0076] Step S602: determine the probability threshold, map all class instance boundaries into the probability layer and take the union to obtain the class instance region;

[0077] Step S604: running a watershed algorithm on the class instance region to obtain an instance segmentation result.

[0078] Specifically, the size of the hyperspectral instance segmentation data is W*H*2.

[0079] The hyperspectral instance segmentation data includes a type layer (ie, an endmember type result map) and a probability layer (ie, a type prediction probability map).

[0080] The size of the type layer and the probability layer are both W*H.

[0081] In step S601, the method of using the region growing algorithm to process the hyperspectral instance segmentation data to obtain the class instance segmentation result is specifically as follows:

[0082] Step S6011: determining a seed point selection method, a growth criterion and a stop condition for the hyperspectral instance segmentation data;

[0083] Step S6012: According to the seed point selection method, growth criteria and stopping conditions, run the region growing algorithm in the end member type result map, select the seed point as the initial end member, search for the end member that meets the growth criteria until the stopping conditions are met, and obtain the class instance segmentation result.

[0084] The reason why it is called "class instance segmentation result" is that compared with semantic segmentation, it can distinguish different individuals of the same type, which is something only instance segmentation can do, and semantic segmentation can only distinguish different types; compared with instance segmentation, the only thing it cannot do is distinguish individuals of the same type that overlap in space, so this embodiment continues to process the class instance segmentation result to obtain individuals of the same type that overlap in space.

[0085] Specifically, the class instance segmentation result includes several class instance masks.

[0086] The class instance mask includes the class instance boundary and the class instance color.

[0087] The color of the class instance is the same as the color of the endmembers located inside the class instance boundary in the endmember type result map. Although the colors are the same, the region growing criterion obtains the boundary point and type information compared with the endmember type result map.

[0088] In step S604, the method of running the watershed algorithm on the class instance region to obtain the instance segmentation result is specifically as follows:

[0089] The end members that meet the overlapping grain boundary conditions in the class instance region are classified as overlapping grain boundaries. The overlapping grain boundary conditions are that the end member type value is equal to the standard type value and the probability gray value is less than or equal to the probability threshold.

[0090] Specifically, the overlapping particle boundary condition is that the end member type value = 1 and the probability gray value ≤ the probability threshold.

[0091] The instance segmentation result includes several instance masks.

[0092] The instance mask includes instance boundary and instance color.

[0093] The hyperspectral image instance segmentation method based on deep learning prediction probability proposed in this embodiment is described in detail below with a specific embodiment.

[0094] This specific embodiment uses a Zhongdari VIX-N220 line scan hyperspectral camera and a 12mm fixed-focus FA lens to perform hyperspectral imaging on all six dolomite particles, and obtains hyperspectral raw data in the range of 400-1000nm, with the background being blue nitrile rubber.

[0095] In step S1, the hyperspectral raw data result graph is standardized to obtain a light intensity and wavelength data curve, and the light intensity and wavelength data curve is baseline corrected and the reflectance calibrated to obtain a reflectance and wavelength data curve. The size (i.e., the number of bands) is 601, the wavelength range is [400, 1000], the unit is nm, and the reflectance range is [0, 1].

[0096] In this specific embodiment, the sample type is dolomite, and the corresponding type value is 1; the background is blue nitrile rubber, and the corresponding type value is 0.

[0097] In step S2, the spectral dataset is randomly divided into a spectral training set and a spectral validation set according to the validation ratio, and then the hyperparameters are set and the spectral classification model is input for training and validation to obtain the pre-trained weights. The validation ratio is 0.30. The hyperparameters include the learning rate, batch size, and number of iterations. The learning rate is 0.0001, the batch size is 16, and the number of iterations is 100. The spectral classification model is a one-dimensional deep residual shrinkage network.

[0098] In step S3, after slicing the hyperspectral raw data result graph, the reflectance and wavelength data curve of the end member is obtained, and then the end member spectrum curve is input into the pre-trained weight to obtain the type value of the end member and the type prediction probability of the end member. Figure 3 As shown, it is a result diagram of the hyperspectral raw data of a specific embodiment of the present invention, and the data size is 400px*170px*601. The data size (ie, the number of bands) of the reflectivity and wavelength data curve of the end member is 601.

[0099] In step S4, the size of the end member type result graph is 400px*170px, such as Figure 4 The figure shows the end member type result diagram of a specific embodiment of the present invention.

[0100] In step S5, the size of the type prediction probability map is 400px*170px.

[0101] In step S6, the end member type result map is combined with the type prediction probability map to obtain the hyperspectral instance segmentation data. The hyperspectral instance segmentation data is processed using the overlapping particle instance segmentation method to obtain the instance segmentation result. The size of the hyperspectral instance segmentation data is 400px*170px*2. The hyperspectral instance segmentation data includes a type layer and a probability layer. The size of the type layer and the probability layer are both 400px*170px.

[0102] The overlapping particle instance segmentation method includes the following steps:

[0103] Determine the seed point selection method, growth criterion and stop condition. The seed point selection method is to randomly select endmembers with endmember type values ​​of 0 and 1 respectively. The growth criterion is to be spatially adjacent to the seed point and have the same endmember type value. The stop condition is to find all W*H endmembers in the image.

[0104] According to the seed point selection method, growth criteria and stop condition, the regional growing algorithm is run in the type layer, the seed point is selected as the initial end member, and the end member that meets the growth criteria is searched until the stop condition is met, and the class instance segmentation result is obtained. The class instance segmentation result includes the background and 4 dolomite particles;

[0105] Determine the probability threshold, map all class instance boundaries into the probability layer and take the union to obtain the class instance region, and the probability threshold is 255*16.7%=42.6.

[0106] The watershed algorithm is run on the class instance region, and the endmembers that meet the overlapping particle boundary conditions in the class instance region are classified as overlapping particle boundaries to obtain the instance segmentation result. The overlapping particle boundary conditions are that the endmember type value = 1 and the probability gray value ≤ the probability threshold. The instance segmentation result includes the background and all 6 dolomite particles, such as Figure 5 , which is a diagram of the segmentation result of an example according to a specific embodiment of the present invention.

[0107] Example 2

[0108] Embodiment 2 provides a hyperspectral image instance segmentation system based on deep learning prediction probability, such as Figure 5 As shown, including:

[0109] A first acquisition module is used to acquire a spectral data set, wherein the spectral data set includes multiple groups of input variables and multiple groups of corresponding output variables, wherein the input variables at least include a standard reflectance and wavelength data curve, and the output variables at least include a type value;

[0110] A training module is used to input the spectral data set into the spectral classification model for training and verification to obtain pre-trained weights;

[0111] The second acquisition module is used to obtain the hyperspectral raw data result map and process it to obtain the reflectance and wavelength data curve of the end member, and then input the reflectance and wavelength data curve of the end member into the pre-trained weight to obtain the type value of the end member and the type prediction probability of the end member;

[0112] A third acquisition module is used to convert the type value of the endmember into the endmember color and generate an endmember type result map;

[0113] A fourth acquisition module, used for processing the type prediction probability of the end member to obtain a probability gray value and generate a type prediction probability map;

[0114] The fifth acquisition module is used to combine the end member type result map with the type prediction probability map to obtain hyperspectral instance segmentation data, and process the hyperspectral instance segmentation data to obtain the instance segmentation result.

[0115] Example 3

[0116] Embodiment 3 provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned method for hyperspectral image instance segmentation based on deep learning prediction probability when executing the program.

[0117] Example 4

[0118] Embodiment 4 A non-transitory computer-readable storage medium stores a computer program thereon, and when the computer program is executed by a processor, the method for instance segmentation of a hyperspectral image based on deep learning prediction probability is implemented.

[0119] The memory in the embodiment of the present invention is used to store various types of data to support the operation of the electronic device. Examples of such data include: any computer program used to operate on the electronic device.

[0120] The hyperspectral image instance segmentation method based on deep learning prediction probability disclosed in the embodiment of the present invention can be applied to a processor or implemented by a processor. The processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the hyperspectral image instance segmentation method based on deep learning prediction probability can be completed by hardware integrated logic circuits or software instructions in the processor. The above-mentioned processor may be a general-purpose processor, a digital signal processor (DSP, Digital Signal Processor), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The processor can implement or execute the methods, steps and logic block diagrams disclosed in the embodiment of the present invention. The general-purpose processor may be a microprocessor or any conventional processor, etc. The steps of the method disclosed in the embodiment of the present invention can be directly embodied as a hardware decoding processor to execute, or a combination of hardware and software modules in the decoding processor to execute. The software module can be located in a storage medium, which is located in a memory. The processor reads the information in the memory and completes the steps of the hyperspectral image instance segmentation method based on deep learning prediction probability provided in the embodiment of the present invention in combination with its hardware.

[0121] In an exemplary embodiment, the electronic device may be implemented by one or more application specific integrated circuits (ASIC), DSP, programmable logic device (PLD), complex programmable logic device (CPLD), FPGA, general purpose processor, controller, microcontroller (MCU), microprocessor, or other electronic components to execute the aforementioned method.

[0122] It can be understood that the memory can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM); the magnetic surface memory can be a disk memory or a tape memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), synchronous static random access memory (SSRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM, SyncLink Dynamic Random Access Memory), and direct RAM bus random access memory (DRRAM, Direct Rambus Random Access Memory).The memories described in the embodiments of the present invention are intended to include, but are not limited to, these and any other suitable types of memories.

[0123] The above embodiments are merely examples of the technical solutions of the present invention. The methods involved in the present invention are not limited to the contents described in the above embodiments, but are subject to the scope defined in the claims. Any modification, supplement or equivalent replacement made by a person skilled in the art based on the embodiment is within the scope of protection required by the claims of the present invention.

Claims

1. A hyperspectral image instance segmentation method based on deep learning prediction probability, characterized in that: include: Acquire a spectral data set, the spectral data set comprising a plurality of groups of input variables and a plurality of groups of corresponding output variables, the input variables at least comprising a standard reflectance and wavelength data curve, the output variables at least comprising a type value; Input the spectral data set into the spectral classification model for training and verification to obtain pre-trained weights; Obtain the hyperspectral raw data result graph and process it to obtain the reflectance and wavelength data curve of the end member, then input the reflectance and wavelength data curve of the end member into the pre-trained weight to obtain the type value of the end member and the type prediction probability of the end member; Convert the type value of the end member into the end member color and generate the end member type result map; Process the type prediction probability of the end member to obtain a probability gray value and generate a type prediction probability map; The endmember type result map is combined with the type prediction probability map to obtain hyperspectral instance segmentation data, and the hyperspectral instance segmentation data is processed to obtain instance segmentation results.

2. The hyperspectral image instance segmentation method based on deep learning prediction probability according to claim 1 is characterized in that: The method for obtaining the standard reflectivity and wavelength data curve is: Obtain standard reflectance and wavelength data curves through the spectral database, or A standard light intensity and wavelength data curve is obtained through a spectral database, and a baseline correction and reflectivity calibration are performed on the standard light intensity and wavelength data curve to obtain a standard reflectivity and wavelength data curve; The method for processing the hyperspectral raw data result graph and obtaining the reflectivity and wavelength data curve of the end member is: The hyperspectral raw data result graph is standardized to obtain the light intensity and wavelength data curve, and the light intensity and wavelength data curve is baseline corrected and reflectance calibrated to obtain the reflectance and wavelength data curve.

3. The hyperspectral image instance segmentation method based on deep learning prediction probability according to claim 1 is characterized in that: The spectral dataset is randomly divided into a spectral training set and a spectral validation set according to the validation ratio, and input into the spectral classification model for training and validation. The validation ratio ranges from 0.05 to 0.30, and hyperparameters are set. The hyperparameters include learning rate, batch size and number of iterations. The spectral classification model is a one-dimensional deep learning network model.

4. The hyperspectral image instance segmentation method based on deep learning prediction probability according to claim 1 is characterized in that: The method of processing the type prediction probability of the end member to obtain the probability gray value and generate the type prediction probability map is as follows: The type prediction probabilities are linearly stretched and rounded in sequence to obtain probability grayscale values, and a type prediction probability map is generated based on the probability grayscale values. The size of the type prediction probability map is the same as the size of the end member type result map.

5. The hyperspectral image instance segmentation method based on deep learning prediction probability according to claim 1 is characterized in that: The overlapping particle instance segmentation method processes the hyperspectral instance segmentation data to obtain an instance segmentation result, specifically comprising the following steps: A region growing algorithm is used to process the hyperspectral instance segmentation data to obtain a class instance segmentation result, wherein the class instance segmentation result includes a plurality of class instance masks, and the class instance masks include a class instance boundary and a class instance color; Determine the probability threshold, map all class instance boundaries into the probability layer and take the union to obtain the class instance region; Run the watershed algorithm on the class instance area to obtain the instance segmentation result.

6. The hyperspectral image instance segmentation method based on deep learning prediction probability according to claim 5 is characterized in that: The specific method of using the region growing algorithm to process the hyperspectral instance segmentation data to obtain the class instance segmentation result is as follows: Determine the seed point selection method, growth criteria and stop condition for hyperspectral instance segmentation data; According to the seed point selection method, growth criteria and stopping conditions, a regional growing algorithm is run in the end member type result map, a seed point is selected as the initial end member, and an end member that meets the growth criteria is searched until the stopping condition is met to obtain a class instance segmentation result.

7. The hyperspectral image instance segmentation method based on deep learning prediction probability according to claim 5 is characterized in that: The specific method of running the watershed algorithm on the class instance area to obtain the instance segmentation result is: The end members that meet the overlapping grain boundary condition in the class instance region are classified as overlapping grain boundaries. The overlapping grain boundary condition is that the end member type value is equal to the standard type value and the probability gray value is less than or equal to the probability threshold.

8. A hyperspectral image instance segmentation system based on deep learning prediction probability, characterized in that: include: A first acquisition module is used to acquire a spectral data set, wherein the spectral data set includes multiple groups of input variables and multiple groups of corresponding output variables, wherein the input variables at least include a standard reflectance and wavelength data curve, and the output variables at least include a type value; A training module is used to input the spectral data set into the spectral classification model for training and verification to obtain pre-trained weights; The second acquisition module is used to obtain the hyperspectral raw data result map and process it to obtain the reflectance and wavelength data curve of the end member, and then input the reflectance and wavelength data curve of the end member into the pre-trained weight to obtain the type value of the end member and the type prediction probability of the end member; A third acquisition module is used to convert the type value of the endmember into the endmember color and generate an endmember type result map; A fourth acquisition module, used for processing the type prediction probability of the end member to obtain a probability gray value and generate a type prediction probability map; The fifth acquisition module is used to combine the end member type result map with the type prediction probability map to obtain hyperspectral instance segmentation data, and process the hyperspectral instance segmentation data to obtain the instance segmentation result.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the hyperspectral image instance segmentation method based on deep learning prediction probability as described in any one of claims 1 to 7 is implemented.

10. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for hyperspectral image instance segmentation based on deep learning prediction probability as described in any one of claims 1 to 7 is implemented.

Images