High-precision short-wave infrared hyperspectral imaging soil plastic in-situ detection method and device

Abstract

The application discloses a kind of high-precision short-wave infrared hyperspectral imaging soil plastic in-situ detection method and device.The device is carried on unmanned aerial vehicle or indoor detection platform, carries out wide-range short-wave infrared hyperspectral imaging to soil, and data is input into multi-scale three-dimensional convolution instance segmentation network, network is fused spatial-spectral dual mode feature extraction, can realize the pixel-level classification of plastic target under complex soil background, even plastic can be effectively identified even if there is partial occlusion or fragmentation.Statistics the kind, density, spatial distribution and material traceability information of plastic in soil area, generates plastic distribution space graph, for environmental plastic recycling path planning.The application improves the efficient sorting capacity of plastic packaging waste through identification technology, solves the defects of poor in-situ classification and identification precision of traditional recycling methods in processing mixed, colored or contaminated plastics.

Description

TECHNICAL FIELD

[0001] The application belongs to the field of environmental resource recycling and protection, and particularly relates to a high-precision short-wave infrared hyperspectral imaging soil plastic in-situ detection method and device. BACKGROUND

[0002] The EU-funded Polymark project and the HolyGrail 2.0 project both aim to promote the efficiency and intelligence of the plastic recycling system by improving the identification and classification technology of plastic packaging, and to promote the recycling of resources. Among them, the Polymark project mainly focuses on developing an identification system based on chemical markers, adding unique marks on plastic packaging that can be detected during recycling, so that different types of plastics can be accurately sorted, improving the efficiency of recycling and the purity of recycled materials. The HolyGrail 2.0 project embeds invisible information on the surface of the packaging through digital watermarking technology, enabling rapid identification of key attributes such as packaging materials and purposes. This information can be read by intelligent camera systems on the sorting line, significantly improving the automated classification accuracy of plastic packaging (including colored plastics). The core goal of these two projects is consistent: through marking and identification technology, to improve the efficient sorting ability of plastic packaging waste, and to solve the technical bottlenecks of traditional recycling methods in dealing with mixed, colored or contaminated plastics. However, the Polymark project and the HolyGrail 2.0 project need to use chemical markers and digital watermarks to mark plastics, which will provide the cost and expense of plastic production, and the marking will be damaged due to stains during use, thus cannot be identified for recycling, and is not conducive to large-scale promotion and use.

[0003] In order to overcome the marking use defects of chemical markers and digital watermarks of the Polymark project and the HolyGrail 2.0 project, the application proposes a technical solution that does not need marking, and classifies and identifies the types of plastics on complex soil according to the intrinsic absorption spectrum of the plastic material, which helps to promote the efficiency and intelligence of the plastic recycling system, and has important significance for promoting the recycling of resources. SUMMARY

[0004] To overcome the problems of the prior art, the present invention aims to provide a high-precision short-wave infrared hyperspectral imaging method and device for in-situ detection of soil plastics. The present invention can detect in-situ soil plastics using short-wave infrared hyperspectral imaging. The short-wave infrared hyperspectral imaging data can be segmented into pixel instances using a plastic 3D convolutional instance segmentation deep network model. Based on the instance segmentation results, the types and number of individual instances of various plastics in the soil are independently identified, and finally, the types, density, and number of individual instances of plastics in the soil of the detection area are counted. Short-wave infrared hyperspectral imaging can avoid the interference of visible light on color, obtain the intrinsic absorption spectrum of plastics, and thus can identify more than ten different types of plastics in different colors.

[0005] The technical solution for achieving the purpose of the present invention is as follows:

[0006] A high-precision short-wave infrared hyperspectral imaging in-situ detection method for soil plastics comprises the following steps:

[0007] S1. Use a shortwave infrared hyperspectral imager mounted on an unmanned aerial vehicle (UAV) or indoor testing platform to perform hyperspectral imaging of the soil area to be tested, obtaining a hyperspectral data cube with a wavelength range of 900-1800 nm and ≥400 spectral channels.

[0008] S2. Performing radiation calibration, background noise suppression, spectral smoothing, and absorption peak normalization on the hyperspectral data cube to obtain preprocessed data reflecting the intrinsic absorption spectral characteristics of the plastic;

[0009] S3. Input the preprocessed data obtained in step S2 into a pretrained Multi-Scale 3D Convolutional Instance Segmentation Network for Soil and Plastic (MS3D-ISNet). By integrating a spatial-spectral dual-modal feature extraction module, pixel-level instance segmentation results of soil and plastic are obtained. The instance segmentation results include the location of plastic pixels, type labels, and individual instance IDs.

[0010] S4. Based on the instance segmentation results, the types, density, spatial distribution, and material traceability information of plastics in the tested soil area are collected for pollution source tracking and recycling path planning, forming a quantitative analysis report on soil plastic pollution.

[0011] The multi-scale three-dimensional convolutional instance segmentation network includes a three-dimensional convolutional feature extraction module, a spatial-spectral dual-stream feature fusion module and an instance segmentation decoding module; the three-dimensional convolutional feature extraction module performs spatial-spectral multimodal feature extraction on the input short-wave infrared hyperspectral data; the feature fusion module uses the residual channel attention mechanism to dynamically weighted fuse feature maps of different scales; the instance segmentation decoding module realizes pixel-level mask generation, bounding box prediction and material traceability classification of plastic targets.

[0012] The described method can simultaneously and quickly and accurately identify common plastics in soil, including PE, PP, PVC, PET, PS, PA, PMMA, PHC, and PVA.

[0013] Step S4. The specific volume of soil sample obtained from the soil in situ or detected by drone is (x, y, z). The plastic individuals in the first surface layer of the soil sample are segmented by type and instance using the soil plastic 3D convolutional instance segmentation deep network; the number of types of plastics in the first surface layer of the current soil sample is obtained. T i , where n is the number of types of plastics in the soil; the mass of plastics in the soil samples of the area is estimated as follows:

[0014] P i is the specific volume of plastic type, i is the distribution density, V i Estimate the total survey area volume for soils.

[0015] The UAV is equipped with a short-wave infrared hyperspectral imager device, which performs a large-scale scan of the area to be tested according to a preset flight mode and path, and realizes real-time in-situ positioning and classification detection of soil plastics.

[0016] The method, step S1. The short-wave infrared hyperspectral imager includes an imaging lens, a slit, a collimating lens, a prism-near-infrared grating-prism combination, a Dove prism, a focusing lens and a short-wave infrared camera arranged in sequence, and a first near-infrared light source arranged around the first lens and a second near-infrared light source arranged around the second lens; the imaging lens images the target image of the plastic in the soil at the slit position, and the linear area light beam passing through the slit is collimated into a parallel light beam by the collimating lens; the parallel light beam is separated by wavelength after passing through the prism-near-infrared grating-prism combination to form light beams with different diffraction angles, and then focused on the short-wave infrared camera by the focusing lens to form a hyperspectral image.

[0017] The method described uses short-wave infrared hyperspectral imaging technology to obtain spectral information of soil samples in real time, realize in-situ detection and classification identification of plastic pollutants in the soil, and is used for sorting plastic packaging waste.

[0018] A device used according to the method comprises an imaging lens, a slit, a collimating lens, a prism-near-infrared grating-prism combination, a dove prism, a focusing lens and a short-wave infrared camera, which are arranged in sequence, and a first near-infrared light source and a second near-infrared light source arranged around the imaging lens; the imaging lens forms a target image of plastic in soil at the position of the adjustable slit, and the linear area light beam passing through the slit is collimated into a parallel light beam by the collimating lens; the parallel light beam is split according to wavelength after passing through the prism-near-infrared grating-prism combination to form light beams with different diffraction angles; the dove prism rotates the image by a certain angle, and then focuses the image on the short-wave infrared camera by the focusing lens to form a hyperspectral image.

[0019] Beneficial effects of the present invention:

[0020] This invention discloses a method and apparatus for investigating colored plastics in soil using a shortwave infrared hyperspectral imager. This method can detect plastics in situ in soil using shortwave infrared hyperspectral imaging. The shortwave infrared hyperspectral imaging data can be segmented into pixel instances using a deep 3D convolutional instance segmentation model for plastics. Based on the instance segmentation results, the types and number of individual instances of various plastics in the soil are independently identified. Finally, the type, density, and number of individual instances of plastics in the soil within the detection area are counted. Shortwave infrared hyperspectral imaging avoids the interference of visible light on color, deriving the intrinsic absorption spectrum of plastics, and thus enabling the identification of different types of plastics in different colors.

[0021] This invention overcomes the defect of traditional low-precision spectral resolution that cannot accurately identify plastic types. It can quickly and accurately identify more than ten common plastic types, such as PE, PP, PVC, in the soil, as well as their density and spatial distribution information, providing more reliable data support for soil environmental surveys and promoting the development of plastic recycling and environmental protection. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 This is a flow chart of the high-precision shortwave infrared hyperspectral imaging soil plastic in situ detection method.

[0023] Figure 2 It is a device that uses high-precision short-wave infrared hyperspectral imaging to detect soil plastic in situ.

[0024] Figure 3 This is a schematic diagram of the MS3D-ISNet network structure.

[0025] Figure 4 It is the short-wave infrared hyperspectral curve used by the present invention to identify different types of plastics.

[0026] Figure 5 It is a rendering of different types of plastics recognized by the present invention.

[0027] Figure 2Icons in the figure: imaging lens 1, slit 2, collimating lens 3, prism-near-infrared grating-prism 4, Dove prism 5, focusing lens 6, short-wave infrared camera 7, first lens 8, first near-infrared light source 9, second lens 10, second near-infrared light source 11. DETAILED DESCRIPTION

[0028] The present invention will be further described below with reference to the accompanying drawings and embodiments.

[0029] like Figure 1 As shown, a high-precision short-wave infrared hyperspectral imaging in-situ detection method for soil plastics includes the following steps:

[0030] S1. Use a shortwave infrared hyperspectral imaging device mounted on a drone or indoor testing platform to perform hyperspectral imaging of the soil area to be tested, generating a hyperspectral data cube with a wavelength range of 900-1800 nm and ≥400 spectral channels. The wavelength range of 900-1800 nm is characteristic for plastics and avoids interference from color on visible light absorption. ≥400 spectral channels provide more detailed and rich data, enabling high-precision plastic identification.

[0031] S2. Performing radiometric calibration, background noise suppression, spectral smoothing, and absorption peak normalization on the hyperspectral data cube to obtain preprocessed data reflecting the intrinsic absorption spectral characteristics of the plastic.

[0032] S3. The preprocessed data obtained in step S2 is fed into a pre-trained soil-plastic multi-scale 3D convolutional instance segmentation network (MS3D-ISNet). By integrating the spatial-spectral dual-mode feature extraction module, pixel-level instance segmentation results of soil plastic are obtained. The instance segmentation results include the location of plastic pixels, type labels, and instance individual identifiers (IDs). The detailed architecture and workflow of the proposed MS3D-Net model are shown in the figure. Figure 3As shown in Figure 1. First, the three-dimensional hyperspectral data cube is preprocessed through a convolutional layer to initially extract its spatial-spectral features. The data then enters the encoder module designed in this paper, which consists of two parts: a deep convolutional neural network and a dilated convolution. The ResNet-based DCNN contains multiple residual modules (ResBlocks). These modules utilize shortcut connections to allow features to propagate directly across layers, effectively overcoming the vanishing gradient problem and supporting efficient training of deeper neural networks. Each residual module in the DCNN extracts hierarchical and deeper spatial-spectral features step by step, effectively capturing the inherent correlations within the hyperspectral data. The feature maps processed by the DCNN are then fed into atrous convolutions (also known as dilated convolutions) with different dilation rates to further capture multi-scale contextual information. Dilated convolutions can significantly expand the network's receptive field without reducing spatial resolution, effectively preserving the detailed information necessary for accurate segmentation.

[0033] S4. Based on the instance segmentation results, the type, density, spatial distribution, and material traceability of plastics within the tested soil area are collected for pollution source tracking and recycling route planning, generating a quantitative analysis report on soil plastic pollution. This technology overcomes the limitations of traditional low-precision spectral resolution, which prevents accurate identification of plastic types. It can simultaneously and accurately identify more than ten common plastics in soil, including PE, PP, and PVC. This identification technology improves the efficient sorting of plastic packaging waste and addresses the technical bottlenecks of traditional recycling methods when dealing with mixed, colored, or contaminated plastics.

[0034] like Figure 2 As shown, the short-wave infrared hyperspectral imager device includes an imaging lens 1, a slit 2, a collimating lens 3, a prism-near-infrared grating-prism combination 4, a dove prism 5, a focusing lens 6 and a short-wave infrared camera 7, which are arranged in sequence, and a first near-infrared light source 9 and a second near-infrared light source 11 arranged around the imaging lens 1; the imaging lens 1 images the target image of the plastic in the soil at the position of the adjustable slit 2, and the linear area light beam passing through the slit 2 is collimated into a parallel light beam by the collimating lens 3; the parallel light beam is separated according to wavelength after passing through the prism-near-infrared grating-prism combination 4 to form light beams with different diffraction angles, the dove prism 5 rotates the image by a certain angle, and then focuses on the short-wave infrared camera 7 by the focusing lens 6 to form a hyperspectral image.

[0035] The multi-scale three-dimensional convolutional instance segmentation network includes a three-dimensional convolutional feature extraction module, a spatial-spectral dual-stream feature fusion module and an instance segmentation decoding module; the three-dimensional convolutional feature extraction module performs spatial-spectral multimodal feature extraction on the input short-wave infrared hyperspectral data; the feature fusion module uses the residual channel attention mechanism to dynamically weighted fuse feature maps of different scales; the instance segmentation decoding module realizes pixel-level mask generation, bounding box prediction and material traceability classification of plastic targets.

[0036] The high-precision short-wave infrared hyperspectral imaging in-situ detection method for soil plastics overcomes the defect that traditional low-precision spectral resolution cannot accurately identify the type of plastic. It can simultaneously and quickly and accurately identify more than ten common plastics in the soil, including but not limited to PE, PP, PVC, PET, PS, PA, PMMA, PHC, and PVA. Figure 4 It is the short-wave infrared hyperspectral curve used by the present invention to identify different types of plastics, wherein the spectral curves of various types of plastics are different. Figure 5 This is a rendering of different types of plastics identified by the present invention. Different plastics are mixed in the soil. Using the method proposed by the present invention, they can be well segmented and identified and marked with different colors.

[0037] The high-precision short-wave infrared hyperspectral imaging soil plastic in-situ detection method is described. The specific volume of soil sample obtained from the soil in-situ or detected by drone is (x, y, z). The soil plastic 3D convolutional instance segmentation deep network is used to perform type and instance segmentation on the plastic individuals in the first layer of the soil sample. In this way, the number of types of plastic individuals in the first layer of the current soil sample is obtained. T i , where n is the number of types of plastic in the soil. The mass of plastic in the soil sampled in the area is estimated as follows:

[0038]

[0039] P i is the specific volume of plastic type, i is the distribution density, V i Estimate the total survey area volume for soils.

[0040] The drone is equipped with a short-wave infrared hyperspectral imager device, which conducts a large-scale scan of the area to be tested according to the preset flight mode and path, and realizes real-time in-situ positioning and classification detection of soil plastics, significantly improving the efficiency of plastic environmental monitoring and reducing monitoring costs.

[0041] The unmanned aerial vehicle is equipped with a short-wave infrared hyperspectral imager device, and spectral information of soil samples is obtained in real time by using short-wave infrared hyperspectral imaging technology, so that in-situ detection and classification identification of plastic pollutants in the soil are realized; through the identification technology, the efficient sorting capability of plastic packaging waste is improved, and the technical bottleneck of traditional recycling methods in processing mixed, colored or contaminated plastics is solved.

[0042] The embodiments in the above description can be further combined or replaced, and the embodiments only describe the preferred embodiments of the present application, and do not limit the concept and scope of the present application. Without departing from the design idea of the present application, various changes and improvements of the technical solutions of the present application made by those skilled in the art all belong to the protection scope of the present application. The protection scope of the present application is given by the appended claims and any equivalent technical solutions thereof.

Claims

1. A high-precision short-wave infrared hyperspectral imaging soil plastic in-situ detection method, characterized in that: The steps include: S1. Use a shortwave infrared hyperspectral imager mounted on an unmanned aerial vehicle (UAV) or indoor testing platform to perform hyperspectral imaging of the soil area to be tested, obtaining a hyperspectral data cube with a wavelength range of 900-1800 nm and ≥400 spectral channels. S2. Performing radiation calibration, background noise suppression, spectral smoothing, and absorption peak normalization on the hyperspectral data cube to obtain preprocessed data reflecting the intrinsic absorption spectral characteristics of the plastic; S3. The preprocessed data obtained in step S2 is fed into a pre-trained soil-plastic multi-scale 3D convolutional instance segmentation network. By integrating a spatial-spectral dual-mode feature extraction module, pixel-level instance segmentation results for soil-plastic are obtained. The instance segmentation results include the location of plastic pixels, their type labels, and individual instance identifiers. S4. Based on the instance segmentation results, the type, density, spatial distribution, and material traceability of plastics within the tested soil area are collected. This information is used to track pollution sources and plan recycling routes, generating a quantitative analysis report on soil plastic pollution. The multi-scale 3D convolutional instance segmentation network includes a 3D convolutional feature extraction module, a spatial-spectral dual-stream feature fusion module, and an instance segmentation decoding module. The 3D convolutional feature extraction module performs spatial-spectral multimodal feature extraction on the input short-wave infrared hyperspectral data. The feature fusion module uses the residual channel attention mechanism to dynamically weighted fuse feature maps of different scales. The instance segmentation decoding module implements pixel-level mask generation, bounding box prediction, and material traceability classification for plastic targets. Step S4. A specific volume (x, y, z) of soil samples obtained in situ or detected by drone is used to segment the plastic individuals in the first surface layer of the soil sample using a soil plastic 3D convolutional instance segmentation deep network. To obtain the number of types of plastic in the first surface layer of the current soil sample T i , where n is the number of types of plastics in the soil; the mass of plastics in the soil samples of the area is estimated as follows: ；P i is the specific volume of plastic type, i is the distribution density, V i Estimate the total survey area volume for soils; Step S1. The short-wave infrared hyperspectral imager comprises an imaging lens (1), a slit (2), a collimating lens (3), a prism-near-infrared grating-prism combination (4), a Dove prism (5), a focusing lens (6) and a short-wave infrared camera (7) which are arranged in sequence, and a first near-infrared light source (9) arranged around the first lens (8) and a second near-infrared light source (11) arranged around the second lens (10); the imaging lens (1) images the target image of the plastic in the soil at the position of the slit (2), and the linear area light beam passing through the slit (2) is collimated into a parallel light beam by the collimating lens (3); the parallel light beam is separated according to wavelength after passing through the prism-near-infrared grating-prism combination (4) to form light beams with different diffraction angles, and then focused on the short-wave infrared camera (7) by the focusing lens (6) to form a hyperspectral image.

2. The method according to claim 1, characterized in that It can quickly and accurately identify common plastics in soil, including PE, PP, PVC, PET, PS, PA, PMMA, PHC, and PVA.

3. The method according to claim 1, characterized in that The UAV is equipped with a short-wave infrared hyperspectral imager device, which performs a large-scale scan of the area to be tested according to a preset flight mode and path, and realizes real-time in-situ positioning and classification detection of soil plastics.

4. The method according to claim 1, wherein: Short-wave infrared hyperspectral imaging technology is used to obtain spectral information of soil samples in real time, enabling in-situ detection and classification identification of plastic pollutants in the soil for the sorting of plastic packaging waste.

Images