Optical remote sensing imaging method, device, equipment, medium and computer program product
By using off-axis three-mirror optical modules and image fusion technology, high spatial resolution hyperspectral images of targets with a range exceeding 100 kilometers were generated, solving the problems of insufficient spatial resolution and limited coverage of hyperspectral remote sensing satellites in small-scale fine monitoring.
Patent Information
- Application Number
- CN202511765818.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-11-27
- Publication Date
- 2026-02-27
AI Technical Summary
Existing hyperspectral remote sensing satellites cannot simultaneously achieve both hyperspectral and high spatial resolution, resulting in insufficient spatial resolution and limited coverage in small-scale fine monitoring.
An off-axis three-mirror optical module is used for beam splitting imaging to form panchromatic and hyperspectral images. Image fusion technology is then used to generate a high spatial resolution hyperspectral image of the target with a range of over 100 kilometers.
It achieves high spatial resolution and wide swath hyperspectral image fusion, solving the problems of insufficient spatial resolution and limited coverage, and improving the accuracy and coverage of monitoring.
Smart Images
Figure CN121582802A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of optical remote sensing imaging technology, and in particular to an optical remote sensing imaging method, apparatus, device, medium, and computer program product. Background Technology
[0002] Hyperspectral remote sensing imagery possesses ultra-high spectral resolution, providing richer information on the surface of ground objects. While hyperspectral remote sensing imagery boasts excellent spectral resolution, the signal-to-noise ratio (SNR) limitation of spaceborne optical payloads prevents it from simultaneously achieving both high spectral and high spatial resolution. Furthermore, existing operational satellites, in order to maintain a spectral SNR across hundreds of bands, are forced to use hyperspectral data with spatial resolutions ranging from meters to tens of meters. Coupled with the limited swath width of spaceborne hyperspectral optical payloads (only tens of kilometers), this results in insufficient spatial resolution for small-scale, detailed monitoring and limited coverage for macro-level surveys.
[0003] The above content is only used to help understand the technical solution of this application and does not represent an admission that the above content is prior art. Summary of the Invention
[0004] The main objective of this application is to provide an optical remote sensing imaging method, apparatus, device, medium, and computer program product, which aims to improve the spatial resolution and coverage width of hyperspectral imaging.
[0005] To achieve the above objectives, this application proposes an optical remote sensing imaging method applied to an optical remote sensing imaging device, the device including an off-axis three-mirror optical module, comprising: Determine the imaging field of view of the off-axis three-mirror optical module; Based on the imaging field of view, the ground swath width is determined, wherein light rays from the area corresponding to the ground swath width propagate to the off-axis three-mirror optical module; The light emitted from the off-axis three-mirror optical module is split into multiple paths for imaging to obtain panchromatic and hyperspectral images; The panchromatic image and the hyperspectral image are fused to obtain the target hyperspectral image.
[0006] In one embodiment, after fusing the panchromatic image and the hyperspectral image to obtain the target hyperspectral image, the method further includes: Target detection is performed on the hyperspectral image of the target to obtain the region of interest image; The image of the region of interest is sliced to obtain multiple target slices; The multiple target slices are transmitted back to the ground station.
[0007] In one embodiment, the step of splitting the light emitted from the off-axis three-mirror optical module to obtain a panchromatic image and a hyperspectral image includes: The light beam is split using a pre-set beam splitting element to form reflected light and transmitted light; The reflected light is subjected to hyperspectral imaging to obtain a hyperspectral image, and the transmitted light is subjected to panchromatic imaging to obtain a panchromatic image.
[0008] In one embodiment, the step of performing hyperspectral imaging on the reflected light to obtain a hyperspectral image, and performing panchromatic imaging on the transmitted light to obtain the panchromatic image, includes: After the reflected light enters the hyperspectral optical channel, a spectral scanning image is obtained by scanning the slit. After the transmitted light enters the panchromatic optical channel, the transmitted light is converted using a preset panchromatic detector to obtain the panchromatic image.
[0009] In one embodiment, the step of fusing the panchromatic image and the hyperspectral image to obtain the target hyperspectral image includes: Preprocess the panchromatic image and the hyperspectral image; Feature extraction is performed on the preprocessed panchromatic image to obtain high spatial resolution spatial detail features; Feature extraction is performed on the preprocessed hyperspectral image to obtain spectral features; The spectral features and the high spatial resolution spatial detail features are fused to obtain the target hyperspectral image.
[0010] In one embodiment, determining the ground width based on the imaging field of view includes: Obtain the satellite's orbital altitude; The ground width is determined based on the orbital height and the imaging field of view.
[0011] Furthermore, to achieve the above objectives, this application also proposes an optical remote sensing imaging device, which includes: The first determining module is used to determine the imaging field of view of the off-axis three-mirror optical module; The second determining module is used to determine the ground width based on the imaging field of view, wherein light rays from the area corresponding to the ground width propagate to the off-axis three-mirror optical module; The split imaging module is used to split the light emitted from the off-axis three-mirror optical module to obtain panchromatic and hyperspectral images. The image fusion module is used to fuse the panchromatic image and the hyperspectral image to obtain the target hyperspectral image.
[0012] In addition, to achieve the above objectives, this application also proposes an optical remote sensing imaging device, the device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the optical remote sensing imaging method as described above.
[0013] In addition, to achieve the above objectives, this application also proposes a storage medium, which is a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it implements the steps of the optical remote sensing imaging method described above.
[0014] In addition, to achieve the above objectives, this application also provides a computer program product, which includes a computer program that, when executed by a processor, implements the steps of the optical remote sensing imaging method described above.
[0015] This application provides an optical remote sensing imaging method, apparatus, device, medium, and computer program product. The optical remote sensing imaging method is applied to an optical remote sensing imaging apparatus, which includes an off-axis three-mirror optical module. The method includes: determining the imaging field of view of the off-axis three-mirror optical module; determining the ground swath width of the off-axis three-mirror optical module based on the imaging field of view; having light rays from the corresponding area of the ground swath propagate to the off-axis three-mirror optical module; splitting the light rays emitted from the off-axis three-mirror optical module into two imaging paths to obtain a panchromatic image and a hyperspectral image; and fusing the panchromatic image and the hyperspectral image to obtain a target hyperspectral image. This application achieves wide coverage with a large field of view exceeding 100 kilometers by employing an off-axis three-mirror optical module. The optical path is split into two optical channels: hyperspectral imaging and panchromatic imaging. The hyperspectral image and the high spatial resolution panchromatic image are obtained through split imaging, and then the panchromatic image and the hyperspectral image are fused to obtain a high spatial resolution target hyperspectral image exceeding 100 kilometers. Attached Figure Description
[0016] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.
[0017] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0018] Figure 1 This is a flowchart illustrating an embodiment of the optical remote sensing imaging method of this application. Figure 2A schematic diagram of ground imaging along the vertical direction of satellite flight; Figure 3 This is a flowchart illustrating Embodiment 2 of the optical remote sensing imaging method of this application; Figure 4 This is a flowchart illustrating Embodiment 3 of the optical remote sensing imaging method of this application; Figure 5 This is a flowchart illustrating Embodiment 4 of the optical remote sensing imaging method of this application; Figure 6 This is a schematic diagram of the module structure of the optical remote sensing imaging device according to an embodiment of this application; Figure 7 This is a schematic diagram of the device structure of the hardware operating environment involved in the optical remote sensing imaging method in the embodiments of this application.
[0019] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation
[0020] It should be understood that the specific embodiments described herein are merely illustrative of the technical solutions of this application and are not intended to limit this application.
[0021] To better understand the technical solution of this application, a detailed description will be provided below in conjunction with the accompanying drawings and specific implementation methods.
[0022] It should be noted that the executing entity in this embodiment can be a computing service device with data processing, network communication, and program execution functions, such as a tablet computer, personal computer, or mobile phone, or an electronic device, big data service platform, or optical remote sensing imaging system capable of performing the above functions. The following description uses an optical remote sensing imaging system as an example to illustrate this embodiment and the subsequent embodiments.
[0023] Hyperspectral remote sensing imagery possesses ultra-high spectral resolution, providing richer information on the surface of ground objects. Its narrow bandwidth and multi-band characteristics enable near-continuous spectral data, enhancing the ability to observe target attributes and match them with measured ground spectra. Furthermore, based on the spectral curves of ground objects, hyperspectral data can detect substances with specific spectral absorption characteristics, leading to precise target type differentiation. In addition, the increased number of image bands and spectral information provides more possibilities for ground object identification models and algorithms, and allows for the estimation of ground object state parameters. Its applications have expanded to encompass all aspects of Earth science, becoming an effective technical means in fields such as agricultural remote sensing, environmental monitoring, marine remote sensing, mineral exploration, forest fire monitoring, and oil and gas detection, playing an increasingly important role. While hyperspectral remote sensing imagery possesses excellent spectral resolution, the signal-to-noise ratio (SNR) limitation of spaceborne optical payloads prevents it from simultaneously achieving both hyperspectral and high spatial resolution. Existing operational satellites, to ensure a spectral SNR across hundreds of bands, are forced to use hyperspectral data with spatial resolutions ranging from meters to tens of meters. Furthermore, the swath width of spaceborne hyperspectral optical payloads is only tens of kilometers, resulting in insufficient spatial resolution for small-scale, detailed monitoring and limited coverage for macro-level surveys. Additionally, the large volume of hyperspectral data requires significant time for on-orbit transmission and ground processing, severely limiting the identification and monitoring of minute targets and the real-time requirements for industrial applications.
[0024] Based on this, this application provides an optical remote sensing imaging method applied to an optical remote sensing imaging device. The device includes an off-axis three-mirror optical module, a beam splitter, a panchromatic detector, and a processor. Light propagates to the off-axis three-mirror optical module, is focused, and then emitted to the beam splitter. The beam splitter separates the light into reflected and transmitted light. After the reflected light enters the hyperspectral optical channel, it is scanned through a slit to obtain a hyperspectral image. After the transmitted light enters the panchromatic optical channel, it is converted by a pre-set panchromatic detector to obtain a panchromatic image with sub-meter high spatial resolution. The processor fuses the panchromatic image and the hyperspectral image to obtain a high spatial resolution target hyperspectral image with a range exceeding 100 kilometers.
[0025] Specifically, refer to Figure 1 , Figure 1 This is a flowchart illustrating an embodiment of the optical remote sensing imaging method of this application.
[0026] Step S11: Determine the imaging field of view of the off-axis three-mirror optical module; It should be noted that, referring to Figure 2, Figure 2 This is a schematic diagram of ground imaging along the direction of satellite flight. Figure 2 In this context, α represents the imaging field of view of the off-axis three-mirror optical module.
[0027] Step S12: Determine the ground width based on the imaging field of view, wherein light rays from the area corresponding to the ground width propagate to the off-axis three-mirror optical module; It should be noted that the ground swath width is the width of the ground imaging coverage within the imaging field of view α.
[0028] Step S12 includes: acquiring the satellite's orbital altitude; and determining the ground swath width based on the orbital altitude and the imaging field of view.
[0029] In this embodiment, specifically, the orbital altitude of the satellite is obtained, for example, Figure 2 The orbital height H is used to determine the ground swath width of the ground image based on the orbital height and the imaging field of view. The formula for calculating the ground swath width is as follows: B = 2H × tan(α / 2), where B represents the ground swath width, H represents the orbital height, and α represents the imaging field of view.
[0030] It should be noted that when the satellite observes the ground through its optical system while in orbit, light emitted or reflected from a specific width of the observed area on the ground (i.e., the ground swath in this embodiment) propagates through the atmosphere and enters the satellite's off-axis three-mirror optical module. This off-axis three-mirror optical system consists of three non-coaxially arranged mirrors, and its core feature is that all mirrors are offset from the central axis of the optical system, forming an asymmetrical optical path. This off-axis three-mirror optical module achieves wide coverage exceeding 100 kilometers.
[0031] Step S13: The light emitted from the off-axis three-mirror optical module is split into multiple paths for imaging to obtain a panchromatic image and a hyperspectral image; It should be noted that this embodiment adopts a 1:N optical path splitting design, where 1 path is a panchromatic optical channel and N paths are hyperspectral optical channels. The 1:N optical path splitting design refers to an optical architecture that distributes the same incident light beam to one panchromatic optical channel and N hyperspectral optical channels. Optionally, the panchromatic imaging resolution is sub-meter, and the hyperspectral optical channel imaging resolution is on the order of ten meters. While meeting the signal-to-noise ratio requirements of the panchromatic optical channel imaging, the N value is maximized. By increasing the number of hyperspectral optical channels, more optical flux enters the hyperspectral system, compensating for the insufficient light intake caused by its narrow-band splitting.
[0032] In this embodiment, the light emitted from the off-axis three-mirror optical module is split by a preset beam splitter. Part of the split light is reflected by the beam splitter and enters the hyperspectral optical channel. Spectral scanning imaging is completed by scanning slits in conjunction with satellite orbit pushbroom, and a hyperspectral image is finally output. The other part of the light is transmitted through the beam splitter and enters the panchromatic optical channel. A preset panchromatic detector converts the broadband optical signal into an electrical signal, and a panchromatic image is finally output.
[0033] Step S14: The panchromatic image and the hyperspectral image are fused to obtain the target hyperspectral image.
[0034] It should be noted that this embodiment includes an image processor, which is an embedded program hardware with a built-in operating system similar to Linux, and can perform image processing functions, such as image stitching, radiometric correction, and target recognition.
[0035] In this embodiment, specifically, feature extraction is performed on the panchromatic image to obtain detailed features such as edges and textures, resulting in sub-meter-level high spatial resolution spatial detail features. In addition, feature extraction is performed on the hyperspectral image to retain the spectral features of the surface core. The spectral features and the high spatial resolution spatial detail features are fused, that is, the high spatial detail features are precisely injected and fused based on the spectral features, ultimately obtaining a target hyperspectral image with both sub-meter-level spatial resolution and a coverage width of over 100 kilometers.
[0036] This embodiment, through the above-described scheme, includes: determining the imaging field of view of the off-axis three-mirror optical module; determining the ground swath width of the off-axis three-mirror optical module based on the imaging field of view, with light rays from the corresponding area of the ground swath propagating to the off-axis three-mirror optical module; splitting the light rays emitted from the off-axis three-mirror optical module into two optical channels to obtain a panchromatic image and a hyperspectral image; and fusing the panchromatic image and the hyperspectral image to obtain a target hyperspectral image. This embodiment achieves wide coverage with a large field of view exceeding 100 kilometers by employing an off-axis three-mirror optical module. The optical path is split into two optical channels: hyperspectral imaging and panchromatic imaging. Split imaging yields a hyperspectral image and a high spatial resolution panchromatic image. Then, the panchromatic image and the hyperspectral image are fused to obtain a target hyperspectral image with high spatial resolution and a coverage range exceeding 100 kilometers.
[0037] In one feasible implementation, refer to Figure 3 , Figure 3 This is a schematic flowchart of an embodiment two of the optical remote sensing imaging method of this application. After fusing the panchromatic image and the hyperspectral image to obtain the target hyperspectral image, the method further includes: Step S21: Target detection is performed on the hyperspectral image of the target to obtain the region of interest image; Step S22: Slice the image of the region of interest to obtain multiple target slices; Step S23: The multiple target slices are transmitted back to the ground station.
[0038] It should be noted that hyperspectral data is large in volume, requiring significant time for on-orbit transmission and ground processing, which greatly limits the identification, monitoring, and real-time requirements of fine targets in industrial applications. In this embodiment, target detection is performed on the target hyperspectral image to determine the region where the target is located. Based on the region where the target is located, the corresponding region is cropped from the original target hyperspectral image to obtain a region of interest (ROI) image. Further, the ROI image is sliced according to a preset slice size to obtain multiple target slices, which are then transmitted to a ground station. Optionally, this transmission can be achieved via the satellite's data transmission antenna using common satellite hyperspectral frequencies such as the X-band or Ka-band.
[0039] This embodiment obtains a region of interest image by performing target detection on the hyperspectral image of the target; slices the region of interest image to obtain multiple target slices; and transmits the multiple target slices back to the ground station, effectively reducing the data transmission pressure on the spacecraft and improving the real-time performance of data transmission.
[0040] In one feasible implementation, refer to Figure 4 , Figure 4 This is a schematic flowchart of an embodiment three of the optical remote sensing imaging method of this application; the light emitted from the off-axis three-mirror optical module is split into multiple paths for imaging to obtain a panchromatic image and a hyperspectral image, including: Step S31: The light is split using a preset beam splitting element to form reflected light and transmitted light; It should be noted that the light emitted from the off-axis three-mirror optical module propagates to the beam-splitting element, which can be a dichroic separator, a beam-splitting prism, or a field-of-view divider, etc. Optionally, the beam-splitting element has high transmittance for broadband light (such as visible light and near-infrared full-band) corresponding to the panchromatic channel and high reflectance for narrow spectrum light (such as N subdivided bands) corresponding to the hyperspectral channel. The beam-splitting element splits the light into reflected and transmitted light. In this embodiment, the broadband panchromatic light passes through the dichroic separator and enters one panchromatic optical channel; all narrow spectrum hyperspectral light is directly reflected and enters the subsequent N hyperspectral optical channels.
[0041] Step S32: Perform hyperspectral imaging on the reflected light to obtain a hyperspectral image, and perform panchromatic imaging on the transmitted light to obtain a panchromatic image.
[0042] In this embodiment, after the reflected light enters the hyperspectral optical channel through a slit at the image plane of the off-axis three-mirror optical system, the slit images of different wavelengths are finally imaged at the focal plane of the hyperspectral camera, spreading out along a direction perpendicular to the slit. A hyperspectral image is obtained by scanning the field of view perpendicular to the slit direction. Optionally, in a specific example, the hyperspectral band light reflected from the beam-splitting element first illuminates the scanning slit. The width of the slit corresponds to a narrow band on the ground; for example, if the ground swath is over 100 kilometers wide, the slit only allows a 5-kilometer-wide narrow band of light to pass through. The ground narrow band light passing through the slit enters the beam-splitting component (e.g., grating, prism) within the hyperspectral optical channel. The beam-splitting component splits the narrow band light into N consecutive narrow spectral bands according to wavelength. Furthermore, the split light is projected onto a linear array detector within the hyperspectral channel. The detector converts the optical signal into an electrical signal, resulting in one-dimensional hyperspectral data of a narrow band with N spectral bands on the ground. By scanning the field of view perpendicular to the slit direction, a two-dimensional hyperspectral image with a full swath width exceeding 100 kilometers and N spectral bands is formed. The satellite continues to move forward in its orbit, meaning... Figure 2 The satellite's motion direction corresponding to the ground swath width H is obtained by scanning the satellite in orbit to obtain hyperspectral images with a swath width of over 100 kilometers for more ground targets.
[0043] In this embodiment, after the transmitted light enters the panchromatic optical channel, a preset panchromatic detector converts the transmitted light to obtain the panchromatic image. Optionally, in a specific example, after the transmitted light enters the panchromatic optical channel, it illuminates a preset panchromatic detector. The panchromatic detector can be a CCD (Charge-Coupled Device) or a CMOS (Complementary Metal-Oxide-Semiconductor) detector. The detector's photosensitive pixels have high responsivity to broadband light and convert the intensity of the light signal received by each pixel into a corresponding analog electrical signal. Further, the analog electrical signal output by the detector passes through a signal processing module within the panchromatic optical channel. The signal processing module converts the analog electrical signal into a digital signal (i.e., the grayscale value of the pixel), ultimately outputting a panchromatic image. Each pixel in the panchromatic image corresponds to a sub-meter spatial region on the ground, while retaining the brightness information of the broadband light.
[0044] This embodiment uses a pre-set beam splitter to split the light into reflected and transmitted light. After the reflected light enters the hyperspectral optical channel, spectral scanning imaging is performed through a scanning slit to obtain a hyperspectral image. After the transmitted light enters the panchromatic optical channel, a pre-set panchromatic detector converts the transmitted light to obtain a panchromatic image. Spectral scanning imaging through a scanning slit allows the hyperspectral optical channel to image a hyperspectral image containing both ground spatial information (over 100 km swath width) and spectral information. The transmitted light has a wide spectral range and sufficient light intake, enabling the panchromatic optical channel to image a panchromatic image with sub-meter high spatial resolution.
[0045] In one feasible implementation, refer to Figure 5 , Figure 5 This is a flowchart illustrating Embodiment 4 of the optical remote sensing imaging method of this application; the step of fusing the panchromatic image and the hyperspectral image to obtain the target hyperspectral image includes: Step S41: Preprocess the panchromatic image and the hyperspectral image; Step S42: Extract features from the preprocessed panchromatic image to obtain high spatial resolution spatial detail features; Step S43: Extract features from the preprocessed hyperspectral image to obtain spectral features; Step S44: The spectral features and the high spatial resolution spatial detail features are fused to obtain the target hyperspectral image.
[0046] It should be noted that preprocessing includes geometric registration, radiometric calibration, and other processing methods. For example, spatial pixel alignment is performed on panchromatic and hyperspectral data, grayscale values of panchromatic and hyperspectral images are converted into physical radiometric values (such as reflectance), and the brightness quantization range of the two is unified.
[0047] In this embodiment, the panchromatic image and the hyperspectral image are preprocessed; then, feature extraction is performed on the preprocessed panchromatic image to extract detailed information such as edges, textures, and contours of ground objects, obtaining high spatial resolution spatial detail features; in addition, feature extraction is also performed on the preprocessed hyperspectral image to obtain spectral morphology information, for example, extracting multi-band spectral curves (such as the characteristics of strong near-infrared reflectance and weak red light reflectance of vegetation) and spectral indices (such as the NDVI vegetation index) for each pixel to obtain spectral features. It should be noted that this embodiment does not limit the execution order of steps S42 and S43; optionally, steps S42 and S43 can be executed simultaneously.
[0048] Furthermore, the spectral features and the high spatial resolution spatial detail features are fused, for example, by using PCA (Principal Component Analysis Fusion Method) to fuse them, thereby injecting panchromatic spatial detail features into the hyperspectral spectral features as a base, resulting in a target hyperspectral image that has both sub-meter level spatial detail and complete spectral features.
[0049] This embodiment extracts features from the preprocessed panchromatic image to obtain high spatial resolution spatial detail features; in addition, it extracts features from the preprocessed hyperspectral image to obtain spectral features; then it fuses the spectral features and the high spatial resolution spatial detail features to obtain a target hyperspectral image with both sub-meter level spatial detail and complete spectral features and a range of over 100 kilometers.
[0050] It should be noted that the examples in the figure are only for understanding this application and do not constitute a limitation on the optical remote sensing imaging method of this application. Any simple modifications based on this technical concept are within the protection scope of this application.
[0051] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
[0052] This application also provides an optical remote sensing imaging device, please refer to... Figure 6 , Figure 6 This is a schematic diagram of the module structure of the optical remote sensing imaging device according to an embodiment of this application; the optical remote sensing imaging device includes: The first determining module 51 is used to determine the imaging field of view of the off-axis three-mirror optical module; The second determining module 52 is used to determine the ground width based on the imaging field of view, wherein light rays in the area corresponding to the ground width propagate to the off-axis three-mirror optical module; The split imaging module 53 is used to split the light emitted from the off-axis three-mirror optical module to obtain panchromatic and hyperspectral images. The image fusion module 54 is used to fuse the panchromatic image and the hyperspectral image to obtain the target hyperspectral image.
[0053] The optical remote sensing imaging device also includes: The detection module is used to perform target detection on the hyperspectral image of the target to obtain an image of the region of interest; The slicing module is used to slice the image of the region of interest to obtain multiple target slices; The backhaul module is used to transmit the multiple target slices back to the ground station.
[0054] The split imaging module 53 is also used for: The light beam is split using a pre-set beam splitting element to form reflected light and transmitted light; The reflected light is subjected to hyperspectral imaging to obtain a hyperspectral image, and the transmitted light is subjected to panchromatic imaging to obtain a panchromatic image.
[0055] The split imaging module 53 is also used for: After the reflected light enters the hyperspectral optical channel, a spectral scanning image is obtained by scanning the slit. After the transmitted light enters the panchromatic optical channel, the transmitted light is converted using a preset panchromatic detector to obtain the panchromatic image.
[0056] The image fusion module 54 is also used for: Preprocess the panchromatic image and the hyperspectral image; Feature extraction is performed on the preprocessed panchromatic image to obtain high spatial resolution spatial detail features; Feature extraction is performed on the preprocessed hyperspectral image to obtain spectral features; The spectral features and the high spatial resolution spatial detail features are fused to obtain the target hyperspectral image.
[0057] The second determining module 52 is further configured to: Obtain the satellite's orbital altitude; The ground width is determined based on the orbital height and the imaging field of view.
[0058] The optical remote sensing imaging device provided in this application, employing the optical remote sensing imaging method in the above embodiments, can solve the technical problems mentioned in the background art. Compared with the prior art, the beneficial effects of the optical remote sensing imaging device provided in this application are the same as the beneficial effects of the optical remote sensing imaging method provided in the above embodiments, and other technical features in the optical remote sensing imaging device are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.
[0059] This application provides an optical remote sensing imaging device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the optical remote sensing imaging method in the first embodiment described above.
[0060] The following is for reference. Figure 7 , Figure 7 This is a schematic diagram of the device structure of the hardware operating environment involved in the optical remote sensing imaging method in the embodiments of this application. The optical remote sensing imaging device in the embodiments of this application may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Description), PMPs (Portable Media Players), vehicle terminals (such as vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 7 The optical remote sensing imaging device shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of this application.
[0061] like Figure 7 As shown, the optical remote sensing imaging device may include a processing unit 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory 1002 or a program loaded from a storage device 1003 into a random access memory 1004. The random access memory 1004 also stores various programs and data required for the operation of the optical remote sensing imaging device. The processing unit 1001, the read-only memory 1002, and the random access memory 1004 are interconnected via a bus 1005. An input / output interface 1006 is also connected to the bus. Typically, the following systems can be connected to the input / output interface 1006: input devices 1007 including, for example, a touchscreen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1003 including, for example, magnetic tape, hard disk, etc.; and communication devices 1009. Communication device 1009 allows the optical remote sensing imaging device to communicate wirelessly or wiredly with other devices to exchange data. Although the figure shows optical remote sensing imaging devices with various systems, it should be understood that it is not required to implement or possess all of the systems shown. More or fewer systems may be implemented alternatively.
[0062] Specifically, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 1003, or installed from read-only memory 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of the embodiments disclosed in this application.
[0063] The optical remote sensing imaging device provided in this application, employing the optical remote sensing imaging method in the above embodiments, can solve the technical problems mentioned in the background art. Compared with the prior art, the beneficial effects of the optical remote sensing imaging device provided in this application are the same as the beneficial effects of the optical remote sensing imaging method provided in the above embodiments, and other technical features in this optical remote sensing imaging device are the same as those disclosed in the method of the previous embodiment, and will not be repeated here.
[0064] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.
[0065] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
[0066] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, the computer-readable program instructions being used to execute the optical remote sensing imaging method in the above embodiments.
[0067] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.
[0068] The aforementioned computer-readable storage medium may be included in the optical remote sensing imaging device; or it may exist independently and not assembled into the optical remote sensing imaging device.
[0069] The aforementioned computer-readable storage medium carries one or more programs. When these programs are executed by the optical remote sensing imaging device, the optical remote sensing imaging device: determines the imaging field of view of the off-axis three-mirror optical module; determines the ground swath width of the off-axis three-mirror optical module based on the imaging field of view, and the light rays corresponding to the ground swath width propagate to the off-axis three-mirror optical module; performs split imaging on the light rays emitted from the off-axis three-mirror optical module to obtain a panchromatic image and a hyperspectral image; and fuses the panchromatic image and the hyperspectral image to obtain a target hyperspectral image. This application achieves wide coverage with a large field of view exceeding 100 kilometers by employing an off-axis three-mirror optical module. The optical path is split into two optical channels: hyperspectral imaging and panchromatic imaging. Split imaging yields a hyperspectral image and a high spatial resolution panchromatic image. Then, the panchromatic image and the hyperspectral image are fused to obtain a high spatial resolution target hyperspectral image exceeding 100 kilometers.
[0070] Computer program code for performing the operations of this application can be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, and C++, and conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0071] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.
[0072] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.
[0073] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for executing the above-described optical remote sensing imaging method, and is capable of solving the technical problems described in the background art. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as the beneficial effects of the optical remote sensing imaging method provided in the above embodiments, and will not be repeated here.
[0074] This application provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the optical remote sensing imaging method described above.
[0075] The computer program product provided in this application can solve the technical problems described in the background section. Compared with the prior art, the beneficial effects of the computer program product provided in the embodiments of this application are the same as the beneficial effects of the optical remote sensing imaging method provided in the above embodiments, and will not be repeated here.
[0076] The above description is only a part of the embodiments of this application and does not limit the patent scope of this application. All equivalent structural transformations made under the technical concept of this application and using the contents of the specification and drawings of this application, or direct / indirect applications in other related technical fields, are included in the patent protection scope of this application.
Claims
1. An optical remote sensing imaging method, characterized in that, Applied to an optical remote sensing imaging device, the device includes an off-axis three-mirror optical module, comprising: Determine the imaging field of view of the off-axis three-mirror optical module; Based on the imaging field of view, the ground swath width is determined, wherein light rays from the area corresponding to the ground swath width propagate to the off-axis three-mirror optical module; The light emitted from the off-axis three-mirror optical module is split into multiple paths for imaging to obtain panchromatic and hyperspectral images; The panchromatic image and the hyperspectral image are fused to obtain the target hyperspectral image.
2. The optical remote sensing imaging method as described in claim 1, characterized in that, After fusing the panchromatic image and the hyperspectral image to obtain the target hyperspectral image, the method further includes: Target detection is performed on the hyperspectral image of the target to obtain the region of interest image; The image of the region of interest is sliced to obtain multiple target slices; The multiple target slices are transmitted back to the ground station.
3. The optical remote sensing imaging method as described in claim 1, characterized in that, The step of splitting the light emitted from the off-axis three-mirror optical module to obtain a panchromatic image and a hyperspectral image includes: The light beam is split using a pre-set beam splitting element to form reflected light and transmitted light; The reflected light is subjected to hyperspectral imaging to obtain a hyperspectral image, and the transmitted light is subjected to panchromatic imaging to obtain a panchromatic image.
4. The optical remote sensing imaging method as described in claim 3, characterized in that, The process of performing hyperspectral imaging on the reflected light to obtain a hyperspectral image, and performing panchromatic imaging on the transmitted light to obtain the panchromatic image, includes: After the reflected light enters the hyperspectral optical channel, a spectral scanning image is obtained by scanning the slit. After the transmitted light enters the panchromatic optical channel, the transmitted light is converted using a preset panchromatic detector to obtain the panchromatic image.
5. The optical remote sensing imaging method as described in claim 1, characterized in that, The step of fusing the panchromatic image and the hyperspectral image to obtain the target hyperspectral image includes: Preprocess the panchromatic image and the hyperspectral image; Feature extraction is performed on the preprocessed panchromatic image to obtain high spatial resolution spatial detail features; Feature extraction is performed on the preprocessed hyperspectral image to obtain spectral features; The spectral features and the high spatial resolution spatial detail features are fused to obtain the target hyperspectral image.
6. The optical remote sensing imaging method as described in claim 1, characterized in that, Determining the ground width based on the imaging field of view includes: Obtain the satellite's orbital altitude; The ground width is determined based on the orbital height and the imaging field of view.
7. An optical remote sensing imaging device, characterized in that, include: The first determining module is used to determine the imaging field of view of the off-axis three-mirror optical module; The second determining module is used to determine the ground width based on the imaging field of view, wherein light rays from the area corresponding to the ground width propagate to the off-axis three-mirror optical module; The split imaging module is used to split the light emitted from the off-axis three-mirror optical module to obtain panchromatic and hyperspectral images. The image fusion module is used to fuse the panchromatic image and the hyperspectral image to obtain the target hyperspectral image.
8. An optical remote sensing imaging device, characterized in that, The optical remote sensing imaging device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the optical remote sensing imaging method as described in any one of claims 1 to 6.
9. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, it implements the steps of the optical remote sensing imaging method as described in any one of claims 1 to 6.
10. A computer program product comprising a computer program that, when executed by a processor, implements the steps of the optical remote sensing imaging method as described in any one of claims 1 to 6.