Large-range static and dynamic ground feature information synchronous acquisition technology
By using a combination of optical machine lenses, surface array CMOS detectors and imaging circuits on the aerospace remote sensing platform, the problem of synchronous acquisition of static spectra and dynamic motion information in a large range is solved, and efficient information collection is achieved.
Patent Information
- Application Number
- CN202411425423.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-12
- Publication Date
- 2025-02-25
AI Technical Summary
The prior art cannot synchronize the static spectral information and dynamic motion information of terrestrial objects on a large scale, especially in the synchronous acquisition of spectral information and motion trend information of high-speed moving objects.
The aerospace remote sensing platform and remote sensing load are adopted. The remote sensing load consists of an optical machine lens, a surface array CMOS detector and an imaging circuit. The surface array CMOS detector is equipped with a multi-spectral filter and a full-color filter. The earth light is gathered through the optical machine lens. The surface array CMOS detector converts the light signal into a digital image, and the imaging circuit processes it to form a static multi-spectral striped picture and a dynamic full-color video.
The simultaneous acquisition of static spectral information and dynamic motion information of local matters has been achieved on a large scale, and the problems of low efficiency of traditional handheld devices and the inability of traditional aerospace remote sensing to synchronously collect static spectral and dynamic video information are overcome.
Smart Images
Figure CN119509693A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a technology for synchronously collecting static and dynamic ground object information over a large area, which is suitable for collecting static spectral information and dynamic change trend information of ground objects over a large area, especially synchronously collecting spectral information and motion trend information of high-speed moving objects, and belongs to the field of information collection and processing technology. Background Art
[0002] Ground objects are referred to as objects, and their information collection has a wide range of applications in agriculture, transportation, urban construction, emergency disaster reduction, and military. Information collection is divided into two parts: one is the color information of objects, namely spectral information; the other is the change information of objects, especially the position change information of fast-moving objects. Spectral information collection requires the simultaneous collection of more than three spectral bands of objects; motion information collection requires the ability to collect video images to infer the moving speed and direction of objects. In order to better serve the application, spectral information and motion information collection need to be carried out on a large geographical scale, such as tens of kilometers or hundreds of kilometers.
[0003] Traditional means of spectral information and motion information include handheld instruments, aerial drones, and space remote sensing. Handheld instruments rely on manpower, have a small collection range, and are inefficient; aerial drones equipped with multispectral cameras can synchronously collect multiple spectral band information of ground objects in a push-broom manner, but cannot synchronously collect ground object motion information. The collection efficiency is higher than that of handheld instruments, but the efficiency is still low; space remote sensing has been increasingly used in recent years because of its large range and high efficiency. Advanced space remote sensing payloads have multispectral push-broom imaging mode and video imaging mode, but these two modes cannot work at the same time, so they cannot synchronously collect ground object spectral information and motion information. Summary of the invention
[0004] The technical problem solved by the present invention is: to overcome the shortcomings of the prior art, the present invention provides a large-scale synchronous acquisition technology of static and dynamic ground object information, including a space remote sensing platform and a remote sensing payload. The remote sensing payload is composed of an optical machine lens and a focal plane component. The focal plane component is composed of an array CMOS detector and an imaging circuit. The array CMOS detector is equipped with 3 to 9 multi-spectral filters and 1 full-color filter. The remote sensing payload is installed on the remote sensing platform. As the remote sensing platform flies relative to the earth, the optical machine lens converges the light of the ground object onto the array CMOS detector. The array CMOS detector converts the optical signal of the ground object into an electrical signal to form a digital image. The imaging circuit processes the digital image to form a static multi-spectral strip picture of the ground object and a dynamic full-color video, thereby realizing a large-scale synchronous acquisition of static and dynamic ground object information. This technology solves the problem that the acquisition efficiency of traditional handheld devices is low and traditional aerospace remote sensing cannot synchronously collect static spectral information and dynamic video information.
[0005] The technical solution of the present invention is:
[0006] A technology for synchronously collecting information on static and dynamic objects over a large range, characterized in that it includes a space remote sensing platform and a remote sensing payload; the remote sensing payload is composed of an optical machine lens and a focal plane assembly. The focal plane assembly is composed of an array CMOS detector and an imaging circuit. The array CMOS detector is equipped with 3 to 9 multi-spectral filters and 1 full-color filter. The remote sensing payload is installed on the remote sensing platform, and as the remote sensing platform flies relative to the earth, the optical machine lens converges the light of the object onto the array CMOS detector. The array CMOS detector converts the optical signal of the object into an electrical signal to form a digital image. The imaging circuit processes the digital image to form a static multi-spectral strip picture of the object and a dynamic full-color video, thereby realizing the synchronous collection of static and dynamic object information over a large range.
[0007] In the above-mentioned large-scale static and dynamic ground object information synchronous acquisition technology, the aerospace remote sensing platform generally operates in a sun-synchronous orbit; provides attitude control, orbit control, power supply, drift angle correction, image storage and downloading necessary for the remote sensing payload; uses aerospace remote sensing to image the ground object, which has the characteristics of a large range;
[0008] In the above-mentioned large-scale static and dynamic ground object information synchronous acquisition technology, the optical-mechanical lens, the area array CMOS detector and the imaging circuit work together. The optical-mechanical lens converges the light of the ground object onto the area array CMOS detector. The area array CMOS detector completes the photoelectric conversion and forms a digital image. The imaging circuit processes the digital image to form a static multi-spectral strip image and a dynamic full-color video. The imaging circuit also completes the power supply, timing drive and imaging control of the area array CMOS detector.
[0009] In the above-mentioned large-scale static and dynamic ground object information synchronous acquisition technology, the area array CMOS detector is composed of a detector body and a filter; the detector body has M rows and N columns of photosensitive pixels, and the spectral response range of each photosensitive pixel covers 400-1000nm; in the row direction of the area array CMOS detector, 3-9 multi-spectral filters in the 400-1000nm spectrum are added to a part of the row pixels, and the other part is added with a full-color filter; the detector body can complete photoelectric conversion. In the photoelectric conversion process, the charge formed by the photoelectric conversion of the row pixels covered by the multi-spectral filter carries the multi-spectral information of the ground object; the row pixels covered by the full-color filter carry the dynamic information of the ground object in the charge formed by the multi-frame photoelectric conversion; the charge formed by the photoelectric conversion is converted by the detector body to form a multi-spectral digital image and a full-color digital image and output to the imaging circuit.
[0010] In the above-mentioned large-scale static and dynamic ground object information synchronous acquisition technology, when the remote sensing payload is photographing the ground, the aerospace remote sensing platform synchronously performs a drift angle correction to ensure that the row direction of the array CMOS detector is perpendicular to the image movement direction of the scene; when photographing the ground, the shooting interval is equal to the time it takes for the image of the ground object to move a row distance on the detector surface;
[0011] In the above-mentioned large-scale synchronous acquisition technology of static and dynamic ground object information, the imaging circuit processes the multi-spectral digital image and the full-color digital image output by the array CMOS detector. The processing method is to splice the multi-spectral digital image line by line according to the spectrum segment to form a continuous static multi-spectral strip image; for the full-color digital image, multiple frames are superimposed into a dynamic video image; the multi-spectral static strip image contains the static spectral information of the ground object; the high-frequency video image contains the dynamic motion information of the ground object; because the static spectral information and the dynamic motion information are collected at the same time, the synchronous acquisition of static and dynamic ground object information is achieved.
[0012] The beneficial effects of the present invention compared with the prior art are:
[0013] 【1】The present invention uses aerospace remote sensing to collect ground information, which has the advantages of large range and high efficiency;
[0014] [2] The present invention installs a multi-spectral filter and a panchromatic filter on the area array CMOS detector, which can simultaneously collect static spectral information and dynamic motion information of ground objects during ground imaging. It has the advantages of synchronizing static and dynamic information;
[0015] 【3】The present invention uses an imaging circuit to stitch multispectral images one by one to form a multispectral long-strip image; and processes multiple frames of full-color images to form a video. The user obtains processed images and videos, which has the advantage of being easy to use. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Figure 1 The composition diagram of the present invention
[0017] Figure 2 Schematic diagram of the CMOS detector and filter of the present invention
[0018] Figure 3 Schematic diagram of multispectral image acquisition and processing process
[0019] Figure 4 Schematic diagram of full-color video acquisition and processing process
[0020] Figure 5 Figure 1 for the abstract
[0021] Among them: 1 remote sensing platform; 2 optical machine lens; 3 array CMOS detector with filter; 4 imaging circuit; 5 static multi-spectral strip image; 6 dynamic full-color video. DETAILED DESCRIPTION
[0022] The present disclosure is further described in detail below in conjunction with the accompanying drawings and implementations. It is understood that the specific implementations described herein are only used to explain the relevant content, rather than to limit the present disclosure. It should also be noted that, for ease of description, only the parts related to the present disclosure are shown in the accompanying drawings.
[0023] It should be noted that, in the absence of conflict, the embodiments and features of the embodiments in the present disclosure can be combined with each other. The technical solution of the present disclosure will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.
[0024] like Figure 1 As shown, a technology for synchronously collecting information of static and dynamic objects over a large range includes a space remote sensing platform 1 and a remote sensing payload; the remote sensing payload is composed of an optical lens 2 and a focal plane assembly. The focal plane assembly is composed of a planar array CMOS detector 3 with a filter and an imaging circuit 4. The planar array CMOS detector is equipped with 3 to 9 multi-spectral filters and 1 full-color filter, preferably 9 multi-spectral bands. The remote sensing payload is installed on the remote sensing platform 1. As the remote sensing platform flies relative to the earth, the optical lens 2 converges the light of the object onto the planar array CMOS detector 3. The planar array CMOS detector 3 converts the optical signal of the object into an electrical signal to form a digital image. The imaging circuit 4 processes the digital image to form a static multi-spectral strip image 5 of the object and a dynamic full-color video 6, thereby realizing the synchronous collection of static and dynamic object information over a large range. The imaging circuit 4 simultaneously completes the power supply, timing drive and imaging control of the planar array CMOS detector 3.
[0025] like Figure 2 As shown, preferably, the frame rate of the area array CMOS detector 3 is greater than 1000fps, the number of rows M is greater than 4096, and the number of columns N is greater than 3112; the multispectral filter is preferably 9 independent filters, and the preferred filter spectrum is set as follows: B1: 400-450nm; B2: 450-510nm; B3: 510-580nm; B4: 585-625nm; B5: 630-690nm; B6: 695-715nm; B7: 730-750nm; B8: 770-895nm; B9: 905-985nm; PAN: 450-900nm. Preferably, each multispectral spectrum filter covers a detector area of not less than 50 rows; the full color spectrum covers a detector area of not less than 2000 rows.
[0026] like Figure 3As shown, the imaging circuit 4 processes the photographic images of the area array CMOS detector 3 in the multispectral filter area into 9 independent static multispectral images. Taking the photographing of the aircraft in the B1 spectrum as an example, at T1, T2, T3, T4, and T5, the B1 spectrum sequentially photographs the aircraft from the nose to the tail, forming 5 photos with the spectrum information of the B1 spectrum, which are input into the imaging circuit 4. In the imaging circuit, the B1 spectrum photos at T1, T2, T3, T4, and T5 are spliced in turn to form a complete picture of the aircraft's B1 spectrum. As the aerospace remote sensing platform 1 continues to fly forward, the aircraft is imaged in the B2, B3, B4, B5, B6, B7, B8, and B9 areas of the area array CMOS detector 3 in turn. In the imaging circuit 4, the complete pictures of the aircraft's B2, B3, B4, B5, B6, B7, B8, and B9 spectrums are spliced in turn. In this way, the static multispectral spectrum information of the aircraft is collected.
[0027] like Figure 4 As shown, the imaging circuit 4 processes the photographed images of the area array CMOS detector 3 in the full-color filter area into a dynamic video. Taking the photographing of an airplane in the full-color filter area as an example, at t1, t2, and t3, the full-color area sequentially photographs the airplane to form three complete airplane photos, which are input to the imaging circuit 4. In the imaging circuit, the airplane pictures collected at t1, t2, and t3 are superimposed to form a full-color video of the airplane. In this way, the dynamic full-color information of the airplane is collected.
[0028] The working principle of the present invention is:
[0029] The space remote sensing payload is used to take photos of the ground. The optical machine lens 2 of the remote sensing payload converges the light of the ground object onto the area array CMOS detector 3. The area array CMOS detector 3 is equipped with 9 multi-spectral bands and a full-color spectrum filter 32. During the photo-taking process of the area array CMOS detector 3, the optical signal of the ground object is converted into an electrical signal, and the formed digital image contains 9 multi-spectral band information and full-color spectrum information. The imaging circuit 4 splices the 9 multi-spectral band digital images to form a static multi-spectral strip image of the ground object; the full-color spectrum digital image is superimposed to form a dynamic full-color video. This realizes the synchronous acquisition of static and dynamic ground object information over a large range.
[0030] Unless otherwise specified, the exemplary embodiments / embodiments shown will be understood as providing exemplary features of various details of some ways in which the technical concept of the present disclosure can be implemented in practice. Therefore, unless otherwise specified, the features of the various embodiments / embodiments can be combined, separated, interchanged and / or rearranged without departing from the technical concept of the present disclosure.
[0031] Those skilled in the art should understand that the above embodiments are only for the purpose of clearly illustrating the present disclosure, and are not intended to limit the scope of the present disclosure. For those skilled in the art, other changes or modifications may be made based on the above disclosure, and these changes or modifications are still within the scope of the present disclosure.
Claims
1. A technology for synchronously collecting large-scale static and dynamic ground object information, characterized in that: The invention comprises a space remote sensing platform (1) and a remote sensing payload; the remote sensing payload is composed of an optical machine lens (2) and a focal plane assembly. The focal plane assembly is composed of a planar array CMOS detector (3) with a filter and an imaging circuit (4). The planar array CMOS detector is equipped with 3 to 9 multi-spectral filters and 1 full-color filter. The remote sensing payload is installed on the remote sensing platform (1). As the remote sensing platform flies relative to the earth, the optical machine lens (2) converges the light of the ground object onto the planar array CMOS detector (3). The planar array CMOS detector (3) converts the light signal of the ground object into an electrical signal to form a digital image. The imaging circuit (4) processes the digital image to form a static multi-spectral strip image (5) of the ground object and a dynamic full-color video (6), thereby realizing the synchronous acquisition of static and dynamic ground object information over a large range.
2. The aerospace remote sensing platform (1) according to claim 1 generally operates in a sun-synchronous orbit; provides attitude control, orbit control, power supply, drift angle correction, image storage and downloading necessary for the remote sensing payload; and utilizes aerospace remote sensing to image ground objects, with the characteristics of a large range.
3. The optical machine lens (2), the area array CMOS detector (3) and the imaging circuit (4) according to claim 1 work in cooperation. The optical machine lens (2) converges the light of the ground object onto the area array CMOS detector (3). The area array CMOS detector (3) completes the photoelectric conversion to form a digital image. The imaging circuit (4) processes the digital image to form a static multi-spectral strip image (5) and a dynamic full-color video (6). The imaging circuit (4) also completes the power supply, timing drive and imaging control of the area array CMOS detector (3).
4. The area array CMOS detector (3) according to claim 1 is composed of a detector body (31) and a filter (32); the detector body (31) has M rows and N columns of photosensitive pixels, and the spectral response range of each photosensitive pixel covers 400-1000nm; in the row direction of the area array CMOS detector (3), 3-9 multispectral filters (321) in the 400-1000nm spectrum band are added to a part of the row pixels, and a full-color filter (322) is added to the other part; the detector body (31) can complete photoelectric conversion. In the photoelectric conversion process, the row pixels covered by the multispectral filter (321) have multispectral information of the ground object in the charge formed by the photoelectric conversion; the row pixels covered by the full-color filter (322) have dynamic information of the ground object in the charge formed by the multi-frame photoelectric conversion; the charge formed by the photoelectric conversion is converted by the detector body (31) into a multispectral digital image and a full-color digital image, which are output to the imaging circuit (4).
5. When the remote sensing payload according to claim 1 is photographing the earth, the aerospace remote sensing platform simultaneously performs a drift angle correction to ensure that the row direction of the planar array CMOS detector is perpendicular to the image movement direction of the scene; when photographing the earth, the photographing interval is equal to the time it takes for the image of the ground object to move a row distance on the detector surface.
6. The imaging circuit (4) according to claim 1 processes the multispectral digital image and the full-color digital image output by the array CMOS detector (3). The processing method is as follows: for the multispectral digital image, the spectral bands are spliced line by line to form a continuous static multispectral strip image (5); for the full-color digital image, multiple frames are superimposed to form a dynamic video image (6); the multispectral static strip image (5) contains the static spectral information of the ground object; the high-frequency video image (6) contains the dynamic motion information of the ground object; because (5) (6) are collected simultaneously, the synchronous collection of static and dynamic ground object information is achieved.