Fast Adaptive Method and Apparatus for Integration Time of Remote Sensing Detectors at Fixed Frame Rate

By acquiring image acquisition identification signals and time-series data from remote sensing detectors, and using a threshold judgment function to set the integration time and adjust it multiple times, the problem of slow integration time adjustment under a fixed frame rate is solved, achieving rapid adaptation and improving the efficiency of remote sensing image data acquisition.

CN119743678BActive Publication Date: 2025-10-28SHANGHAI INSTITUTE OF TECHNICAL PHYSICS CHINESE ACADEMY OF SCIENCES
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411929739.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-12-26
Publication Date
2025-10-28
Estimated Expiration
2044-12-26

AI Technical Summary

Technical Problem

At a fixed frame rate, the existing detector integration time adaptive algorithm has a long adjustment process in remote sensing, making it difficult to quickly obtain usable data after changes in the observed target.

Method used

By acquiring image acquisition identification signals and remote sensing detector time series data, a threshold judgment function is used to set the detector integration time. The integration time is adjusted multiple times under the time series constraints, and subsequent readout operations are interrupted to achieve rapid adaptation.

Benefits of technology

Multiple integration time adjustments are achieved within a single image acquisition cycle, improving the adaptive speed of the remote sensing detector's integration time and enabling rapid acquisition of usable remote sensing image data.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119743678B_ABST
    Figure CN119743678B_ABST
Patent Text Reader

Abstract

This application discloses a method and apparatus for rapid adaptive integration time of a remote sensing detector under a fixed frame rate, relating to the field of remote sensing. The method includes: normally acquiring an image signal matrix based on an image acquisition marker signal; adjusting the detector integration time according to the numerical distribution information of the first p rows of elements in the image signal matrix; re-acquiring the first p rows of elements based on the image acquisition marker signal of the next frame, and adjusting the detector integration time multiple times according to the numerical distribution information of each element; determining whether the finally adjusted detector integration time of the current frame needs further adjustment; if yes, continuing with image acquisition of the next frame; otherwise, the adjustment process of the detector integration time ends. This application can effectively improve the adaptive speed of the remote sensing detector's integration time.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of remote sensing, and in particular to a method and apparatus for rapid adaptive integration time of a remote sensing detector under a fixed frame rate. Background Technology

[0002] Remote sensing measurements of rapidly changing targets are of significant practical importance for climate change monitoring and scientific research. However, due to the limited integrating capacitance of detectors, images may appear too dark or too bright at fixed integration times. This is because the detector's integration time is either too short or too long. Remote sensing applications require high image registration accuracy. Once the image acquisition signal arrives, the detector must immediately begin integration observation, matching the timecode of the image acquisition signal with the remote sensing image to obtain usable data for remote sensing inversion. Therefore, the current image frame rate for remote sensing observations is often fixed. By transmitting image acquisition signals at fixed intervals to the detector, remote sensing observations at a fixed frame rate are achieved. If the detector fails to integrate and sample according to the image acquisition signal, the remote sensing image cannot be matched with the image acquisition timecode. Since the image acquisition timecode corresponds to the orbital position of the remote sensing satellite, it is impossible to correlate the remote sensing image with the actual observed target, ultimately rendering the remote sensing image unsuitable for remote sensing inversion.

[0003] Existing detector integration time adaptive algorithms, if simply applied under fixed frame rate constraints, will make the detector integration time adjustment process very long, and may even continue until the observed target changes, making it difficult to obtain usable data. Summary of the Invention

[0004] The purpose of this application is to provide a method and apparatus for fast adaptive integration time of remote sensing detectors under a fixed frame rate, which can effectively improve the adaptive speed of integration time of remote sensing detectors.

[0005] To achieve the above objectives, this application provides the following solution:

[0006] In a first aspect, this application provides a fast adaptive method for the integration time of a remote sensing detector under a fixed frame rate, including:

[0007] Acquire image acquisition identification signals and remote sensing detector timing data; the remote sensing detector timing data includes the time required for detector initialization before integration, detector readout time, initial detector integration time, maximum detector integration time, and minimum detector integration time; the initial detector integration time is the integration time under saturation conditions or the integration time under under-saturation conditions.

[0008] A first image signal matrix is ​​acquired based on the image acquisition identifier signal and the time-series data of the remote sensing detector; the first image signal matrix contains all the image information detected by the detector.

[0009] Based on the numerical distribution information of the first p rows of the first image signal matrix, the integration time of the first detector is set; the minimum integration time of the detector is less than or equal to the integration time of the first detector and the maximum integration time of the detector.

[0010] Obtain the image acquisition identifier signal for the next frame;

[0011] Based on the current integration time of the first detector, the first p rows of the first image signal matrix are reacquired to obtain the second image signal matrix;

[0012] Within the current frame, based on the numerical distribution information of each element in the second image signal matrix, the detector integration time is adjusted multiple times while satisfying the timing constraints. It is then determined whether the final adjusted detector integration time in the current frame should be adjusted further. If yes, the process returns to the step "obtain the image acquisition identifier signal for the next frame". If no, the adjustment process of the detector integration time ends. The timing constraints include upper and lower limits of the detector integration time and timing constraints for inserting a new image acquisition operation in the current frame.

[0013] Secondly, this application provides a fast adaptive integration time device for remote sensing detectors under a fixed frame rate, comprising:

[0014] The signal and timing constraint acquisition module is used to acquire image acquisition identification signals and remote sensing detector timing data; the remote sensing detector timing data includes the time required for detector initialization operation before integration, detector readout time, initial detector integration time, maximum detector integration time, and minimum detector integration time; the initial detector integration time is the integration time under saturation conditions or the integration time under under-saturation conditions.

[0015] The first image acquisition module is used to acquire a first image signal matrix based on the image acquisition identification signal and the time-series data of the remote sensing detector; the first image signal matrix contains all the image information detected by the detector.

[0016] The first detector integration adjustment module is used to set the first detector integration time according to the numerical distribution information of the first p rows of the first image signal matrix; the minimum integration time of the detector is ≤ the first detector integration time is ≤ the maximum integration time of the detector.

[0017] The signal acquisition module is used to acquire the image acquisition identifier signal for the next frame;

[0018] The second image acquisition module is used to reacquire the first p rows of the first image signal matrix based on the current integration time of the first detector, so as to obtain the second image signal matrix.

[0019] The second detector integration adjustment module is used to adjust the detector integration time multiple times within the current frame based on the numerical distribution information of each element in the second image signal matrix, while satisfying timing constraints; determine whether the final adjusted detector integration time in the current frame should continue to be adjusted; if yes, then execute the step "acquire the image acquisition identifier signal of the next frame" in the signal acquisition module; if no, then the adjustment process of the detector integration time ends; the timing constraints include upper and lower limits of detector integration time constraints and timing constraints for inserting new image acquisition operations in the current frame.

[0020] Thirdly, this application provides a computer device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the above-described fast adaptive method for integration time of remote sensing detectors at a fixed frame rate.

[0021] Fourthly, this application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the above-described fast adaptive method for the integration time of a remote sensing detector at a fixed frame rate.

[0022] Fifthly, this application provides a computer program product, including a computer program that, when executed by a processor, implements the above-described fast adaptive method for the integration time of a remote sensing detector at a fixed frame rate.

[0023] According to the specific embodiments provided in this application, the following technical effects are disclosed:

[0024] This application provides a method and apparatus for rapid adaptive integration time of a remote sensing detector under a fixed frame rate. Based on the on-orbit working state of the remote sensing detector and considering the temporal constraints of the fixed frame rate, the integration time is adjusted using the acquired portion of the remote sensing image (the first p rows of elements), interrupting subsequent readout operations to save time. Furthermore, multiple integration time adjustment operations can be performed within a single image acquisition cycle, effectively improving the adaptive speed of the remote sensing detector's integration time, thereby quickly acquiring usable remote sensing image data. This method can be widely applied in the field of remote sensing detection where the observed target changes rapidly. Attached Figure Description

[0025] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0026] Figure 1A flowchart illustrating a fast adaptive method for integration time of a remote sensing detector under a fixed frame rate, provided in an embodiment of this application;

[0027] Figure 2 This is a schematic diagram of the technical route of a fast adaptive method for integration time of a remote sensing detector under a fixed frame rate, provided in an embodiment of this application.

[0028] Figure 3 A timing diagram illustrating the rapid adaptive integration time of the detector according to an embodiment of this application;

[0029] Figure 4 A functional module diagram of a fast adaptive integration time device for a remote sensing detector under a fixed frame rate is provided in another embodiment of this application;

[0030] Figure 5 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0031] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0032] The purpose of this invention is to provide a method and apparatus for rapid adaptive integration time of remote sensing detectors under fixed frame rate constraints, as well as under saturated and under-saturated conditions, to quickly adjust the integration time and obtain usable remote sensing image data. It can be widely used in the field of remote sensing detection with high image registration accuracy and rapidly changing observation targets.

[0033] To make the above-mentioned objectives, features and advantages of this application more apparent and understandable, the application will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0034] Existing detector integration time adaptive algorithms often fail to consider the temporal constraints of detector integration time changes. If simply applied to fixed frame rate constraints, this results in a very lengthy detector integration time adjustment process, which may continue even after the observed target changes, making it difficult to obtain usable data. To address this, this embodiment provides a fast adaptive method for remote sensing detector integration time under fixed frame rate constraints, specifically a fast adaptive method for remote sensing detector integration time under saturation and under-saturation conditions under fixed frame rate constraints. Figure 1 and Figure 2 As shown, the fast adaptive integration time method for remote sensing detectors under a fixed frame rate includes the following steps.

[0035] S1: Acquire image acquisition identification signal and remote sensing detector timing data; the remote sensing detector timing data includes the time t required for the detector's pre-integration initialization operation. i Detector readout time t r Initial detector integration time, maximum detector integration time t max and detector minimum integration time t min The initial detector integration time is either the integration time under saturation or the integration time under under-saturation conditions.

[0036] S2: Acquire a first image signal matrix based on the image acquisition identifier signal and the timing data of the remote sensing detector; the first image signal matrix contains all the image information detected by the detector. The first image signal matrix is ​​an m-row, n-column image signal matrix A. m×n .

[0037] S3: Based on the numerical distribution information of the first p rows of the first image signal matrix (i.e., the number of saturated elements and the number of undersaturated elements), set the first detector integration time (a new detector integration time); the minimum detector integration time ≤ the first detector integration time ≤ the maximum detector integration time.

[0038] Specifically, based on the numerical distribution information of the first p rows of the first image signal matrix, the number of saturated elements and the number of undersaturated elements in the first p rows are determined. These numbers are then substituted into the threshold judgment function to obtain the first detector integration time. Here, the number of saturated elements refers to the number of elements whose digital values ​​reach the set maximum digital threshold; the number of undersaturated elements refers to the number of elements whose digital values ​​do not reach the set minimum digital threshold.

[0039] The expression for the threshold judgment function is:

[0040]

[0041] In the formula, t next t represents the integration time of the second detector; now Q represents the integration time of the first detector; max Q represents the number of saturated elements; min This represents the number of undersaturated elements; p and n represent the p rows and n columns of the first image signal matrix; a1, a2, a3, a4, b1, b2, b3, and b4 are empirically set values. b1, b2, b3, and b4 are all in the range of 0 to 1. t min ≤t next ≤t max . t min ≤tnow ≤t max .

[0042] Since the initial detector integration time is the integration time under saturation or under-saturation conditions, which is the integration time to be adjusted, this step directly sets a new integration time based on the threshold judgment function.

[0043] In step S3, after calculating a new detector integration time (i.e., the first detector integration time), we directly wait for the image acquisition flag signal to acquire the image. We then use the image acquisition to confirm whether the adjusted detector integration time is appropriate. If it is not appropriate, we continue to adjust it.

[0044] S4: Wait for the image acquisition identifier signal (i.e., after the image acquisition identifier signal of the next frame is issued, obtain the image acquisition identifier signal of the next frame).

[0045] S5: Based on the current integration time of the first detector, re-acquire the first p rows of the first image signal matrix to obtain the second image signal matrix.

[0046] In this step, the image matrix B of the first p rows of data is acquired. p×n This interrupts the readout operation of subsequent rows. Specifically, interrupting the readout operation of subsequent rows by the detector saves time; the time saved is t. save for:

[0047]

[0048] S6: Within the current frame, based on the numerical distribution information of each element in the second image signal matrix, and while satisfying the timing constraints, the detector integration time is adjusted multiple times; it is determined whether the final adjusted detector integration time in the current frame should be further adjusted; if yes, the process returns to the step "obtain the image acquisition identifier signal for the next frame"; otherwise, the adjustment process of the detector integration time ends. The timing constraints include upper and lower limits of the detector integration time and timing constraints for inserting a new image acquisition operation in the current frame.

[0049] By implementing steps S1 to S6 above, considering the temporal constraints of a fixed frame rate, and using the acquired remote sensing images as a judgment, subsequent readout operations are interrupted to save time. Multiple integration time adjustments can be performed within a single image acquisition cycle. The integration time can be quickly adjusted under fixed frame rate constraints and under saturation and undersaturation conditions, effectively improving the adaptive speed of the remote sensing detector's integration time. This allows for the rapid acquisition of usable remote sensing image data and can be widely applied in the field of remote sensing detection where the observed target changes rapidly.

[0050] In another exemplary embodiment of this application, step S6 involves adjusting the detector integration time multiple times within the current frame based on the numerical distribution information of each element in the second image signal matrix; determining whether the final adjusted detector integration time in the current frame should continue to be adjusted; if yes, returning to the step "obtain the image acquisition identifier signal for the next frame"; if no, the adjustment process of the detector integration time ends, specifically including:

[0051] (1) Based on the numerical distribution information of each element in the second image signal matrix, the integration time of the second detector is set; the minimum integration time of the detector is ≤ the integration time of the second detector is ≤ the maximum integration time of the detector.

[0052] Specifically, the integration time of the second detector is set based on the numerical distribution information of each element in the second image signal matrix, including:

[0053] (a1) Determine the number of saturated elements and the number of undersaturated elements in the second image signal matrix based on the numerical distribution information of each element in the second image signal matrix.

[0054] (b1) Substitute the number of saturated elements and the number of undersaturated elements of the second image signal matrix into the threshold judgment function to obtain the integration time of the second detector.

[0055] The expression for the threshold judgment function here is the same as the expression for calculating the integration time of the first detector; only the meaning of the parameters changes. In the expression for the threshold judgment function for calculating the integration time of the second detector, t... next This is represented as the integration time of the second detector; t now This represents the integration time of the first detector.

[0056] (2) If the current integration time of the second detector is not equal to the current integration time of the first detector, then determine whether to continue image acquisition in the current frame.

[0057] In one optional implementation of this application, step (2), determining whether to continue image acquisition for the current frame, specifically includes:

[0058] Based on the timing constraint condition that a new image acquisition operation can be inserted in the current frame, determine whether to continue image acquisition in the current frame; the expression for the timing constraint condition is:

[0059] TT pass >t i +t next +(t r -t save );

[0060] In the formula, T represents the time interval between two adjacent image acquisition marker signals; T pass The elapsed time for the current frame can be calculated based on the number of image acquisition operations for the current frame and the timing constraints of the remote sensing detector; t i t represents the time required for the detector initialization operation before integration; r Indicates the detector readout time; t next t represents the integration time of the second detector; save This indicates that only the first p rows of the first image signal matrix are collected, thus saving time by interrupting the detector's subsequent row readout operations.

[0061] (3) If not, set the current integration time of the second detector to the current integration time of the first detector, and return to the execution step "obtain the image acquisition identifier signal of the next frame".

[0062] (4) If so, let the current integration time of the second detector be the current integration time of the first detector, and return to the execution step "According to the current integration time of the first detector, re-acquire the first p rows of the first image signal matrix to obtain the second image signal matrix".

[0063] (5) If the current integration time of the second detector is equal to the current integration time of the first detector, the adjustment process of the detector integration time ends.

[0064] The following discusses the interval time T and the time t required for detector initialization before integration. i The detector readout time is t. r The detector integration time and the detector's maximum integration time are t. max The minimum integration time is t min The specific values ​​assigned to the parameters will be used to illustrate the detailed process of the fast adaptive integration time method for remote sensing detectors under a fixed frame rate in this application. The details are as follows:

[0065] Step 1: Given an image acquisition identifier signal with an interval of T = 600ms, and given timing constraints for the remote sensing detector, the timing constraints include the time t required for the detector's initialization operation before integration. i =1ms, detector readout time is t r =100ms, current integration time t of the detector now = 400ms (initial detector integration time), the maximum detector integration time is t max = 400ms, minimum integration time is t min =4ms,t min ≤t now ≤t max .

[0066] Step 2: The normal image of the remote sensing detector is 400 rows and 1200 columns. A normal image matrix A of 400 rows and 1200 columns is acquired. 400×1200 Save and store the first 10 rows of data, and calculate the numerical distribution of each element. Calculate the numerical distribution information of each element in the matrix: the number of saturated elements Q. max =11400, Number of undersaturated elements Q min =120, since a 14-bit ADC is used as the analog-to-digital conversion acquisition unit of the remote sensing detector, its digital value range is 0 to 16383, where the saturation element refers to the digital value reaching the set maximum threshold DN. max =15000, an undersaturated element refers to an element whose numerical value has not reached the set minimum threshold DN. min =1000.

[0067] Step 3: Set a new integration time t based on the threshold judgment function. next (Corresponding to the integration time of the first detector), the expression for the threshold judgment function is:

[0068]

[0069] Due to the number of saturated elements Q max =11400, Number of undersaturated elements Q min =120, the current integration time (initial detector integration time) is t. now =400ms, then according to the above formula, the new integration time (integration time of the first detector) is 32ms, t min ≤t next ≤t max .

[0070] Step 4: Wait for the image acquisition indicator to appear.

[0071] Step 5: Collect the image matrix B of the first 10 rows of data. 10×1200 The read operation of subsequent rows is interrupted, and the time t saved at this time is... save for:

[0072]

[0073] Step 6, Statistical analysis of image matrix B 10×1200 The numerical distribution of each element in the mixture yields the number of saturated elements, Q. max =10900, Number of undersaturated elements Q min =270, the current integration time (integration time of the first detector) is t now = 32ms, then according to the threshold judgment function mentioned above, it is known that the integration time needs to be adjusted again. The new integration time (integration time of the second detector) is calculated to be 6.4ms. min ≤tnext ≤t max .

[0074] Step 7: Since the calculated integral time needs to be adjusted, determine whether a new image acquisition can be performed in the current frame based on the timing constraints.

[0075] The time taken for image acquisition after the first integration time adjustment is:

[0076] T pass =t i +t now +t r -t save =35.5ms

[0077] Based on the timing constraint judgment conditions, we know that:

[0078] 600ms-35.5ms>1ms+6.4ms+(100ms-97.5ms)

[0079] Then a new image can be acquired in the current frame, and step five can be repeated.

[0080] The second execution of step five involves acquiring the image matrix B of the first 10 rows of data. 10×1200 The read operation of subsequent rows is interrupted, and the time t saved at this time is... save for:

[0081]

[0082] The second execution step six involves statistical analysis of image matrix B. 10×1200 The numerical distribution of each element in the mixture yields the number of saturated elements, Q. max =4900, Number of undersaturated elements Q min =510, current integration time is t now =6.4ms, then according to the threshold judgment function, there is no need to adjust the integration time again.

[0083] The timing diagram for the detector's fast adaptive integration time is shown below. Figure 3 As shown in the figure, the algorithm of this application adjusts the detector integration time twice, and these two adjustments occupy one image frame. That is, it achieves rapid adaptation of the detector integration time under the constraint of a fixed frame rate of 600ms under the image acquisition signal with an interval of 600ms. If a general detector integration time adaptive algorithm is used, it is necessary to acquire all images and perform calculations, which requires two frames to complete the adjustment. However, this application only requires one frame, which effectively improves the adaptive speed of the remote sensing detector integration time, thereby quickly acquiring usable remote sensing image data. It can be widely used in the field of remote sensing detection where the observed target changes rapidly.

[0084] This application also provides an application scenario in which the above-described fast adaptive integration time method for remote sensing detectors under a fixed frame rate is applied. Specifically, the fast adaptive integration time method for remote sensing detectors under a fixed frame rate provided in this embodiment can be applied in remote sensing scenarios. This scenario includes a fast adaptive integration time stage, used to quickly adjust the integration time under fixed frame rate constraints and in saturated and under-saturated conditions; and a remote sensing image detection stage, used to detect image information using the remote sensing detector based on the adjusted integration time.

[0085] Based on the same inventive concept, this application also provides an apparatus for implementing the above-described fast adaptive integration time method for remote sensing detectors at a fixed frame rate. The solution provided by this apparatus is similar to the implementation described in the above method. Therefore, the specific limitations in one or more embodiments of the fast adaptive integration time method for remote sensing detectors at a fixed frame rate provided below can be found in the above-described limitations of the fast adaptive integration time method for remote sensing detectors at a fixed frame rate, and will not be repeated here.

[0086] In one exemplary embodiment, such as Figure 4 As shown, a fast adaptive integration time device for a remote sensing detector under a fixed frame rate is provided, comprising:

[0087] The signal and timing constraint acquisition module M1 is used to acquire image acquisition identification signals and remote sensing detector timing data; the remote sensing detector timing data includes the time required for detector initialization operation before integration, detector readout time, initial detector integration time, maximum detector integration time, and minimum detector integration time; the initial detector integration time is the integration time under saturation or under undersaturation conditions.

[0088] The first image acquisition module M2 is used to acquire a first image signal matrix based on the image acquisition identification signal and the time-series data of the remote sensing detector; the first image signal matrix contains all the image information detected by the detector.

[0089] The first detector integration adjustment module M3 is used to set the first detector integration time according to the numerical distribution information of the first p rows of the first image signal matrix; the minimum integration time of the detector is less than or equal to the first detector integration time and the maximum integration time of the detector.

[0090] The signal acquisition module M4 is used to acquire the image acquisition identifier signal for the next frame.

[0091] The second image acquisition module M5 is used to reacquire the first p rows of the first image signal matrix based on the current integration time of the first detector, so as to obtain the second image signal matrix.

[0092] The second detector integration adjustment module M6 is used to adjust the detector integration time multiple times within the current frame based on the numerical distribution information of each element in the second image signal matrix, while satisfying timing constraints; determine whether the finally adjusted detector integration time in the current frame should continue to be adjusted; if yes, then execute the step "acquire the image acquisition identifier signal of the next frame" in the signal acquisition module; if no, then the adjustment process of the detector integration time ends. The timing constraints include upper and lower limits of the detector integration time and timing constraints for inserting a new image acquisition operation in the current frame.

[0093] In one exemplary embodiment, a computer device is provided, which may be a server or a terminal, and its internal structure diagram may be as follows. Figure 5 As shown, the computer device includes a processor, memory, input / output (I / O) interfaces, and a communication interface. The processor, memory, and I / O interfaces are connected via a system bus, and the communication interface is also connected to the system bus via the I / O interfaces. The processor provides computational and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system, computer programs, and a database. The internal memory provides the environment for the operating system and computer programs stored in the non-volatile storage media. The database stores fast adaptive integration time data for remote sensing detectors at a fixed frame rate. The I / O interfaces are used for exchanging information between the processor and external devices. The communication interface is used for communication with external terminals via a network connection. When the computer program is executed by the processor, it implements a fast adaptive integration time method for remote sensing detectors at a fixed frame rate.

[0094] Those skilled in the art will understand that Figure 5 The structures shown are merely block diagrams of some structures related to the present application and do not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than shown in the figures, or combine certain components, or have different component arrangements. In an exemplary embodiment, a computer device is provided, including a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the steps in the above-described method embodiments.

[0095] In one exemplary embodiment, a computer-readable storage medium is provided storing a computer program that, when executed by a processor, implements the steps in the above-described method embodiments.

[0096] In one exemplary embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above-described method embodiments.

[0097] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of the relevant data must comply with relevant regulations.

[0098] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods.

[0099] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0100] This document uses specific examples to illustrate the principles and implementation methods of this application. The descriptions of the above embodiments are only for the purpose of helping to understand the methods and core ideas of this application. Furthermore, those skilled in the art will recognize that, based on the ideas of this application, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A fast adaptive method for integration time of a remote sensing detector under a fixed frame rate, characterized in that, The fast adaptive integration time method for remote sensing detectors under a fixed frame rate includes: Acquire image acquisition identification signals and remote sensing detector timing data; the remote sensing detector timing data includes the time required for detector initialization before integration, detector readout time, initial detector integration time, maximum detector integration time, and minimum detector integration time; the initial detector integration time is the integration time under saturation conditions or the integration time under under-saturation conditions. A first image signal matrix is ​​acquired based on the image acquisition identifier signal and the time-series data of the remote sensing detector; the first image signal matrix contains all the image information detected by the detector. Based on the numerical distribution information of the first p rows of the first image signal matrix, the integration time of the first detector is set; the minimum integration time of the detector is less than or equal to the integration time of the first detector and the maximum integration time of the detector. Obtain the image acquisition identifier signal for the next frame; Based on the current integration time of the first detector, the first p rows of the first image signal matrix are reacquired to obtain the second image signal matrix; Within the current frame, based on the numerical distribution information of each element in the second image signal matrix, the detector integration time is adjusted multiple times while satisfying the timing constraints; it is determined whether the final adjusted detector integration time in the current frame should continue to be adjusted; if yes, the process returns to the step "obtain the image acquisition identifier signal of the next frame"; if no, the adjustment process of the detector integration time ends; the timing constraints include upper and lower limits of the detector integration time and timing constraints for inserting a new image acquisition operation in the current frame. Specifically, within the current frame, based on the numerical distribution information of each element in the second image signal matrix, the detector integration time is adjusted multiple times while satisfying timing constraints; it is then determined whether the final adjusted detector integration time in the current frame should be further adjusted; if yes, the process returns to the step "obtain the image acquisition identifier signal for the next frame"; otherwise, the adjustment process of the detector integration time ends. This process specifically includes: Based on the numerical distribution information of each element in the second image signal matrix, the integration time of the second detector is set; the minimum integration time of the detector is less than or equal to the integration time of the second detector and the maximum integration time of the detector. If the current integration time of the second detector is not equal to the current integration time of the first detector, then determine whether to continue image acquisition in the current frame according to the timing constraints of inserting a new image acquisition operation in the current frame. If not, then set the current integration time of the second detector to the current integration time of the first detector, and return to the execution step "obtain the image acquisition identification signal of the next frame"; If so, then set the current integration time of the second detector to the current integration time of the first detector, and return to the execution step "According to the current integration time of the first detector, re-acquire the first p rows of the first image signal matrix to obtain the second image signal matrix"; If the current integration time of the second detector is equal to the current integration time of the first detector, then the adjustment process of the detector integration time ends. The expression for the timing constraint of inserting a new image acquisition operation in the current frame is: T-T pass >t i +t next +(t r -t save ); In the formula, T represents the time interval between two adjacent image acquisition marker signals; T pass t represents the time elapsed since the current frame was last displayed. i t represents the time required for the detector initialization operation before integration; r Indicates the detector readout time; t next t represents the integration time of the second detector; save This indicates that only the first p rows of the first image signal matrix are collected, thus saving time by interrupting the detector's subsequent row readout operations.

2. The fast adaptive integration time method for remote sensing detectors under a fixed frame rate according to claim 1, characterized in that, Based on the numerical distribution information of each element in the second image signal matrix, the integration time of the second detector is set, specifically including: Based on the numerical distribution information of each element in the second image signal matrix, determine the number of saturated elements and the number of undersaturated elements in the second image signal matrix; Substituting the number of saturated and undersaturated elements of the second image signal matrix into the threshold judgment function yields the integration time of the second detector; the expression for the threshold judgment function is: In the formula, t next t represents the integration time of the second detector; now Q represents the integration time of the first detector; max Q represents the number of saturated elements; min The number of undersaturated elements is represented; p and n represent the p rows and n columns of the first image signal matrix; a1, a2, a3, a4, b1, b2, b3, and b4 are empirically set values.

3. The fast adaptive integration time method for remote sensing detectors under a fixed frame rate according to claim 2, characterized in that, The number of saturated elements refers to the number of elements whose digital values ​​reach the set maximum digital value threshold; the number of undersaturated elements refers to the number of elements whose digital values ​​are less than the set minimum digital value threshold.

4. The fast adaptive integration time method for remote sensing detectors under a fixed frame rate according to claim 1, characterized in that, Save time t save The calculation expression is: In the formula, m represents the total number of rows in the first image signal matrix.

5. A fast adaptive integration time device for a remote sensing detector under a fixed frame rate, characterized in that, The fast adaptive integration time device for remote sensing detectors under fixed frame frequency includes: The signal and timing constraint acquisition module is used to acquire image acquisition identification signals and remote sensing detector timing data; the remote sensing detector timing data includes the time required for detector initialization operation before integration, detector readout time, initial detector integration time, maximum detector integration time, and minimum detector integration time; the initial detector integration time is the integration time under saturation conditions or the integration time under under-saturation conditions. The first image acquisition module is used to acquire a first image signal matrix based on the image acquisition identification signal and the time-series data of the remote sensing detector; the first image signal matrix contains all the image information detected by the detector. The first detector integration adjustment module is used to set the first detector integration time according to the numerical distribution information of the first p rows of the first image signal matrix; the minimum integration time of the detector is ≤ the first detector integration time is ≤ the maximum integration time of the detector. The signal acquisition module is used to acquire the image acquisition identifier signal for the next frame; The second image acquisition module is used to reacquire the first p rows of the first image signal matrix based on the current integration time of the first detector, so as to obtain the second image signal matrix. The second detector integration adjustment module is used to adjust the detector integration time multiple times within the current frame based on the numerical distribution information of each element in the second image signal matrix, while satisfying timing constraints; determine whether the final adjusted detector integration time in the current frame should continue to be adjusted; if yes, then execute the step "acquire the image acquisition identifier signal of the next frame" in the signal acquisition module; if no, then the adjustment process of the detector integration time ends; the timing constraints include upper and lower limits of detector integration time constraints and timing constraints for inserting a new image acquisition operation in the current frame; Specifically, within the current frame, based on the numerical distribution information of each element in the second image signal matrix, the detector integration time is adjusted multiple times while satisfying timing constraints; it is then determined whether the final adjusted detector integration time in the current frame should be further adjusted; if yes, the process returns to the step "obtain the image acquisition identifier signal for the next frame"; otherwise, the adjustment process of the detector integration time ends. This process specifically includes: Based on the numerical distribution information of each element in the second image signal matrix, the integration time of the second detector is set; the minimum integration time of the detector is less than or equal to the integration time of the second detector and the maximum integration time of the detector. If the current integration time of the second detector is not equal to the current integration time of the first detector, then determine whether to continue image acquisition in the current frame according to the timing constraints of inserting a new image acquisition operation in the current frame. If not, then set the current integration time of the second detector to the current integration time of the first detector, and return to the execution step "obtain the image acquisition identification signal of the next frame"; If so, then set the current integration time of the second detector to the current integration time of the first detector, and return to the execution step "According to the current integration time of the first detector, re-acquire the first p rows of the first image signal matrix to obtain the second image signal matrix"; If the current integration time of the second detector is equal to the current integration time of the first detector, then the adjustment process of the detector integration time ends. The expression for the timing constraint of inserting a new image acquisition operation in the current frame is: T-T pass >t i +t next +(t r -t save ); In the formula, T represents the time interval between two adjacent image acquisition marker signals; T pass t represents the time elapsed since the current frame was last displayed. i t represents the time required for the detector initialization operation before integration; r Indicates the detector readout time; t next t represents the integration time of the second detector; save This indicates that only the first p rows of the first image signal matrix are collected, thus saving time by interrupting the detector's subsequent row readout operations.

6. A computer device, comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that the processor executes the computer program to implement the fast adaptive method for integration time of a remote sensing detector at a fixed frame rate according to any one of claims 1-4.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that, When executed by a processor, the computer program implements the fast adaptive method for integration time of remote sensing detectors at a fixed frame rate as described in any one of claims 1-4.

8. A computer program product, comprising a computer program, characterized in that, When executed by a processor, the computer program implements the fast adaptive method for integration time of remote sensing detectors at a fixed frame rate as described in any one of claims 1-4.

Citation Information

Patent Citations

  • Pixel signal output method and reading circuit of infrared focal plane detector

    CN114660671A

  • Method for operating CMOS image sensor

    KR1020060114406A