Fire detection sensor and its task processing method

Abstract

The present application provides a forest fire detection sensor and a task processing method thereof, the forest fire detection sensor comprising an imaging unit and an image processing unit; the method comprising: based on the imaging task set in each round, performing remote sensing imaging on the ground target by the imaging unit, sending the remote sensing image obtained to the image processing unit, and performing image processing on the received remote sensing image by the image processing unit; when it is determined that the imaging unit completes the imaging task in the current round and it is determined that the image processing unit completes the image processing task in the current round, triggering the imaging unit and the image processing unit to enter the next round of task execution process; the image processing task and the imaging task in each round correspond to each other. According to the scheme, the total task processing time can be shortened, the processing efficiency of the forest fire detection sensor can be improved, and the on-orbit autonomous detection function of the forest fire detection sensor can be met.

Description

Technical Field

[0001] This invention relates to the field of remote sensing imaging technology, and in particular to a forest fire detection sensor and its task processing method. Background Technology

[0002] The current satellite products used for forest fire detection consist of forest fire detection sensors that perform remote sensing imaging of the ground according to a fixed time sequence, and then transmit the obtained remote sensing images to ground equipment. The ground equipment then processes the remote sensing images to obtain the final forest fire detection results.

[0003] However, for forest fire detection sensors capable of on-board imaging and image processing, a new timing sequence needs to be designed to meet the on-orbit autonomous detection function of the forest fire detection sensors. Summary of the Invention

[0004] This invention provides a forest fire detection sensor and its task processing method, which can improve the processing efficiency of the forest fire detection sensor and meet the on-orbit autonomous detection function of the forest fire detection sensor.

[0005] In a first aspect, embodiments of the present invention provide a task processing method for a forest fire detection sensor, the forest fire detection sensor including an imaging unit and an image processing unit; the method includes:

[0006] Based on the imaging task set in each round, the imaging unit performs remote sensing imaging of ground targets. Each remote sensing image is sent to the image processing unit, which performs image processing on the received remote sensing images.

[0007] When it is determined that the imaging unit has completed the imaging task for this round, and the image processing unit has completed the image processing task for this round, the imaging unit and the image processing unit are triggered to enter the next round of task execution process; the image processing task and the imaging task in each round correspond one-to-one.

[0008] In one possible implementation, determining that the imaging unit has completed the imaging task for this round includes:

[0009] Determine whether the number of remote sensing images obtained by the imaging unit in this round meets the requirements of the imaging task in this round; if it does, further determine whether the motor in the imaging unit has reached the predetermined position; wherein, if the filter of the spectral band corresponding to the next imaging has reached the imaging position, then determine that the motor has reached the predetermined position.

[0010] If it is determined that the motor has reached the predetermined position, then the imaging unit has completed the imaging task for this round.

[0011] In one possible implementation, the required quantity is the number of filters for the imaging unit corresponding to multiple spectral bands.

[0012] One possible implementation also includes:

[0013] Determine the target processing time required for the image processing unit to process a single remote sensing image;

[0014] Based on the required quantity and the target duration, the time interval between two consecutive remote sensing imaging operations of the imaging unit on the ground target is determined, so that the imaging unit performs remote sensing imaging of the ground target according to the time interval.

[0015] In one possible implementation, the time interval is no greater than the target duration.

[0016] In one possible implementation, the baffles and filters corresponding to multiple spectral bands in the imaging unit are uniformly distributed on the concentric circles of the filter wheel;

[0017] It also includes: when the baffle reaches the imaging position and the correction conditions are met, using the baffle to acquire a dark field image, so as to use the dark field image to update the non-uniform correction parameters of the imaging unit.

[0018] In one possible implementation, the image processing unit performs image processing on the received remote sensing image, including:

[0019] The image processing unit processes each remote sensing image sequentially according to the order in which they are received.

[0020] Secondly, embodiments of the present invention also provide a forest fire detection sensor, the forest fire detection sensor including an imaging unit and an image processing unit;

[0021] The imaging unit is used to perform remote sensing imaging of ground targets based on the imaging task set in each round, and sends each obtained remote sensing image to the image processing unit.

[0022] The image processing unit is used to perform image processing on the received remote sensing images;

[0023] The imaging unit is further configured to trigger the imaging unit and the image processing unit to enter the next round of task execution when it is determined that the imaging unit has completed the imaging task of the current round and the image processing unit has completed the image processing task of the current round; the image processing task and the imaging task in each round correspond one-to-one.

[0024] Thirdly, embodiments of the present invention also provide an electronic device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, it implements the method described in any embodiment of this specification.

[0025] Fourthly, embodiments of the present invention also provide a computer-readable storage medium having a computer program stored thereon, which, when executed in a computer, causes the computer to perform the methods described in any embodiment of this specification.

[0026] This invention provides a forest fire detection sensor and its task processing method. During task processing, tasks are executed separately according to different rounds. For each round of task processing, the imaging unit and the image processing unit execute the corresponding tasks in parallel. After both the imaging unit and the image processing unit have completed the task processing for this round, the next round of task execution begins. In this way, the total task processing time can be shortened, the processing efficiency of the forest fire detection sensor can be improved, and the on-orbit autonomous detection function of the forest fire detection sensor can be met. Attached Figure Description

[0027] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0028] Figure 1 This is a flowchart of a task processing method for a forest fire detection sensor according to an embodiment of the present invention;

[0029] Figure 2 This is a structural diagram of a forest fire detection sensor provided in an embodiment of the present invention. Detailed Implementation

[0030] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are some embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0031] To improve the processing efficiency of forest fire detection sensors and ensure their overall timing meets the requirements for autonomous on-orbit detection, it is necessary to analyze their working principle. The forest fire detection sensor uses infrared multispectral time-division imaging to remotely sense the Earth, and then fuses the multispectral images to obtain the final forest fire detection result. Therefore, on-orbit detection requires both remote sensing imaging and image processing. Besides requiring computationally efficient image processing algorithms, a highly efficient overall timing is also crucial for achieving on-orbit detection.

[0032] Based on this, the inventive concept of this invention is to parallelize the remote sensing imaging control process and the image processing process to improve time utilization efficiency and provide a basis for real-time on-orbit detection of forest fire detection sensors.

[0033] The specific implementation of the above concept is described below.

[0034] Please refer to Figure 1 This invention provides a task processing method for a forest fire detection sensor, the forest fire detection sensor including an imaging unit and an image processing unit; the method includes:

[0035] Step 100: Based on the imaging task set in each round, the imaging unit performs remote sensing imaging of the ground target. Each remote sensing image is sent to the image processing unit, which performs image processing on the received remote sensing image.

[0036] Step 102: When it is determined that the imaging unit has completed the imaging task of this round, and the image processing unit has completed the image processing task of this round, the imaging unit and the image processing unit are triggered to enter the next round of task execution process; the image processing task and the imaging task in each round correspond one-to-one.

[0037] In this embodiment of the invention, during task processing, tasks are executed separately according to different rounds. For each round of task processing, the imaging unit and the image processing unit execute the corresponding tasks in parallel. After both the imaging unit and the image processing unit have completed the task processing of this round, the next round of task execution process begins. In this way, the total task processing time can be shortened, the processing efficiency of the forest fire detection sensor can be improved, and the on-orbit autonomous detection function of the forest fire detection sensor can be met.

[0038] The following description Figure 1 The execution method of the task processing method shown is explained.

[0039] The forest fire detection sensor implements remote sensing imaging and image processing through an imaging unit and an image processing unit, respectively. Since the forest fire detection sensor uses infrared multispectral time-division imaging for earth remote sensing, the imaging unit includes at least a motor, a filter wheel, a baffle, and filters corresponding to multiple spectral bands. The baffle and filters corresponding to multiple spectral bands are evenly distributed on concentric circles of the filter wheel. The motor is controlled via a closed loop using an FPGA or DPU to switch the imaging spectral bands of the infrared detector.

[0040] The task in this embodiment of the invention refers to the forest fire detection task to be performed by the forest fire detection sensor. Since forest fire detection needs to be performed in real time on orbit, both the remote sensing imaging process and the image processing process need to be implemented on the satellite. If the remote sensing imaging process and the image processing process are processed according to their respective time sequences, the image processing process will be severely delayed, and as the forest fire detection time increases, the recognition results cannot be output in real time.

[0041] Therefore, in this embodiment of the invention, the task execution process is carried out in rounds. In each round of task execution, the imaging unit and the image processing unit execute their respective tasks in parallel. That is, the imaging unit performs remote sensing imaging of the ground target and sends the obtained remote sensing image to the image processing unit. The image processing unit performs image processing on the received remote sensing image. While the image processing unit is performing image processing, the imaging unit controls the filter wheel to switch imaging spectral bands. Only after both have completed their tasks for this round can the next round of task execution begin. Since the duration of filter wheel control is shorter than the duration of a single image processing, and the imaging tasks performed by the imaging unit and the image processing tasks performed by the image processing unit are in one-to-one correspondence, the imaging tasks will be completed before the image processing tasks. Therefore, after the imaging unit completes its imaging task for this round, if the image processing unit has not yet completed its image processing task for this round, the imaging unit needs to wait for the image processing unit through an interrupt method. Only after the image processing unit completes its image processing task for this round will the imaging unit perform the next imaging. This ensures that the imaging task and the image processing task are in one-to-one correspondence within each round of task processing. The forest fire detection results output in this stage are generated from the remote sensing images in the same stage, thus ensuring the real-time nature of the detection results.

[0042] In this embodiment of the invention, an imaging task can be set for each round, which can require the acquisition of a certain number of remote sensing images. For example, if a round of imaging requires one remote sensing image, the imaging unit performs one remote sensing imaging of the ground target, such as using spectrum A1, and sends the remote sensing image obtained from spectrum A1 to the image processing unit. The image processing unit processes the remote sensing image, and after processing, the next round begins, using spectrum A2, and so on. Alternatively, if a round of imaging requires M (M is a positive integer not less than 1) remote sensing images, then in each round, the ground target is imaged M times, using filters of different spectral bands for each imaging, such as spectra A1, A2, ..., AN. Each obtained remote sensing image is sent to the image processing unit, which processes the received image. After processing M images, the next round begins.

[0043] It should be noted that the number of remote sensing images required for different rounds of imaging tasks may be the same or different, and the specific program settings should be made according to the actual algorithm requirements.

[0044] In one embodiment of the present invention, step 102, determining that the imaging unit has completed the imaging task for this round, may specifically include:

[0045] Determine whether the number of remote sensing images obtained by the imaging unit in this round meets the requirements of the imaging task in this round; if it does, further determine whether the motor in the imaging unit has reached the predetermined position; wherein, if the filter of the spectral band corresponding to the next imaging has reached the imaging position, then determine that the motor has reached the predetermined position.

[0046] If it is determined that the motor has reached the predetermined position, then the imaging unit has completed the imaging task for this round.

[0047] The motor controls the rotation of the filter wheel by rotating. Each rotation of the filter wheel switches the filter. Controlling the filter wheel to rotate one unit takes a certain amount of time, such as 200ms. If the imaging unit considers the imaging task complete only after the number of remote sensing images obtained in the current round meets the requirements of the current imaging task, then when entering the next round of task processing, the motor needs to be rotated first to perform the first imaging of the next round. That is, it takes 200ms to rotate the motor before imaging and image processing can be performed. In this embodiment of the invention, as described above, the imaging unit's task is completed before the image processing task. Therefore, when the number of remote sensing images obtained by the imaging unit in the current round meets the requirements of the current imaging task, the imaging unit rotates the motor to a predetermined position while waiting for the image processing unit to complete the image processing task. Thus, when entering the next round of task processing, imaging can be performed directly without consuming 200ms of motor rotation, thereby further shortening the task processing time and making it easier to achieve on-orbit detection of the forest fire detection sensor.

[0048] In one embodiment of the present invention, the required quantity is the number of filters corresponding to multiple spectral bands in the imaging unit. This ensures that a target can be imaged in the remote sensing image from spectrum A1 to spectrum AN, preventing the target from leaving the field of view when using spectrum AN imaging, thereby improving the accuracy of forest fire detection results.

[0049] Furthermore, in step 100, when the imaging task requires a number of remote sensing images greater than 1, the imaging unit can continuously acquire the required number of remote sensing images or perform remote sensing imaging of the ground target at set time intervals to obtain the required number of remote sensing images.

[0050] In this embodiment of the invention, the time interval can be determined by: determining the target duration required for the image processing unit to process a single spectral band remote sensing image; and determining the time interval between two adjacent remote sensing imaging operations of the ground target by the imaging unit based on the required quantity and the target duration, so that the imaging unit performs remote sensing imaging of the ground target according to the time interval.

[0051] Specifically, this time interval is no greater than the target duration. Since the imaging unit needs to control the motor to rotate the filter wheel to the next spectral band after imaging the previous spectral band before it can perform the next imaging, and the rotation of the filter wheel to one spectral band takes a fixed amount of time, the imaging unit needs to complete the rotation of the filter wheel within this time interval after the previous imaging is completed. This rotation of the filter wheel can occur at any point within the time interval. It can be understood that the time interval is no less than the rotation time of the filter wheel to one spectral band.

[0052] In one embodiment of the present invention, when the baffle reaches the imaging position and meets the correction conditions, a dark field image is acquired using the baffle, so as to update the non-uniform correction parameters of the imaging unit using the dark field image.

[0053] The calibration condition can be performed once every time the filter wheel switches to the baffle, or once every set number of switches to the baffle. Furthermore, the process of updating parameters using the baffle can be implemented using existing technologies, which will not be elaborated upon in this embodiment.

[0054] like Figure 2 As shown, an embodiment of the present invention provides a forest fire detection sensor, which includes an imaging unit 201 and an image processing unit 202;

[0055] The imaging unit is used to perform remote sensing imaging of ground targets based on the imaging task set in each round, and sends each obtained remote sensing image to the image processing unit.

[0056] The image processing unit is used to perform image processing on the received remote sensing images;

[0057] The imaging unit is further configured to trigger the imaging unit and the image processing unit to enter the next round of task execution when it is determined that the imaging unit has completed the imaging task of the current round and the image processing unit has completed the image processing task of the current round; the image processing task and the imaging task in each round correspond one-to-one.

[0058] In one embodiment of the present invention, when the imaging unit determines that it has completed the imaging task of the current round, it specifically includes:

[0059] Determine whether the number of remote sensing images obtained by the imaging unit in this round meets the requirements of the imaging task in this round; if it does, further determine whether the motor in the imaging unit has reached the predetermined position; wherein, if the filter of the spectral band corresponding to the next imaging has reached the imaging position, then determine that the motor has reached the predetermined position.

[0060] If it is determined that the motor has reached the predetermined position, then the imaging unit has completed the imaging task for this round.

[0061] In one embodiment of the present invention, the required quantity is the number of filters corresponding to multiple spectral bands of the imaging unit.

[0062] In one embodiment of the present invention, the imaging unit is further configured to determine the target duration required for the image processing unit to process a single remote sensing image; based on the required quantity and the target duration, the time interval between two adjacent remote sensing imaging operations of the ground target by the imaging unit is determined, so that the imaging unit performs remote sensing imaging of the ground target according to the time interval.

[0063] In one embodiment of the present invention, the time interval is not greater than the target duration.

[0064] In one embodiment of the present invention, the baffles and filters corresponding to multiple spectral bands in the imaging unit are uniformly distributed on the concentric circles of the filter wheel;

[0065] The imaging unit is also used to acquire a dark field image using the baffle when the baffle reaches the imaging position and the correction conditions are met, so as to update the non-uniform correction parameters of the imaging unit using the dark field image.

[0066] In one embodiment of the present invention, when the image processing unit performs image processing on the received remote sensing images, it specifically includes: the image processing unit processes each remote sensing image sequentially according to the order in which the remote sensing images are received.

[0067] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on a forest fire detection sensor. In other embodiments of the present invention, a forest fire detection sensor may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0068] The information interaction and execution process between the modules in the above-mentioned device are based on the same concept as the method embodiment of the present invention, and the specific details can be found in the description in the method embodiment of the present invention, and will not be repeated here.

[0069] This invention also provides an electronic device, including a memory and a processor. The memory stores a computer program, and when the processor executes the computer program, it implements a task processing method for a forest fire detection sensor according to any embodiment of this invention.

[0070] This invention also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, causes the processor to perform a task processing method for a forest fire detection sensor according to any embodiment of this invention.

[0071] Specifically, a system or apparatus equipped with a storage medium may be provided, on which software program code implementing the functions of any of the embodiments described above is stored, and the computer (or CPU or MPU) of the system or apparatus may read and execute the program code stored in the storage medium.

[0072] In this case, the program code read from the storage medium can itself implement the function of any of the above embodiments, and therefore the program code and the storage medium storing the program code constitute part of the present invention.

[0073] Examples of storage media used to provide program code include floppy disks, hard disks, magneto-optical disks, optical disks (such as CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD+RW), magnetic tapes, non-volatile memory cards, and ROMs. Alternatively, program code can be downloaded from a server computer via a communication network.

[0074] Furthermore, it should be clear that not only can the program code read by the computer be executed, but also the operating system or other components operating on the computer can be instructed based on the program code to perform some or all of the actual operations, thereby achieving the function of any of the embodiments described above.

[0075] Furthermore, it is understood that the program code read from the storage medium is written to the memory set in the expansion board inserted into the computer or to the memory set in the expansion module connected to the computer. Then, based on the instructions of the program code, the CPU or other components installed on the expansion board or expansion module execute some and all of the actual operations, thereby realizing the function of any of the above embodiments.

[0076] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0077] Those skilled in the art will understand that all or part of the steps of the above method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it performs the steps of the above method embodiments. The aforementioned storage medium includes various media that can store program code, such as ROM, RAM, magnetic disk, or optical disk.

[0078] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A task processing method for a forest fire detection sensor, characterized in that, The forest fire detection sensor includes an imaging unit and an image processing unit, which respectively implement the remote sensing imaging process and the image processing process. Both the remote sensing imaging process and the image processing process are implemented on-board. The forest fire detection sensor is used to meet the on-orbit autonomous detection function within the overall system timeline. During task processing, tasks are executed separately according to different rounds. For each round of task processing, the imaging unit and the image processing unit execute the corresponding tasks in parallel. After both the imaging unit and the image processing unit complete the task processing for this round, the next round of task execution begins. The method includes: Based on the imaging task set in each round, the imaging unit performs remote sensing imaging of ground targets. Each remote sensing image is sent to the image processing unit, which performs image processing on the received remote sensing images. The system determines whether the number of remote sensing images obtained by the imaging unit in this round meets the requirements of the imaging task for this round. If it does, it further determines whether the motor in the imaging unit has reached the predetermined position. If the filter for the spectral band corresponding to the next imaging has reached the imaging position, it determines that the motor has reached the predetermined position. If it is determined that the motor has reached the predetermined position, it determines that the imaging unit has completed the imaging task for this round. When it is determined that the imaging unit has completed the imaging task for this round, and it is determined that the image processing unit has completed the image processing task for this round, the imaging unit and the image processing unit are triggered to enter the next round of task execution. While the image processing unit is performing image processing, the imaging unit controls the filter wheel to switch the imaging spectral band. The duration of the filter wheel control is shorter than the duration of a single image processing. After the imaging unit completes the imaging task for this round, if the image processing unit has not yet completed the image processing task for this round, the imaging unit waits for the image processing unit through an interrupt. Only after the image processing unit completes the image processing task for this round will the imaging unit perform the next imaging, so as to ensure that the image processing task and the imaging task correspond one-to-one in each round of task processing stage.

2. The method according to claim 1, characterized in that, The required quantity refers to the number of filters for the imaging unit corresponding to multiple spectral bands.

3. The method according to claim 1, characterized in that, Also includes: Determine the target processing time required for the image processing unit to process a single remote sensing image; Based on the required quantity and the target duration, the time interval between two consecutive remote sensing imaging operations of the imaging unit on the ground target is determined, so that the imaging unit performs remote sensing imaging of the ground target according to the time interval.

4. The method according to claim 3, characterized in that, The time interval is not greater than the target duration.

5. The method according to claim 1, characterized in that, The baffles and filters corresponding to multiple spectral bands in the imaging unit are evenly distributed on the concentric circles of the filter wheel; It also includes: when the baffle reaches the imaging position and the correction conditions are met, using the baffle to acquire a dark field image, so as to use the dark field image to update the non-uniform correction parameters of the imaging unit.

6. The method according to any one of claims 1-5, characterized in that, The image processing unit performs image processing on the received remote sensing images, including: The image processing unit processes each remote sensing image sequentially according to the order in which they are received.

7. A forest fire detection sensor, characterized in that, For performing the method as described in any one of claims 1-6, the forest fire detection sensor includes an imaging unit and an image processing unit; The imaging unit is used to perform remote sensing imaging of ground targets based on the imaging task set in each round, and sends each obtained remote sensing image to the image processing unit. The image processing unit is used to perform image processing on the received remote sensing images; The imaging unit is further configured to trigger the imaging unit and the image processing unit to enter the next round of task execution when it is determined that the imaging unit has completed the imaging task of the current round and the image processing unit has completed the image processing task of the current round; the image processing task and the imaging task in each round correspond one-to-one.

8. An electronic device comprising a memory and a processor, wherein the memory stores a computer program, and the processor, when executing the computer program, implements the method as described in any one of claims 1-6.

9. A computer-readable storage medium having a computer program stored thereon, which, when executed in a computer, causes the computer to perform the method of any one of claims 1-6.

Images