Remote sensing target dynamic detection method, device, storage medium and electronic equipment

Abstract

This specification discloses a method, device, storage medium and electronic device for dynamic detection of remote sensing targets. When using satellites to perform dynamic detection of remote sensing targets using this method, remote sensing images of the same target area can be collected in sequence at the same position by several satellites on the same track. After each satellite identifies the remote sensing image and obtains the object state of the target object, the data of all satellites are transmitted to the next satellite until the last satellite summarizes all remote sensing images and object states to obtain dynamic analysis results. Through this method, the satellite does not need to transmit a large amount of image data back to the ground station, which greatly reduces the amount of data that needs to be transmitted between the satellite and the ground station; at the same time, each satellite performs target recognition on the remote sensing images collected by itself, which not only saves the time for the ground station to analyze the image data, but also can complete target recognition and transmit data to the next satellite during the subsequent satellite operation, greatly improving the overall efficiency of target detection.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a remote sensing target dynamic detection method, device, storage medium and electronic device. Background Art

[0002] Satellite remote sensing technology is one of the commonly used target detection technologies. It uses artificial satellites as a platform to observe the earth through remote sensors carried on satellites, obtain surface information, and process and analyze it. However, at present, satellite remote sensing technology still has some shortcomings.

[0003] On the one hand, since satellites do not have the ability to process image data, the acquired image data needs to be transmitted to the ground for processing, resulting in poor real-time performance, which seriously affects the real-time detection capability of dynamically changing targets on the ground. On the other hand, since most ground stations are located within the country, the window period for receiving satellite data is very short, usually only seven to eight minutes. However, the amount of remote sensing image data is large, and it is often impossible to complete the transmission of all data within the window period of a single transit, resulting in low data transmission efficiency.

[0004] In summary, satellites can only observe target areas for a limited time in orbit, and it is difficult to quickly transmit a large amount of remote sensing image data, making it impossible to achieve continuous detection and change tracking of ground targets and events. Therefore, how to enhance the detection and tracking capabilities of satellite remote sensing for dynamic targets is an urgent problem to be solved. Summary of the invention

[0005] The present specification provides a remote sensing target dynamic detection method, device, storage medium and electronic device to at least partially solve the above-mentioned problems existing in the prior art.

[0006] This manual adopts the following technical solutions:

[0007] This specification provides a remote sensing target dynamic detection method, the method is applied to a constellation, the constellation includes a plurality of satellites, and each satellite runs on the same orbit, the method includes:

[0008] receiving a target detection instruction, determining a target area where a target object to be detected is located, and selecting a number of consecutive satellites from the satellites for performing this target detection;

[0009] For each selected satellite, when the satellite moves to a specified position of the orbit, the satellite collects a remote sensing image of the target area;

[0010] The satellite performs target recognition on the remote sensing image to obtain the object state of the target object;

[0011] If the satellite is not the last satellite among the selected satellites, the satellite transmits the remote sensing image and the object status, as well as the remote sensing image and the object status received from the previous satellite of the satellite in the constellation, to a next satellite adjacent to the satellite in the constellation;

[0012] If the satellite is the last satellite among the selected satellites, the satellite determines the dynamic analysis result of the target object according to the remote sensing images and the object status collected by the satellites, and transmits the dynamic analysis result to the ground station.

[0013] Optionally, the satellite includes a satellite platform and a satellite payload, the satellite platform includes at least a power distribution unit, an attitude and orbit control subsystem, an integrated electronic computer, an all-in-one measurement and transmission machine, and an antenna, and the satellite payload includes at least an intelligent computing payload, a router payload, a laser communicator, and a remote sensing sensor.

[0014] Optionally, the satellite collects remote sensing images of the target area, specifically including:

[0015] The satellite collects at least one of an optical image, an infrared image, and a synthetic aperture radar image of the target area as a remote sensing image of the target area.

[0016] Optionally, before the satellite performs target recognition on the remote sensing image, the method further includes:

[0017] The satellite preprocesses the remote sensing image, wherein the preprocessing includes at least one of radiation correction, band registration, geometric correction, image denoising, and image fusion.

[0018] Optionally, the satellite performs target recognition on the remote sensing image to obtain the object state of the target object, specifically including:

[0019] The satellite identifies the location, object type, and identification confidence of the target object as the object state of the target object.

[0020] Optionally, the satellite determines the dynamic analysis result of the target object according to the remote sensing images collected by the satellites and the state of the object, specifically including:

[0021] The satellite determines, for each remote sensing image, whether the target object exists in the remote sensing image;

[0022] A dynamic analysis result of the target object is determined according to the object state of the target object in each remote sensing image in which the target object exists.

[0023] Optionally, transmitting the dynamic analysis result to a ground station specifically includes:

[0024] The satellite determines whether it is in a window period in which it can communicate with the ground station;

[0025] In response to the satellite being in a window period in which it can communicate with the ground station, the satellite transmits the dynamic analysis result to the ground station;

[0026] In response to the satellite not being in a window period in which it can communicate with the ground station, the satellite stores the dynamic analysis result, and transmits the dynamic analysis result to the ground station when the satellite next operates into a window period in which it can communicate with the ground station.

[0027] This specification provides a remote sensing target dynamic detection device, which is applied to a constellation, wherein the constellation includes a plurality of satellites, and each satellite runs on the same orbit, and the device includes:

[0028] A determination module is used to receive a target detection instruction, determine a target area where a target object to be detected is located, and select a number of consecutive satellites from the satellites to perform this target detection;

[0029] A collection module, for each selected satellite, when the satellite moves to a specified position of the orbit, the satellite collects a remote sensing image of the target area;

[0030] An identification module, used for the satellite to perform target identification on the remote sensing image to obtain the object state of the target object;

[0031] a transmission module, configured to transmit, if the satellite is not the last satellite among the selected satellites, the remote sensing image and the object state, and the remote sensing image and the object state received from the previous satellite of the satellite in the constellation to a next satellite adjacent to the satellite in the constellation;

[0032] The analysis module is used for determining the dynamic analysis result of the target object according to the remote sensing images and object states collected by the satellites if the satellite is the last satellite among the selected satellites, and transmitting the dynamic analysis result to the ground station.

[0033] This specification provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the above-mentioned remote sensing target dynamic detection method is implemented.

[0034] This specification provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above remote sensing target dynamic detection method when executing the program.

[0035] At least one of the above technical solutions adopted in this specification can achieve the following beneficial effects:

[0036] In the remote sensing target dynamic detection method provided in the present specification, a target detection instruction is received, a target area where a target object to be detected is located is determined, and a number of consecutive satellites are selected from the satellites for performing this target detection; for each selected satellite, when the satellite moves to a specified position of the orbit, the satellite collects a remote sensing image of the target area; the satellite performs target recognition on the remote sensing image to obtain the object state of the target object; if the satellite is not the last satellite among the selected satellites, the satellite transmits the remote sensing image and the object state, as well as the remote sensing image and the object state received from the previous satellite of the satellite in the constellation to the next satellite adjacent to the satellite in the constellation; if the satellite is the last satellite among the selected satellites, the satellite determines a dynamic analysis result of the target object based on the remote sensing images and the object state collected by the satellites, and transmits the dynamic analysis result to a ground station.

[0037] When using the remote sensing target dynamic detection method provided in this specification to use satellites for dynamic detection of remote sensing targets, several satellites on the same track can collect remote sensing images of the same target area at the same location in turn, and after identifying the remote sensing images themselves to obtain the object state of the target object, they can continuously transmit data to the next satellite in a relay manner until the last satellite summarizes all remote sensing images and object states, obtains dynamic analysis results and returns them to the ground station. Through this method, the satellite does not need to transmit a large amount of image data back to the ground station, which greatly reduces the amount of data that needs to be transmitted between the satellite and the ground station; at the same time, each satellite can identify the target of the remote sensing image collected by itself, which not only saves the time for the ground station to analyze the image data, but also can complete target identification and transmit data to the next satellite during the subsequent satellite operation, greatly improving the overall efficiency of target detection. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The drawings described herein are used to provide a further understanding of this specification and constitute a part of this specification. The illustrative embodiments and descriptions of this specification are used to explain this specification and do not constitute an improper limitation on this specification. In the drawings:

[0039] Figure 1 A schematic diagram of a remote sensing target dynamic detection method in this specification;

[0040] Figure 2 A schematic diagram of the structure of a satellite provided in this specification;

[0041] Figure 3 A schematic diagram of a satellite collecting remote sensing images of a target area provided in this specification;

[0042] Figure 4A schematic diagram of a remote sensing target dynamic detection device provided in this specification;

[0043] Figure 5 The corresponding Figure 1 Schematic diagram of electronic equipment. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solutions and advantages of this specification more clear, the technical solutions of this specification will be clearly and completely described below in combination with the specific embodiments of this specification and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0045] The technical solutions provided by the embodiments of this specification are described in detail below in conjunction with the accompanying drawings.

[0046] Figure 1 The following is a flow chart of a remote sensing target dynamic detection method in this specification, which specifically includes the following steps:

[0047] S100: receiving a target detection instruction, determining a target area where a target object to be detected is located, and selecting a number of consecutive satellites from the satellites for performing this target detection.

[0048] This method is mainly used for dynamic detection of targets on the surface of the earth (hereinafter referred to as the ground) by remote sensing satellites. Unlike the traditional method of using only a single satellite to detect the target, this method uses multiple satellites in a constellation to dynamically track and detect the target. Based on this, all steps in the remote sensing target dynamic detection method provided in this specification can be implemented by any constellation constructed by several co-orbital satellites. Furthermore, in order to ensure that the detection results are as accurate as possible, in this method, all satellites in the constellation collect images of the target area at the same position on the orbit. Therefore, all satellites included in the constellation of this method are co-orbital satellites.

[0049] It is conceivable that when the satellite collects images of the ground, it will shoot the content in an area and obtain a remote sensing image. Therefore, when using this method to dynamically detect the target object, the target area where the target object to be detected is located can be first determined in this step. Among them, the target object is the object that needs to be analyzed in this detection. There can be only one target object or multiple target objects at the same time. This manual does not impose specific restrictions on this; the target area is the area where the target object is located. The size of the target area can be determined according to the range that can be collected when the satellite collects images, and the position of the target area can be determined according to the position of the target object.

[0050] Generally, the target detection command is transmitted from the ground station to the satellite. Therefore, the target area where the target object is located is usually determined by the ground station and then sent to each executing satellite.

[0051] The ground station can select a number of consecutive satellites from the constellation to perform the target detection according to the requirements of the target detection task. The number of satellites performing target detection can be any number, such as three, five, and all satellites included in the constellation, etc., and this specification does not impose specific restrictions on this. At the same time, the selected satellites should be consecutive satellites in the constellation, that is, the selected satellites in orbit are running continuously.

[0052] Furthermore, in the present method, there may be a variety of satellite structures, as long as the satellite can implement all the steps in the present method. This specification provides a specific embodiment for reference. Figure 2 This is a schematic diagram of the structure of a satellite provided in this manual. Figure 2 As shown, specifically, the satellite includes a satellite platform and a satellite payload. The satellite platform includes at least a power distribution unit, an attitude and orbit control subsystem, an integrated electronic computer, a measurement and transmission all-in-one machine, and an antenna. The satellite payload includes at least an intelligent computing payload, a router payload, a laser communicator, and a remote sensing sensor.

[0053] A satellite platform is a combination of a satellite body and a service system that can support one or more payloads. In fact, a satellite platform is the rest of a satellite except for the payload or payload compartment. The basic functions of a satellite platform include providing energy for the satellite, maintaining the accuracy of the satellite's attitude and orbit, and communicating with the ground control center. These functions are implemented through different subsystems, including energy subsystems, attitude and orbit control systems, propulsion systems, measurement and control data transmission systems, and temperature control systems.

[0054] Satellite payload refers to the instrument, equipment or subsystem that directly performs a specific satellite mission. It is a key part for the satellite to achieve specific functions in orbit, and different payloads can be configured according to different satellite missions. For example, remote sensing satellites may be equipped with payloads such as cameras, microwave radiometers, and radars; communication satellites may be equipped with payloads such as antennas and transponders; and navigation satellites are equipped with payloads such as high-precision onboard atomic clocks. There are many types of satellite payloads with great differences in performance, but they are all designed to achieve specific tasks that satellites must complete when operating in orbit. In the satellite design process, the selection and configuration of payloads are crucial, as they directly determine the application functions and performance of the satellite.

[0055] In this method, the satellite platform may include at least a power distribution unit, an attitude and orbit control subsystem, an integrated electronic computer, a measurement and transmission integrated machine, and an antenna. Among them, the power distribution unit is used to distribute power resources to other equipment in the satellite; the attitude and orbit control subsystem is a full-range attitude and orbit control system subsystem, which is used to control the attitude and orbit of the satellite; the integrated electronic computer is the main control system of the satellite, which is used to send control instructions to other equipment; the measurement and transmission integrated machine has both measurement and control and communication functions, which can monitor the status of the equipment and transmit data; the antenna is used to send and receive signals on the satellite to achieve communication with other satellites or ground stations.

[0056] The satellite payload may include at least intelligent computing payload, router payload, laser communication machine, and remote sensing sensor. Among them, the intelligent computing payload can be equipped with multiple high-performance computing units, each of which includes a central processing unit (CPU), a graphics processing unit (GPU), and may also include a field programmable gate array (FPGA), which can run complex computing models and support real-time processing and analysis of high-definition image data; the router payload is used for data exchange and network management to ensure efficient and reliable communication between satellites; multiple laser communication machines can be carried, which can provide high-speed, low-latency data transmission for inter-satellite business data exchange; remote sensing sensors may include optical sensors, infrared sensors, and synthetic aperture radar imaging sensors, etc. Satellites can be equipped with a variety of different remote sensing sensors to obtain different types of multi-spectral image data. In addition to the hardware payload, the satellite is also equipped with a corresponding software system. In addition to the underlying customized Linux operating system, it also includes a distributed system based on KubeEdge to support multi-satellite distributed computing needs.

[0057] S102: For each selected satellite, when the satellite moves to a specified position of the orbit, the satellite collects a remote sensing image of the target area.

[0058] After determining the target area for which images need to be collected in step S100, in this step, remote sensing images of the target area can be collected by satellites in the constellation. It should be noted that in steps S102 to S108 of this specification, the description is based on a satellite in the constellation. In other words, the execution subject in steps S102 to S108 is the same satellite, and the satellite can be any satellite in the constellation. Each satellite will execute steps S102 to S108 in sequence until all satellites complete the above steps.

[0059] In this method, each selected satellite will collect remote sensing images of the target area, and each satellite will collect remote sensing images of the target area at different times and the same position. The same position is the designated position on the orbit where the satellite is running. Under the condition that each satellite is a co-orbital satellite, each satellite will run to the designated position on the orbit to collect the target area. Similar to the target area, the designated position on the orbit is also determined by the ground station and sent to the satellite.

[0060] Each satellite in the constellation will continuously move along the orbit around the earth, and the spacing between them is uniform. Each time when the target detection command is received from the ground station, the position of each satellite in the orbit is not fixed, and the time to reach the designated position next time is also not fixed. Therefore, in this method, the target detection command received in step S100 is taken as the current moment, and the selected satellites are sorted from the first satellite to the last satellite according to the time required to move to the designated position for the first time at the current moment from short to long. For example, the satellite with the shortest time required to move to the designated position on the orbit for the first time at the current moment is the first satellite; the satellite with the longest time required to move to the designated position on the orbit for the first time at the current moment is the last satellite.

[0061] Under the above rules, each selected satellite will pass through the designated position on the orbit at the same interval, and collect remote sensing images of the target area at the designated position. Furthermore, according to the type of remote sensing sensor carried in the satellite payload, there may be multiple means of collecting remote sensing images, including but not limited to optical images, infrared images, synthetic aperture radar (SAR) images, etc. The satellite collects at least one of the multiple different types of images as the remote sensing image of the target area. In order to ensure the accuracy of subsequent analysis, the types of remote sensing images collected by each satellite should be consistent.

[0062] Figure 3 The following is a schematic diagram of a feasible satellite remote sensing image collection target area provided in this specification. Figure 3 As shown in FIG. 1 , when each satellite moves along its orbit, when a satellite moves to a specified position on the orbit, it will take a remote sensing image of the target area containing the target object. Figure 3 In the example, the target object to be detected is a ship sailing on the sea. It can be seen that Figure 3 The direction of travel of the middle satellite is to the right, and the satellite in front of it, that is, Figure 3The satellite on the right side will arrive at the designated position first and take pictures of the target area; the satellite on the left side will arrive at the designated position later and take pictures of the target area. During the two shots, the target area will not change, but the ship that is the target object is in a moving state. Therefore, the position of the ship in the target area is different in the two shots. Of course, Figure 3 Only two satellites are shown. Figure 3 The method given can also obtain the situation where more satellites collect remote sensing images of the target area in sequence.

[0063] S104: The satellite performs target recognition on the remote sensing image to obtain the object state of the target object.

[0064] In step S102, after the satellite has collected the remote sensing image of the target area, a target recognition function may be performed on the remote sensing image to determine the object state of the target object.

[0065] In this method, a neural network model capable of realizing the target recognition function can be used to perform target recognition on remote sensing images. At present, there are many relatively mature neural network models for target recognition, including but not limited to yolo, R-CNN, SSD and other series of models. Any of these neural network models can be used to realize the function of identifying the target object in the remote sensing image in this step, and this manual does not make specific restrictions on this.

[0066] Among them, the object state of the target object can be predetermined according to the specific needs when performing target detection. For example, in the scenario of analyzing the motion of a continuously moving dynamic target that this method focuses on, the position, object type and recognition confidence of the target object can be identified when performing object recognition as the object state of the target object. Among them, the position of the target object can be an absolute position expressed in the form of longitude and latitude, or a relative position expressed in coordinates with a point in the target area as the far point; the object type is the type to which the target object belongs, in layman's terms, what the target object is; the recognition confidence is used to indicate the credibility of the output of the neural network model.

[0067] Additionally, before performing target recognition on the remote sensing image, the remote sensing image may be preprocessed. Specifically, the satellite may preprocess the remote sensing image, wherein the preprocessing includes at least one of radiation correction, band registration, geometric correction, image denoising, and image fusion. Through the preprocessing operation, the image quality may be further improved, and the image recognizability may be enhanced, so that a better target recognition effect may be obtained later.

[0068] Among them, radiation correction is used to correct radiation errors in images to ensure the radiation consistency of images; band registration is used to accurately align different bands of multispectral images to ensure that the same geographical location corresponds to the same pixel position in all bands; geometric correction is used to correct geometric distortion in images to ensure spatial alignment between multiple images; image denoising is used to use advanced image denoising algorithms to remove noise and interference in images and improve image quality; image fusion is used to combine image information from different bands to generate a composite image containing more information, which can combine the advantages of multiple sensors to improve the reliability and accuracy of target detection. For example, visible light images provide detailed information, while infrared images can provide temperature information under low visibility conditions. Combining the advantages of both, targets can be identified more accurately under different environmental conditions.

[0069] S106: If the satellite is not the last satellite among the selected satellites, the satellite transmits the remote sensing image and the object status, as well as the remote sensing image and the object status received from the previous satellite of the satellite in the constellation, to the next satellite adjacent to the satellite in the constellation.

[0070] After the satellite completes target recognition of the remote sensing image collected by itself in step S104, the next operation to be performed can be determined according to the position of the satellite itself in the satellite sequence included in the constellation during this target detection process.

[0071] As described in step S102, the position of the satellite in the constellation is determined by the time required for the satellite to move to the specified position on the orbit next time when receiving the instruction to perform target detection. In simple terms, the shorter the time required, the higher the satellite is ranked in the satellite sequence; conversely, the longer the time required, the lower the satellite is ranked in the satellite sequence.

[0072] There are two specific cases. The first case is when the satellite is not the last satellite selected. At this time, the satellite can transmit the remote sensing images it has collected and the object status obtained after target recognition of the remote sensing images to the next satellite adjacent to the satellite in the constellation. At the same time, the satellite will also transmit the remote sensing images and object status received from the previous satellite to the next satellite.

[0073] When any two satellites are continuous in orbit, that is, there is no other satellite between them, then the two satellites can be considered adjacent. Based on the direction of the satellites in orbit, the satellite that is relatively behind in the direction of movement is the next satellite of the satellite that is relatively ahead, and vice versa, the satellite that is relatively ahead is the previous satellite of the satellite that is relatively behind.

[0074] For example, starting from the first satellite, it transmits the remote sensing images it has collected and the object status obtained through target recognition to the second satellite; the second satellite transmits its own remote sensing images and object status, together with the content received from the first satellite, to the third satellite, and so on, until all remote sensing images and object status are transmitted to the last satellite. In simple terms, each satellite will transmit all remote sensing images and object status obtained from the first satellite to itself to the next satellite until the last satellite.

[0075] S108: If the satellite is the last satellite among the selected satellites, the satellite determines a dynamic analysis result of the target object according to the remote sensing images collected by the satellites and the object status, and transmits the dynamic analysis result to the ground station.

[0076] After analyzing the case in step S106 where the satellite is not the last satellite selected, this step will describe the case where the satellite is the last satellite selected.

[0077] In the case that this satellite is the last satellite selected, there are no subsequent satellites to continue collecting remote sensing images. Therefore, this satellite will play a summary role, and obtain the final dynamic analysis results of the target object based on all remote sensing images obtained from the first satellite to the last satellite and the object states corresponding to all remote sensing images.

[0078] The content included in the dynamic analysis result can also be set according to specific needs. In a specific embodiment, when determining the analysis result of the target object, the satellite can specifically determine whether the target object exists in each remote sensing image; and determine the dynamic analysis result of the target object according to the object state of the target object in each remote sensing image where the target object exists.

[0079] During the continuous operation and shooting of the satellite, the target object may not appear in the first few remote sensing images, or the target image may have left the target area in the last few remote sensing images. Therefore, before the last satellite performs analysis, it is necessary to first determine which remote sensing images contain the target object and filter out the remote sensing images that do not contain the target object.

[0080] Subsequently, the dynamic analysis results of the target object can be analyzed based on the object state corresponding to the remote sensing image where the target object exists. The dynamic analysis results may include but are not limited to the moving speed, diffusion speed, acceleration, direction and other data of the target object. Finally, the last satellite can transmit the dynamic analysis results obtained by analysis back to the ground station.

[0081] Additionally, the satellite is not able to communicate with the ground station at all times. Therefore, before the satellite transmits the dynamic analysis results back to the ground station, it can first determine whether it can communicate with the ground station. Specifically, the satellite determines whether it is in a window period in which it can communicate with the ground station; in response to the satellite being in a window period in which it can communicate with the ground station, the satellite transmits the dynamic analysis results to the ground station; in response to the satellite not being in a window period in which it can communicate with the ground station, the satellite stores the dynamic analysis results and transmits the dynamic analysis results to the ground station the next time the satellite runs to a window period in which it can communicate with the ground station.

[0082] Generally speaking, a satellite can communicate with a ground station only when it passes through a specific area, and the period when the satellite is navigating in this specific area is called the window period for communication with the ground station. If the satellite is within the window period for communication when it obtains the dynamic analysis results, it can directly send the dynamic analysis results to the ground station; if it is not within the window period for communication at this time, the satellite needs to store the dynamic analysis results first, and then transmit the dynamic analysis results back to the ground station when it runs into the window period for communication with the ground station.

[0083] When using the remote sensing target dynamic detection method provided in this specification to use satellites for dynamic detection of remote sensing targets, several satellites on the same track can collect remote sensing images of the same target area at the same location in turn, and after identifying the remote sensing images themselves to obtain the object state of the target object, they can continuously transmit data to the next satellite in a relay manner until the last satellite summarizes all remote sensing images and object states, obtains dynamic analysis results and returns them to the ground station. Through this method, the satellite does not need to transmit a large amount of image data back to the ground station, which greatly reduces the amount of data that needs to be transmitted between the satellite and the ground station; at the same time, each satellite can identify the target of the remote sensing image collected by itself, which not only saves the time for the ground station to analyze the image data, but also can complete target identification and transmit data to the next satellite during the subsequent satellite operation, greatly improving the overall efficiency of target detection.

[0084] The above is the remote sensing target dynamic detection method provided in this specification. Based on the same idea, this specification also provides a corresponding remote sensing target dynamic detection device, such as Figure 4 shown.

[0085] Figure 4 A schematic diagram of a remote sensing target dynamic detection device provided in this specification specifically includes:

[0086] The determination module 200 is used to receive a target detection instruction, determine a target area where a target object to be detected is located, and select a number of consecutive satellites from the satellites to perform the current target detection;

[0087] The acquisition module 202 is used for acquiring a remote sensing image of the target area for each selected satellite when the satellite moves to a specified position of the orbit;

[0088] An identification module 204 is used for the satellite to perform target identification on the remote sensing image to obtain the object state of the target object;

[0089] a transmission module 206, configured to transmit, if the satellite is not the last satellite among the selected satellites, the remote sensing image and the object state, and the remote sensing image and the object state received from the previous satellite of the satellite in the constellation to a next satellite adjacent to the satellite in the constellation;

[0090] The analysis module 208 is used to determine the dynamic analysis result of the target object according to the remote sensing images and object states collected by the satellites if the satellite is the last satellite among the selected satellites, and transmit the dynamic analysis result to the ground station.

[0091] Optionally, the satellite includes a satellite platform and a satellite payload, the satellite platform includes at least a power distribution unit, an attitude and orbit control subsystem, an integrated electronic computer, an all-in-one measurement and transmission machine, and an antenna, and the satellite payload includes at least an intelligent computing payload, a router payload, a laser communicator, and a remote sensing sensor.

[0092] Optionally, the acquisition module 202 is specifically configured to enable the satellite to acquire at least one of an optical image, an infrared image, and a synthetic aperture radar image of the target area as a remote sensing image of the target area.

[0093] Optionally, the device further includes a processing module 210, which is specifically used for the satellite to preprocess the remote sensing image, wherein the preprocessing includes at least one of radiation correction, band alignment, geometric correction, image denoising, and image fusion.

[0094] Optionally, the identification module 204 is specifically configured for the satellite to identify the position, object type and identification confidence of the target object as the object state of the target object.

[0095] Optionally, the analysis module 208 is specifically used for the satellite to determine whether the target object exists in each remote sensing image; and determine the dynamic analysis result of the target object according to the object state of the target object in each remote sensing image where the target object exists.

[0096] Optionally, the analysis module 208 is specifically used for the satellite to determine whether it is in a window period in which it can communicate with a ground station; in response to the satellite being in the window period in which it can communicate with the ground station, the satellite transmits the dynamic analysis result to the ground station; in response to the satellite not being in the window period in which it can communicate with the ground station, the satellite stores the dynamic analysis result and transmits the dynamic analysis result to the ground station when the satellite next runs into the window period in which it can communicate with the ground station.

[0097] This specification also provides a computer-readable storage medium, which stores a computer program, which can be used to execute the above Figure 1 A remote sensing target dynamic detection method is provided.

[0098] This manual also provides Figure 5 The schematic structure diagram of the electronic device shown in FIG. Figure 5 As mentioned above, at the hardware level, the electronic device includes a processor, an internal bus, a network interface, a memory, and a non-volatile memory, and may also include other hardware required for the business. The processor reads the corresponding computer program from the non-volatile memory into the memory and then runs it to achieve the above Figure 1 The remote sensing target dynamic detection method. Of course, in addition to the software implementation, this specification does not exclude other implementations, such as logic devices or a combination of software and hardware, etc., that is, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or logic devices.

[0099] For the improvement of a technology, it can be clearly distinguished whether it is a hardware improvement (for example, improvement of the circuit structure of diodes, transistors, switches, etc.) or a software improvement (improvement of the method flow). However, with the development of technology, many improvements of the method flow today can be regarded as direct improvements of the hardware circuit structure. Designers almost always obtain the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. Therefore, it cannot be said that the improvement of a method flow cannot be implemented with a hardware entity module. For example, a programmable logic device (PLD) (such as a field programmable gate array (FPGA)) is such an integrated circuit whose logical function is determined by the user's programming of the device. Designers can "integrate" a digital system on a PLD by programming themselves, without having to ask chip manufacturers to design and make dedicated integrated circuit chips. Moreover, nowadays, instead of manually making integrated circuit chips, this kind of programming is mostly implemented by "logic compiler" software, which is similar to the software compiler used when developing and writing programs, and the original code before compilation must also be written in a specific programming language, which is called hardware description language (HDL). There is not only one kind of HDL, but many kinds, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc. The most commonly used ones are VHDL (Very-High-Speed ​​Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art should also know that it is only necessary to program the method flow slightly in the above-mentioned hardware description languages ​​and program it into the integrated circuit, and then it is easy to obtain the hardware circuit that implements the logic method flow.

[0100] The controller may be implemented in any suitable manner, for example, the controller may take the form of a microprocessor or processor and a computer-readable medium storing a computer-readable program code (e.g., software or firmware) executable by the (micro)processor, a logic gate, a switch, an application-specific integrated circuit (ASIC), a programmable logic controller, and an embedded microcontroller, examples of which include but are not limited to the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320, and the memory controller may also be implemented as part of the control logic of the memory. It is also known to those skilled in the art that, in addition to implementing the controller in a purely computer-readable program code manner, the controller may be implemented in the form of a logic gate, a switch, an application-specific integrated circuit, a programmable logic controller, and an embedded microcontroller by logically programming the method steps. Therefore, such a controller may be considered as a hardware component, and the devices for implementing various functions included therein may also be considered as structures within the hardware component. Or even, the devices for implementing various functions may be considered as both software modules for implementing the method and structures within the hardware component.

[0101] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0102] For the convenience of description, the above device is described in various units according to their functions. Of course, when implementing this specification, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0103] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0104] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0105] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0106] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0107] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0108] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0109] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0110] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0111] It should be understood by those skilled in the art that the embodiments of this specification may be provided as methods, systems or computer program products. Therefore, this specification may take the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware. Moreover, this specification may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0112] This specification may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. This specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules may be located in local and remote computer storage media, including storage devices.

[0113] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0114] The above description is only an embodiment of this specification and is not intended to limit this specification. For those skilled in the art, this specification may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this specification should be included in the scope of the claims of this application.

Claims

1. A remote sensing target dynamic detection method, characterized in that: The method is applied to a constellation, the constellation includes a plurality of satellites, and each satellite runs on the same orbit, and the method comprises: receiving a target detection instruction, determining a target area where a target object to be detected is located, and selecting a number of consecutive satellites from the satellites for performing this target detection; For each selected satellite, when the satellite moves to a specified position of the orbit, the satellite collects a remote sensing image of the target area; The satellite performs target recognition on the remote sensing image to obtain the object state of the target object; If the satellite is not the last satellite among the selected satellites, the satellite transmits the remote sensing image and the object status, as well as the remote sensing image and the object status received from the previous satellite of the satellite in the constellation, to a next satellite adjacent to the satellite in the constellation; If the satellite is the last satellite among the selected satellites, the satellite determines the dynamic analysis result of the target object according to the remote sensing images and the object status collected by the satellites, and transmits the dynamic analysis result to the ground station.

2. The method according to claim 1, characterized in that The satellite includes a satellite platform and a satellite payload. The satellite platform includes at least a power distribution unit, an attitude and orbit control subsystem, an integrated electronic computer, a measurement and transmission integrated machine, and an antenna. The satellite payload includes at least an intelligent computing payload, a router payload, a laser communicator, and a remote sensing sensor.

3. The method according to claim 1, characterized in that The satellite collects remote sensing images of the target area, specifically including: The satellite collects at least one of an optical image, an infrared image, and a synthetic aperture radar image of the target area as a remote sensing image of the target area.

4. The method according to claim 1, characterized in that Before the satellite performs target recognition on the remote sensing image, the method further includes: The satellite preprocesses the remote sensing image, wherein the preprocessing includes at least one of radiation correction, band registration, geometric correction, image denoising, and image fusion.

5. The method according to claim 1, characterized in that The satellite performs target recognition on the remote sensing image to obtain the object state of the target object, specifically including: The satellite identifies the location, object type, and identification confidence of the target object as the object state of the target object.

6. The method according to claim 1, characterized in that The satellite determines the dynamic analysis result of the target object according to the remote sensing images collected by the satellites and the state of the object, specifically including: The satellite determines, for each remote sensing image, whether the target object exists in the remote sensing image; A dynamic analysis result of the target object is determined according to the object state of the target object in each remote sensing image in which the target object exists.

7. The method according to claim 1, characterized in that Transmitting the dynamic analysis results to a ground station specifically includes: The satellite determines whether it is in a window period in which it can communicate with the ground station; In response to the satellite being in a window period in which it can communicate with the ground station, the satellite transmits the dynamic analysis result to the ground station; In response to the satellite not being in a window period in which it can communicate with the ground station, the satellite stores the dynamic analysis result, and transmits the dynamic analysis result to the ground station when the satellite next operates into a window period in which it can communicate with the ground station.

8. A remote sensing target dynamic detection device, characterized in that: The device is applied to a constellation, wherein the constellation includes a plurality of satellites, and each satellite runs in the same orbit, including: A determination module is used to receive a target detection instruction, determine a target area where a target object to be detected is located, and select a number of consecutive satellites from the satellites to perform this target detection; A collection module, for each selected satellite, when the satellite moves to a specified position of the orbit, the satellite collects a remote sensing image of the target area; An identification module is used for the satellite to perform target identification on the remote sensing image to obtain the object state of the target object; a transmission module, configured to transmit, if the satellite is not the last satellite among the selected satellites, the remote sensing image and the object state, and the remote sensing image and the object state received from the previous satellite of the satellite in the constellation to a next satellite adjacent to the satellite in the constellation; The analysis module is used for determining the dynamic analysis result of the target object according to the remote sensing images and object states collected by the satellites if the satellite is the last satellite among the selected satellites, and transmitting the dynamic analysis result to the ground station.

9. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the method described in any one of claims 1 to 7 is implemented.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the method described in any one of claims 1 to 7 is implemented.

Images