A data management method based on photoelectric load
By decoding video image data streams, the system can collect and manage target data and images of optoelectronic reconnaissance payloads in real time, solving the problems of insufficient storage space and difficulty in data correspondence for optoelectronic reconnaissance payloads, and realizing the real-time collection, processing and sharing of intelligence data.
Patent Information
- Application Number
- CN202610256038.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-03-04
- Publication Date
- 2026-06-19
AI Technical Summary
Existing optoelectronic reconnaissance payloads consume a large amount of storage space in real time during target search, tracking, and positioning, leading to increased storage risks. Furthermore, the embedded architecture makes it difficult to store large amounts of intelligence data, resulting in difficulties in matching target data with images one by one.
By receiving and decoding video image data streams, target data and images are collected in real time and treated as intelligence data. Relationship data tables are established in the intelligence database, attribute data fields are set, and mapping relationship tables are constructed to realize the real-time collection, storage, and management of intelligence data.
It enables real-time collection, processing, and management of intelligence data, ensuring a one-to-one correspondence between target data and images, supporting real-time sharing and reporting in both proactive and reactive modes, and solving the problems of insufficient storage space and difficulty in data correspondence.
Smart Images
Figure CN122240863A_ABST
Abstract
Description
Technical Field
[0001] This invention belongs to the field of optoelectronic data processing technology, and specifically relates to a data management method based on optoelectronic payload. Background Technology
[0002] Currently, during target search, tracking, and localization, electro-optical reconnaissance payloads can store target data such as the aircraft's geographical location, attitude, target's geographical location, coordinates, size, type, and confidence level, as well as intelligence data such as target images, in their NVRAM. However, real-time storage of this intelligence data requires a large amount of storage space, which may pose a risk to the electro-optical reconnaissance payload storing other data.
[0003] Furthermore, the core control unit of the electro-optical reconnaissance payload adopts an embedded architecture. Due to the potential difficulties in storing large amounts of intelligence data such as target images, and the challenges in establishing a one-to-one correspondence between target data and images, the payload's memory only stores a small amount of target data, such as geographical location, type, and confidence level, and cannot store target images. However, the actual requirement for electro-optical reconnaissance is to collect and store large amounts of intelligence data during flight, including the aircraft's geographical location, attitude, and speed; the electro-optical reconnaissance payload's line of sight; the target's geographical location, size, and operational status; and target images.
[0004] In view of this, there is an urgent need to design a practical and feasible solution to address the aforementioned issues of data storage for objectives and intelligence without altering the current hardware framework. Summary of the Invention
[0005] The purpose of this invention is to address the shortcomings of existing technologies in the difficulty of real-time target intelligence data storage and management, and to provide an intelligence data management method based on an optoelectronic reconnaissance payload. By reading and decoding video image data streams, it can collect and process target data and target images in real time, and store, operate and manage the intelligence data entered into the intelligence database, thereby realizing the intelligence data collection and management function.
[0006] To achieve the above objectives, the technical solution provided by this invention is:
[0007] A data management method based on photoelectric payload includes:
[0008] Step 1: Receive video images marked with the reconnaissance payload transmitted in real time by the photoelectric reconnaissance payload, and read the target data from the corresponding reconnaissance payload data of each frame of video image;
[0009] Step 2: Based on the target information in the target data, extract the target image from the video image in the corresponding frame, and regard the target data and the target image as intelligence data;
[0010] Step 3: Establish relational data in the intelligence database to store and manage intelligence data, set corresponding attribute data fields for the input intelligence data, insert the relational data into the intelligence database, and construct a unique corresponding mapping relationship table.
[0011] Step 4: Based on the control data received from the photoelectric mission station to report intelligence data, query the intelligence data from the intelligence database through the mapping relationship, and report at least part of the intelligence data that meets the intelligence control and reporting requirements to the photoelectric mission station.
[0012] As a further improvement of the present invention, step one includes:
[0013] Step (11) Receive reconnaissance data and video images of multiple targets collected by the optoelectronic reconnaissance payload, in which the reconnaissance payload data is marked;
[0014] Step (12) The ground optoelectronic mission station receives the real-time downlink video image data stream marked with reconnaissance payload, removes the frame header, check bit and frame tail, reads the prefix data containing reconnaissance payload data, and judges the current frame sequence number.
[0015] Step (13) buffers the video image data stream frame by frame in the buffer until the current frame number is equal to the total number of video images;
[0016] Step (14) reads all data streams containing the total number of video images from the buffer, decodes each frame into a video image, performs format conversion on the prefix data and parses it into the target data read from the reconnaissance payload data; specifically: when reading the target data of each video image, first read the target data in the first row that meets the requirements for storing and managing data; including: the geographical location of the carrier aircraft, attitude, speed, geographical location of the target, coordinate position, target size, target type, confidence level, and the aiming line of the electro-optical reconnaissance payload.
[0017] As a further improvement of the present invention, step two includes:
[0018] Step (21) decodes the video image from the video image data stream, performs format conversion on the prefix data in the video image, and parses it into target data, including the carrier's geographical location, attitude, target coordinate position, target size and target type;
[0019] Step (22) Based on the target's coordinate position, size, and number in the video image, the target in the video image is cut out, and the target data and the target image are regarded as the final generated intelligence data.
[0020] As a further improvement of the present invention, step three includes:
[0021] Step (31) Establish a relational data table in the intelligence database to store and manage target data and target images;
[0022] Step (32) involves setting attribute data fields for the input intelligence data, combined with the collected target data and target images, according to the constraints of the relational data table. The intelligence data, along with the relational data, is then inserted into and updated in the intelligence database to correspond to the data records of the attribute data fields. If data insertion fails, a failure message is issued. If data insertion is successful, the intelligence data records in the intelligence database are deleted, updated, and retrieved.
[0023] Step (33) Based on the attribute data fields of the target data, quickly retrieve the target image associated with it in the intelligence database and construct a unique logical relationship mapping table; based on the association number of the input target data, first retrieve the association number corresponding to the target image in the mapping table and judge the retrieval status;
[0024] Step (34): If the associated sequence number does not exist, a message indicating failure to retrieve the intelligence data record is issued. If the associated sequence number exists, the target image is queried and read from the intelligence database according to the associated sequence number in the logical relationship mapping table.
[0025] As a further improvement of the present invention, step four includes:
[0026] Step (41) Other optoelectronic task positions send control data for reporting intelligence data to optoelectronic task positions, including the timing, method and content of the reporting; specifically: first, the timing of the reporting is judged to determine whether it is an active or passive reporting; second, the reporting method is judged to determine whether it is a single-target reporting or a unified multi-target reporting; finally, the reporting content is judged to determine whether to report target data and target images at the same time, or to report only target data and not target images.
[0027] Step (42) The optoelectronic task station receives control data sent by other optoelectronic task stations. Based on the reporting timing, method and content in the control data, it queries the target data from the intelligence database, or quickly retrieves the target image corresponding to the associated sequence number in the retrieval mapping table based on the queried target data, and reports the intelligence data corresponding to the control data to other optoelectronic task stations. The intelligence data is specifically: (1) actively reporting both target data and target image; (2) actively reporting only target data and not target image; (3) passively reporting both target data and target image; (4) passively reporting only target data and not target image.
[0028] The advantages of this invention are:
[0029] 1. Under the condition that multi-target detection of the optoelectronic reconnaissance payload is enabled, this invention parses multiple frames of video image data marked with the reconnaissance payload and transmitted to the ground optoelectronic mission position into video images. The system collects, processes, and inputs intelligence data in real time. It also enables the storage, manipulation, and management of intelligence data within the database, utilizing attribute data fields and mapping tables. This achieves the functions of intelligence data acquisition and management.
[0030] 2. In the process of detecting and collecting target data and images, the ground-based optoelectronic mission station of this invention constructs a logical mapping table and associated sequence numbers between target data and target images in the intelligence database. When reporting intelligence data to other mission stations, a transaction query method is used, and the associated sequence number of the corresponding target data is retrieved in real time through the logical mapping table. Based on the associated sequence number, the corresponding target image is quickly retrieved from the intelligence database. When other mission stations need to report intelligence data, the optoelectronic mission station can quickly report compliant intelligence data to other mission stations through both active and passive methods, based on the reporting method, content, and timing conditions in the received control data. This realizes the function of real-time sharing of intelligence data between the optoelectronic mission station and other mission stations.
[0031] Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. Attached Figure Description
[0032] The above and / or additional aspects and advantages of the present invention will become apparent and readily understood from the description of the embodiments taken in conjunction with the following drawings, in which:
[0033] Figure 1 This invention provides a flowchart of a data management method based on photoelectric payload;
[0034] Figure 2 The present invention provides a flowchart for application-time intelligence data management.
[0035] Figure 3 The present invention provides a flowchart of the intelligence data acquisition process for the photoelectric reconnaissance payload during application.
[0036] Figure 4The present invention provides a flowchart for the management of intelligence data in an intelligence database during application.
[0037] Figure 5 The flowchart of the intelligence data reporting process provided by this invention. Detailed Implementation
[0038] The embodiments of the present invention are described in detail below. These embodiments are exemplary and intended to explain the present invention, and should not be construed as limiting the present invention.
[0039] To address the challenges of real-time target intelligence data storage and management in existing optoelectronic reconnaissance payloads, without altering the current hardware framework, target data such as the aircraft's geographical location, attitude, target's geographical location, size, type, confidence level, coordinates, and the optoelectronic reconnaissance payload's aiming line are printed on the first line of each video frame during target search, tracking, and localization, and then transmitted to the ground optoelectronic mission station. Then, when reading and parsing each video frame at the ground optoelectronic mission station, firstly, the target data from the first line is read, and based on the target's coordinates, size, and number, the target image is extracted from the video frame, treating the target data and image as intelligence data. Secondly, a relational data table is established in the intelligence database for storing and managing target data, images, and other intelligence data. Corresponding attribute data fields are set based on the input intelligence data, and records are inserted into the intelligence database for deletion, updating, and retrieval. Finally, based on control data such as the timing, method, and content of reports sent by other mission stations, the required intelligence data is reported to other mission stations, thus realizing the functions of intelligence data collection, management, and reporting.
[0040] For further details, please refer to [link / reference]. Figure 1 This invention discloses a data management method based on photoelectric payload, comprising:
[0041] Step 1: Receive video images marked with the reconnaissance payload transmitted in real time by the photoelectric reconnaissance payload, and read the target data from the corresponding reconnaissance payload data of each frame of video image;
[0042] Step 2: Based on the target information in the target data, extract the target image from the corresponding frame video image, and treat the target data and target image as intelligence data;
[0043] Step 3: Establish relational data in the intelligence database to store and manage intelligence data, set corresponding attribute data fields for the input intelligence data, insert the relational data into the intelligence database, and construct a unique corresponding mapping relationship table.
[0044] Step 4: Based on the control data received from the optoelectronic mission station, query the intelligence data from the intelligence database through the mapping relationship, and report at least part of the intelligence data that meets the intelligence control and reporting requirements to the optoelectronic mission station.
[0045] See Figure 2 As shown, in practical applications, the intelligence data management method disclosed in the above embodiments of the present invention first involves collecting intelligence data and judging the intelligence data markers in the video images transmitted by the optoelectronic reconnaissance payload: if it is not intelligence data, no processing is performed; otherwise, the target data in the first row of the video image is read, including the target's geographical location, target slant range, carrier aircraft's geographical location, carrier aircraft's attitude, number of targets, target coordinates, target size, target type, target confidence level, and the optoelectronic reconnaissance payload's aiming line, etc.; then, since the target data in the video image is all in ASCII format, the received ASCII format target data needs to be converted, and these data need to be parsed and processed; finally, the target image (*.JPG format) at the corresponding position is extracted from the video image according to the number of targets, coordinates, and target size. Secondly, intelligence data management involves establishing a relational data table in a domestically produced intelligence database to store and manage intelligence data such as target data and target images. First, combining collected target data and image data, attribute data fields (data records) are set according to the constraints in the relational data table, and these records are inserted and updated in the intelligence database. Then, to quickly retrieve associated target images from the intelligence database based on the target data's attribute data fields, a logical mapping table is further established. Finally, intelligence data reporting is performed by sending control data (including reporting timing, method, and internal parameters) to other task positions. First, the timing of the received report determines whether to use proactive reporting (reporting immediately after data collection) or reactive reporting (reporting upon receiving control data). Second, the reporting method determines whether to use single-target reporting or multi-target unified reporting. Finally, the content of the received report determines whether to report target data and images simultaneously or only target data. This achieves the functions of intelligence data collection, management, and reporting based on an electro-optical reconnaissance payload.
[0046] See Figure 3As shown, the intelligence data acquisition method involves real-time reading and parsing of the downlink video image data stream (including prefix data and video data) from the electro-optical reconnaissance payload when multi-target detection is enabled. The first step involves removing the frame header, checksum, and frame tail synchronization words from each frame of the video image data stream. Then, the prefix data is read, and based on the total number of video frames and the current frame number in the prefix data, all data streams for that frame are buffered frame by frame. Finally, the video data for that frame is decoded, generating a *.jpg format video image. The second step involves format conversion and parsing of the prefix data, generating target data including aircraft position, aircraft attitude, payload aiming line, target position, total number of targets, target number, target size, target coordinates, target type, and target confidence level. The third step involves using the target coordinates (origin at the top left corner, positive horizontally to the right, positive vertically downwards), target size (target width and height, resolution 1 pixel), and target number from each target data set to perform image matting on the video image of that frame, generating a target image. Step 4: Using the first target image as the base image, the next target image is compared using a local feature + RANSAC matching algorithm. If the number of matching points is greater than a threshold, it is determined to be the same target image and inserted into the target image buffer queue. The comparison of the next target image continues until the target number changes. The threshold parameter is adjusted accordingly based on different scenarios and weather conditions. Step 4: For the same target image in the target image buffer queue, target images with small pixel size, low information entropy, or blurry image clarity are directly discarded. Then, for the remaining target images, deduplication is performed using methods such as Laplacian sharpness comparison and perceptual hash calculation. Finally, the extracted target images and target data are combined into a complete frame of intelligence data. Since the electro-optical reconnaissance payload can only locate the main target, only the main target intelligence data contains target location data; other auxiliary targets do not have target location data.
[0047] See Figure 4 As shown, the intelligence data management method involves using a domestically produced database to manage intelligence data. Figure 3 The collected target data and images are used for operations such as insertion, updating, deletion, and retrieval. The first step involves combining... Figure 3The collected intelligence data, according to the constraints of the domestically produced database, has attribute data fields (intelligence data records) set, including target sequence number (primary key), type, confidence level, size, aircraft latitude and longitude, heading angle, pitch angle, roll angle, load azimuth angle, and pitch angle; target latitude and longitude (present for primary targets, empty for secondary targets); target image; and association sequence number. The association sequence number is a unique association number between the target data and the target image, composed of the current year, month, day, hour, minute, second, and millisecond, and the sequence number, for example: 20240516092356229001. These intelligence data records are then inserted into the intelligence database. The insertion status is checked; if the insertion is successful, operations such as updating, deleting, and retrieving the intelligence data records in the database can be performed; otherwise, a message indicating that the insertion of the intelligence data record failed is issued. The second step involves updating, deleting, and retrieving intelligence data records. Deletion involves quickly searching the intelligence database for the corresponding data record based on the input target number. If the record exists, it is deleted, and the database is updated; otherwise, a message indicating that the target data record does not exist is issued. Retrieving involves quickly searching the intelligence database for the target image corresponding to the input target data's association number. To achieve this rapid image retrieval, a logical mapping table between target data and target images is established. When retrieving a target image from the intelligence database based on the target data's association number, the logical mapping table is first searched for the corresponding association number. If the association number exists, the target image is queried and retrieved from the intelligence database; otherwise, the retrieval is not performed, and a message indicating that the image retrieval failed is issued.
[0048] See Figure 5As shown, intelligence data reporting is a processing method that involves reporting target data, target images, and other intelligence data to other task positions based on control data (including reporting timing, method, and content) sent by them. The first step is to select the corresponding reporting mechanism based on the received reporting timing. Reporting timing includes passive reporting and active reporting. Passive reporting occurs when reporting control data is received from other task positions, while active reporting occurs when no such control data has been received, but intelligence data is collected. The second step is to select the corresponding reporting method based on the received reporting method. Reporting methods include single-target individual reporting and multi-target unified reporting. Single-target individual reporting means reporting after each frame of intelligence data is collected; multi-target unified reporting is performed after all intelligence data collection is completed. The third step is to determine how to report target data and target images based on the received reporting content. Reporting content includes two types: first, reporting both target data and target images to other task positions simultaneously; second, reporting only target data without reporting target images.
[0049] This invention, through reading and decoding video image data streams, can collect and process intelligence data such as target data and target images in real time, and record the intelligence data into an intelligence database for storage, operation, and management, thus realizing the functions of intelligence data collection and management. When other task positions require the reporting of intelligence data, this invention can quickly report intelligence data that meets the requirements to other task positions according to the reporting method, content, timing, and other conditions in the received control data, thus realizing the functions of intelligence data reporting and sharing.
[0050] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the scope of the technology disclosed in the present invention, and such modifications or substitutions should all be covered within the scope of protection of the present invention.
Claims
1. A data management method based on photoelectric payload, characterized in that, include: Step 1: Receive video images marked with the reconnaissance payload transmitted in real time by the photoelectric reconnaissance payload, and read the target data from the corresponding reconnaissance payload data of each frame of video image; Step 2: Based on the target information in the target data, extract the target image from the video image in the corresponding frame, and regard the target data and the target image as intelligence data; Step 3: Establish relational data in the intelligence database to store and manage intelligence data, set corresponding attribute data fields for the input intelligence data, insert the relational data into the intelligence database, and construct a unique corresponding mapping relationship table. Step 4: Based on the control data received from the photoelectric mission station to report intelligence data, query the intelligence data from the intelligence database through the mapping relationship, and report at least part of the intelligence data that meets the intelligence control and reporting requirements to the photoelectric mission station.
2. The data management method based on photoelectric payload according to claim 1, characterized in that, Step one includes: Step (11) Receive reconnaissance data and video images of multiple targets collected by the optoelectronic reconnaissance payload, in which the reconnaissance payload data is marked; Step (12) The ground optoelectronic mission station receives the real-time downlink video image data stream marked with reconnaissance payload, removes the frame header, check bit and frame tail, reads the prefix data containing reconnaissance payload data, and judges the current frame sequence number. Step (13) buffers the video image data stream frame by frame in the buffer until the current frame number is equal to the total number of video images; Step (14) reads all data streams containing the total number of video images from the buffer, decodes each frame into a video image, performs format conversion on the prefix data and parses it into the target data read from the reconnaissance payload data; specifically: when reading the target data of each video image, first read the target data in the first row that meets the requirements for storing and managing data; including: the geographical location of the carrier aircraft, attitude, speed, geographical location of the target, coordinate position, target size, target type, confidence level, and the aiming line of the electro-optical reconnaissance payload.
3. The data management method based on photoelectric payload according to claim 1, characterized in that, Step two includes: Step (21) decodes the video image from the video image data stream, performs format conversion on the prefix data in the video image, and parses it into target data, including the carrier's geographical location, attitude, target coordinate position, target size and target type; Step (22) Based on the target's coordinate position, size, and number in the video image, the target in the video image is cut out, and the target data and the target image are regarded as the final generated intelligence data.
4. The data management method based on photoelectric payload according to claim 1, characterized in that, Step three includes: Step (31) Establish a relational data table in the intelligence database to store and manage target data and target images; Step (32) involves setting attribute data fields for the input intelligence data, combined with the collected target data and target images, according to the constraints of the relational data table. The intelligence data, along with the relational data, is then inserted into and updated in the intelligence database to correspond to the data records of the attribute data fields. If data insertion fails, a failure message is issued. If data insertion is successful, the intelligence data records in the intelligence database are deleted, updated, and retrieved. Step (33) Based on the attribute data fields of the target data, quickly retrieve the target image associated with it in the intelligence database and construct a unique logical relationship mapping table; based on the association number of the input target data, first retrieve the association number corresponding to the target image in the mapping table and judge the retrieval status; Step (34): If the associated sequence number does not exist, a message indicating failure to retrieve the intelligence data record is issued. If the associated sequence number exists, the target image is queried and read from the intelligence database according to the associated sequence number in the logical relationship mapping table.
5. The data management method based on photoelectric payload according to claim 1, characterized in that, Step four includes: Step (41) Other optoelectronic task positions send control data for reporting intelligence data to optoelectronic task positions, including the timing, method and content of the reporting; specifically: first, the timing of the reporting is judged to determine whether it is an active or passive reporting; second, the reporting method is judged to determine whether it is a single-target reporting or a unified multi-target reporting; finally, the reporting content is judged to determine whether to report target data and target images at the same time, or to report only target data and not target images. Step (42) The optoelectronic task station receives control data sent by other optoelectronic task stations. Based on the reporting timing, method and content in the control data, it queries the target data from the intelligence database, or quickly retrieves the target image corresponding to the associated sequence number in the retrieval mapping table based on the queried target data, and reports the intelligence data corresponding to the control data to other optoelectronic task stations. The intelligence data is specifically: (1) actively reporting both target data and target image; (2) actively reporting only target data and not target image; (3) passively reporting both target data and target image; (4) passively reporting only target data and not target image.