Data processing method for wireless transmission of airborne photoelectric system

Abstract

The invention provides a data processing method for wireless transmission of an airborne photoelectric system, and the method comprises the steps: a data processing method of a transmitting end: segmenting an investigation image and information generated by the airborne photoelectric system in real time into small data packets through employing an investigation image and information packaging method, and transmitting the small data packets to a ground control station; the investigation image and information packaging method comprises the following steps: processing the same frame of investigation image of an airborne photoelectric system into identification information, and obtaining state information of the airborne photoelectric system corresponding to the investigation image; segmenting each frame of investigation image of the airborne photoelectric system into x small data packets; the data processing method of the ground control station comprises the following steps of: reordering, packing and analyzing the received small data packets; according to the method, investigation images and information with variable-length structures are packed into small data packets in real time according to rules and then transmitted, and a ground control station receives the small data packets wirelessly transmitted in real time, dynamically sorts the small data packets generated by the same frame of image and information, and splices and recovers the small data packets into complete investigation images and information.

Description

Technical Field

[0001] The present invention belongs to the technical field of wireless communication of unmanned aerial vehicle payloads, and in particular relates to a data processing method for wireless transmission of an airborne optoelectronic system. Background Art

[0002] The airborne optoelectronic system is an important payload for UAV target reconnaissance. The reconnaissance images and information are transmitted to the ground control station through wireless terminal equipment. The software of the ground control station analyzes and processes them, and communicates with the airborne optoelectronic system through the wireless terminal equipment to control it to conduct reconnaissance of the target area.

[0003] The wireless two-way communication data of wireless terminal equipment includes visible light color and grayscale images, infrared thermal images, low-light night vision images, image recognition information, optoelectronic system control data and status information, etc. The wireless two-way communication data has high requirements for real-time transmission and security.

[0004] At present, the application scenarios of airborne optoelectronic systems are different, and the design schemes and indicators are different. In addition, there are many types and formats of reconnaissance images. With the continuous development of image artificial intelligence information recognition technology, the amount of image and recognition information data is large and the length is not fixed. The wireless transmission protocols and methods vary a lot, which is not conducive to the design of the transmission mechanism. In particular, small and medium-sized drones usually transmit various types of aircraft information wirelessly. The wireless transmission bandwidth allocated to airborne optoelectronic systems is limited, which can easily lead to transmission errors, congestion, etc., affecting safety and creating adverse factors for the normal execution of reconnaissance tasks by optoelectronic systems. In addition, during the data transmission process, the reconnaissance image and image recognition information need to correspond one by one, while the traditional transmission mechanism transmits the reconnaissance image and image recognition information from different protocols and channels. It is difficult for the ground control station to complete the correspondence and analysis of the reconnaissance image and image recognition information in real time. Therefore, it is necessary to design complex tasks and consume more computing resources for analysis. Summary of the invention

[0005] The purpose of the present invention is to solve the shortcomings of the prior art that the reconnaissance image and image recognition information cannot be matched and analyzed in real time during the data transmission process, and to provide a data processing method for wireless transmission of an airborne optoelectronic system, which packages the reconnaissance image and information of indefinite length structure into small data packets according to rules in real time and transmits them. The ground control station receives the small data packets transmitted wirelessly in real time, and dynamically sorts the small data packets generated by the same frame of image and information, and splices them to restore the complete reconnaissance image and information.

[0006] To achieve the above purpose, the technical solution provided by the present invention is:

[0007] A data processing method for wireless transmission of an airborne optoelectronic system, comprising:

[0008] The data processing method at the transmitting end is as follows: the reconnaissance images and information generated in real time by the airborne optoelectronic system are divided into small data packets using the reconnaissance image and information packaging method and transmitted to the ground control station; wherein: the reconnaissance image and information packaging method includes: processing the same frame of the reconnaissance image of the airborne optoelectronic system into the identification information of the corresponding reconnaissance image, and obtaining the status information of the airborne optoelectronic system corresponding to the reconnaissance image; dividing each frame of the reconnaissance image of the airborne optoelectronic system into x small data packets; specifically: each small data packet is the reconnaissance image, identification information, and status information, which are packaged into fixed byte + n byte variable length data according to the rules to form an indefinite length structure of the small data packet; the fixed bytes include: synchronization byte, data packet number, image classification number, identification information and status information, number of divided small data packets, number, length and tail character; the variable length data includes: image generated by the airborne optoelectronic system, image identification information, and status information of the airborne optoelectronic system;

[0009] The data processing method of the ground control station is as follows: the received small data packets are reordered, grouped and parsed according to the data processing method; wherein the data processing method comprises: querying the data packet number corresponding to the small data packet, sorting the data packet number by bubble sorting, inserting the parsed variable-length data into the sorting sequence, and counting the number of packets participating in the bubble sorting under the same data packet number, judging whether the number of packets is equal to x, and if so, the information of a frame of reconnaissance image is spliced, and parsing the identification information and status information.

[0010] As a further limitation of the present invention, in the data processing method at the transmitting end, the bytes of the small data packet are:

[0011] Synchronization byte, data packet number, image classification number, identification information and status information, number of divided small data packets, small data packet number, small data packet length, image data filled with variable length structure, and tail character.

[0012] As a further limitation of the present invention, the data processing method at the sending end specifically includes:

[0013] Step (1) The first 4 bytes of the small data packet are defined as synchronization bytes of type unsigned char.

[0014] 0xCAHBMCZD;

[0015] The fifth and sixth bytes of the small data packet in step (2) are data packet numbers of unsigned char type, where: the airborne optoelectronic system generates a unique number corresponding to each frame of image and information in real time, and the data packet number of the next frame of image and information is accumulated by 1 in sequence;

[0016] The 7th and 8th bytes of the small data packet in step (3) are the image classification numbers, where: visible light color images generate the number 0x0011; visible light grayscale images generate the number 0x0022; infrared thermal images generate the number 0x0033; low-light night vision images generate the number 0x0044; other image categories have their own self-defined numbers;

[0017] The 9th to 137th bytes of the small data packet in step (4) are identification information of the reconnaissance image, wherein the identification information includes: target number information, classification information and posture information generated by real-time image target recognition of the airborne optoelectronic system;

[0018] Step (5): the 138th to 202nd bytes of the small data packet are status information of the airborne optoelectronic system, wherein the status information includes: angle information, field of view angle information, system mode information and ranging distance value information of the airborne optoelectronic system;

[0019] Step (6) The 203rd to 204th bytes of the small data packet are the number of divided small data packets. The byte length of the small data packet is dynamically calculated using formula (1), and the number of small data packets is dynamically calculated using formula (2); wherein formula (1) is: byte length of small data packet = wireless transmission bandwidth / transmission baud rate - fixed length byte; formula (2) is: number of small data packets = (reconnaissance image byte + fixed length byte) / small data packet byte;

[0020] In step (7), the 205th to 206th bytes of the small data packet are the small data packet numbers; wherein the small data packet numbers are automatically accumulated, and the maximum accumulated value of the small data packet is the number of small data packets calculated in step (6);

[0021] Step (8): the 207th to 208th bytes of the small data packet are the length of the small data packet calculated by formula (3); wherein formula (3) is: small data packet byte length = wireless transmission bandwidth / transmission baud rate - fixed byte length;

[0022] In step (9), the 209th byte to the Nth byte of the small data packet are image data filled with a variable length structure, and the image data generated in real time by the airborne optoelectronic system is cyclically divided and filled according to the length of the small data packet calculated in step (8); wherein the number of fillings is the number of small data packets calculated in step (6);

[0023] Step (10) generates 4 bytes as the tail character 0xCA0KSMZD of the small data packet, and the tail character is the check mark of the small data packet.

[0024] As a further limitation of the present invention, the received small data packets are reordered, grouped and parsed according to the data processing method, including:

[0025] Step (1) reads 4 bytes from the buffer in sequence to determine whether it is the synchronization byte 0xCAHBMCZD. If not, reads 4 bytes in sequence from the next byte to determine. If yes, proceeds to step (2);

[0026] Step (2) reads 2 bytes sequentially and interprets them as data packet numbers, each data packet number corresponds to a frame of image and information, and the data packet number is used as the number of the buffer area;

[0027] Step (3) reads 2 bytes in sequence and interprets them as image classification, where the image classification indicates whether the current photoelectric system detection image is a visible light image, an infrared thermal image, or a low-light night vision image;

[0028] Step (4) sequentially reads 128 bytes of identification information and 64 bytes of status information, wherein the identification information is the target number, classification, and attitude information of the image recognition transmitted by the current data packet, and is used to achieve synchronous alignment of the image and the identification information; the status information is the reconnaissance information fed back to the ground control station by the airborne optoelectronic system in real time, including the optoelectronic system field of view angle, system mode, and ranging value;

[0029] Step (5) sequentially reads and stores the 2-byte small data packet number and the 2-byte small data packet ID;

[0030] Step (6) sequentially reads, parses and records the 2-byte image data length, where the image data length is the image data byte length filled in the small data packet dynamically calculated based on the wireless bandwidth, rate, one frame of image and information data;

[0031] Step (7) looping and reading the image data and caching it according to the length of the image data parsed in step (6);

[0032] Step (8) reads the last 4 bytes of tail characters in sequence to determine whether they are 0xCA0KSMZD. If so, proceed to step (9); otherwise, continue reading the buffer data from step (1);

[0033] Step (9) queries the cache area corresponding to the data packet number of the small data packet in the cache area, sorts the small data packet numbers using the bubble sort method, inserts the image data parsed in step (7) into the sorting sequence, and counts the number of packets participating in the bubble sort under the same data packet number to determine whether it is equal to the number of small data packets parsed in step (5). If so, a complete frame of image data is spliced, and the ground control station classifies and parses the image according to the image parsed in step (3); if not, continue to read and parse the data in sequence from step (1).

[0034] As a further limitation of the present invention, in the data processing method at the transmitting end, each frame of the reconnaissance image of the airborne optoelectronic system is divided into x small data packets, specifically:

[0035] By using the wireless transmission parameters assigned to the airborne optoelectronic system, the length of the divided small data packets is dynamically calculated to prevent the large amount of data of reconnaissance images and information, packet loss or congestion, and to achieve dynamic adaptation of wireless transmission requirements.

[0036] As a further limitation of the present invention, the ground control station data processing method further includes:

[0037] The optoelectronic reconnaissance images are packaged together with the identification information and status information. When the ground control station receives small data packets, it automatically synchronizes and aligns the current reconnaissance images and information.

[0038] As a further limitation of the present invention, when the ground control station parses small data packets: the parsed data packet number, the number of small data packets and the number are used as query and processing parameters, and all current small data packets under the parsed data packet number are sorted in real time to prevent the occasional inversion and disorder of the data packet sequence due to multiple levels of wireless transmission or receiving end paths.

[0039] The advantages of the present invention are:

[0040] The present invention packages the indefinite-length reconnaissance images and information into small data packets according to rules in real time and transmits them. The ground control station receives the small data packets transmitted wirelessly in real time, dynamically sorts the small data packets generated by the same frame of image and information, and splices them together to restore the complete reconnaissance images and information.

[0041] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0043] Figure 1 : A block diagram of a data processing method for wireless transmission of an airborne optoelectronic system provided by the present invention;

[0044] Figure 2 : Flow chart of the data processing method at the sending end provided by the present invention;

[0045] Figure 3 : Illustration of the method for packaging reconnaissance images and information into small data packets provided by the present invention;

[0046] Figure 4 : Flowchart of the ground control station data processing method provided by the present invention. DETAILED DESCRIPTION

[0047] Embodiments of the present invention are described in detail below. The embodiments are exemplary and intended to be used to explain the present invention, but should not be construed as limiting the present invention.

[0048] In order to overcome the current wireless transmission of reconnaissance images and information between airborne optoelectronic systems and ground control stations, and the problems of packet loss, congestion, and error codes that are easily caused by bandwidth limitations when the data volume is large and changes in real time; an embodiment of the present invention provides a data processing method for wireless transmission of airborne optoelectronic systems. In addition, the data processing method of the embodiment of the present invention is affected by external electromagnetic interference, which affects the real-time synchronous transmission of data; traditional reconnaissance images and identification information are transmitted according to different protocols and channels, and it is difficult for the ground control station software to receive the reconnaissance images and identification information synchronously, align and parse them, and due to different receiving level paths, occasional data packet sequence inversion and disorder occur. A data processing method for wireless transmission of an airborne optoelectronic system in an embodiment of the present invention provides safe and reliable real-time variable-length data for wireless transmission of airborne optoelectronic systems.

[0049] See also Figure 1 The embodiment of the present invention provides a data processing method for wireless transmission of an airborne optoelectronic system, including: (1) a data processing method at a transmitting end, and (2) a data processing method at a ground control station, wherein:

[0050] (1) A data processing method at the transmitting end, comprising: using a reconnaissance image and information packetization method to divide the reconnaissance image and information generated in real time by the airborne optoelectronic system into small data packets and transmit them to a ground control station; wherein: the reconnaissance image and information packetization method comprises: processing the same frame of reconnaissance image of the airborne optoelectronic system into identification information corresponding to the reconnaissance image, and obtaining the status information of the airborne optoelectronic system corresponding to the reconnaissance image; dividing each frame of reconnaissance image of the airborne optoelectronic system into x small data packets. Preferably, the identification information of the embodiment of the present invention is the target classification, numbering, posture and other information generated by the airborne optoelectronic system for each frame of image recognition processing; the optoelectronic status information of the embodiment of the present invention is the angle, field of view, system mode and other information of the airborne optoelectronic system.

[0051] The size of the reconnaissance image data generated by the optoelectronic system of the embodiment of the present invention changes dynamically according to different image categories and formats and real-time changes in the reconnaissance scene. The embodiment of the present invention is divided into n small data packets according to the bandwidth, rate, image and information data size allocated to the airborne optoelectronic system by the carrier during wireless transmission. The fixed bytes of the embodiment of the present invention are composed of synchronization bytes, data packet numbers, image classification numbers, identification information and status information, the number of divided small data packets, numbers, lengths and tail characters, and the variable-length data is generated by the image and information generated in real time by the optoelectronic system, the wireless transmission bandwidth, and the baud rate or rate.

[0052] See also Figure 3Specifically: each small data packet is a reconnaissance image, identification information, and status information, which are packaged into fixed bytes + n bytes of variable-length data according to rules, forming an indefinite-length structure of the small data packet; the fixed bytes include: synchronization bytes, data packet numbers, image classification numbers, identification information and status information, the number of divided small data packets, numbers, lengths, and tail characters; the variable-length data include: images generated in real time by the airborne optoelectronic system, identification information of the images, and status information of the airborne optoelectronic system.

[0053] Please continue reading Figure 3 In the above-mentioned sending end data processing method of the embodiment of the present invention, the bytes of the small data packet are: synchronization byte, data packet number, image classification number, identification information and status information, number of divided small data packets, small data packet number, small data packet length, image data filled with variable length structure, and tail character.

[0054] See also Figure 2 and Figure 3 The above-mentioned data processing method at the sending end of the embodiment of the present invention specifically includes:

[0055] Step (1) The first 4 bytes of the small data packet are defined as synchronization bytes of type unsigned char.

[0056] 0xCAHBMCZD; Sync Byte Generates 4-byte sync bytes for information transmission synchronization.

[0057] The fifth and sixth bytes of the small data packet in step (2) are data packet numbers of unsigned char type, wherein: the airborne optoelectronic system generates a unique number corresponding to each frame of image and information in real time, and the data packet number of the next frame of image and information is accumulated by 1 in sequence; specifically, according to the process of the airborne optoelectronic system generating reconnaissance images and information in real time, a 2-byte data packet number is generated, and the same frame of reconnaissance image and information has a unique data packet number, so as to prevent the ground control station software from being unable to distinguish between reconnaissance images and information of different frames during wireless data transmission.

[0058] The 7th and 8th bytes of the small data packet in step (3) are the image classification number, where: visible light color image, generates the number 0x0011; visible light grayscale image, generates the number 0x0022; infrared thermal image, generates the number 0x0033; low-light night vision image, generates the number 0x0044; other image categories define their own numbers; specifically, a 2-byte image classification number is generated. Different airborne optoelectronic systems have different video sensors and generate different image categories, which are distinguished by the 2 bytes of the image classification number.

[0059] The 9th to 137th bytes of the small data packet in step (4) are the identification information of the reconnaissance image, wherein the identification information includes: target number information, classification information and posture information generated by the real-time image target recognition of the airborne optoelectronic system; specifically, the information of the target recognition frame by frame of the reconnaissance image by the airborne optoelectronic system, including the target number, category and posture, etc., fills 128 bytes.

[0060] In step (5), the 138th to 202nd bytes of the small data packet are status information of the airborne optoelectronic system, wherein the status information includes: angle information, field of view angle information, system mode information and ranging distance value information of the airborne optoelectronic system; specifically, 64 bytes of current status information of the airborne optoelectronic system, such as field of view angle, system mode, etc., are filled.

[0061] In step (6), the 203rd to 204th bytes of the small data packet are the number of divided small data packets. The byte length of the small data packet is dynamically calculated using formula (1), and the number of small data packets is dynamically calculated using formula (2); wherein formula (1) is: byte length of small data packet = wireless transmission bandwidth / transmission baud rate - fixed length byte; formula (2) is: number of small data packets = (reconnaissance image byte + fixed length byte) / small data packet byte; specifically, the reconnaissance image and information of the airborne optoelectronic system are packaged and grouped, and the reconnaissance image is dynamically divided into x small data packets according to the wireless transmission bandwidth, the data transmission baud rate or rate defined by the transmitter and the ground control station, and each small data packet is numbered in turn, and the byte length of the small data packet is dynamically calculated using formula (small data packet byte = wireless transmission bandwidth / transmission baud rate - fixed length byte); and the number of small data packets is calculated using formula (number of small data packets = (reconnaissance image byte + fixed length byte) / small data packet byte).

[0062] In step (7), the 205th to 206th bytes of the small data packet are the small data packet number; wherein the small data packet number is automatically accumulated, and the maximum accumulated value of the small data packet is the number of small data packets calculated in step (6).

[0063] Step (8): the 207th to 208th bytes of the small data packet are the length of the small data packet calculated by formula (3); wherein formula (3) is: small data packet byte length = wireless transmission bandwidth / transmission baud rate - fixed byte length;

[0064] In step (9), the 209th byte to the Nth byte of the small data packet are image data filled with a variable-length structure. The image data generated in real time by the airborne optoelectronic system is cyclically divided and filled according to the small data packet length calculated in step (8); wherein the number of fillings is the number of small data packets calculated in step (6); specifically, the 2-byte small data packet number, the 2-byte small data number and the 2-byte small data packet byte length are filled in sequence.

[0065] Step (10) generates 4 bytes as the tail character 0xCA0KSMZD of the small data packet, and the tail character is the check mark of the small data packet; generates a 4-byte tail byte.

[0066] The embodiment of the present invention cyclically fills data from step (1) and automatically accumulates and generates small data packet numbers, up to the number of small data packets calculated in step (6). A complete frame of reconnaissance image and information is dynamically divided into x small data packets and sent according to the above rules.

[0067] Preferably, the above-mentioned embodiment of the present invention divides each frame of the reconnaissance image of the airborne optoelectronic system into x small data packets, specifically: using the wireless transmission parameters assigned to the airborne optoelectronic system, dynamically calculating the length of the divided small data packets, preventing the large amount of data of the reconnaissance images and information, and preventing packet loss or congestion, thereby realizing dynamic adaptation of wireless transmission requirements.

[0068] The ground control station data processing method of the embodiment of the present invention, in addition to the above contents, also includes: uniformly packaging the optoelectronic reconnaissance image with identification information and status information, and automatically synchronizing and aligning the current reconnaissance image and information when the ground control station receives a small data packet.

[0069] When the reconnaissance images and information generated in real time by the airborne optoelectronic system of the embodiment of the present invention are transmitted through a wireless terminal with limited bandwidth, they are automatically calculated and dynamically divided into small data packets for transmission based on the transmission bandwidth, baud rate or rate, thereby preventing abnormalities such as packet loss, code error or congestion of the reconnaissance images and information during the wireless network transmission process, thereby improving transmission efficiency.

[0070] (2) A data processing method for a ground control station, comprising: reordering, grouping and parsing the received small data packets according to the data processing method; wherein the data processing method comprises: querying the data packet number corresponding to the small data packet, sorting the data packet number using a bubble sort method, inserting the parsed variable-length data into the sorting sequence, and counting the number of packets participating in the bubble sort under the same data packet number, judging whether the number of packets is equal to x, and if so, the information of a frame of reconnaissance image is spliced, and parsing the identification information and status information. It should be pointed out that the bubble sort method of the embodiment of the present invention refers to comparing two adjacent numbers in a group of numbers to be sorted, and exchanging the two numbers if the previous number is larger than the next number, otherwise not exchanging; and so on until the sorting is finally completed.

[0071] Please continue reading Figure 3The data processing method for wireless transmission of an airborne optoelectronic system of an embodiment of the present invention is to design a data encapsulation protocol for the reconnaissance images and information generated in real time by the airborne optoelectronic system when the wireless bandwidth is limited, based on the reconnaissance image data, image category, identification information and status information, transmission baud rate or rate and transmission bandwidth, etc.: the first 4 bytes are defined as unsigned char type synchronization bytes, which are used for wireless transmission and ground control station receiving data synchronization; the 5th byte and the 6th byte are unsigned char type data packet numbers, which represent the unique number corresponding to each frame of image and information generated in real time by the airborne optoelectronic system; the 7th byte and the 8th byte are unsigned char type image classification numbers, which usually include visible light color images, visible light grayscale images, infrared thermal images and low-light night vision images, and other image types can be independently expanded. The length of the 9th byte to the 137th byte is 128 bytes, which is defined as unsigned char type image recognition information, and the target number, classification, posture and other information generated by the airborne optoelectronic system for each frame of image recognition processing. The length of the 138th byte to the 202nd byte is 64 bytes, which is defined as the optoelectronic system status information, including the angle, field of view, system mode and other information of the airborne optoelectronic system. The 203rd and 204th bytes are the number of unsigned char type segmented small data packets. The number of segmented small data packets is dynamically calculated based on the wireless transmission parameters, the baud rate or rate defined by the data transmission, and the data volume of the image and information. The 205th and 206th bytes are the small data packet numbers of unsigned char type, which are automatically accumulated, and the maximum accumulated value is equal to the number of small data packets defined by the 203rd and 204th bytes; the 207th and 208th bytes are the length of the small data packet of unsigned char type. The reconnaissance image and information change dynamically in real time. The length of each small data packet is calculated according to the formula (small data packet byte length = wireless transmission bandwidth / transmission baud rate-fixed byte length). In the above formula, the sum of other bytes except the padded image data constitutes a fixed byte. The 209th byte to the Nth byte are image data filled with a variable-length structure. To adapt to the transmission method with limited bandwidth, the image data is cyclically divided and filled according to the data packet length calculated by the 207th byte and the 208th byte. The number of fillings is equal to the number of small data packets calculated by the 203rd byte and the 204th byte. The end is a 4-byte tail character as the verification byte of the data packet.

[0072] More specifically, see Figure 4 The embodiment of the present invention reorders, groups and parses the received small data packets according to the data processing method, including:

[0073] Step (1) The ground control station receives the wirelessly transmitted data packets in sequence and stores them in a buffer, reads 4 bytes from the buffer in sequence, parses the first 4 synchronization bytes in sequence, and determines whether it is the synchronization byte 0xCAHBMCZD. If not, reads 4 bytes in sequence from the next byte to determine if it is. If yes, proceeds to step (2);

[0074] Step (2) reads 2 bytes sequentially and parses them into data packet numbers, each data packet number corresponds to a frame of image and information, and the data packet number is used as the number of the cache area; specifically, the data packet numbers are parsed sequentially and recorded in the cache area as the address number of the cache area, and each identical data packet number represents that the cache area stores the same frame of image and information. Specifically, the data packet numbers are parsed sequentially and recorded in the cache area as the address number of the cache area, and each identical data packet number represents that the cache area stores the same frame of image and information.

[0075] Step (3) reads 2 bytes in sequence and interprets them as image classification, where the image classification indicates whether the current photoelectric system detection image is a visible light image, an infrared thermal image, or a low-light night vision image;

[0076] Step (4) sequentially reads 128 bytes of identification information and 64 bytes of status information, wherein the identification information is the target number, classification, and attitude information of the image recognition transmitted by the current data packet, and is used to achieve synchronous alignment of the image and the identification information; the status information is the reconnaissance information fed back to the ground control station by the airborne optoelectronic system in real time, including the optoelectronic system field of view angle, system mode, and ranging value;

[0077] Step (5) sequentially reads and stores the 2-byte small data packet number and the 2-byte small data packet number; specifically, sequentially parses and records the small data packet number and number. The same frame of reconnaissance image and information has the same small data packet number, and the small data number represents the currently received data packet number.

[0078] Step (6) sequentially reads, parses and records the 2-byte image data length, where the image data length is the image data byte length filled in the small data packet dynamically calculated based on the wireless bandwidth, rate, one frame of image and information data;

[0079] Step (7) loops through and caches the image data according to the length of the image data parsed in step (6); specifically, the lengths of the small data packets are parsed in sequence, and the image data contents of corresponding lengths are looped through in sequence.

[0080] Step (8) reads the last 4-byte tail characters in sequence to determine whether they are 0xCA0KSMZD. If so, proceed to step (9); otherwise, continue reading the buffer data from step (1); specifically, parse the 4-byte tail bytes in sequence to determine whether they are correct tail bytes. If so, a complete packet of data is received and parsed, and proceed to step (9); otherwise, abandon the data frame and read and parse it again from step (1).

[0081] Step (9) searches the cache area for the data packet number corresponding to the small data packet in the cache area, sorts the small data packet number using the bubble sort method, inserts the image data parsed in step (7) into the sorting sequence, and counts the number of packets participating in the bubble sort under the same data packet number to determine whether it is equal to the number of small data packets parsed in step (5). If so, a complete frame of image data is spliced, and the ground control station classifies and parses the image according to the image parsed in step (3); if not, continue to read and parse the data in sequence from step (1). Specifically, according to the data packet number parsed in step (2), the small data packet is stored in the cache area corresponding to the data packet number, and the bubble sort is performed with the small data packet number as a parameter. According to the sorting result, the image data is spliced ​​to the corresponding position of the cache area. During the bubble sorting process, the count of the small data packets participating in the sorting is counted to see whether it is equal to the number of small data packets. If not, continue with step (1). If yes, proceed to step (10).

[0082] Step (10) After parsing and packaging in the above steps, a complete frame of reconnaissance image and information packet is read, and the ground control station software restores the image, identification information and status information based on the package and protocol spliced ​​in the buffer area.

[0083] Preferably, when the ground control station of an embodiment of the present invention parses small data packets: the parsed data packet number, the number of small data packets and the number are used as query and processing parameters, and all current small data packets under the parsed data packet number are sorted in real time to prevent occasional inversion and disorder of the data packet sequence due to multiple levels of wireless transmission or receiving end paths.

[0084] The ground control station of the embodiment of the present invention re-orders, packages and parses the data according to the data processing method to prevent the data packet sequence from being inverted or disordered when the data packet is transmitted wirelessly and through the multi-layer path of the ground control station.

[0085] The embodiments of the present invention solve the problem that different airborne optoelectronic systems have different types and formats of reconnaissance images, and their application scenarios are complex and vary greatly. When the reconnaissance images and information generated are transmitted wirelessly, the transmission methods and protocols vary a lot, which brings unsafe factors. Traditional reconnaissance images and identification information are transmitted through different channels and protocols. It is difficult for the ground control station software to align images and identification information. The mechanism is complex and consumes a lot of computing resources. The embodiments of the present invention package the reconnaissance images and information of indefinite length structure into small data packets according to rules in real time and then transmit them. The ground control station receives the small data packets transmitted wirelessly in real time, and dynamically sorts the small data packets generated by the same frame of image and information, and splices them back to complete reconnaissance images and information.

[0086] The above description is only a specific implementation mode of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or substitutions within the technical scope disclosed in the present invention, and these modifications or substitutions should be included in the protection scope of the present invention.

Claims

1. A data processing method for wireless transmission of an airborne optoelectronic system, characterized in that: include: The data processing method at the transmitting end is as follows: the reconnaissance images and information generated in real time by the airborne optoelectronic system are divided into small data packets using the reconnaissance image and information packaging method and transmitted to the ground control station; wherein: the reconnaissance image and information packaging method includes: processing the same frame of the reconnaissance image of the airborne optoelectronic system into the identification information of the corresponding reconnaissance image, and obtaining the status information of the airborne optoelectronic system corresponding to the reconnaissance image; dividing each frame of the reconnaissance image of the airborne optoelectronic system into x small data packets; specifically: each small data packet is the reconnaissance image, identification information, and status information, which are packaged into fixed byte + n byte variable length data according to the rules to form an indefinite length structure of the small data packet; the fixed bytes include: synchronization byte, data packet number, image classification number, identification information and status information, number of divided small data packets, number, length and tail character; the variable length data includes: image generated by the airborne optoelectronic system, image identification information, and status information of the airborne optoelectronic system; The data processing method of the ground control station is as follows: the received small data packets are reordered, grouped and parsed according to the data processing method; wherein the data processing method comprises: querying the data packet number corresponding to the small data packet, sorting the data packet number by bubble sorting, inserting the parsed variable-length data into the sorting sequence, and counting the number of packets participating in the bubble sorting under the same data packet number, judging whether the number of packets is equal to x, and if so, the information of a frame of reconnaissance image is spliced, and parsing the identification information and status information.

2. The data processing method for wireless transmission of an airborne optoelectronic system according to claim 1, characterized in that: In the transmitting end data processing method, the bytes of the small data packet are as follows: Synchronization byte, data packet number, image classification number, identification information and status information, number of divided small data packets, small data packet number, small data packet length, image data filled with variable length structure, and tail character.

3. The data processing method for wireless transmission of an airborne optoelectronic system according to claim 1, characterized in that: The data processing method at the sending end specifically includes: Step (1) The first 4 bytes of the small data packet are defined as the synchronization byte 0xCAHBMCZD of unsigned char type; The fifth and sixth bytes of the small data packet in step (2) are data packet numbers of unsigned char type, where: the airborne optoelectronic system generates a unique number corresponding to each frame of image and information in real time, and the data packet number of the next frame of image and information is accumulated by 1 in sequence; The 7th and 8th bytes of the small data packet in step (3) are the image classification numbers, where: visible light color images generate the number 0x0011; visible light grayscale images generate the number 0x0022; infrared thermal images generate the number 0x0033; low-light night vision images generate the number 0x0044; other image categories have their own self-defined numbers; The 9th to 137th bytes of the small data packet in step (4) are identification information of the reconnaissance image, wherein the identification information includes: target number information, classification information and posture information generated by real-time image target recognition of the airborne optoelectronic system; Step (5): the 138th to 202nd bytes of the small data packet are status information of the airborne optoelectronic system, wherein the status information includes: angle information, field of view angle information, system mode information and ranging distance value information of the airborne optoelectronic system; Step (6) The 203rd to 204th bytes of the small data packet are the number of divided small data packets. The byte length of the small data packet is dynamically calculated using formula (1), and the number of small data packets is dynamically calculated using formula (2); wherein formula (1) is: byte length of small data packet = wireless transmission bandwidth / transmission baud rate - fixed length byte; formula (2) is: number of small data packets = (reconnaissance image byte + fixed length byte) / small data packet byte; In step (7), the 205th to 206th bytes of the small data packet are the small data packet numbers; wherein the small data packet numbers are automatically accumulated, and the maximum accumulated value of the small data packet is the number of small data packets calculated in step (6); Step (8): the 207th to 208th bytes of the small data packet are the length of the small data packet calculated by formula (3); wherein formula (3) is: small data packet byte length = wireless transmission bandwidth / transmission baud rate - fixed byte length; In step (9), the 209th byte to the Nth byte of the small data packet are image data filled with a variable length structure, and the image data generated in real time by the airborne optoelectronic system is cyclically divided and filled according to the length of the small data packet calculated in step (8); wherein the number of fillings is the number of small data packets calculated in step (6); Step (10) generates 4 bytes as the tail character 0xCA0KSMZD of the small data packet, and the tail character is the check mark of the small data packet.

4. The data processing method for wireless transmission of an airborne optoelectronic system according to claim 1, characterized in that: Reorder, group and parse the received small data packets according to the data processing method, including: Step (1) reads 4 bytes from the buffer in sequence to determine whether it is the synchronization byte 0xCAHBMCZD. If not, reads 4 bytes in sequence from the next byte to determine. If yes, proceeds to step (2); Step (2) reads 2 bytes sequentially and interprets them as data packet numbers, each data packet number corresponds to a frame of image and information, and the data packet number is used as the number of the buffer area; Step (3) reads 2 bytes in sequence and interprets them as image classification, where the image classification indicates whether the current photoelectric system detection image is a visible light image, an infrared thermal image, or a low-light night vision image; Step (4) sequentially reads 128 bytes of identification information and 64 bytes of status information, wherein the identification information is the target number, classification, and attitude information of the image recognition transmitted by the current data packet, and is used to achieve synchronous alignment of the image and the identification information; the status information is the reconnaissance information fed back to the ground control station by the airborne optoelectronic system in real time, including the optoelectronic system field of view angle, system mode, and ranging value; Step (5) sequentially reads and stores the 2-byte small data packet number and the 2-byte small data packet ID; Step (6) sequentially reads, parses and records the 2-byte image data length, where the image data length is the image data byte length filled in the small data packet dynamically calculated based on the wireless bandwidth, rate, one frame of image and information data; Step (7) looping and reading the image data and caching it according to the length of the image data parsed in step (6); Step (8) reads the last 4 bytes of tail characters in sequence to determine whether they are 0xCA0KSMZD. If so, proceed to step (9); otherwise, continue reading the buffer data from step (1); Step (9) queries the cache area corresponding to the data packet number of the small data packet in the cache area, sorts the small data packet numbers using the bubble sort method, inserts the image data parsed in step (7) into the sorting sequence, and counts the number of packets participating in the bubble sort under the same data packet number to determine whether it is equal to the number of small data packets parsed in step (5). If so, a complete frame of image data is spliced, and the ground control station classifies and parses the image according to the image parsed in step (3); if not, continues to read and parse the data in sequence from step (1).

5. The data processing method for wireless transmission of an airborne optoelectronic system according to claim 1, characterized in that: In the data processing method at the transmitting end, each frame of the reconnaissance image of the airborne optoelectronic system is divided into x small data packets, specifically: By using the wireless transmission parameters assigned to the airborne optoelectronic system, the length of the divided small data packets is dynamically calculated to prevent the large amount of data of reconnaissance images and information, packet loss or congestion, and to achieve dynamic adaptation of wireless transmission requirements.

6. The data processing method for wireless transmission of an airborne optoelectronic system according to claim 1, characterized in that: The ground control station data processing method further includes: The optoelectronic reconnaissance images are packaged together with the identification information and status information. When the ground control station receives small data packets, it automatically synchronizes and aligns the current reconnaissance images and information.

7. The data processing method for wireless transmission of an airborne optoelectronic system according to claim 1, characterized in that: When the ground control station parses small data packets: the parsed data packet number, the number of small data packets and the number are used as query and processing parameters to sort all current small data packets under the parsed data packet number in real time to prevent the occasional inversion and disorder of the data packet sequence due to multiple levels of wireless transmission or receiving end paths.

Images