Airborne high-resolution video transmission method and device

Abstract

The invention particularly relates to an airborne high-resolution video transmission method. The method comprises the following steps: acquiring a to-be-processed image by a first device end, and preprocessing the to-be-processed image according to image format information of the to-be-processed image to acquire a first image; the first device end carries out image segmentation processing on the first image to obtain a plurality of image slices and sends the image slices; the second equipment end receives the image slices and performs image splicing processing to obtain a second image; carrying out image coding processing on the second image to obtain image coding data; the second equipment sends the image coding data to the target terminal; the first equipment end is a field programmable gate array (FPGA); and the second equipment end is a system chip SOC. According to the method, the standard format image and the non-standard format image can be processed in real time. The image slices are spliced at the SOC end, the slice image is restored to the original image, video compression coding of the whole image is carried out, and the problem that the edge of the compressed slice image is blurred and uneven is avoided.

Description

Technical Field

[0001] The present invention relates to the field of image processing technology, and in particular to an airborne high-resolution video transmission method and device, a storage medium, a computer program product, and an electronic device. Background Art

[0002] In related technologies, with the rapid development of image processing technology, the resolution of videos and images is increasing. Especially for airborne optoelectronic systems, the image resolution of airborne optoelectronic payloads is also increasing. The amount of data that needs to be compressed and processed in real time by airborne image processing equipment is increasing, the data rate requirements are getting higher and higher, and there are more and more optoelectronic payloads in non-standard formats. Limited by the upper limit of the physical link transmission rate, traditional video acquisition and compression technology can no longer meet the current real-time acquisition and compression of non-standard large-resolution images.

[0003] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present invention, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0004] The present invention provides an airborne high-resolution video transmission method and device, a computer program product, and an electronic device, which can effectively overcome the defects existing in the prior art.

[0005] Other features and advantages of the present invention will become apparent from the following detailed description, or may be learned in part by practice of the present invention.

[0006] According to a first aspect of the present invention, there is provided an airborne high-resolution video transmission method, the method comprising:

[0007] The first device end obtains an image to be processed, and pre-processes the image to be processed according to image format information of the image to be processed to obtain a first image;

[0008] The first device performs image segmentation processing on the first image to obtain a plurality of image slices and sends the image slices;

[0009] The second device receives the image slices and performs image stitching processing to obtain a second image; and performs image encoding processing on the second image to obtain image encoding data;

[0010] The second device sends the image encoding data to a target terminal; wherein the first device end is a field programmable gate array FPGA; and the second device end is a system on chip SOC.

[0011] In some exemplary embodiments, the image format information includes: any one or more of image format, image resolution, and image size;

[0012] The preprocessing of the image to be processed according to the image format information of the image to be processed includes:

[0013] If it is determined according to the image format information that the image to be processed is a standard format image, the preprocessing of the image to be processed is empty; or,

[0014] If it is determined according to the image format information that the image to be processed is a non-standard format image, the preprocessing of the image to be processed includes image supplementation processing.

[0015] In some exemplary embodiments, the image to be processed includes a photoelectric load image;

[0016] The image supplementation process includes: supplementing redundant pixels along at least one image side of the image to be processed to obtain the first image in a standard format.

[0017] In some exemplary embodiments, when the first device acquires the image to be processed, the method further includes:

[0018] The first device configures image segmentation parameters according to the image format information of the image to be processed, so as to perform image segmentation processing on the first image according to the image segmentation parameters; wherein the image segmentation parameters include: the number of image slices and the width of image slices.

[0019] In some exemplary embodiments, the method further comprises:

[0020] The first device end configures the number of MIPI interfaces of the mobile industry processor according to the number of image slices, so as to send the corresponding image slices to the second device end in parallel according to the number of MIPI interfaces.

[0021] In some exemplary embodiments, before the second device receives the image slice, the method further includes: the second device configures an acquisition resolution of the image slice;

[0022] After the second device receives the image slice, the method further includes:

[0023] Performing resolution identification on the received image slice according to the acquisition resolution;

[0024] When the resolution of the image slice is inconsistent with the acquisition resolution, image filling processing is performed on the image slice so that the second device end can perform image stitching processing according to the image segmentation sequence.

[0025] In some exemplary embodiments, performing image encoding processing on the second image to obtain image encoding data includes:

[0026] Calling an image progressive refresh coding algorithm to perform image coding processing on the second image to obtain image coding data corresponding to the image to be processed.

[0027] According to a second aspect of the present invention, there is provided an airborne high-resolution video transmission device, comprising:

[0028] The first device end is used to obtain an image to be processed, pre-process the image to be processed according to image format information of the image to be processed to obtain a first image; perform image segmentation processing on the first image to obtain multiple image slices and send the image slices;

[0029] The second device end is used to receive the image slices and perform image stitching processing to obtain a second image; and perform image encoding processing on the second image to obtain encoded data; and send the encoded data to a target terminal;

[0030] Among them, the first device end is a field programmable gate array FPGA; the second device end is a system on chip SOC.

[0031] According to a third aspect of the present invention, there is provided a computer program product having a computer program stored thereon, and when the computer program is executed by a processor, the above-mentioned airborne high-resolution video transmission method is implemented.

[0032] According to a fourth aspect of the present invention, there is provided an electronic device, comprising:

[0033] Processor; and

[0034] A memory, configured to store executable instructions of the processor;

[0035] Wherein, the processor is configured to implement the above-mentioned airborne high-resolution video transmission method by executing the executable instructions.

[0036] According to a fifth aspect of the present invention, there is provided a storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the above-mentioned airborne high-resolution video transmission method.

[0037] The airborne high-resolution video transmission method provided by the embodiment of the present invention performs image preprocessing on the original high-resolution image to be processed on the FPGA side, so that standard format images and non-standard format images can be processed in real time. By performing multi-channel slicing on the preprocessed first image on the FPGA side and then sending the image slices to the SOC side, the problem that the original high-resolution image cannot be transmitted in real time is solved. By splicing the image slices on the SOC side, the sliced ​​images are restored to the original images for video compression encoding of the entire image, avoiding the problem of blurred and uneven edges caused by compressed sliced ​​images. In addition, real-time processing of high-resolution non-standard format images can be achieved.

[0038] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The accompanying drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present invention, and together with the specification are used to explain the principles of the present invention. Obviously, the accompanying drawings described below are only some embodiments of the present invention, and for those of ordinary skill in the art, other accompanying drawings can be obtained based on these accompanying drawings without creative work.

[0040] Figure 1 A schematic diagram schematically illustrates an airborne high-resolution video transmission method according to an exemplary embodiment of the present invention;

[0041] Figure 2 A schematic diagram schematically illustrates a flow chart of an airborne high-resolution video transmission method according to an exemplary embodiment of the present invention;

[0042] Figure 3 A schematic diagram schematically illustrates an airborne high-resolution video transmission device according to an exemplary embodiment of the present invention;

[0043] Figure 4 The figure schematically shows the composition of an electronic device in an exemplary embodiment of the present invention. DETAILED DESCRIPTION

[0044] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that the present invention will be more comprehensive and complete and fully convey the concepts of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0045] In addition, the accompanying drawings are only schematic illustrations of the present invention and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.

[0046] In related technologies, with the development of airborne optoelectronic systems, the image resolution of optoelectronic payloads is increasing, the amount of data that airborne image processing equipment needs to compress and process in real time is increasing, the data rate is getting higher and higher, and there are more and more optoelectronic payloads in non-standard formats. Traditional video acquisition and transmission compression technology only supports standard format image acquisition, and is limited by the upper limit of the physical link rate, and cannot achieve real-time acquisition and compression of non-standard large-resolution images.

[0047] In view of the shortcomings and deficiencies of the prior art, this example implementation provides an airborne high-resolution video transmission method, which can be applied to the real-time acquisition and real-time compression transmission of airborne high-resolution video.

[0048] The following will describe in more detail the various steps of the airborne high-resolution video transmission method in this example implementation with reference to the accompanying drawings and embodiments.

[0049] In this example implementation, the airborne high-resolution video transmission method can be implemented by FPGA (Field Programmable Gate Array) and SOC (System on Chip) as the execution subject; wherein, the FPGA device and the SOC device can be airborne image processing devices. For example, an FPGA device and a SOC device can be assembled in an image processing device, and the above-mentioned airborne high-resolution video transmission method can be implemented; or, the FPGA device and the SOC device can be assembled in different hardware devices respectively to form an image processing component device, and the above-mentioned airborne high-resolution video transmission method can be implemented. The above-mentioned image processing device can be an image processing device applied to an aircraft, and used in application scenarios such as ground / air target detection and tracking.

[0050] refer to Figure 1 As shown, the airborne high-resolution video transmission method may specifically include the following steps:

[0051] In step S11, a first device acquires an image to be processed, and pre-processes the image to be processed according to image format information of the image to be processed to acquire a first image.

[0052] Exemplarily, the first device is an FPGA device. The FPGA device can receive the image and / or video data collected in real time by the optoelectronic payload system and configure it as an image to be processed. The optoelectronic payload system can be an optoelectronic imaging device for acquiring image data, and the collected image can be a high-resolution color image or grayscale image; the image resolution can be 2k, 4k or 8k.

[0053] Exemplarily, the image to be processed may be an optoelectronic load image. For the FPGA device, when receiving the image to be processed, corresponding image format information may also be received. For example, the image format information may include any one or more of image format, image resolution, and image size.

[0054] Exemplarily, preprocessing the image to be processed according to the image format information of the image to be processed includes:

[0055] If it is determined according to the image format information that the image to be processed is a standard format image, the preprocessing of the image to be processed is empty; or,

[0056] If it is determined according to the image format information that the image to be processed is a non-standard format image, the preprocessing of the image to be processed includes image supplementation processing.

[0057] Specifically, it is used to predefine the standard format of images in the image processing program in the FPGA device, such as image size and image format. The FPGA device receives the image to be processed and the corresponding image format information sent by the airborne optoelectronic payload system, reads and identifies the image format information, and determines whether the current image to be processed meets the standard image format. If the image to be processed is a standard format image, the preprocessing operation content is empty, and the image segmentation process can be performed directly. Alternatively, if the image format information is read to determine that the current image to be processed is not a standard format image, it is necessary to preprocess it and convert the image to be processed into a standard format image.

[0058] Exemplarily, the image supplementation processing includes: supplementing redundant pixels along at least one image side of the image to be processed to obtain the first image in a standard format.

[0059] Specifically, considering that the image segmentation process needs to segment the image to be processed by columns, the size of the corresponding standard format image can be configured as an integer multiple of 16 image columns. When supplementing the image, one or more columns of redundant pixels can be supplemented on the right or left side of the non-standard format image, and the image can be expanded and converted into the standard image format, thereby ensuring that the SOC end can collect and compress the image normally. In addition, one or more rows of redundant pixels can be supplemented on the lower or upper side of the non-standard format image to facilitate subsequent image segmentation processing.

[0060] In this example implementation, when the first device end obtains the image to be processed, the method further includes: the first device end configures image segmentation parameters according to the image format information of the image to be processed, so as to perform image segmentation processing on the first image according to the image segmentation parameters; wherein the image segmentation parameters include: the number of image slices and the width of image slices.

[0061] Specifically, for the FPGA device, when receiving the current image to be processed, a corresponding image processing task can be created, and the task parameters corresponding to the image processing task can be configured; the task parameters can be used to indicate the various task parameters of the current image sequence. Among them, the image to be processed can be an image sequence, including multiple images to be processed; in the current image sequence, the image format and image resolution of each image are the same. For example, the task parameters may include the above-mentioned image segmentation parameters, the number of images in the current image sequence, the process gap duration between each image processing process, etc. The FPGA device can configure the number of image slices and the width of the image slices according to the image size of the current image to be processed and the number of MIPI (Mobile Industry Processor Interface) interfaces that can be called currently. Among them, the width of the image slice can be configured as an integer multiple of 16, so as to facilitate subsequent image processing. Of course, in other exemplary embodiments of the present disclosure, the slice width can also be configured as other values. For example, when the size of the image to be processed is 1000*1000, the number of image slices is configured to be 2, and the corresponding image slice width is 500.

[0062] In step S12, the first device performs image segmentation processing on the first image to obtain multiple image slices and sends the image slices.

[0063] Exemplarily, after completing preprocessing of the current frame of the image to be processed, the FPGA side can perform image segmentation processing on the first image according to pre-configured image segmentation parameters to obtain corresponding multiple image slices; and call the MIPI interface to send the multiple image slices in parallel to the SOC device.

[0064] Exemplarily, the method further includes: the first device end configures the number of MIPI interfaces of the mobile industry processor according to the number of image slices, so as to send the corresponding image slices to the second device end in parallel according to the number of MIPI interfaces.

[0065] Specifically, the FPGA device can configure n MIPI interfaces to transmit n image slices in parallel to the SOC device. Where n is a positive integer. For example, after completing image segmentation, the FPGA device calls the corresponding multiple MIPI interfaces to send multiple image slices in parallel to the SOC device. For example, when the image is segmented into 5 image slices, 5 MIPI interfaces can be called to transmit the image slices in parallel; each MIPI interface transmits one image slice in the order of image segmentation.

[0066] By using the Mipi interface instead of traditional video interfaces such as the BT1120 interface for video data collection and transmission, electronic devices can have lower power consumption, higher data transmission rate and smaller PCB site space, realize the collection of more channels of video, and improve the maximum resolution supported by the image processing system.

[0067] In step S13, the second device receives the image slices and performs image stitching processing to obtain a second image; and performs image encoding processing on the second image to obtain image encoding data.

[0068] Exemplarily, for a SOC device, the corresponding n-way MIPI interface can be used to receive the segmented image slice data sent by the FPGA end in parallel, thereby solving the problem that the original high-resolution image cannot be transmitted in real time. After receiving n image slices, the SOC device can perform image stitching on the image slices. For example, the SOC end can call a panoramic stitching algorithm to stitch multiple image slices of the same size in columns, thereby restoring the image slices to the original high-resolution image, that is, the second image mentioned above. After the second image is generated, the image can be compressed and encoded.

[0069] Exemplarily, performing image coding processing on the second image to obtain image coding data includes: calling an image progressive refresh coding algorithm to perform image coding processing on the second image to obtain image coding data corresponding to the image to be processed.

[0070] Specifically, after completing the image stitching process, the SOC can call the GDR (Gradual Decoder Refresh) algorithm to compress and encode the original high-resolution stitched image. The GDR algorithm can divide the video key frames into multiple slices for encoding, and distribute the encoded key frames in non-key frames, thereby reducing the amount of data in the key frames, reducing the amount of data changes during real-time transmission, and reducing the bandwidth requirements for the airborne link. In addition, users can also pre-configure the hyperparameters of the GDR algorithm. For example, they can configure the number of refresh lines of the GDR algorithm according to the current application scenario (such as air target tracking or ground target scanning), thereby ensuring that all key frame data is refreshed in one GOP (Group of Pictures) to avoid screen distortion.

[0071] In this example implementation, before the second device receives the image slice, the method further includes: the second device configures an acquisition resolution of the image slice.

[0072] After the second device receives the image slice, the method further includes: performing resolution identification on the received image slice according to the acquisition resolution; when the resolution of the image slice is inconsistent with the acquisition resolution, performing image filling processing on the image slice, so that the second device can perform image stitching processing according to the image segmentation order.

[0073] Specifically, the acquisition resolution of the image slices can be configured when the FPGA side completes the image format conversion and image segmentation, or after the FPGA completes the sending of the image slices, and before the SOC side receives the image slices sent by the FPGA side. Specifically, the SOC side can configure the acquisition resolution of each video interface separately, and call the MIPI interface to obtain the image slice data after multi-channel segmentation. If the SOC side determines that the resolutions of multiple image slices are inconsistent, the image slices of other channels can be filled according to the maximum resolution, and then the image slices after image filling processing can be used to stitch and restore the original image in the order of FPGA segmentation.

[0074] For example, when filling an image, its image filling position can be configured according to the position of the image slice in the complete image. For example, if the current segmented image with the smallest number of columns is the segmented image on the rightmost side of the complete image, redundant pixel filling can be performed on the right side of the segmented image with the smallest number of columns to prevent the filled pixels from dividing the original image content. Alternatively, if the current segmented image with the smallest number of columns is the segmented image on the leftmost side of the complete image, redundant pixel filling can be performed on the left side of the segmented image with the smallest number of columns to prevent the filled pixels from dividing the original image content.

[0075] In step S14, the second device sends the image encoding data to a target terminal.

[0076] For example, after the SOC completes the compression encoding of the image, the image encoding data can be transmitted to the downstream target terminal device, where the target terminal device can be other airborne devices or other electronic devices that communicate with the airborne devices in real time.

[0077] For example, when the FPGA side starts preprocessing the current frame of the image to be processed, it can start timing the process gap, and before the process gap time ends, the FPGA side sends the image slice to the SOC side, and the SOC side completes image stitching and image compression encoding and transmission. After the process gap timing ends, the processing flow of the next frame of the image to be processed in the image sequence can be started until the current image sequence completes image compression encoding and transmission.

[0078] The method provided in the embodiment of the present invention is referred to Figure 2 As shown, by converting the resolution format of the video at the FPGA end 21, the non-standard video resolution is converted to a standard format, thereby solving the problem that the SOC cannot collect and process non-standard videos. By performing multi-channel slicing processing on the original high-resolution image at the FPGA end and sending the sliced ​​image in parallel through multiple channels, the problem of sending high-resolution video through the MIPI interface is solved. By receiving the image slices sliced ​​at the FPGA end through multiple MIPI video interfaces at the SOC end 22, the problem that the original high-resolution image cannot be transmitted in real time is solved. By performing image splicing on the image slices at the SOC end, the sliced ​​image slices are restored to the original high-resolution image for video compression encoding of the entire image, thereby avoiding the problem of blurred and uneven edges caused by compressed sliced ​​images. During compression encoding, image compression encoding is performed by using image progressive refresh encoding, thereby reducing the amount of data of the encoded key frames, thereby reducing transmission delay under limited bandwidth.

[0079] It should be noted that the above-mentioned figures are only schematic illustrations of the processes included in the method according to an exemplary embodiment of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0080] For further reference, Figure 3 As shown, in the implementation manner of this example, an airborne high-resolution video transmission device 30 is also provided, including: a first device end and a second device end.

[0081] The first device end is a field programmable gate array FPGA301, which is used to obtain an image to be processed, pre-process the image to be processed according to image format information of the image to be processed to obtain a first image; perform image segmentation processing on the first image to obtain multiple image slices and send the image slices.

[0082] The second device end is a system chip SOC302, which is used to receive the image slices and perform image stitching processing to obtain a second image; and perform image encoding processing on the second image to obtain encoded data; and send the encoded data to a target terminal.

[0083] It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to an embodiment of the present invention, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.

[0084] Figure 4 A schematic diagram of an electronic device suitable for implementing an embodiment of the present invention is shown.

[0085] It should be noted that Figure 4 The electronic device 1000 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0086] like Figure 4 As shown, the electronic device 1000 includes a central processing unit (CPU) 1001, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 1002 or the program loaded from the storage part 1008 to the random access memory (RAM) 1003. In the RAM 1003, various programs and data required for system operation are also stored. The CPU 1001, ROM 1002 and RAM 1003 are connected to each other through a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004. In addition, the electronic device 1000 also includes: FPGA devices, SOC devices.

[0087] The following components are connected to the I / O interface 1005: an input section 1006 including a keyboard, a mouse, etc.; an output section 1007 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1008 including a hard disk, etc.; and a communication section 1009 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 1009 performs communication processing via a network such as the Internet. A drive 1010 is also connected to the I / O interface 1005 as needed. A removable medium 1011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1010 as needed, so that a computer program read therefrom is installed into the storage section 1008 as needed.

[0088] In particular, according to an embodiment of the present invention, the process described below with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present invention includes a computer program product, which includes a computer program carried on a storage medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication part 1009, and / or installed from a removable medium 1011. When the computer program is executed by a central processing unit (CPU) 1001, various functions defined in the system of the present application are executed.

[0089] Specifically, the above-mentioned electronic device may be an airborne intelligent electronic device, such as an airborne video processing device.

[0090] It should be noted that the storage medium shown in the embodiment of the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any storage medium other than computer-readable storage media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the storage medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0091] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0092] The units involved in the embodiments of the present invention may be implemented by software or hardware, and the units described may also be arranged in a processor. The names of these units do not, in some cases, limit the units themselves.

[0093] It should be noted that, as another aspect, the present application also provides a storage medium, which can be included in an electronic device; or it can exist independently without being installed in the electronic device. The above storage medium carries one or more programs, and when the above one or more programs are executed by an electronic device, the electronic device implements the method described in the following embodiments. For example, the electronic device can implement the following Figure 2 The individual steps of the method are shown.

[0094] In one embodiment, the present application provides a computer program product, including a computer program, which implements the steps in the above-mentioned method embodiments when executed by a processor.

[0095] In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to an exemplary embodiment of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0096] Other embodiments of the invention will readily occur to those skilled in the art after considering the specification and practicing the invention herein. This application is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art that are not disclosed by the present invention. The specification and examples are to be considered exemplary only, and the true scope and spirit of the invention are indicated by the claims.

[0097] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. An airborne high-resolution video transmission method, characterized in that: The method comprises: The first device end obtains an image to be processed, and pre-processes the image to be processed according to image format information of the image to be processed to obtain a first image; The first device performs image segmentation processing on the first image to obtain a plurality of image slices and sends the image slices; The second device receives the image slices and performs image stitching processing to obtain a second image; and performs image encoding processing on the second image to obtain image encoding data; The second device sends the image encoding data to a target terminal; wherein the first device end is a field programmable gate array FPGA; and the second device end is a system on chip SOC.

2. The method according to claim 1, characterized in that The image format information includes: any one or more of image format, image resolution, and image size; The preprocessing of the image to be processed according to the image format information of the image to be processed includes: If it is determined according to the image format information that the image to be processed is a standard format image, the preprocessing of the image to be processed is empty; or, If it is determined according to the image format information that the image to be processed is a non-standard format image, the preprocessing of the image to be processed includes image supplementation processing.

3. The method according to claim 2, characterized in that The image to be processed includes a photoelectric load image; The image supplementation process includes: supplementing redundant pixels along at least one image side of the image to be processed to obtain the first image in a standard format.

4. The method according to claim 1, characterized in that When the first device acquires the image to be processed, the method further includes: The first device configures image segmentation parameters according to the image format information of the image to be processed, so as to perform image segmentation processing on the first image according to the image segmentation parameters; wherein the image segmentation parameters include: the number of image slices and the width of image slices.

5. The method according to claim 1 or 4, characterized in that: The method further comprises: The first device end configures the number of MIPI interfaces of the mobile industry processor according to the number of image slices, so as to send the corresponding image slices to the second device end in parallel according to the number of MIPI interfaces.

6. The method according to claim 1, characterized in that Before the second device receives the image slice, the method further includes: the second device configures the acquisition resolution of the image slice; After the second device receives the image slice, the method further includes: Performing resolution identification on the received image slice according to the acquisition resolution; When the resolution of the image slice is inconsistent with the acquisition resolution, image filling processing is performed on the image slice so that the second device end can perform image stitching processing according to the image segmentation sequence.

7. The method according to claim 1, characterized in that The performing image encoding processing on the second image to obtain image encoding data comprises: Calling an image progressive refresh coding algorithm to perform image coding processing on the second image to obtain image coding data corresponding to the image to be processed.

8. An airborne high-resolution video transmission device, characterized in that: The device comprises: The first device end is used to obtain an image to be processed, pre-process the image to be processed according to image format information of the image to be processed to obtain a first image; perform image segmentation processing on the first image to obtain multiple image slices and send the image slices; The second device end is used to receive the image slices and perform image stitching processing to obtain a second image; and perform image encoding processing on the second image to obtain encoded data; and send the encoded data to a target terminal; Among them, the first device end is a field programmable gate array FPGA; the second device end is a system on chip SOC.

9. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the airborne high-resolution video transmission method according to any one of claims 1 to 7 is implemented.

10. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; The processor is configured to execute the airborne high-resolution video transmission method according to any one of claims 1 to 7 by executing the executable instructions.

Images