Satellite and public network combined image transmission method, device and system

Abstract

The invention discloses a satellite and public network combined image transmission method, device and system, and relates to the field of image data transmission, and the image transmission method applied to a sending end comprises the steps: initiating a first connection request to a public network server, and obtaining a first transmission mode according to the response of the first connection request; wherein the first transmission mode comprises any one of public network transmission and satellite transmission; performing subpackage compression on the to-be-sent image according to the first transmission mode to obtain a plurality of first image subpackages; initiating a signal verification request to a public network server according to the first transmission mode, and obtaining a first verification result according to the response of the signal verification request; according to the first verification result, updating the first transmission mode to obtain a second transmission mode, and updating the plurality of first image sub-packages to obtain a plurality of second image sub-packages; and sending the plurality of second image sub-packets to a receiving end in a second transmission mode. The problem that image data transmission efficiency and quality are low under the condition of low network coverage can be solved.

Description

Technical Field

[0001] The present application relates to the field of image data transmission, and in particular to an image transmission method, device and system combining a satellite and a public network. Background Art

[0002] In the field of remote monitoring, data transmission technology, especially image data transmission technology, has been widely used. In the field of remote monitoring, the transmission efficiency and quality of images are more important for monitoring important areas such as reservoirs, power lines, borders and wild animals. However, these key areas often have low network coverage or require satellite networks for data communication transmission. Traditional image data transmission technology is difficult to consider data transmission in this case, resulting in image transmission efficiency and transmission quality to be improved. Therefore, in the prior art, how to improve the efficiency and quality of image data transmission under low network coverage conditions is still a problem that needs to be solved urgently in the prior art. Summary of the invention

[0003] The present application provides a method, device and system for image transmission combining satellite and public network to solve the technical problems of low image data transmission efficiency and low transmission quality under low network coverage conditions.

[0004] According to a first aspect of the implementation manner of the present application, there is provided a satellite-public network-based image transmission method, which is applied to a transmitting end and includes:

[0005] Initiate a first connection request to a public network server, and obtain a first transmission mode according to a response to the first connection request; wherein the first transmission mode includes any one of public network transmission and satellite transmission;

[0006] According to the first transmission mode, the image to be sent is compressed in packets to obtain a plurality of first image packets;

[0007] Initiating a signal verification request to the public network server according to the first transmission mode, and obtaining a first verification result according to a response to the signal verification request;

[0008] According to the first verification result, updating the first transmission mode to obtain a second transmission mode, and updating the plurality of first image subpackets to obtain a plurality of second image subpackets;

[0009] The plurality of second image packets are sent to a receiving end in the second transmission mode.

[0010] The present application first initiates a first connection request to a public network server, and determines a first transmission mode of public network transmission or satellite transmission based on a response to the first connection request, and can judge the signal quality of the public network server based on the response, and then select a first transmission mode that is more suitable for the current transmission, which can improve the image transmission efficiency and ensure the image transmission quality; then, according to the first transmission mode, the image to be sent is packetized and compressed, and a packet compression strategy that matches the current transmission mode can be selected to ensure the image transmission quality under the current transmission mode, and then a signal verification request is initiated to the public network server, and a first verification result is obtained based on the response to the signal verification request, and the signal quality of the public network server can be judged again based on the response of the public network server, and then the transmission mode and the packet compression strategy can be adjusted to make it more in line with the current sending needs, thereby improving the image transmission efficiency and the image transmission quality when the second image packet is sent to the receiving end.

[0011] In some implementations of the present application, obtaining the first transmission mode according to the response to the first connection request specifically includes:

[0012] If a response signaling is received from the public network server according to the first connection request, public network transmission is used as the first transmission mode;

[0013] If no response signaling is received from the public network server in response to the first connection request, satellite transmission is used as the first transmission mode.

[0014] This application selects different transmission modes according to the reception of the response signaling sent back by the public network server. It can judge the signal quality of the public network server according to the response of the public network server, and then select the first transmission mode that is more suitable for the current sending needs, which can improve the image transmission efficiency and ensure the image transmission quality.

[0015] In some implementations of the present application, the step of performing packet compression on the image to be sent according to the first transmission mode to obtain a plurality of first image packets specifically includes:

[0016] If the first transmission mode is satellite transmission, the image to be sent is compressed in packets according to a preset first compression ratio to obtain a plurality of first image packets;

[0017] If the first transmission mode is public network transmission, the image to be sent is compressed in packets according to a preset second compression ratio to obtain a plurality of first image packets; wherein the first compression ratio is greater than the second compression ratio.

[0018] The present application selects different packet compression strategies according to the type of the first transmission mode, and the first compression ratio under satellite transmission is greater than the second compression ratio under public network transmission, which can match the type of the first transmission mode with the upper limit of the channel capacity corresponding to the first transmission mode, thereby matching the corresponding packet compression strategy, thereby ensuring the image transmission quality under the current transmission mode.

[0019] In some embodiments of the present application, updating the first transmission mode to obtain a second transmission mode according to the first verification result, and updating the plurality of first image subpackets to obtain a plurality of second image subpackets specifically includes:

[0020] If the first verification result is successful, the first transmission mode is changed to public network transmission, and the multiple first image subpackets are used as multiple second image subpackets;

[0021] If the first verification result is that the verification is unsuccessful, the first transmission mode is changed to satellite transmission, and the multiple first image subpackets are updated to obtain multiple second image subpackets according to a preset third compression ratio and the current compression ratio of the multiple first image subpackets.

[0022] The present application adjusts the transmission mode and updates multiple first image subpackets according to the first verification result, and can select the optimal transmission mode to make it more in line with the current sending needs, thereby improving image transmission efficiency and image transmission quality.

[0023] In some embodiments of the present application, updating the plurality of first image subpackets to obtain the plurality of second image subpackets according to the preset third compression ratio and the current compression ratio of the plurality of first image subpackets specifically includes:

[0024] If the current compression ratio is equal to the third compression ratio, treating the plurality of first image packets as a plurality of second image packets;

[0025] If the current compression ratio is not equal to the third compression ratio, the multiple first image subpackets are updated according to the third compression ratio to obtain multiple second image subpackets.

[0026] The present application selectively adjusts multiple first image packets according to the size relationship between the current compression ratio and the preset third compression ratio. After the first transmission mode is adjusted to satellite transmission, the packet compression strategy can be adjusted to be more suitable for satellite transmission, thereby ensuring image transmission efficiency and image transmission quality.

[0027] According to a second aspect of the implementation manner of the present application, there is provided a satellite-public network combined image transmission method, which is applied to a receiving end and includes:

[0028] receiving a plurality of third image subpackets sent by a transmitting end, and reading and obtaining a total number of subpackets and a subpacket sequence corresponding to the plurality of third image subpackets;

[0029] Determine the missing bit sequence of the sub-packet bit sequence according to the total number of sub-packets;

[0030] splicing the plurality of third image subpackets according to the subpacket bit sequence, and setting the bytes of the third image subpackets corresponding to the missing bit sequence to zero bytes during splicing, to obtain a first compressed image;

[0031] According to the transmission mode of the plurality of third image packets at the transmitting end, the first compressed image is decompressed to obtain an original transmission image.

[0032] The present application first receives multiple third image subpackets sent by the sending end, and reads to obtain the total number of subpackets and the subpacket sequence, and then determines the missing sequence of the subpacket sequence according to the total number of subpackets, which can detect the loss of image subpackets during image transmission, and when splicing according to the subpacket sequence, the bytes of the image subpackets corresponding to the missing sequence are set to zero bytes to obtain the first compressed image, which can ensure the correctness of the subpacket sequence in the event of data loss, and then when the first compressed image is decompressed according to the transmission method to obtain the original transmission image, the overall content of the image is ensured, thereby ensuring the transmission quality of the image.

[0033] In some embodiments of the present application, after determining the missing bit sequence of the subpacket bit sequence according to the total number of subpackets, the method further includes:

[0034] generating a retransmission instruction according to the transmission mode and the missing bit sequence;

[0035] The retransmission instruction is sent to the sending end in the transmission mode, so that the sending end retransmits the third image subpacket corresponding to the missing bit sequence according to the retransmission instruction.

[0036] The present application generates a retransmission instruction according to the transmission mode and missing bit sequence of the sending end, and sends it to the sending end, so as to obtain the third image subpacket corresponding to the missing bit sequence, further complete the first compressed image, and thus improve the transmission quality of the image.

[0037] In some embodiments of the present application, after decompressing the first compressed image according to the transmission mode of the plurality of third image packets by the transmitting end to obtain the original transmission image, the method further includes:

[0038] According to the transmission mode, a preset first enhancement ratio is obtained, and image enhancement is performed on the original transmission image according to the first enhancement ratio to obtain a first enhanced image.

[0039] The present application obtains a preset first enhancement ratio according to the transmission mode of the sending end, performs image enhancement on the original transmission image to obtain a first enhanced image, and can select different image enhancement ratios for the original transmission image to match different transmission modes, avoid excessive enhancement, and thus ensure the transmission quality of the image.

[0040] According to a third aspect of the implementation of the present application, there is provided an image transmission device combining a satellite and a public network, which is applied to a transmitting end and includes a transmission mode determination module, an image packet compression module, a transmission signal verification module, a transmission mode update module and an image packet sending module;

[0041] The transmission mode determination module is used to initiate a first connection request to a public network server, and obtain a first transmission mode according to a response to the first connection request; wherein the first transmission mode includes any one of public network transmission and satellite transmission;

[0042] The image sub-packet compression module is used to perform sub-packet compression on the image to be sent according to the first transmission mode to obtain a plurality of first image sub-packets;

[0043] The transmission signal verification module is used to initiate a signal verification request to the public network server according to the first transmission mode, and obtain a first verification result according to a response to the signal verification request;

[0044] The transmission mode updating module is used to update the first transmission mode to obtain a second transmission mode according to the first verification result, and to update the plurality of first image subpackets to obtain a plurality of second image subpackets;

[0045] The image subpacket sending module is used to send the multiple second image subpackets to the receiving end in the second transmission mode.

[0046] In certain embodiments of the present application, the transmission mode determination module includes a public network transmission determination unit and a satellite transmission determination unit;

[0047] The public network transmission determining unit is configured to use the public network transmission as the first transmission mode if a response signaling transmitted back by the public network server according to the first connection request is received;

[0048] The satellite transmission determination unit is configured to use satellite transmission as the first transmission mode if no response signaling transmitted back by the public network server according to the first connection request is received.

[0049] In certain embodiments of the present application, the image sub-packet compression module includes a first sub-packet compression unit and a second sub-packet compression unit;

[0050] The first packet compression unit is configured to, if the first transmission mode is satellite transmission, perform packet compression on the image to be transmitted according to a preset first compression ratio to obtain a plurality of first image packets;

[0051] The second packet compression unit is used to perform packet compression on the image to be sent according to a preset second compression ratio to obtain multiple first image packets if the first transmission mode is public network transmission; wherein the first compression ratio is greater than the second compression ratio.

[0052] In certain embodiments of the present application, the transmission mode update module includes a first transmission update unit and a second transmission update unit;

[0053] The first transmission updating unit is configured to change the first transmission mode to public network transmission if the first verification result is successful, and use the multiple first image subpackets as multiple second image subpackets;

[0054] The second transmission update unit is used to change the first transmission mode to satellite transmission if the first verification result is unsuccessful, and update the multiple first image subpackets to obtain multiple second image subpackets according to a preset third compression ratio and the current compression ratio of the multiple first image subpackets.

[0055] In some embodiments of the present application, the second transmission update unit includes a first compression subunit and a second compression subunit;

[0056] The first compression subunit is configured to use the plurality of first image packets as a plurality of second image packets if the current compression ratio is equal to the third compression ratio;

[0057] The second compression subunit is used to update the multiple first image subpackets according to the third compression ratio to obtain multiple second image subpackets if the current compression ratio is not equal to the third compression ratio.

[0058] The present application first initiates a first connection request to a public network server, and determines a first transmission mode of public network transmission or satellite transmission based on a response to the first connection request, and can judge the signal quality of the public network server based on the response, and then select a first transmission mode that is more suitable for the current transmission, which can improve the image transmission efficiency and ensure the image transmission quality; then, according to the first transmission mode, the image to be sent is packetized and compressed, and a packet compression strategy that matches the current transmission mode can be selected to ensure the image transmission quality under the current transmission mode, and then a signal verification request is initiated to the public network server, and a first verification result is obtained based on the response to the signal verification request, and the signal quality of the public network server can be judged again based on the response of the public network server, and then the transmission mode and the packet compression strategy can be adjusted to make it more in line with the current sending needs, thereby improving the image transmission efficiency and the image transmission quality when the second image packet is sent to the receiving end.

[0059] According to a fourth aspect of the implementation of the present application, there is provided an image transmission device combining a satellite and a public network, which is applied to a receiving end and includes a packet receiving and reading module, a missing bit sequence determination module, an image packet splicing module, and a compressed image decompression module;

[0060] The sub-packet receiving and reading module is used to receive a plurality of third image sub-packets sent by the sending end, and read and obtain the total number of sub-packets and the sub-packet bit sequence corresponding to the plurality of third image sub-packets;

[0061] The missing bit sequence determining module is used to determine the missing bit sequence of the subpacket bit sequence according to the total number of subpackets;

[0062] The image subpacket splicing module is used to splice the plurality of third image subpackets according to the subpacket bit sequence, and during the splicing, the bytes of the third image subpackets corresponding to the missing bit sequence are all set to zero bytes to obtain a first compressed image;

[0063] The compressed image decompression module is used to decompress the first compressed image according to the transmission mode of the plurality of third image subpackets at the sending end to obtain the original transmission image.

[0064] In some embodiments of the present application, a missing subpacket retransmission module is further included; the missing subpacket retransmission module includes a retransmission instruction generating unit and a retransmission instruction sending unit;

[0065] The retransmission instruction generating unit is used to generate a retransmission instruction according to the transmission mode and the missing bit sequence;

[0066] The retransmission instruction sending unit is used to send the retransmission instruction to the sending end in the transmission mode, so that the sending end retransmits the third image packet corresponding to the missing bit sequence according to the retransmission instruction.

[0067] In some embodiments of the present application, a first image enhancement module is also included;

[0068] The first image enhancement module is used to obtain a preset first enhancement ratio according to the transmission mode, and perform image enhancement on the original transmission image according to the first enhancement ratio to obtain a first enhanced image.

[0069] The present application first receives multiple third image subpackets sent by the sending end, and reads to obtain the total number of subpackets and the subpacket sequence, and then determines the missing sequence of the subpacket sequence according to the total number of subpackets, which can detect the loss of image subpackets during image transmission, and when splicing according to the subpacket sequence, the bytes of the image subpackets corresponding to the missing sequence are set to zero bytes to obtain the first compressed image, which can ensure the correctness of the subpacket sequence in the event of data loss, and then when the first compressed image is decompressed according to the transmission method to obtain the original transmission image, the overall content of the image is ensured, thereby ensuring the transmission quality of the image.

[0070] According to a fifth aspect of the implementation of the present application, there is provided an image transmission system combining satellite and public network, comprising a plurality of acquisition devices, a public network server and an image processing platform;

[0071] Wherein, the plurality of acquisition devices are used to acquire images to be processed, and execute a satellite-public network-combined image transmission method applied to a transmitting end as described in the present application, so as to send the images to be processed to the image processing platform;

[0072] The public network server is used to respond to the requests of the plurality of acquisition devices, and return signaling according to the requests, so that the plurality of acquisition devices process and send the to-be-processed images according to the signaling;

[0073] The image processing platform is used to execute a satellite and public network combined image transmission method applied to a receiving end as described in the present application, so as to receive, process and store the images to be processed sent by the multiple acquisition devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0074] Figure 1 : A schematic flow chart of a satellite-public network-based image transmission method when applied to a transmitting end, as shown in certain embodiments of the present application;

[0075] Figure 2 : A schematic flow chart of a satellite-public network combined image transmission method when applied to a receiving end shown in certain embodiments of the present application;

[0076] Figure 3 : is a module structure diagram of a satellite-public network-combined image transmission device when applied to a transmitting end, as shown in certain embodiments of the present application;

[0077] Figure 4 : is a module structure diagram of a satellite-public network-combined image transmission device when applied to a receiving end, as shown in certain embodiments of the present application;

[0078] Figure 5 : A system architecture diagram of an image transmission system combining satellite and public network shown in certain embodiments of the present application. DETAILED DESCRIPTION

[0079] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions from beginning to end. The embodiments described below in conjunction with the accompanying drawings are exemplary and are only used to explain some embodiments of the present application, and should not be construed as limitations on the embodiments of the present application. Based on the embodiments shown in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0080] In the description of this application, it should be understood that the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, unless otherwise clearly and specifically defined, "multiple" and "several" mean two or more.

[0081] Existing image data transmission technology is difficult to consider data transmission under low network coverage when monitoring important areas such as reservoirs, power lines, borders and wild animals, resulting in image transmission efficiency and transmission quality to be improved. Therefore, in the existing technology, how to improve the image data transmission efficiency and transmission quality under low network coverage conditions is still a problem that needs to be solved urgently.

[0082] Based on the above technical background, please refer to Figure 1 The embodiment of the present application provides an image transmission method combining satellite and public network, which is applied to the sending end and includes steps S101 to S105, each of which is as follows:

[0083] Step S101: Initiate a first connection request to a public network server, and obtain a first transmission mode according to a response to the first connection request; wherein the first transmission mode includes any one of public network transmission and satellite transmission.

[0084] In some implementations of the present application, obtaining the first transmission mode according to the response to the first connection request specifically includes:

[0085] If a response signaling is received from the public network server according to the first connection request, public network transmission is used as the first transmission mode;

[0086] If no response signaling is received from the public network server in response to the first connection request, satellite transmission is used as the first transmission mode.

[0087] This application selects different transmission modes according to the reception of the response signaling sent back by the public network server. It can judge the signal quality of the public network server according to the response of the public network server, and then select the first transmission mode that is more suitable for the current sending needs, which can improve the image transmission efficiency and ensure the image transmission quality.

[0088] Step S102: According to the first transmission mode, the image to be sent is compressed into packets to obtain a plurality of first image packets.

[0089] In some implementations of the present application, the image to be sent is compressed in packets according to the first transmission mode to obtain a plurality of first image packets, specifically including:

[0090] If the first transmission mode is satellite transmission, the image to be sent is compressed in packets according to a preset first compression ratio to obtain a plurality of first image packets;

[0091] If the first transmission mode is public network transmission, the image to be sent is compressed in packets according to a preset second compression ratio to obtain a plurality of first image packets; wherein the first compression ratio is greater than the second compression ratio.

[0092] In certain embodiments of the present application, the value ranges of the first compression ratio and the second compression ratio are both matched with the upper limit of the channel capacity of the corresponding transmission mode. For example, in one embodiment of the first compression ratio, the compressed data size of the image to be sent is 10KB; in one embodiment of the second compression ratio, the compressed data size of the image to be sent is 100KB.

[0093] In some implementations of the present application, the image to be sent is compressed in packets according to a preset first compression ratio to obtain a plurality of first image packets, specifically:

[0094] Identifying an area of ​​interest of an image to be sent, obtaining a first area, and compressing the first area according to the first compression ratio to obtain a first compressed file;

[0095] Performing a clarity mask on the image to be sent to obtain a first image, and compressing the first image according to the first compression ratio to obtain a second compressed file;

[0096] According to the preset subpackaging capacity, the first compressed file and the second compressed file are respectively subpacked to obtain a plurality of first compressed subpackets and a plurality of second compressed subpackets, and the plurality of second compressed subpackets are combined with the plurality of first compressed subpackets to obtain a plurality of first image subpackets.

[0097] In certain embodiments of the present application, the identification of the region of interest of the image to be sent to obtain the first region includes but is not limited to identification through a YOLO v5 model, a Fast R-CNN model, a RFCN model or an AttentionNet model.

[0098] In certain embodiments of the present application, when a plurality of first image subpackets are combined, the subpacket order of the plurality of first compressed subpackets and the plurality of second compressed subpackets may be such that the plurality of first compressed subpackets are located after the plurality of second compressed subpackets, or may be such that the plurality of first compressed subpackets are located before the plurality of second compressed subpackets.

[0099] In certain embodiments of the present application, the specific steps of performing packet compression on the image to be sent according to a preset second compression ratio to obtain multiple first image packets are different from the specific steps of using the first compression ratio mentioned above only in the compression ratio during compression, so they will not be repeated here.

[0100] Specifically, the preferred implementation of the clarity of the clarity mask is 50%; the preferred implementation of the sub-inclusion capacity is 600B.

[0101] The present application selects different packet compression strategies according to the type of the first transmission mode, and the first compression ratio under satellite transmission is greater than the second compression ratio under public network transmission, which can match the type of the first transmission mode with the upper limit of the channel capacity corresponding to the first transmission mode, thereby matching the corresponding packet compression strategy, thereby ensuring the image transmission quality under the current transmission mode.

[0102] Step S103: According to the first transmission mode, a signal verification request is initiated to the public network server, and a first verification result is obtained according to a response to the signal verification request.

[0103] Step S104: according to the first verification result, the first transmission mode is updated to obtain a second transmission mode, and the plurality of first image subpackets are updated to obtain a plurality of second image subpackets.

[0104] In some embodiments of the present application, updating the first transmission mode to obtain a second transmission mode according to the first verification result, and updating the plurality of first image subpackets to obtain a plurality of second image subpackets specifically includes:

[0105] If the first verification result is successful, the first transmission mode is changed to public network transmission, and the multiple first image subpackets are used as multiple second image subpackets;

[0106] If the first verification result is that the verification is unsuccessful, the first transmission mode is changed to satellite transmission, and the multiple first image subpackets are updated to obtain multiple second image subpackets according to a preset third compression ratio and the current compression ratio of the multiple first image subpackets.

[0107] In certain embodiments of the present application, the third compression ratio is equal to the first compression ratio.

[0108] The present application adjusts the transmission mode and updates multiple first image subpackets according to the first verification result, and can select the optimal transmission mode to make it more in line with the current sending needs, thereby improving image transmission efficiency and image transmission quality.

[0109] In some embodiments of the present application, updating the plurality of first image subpackets to obtain the plurality of second image subpackets according to the preset third compression ratio and the current compression ratio of the plurality of first image subpackets specifically includes:

[0110] If the current compression ratio is equal to the third compression ratio, treating the plurality of first image packets as a plurality of second image packets;

[0111] If the current compression ratio is not equal to the third compression ratio, the multiple first image subpackets are updated according to the third compression ratio to obtain multiple second image subpackets.

[0112] In some implementations of the present application, the updating of the plurality of first image subpackets according to the third compression ratio to obtain the plurality of second image subpackets is specifically:

[0113] According to the third compression ratio, the plurality of first image subpackets are respectively subpacketized to obtain a plurality of second image subpackets.

[0114] The present application selectively adjusts multiple first image packets according to the size relationship between the current compression ratio and the preset third compression ratio. After the first transmission mode is adjusted to satellite transmission, the packet compression strategy can be adjusted to be more suitable for satellite transmission, thereby ensuring image transmission efficiency and image transmission quality.

[0115] Step S105: sending the plurality of second image packets to a receiving end in the second transmission mode.

[0116] In some implementations of the present application, sending the plurality of second image packets to the receiving end in the second transmission mode is specifically:

[0117] When the second transmission mode is public network transmission, the plurality of second image subpackets are sent to the public network server in the second transmission mode, so that the public network server forwards the plurality of second image subpackets to the receiving end.

[0118] The present application first initiates a first connection request to a public network server, and determines a first transmission mode of public network transmission or satellite transmission based on a response to the first connection request, and can judge the signal quality of the public network server based on the response, and then select a first transmission mode that is more suitable for the current transmission, which can improve the image transmission efficiency and ensure the image transmission quality; then, according to the first transmission mode, the image to be sent is packetized and compressed, and a packet compression strategy that matches the current transmission mode can be selected to ensure the image transmission quality under the current transmission mode, and then a signal verification request is initiated to the public network server, and a first verification result is obtained based on the response to the signal verification request, and the signal quality of the public network server can be judged again based on the response of the public network server, and then the transmission mode and the packet compression strategy can be adjusted to make it more in line with the current sending needs, thereby improving the image transmission efficiency and the image transmission quality when the second image packet is sent to the receiving end.

[0119] For the corresponding Figure 2 The embodiment of the present application also provides an image transmission method combining satellite and public network, which is applied to the receiving end and includes steps S201 to S204, and each step is specifically as follows:

[0120] Step S201: receiving a plurality of third image subpackets sent by a transmitting end, and reading out the total number of subpackets and the subpacket bit sequence corresponding to the plurality of third image subpackets.

[0121] In certain embodiments of the present application, step S201 further includes: respectively reading and obtaining the subpacket types of the plurality of third image subpackets; wherein the subpacket types include a first compressed subpacket and a second compressed subpacket.

[0122] In some embodiments of the present application, step S201 further includes: reading and obtaining the region comparison parameters of the plurality of third image subpackets. Specifically, the region comparison parameters are used to obtain the region position of the region of interest when the sending end processes the image to be sent to obtain the region of interest.

[0123] Step S202: Determine the missing bit sequence of the sub-packet bit sequence according to the total number of sub-packets.

[0124] In some embodiments of the present application, after determining the missing bit sequence of the subpacket bit sequence according to the total number of subpackets, the method further includes:

[0125] generating a retransmission instruction according to the transmission mode and the missing bit sequence;

[0126] The retransmission instruction is sent to the sending end in the transmission mode, so that the sending end retransmits the third image subpacket corresponding to the missing bit sequence according to the retransmission instruction.

[0127] The present application generates a retransmission instruction according to the transmission mode and missing bit sequence of the sending end, and sends it to the sending end, so as to obtain the third image subpacket corresponding to the missing bit sequence, further complete the first compressed image, and thus improve the transmission quality of the image.

[0128] Step S203: splicing the plurality of third image subpackets according to the subpacket bit sequence, and setting the bytes of the third image subpackets corresponding to the missing bit sequence to zero bytes during splicing, to obtain a first compressed image.

[0129] In certain embodiments of the present application, the plurality of third image subpackets are spliced ​​according to the subpacket bit sequence, and when splicing, the bytes of the third image subpackets corresponding to the missing bit sequence are all set to zero bytes to obtain the first compressed image, specifically:

[0130] Dividing the plurality of third image subpackets according to the subpacket type to obtain a plurality of first compressed subpackets and a plurality of second compressed subpackets;

[0131] splicing the plurality of first compressed subpackets and the plurality of second compressed subpackets respectively according to the subpacket bit sequence, and setting the bytes of the first compressed subpackets or the second compressed subpackets corresponding to the missing bit sequence to zero bytes during splicing, to obtain a first compressed sub-graph and a second compressed sub-graph;

[0132] According to the region comparison parameter, the first compressed sub-image is overlaid on the second compressed sub-image to obtain a first compressed image.

[0133] Step S204: decompressing the first compressed image according to the transmission mode of the plurality of third image subpackets at the transmitting end to obtain an original transmission image.

[0134] In some implementations of the present application, decompressing the first compressed image to obtain the original transmission image according to the transmission mode of the plurality of third image subpackets by the transmitting end is specifically:

[0135] Obtaining current compression ratios of the plurality of third image subpackets according to a transmission mode of the plurality of third image subpackets by the transmitting end;

[0136] The first compressed image is decompressed according to the current compression ratio to obtain an original transmission image.

[0137] In some embodiments of the present application, after decompressing the first compressed image according to the transmission mode of the plurality of third image packets by the transmitting end to obtain the original transmission image, the method further includes:

[0138] According to the transmission mode, a preset first enhancement ratio is obtained, and image enhancement is performed on the original transmission image according to the first enhancement ratio to obtain a first enhanced image.

[0139] The present application obtains a preset first enhancement ratio according to the transmission mode of the sending end, performs image enhancement on the original transmission image to obtain a first enhanced image, and can select different image enhancement ratios for the original transmission image to match different transmission modes, avoid excessive enhancement, and thus ensure the transmission quality of the image.

[0140] Compared with the prior art, the present application first receives multiple third image subpackets sent by the sending end, and reads the total number of subpackets and the subpacket sequence, and then determines the missing sequence of the subpacket sequence according to the total number of subpackets. It can check the loss of image subpackets during image transmission, and set the bytes of the image subpackets corresponding to the missing sequence to zero bytes when splicing according to the subpacket sequence to obtain the first compressed image. It can ensure the correctness of the subpacket sequence in the event of data loss, and then when the first compressed image is decompressed according to the transmission method to obtain the original transmission image, the overall content of the image is ensured, thereby ensuring the transmission quality of the image.

[0141] Corresponding to the previous method, see Figure 3 , the embodiment of the present application provides an image transmission device combining a satellite and a public network, which is applied to a transmitting end, and includes a transmission mode determination module 310, an image packet compression module 320, a transmission signal verification module 330, a transmission mode update module 340 and an image packet sending module 350;

[0142] The transmission mode determination module 310 is used to initiate a first connection request to a public network server, and obtain a first transmission mode according to a response to the first connection request; wherein the first transmission mode includes any one of public network transmission and satellite transmission;

[0143] The image packet compression module 320 is used to perform packet compression on the image to be sent according to the first transmission mode to obtain a plurality of first image packets;

[0144] The transmission signal verification module 330 is used to initiate a signal verification request to the public network server according to the first transmission mode, and obtain a first verification result according to a response to the signal verification request;

[0145] The transmission mode updating module 340 is used to update the first transmission mode to obtain a second transmission mode according to the first verification result, and to update the plurality of first image subpackets to obtain a plurality of second image subpackets;

[0146] The image subpacket sending module 350 is used to send the plurality of second image subpackets to a receiving end in the second transmission mode.

[0147] In certain embodiments of the present application, the transmission mode determination module 310 includes a public network transmission determination unit and a satellite transmission determination unit;

[0148] The public network transmission determining unit is configured to use the public network transmission as the first transmission mode if a response signaling transmitted back by the public network server according to the first connection request is received;

[0149] The satellite transmission determination unit is configured to use satellite transmission as the first transmission mode if no response signaling transmitted back by the public network server according to the first connection request is received.

[0150] In some embodiments of the present application, the image packet compression module 320 includes a first packet compression unit and a second packet compression unit;

[0151] The first packet compression unit is configured to, if the first transmission mode is satellite transmission, perform packet compression on the image to be transmitted according to a preset first compression ratio to obtain a plurality of first image packets;

[0152] The second packet compression unit is used to perform packet compression on the image to be sent according to a preset second compression ratio to obtain multiple first image packets if the first transmission mode is public network transmission; wherein the first compression ratio is greater than the second compression ratio.

[0153] In certain embodiments of the present application, the transmission mode update module 340 includes a first transmission update unit and a second transmission update unit;

[0154] The first transmission updating unit is configured to change the first transmission mode to public network transmission if the first verification result is successful, and use the multiple first image subpackets as multiple second image subpackets;

[0155] The second transmission update unit is used to change the first transmission mode to satellite transmission if the first verification result is unsuccessful, and update the multiple first image subpackets to obtain multiple second image subpackets according to a preset third compression ratio and the current compression ratio of the multiple first image subpackets.

[0156] In some embodiments of the present application, the second transmission update unit includes a first compression subunit and a second compression subunit;

[0157] The first compression subunit is configured to use the plurality of first image packets as a plurality of second image packets if the current compression ratio is equal to the third compression ratio;

[0158] The second compression subunit is used to update the multiple first image subpackets according to the third compression ratio to obtain multiple second image subpackets if the current compression ratio is not equal to the third compression ratio.

[0159] The present application first initiates a first connection request to a public network server, and determines a first transmission mode of public network transmission or satellite transmission based on a response to the first connection request, and can judge the signal quality of the public network server based on the response, and then select a first transmission mode that is more suitable for the current transmission, which can improve the image transmission efficiency and ensure the image transmission quality; then, according to the first transmission mode, the image to be sent is packetized and compressed, and a packet compression strategy that matches the current transmission mode can be selected to ensure the image transmission quality under the current transmission mode, and then a signal verification request is initiated to the public network server, and a first verification result is obtained based on the response to the signal verification request, and the signal quality of the public network server can be judged again based on the response of the public network server, and then the transmission mode and the packet compression strategy can be adjusted to make it more in line with the current sending needs, thereby improving the image transmission efficiency and the image transmission quality when the second image packet is sent to the receiving end.

[0160] For the corresponding Figure 4 , the embodiment of the present application also provides an image transmission device combining a satellite and a public network, which is applied to a receiving end, and includes a packet receiving and reading module 410, a missing bit sequence determination module 420, an image packet splicing module 430 and a compressed image decompression module 440;

[0161] The sub-packet receiving and reading module 410 is used to receive a plurality of third image sub-packets sent by the sending end, and read and obtain the total number of sub-packets and the sub-packet bit sequence corresponding to the plurality of third image sub-packets;

[0162] The missing bit sequence determining module 420 is used to determine the missing bit sequence of the subpacket bit sequence according to the total number of subpackets;

[0163] The image subpacket splicing module 430 is used to splice the plurality of third image subpackets according to the subpacket bit sequence, and during the splicing, the bytes of the third image subpackets corresponding to the missing bit sequence are all set to zero bytes to obtain a first compressed image;

[0164] The compressed image decompression module 440 is used to decompress the first compressed image according to the transmission mode of the plurality of third image packets at the transmitting end to obtain an original transmission image.

[0165] In some embodiments of the present application, a missing subpacket retransmission module is further included; the missing subpacket retransmission module includes a retransmission instruction generating unit and a retransmission instruction sending unit;

[0166] The retransmission instruction generating unit is used to generate a retransmission instruction according to the transmission mode and the missing bit sequence;

[0167] The retransmission instruction sending unit is used to send the retransmission instruction to the sending end in the transmission mode, so that the sending end retransmits the third image packet corresponding to the missing bit sequence according to the retransmission instruction.

[0168] In some embodiments of the present application, a first image enhancement module is also included;

[0169] The first image enhancement module is used to obtain a preset first enhancement ratio according to the transmission mode, and perform image enhancement on the original transmission image according to the first enhancement ratio to obtain a first enhanced image.

[0170] The present application first receives multiple third image subpackets sent by the sending end, and reads to obtain the total number of subpackets and the subpacket sequence, and then determines the missing sequence of the subpacket sequence according to the total number of subpackets, which can detect the loss of image subpackets during image transmission, and when splicing according to the subpacket sequence, the bytes of the image subpackets corresponding to the missing sequence are set to zero bytes to obtain the first compressed image, which can ensure the correctness of the subpacket sequence in the event of data loss, and then when the first compressed image is decompressed according to the transmission method to obtain the original transmission image, the overall content of the image is ensured, thereby ensuring the transmission quality of the image.

[0171] It should be understood that the device provided in the embodiment of the present application corresponds to the aforementioned method. The image transmission device combining a satellite and a public network applied to the sending end provided in the embodiment of the present application can implement the image transmission method combining a satellite and a public network applied to the sending end provided in any embodiment of the present application; similarly, the image transmission device combining a satellite and a public network applied to the receiving end provided in the embodiment of the present application can implement the image transmission method combining a satellite and a public network applied to the receiving end provided in any embodiment of the present application.

[0172] Adaptively, see Figure 5 , the embodiment of the present application also provides an image transmission system combining satellite and public network, including multiple acquisition devices, a public network server and an image processing platform;

[0173] Wherein, the plurality of acquisition devices are used to acquire images to be processed, and execute a satellite-public network-combined image transmission method applied to a transmitting end as described in the present application, so as to send the images to be processed to the image processing platform;

[0174] The public network server is used to respond to the requests of the plurality of acquisition devices, and return signaling according to the requests, so that the plurality of acquisition devices process and send the to-be-processed images according to the signaling;

[0175] The image processing platform is used to execute a satellite and public network combined image transmission method applied to a receiving end as described in the present application, so as to receive, process and store the images to be processed sent by the multiple acquisition devices.

[0176] Adaptively, the embodiments of the present application also provide a computer device and a computer-readable storage medium.

[0177] The computer device comprises: a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor;

[0178] Among them, when the processor executes the computer program, it implements the image transmission method combining a satellite and a public network applied to the sending end or the image transmission method combining a satellite and a public network applied to the receiving end of the present application.

[0179] The computer-readable storage medium stores multiple instructions, which are suitable for the processor to load to execute the image transmission method combining satellite and public network applied to the sending end or the image transmission method combining satellite and public network applied to the receiving end of the present application.

[0180] The above are some implementation methods of the present application, and the purpose, technical scheme and beneficial effects of the present application are further described in detail. It should be clear that the above-mentioned partial implementation methods of the present application cannot be understood as limiting the present application. It is particularly pointed out that for those skilled in the art, any changes, modifications, equivalent substitutions and variations made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A satellite and public network combined image transmission method, characterized in that: Applied to the sending end, including: Initiate a first connection request to a public network server, and obtain a first transmission mode according to a response to the first connection request; wherein the first transmission mode includes any one of public network transmission and satellite transmission; According to the first transmission mode, the image to be sent is compressed in packets to obtain a plurality of first image packets; Initiating a signal verification request to the public network server according to the first transmission mode, and obtaining a first verification result according to a response to the signal verification request; According to the first verification result, updating the first transmission mode to obtain a second transmission mode, and updating the plurality of first image subpackets to obtain a plurality of second image subpackets; The plurality of second image packets are sent to a receiving end in the second transmission mode.

2. The image transmission method combining satellite and public network according to claim 1, characterized in that: The obtaining a first transmission mode according to a response to the first connection request specifically includes: If a response signaling is received from the public network server according to the first connection request, public network transmission is used as the first transmission mode; If no response signaling is received from the public network server in response to the first connection request, satellite transmission is used as the first transmission mode.

3. The image transmission method combining satellite and public network according to claim 1, characterized in that: The step of compressing the image to be sent according to the first transmission mode to obtain a plurality of first image subpackets specifically includes: If the first transmission mode is satellite transmission, the image to be sent is compressed in packets according to a preset first compression ratio to obtain a plurality of first image packets; If the first transmission mode is public network transmission, the image to be sent is compressed in packets according to a preset second compression ratio to obtain a plurality of first image packets; wherein the first compression ratio is greater than the second compression ratio.

4. The image transmission method combining satellite and public network according to claim 1, characterized in that: The updating of the first transmission mode to obtain a second transmission mode according to the first verification result, and the updating of the plurality of first image subpackets to obtain a plurality of second image subpackets specifically include: If the first verification result is successful, the first transmission mode is changed to public network transmission, and the multiple first image subpackets are used as multiple second image subpackets; If the first verification result is that the verification is unsuccessful, the first transmission mode is changed to satellite transmission, and the multiple first image subpackets are updated to obtain multiple second image subpackets according to a preset third compression ratio and the current compression ratio of the multiple first image subpackets.

5. The image transmission method combining satellite and public network according to claim 4, characterized in that: The updating of the plurality of first image subpackets to obtain the plurality of second image subpackets according to the preset third compression ratio and the current compression ratio of the plurality of first image subpackets specifically includes: If the current compression ratio is equal to the third compression ratio, treating the plurality of first image packets as a plurality of second image packets; If the current compression ratio is not equal to the third compression ratio, the multiple first image subpackets are updated according to the third compression ratio to obtain multiple second image subpackets.

6. A satellite and public network combined image transmission method, characterized in that: Applied to the receiving end, including: receiving a plurality of third image subpackets sent by a transmitting end, and reading and obtaining a total number of subpackets and a subpacket sequence corresponding to the plurality of third image subpackets; Determine the missing bit sequence of the sub-packet bit sequence according to the total number of sub-packets; splicing the plurality of third image subpackets according to the subpacket bit sequence, and setting the bytes of the third image subpackets corresponding to the missing bit sequence to zero bytes during splicing, to obtain a first compressed image; According to the transmission mode of the plurality of third image packets at the transmitting end, the first compressed image is decompressed to obtain an original transmission image.

7. The image transmission method combining satellite and public network according to claim 6, characterized in that: After determining the missing bit sequence of the sub-packet bit sequence according to the total number of sub-packets, the method further includes: generating a retransmission instruction according to the transmission mode and the missing bit sequence; The retransmission instruction is sent to the sending end in the transmission mode, so that the sending end retransmits the third image subpacket corresponding to the missing bit sequence according to the retransmission instruction.

8. The image transmission method combining satellite and public network according to claim 6, characterized in that: After decompressing the first compressed image according to the transmission mode of the plurality of third image subpackets by the transmitting end to obtain the original transmission image, the method further includes: According to the transmission mode, a preset first enhancement ratio is obtained, and image enhancement is performed on the original transmission image according to the first enhancement ratio to obtain a first enhanced image.

9. An image transmission device combining satellite and public network, characterized in that: Applied to the sending end, it includes a transmission mode determination module, an image packet compression module, a transmission signal verification module, a transmission mode update module and an image packet sending module; The transmission mode determination module is used to initiate a first connection request to a public network server, and obtain a first transmission mode according to a response to the first connection request; wherein the first transmission mode includes any one of public network transmission and satellite transmission; The image sub-packet compression module is used to perform sub-packet compression on the image to be sent according to the first transmission mode to obtain a plurality of first image sub-packets; The transmission signal verification module is used to initiate a signal verification request to the public network server according to the first transmission mode, and obtain a first verification result according to a response to the signal verification request; The transmission mode updating module is used to update the first transmission mode to obtain a second transmission mode according to the first verification result, and to update the plurality of first image subpackets to obtain a plurality of second image subpackets; The image subpacket sending module is used to send the multiple second image subpackets to the receiving end in the second transmission mode.

10. An image transmission device combining satellite and public network, characterized in that: Applied to the receiving end, it includes a packet receiving and reading module, a missing bit sequence determination module, an image packet splicing module and a compressed image decompression module; The sub-packet receiving and reading module is used to receive a plurality of third image sub-packets sent by the sending end, and read and obtain the total number of sub-packets and the sub-packet bit sequence corresponding to the plurality of third image sub-packets; The missing bit sequence determining module is used to determine the missing bit sequence of the subpacket bit sequence according to the total number of subpackets; The image subpacket splicing module is used to splice the plurality of third image subpackets according to the subpacket bit sequence, and during the splicing, the bytes of the third image subpackets corresponding to the missing bit sequence are all set to zero bytes to obtain a first compressed image; The compressed image decompression module is used to decompress the first compressed image according to the transmission mode of the plurality of third image subpackets at the sending end to obtain the original transmission image.

11. An image transmission system combining satellite and public network, characterized in that: Includes multiple acquisition devices, public network servers and image processing platforms; Wherein, the plurality of acquisition devices are used to acquire images to be processed, and execute the image transmission method combining satellite and public network as claimed in any one of claims 1 to 5 to send the images to be processed to the image processing platform; The public network server is used to respond to the requests of the plurality of acquisition devices, and return signaling according to the requests, so that the plurality of acquisition devices process and send the to-be-processed images according to the signaling; The image processing platform is used to execute the image transmission method combining satellite and public network as described in any one of claims 6 to 8, so as to receive, process and store the images to be processed sent by the multiple acquisition devices.

Images