Integrated image transmission terminal and method special for electric power based on high-flux broadband satellite

Abstract

The invention discloses an integrated image transmission terminal and method special for electric power based on a high-flux broadband satellite, and the terminal comprises an image collection module which is used for converting image information in a complex environment into an image data set, carrying out the fusion of the information through the image modes of an RGB image, a depth image and the like, and improving the understanding and processing capability of the complex environment; and the quick transmission interface is used for quickly transmitting the processed data to be displayed, and the transmission speed is high. Through the installation mechanism, the purpose of rapidly installing the image transmission terminal equipment is achieved, so that the installation process is simple and convenient, the stability is higher, the installation time is shortened during emergency use, great convenience is brought to a user, images are clearer in the transmission process through a DPM diffusion probability model algorithm, and the image transmission efficiency is improved. Therefore, the terminal equipment can receive useful information conveniently, and the data transmission rate and quality are improved.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and more specifically to an integrated image transmission terminal and method dedicated to power based on a high-throughput broadband satellite. Background Art

[0002] Digital grid is a new energy ecosystem formed by the core driving force of new generation digital technologies such as cloud computing, big data, Internet of Things, mobile Internet, artificial intelligence, blockchain, etc., with data as the key production factor, modern power energy network and new generation information network as the basis, and continuously improving the level of digitalization, networking and intelligence through the deep integration of digital technology with energy enterprise business and management. It has the characteristics of flexibility, openness, interactivity, economy and sharing. As satellite application technology enters a new era, satellite communications, satellite navigation and satellite remote sensing have been integrated into the construction of core infrastructure such as power and communications in my country, playing an important role in realizing the optimal allocation and efficient utilization of power resources and helping to build a digital grid.

[0003] Although my country's wireless mobile communication network has become the world's largest and most widely covered mobile communication network after decades of development, there are still a large number of wireless mobile communication network coverage blind spots in sparsely populated areas such as sand dunes, deserts and mountains in central and western my country. As a result, even if various digital equipment such as online monitoring devices are installed in the digital scenes of power grids represented by substations and transmission lines in these areas, they cannot be used due to lack of network coverage. In fact, due to the harsh natural environment and difficulty in reaching people, these areas are often the most in need of technical means such as video surveillance and online status monitoring to improve digital status perception capabilities.

[0004] Satellite communication can achieve stable data transmission and communication over long distances and over a large range. Satellite communication is not affected by objective factors such as geological disasters, natural disasters and human factors, so the transmission system is more stable. Therefore, the use of satellite communication is not limited by time and space, and is more flexible and convenient. The development of high-throughput satellites has a high-throughput communication capability that can reach tens or even hundreds of times that of traditional communication satellites, making it possible for satellites to transmit image data. Through high-throughput satellite communication technology, power grid monitoring images and massive power Internet of Things data can be quickly returned, improving the guarantee capability in power communication scenarios such as wide-area power Internet of Things, emergency rescue, and tower communication blind spots. At the same time, most of the high-throughput satellite power integrated image transmission terminal devices are relatively cumbersome to install when in use. If an emergency occurs, it will waste time, bring unnecessary trouble to users, and reduce the practicality of the image transmission terminal. At the same time, when the image transmission terminal is transmitting image data, it is very likely to be interfered by external information, which reduces the quality of the transmitted data and cannot receive accurate information, reducing the practicality and convenience of the image transmission terminal. Therefore, we propose a power-specific integrated image transmission terminal and method based on high-throughput broadband satellite to solve the above problems. Summary of the invention

[0005] In view of the deficiencies of the above-mentioned technologies, the present invention discloses an integrated image transmission terminal and method dedicated to power based on a high-throughput broadband satellite. The image transmission terminal equipment can be quickly installed through an installation mechanism, and the DPM diffusion probability model algorithm is used to cope with external interference to data transmission.

[0006] An integrated image transmission terminal dedicated to power based on a high-throughput broadband satellite, comprising:

[0007] Image acquisition module, which is used to convert image information in complex environments into image data sets, and fuse information using image modalities such as RGB images and depth images to improve the ability to understand and process complex environments;

[0008] Image processing module, used to perform denoising and color correction on the collected image data to reduce noise and improve image quality, and to process and encode the divided areas of large images to improve the computing power of subsequent models;

[0009] Fast transmission interface, used to quickly transmit the processed data to be displayed, with fast transmission speed;

[0010] The fast transmission interface is provided with a data transmitter, a data receiver and a physical layer interface. The data transmitter is responsible for sending data from the terminal system to the physical medium, the data receiver receives data from the physical medium and transmits it back to the terminal system, and the physical layer interface is responsible for processing the connection and communication with the physical medium, including signal encoding and decoding;

[0011] The fast transmission interface adopts high-speed image data transmission technology, power supply and grounding, and thermal design and heat dissipation to achieve the purpose of fast data transmission;

[0012] Remote monitoring module, used to remotely monitor the data transmission process, effectively reducing the attacks of saboteurs during the data transmission process, thereby protecting the security of information transmission;

[0013] A data storage module is used to store the processed target data to pave the way for the subsequent use of the target data;

[0014] The communication terminal is used to receive data information forwarded by other ground users through the satellite for query by the unmanned machine through the USB interface, and send the data sent by the user through the USB interface to the satellite, and forward it to other ground users through the satellite;

[0015] An adaptive coding module, used to compensate for the attenuation of information transmission signals, ensuring the effective transmission of data information in the satellite communication system, wherein the adaptive coding module includes a receiver and a transmitter;

[0016] The output end of the transmitter is connected to the input end of the transmitting antenna, the output end of the transmitting antenna is connected to the input end of the channel, the output end of the channel is connected to the input end of the receiving antenna, the output end of the receiving antenna is connected to the input end of the receiver, and the output end of the receiver is connected to the terminal device.

[0017] Furthermore, the communication terminal comprises:

[0018] The RF channel unit is mainly equipped with an agile converter and a power amplifier, responsible for transmitting the IQ data received from the baseband through RF and transmitting the data received from the satellite signal after frequency conversion to the baseband signal processing unit;

[0019] The terminal processing unit is used to control the entire device, collect user data and pass the data block to the signal processing unit, send commands to the RF channel unit and the baseband processing unit to remember the external interface components, and is responsible for the control of the entire device. When sending user data, it obtains data from the user terminal through the Bluetooth module or the direct USB connection line interaction to complete the communication with the signal processing unit. The terminal processing module can also obtain the decoded user data from the signal processing and send it to the user terminal, and is responsible for completing the power management function of the whole machine, turning on and off the device, sleeping, standby, restarting and resetting. The baseband processing unit completes the physical layer baseband function, including MAC frame encoding and decoding, addition and de-spreading, modulation and demodulation, anti-interference, pilot capture and tracking.

[0020] The power management unit controls the power switch and power consumption of the entire device, connects to an external DC power supply, supplies power to the entire satellite communication equipment, and implements power filtering and noise suppression functions through hardware circuits.

[0021] Further, the baseband processing module includes a data preprocessor and a decompression decoder;

[0022] The data preprocessor receives the data transmitted by the demodulator, completes real-time frame synchronization, descrambling, RS decoding and decryption decoding, and then sends the decoded data to the decompression decoder format analysis unit for processing. After the processing, the data divided by load is distributed to different decompression decoding units or the load data that does not need to be decompressed is directly transmitted to the display device. The data after decompression is transmitted to the back-end display device and connected to the storage array to complete the storage of the original data and the decompressed level 0 data;

[0023] The decompression decoder mainly performs frame format analysis and decompression decoding processing on the input data, sends the decompressed data to the recording device for recording and transmits it to the display device for display. The device has strong scalability and reconfigurability.

[0024] Furthermore, the transmitting terminal includes an Rx front-end circuit, a Tx front-end circuit, a mixer, a phase-locked loop, a filter, an ADC, a DAC, an FPGA, and an MCU circuit. In the digital circuit part, FPGA and MCU are used to complete the processing of digital signals and the control of each chip and power module;

[0025] The FPGA is mainly used to receive ADC data inside the AD9364 and transmit data to the DAC inside the AD9364;

[0026] The MCU is mainly used to configure and control the FPGA and other modules of the system. At the same time, the FPGA will package the data received by the ADC and send it to the MCU. After the MCU processes it, it transmits it to the external module through the interface.

[0027] Furthermore, the integrated image transmission method for power-specific use based on a high-throughput broadband satellite, and the working method of the image transmission terminal include the following steps:

[0028] Step 1: First, the image information in the complex environment needs to be converted into image data, and then the information is fused using image modalities such as RGB images and depth images to encode the image's salient target areas;

[0029] The image salient target area coding refers to detecting and coding the detection target area in the image, and selecting delayed coding or no coding for the non-salient area according to the interference situation, thereby ensuring the quality of image acquisition.

[0030] Step 2: De-noise and color correct the collected image data;

[0031] The denoising process refers to using the DPM diffusion probability model algorithm as an image sharpening model. The DPM forward process gradually adds Gaussian noise to the clear image. The reverse process uses a Markov chain structure to perform deep learning operations to denoise the collected image and restore it to a clean image, thereby sharpening the blurred image.

[0032] Step 3: Remotely monitor the transmitted data;

[0033] The remote monitoring refers to monitoring the entire image during the image transmission process to prevent image data from being disturbed during the transmission process and to avoid mosaics appearing in the image after transmission, thereby preventing any useful information from being obtained.

[0034] Step 4: Transmit the received image data to the communication terminal;

[0035] The communication terminal sends the received image to other ground users via a USB interface or Bluetooth, thereby ensuring effective transmission of images in the satellite communication system.

[0036] Furthermore, the working method of the image transmission algorithm comprises the following steps:

[0037] Step 1: Use image classification labels for weakly supervised explicit detection. It is necessary to convert image classification information labels into pixel-level labels. The input image of the mapping network is an RGB image. In the extraction process, the mapping network is first used to extract the feature map after global average pooling, and then the weights of the classification feature maps are superimposed according to the confidence level, and finally aggregated into a mapping network map. The superposition process formula is as follows:

[0038]

[0039] In formula (1), P is the activation map of the input image, is the weight value of the k-th classification feature map of the c-th target, F k is the kth classification feature map. According to the feature map, the prediction category formula can be obtained as follows:

[0040]

[0041] In formula (2), Class represents the predicted category, Represents the weight value of the mapping network, b s represents the bias value, g(P) represents the average pooling operation on the mapping network graph;

[0042] Finally, the generated class activation map has the following analytical expression:

[0043]

[0044] The trained mapping images are divided into images with strong significance and images with pseudo noise according to the amount of noise. This time, the image processing module is used to conduct comprehensive training on the two types of images.

[0045] The class activation mapping network described above is used as a generator, and the noise network is used as a discriminator. The two networks compete with each other in training. The class activation mapping network generates a more realistic saliency image, while the discriminator determines whether the predicted image is a pseudo-noise image by judging the characteristics of the noise information data.

[0046] Step 2: During the image data transmission process, when there is a strong electromagnetic signal from the outside world, it is easy to interfere with the signal and cause bit errors. The error correction coding scheme is used to correct the data. At the same time, the traditional error correction code is improved to make it suitable for the image transmission equipment of high-throughput broadband satellites. The low-density parity check code is a small-sized and low-algorithm error correction coding scheme, which is directly deployed in embedded devices. To realize the low-density parity check code LDPC, its matrix needs to be constructed. A check matrix needs to be randomly constructed. The matrix size is 1023*2046. The encoding method uses Gaussian elimination. Assuming that the check matrix is ​​H, the Gaussian elimination formula is as follows:

[0047] H=[E / L]=[I / P](5)

[0048] The specific implementation steps are:

[0049] 1) Perform an upper triangular transformation on H to obtain the matrix L; perform a row transformation on H to obtain the diagonal matrix E; at the same time, convert the diagonal matrix E into a unit matrix to obtain the inverse matrix P;

[0050] 2) Encode the original information C and perform synchronous grouping. The number of information bits in the grouping is the number of rows in the P matrix. The information is recorded as C i+1 , i is a positive integer, and the check vector formula is as follows:

[0051] V=C i P(6)

[0052] Step 3: The algorithm scheme uses compressed sensing to compress the signal according to the characteristics of high-throughput satellite communication transmission, thereby reducing the signal transmission volume. At the same time, the saliency detection algorithm is used to ensure image recognition in the main area, improving the efficiency of image transmission. Finally, LDPC coding technology is used to reduce the impact of channel interference on image transmission, effectively achieving resistance to strong magnetic field interference during image transmission.

[0053] Furthermore, the integrated image transmission terminal dedicated to power based on high-throughput broadband satellite comprises an image transmission terminal device, a mounting column, a fixing frame, a fixing slot and an adjustment slot, and the image transmission terminal device is provided with a mounting mechanism on the outside;

[0054] The mounting mechanism includes a screw rod rotatably installed between a fixing groove and an inner bottom wall of the adjusting groove, a No. 1 gear is fixedly installed on the outer surface of the screw, a rotating rod with one end penetrating and extending to the outside of the fixing frame is rotatably installed on the inner top wall of the adjusting groove, a No. 2 gear is fixedly installed on the outer surface of the rotating rod, an adjusting block is threadedly connected on the outer surface of the screw, a moving frame is fixedly installed on the right side of the adjusting block, a first clamping plate is fixedly installed on the top of the moving frame, a mounting frame is fixedly installed on the inner top wall of the fixing frame, a second clamping plate is fixedly installed on the bottom of the mounting frame, a limiting disk is fixedly installed on the outer surface of the rotating rod, a supporting plate is fixedly installed on the bottom of the fixing frame, and a limiting rod with one end penetrating and extending to the outside of the supporting plate is rotatably installed on the right side of the supporting plate.

[0055] Furthermore, an integrated image transmission terminal dedicated to electricity based on a high-throughput broadband satellite is provided, wherein the mounting column is fixedly mounted on the outside of the image transmission terminal device, the fixing bracket is movably mounted on the outside of the image transmission terminal device, the fixing groove is opened on the inside of the fixing bracket, and the adjustment groove is opened on the inside of the fixing bracket.

[0056] Furthermore, an integrated image transmission terminal dedicated to electricity based on a high-throughput broadband satellite is provided, wherein a limit rod is fixedly installed on the left side of the adjustment block, a limit groove is provided on the left side wall of the inner cavity of the fixing frame, and the outer surface of the limit rod is slidably connected to the inner wall of the limit groove.

[0057] Furthermore, in an integrated image transmission terminal based on power dedicated to high-throughput broadband satellite, the outer surface of the limit plate is provided with a plurality of evenly distributed card slots, and the size of the limit rod is adapted to the size of the card slots.

[0058] Positive beneficial effects

[0059] Through the installation mechanism, the purpose of quick installation of the image transmission terminal equipment is achieved, making the installation process simple and more stable, thereby shortening the installation time in emergency use, bringing great convenience to the user. By utilizing the DPM diffusion probability model algorithm, the image is made clearer during the transmission process, making it easier for the terminal device to receive useful information, thereby improving the rate and quality of data transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work, among which:

[0061] Figure 1 This is a schematic diagram of the structure of an integrated image transmission terminal dedicated to power based on a high-throughput broadband satellite according to the present invention;

[0062] Figure 2 The present invention is an integrated image transmission terminal dedicated to power based on high-throughput broadband satellite Figure 1 Enlarged view of point A in the middle;

[0063] Figure 3 A partial stereoscopic diagram of an integrated image transmission terminal dedicated to power based on a high-throughput broadband satellite according to the present invention;

[0064] Figure 4 This is a structural diagram of a high-throughput satellite communication module of an integrated image transmission terminal dedicated to power based on a high-throughput broadband satellite according to the present invention;

[0065] Figure 5 This is a system block diagram of an integrated image transmission terminal dedicated to power based on a high-throughput broadband satellite according to the present invention;

[0066] Figure 6 The present invention is a block diagram of a baseband processing module of an integrated image transmission method dedicated to power based on a high-throughput broadband satellite;

[0067] Figure 7 The present invention is a structural block diagram of an adaptive coding and modulation system for an integrated image transmission method dedicated to power based on a high-throughput broadband satellite.

[0068] In the figure: 1. Image transmission terminal device; 2. Mounting column; 3. Fixed bracket; 4. Fixed slot; 5. Adjustment slot; 601. Screw; 602. Gear No. 1; 603. Rotating rod; 604. Gear No. 2; 605. Adjustment block; 606. Moving bracket; 607. First clamping plate; 608. Mounting bracket; 609. Second clamping plate; 610. Limiting plate; 611. Support plate; 612. Limiting rod. DETAILED DESCRIPTION

[0069] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0070] The present invention adopts the following technical solutions:

[0071] like Figure 4-7 As shown, a data transmission abnormality communication system based on Internet of Things technology includes:

[0072] Image acquisition module, which is used to convert image information in complex environments into image data sets, and fuse information using image modalities such as RGB images and depth images to improve the ability to understand and process complex environments;

[0073] Image processing module, used to perform denoising and color correction on the collected image data to reduce noise and improve image quality, and to process and encode the divided areas of large images to improve the computing power of subsequent models;

[0074] Fast transmission interface, used to quickly transmit the processed data to be displayed, with fast transmission speed;

[0075] The fast transmission interface is provided with a data transmitter, a data receiver and a physical layer interface. The data transmitter is responsible for sending data from the terminal system to the physical medium, and the data receiver receives data from the physical medium and transmits it back to the terminal system. The physical layer interface is responsible for processing the connection and communication with the physical medium, including signal encoding and decoding;

[0076] The fast transmission interface uses high-speed image data transmission technology, power supply and grounding, and thermal design and heat dissipation to achieve the purpose of fast data transmission;

[0077] Remote monitoring module, used to remotely monitor the data transmission process, reduce the attacks of saboteurs during the data transmission process, and thus protect the security of information transmission;

[0078] A data storage module is used to store the processed target data to pave the way for the subsequent use of the target data;

[0079] The communication terminal is used to receive data information forwarded by other ground users through the satellite for query by the unmanned machine through the USB interface, and send the data sent by the user through the USB interface to the satellite, and forward it to other ground users through the satellite;

[0080] An adaptive coding module, used to compensate for the attenuation of information transmission signals, ensuring the effective transmission of data information in the satellite communication system, wherein the adaptive coding module includes a receiver and a transmitter;

[0081] The output end of the transmitter is connected to the input end of the transmitting antenna, the output end of the transmitting antenna is connected to the input end of the channel, the output end of the channel is connected to the input end of the receiving antenna, the output end of the receiving antenna is connected to the input end of the receiver, and the output end of the receiver is connected to the terminal device.

[0082] It should be added that the working steps of the adaptive coding modulation system are:

[0083] Step 1: The receiving antenna receives the image data signal information transmitted by the transmitting antenna, and estimates the channel quality through the channel estimation module of the receiver;

[0084] Step 2: The receiver transmits the channel quality estimation information back to the transmitter via a feedback link;

[0085] Step 3: The transmitter's adaptive algorithm module selects a suitable coding and modulation scheme in the MCS lookup table based on the channel quality information.

[0086] In a specific embodiment, the communication terminal includes a radio frequency channel unit, which is mainly equipped with an agile converter and a power amplifier, and is responsible for transmitting IQ data received from the baseband through radio frequency and transmitting the data received from the satellite signal after frequency conversion processing to the baseband signal processing unit;

[0087] The terminal processing unit is used to control the entire device, collect user data and pass the data blocks to the signal processing unit, send commands to the RF channel unit and the baseband processing unit to remember the external interface components, and is responsible for the control of the entire device. When sending user data, it obtains data from the user terminal through the Bluetooth module or the direct USB connection line to complete the communication with the signal processing unit. The terminal processing module can also obtain the decoded user data from the signal processing and send it to the user terminal. At the same time, it also needs to complete the power management function of the whole machine, and is responsible for the device's power on and off, sleep standby, restart and reset and other functions.

[0088] The baseband processing unit completes the physical layer baseband functions, including MAC frame encoding and decoding, addition and de-spreading, modulation and demodulation, anti-interference, pilot acquisition and tracking.

[0089] The power management unit controls the power switch and power consumption of the entire device, connects to an external DC power supply, supplies power to the entire satellite communication equipment, and implements power filtering and noise suppression functions through hardware circuits.

[0090] The communication terminal is controlled by software to send and receive information. As a non-real-time communication method of storage and forwarding, as long as the satellite terminal receives the ground station information stored and sends information to the satellite terminal for the ground station to receive, the workflow is as follows:

[0091] Step 1: Identity authentication: perform identity authentication of user name and password in any application in the PC management program, mobile phone APP, and satellite terminal application layer to realize human-computer interaction between user and terminal, complete email input and email data management, encapsulate the data to be sent into a composite email (text + attachment) according to the protocol, and send it to the satellite terminal through the USB interface; interpret the received composite email in plain text and display it to the user; provide satellite orbit forecast display and pilot signal strength indication functions;

[0092] Step 2, orbit prediction and transmission link. The user terminal calculates the time and direction of the satellite entering the working field that meets the minimum elevation angle limit based on the preset number of satellite orbit elements and its own geographical location, and notifies the user, who decides to communicate at the right time. After turning on the receiver, the terminal searches for the downlink pilot channel. After capturing the pilot information, it notifies the satellite to enter the working field and perform sending and receiving operations. At the transmission level, the composite email sent by the application layer is encrypted by the cryptographic function library and the security chip, and then the identification field and header are added to form a message, and the message is passed to the link layer. The composite message ciphertext is restored based on the identification field and header of the message sent by the link layer, and decrypted by the cryptographic function library and the security chip, and then sent to the application layer in the composite email format. At the link level, the message sent by the transport layer is encapsulated into multiple frames, and data in MAC frames is transmitted on the link. At the same time, errors are detected and corrected, and the received MAC frames are combined into a complete message according to the frame number sequence and transmitted to the transport layer. The pilot signal strength is calculated;

[0093] Step 3: In RF / baseband processing, the satellite end down-converts, captures, tracks, demodulates, and extracts pilot parameters of the pilot signal received from the satellite antenna.

[0094] In the above specific embodiment, the baseband processing module includes a data preprocessor and a decompression decoder;

[0095] The data preprocessor receives the data transmitted by the demodulator, completes real-time frame synchronization, descrambling, RS decoding and decryption decoding, and then sends the decoded data to the decompression decoder format analysis unit for processing. After the processing, the data divided by load is distributed to different decompression decoding units or the load data that does not need to be decompressed is directly transmitted to the display device. The data after decompression is transmitted to the back-end display device and connected to the storage array to complete the storage of the original data and the decompressed level 0 data;

[0096] The decompression decoder mainly performs frame format analysis and decompression decoding processing on the input data, sends the decompressed data to the recording device for recording and transmits it to the display device for display. The device has strong scalability and reconfigurability.

[0097] It should be added that the power management unit manages the power switch and power consumption control of the entire device, connects to an external DC power supply, powers the entire satellite communication equipment, and implements power filtering and noise suppression functions through hardware circuits, thereby preventing image data from external interference during transmission, allowing the terminal to receive clear and useful image information.

[0098] In a specific embodiment, the transmitting terminal includes an Rx front-end circuit, a Tx front-end circuit, a mixer, a phase-locked loop, a filter, an ADC, a DAC, an FPGA, and an MCU circuit. In the digital circuit part, FPGA and MCU are used to complete the processing of digital signals and the control of each chip and power module;

[0099] The FPGA is mainly used to receive ADC data inside the AD9364 and transmit data to the DAC inside the AD9364;

[0100] The MCU is mainly used to configure and control the FPGA and other modules of the system. At the same time, the FPGA will package the data received by the ADC and send it to the MCU. After the MCU processes it, it transmits it to the external module through the interface.

[0101] In the above specific embodiment, the integrated image transmission method dedicated to power of a high-throughput broadband satellite includes the following steps:

[0102] Step 1: First, the image information in the complex environment needs to be converted into image data, and then the information is fused using image modalities such as RGB images and depth images to encode the image's salient target areas;

[0103] Image salient target area coding refers to detecting and coding the detection target area in the image, and choosing to lag code or not code the non-salient area according to the interference situation, thereby ensuring the quality of image acquisition.

[0104] Step 2: De-noise and color correct the collected image data;

[0105] Denoising refers to using the DPM diffusion probability model algorithm as an image sharpening model. The DPM forward process gradually adds Gaussian noise to the clear image, and the reverse process uses a Markov chain structure to perform deep learning operations to denoise the collected image and restore it to a clean image, and to sharpen the blurred image.

[0106] Step 3: Remotely monitor the transmitted data;

[0107] Remote monitoring means monitoring the entire image during image transmission to prevent interference with image data during transmission and avoid mosaics in the image after transmission, which prevents any useful information from being obtained.

[0108] Step 4: Transmit the received image data to the communication terminal;

[0109] The communication terminal sends the received images to other ground users via USB interface or Bluetooth, ensuring the effective transmission of images in the satellite communication system.

[0110] In a specific embodiment, the integrated image transmission method dedicated to power based on high-throughput broadband satellite, the image transmission algorithm includes the following steps:

[0111] Step 1: Use image classification labels for weakly supervised explicit detection. It is necessary to convert image classification information labels into pixel-level labels. The input image of the mapping network is an RGB image. In the extraction process, the mapping network is first used to extract the feature map after global average pooling, and then the weights of the classification feature maps are superimposed according to the confidence level, and finally aggregated into a mapping network map. The superposition process formula is as follows:

[0112]

[0113] In formula (1), P is the activation map of the input image, is the weight value of the k-th classification feature map of the c-th target, F k is the kth classification feature map. According to the feature map, the prediction category formula can be obtained as follows:

[0114]

[0115] In formula (2), Class represents the predicted category, Represents the weight value of the mapping network, b s represents the bias value, g(P) represents the average pooling operation on the mapping network graph;

[0116] Finally, the generated class activation map has the following analytical expression:

[0117]

[0118] The trained mapping images are divided into images with strong significance and pseudo-noise images according to the amount of noise. This time, the image processing module is used to conduct comprehensive training on the two images. The resulting encoded data is shown in Table 1:

[0119] Table 1: Encoded data

[0120] Encoded information Encoding Data P 20 Class 25.3 Tu 26

[0121] The class activation mapping network described above is used as a generator, and the noise network is used as a discriminator. The two networks compete with each other in training. The class activation mapping network generates a more realistic saliency image, while the discriminator determines whether the predicted image is a pseudo-noise image by judging the characteristics of the noise information data.

[0122] Step 2: During the image data transmission process, when there is a strong electromagnetic signal from the outside world, it is easy to interfere with the signal and cause bit errors. Error correction coding schemes are usually used to correct data. At the same time, the traditional error correction code has been improved to make it suitable for the image transmission equipment of high-throughput broadband satellites. Low-density parity check code is a small-volume, low-algorithm complexity error correction coding scheme, which is directly deployed in embedded devices. To realize the low-density parity check code LDPC, its matrix needs to be constructed. A check matrix needs to be randomly constructed. The matrix size is 1023*2046. The encoding method uses Gaussian elimination method. Assuming that the check matrix is ​​H, the Gaussian elimination formula is as follows:

[0123] H=[E / L]=[I / P](5)

[0124] The specific implementation steps are:

[0125] 1) Perform an upper triangular transformation on H to obtain the matrix L; perform a row transformation on H to obtain the diagonal matrix E; at the same time, convert the diagonal matrix E into a unit matrix to obtain the inverse matrix P;

[0126] 2) Encode the original information C and perform synchronous grouping. The number of information bits in the grouping is the number of rows in the P matrix. The information is recorded as C i+1 , i is a positive integer, and the check vector formula is as follows:

[0127] V=C i P(6)

[0128] HStep 3, Algorithm Scheme According to the characteristics of high-throughput satellite communication transmission, the signal is compressed using a compressed sensing method, thereby reducing the amount of signal transmission. At the same time, a saliency detection algorithm is used to ensure that image recognition is in the main area, which improves the efficiency of image transmission. Finally, the LDPC coding technology is used to reduce the impact of channel interference on image transmission, and effectively resist strong magnetic field interference during image transmission. The performance is experimented, channel noise is added, and Gaussian white noise is used to simulate a strong electromagnetic environment. After real-time loading of high-power white noise, multiple different signal-to-noise ratios are dynamically adjusted for testing. It can be seen that with the continuous increase of the signal-to-noise ratio, the algorithm's PSNR and SSIM indicators are also changing. The FPS (number of images transmitted per second) is used to evaluate the algorithm's operating efficiency. A smoother picture is achieved on the same hardware platform. The use of the algorithm has a higher practical value. The test results are shown in Table 2:

[0129] Table 2: Test results

[0130] algorithm Average FPS value / frame WT 20.52 AE 22.38 CNN 26.23 This algorithm 30.25

[0131] It should be added that image compression sensing is used to compress the data transmission volume during image transmission, and the saliency detection network is used to realize the recognition of the image subject, which can optimize the image transmission process and ensure the limitation and practicality of image transmission.

[0132] like Figure 1-3 , in a specific embodiment, an integrated image transmission terminal dedicated to power based on a high-throughput broadband satellite includes an image transmission terminal device 1, a mounting column 2, a fixing frame 3, a fixing slot 4 and an adjustment slot 5, and a mounting mechanism is arranged outside the image transmission terminal device 1;

[0133] The mounting mechanism includes a screw rod 601 rotatably mounted between the inner bottom wall of the fixing slot 4 and the adjusting slot 5, a No. 1 gear 602 is fixedly mounted on the outer surface of the screw rod 601, a rotating rod 603 having one end penetrating and extending to the outside of the fixing frame 3 is rotatably mounted on the inner top wall of the adjusting slot 5, a No. 2 gear 604 is fixedly mounted on the outer surface of the rotating rod 603, an adjusting block 605 is threadedly connected on the outer surface of the screw rod 601, a moving frame 606 is fixedly mounted on the right side of the adjusting block 605, a first clamping plate 607 is fixedly mounted on the top of the moving frame 606, a mounting frame 608 is fixedly mounted on the inner top wall of the fixing frame 3, a second clamping plate 609 is fixedly mounted on the bottom of the mounting frame 608, a limiting disk 610 is fixedly mounted on the outer surface of the rotating rod 603, a supporting plate 611 is fixedly mounted on the bottom of the fixing frame 3, and a limiting rod 612 having one end penetrating and extending to the outside of the supporting plate 611 is rotatably mounted on the right side of the supporting plate 611.

[0134] Among them, a limiting rod is fixedly installed on the left side of the adjustment block 605, and a limiting groove is provided on the left side wall of the inner cavity of the fixing frame 3. The outer surface of the limiting rod is slidably connected to the inner wall of the limiting groove, which plays a role in limiting the adjustment block 605, so that the adjustment block 605 moves upward under the action of the screw 601, thereby facilitating the rapid installation of the image transmission terminal device 1.

[0135] Among them, protective pads are fixedly installed on the top of the first card board 607 and the bottom of the second card board 609, thereby achieving the purpose of protecting the image transmission terminal device 1, so that the image transmission terminal device 1 will not be damaged due to excessive pressure during installation, and the service life of the image transmission terminal device 1 is increased.

[0136] Among them, the outer surface of the limit plate 610 is provided with multiple and evenly distributed card slots, and the size of the limit rod 612 is adapted to the size of the card slot. Its purpose is to limit the rotating rod 603 so that the rotating rod 603 will not be fixed after use, thereby improving the installation stability of the image transmission terminal device 1 and further protecting the image transmission terminal device 1.

[0137] In the above specific embodiment, the mounting column 2 is fixedly installed on the outside of the image transmission terminal device 1, the fixing frame 3 is movably installed on the outside of the image transmission terminal device 1, the fixing groove 4 is opened inside the fixing frame 3, and the adjustment groove 5 is opened inside the fixing frame 3.

[0138] Working principle:

[0139] When the image transmission terminal device 1 needs to be installed, the installation column 2 needs to be placed between the first card plate 607 and the second card plate 609, and then the limiting rod 612 is rotated out from the inside of the limiting plate 610, and then the rotating rod 603 is rotated clockwise, so that the rotating rod 603 drives the second gear 604 to rotate clockwise, and the second gear 604 drives the first gear 602 to rotate clockwise, so that the first gear 602 drives the screw 601 to rotate clockwise, and the screw 601 drives the adjustment block 605 to move upward, so that the adjustment block 605 drives the moving frame 606 to move upward, and the moving frame 606 drives the second card plate 609 to move upward, and the second card plate 609 squeezes the installation column 2, so that the installation column 5 is fixed between the first card plate 607 and the second card plate 609. When the fixation is completed, the limiting rod 603 is rotated again. 12, so that the limit rod 612 moves to the inside of the limit plate 610, and then fixes the rotating rod 603, thereby completing the installation of the image terminal device 1. Through the Rx front-end circuit, Tx front-end circuit, mixer, filter, ADC, DAC, FPGA and MCU circuit, in the digital circuit part, FPGA and MCU are used to complete the processing of digital signals and the control of each chip and power module, among which FPGA is mainly used to receive the ADC data inside AD9364 and transmit the processed image data to the ADC inside AD9364, and MCU is mainly used to configure and control FPGA and other modules of the system. At the same time, FPGA will package the image data received by ADC and send it to MCU. After MCU processes it, it is transmitted to the external module through the interface.

[0140] Although the specific embodiments of the present invention are described above, it should be understood by those skilled in the art that these specific embodiments are only illustrative, and those skilled in the art may make various omissions, substitutions and changes to the details of the above methods and systems without departing from the principles and essence of the present invention. For example, merging the above method steps so as to perform substantially the same functions in substantially the same manner to achieve substantially the same results is within the scope of the present invention. Therefore, the scope of the present invention is limited only by the appended claims.

Claims

1. An integrated image transmission terminal dedicated to power based on high-throughput broadband satellite, characterized in that: Image acquisition module, which is used to convert image information in complex environments into image data sets, and fuse information using image modalities such as RGB images and depth images to improve the ability to understand and process complex environments; Image processing module, used to perform denoising and color correction on the collected image data to reduce noise and improve image quality, and to process and encode the divided areas of large images to improve the computing power of subsequent models; Fast transmission interface, used to quickly transmit the processed data to be displayed, with fast transmission speed; The fast transmission interface is provided with a data transmitter, a data receiver and a physical layer interface. The data transmitter is responsible for sending data from the terminal system to the physical medium, the data receiver receives data from the physical medium and transmits it back to the terminal system, and the physical layer interface is responsible for processing the connection and communication with the physical medium, including signal encoding and decoding; The fast transmission interface adopts high-speed image data transmission technology, power supply and grounding, and thermal design and heat dissipation to achieve the purpose of fast data transmission; Remote monitoring module, used to remotely monitor the data transmission process, reduce the attacks of saboteurs during the data transmission process, and thus protect the security of information transmission; A data storage module is used to store the processed target data to pave the way for the subsequent use of the target data; The communication terminal is used to receive data information forwarded by other ground users through the satellite for query by the unmanned machine through the USB interface, and send the data sent by the user through the USB interface to the satellite, and forward it to other ground users through the satellite; An adaptive coding module, used to compensate for the attenuation of information transmission signals, ensuring the effective transmission of data information in the satellite communication system, wherein the adaptive coding module includes a receiver and a transmitter; The output end of the transmitter is connected to the input end of the transmitting antenna, the output end of the transmitting antenna is connected to the input end of the channel, the output end of the channel is connected to the input end of the receiving antenna, the output end of the receiving antenna is connected to the input end of the receiver, and the output end of the receiver is connected to the terminal device.

2. According to claim 1, a high-throughput broadband satellite-based power-specific integrated image transmission terminal is characterized in that: The communication terminal includes: The RF channel unit is mainly equipped with an agile converter and a power amplifier, responsible for transmitting the IQ data received from the baseband through RF and transmitting the data received from the satellite signal after frequency conversion to the baseband signal processing unit; The terminal processing unit is used to control the entire device, collect user data and pass the data block to the signal processing unit, send commands to the RF channel unit and the baseband processing unit to store external interface components, and is responsible for the control of the entire device. When sending user data, it obtains data from the user terminal through the Bluetooth module or the direct USB connection line to complete the communication with the signal processing unit. The terminal processing module can also obtain the decoded user data from the signal processing and send it to the user terminal, and is responsible for completing the power management of the entire device, turning on and off the device, sleeping and waiting, and restarting and resetting; The baseband processing unit completes the physical layer baseband functions, including MAC frame encoding and decoding, addition and de-spreading, modulation and demodulation, anti-interference, pilot acquisition and tracking; The power management unit controls the power switch and power consumption of the entire device, connects to an external DC power supply, supplies power to the entire satellite communication equipment, and implements power filtering and noise suppression functions through hardware circuits.

3. According to claim 1, a high-throughput broadband satellite-based power-specific integrated image transmission terminal is characterized in that: The baseband processing module includes a data preprocessor and a decompression decoder; The data preprocessor receives the data transmitted by the demodulator, completes real-time frame synchronization, descrambling, RS decoding and decryption decoding, and then sends the decoded data to the decompression decoder format analysis unit for processing. After the processing, the data divided by load is distributed to different decompression decoding units or the load data that does not need to be decompressed is directly transmitted to the display device. The data after decompression is transmitted to the back-end display device and connected to the storage array to complete the storage of the original data and the decompressed level 0 data; The decompression decoder mainly performs frame format analysis and decompression decoding processing on the input data, sends the decompressed data to the recording device for recording and transmits it to the display device for display. The device has strong scalability and reconfigurability.

4. According to claim 1, a high-throughput broadband satellite-based power-specific integrated image transmission terminal is characterized in that: The transmitting terminal includes Rx front-end circuit, Tx front-end circuit, mixer, phase-locked loop, filter, ADC, DAC, FPGA and MCU circuit. In the digital circuit part, FPGA and MCU are used to complete the processing of digital signals and the control of various chips and power modules; The FPGA is mainly used to receive ADC data inside the AD9364 and transmit data to the DAC inside the AD9364; The MCU is mainly used to configure and control the FPGA and other modules of the system. At the same time, the FPGA will package the data received by the ADC and send it to the MCU. After the MCU processes it, it transmits it to the external module through the interface.

5. An integrated image transmission method for power-specific use based on high-throughput broadband satellites, characterized in that: An integrated image transmission terminal for power-dedicated use based on a high-throughput broadband satellite as described in any one of claims 1 to 4 is characterized in that the working method of the image transmission terminal comprises the following steps: Step 1: First, the image information in the complex environment needs to be converted into image data, and then the information is fused using image modalities such as RGB images and depth images to encode the image's salient target areas; The image salient target area coding refers to detecting and coding the detection target area in the image, and selecting delayed coding or no coding for the non-salient area according to the interference situation, thereby ensuring the quality of image acquisition; Step 2: De-noise and color correct the collected image data; The denoising process refers to using the DPM diffusion probability model algorithm as an image sharpening model. The DPM forward process gradually adds Gaussian noise to the clear image, and the reverse process performs deep learning operations with a Markov chain structure to denoise the collected image and restore it to a clean image, and to sharpen the blurred image. Step 3: Remotely monitor the transmitted data; The remote monitoring refers to monitoring the entire image during the image transmission process to prevent image data from being disturbed during the transmission process and to avoid mosaics appearing in the image after transmission, thereby preventing any useful information from being obtained. Step 4: Transmit the received image data to the communication terminal; The communication terminal sends the received image to other ground users via a USB interface or Bluetooth, thereby ensuring effective transmission of images in the satellite communication system.

6. The integrated image transmission method for power-specific use based on high-throughput broadband satellite according to claim 5, characterized in that: The working method of the image transmission algorithm comprises the following steps: Step 1: Use image classification labels for weakly supervised explicit detection. It is necessary to convert image classification information labels into pixel-level labels. The input image of the mapping network is an RGB image. In the extraction process, the mapping network is first used to extract the feature map after global average pooling, and then the weights of the classification feature maps are superimposed according to the confidence level, and finally aggregated into a mapping network map. The superposition process formula is as follows: In formula (1), P is the activation map of the input image, is the weight value of the k-th classification feature map of the c-th target, F k is the kth classification feature map. According to the feature map, the prediction category formula can be obtained as follows: In formula (2), Class represents the predicted category, Represents the weight value of the mapping network, b s represents the bias value, g(P) represents the average pooling operation on the mapping network graph; Finally, the generated class activation map has the following analytical expression: The trained mapping images are divided into images with strong saliency and images with pseudo noise according to the amount of noise. This time, the image processing module is used to conduct comprehensive training on the two types of images. The class activation mapping network described above is used as a generator, and the noise network is used as a discriminator. The two networks compete with each other in training. The class activation mapping network generates a more realistic saliency image, while the discriminator determines whether the predicted image is a pseudo-noise image by judging the characteristics of the noise information data. Step 2: During the image data transmission process, when there is a strong electromagnetic signal from the outside world, it is easy to interfere with the signal and cause bit errors. The error correction coding scheme is used to correct the data. At the same time, the traditional error correction code is improved to make it suitable for the image transmission equipment of high-throughput broadband satellites. The low-density parity check code is a small-sized and low-algorithm error correction coding scheme, which is directly deployed in embedded devices. To realize the low-density parity check code LDPC, its matrix needs to be constructed. A check matrix needs to be randomly constructed. The matrix size is 1023*2046. The encoding method uses Gaussian elimination. Assuming that the check matrix is ​​H, the Gaussian elimination formula is as follows: H=[E / L]=[I / P](5) The specific implementation steps are: 1) Perform an upper triangular transformation on H to obtain the matrix L; perform a row transformation on H to obtain the diagonal matrix E; at the same time, convert the diagonal matrix E into a unit matrix to obtain the inverse matrix P; 2) Encode the original information C and perform synchronous grouping. The number of information bits in the grouping is the number of rows in the P matrix. The information is recorded as C i+1 , i is a positive integer, and the check vector formula is as follows: V=C i P(6) Step 3: The algorithm scheme uses compressed sensing to compress the signal according to the characteristics of high-throughput satellite communication transmission, thereby reducing the signal transmission volume. At the same time, the saliency detection algorithm is used to ensure image recognition in the main area, improving the efficiency of image transmission. Finally, LDPC coding technology is used to reduce the impact of channel interference on image transmission, effectively achieving resistance to strong magnetic field interference during image transmission.

7. The integrated image transmission terminal dedicated to power based on high-throughput broadband satellite according to claim 1, characterized in that: It comprises an image transmission terminal device (1), a mounting column (2), a fixing frame (3), a fixing slot (4) and an adjustment slot (5), wherein a mounting mechanism is arranged outside the image transmission terminal device (1); The mounting mechanism comprises a screw rod (601) rotatably mounted between the inner bottom wall of the fixing groove (4) and the adjusting groove (5); a first gear (602) is fixedly mounted on the outer surface of the screw rod (601); a rotating rod (603) having one end penetrating through and extending to the outside of the fixing frame (3) is rotatably mounted on the inner top wall of the adjusting groove (5); a second gear (604) is fixedly mounted on the outer surface of the rotating rod (603); an adjusting block (605) is threadedly connected to the outer surface of the screw rod (601); and a gear (602) is fixedly mounted on the right side of the adjusting block (605). A movable frame (606) is provided, a first clamping plate (607) is fixedly installed on the top of the movable frame (606), a mounting frame (608) is fixedly installed on the inner top wall of the fixed frame (3), a second clamping plate (609) is fixedly installed on the bottom of the mounting frame (608), a limiting plate (610) is fixedly installed on the outer surface of the rotating rod (603), a supporting plate (611) is fixedly installed on the bottom of the fixed frame (3), and a limiting rod (612) with one end penetrating and extending to the outside of the supporting plate (611) is rotatably installed on the right side of the supporting plate (611).

8. The integrated image transmission terminal dedicated to power based on high-throughput broadband satellite according to claim 7, characterized in that: The mounting column (2) is fixedly mounted on the outside of the image transmission terminal device (1), the fixing frame (3) is movably mounted on the outside of the image transmission terminal device (1), the fixing groove (4) is opened inside the fixing frame (3), and the adjustment groove (5) is opened inside the fixing frame (3).

9. The integrated image transmission terminal dedicated to power based on high-throughput broadband satellite according to claim 7, characterized in that: A limiting rod is fixedly installed on the left side of the adjustment block (605), a limiting groove is provided on the left side wall of the inner cavity of the fixing frame (3), and the outer surface of the limiting rod is slidably connected to the inner wall of the limiting groove.

10. The integrated image transmission terminal dedicated to power based on high-throughput broadband satellite according to claim 7, characterized in that: The outer surface of the limiting plate (610) is provided with a plurality of evenly distributed slots, and the size of the limiting rod (612) is adapted to the size of the slots.

Images