Audio and video communication demonstration method under electronic countermeasure condition and demonstration device thereof

Abstract

The invention relates to the field of audio and video communication, and particularly discloses an audio and video communication demonstration method and demonstration device under an electronic countermeasure condition, and the method comprises the following steps: 1, carrying out the coding compression of an original audio and video signal through a perception compression technology, the perception compression technology is combined with a deep learning algorithm, ROI region detection and protection and coding parameter prediction based on content perception; through combination of deep learning, ROI region protection and content awareness coding, on the premise of keeping the visual image quality of human eyes, the 1080P video code rate is compressed from 2Mbps of traditional H.265 to below 400Kbps, the code rate is reduced to 1 / 20 of the original code rate, the channel bandwidth is remarkably saved, and the communication cost is reduced; by adopting adaptive multi-protocol hybrid transmission and forward error correction coding, the audio and video availability can still be maintained when the bidirectional packet loss rate is as high as 70%, the end-to-end delay is reduced to be within 500ms, and the inherent defects of a traditional single protocol are overcome.

Description

Technical Field

[0001] The present invention belongs to the field of audio - video communication, and more specifically, it is an audio - video communication demonstration method and its demonstration device under the condition of electronic countermeasure. Background Art

[0002] Audio - video communication is one of the most common application scenarios in the communication field. Although with the development of communication technology, from wired to wireless, from 2G to the current 5G and even the next - generation 6G, the communication bandwidth and channel rate have been continuously increasing, the consumption demand for massive audio - video data and the capacity of communication infrastructure have always been a pair of contradictory and complementary aspects like a shield and a spear. In future communication scenarios, it is still necessary to comprehensively consider the trade - off between high - quality transmission requirements and high costs. Therefore, on the premise of ensuring communication quality, minimizing the bit rate of source coding and improving the utilization rate of the channel, so that limited channel bandwidth can transmit as much data as possible, is still an eternal goal to be pursued in the foreseeable future.

[0003] On the other hand, the channel bandwidth and frequency of existing communication devices are generally fixed. For example, they are generally divided into satellite channels, short - wave / ultra - short - wave channels, microwave channels, 4G / 5G mobile communication channels, laser communication channels, quantum communication channels, etc. Communication devices are generally bound to specific channels. Different transmission bandwidths require different forms and models of devices, and the communication capacity, communication rate, and communication delay are also different. Software - defined radio technology uses the same device to flexibly adjust the frequency, modulation waveform, and interface protocol, so as to simulate various communication forms.

[0004] Finally, communication is often interfered by background noise and human - implemented interference. The theoretical delay of the channel is not equal to the end - to - end delay. Non - ideal channels will lead to an increase in the packet loss rate and bit error rate, and the communication quality of such non - cooperative channels will decline or even become unavailable. Usually, different - type communication devices are used for redundant backup. For example, when the ultra - short - wave channel is interfered, other devices such as satellite or short - wave communication channels are enabled. How to ensure the reliability of communication in an electromagnetic interference environment in a modern war environment is also an urgent issue that must be solved. Therefore, in teaching experiments, how to intuitively experience the communication effect in an electronic countermeasure environment and display the real - time communication countermeasure process through a demonstration system is a practical need of many universities and colleges.

[0005] Existing systems generally either implement high - definition video coding and compression based on the H.265 standard, or are limited to software - defined radio signal playback, or waveform simulation, or improve the data transmission of the bit error rate through sporadic single technologies such as FEC coding. It is difficult to achieve an efficient communication demonstration of audio - video in a highly adversarial environment in a systematic manner. Summary of the Invention

[0006] To solve the above technical problems, the present invention provides an audio-video communication demonstration method under electronic countermeasure conditions, so as to solve the problem that in the existing technology, the system generally either realizes high-definition video encoding and compression based on the H.265 standard, or is limited to software radio signal playback, or waveform simulation, or improves the data transmission with bit error rate through sporadic single technologies such as FEC encoding, and it is difficult to achieve efficient communication demonstration of audio-video in a systematic strong countermeasure environment.

[0007] An audio-video communication demonstration method under electronic countermeasure conditions includes the following steps:

[0008] Step 1, encoding and compressing the original audio-video signal through perceptual compression technology. Among them, the perceptual compression technology combines deep learning algorithms, ROI region detection and protection, and content-aware encoding parameter prediction, compresses real-time video with a resolution of 1080P and above to a bit rate of less than 400Kbps, and at the same time keeps the visual quality visible to the human eye without obvious deterioration;

[0009] Step 2, transmitting the compressed audio-video data by using anti-weak network communication technology. The anti-weak network communication technology includes:

[0010] Real-time network status perception and bandwidth estimation;

[0011] Adaptive forward error correction coding (FEC) and fast retransmission based on packet loss detection algorithm;

[0012] Multi-protocol hybrid transmission, dynamically selecting UDP and TCP protocols to balance latency and reliability;

[0013] Step 3, simulating the electromagnetic interference environment through software radio technology, specifically including:

[0014] Generating and transmitting co-frequency interference signals by using a software radio client, and controlling the intensity of the interference signals to adjust the bit error rate;

[0015] Realizing dynamic configuration of communication frequency, channel bandwidth and data transmission rate through software radio transceiver equipment;

[0016] Step 4, performing anti-weak network recovery processing on the interfered transmission data at the receiving end, including error correction, packet loss compensation and adaptive decoding, and finally outputting the restored audio-video signal;

[0017] Step 5, adjusting the audio-video encoding parameters, communication protocol parameters and interference parameters in real time through the client interface to intuitively demonstrate the communication effects under different countermeasure conditions.

[0018] Preferably, the compression efficiency of the perceptual compression technology in Step 1 is 30%-50% higher than that of traditional H.265 encoding, and the bit rate is reduced to 1 / 20 of the original encoding under the same picture quality.

[0019] Preferably, the multi-protocol hybrid transmission technology described in step 2 adopts a dynamic weight allocation strategy, and automatically switches the transmission ratio of UDP and TCP protocols according to the network packet loss rate and delay threshold.

[0020] Preferably, the software radio technology described in step 3 supports the simulation and switching of wired communication, mobile cellular networks, shortwave / ultra-shortwave, satellite communication, and laser communication.

[0021] An audio and video communication demonstration device under electronic countermeasure conditions includes:

[0022] A sending end module, including a high-definition audio and video input device, a codec integrating a perception compression algorithm, an anti-weak network communication SDK, and a software radio transmitting unit;

[0023] A receiving end module, including a software radio receiving unit, an anti-weak network recovery processing module, an audio and video decoder, and an output device;

[0024] An interference simulation module, including a software radio interference signal generating unit and a transmitting antenna;

[0025] A control module, used to dynamically configure audio and video coding parameters, communication protocol parameters, and interference parameters through a client interface, and to monitor the network status and communication quality in real time;

[0026] Among them, the sending end module and the receiving end module are connected through an adaptive multi-protocol hybrid transmission link, and the interference simulation module can independently adjust the interference intensity to simulate different electromagnetic countermeasure scenarios.

[0027] Preferably, the anti-weak network communication SDK integrates a real-time bandwidth estimation algorithm, and can maintain the availability of audio and video transmission under the condition of 70% two-way packet loss rate.

[0028] Preferably, the codec supports the dynamic switching of H.264, H.265, and AV1 coding standards, and optimizes the bitrate allocation of the ROI region through a deep learning model.

[0029] Preferably, the software radio transmitting unit and the receiving unit support the bidirectional forwarding of USB interface and network port data, and can adjust the carrier frequency, modulation waveform, and channel bandwidth through a client.

[0030] Preferably, the control module provides a visual interface, which can display the compression bitrate, bit error rate, network delay, and interference intensity parameters in real time, and supports the historical data playback and comparative analysis functions.

[0031] Compared with the prior art, the present invention has the following beneficial effects:

[0032] By combining deep learning, ROI area protection, and content-aware coding, while maintaining the visual quality visible to the human eye, the bitrate of 1080P video is compressed from 2Mbps of traditional H.265 to below 400Kbps, and the bitrate is reduced to 1 / 20 of the original encoding, significantly saving channel bandwidth and reducing communication costs;

[0033] By adopting adaptive multi-protocol hybrid transmission and forward error correction coding, the audio and video availability can still be maintained when the two-way packet loss rate is as high as 70%, and the end-to-end delay is reduced to within 500ms, solving the inherent defects of traditional single protocols;

[0034] By simulating complex electromagnetic interference (such as Gaussian noise, co-channel interference) through software-defined radio technology, and combining error correction (Reed-Solomon decoding) and packet loss compensation (optical flow motion compensation), when the bit error rate is 10-2, the area ratio of picture mosaics < 5%, improving the communication robustness in non-cooperative channels (such as battlefields, weak networks);

[0035] Supports real-time adjustment of encoding parameters (bitrate, resolution), communication protocol ratio (UDP / TCP), and interference intensity through the client interface, intuitively comparing the communication effects under different adversarial conditions, applicable to teaching experiments and training system tests, reducing the cost of real environment simulation;

[0036] Integrates the three major technologies of perceptual compression, software-defined radio, and anti-weak network transmission into a unified system, covering wired, wireless (shortwave / satellite / 5G), and laser communication scenarios, which can serve both educational demonstrations and provide a test platform for the research and development of military / civil anti-jamming communication equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 It is a schematic flowchart of the method of the present invention;

[0038] Figure 2 It is a schematic diagram of the connection relationship of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0039] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative work shall fall within the protection scope of the present invention.

[0040] As Figure 1 shown:

[0041] Embodiment 1:

[0042] Specific implementation process of the audio and video communication demonstration method under electronic countermeasure conditions

[0043] Perceptual Compression Encoding Stage

[0044] Hardware Configuration: A high-definition camera (supporting 1080P / 60Hz) and a microphone are used to collect real-time audio and video signals, which are input into a codec control computer equipped with an NVIDIA GPU (Processor: Intel i7-12700K, Memory: 32GB DDR4).

[0045] Software Implementation:

[0046] The codec client is based on the FFmpeg framework and integrates a deep learning model (such as ResNet-50) for ROI region detection, giving priority to protecting key regions such as faces and moving objects.

[0047] Through a content-aware encoding parameter prediction algorithm (such as dynamic adjustment of QP value based on scene classification), the original video (bitrate 8Mbps, H.265 encoding) is compressed to 400Kbps, and the bitrate is reduced to 1 / 20 of the original encoding, while the PSNR value remains ≥36dB.

[0048] The audio signal is encoded using Opus, and the bitrate is compressed from 128Kbps to 16Kbps.

[0049] Weak Network Resistance Transmission Stage

[0050] Network Simulation: The packet loss rate (0%-70%), latency (50ms-500ms), and bandwidth fluctuation (1Mbps-5Mbps) are simulated in the Linux system through the NetEm tool.

[0051] Technical Implementation:

[0052] Bandwidth Estimation: The Kalman filter algorithm is used to predict the available bandwidth in real time and dynamically adjust the video bitrate (200Kbps-600Kbps).

[0053] Adaptive FEC and Retransmission: When the packet loss rate > 5%, forward error correction coding is enabled (FEC redundant packet ratio 20%); when the packet loss rate > 30%, the fast retransmission mechanism (based on the RTX protocol) is triggered.

[0054] Multi-Protocol Hybrid Transmission: By default, the video stream is transmitted via UDP (accounting for 80%), and the audio stream is transmitted via TCP (accounting for 20%); if the latency exceeds 200ms, it automatically switches to pure TCP transmission.

[0055] Interference Simulation and Dynamic Configuration

[0056] Hardware Configuration: The USRP B210 software radio device is used as the interference source and communication transceiver unit, and signals are transmitted through a directional antenna.

[0057] Interference Generation:

[0058] Inject Gaussian white noise interference in the 2.4 GHz band, with a power range of -20 dBm to 10 dBm, and the bit error rate can be controlled within 10 -3 to 10 -1 .

[0059] Configure the interference waveform (such as single frequency, frequency sweep, pulse interference) through GNU Radio software.

[0060] Parameter Adjustment: The user can modify the video resolution (720P / 1080P), frame rate (15 - 60 fps), interference intensity, and communication frequency (1 MHz - 6 GHz) in real time through the Web interface.

[0061] Receiver Recovery and Output

[0062] Error Correction: Use a Reed - Solomon decoder to correct the bit errors caused by interference, with an error correction ability ≤ 15%.

[0063] Packet Loss Compensation: Fill in the lost video blocks based on the forward and backward frame motion compensation algorithm (such as optical flow method).

[0064] Output Display: The restored video is displayed in real time through a 4K display, with a delay ≤ 500 ms; the audio eliminates interference noise through a noise reduction algorithm (such as WebRTC NS).

[0065] Example 2: Specific Implementation of the Audio - Video Communication Demonstration Device

[0066] System Architecture

[0067] Transmitter Module:

[0068] A high - definition camera (Sony IMX586) and a microphone array (Beamforming technology) are connected to a codec (NVIDIA Jetson AGX Xavier).

[0069] The anti - weak network communication SDK is integrated into a custom RTC framework (optimized based on WebRTC), supporting API - call bandwidth estimation and protocol switching functions.

[0070] The software - defined radio transmitting unit (USRP X310) communicates with the host through a PCIe interface, supporting multi - band switching (shortwave / ultra - shortwave / 5G).

[0071] Receiver Module:

[0072] After the software-defined radio receiving unit (USRP X310) demodulates the signal, the data is restored by the anti-weak network SDK and output to the decoder (accelerated by FFmpeg+TensorRT).

[0073] The display screen (BenQ PD3220U) and the audio system (Bose Companion 20) are used for audio and video playback.

[0074] Interference simulation module:

[0075] The independent control computer (Raspberry Pi 4) runs the interference generation software (GNU Radio), and adjusts the interference intensity through the power amplifier (Mini-Circuits ZHL-16W-43-S+).

[0076] Example of dynamic parameter configuration

[0077] Teaching scenario: Set the interference intensity to -10dBm, the bandwidth limit to 2Mbps, and demonstrate the picture quality comparison between H.265 compression (bit rate 2Mbps) and perceptual compression (bit rate 400Kbps).

[0078] Training scenario: Simulate a satellite channel (delay 500ms, packet loss rate 40%), enable multi-protocol hybrid transmission (UDP: 70%+TCP: 30%), and observe that the video stuttering rate drops from 30% to 8%.

[0079] Performance test data

[0080] Compression efficiency: For 1080P video at the same PSNR, the traditional H.265 bit rate is 2Mbps, and the bit rate of this scheme is 400Kbps (the compression efficiency is increased by 5 times).

[0081] Anti-weak network ability: When the two-way packet loss rate is 70%, the retention rate of video availability (SSIM≥0.85) > 90%.

[0082] Interference adaptability: When the bit error rate is 10 -2 , the proportion of the mosaic area in the picture < 5%.

[0083] In the description of this specification, the description referring to terms such as "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic expressions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in a suitable manner in any one or more embodiments or examples. In addition, without contradiction, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples.

[0084] In the accompanying drawings of the disclosed embodiments of the present invention, only the structures related to the disclosed embodiments are involved, and other structures can refer to the general design. Without conflict, the same embodiment and different embodiments of the present invention can be combined with each other.

[0085] Although the present invention has been described in detail with reference to the foregoing embodiments, for those skilled in the art, they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements for some of the technical features. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. An audio-video communication demonstration method under electronic countermeasure conditions, characterized in that, It includes the following steps: Step 1: Encode and compress the original audio-visual signal through perceptual compression technology. Among them, the perceptual compression technology combines deep learning algorithms, ROI region detection and protection, and content-aware encoding parameter prediction, compressing real-time video with a resolution of 1080P and above to a bitrate below 400Kbps while maintaining no obvious degradation in the visual quality visible to the human eye; Step 2: Transmit the compressed audio-visual data using anti-weak network communication technology, and the anti-weak network communication technology includes: Real-time network status perception and bandwidth estimation; Adaptive forward error correction coding (FEC) and fast retransmission based on packet loss detection algorithm; Multi-protocol hybrid transmission, dynamically selecting UDP and TCP protocols to balance latency and reliability; Step 3: Simulate the electromagnetic interference environment through software-defined radio technology, specifically including: Using a software-defined radio client to generate and transmit co-frequency interference signals, controlling the intensity of the interference signal to adjust the bit error rate; Implementing dynamic configuration of communication frequency, channel bandwidth, and data transmission rate through software-defined radio transceiver equipment; Step 4: Perform anti-weak network recovery processing on the interfered transmission data at the receiving end, including error correction, packet loss compensation, and adaptive decoding, and finally output the restored audio-visual signal; Step 5: Adjust the audio-visual encoding parameters, communication protocol parameters, and interference parameters in real time through the client interface to intuitively demonstrate the communication effects under different confrontation conditions.

2. The audio and video communication demonstration method under the condition of electronic countermeasure according to claim 1, characterized in that, In Step 1, the compression efficiency of the perceptual compression technology is 30%-50% higher than that of traditional H.265 encoding, and the bitrate is reduced to 1 / 20 of the original encoding under the same picture quality.

3. The audio and video communication demonstration method under the condition of electronic countermeasure according to claim 1, characterized in that, In Step 2, the multi-protocol hybrid transmission technology adopts a dynamic weight allocation strategy, automatically switching the transmission ratio of UDP and TCP protocols according to the network packet loss rate and delay threshold.

4. The method for demonstrating audio and video communication under electronic countermeasure conditions according to claim 1, wherein The software-defined radio technology described in Step 3 supports the simulation and switching of wired communication, mobile cellular networks, shortwave / ultra-shortwave, satellite communication, and laser communication.

5. An audio and video communication demonstration device under electronic countermeasure conditions, characterized in that, It includes: A sending end module, including a high-definition audio-visual input device, a codec integrating perceptual compression algorithms, an anti-weak network communication SDK, and a software-defined radio transmitting unit; A receiving end module, including a software-defined radio receiving unit, an anti-weak network recovery processing module, an audio-visual decoder, and an output device; An interference simulation module, including a software-defined radio interference signal generating unit and a transmitting antenna; A control module, used to dynamically configure audio-visual encoding parameters, communication protocol parameters, and interference parameters through the client interface, and to monitor the network status and communication quality in real time; Among them, the sending end module and the receiving end module are connected through an adaptive multi-protocol hybrid transmission link, and the interference simulation module can independently adjust the interference intensity to simulate different electromagnetic confrontation scenarios.

6. The audio and video communication demonstration device under electronic countermeasure conditions according to claim 5, characterized in that, The anti-weak network communication SDK integrates a real-time bandwidth estimation algorithm, and can maintain the availability of audio-visual transmission under the condition of 70% two-way packet loss rate.

7. The audio and video communication demonstration device under the condition of electronic countermeasure according to claim 5, characterized in that, The codec supports dynamic switching of H.264, H.265, and AV1 encoding standards, and optimizes the bitrate allocation of the ROI region through a deep learning model.

8. The audio and video communication demonstration device under the condition of electronic countermeasure according to claim 5, characterized in that, The software radio transmitting unit and receiving unit support bidirectional forwarding of USB interface and network interface data, and the carrier frequency, modulation waveform and channel bandwidth can be adjusted through the client.

9. The audio and video communication demonstration device under the condition of electronic countermeasure according to claim 5, characterized in that The control module provides a visual interface, which can display parameters such as compression code rate, bit error rate, network delay and interference intensity in real time, and supports functions of historical data playback and comparative analysis.

Images