A real-time video and serial data wireless transmission system based on ZYNQ-7000 chip

Abstract

The present invention provides a real-time video and serial data wireless transmission system based on a ZYNQ‑7000 chip, the system comprising a real-time video and serial data wireless transmission system (1) and a real-time video and serial data wireless receiving system (2). The transmitting system (1) realizes the fusion of TS code stream and serial data, wireless transmission of TS format data, and gating of radio frequency signals of different frequency bands; the receiving system (2) realizes the reception of radio frequency signals, demodulation of radio frequency signals, and extraction of TS code stream and serial data. The PS end based on the ZYNQ‑7000 chip in the present invention can be equipped with a Linux system, making the management interface more convenient; the PL end is an FPGA, which can receive data in parallel and has a fast data processing speed. The system integrates serial data into the TS video signal, improves the diversity of transmission content, and enhances the confidentiality of transmission; the wireless transmission system of the present invention is small in size, easy to carry, flexible in use, and can be applied to industrial and military video and data wireless transmission.

Description

Technical Field

[0001] The present invention is a real-time video and serial data wireless transmission system based on ZYNQ-7000 chip, which belongs to the field of wireless communication and involves embedded system framework design, wireless radio frequency transmission, TS code stream data fusion and other technologies. The wireless video real-time transmission system has strong flexibility and video transmission stability, and is widely used in the military field, and is also increasingly widely used in civilian applications. Background Art

[0002] With the increasing application of drones in aerial photography, power inspection and other fields, the wireless video transmission system that matches it has also become a crucial link in the drone system. In view of the characteristics of drones such as miniaturization, limited load, and frequent long-distance operations, combined with people's increasing requirements for video quality; the present invention uses the flexibility of wireless communication technology to design a small-sized, light-weight, highly confidential and real-time real-time video and serial port data wireless transmission system.

[0003] The present invention provides a real-time video and serial port data wireless transmission system based on the ZYNQ-7000 chip, which can not only receive videos in various formats, but also convert the received videos in different formats into TS format videos, and merge the received serial port data into a new TS code stream; in addition, running the Linux system in the ZYNQ-7000 chip can facilitate debugging and provide good development capabilities and human-computer interaction functions. Summary of the invention

[0004] The present invention provides a real-time video and serial port data wireless transmission system based on the ZYNQ-7000 chip, which can realize the fusion of TS code stream and serial port data, wireless transmission of TS format video data, and gating of radio frequency signals of different frequency bands; reception of wireless TS format video signals, demodulation of radio frequency signals, and extraction of TS code stream and serial port data.

[0005] The present invention describes a real-time video and serial data wireless transmission system based on the ZYNQ-7000 chip. The connection relationship and functions of the relevant modules in the system are as follows:

[0006] A real-time video and serial port data wireless transmission system based on a ZYNQ-7000 chip is divided into a real-time video and serial port data wireless transmission system (1) and a real-time video and serial port data wireless receiving system (2). The system is characterized in that the system can send and receive serial port data of a host while transmitting video. The specific process is as follows:

[0007] 1. In the real-time video and serial port data wireless transmission system (1), the ZYNQ-7000 module (9) receives the TS code stream output by the compression encoding module (3), and also receives the data input by the serial port module (6) of the host device (5), and processes the received serial port data and the TS code stream to form a pseudo TS code stream; then the pseudo TS code stream is transmitted to the modulation and transmission module (10) through the USB interface for modulation, and then passes through the RF switch selection module (11), the filter module (12), and the amplifier module (13) for RF path selection, filtering and amplification processing, and finally transmitted through the antenna;

[0008] 2. In the real-time video and serial port data wireless receiving system (2), the radio frequency signal received by the antenna is amplified by the low noise amplifier module (14) and filtered out by the filter module (15); the radio frequency signal is then processed into a pseudo TS code stream by the demodulation receiving module (16), and transmitted to the ZYNQ-7000 module (21) through the USB interface for parsing and processing, and the pseudo TS code stream is divided into a video TS stream and serial port data. The video TS stream is transmitted to the decoding and decompression module (22), and the serial port data is sent to the host device (17) through the serial port module (18).

[0009] Furthermore, the compression encoding module (3) and the decoding and decompression module (22) utilize the ZYNQ-7000 module (9, 21) to complete the fusion or analysis of the video data and the serial port data while performing compression and decompression of the video data.

[0010] Furthermore, the drivers of the modulation and transmission module (10) and the demodulation and reception module (16) are both run on the Linux system of Zynq-7000 in a dynamic loading manner; the modulation and transmission module (10) can receive a video signal in TS format or a control signal only through a USB interface, and control the frequency band of the transmission and the bandwidth of the transmission signal.

[0011] A further method of fusing the video TS stream data and the serial port data to form a pseudo TS code stream data is as follows: placing the video TS stream into the FIFO of the ZYNQ-7000 module (9); adding a packet header to the serial port information according to the TS packet format to convert it into TS code stream data, and then placing it into the FIFO as well, thereby inserting the serial port data into the video TS stream. The video TS stream and the serial port data are distinguished by the packet header.

[0012] The present invention has the following advantages:

[0013] 1. The present invention combines serial port data and TS code stream into a pseudo TS stream for transmission, so that serial port data can be transmitted while wirelessly transmitting video data, thereby enhancing the confidentiality of transmission.

[0014] 2. The system uses compression encoding module and decoding decompression module to complete the compression and decompression of video data, while ZYNQ-7000 module completes the fusion of video data and serial port data. The above two steps are processed in parallel to reduce transmission delay.

[0015] 3. The present invention uses ZYNQ-7000 chip to build a real-time video and serial data wireless transmission and reception system. The PS end of the chip can be equipped with Linux system, making the management interface more convenient; the PL end is FPGA, which can receive data in parallel and process data quickly. The system has the characteristics of small size, easy to carry and flexible use. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 It is a structural block diagram of the real-time video and serial port data wireless transmission system based on the ZYNQ-7000 chip of the present invention;

[0017] Figure 2 It is a structural block diagram of the real-time video and serial port data wireless transmission system based on the ZYNQ-7000 chip of the present invention;

[0018] Figure 3 It is a structural block diagram of the real-time video and serial port data wireless receiving system based on the ZYNQ-7000 chip of the present invention;

[0019] Figure 4 It is a hardware connection block diagram of the fusion of TS code stream data and serial port data of the present invention;

[0020] Figure 5 It is a structural block diagram of TS code stream data of the present invention;

[0021] Specific implementation

[0022] The present invention is further described in detail below in conjunction with the embodiments and drawings:

[0023] Figure 1 The present invention is a simplified structural block diagram of a real-time video and serial port data wireless transmission system based on a ZYNQ-7000 chip, which comprises two parts: a real-time video and serial port data wireless transmission system (1) and a real-time video and serial port data wireless reception system (2).

[0024] Figure 2The structure diagram of the real-time video and serial data wireless transmission system based on the ZYNQ-7000 chip is shown. In the application, after the system is powered on, the ZYNQ-7000 module (9) first reads the Linux system startup file from the SD card module (8) to complete the Linux system startup and the driver loading of each module. At this time, the compression coding module (3) reads the firmware program from the flash (4) to complete the initialization of the module; the drivers of the modulation and transmission module (10) and the receiving and demodulation module (16) are dynamically loaded, and their drivers are compiled into dynamically loadable modules. The insmod command can be used to complete on-demand loading and can be uninstalled when not in use, which will not increase the size of the Linux kernel; the ZYNQ-7000 module (9) receives the compression coding module (10) and the receiving and demodulation module (16). The module (3) outputs the TS code stream and also receives the data input from the serial port module (6) by the host device (5), and fuses the received serial port data with the TS code stream to form a pseudo TS code stream; the pseudo TS code stream is then transmitted to the modulation and transmission module (10) through the USB interface. In the Linux system of the ZYNQ-7000 module (9), the API of the modulation and transmission module (10) is called to configure the frequency band and bandwidth of the signal transmission; the signal is passed through the RF switch selection module (11), the filter module (12), and the amplifier module (13) for RF path selection, filtering and amplification, and finally sent through the antenna; the network port module (7) can be used for network communication and data transmission; in addition to being used to transmit data, the serial port module (6) can also be used to debug the system.

[0025] Figure 3 The structure block diagram of a real-time video and serial port data wireless receiving system based on a ZYNQ-7000 chip is shown. The receiving demodulation module (16) is always in a receiving state; the radio frequency signal is received through an antenna, amplified by a low noise amplifier module (14), filtered out by a filter module (15), and processed into a pseudo TS code stream by the receiving demodulation module (16), which is transmitted to the ZYNQ-7000 module (21) through a USB interface. After being processed by the ZYNQ-7000 module (21), the pseudo TS code stream is divided into a video TS stream and serial port data, and the video TS stream is transmitted to a decoding and decompression module (22), and the serial port data is sent to a host device (17) through a serial port. The control interface of each module and the peripheral interface of the system, the connection method and the function are consistent with those of the transmitting system.

[0026] Figure 4The hardware connection block diagram of the fusion of TS code stream data and serial port data is shown. The ZYNQ-7000 module (9) receives the TS code stream output by the compression coding module (3), and also receives the serial port data input by the host device (5) from the serial port module (6), and fuses and encrypts the two data to form a pseudo TS stream. The TS video signal contains an 8-bit data signal DATA[7:0] and a 4-bit control signal. The CLK signal in the control signal is the clock signal of the TS code stream. According to the TS signal transmission protocol, the clock is 27MHz; the VALID signal is the valid signal of the TS code stream, which is used to distinguish whether the length of the TS packet is 188Bytes or 204Bytes; the SYNC signal is a synchronization signal, which keeps all signals synchronized with the clock signal; the FAIL signal is a signal sent by the ZYNQ-7000 module (9) to the compression coding module (3). When an error occurs in the transmission of the TS packet or a packet is lost, the FAIL signal will be triggered. The serial port module (6) in the system uses two signals, the TXD transmission signal and the RXD reception signal, for transmission. The ZYNQ-7000 module (9) merges the received serial port data into the TS code stream data to form a pseudo TS code stream, and transmits it to the modulation and transmission module (10) through the USB differential data lines USB_N and USB_P.

[0027] Figure 5 The structure diagram of TS code stream data is shown. The basic unit of TS stream is a TS packet with a length of 188 bytes. PID is a very important part of TS stream. What is stored in the TS packet is determined by PID. The serial port data and video data can be classified by distinguishing PID. When the PID value is 0x04-0x0F or 0x16-0x1B, the meaning is not clearly defined in the protocol. The present invention can set the PID of the TS packet containing serial port data to the value in advance, and configure the transmission priority of the TS packet containing serial port information to high. If there is too much serial port data transmitted in real time, it is divided into several TS packets for transmission. If it is less than one TS packet, it is filled with 0xFF. The fusion of video data and serial port data is carried out through the FIFO in the ZYNQ-7000 module (9). The video TS stream is written into the FIFO by packet. If serial port data is received, the serial port data is used as the payload and the TS stream header is packaged into TS format. The transmission priority is configured to be high and it is written into the FIFO first, thus completing the data fusion process. TS stream data analysis mainly checks the PID of the TS packet. If the PID is the PID of the agreed serial port data, it will be extracted, removed from the packet header and sent to the serial port controller.

[0028] The present invention realizes wireless transmission of TS format video signals, and makes the system compact and flexible through wireless transmission; integrates serial port data into TS video signals, improves the diversity of transmission content, and enhances the confidentiality of transmission; according to the characteristic that any segment of TS can be independently decoded, the video of any segment intercepted and received is complete. The present invention can be applied to wireless transmission of video and data.

[0029] The invention is characterized by small size, strong expansibility and strong confidentiality.

[0030] The above embodiments are only used to illustrate the technical solution of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, ordinary technicians in the field should understand that the specific implementation methods of the present invention can still be modified or some technical features can be replaced by equivalents without departing from the spirit of the technical solution of the present invention, which should be included in the scope of the technical solution for protection of the present invention.

Claims

1. A real-time video and serial data wireless transmission system based on the ZYNQ-7000 chip, comprising a real-time video and serial data wireless transmission system (1) and a real-time video and serial data wireless receiving system (2), characterized in that While transmitting video, the system can also send and receive serial port data from the host. The specific process is as follows: 1.1 In the real-time video and serial port data wireless transmission system (1), after the system is powered on, the ZYNQ-7000 module (9) first reads the Linux system startup file from the SD card module (8) to complete the Linux system startup and the driver loading of each module. At this time, the compression encoding module (3) reads the firmware program from the flash (4) to complete the module initialization; then the ZYNQ-7000 module (9) receives the TS code stream output by the compression encoding module (3), and also receives the data input from the serial port module (6) of the host device (5), and merges the received serial port data with the TS code stream into a pseudo T S code stream; then transmit the pseudo TS code stream to the modulation and transmission module (10) through the USB interface for modulation and modulation into a radio frequency signal; in the Linux program of the ZYNQ-7000 module (9), the API of the modulation and transmission module (10) is called to configure the frequency band and bandwidth of the radio frequency signal; then the radio frequency path is selected, filtered and amplified by the radio frequency switch selection module (11), the filter module (12) and the amplifier module (13), and finally transmitted through the antenna; the network port module (7) is used for network communication and data transmission; in addition to being used for data transmission, the serial port module (6) is also used for debugging the system; 1.2 In the real-time video and serial port data wireless receiving system (2), the radio frequency signal received by the antenna is amplified by the low noise amplifier module (14) and filtered out by the filter module (15); the radio frequency signal is then demodulated into a pseudo TS code stream by the demodulation receiving module (16), and transmitted to the ZYNQ-7000 module (21) through the USB interface for parsing and processing, and the pseudo TS code stream is divided into a video TS stream and serial port data. The video TS stream and the serial port data are parsed by distinguishing the PID of the TS packet through the packet header. If the PID is the PID of the agreed serial port data, it is extracted and sent to the serial port module after removing the packet header; the video TS stream is transmitted to the decoding and decompression module (22), and the serial port data is sent to the host device (17) through the serial port module (18).

2. According to claim 1, a real-time video and serial data wireless transmission system based on ZYNQ-7000 chip is characterized in that The compression coding module (3) and the decoding and decompression module (22) use the ZYNQ-7000 module (9, 21) to complete the fusion or analysis of the video data and the serial port data while compressing and decompressing the video data. In the process of fusion of the video TS stream and the serial port data, the ZYNQ-7000 module (9) uses the 8-bit data signal DATA[7:0] and the 4-bit control signal to control and receive the signal of the video TS stream. When an error occurs in the transmission of the TS packet or the packet is lost, the ZYNQ-7000 module (9) sends a FAIL signal to the compression coding module (3) to make it retransmit.

3. According to claim 1, a real-time video and serial data wireless transmission system based on ZYNQ-7000 chip is characterized in that The Linux system of ZYNQ-7000 compiles the drivers of the modulation and transmission module (10) and the demodulation and reception module (16) into dynamically loadable modules, and uses the insmod command to complete on-demand loading, which can be unloaded when not in use, thus not increasing the size of the Linux kernel; the modulation and transmission module (10) can receive TS format video signals or receive control signals, as well as control the frequency band of the transmission and the bandwidth of the transmission signal, only through the USB interface.

4. According to claim 1, a real-time video and serial data wireless transmission system based on ZYNQ-7000 chip is characterized in that The method of fusing video TS stream data and serial port data to form pseudo TS code stream data is as follows: the content stored in the TS packet in the TS stream is determined by the PID, and the PID of the TS packet containing the serial port data is set to a value between 0x04-0x0F or 0x16-0x1B by advance agreement, and the transmission priority of the TS packet containing the serial port information is configured to be high. If there is too much serial port data to be transmitted in real time, it is divided into several TS packets for transmission. If it is less than one TS packet, it is filled with 0xFF; the video TS stream is placed in the FIFO of the ZYNQ-7000 module (9) according to the packet. If serial port data is received, the serial port data is used as the payload, and a header is added to the serial port information according to the format of the TS packet to convert it into TS code stream data, and then it is written into the FIFO with priority, thus completing the data fusion process.

Images