The invention discloses an infrared video enhancement system based on multi-level guided filtering, and the system comprises an FPGA module and a DSP module. The FPGA module and the DSP module are incommunication connection through an SRIO interface, wherein the FPGA module completes digital single green video data acquisition and transmits the data to the DSP module through the SRIO interface; after video enhancement processing is completed in the DSP module, the video data is transmitted back to the FPGA module through the SRIO interface, and finally the video data is output to an externalscreen display through an LVDS interface of the FPGA module after being converted into a format through the FPGA module. A framework system of the DSP module and the FPGA module is adopted, and the single-frame image processing is efficient. The video transmission is achieved between the DSP module and the FPGA module through an SRIO interface, and the system has the advantages of being high in bandwidth, high in efficiency, high in real-time performance, low in time delay and the like. According to the present invention, the multi-level guided filtering is achieved through box filtering, thecalculation complexity is irrelevant to the size of a window, clear structural characteristics and rich texture details can be reserved, and the system is suitable for occasions with high requirementsfor real-time performance.