Optical fiber splicing control system and method based on FPGA
By adopting an FPGA-based fiber splicing control system in the large-screen splicing system, the problem of high backplane switching bandwidth is solved, stable transmission and system expansion of high-resolution video are achieved, and multi-screen splicing needs are supported.
Patent Information
- Application Number
- CN202411768649.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-04
- Publication Date
- 2025-03-25
- Estimated Expiration
- 2044-12-04
AI Technical Summary
When handling high-resolution videos, the bandwidth requirements of the backplane switching of the existing large-screen splicing system are extremely high, resulting in insufficient performance of the switching chip, increased transmission delay, and difficulty in system expansion, making it difficult to support the multi-screen splicing requirements.
The fiber control system based on FPGA is adopted to collect video data through the fiber transmission module, the fiber switching matrix module performs data switching and information embedding, and the fiber control terminal module is decompressed and merged to reduce transmission broadband and solve the high-broadband problem of backplane switching.
While ensuring the quality of ultra-high-definition video, the transmission stability of high-definition video is improved, and the problems of system expansion difficulties and high bandwidth requirements are solved, and it can support large-scale multi-screen splicing needs.
Smart Images

Figure CN119697331A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of optical fiber transmission technology, and in particular to an optical fiber splicing control system and method based on FPGA. Background Art
[0002] With the continuous advancement of science and technology, the application of ultra-high-definition video has been widely promoted in all walks of life, and ultra-high-definition video has gradually become the mainstream of information display, especially in large-screen display systems in command centers, control rooms, exhibition halls, etc. In these application scenarios, large-screen splicing technology not only needs to support high-resolution image output, but also needs to be able to handle complex video input and display requirements.
[0003] At present, most of the large-screen splicing systems on the market are based on the traditional FPGA centralized processor architecture. This type of system inserts input cards and splicing processing cards into the chassis, uses input cards to collect video signals, and transmits video data to the splicing processing card for splicing and processing through backplane switching, and finally outputs the processing results to the large-screen display device. Although this structure performs well in some lower-resolution video transmissions, the backplane switching has extremely high bandwidth requirements for the system, especially at 4K resolution, the amount of data is exploding, and the switching chip is required to have extremely high transmission capabilities. When facing such huge bandwidth requirements, the existing centralized system often encounters problems such as insufficient switching chip performance, increased transmission delay, and difficulty in system expansion. At the same time, because too many switching channels occupy the resources of the switching chip, the scale of the system is also subject to certain restrictions, making it difficult to support large-scale multi-screen splicing needs. The above problems need to be solved. Summary of the invention
[0004] In order to improve the transmission stability of high-definition video while ensuring the quality of ultra-high-definition video, the present application provides an FPGA-based optical fiber splicing control system and method, which adopts the following technical solutions:
[0005] In a first aspect, the present application provides an FPGA-based optical fiber splicing control system, comprising:
[0006] The optical fiber sending module is used to collect the first video split data output by the front-end interface chip and pre-process the first video split data;
[0007] The optical fiber switching matrix module is used to obtain a plurality of first video split data, perform switching control and information embedding on the first video split data, and obtain second video split data;
[0008] The optical fiber splicing control terminal module is used to obtain a plurality of second video split data, decompress and merge the second video split data, and obtain output video data.
[0009] Preferably, the optical fiber sending module comprises:
[0010] A video acquisition submodule, used for acquiring the first video split data output by the front-end interface chip;
[0011] A compression submodule, used for compressing the first video split data;
[0012] The packetization submodule is used to packetize and transmit the split data of the first video.
[0013] Preferably, the optical fiber switching matrix module includes:
[0014] A switching submodule, used for obtaining the first video split data of the optical fiber sending module and switching the first video split data;
[0015] The FPGA optical fiber board submodule is used to obtain the embedded information, embed the embedded information into the first video split data, and obtain the second video split data;
[0016] The control board is used to receive control data from the control host and control the switching submodule and the FPGA optical fiber board submodule according to the control data.
[0017] Preferably, the optical fiber splicing control terminal module includes:
[0018] An unpacking submodule, used for unpacking the second video split data according to the protocol;
[0019] A decompression submodule, used for decompressing and restoring the unpacked second video split data;
[0020] A video processing submodule, used for adjusting video parameters of the unpacked and decompressed second video split data;
[0021] The video superposition submodule is used to merge a plurality of second video split data to obtain output video data.
[0022] Preferably, the optical fiber sending modules are provided in a plurality of numbers, and the plurality of optical fiber sending modules respectively correspond to a plurality of first video split data output by the acquisition front-end interface chip.
[0023] Preferably, the optical fiber switching matrix module includes a plurality of FPGA optical fiber board submodules, and the switching submodule divides the plurality of first video split data after switching to a plurality of FPGA optical fiber board submodules respectively;
[0024] The optical fiber splicing control terminal module includes several groups of unpacking submodules, decompression submodules and video processing submodules. Each group of unpacking submodules, decompression submodules and video processing submodules inputs the processed second video split data into the video superposition submodule.
[0025] Preferably, at least two optical fiber splicing control terminal modules are provided for simultaneously receiving the second video splitting data output by the multi-channel optical fiber switching matrix.
[0026] In a second aspect, the present application provides an FPGA-based optical fiber splicing control method, which is configured on a control board, including:
[0027] Obtain the status information of the control system and output the status information of the control system to the control host;
[0028] Obtain control data from the control host, including splicing instructions, video overlay instructions, video scaling instructions, and video movement control instructions. Send switching control instructions to the switching submodule based on the control data, and send embedded information to the FPGA fiber optic board submodule based on the control data.
[0029] In a third aspect, the present application provides a device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute the FPGA-based optical fiber splicing control method as described above.
[0030] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, wherein the computer program is configured to execute the FPGA-based optical fiber splicing control method as described above when running.
[0031] In summary, compared with the prior art, the technical solution provided by this application has at least the following beneficial effects:
[0032] The present application collects the first video split data output by the front-end interface chip through the optical fiber sending module, and pre-processes multiple first video split data respectively and transmits them to the optical fiber switching matrix module. After obtaining several first video split data, the optical fiber switching matrix module switches and controls the first video split data, and embeds information into the first video split data to obtain the second video split data that meets the processing and splicing control of the optical fiber splicing control terminal module. The optical fiber splicing control terminal module decompresses and merges the several second video split data output by the optical fiber switching matrix module to obtain output video data. By compressing and reducing the transmission bandwidth, the high bandwidth problem of the backplane switching is solved, and the transmission stability of the high-definition video can be improved while ensuring the ultra-high-definition video quality. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] Figure 1 It is a module schematic diagram of an FPGA-based optical fiber splicing control system described in an embodiment of the present application.
[0034] Figure 2It is a module schematic diagram of the optical fiber sending module described in the embodiment of the present application.
[0035] Figure 3 It is a module schematic diagram of the fiber optic switching matrix module described in an embodiment of the present application.
[0036] Figure 4 It is a module schematic diagram of the optical fiber splicing control terminal module described in the embodiment of the present application. DETAILED DESCRIPTION
[0037] The following combination Figure 1-Figure 4 The present application is described in further detail. The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments and are not intended to be limiting.
[0038] The current splicing control system is usually based on the traditional FPGA centralized processor splicing control system. The input card and the splicing processing card are inserted into the chassis. The input card collects the video and exchanges it to the splicing processing card through the backplane for splicing control processing, and finally outputs it to the large screen for display. This method has very large restrictions on the distance between the large screen and the device. Moreover, with the popularization of ultra-high-definition 4K60 resolution, the bandwidth required for centralized chassis backplane switching is getting larger and larger, and very high requirements are placed on the switching chip. Excessive occupation of the switching channel of the switching chip affects the transmission stability of the high-definition video, and even fails to guarantee the quality of the ultra-high-definition video, resulting in the inability to scale up. In response to this, the present application proposes an FPGA-based optical fiber splicing control system and method.
[0039] Reference Figure 1 The present application relates to an FPGA-based optical fiber splicing control system, which specifically includes:
[0040] The optical fiber sending module is used to collect the first video split data output by the front-end interface chip and pre-process the first video split data;
[0041] The optical fiber switching matrix module is used to obtain a plurality of first video split data, perform switching control and information embedding on the first video split data, and obtain second video split data;
[0042] The optical fiber splicing control terminal module is used to obtain a plurality of second video split data, decompress and merge the second video split data, and obtain output video data.
[0043] Specifically, the present application is provided with an optical fiber transmission module, an optical fiber switching matrix module and an optical fiber splicing control terminal module. The optical fiber transmission module collects the first video split data output by the front-end interface chip. There are several first video split data, which are split according to the optical fiber transmission module. The optical fiber transmission module pre-processes the first video split data and transmits them to the optical fiber switching matrix module. After obtaining several first video split data, the optical fiber switching matrix module switches and controls the first video split data, and embeds information into the first video split data to obtain the second video split data that meets the processing and splicing control of the optical fiber splicing control terminal module. The optical fiber splicing control terminal module decompresses and merges several second video split data output by the optical fiber switching matrix module to obtain output video data. By compressing and reducing the transmission bandwidth, the high bandwidth problem of the backplane exchange is solved. While ensuring the ultra-high-definition video quality, the transmission stability of the high-definition video can be improved, which meets the control and application of large-screen splicing in command centers, control rooms, exhibition halls and other places.
[0044] As one implementation method, the optical fiber transmission module includes:
[0045] A video acquisition submodule, used for acquiring the first video split data output by the front-end interface chip;
[0046] A compression submodule, used for compressing the first video split data;
[0047] The packetization submodule is used to packetize and transmit the split data of the first video.
[0048] Reference Figure 2 Specifically, the optical fiber transmission module of the embodiment of the present application includes a video acquisition submodule, a compression submodule and a packetization submodule, and the order of signal input to output is video acquisition submodule, compression submodule, and packetization submodule. After the optical fiber transmission module acquires the source video, it uses the video compression algorithm DSC to perform 3 times visual lossless compression on the video, and the compressed data is sent to serdes for packetization, and then output to the optical fiber module through the differential pin of serdes to be converted into optical signal transmission.
[0049] Among them, the video acquisition submodule mainly realizes the acquisition of video data from the front-end interface chip, that is, the first video splitting data.
[0050] When the video acquisition submodule acquires the first video split data, the first video split data is transmitted to the compression submodule. The compression submodule is specifically a DSC compression module, which adopts display stream compression technology to achieve less occupied resources. Using it in FPGA can reduce resource consumption to a certain extent. The compression submodule realizes 3 to 4 times visual lossless compression of the video. After compression, the video bandwidth is one third of the original, which greatly reduces the video bandwidth. The bandwidth requirement of the compressed video is low, which reduces the transmission cost, and the display effect can achieve a visual lossless effect to a certain extent. Coupled with the low latency of less than 10 lines, it meets the application requirements of splicing control.
[0051] After the compression submodule compresses the first video split data, the first video split data is transmitted to the packet submodule. The packet submodule is specifically a serdes packet module, which calls the FPGA's high-speed transceiver serdes ip core and uses a custom protocol to packetize and transmit the data. After the first video split data is pre-processed, it is finally transmitted to the optical fiber switching matrix module.
[0052] As one implementation mode, a plurality of optical fiber sending modules are provided, and the plurality of optical fiber sending modules respectively correspond to a plurality of first video split data output by the acquisition front-end interface chip.
[0053] Specifically, the embodiment of the present application has several optical fiber transmission modules, each of which obtains a first video split data, and several first video split data are obtained by splitting a video data. The front-end interface chip performs data splitting according to the number of optical fiber transmission modules, so that the system of the embodiment of the present application can obtain the first video split data corresponding to the number of optical fiber transmission modules. Several optical fiber transmission modules of the embodiment of the present application collect source end video, and after compression, convert it into optical fiber through serdes and output it to the optical fiber switching matrix.
[0054] As one implementation method, the optical fiber switching matrix module includes:
[0055] A switching submodule, used for obtaining the first video split data of the optical fiber sending module and switching the first video split data;
[0056] The FPGA optical fiber board submodule is used to obtain the embedded information, embed the embedded information into the first video split data, and obtain the second video split data;
[0057] The control board is used to receive control data from the control host and control the switching submodule and the FPGA optical fiber board submodule according to the control data.
[0058] Reference Figure 3Specifically, the fiber optic switching matrix of the embodiment of the present application realizes communication with the control host, video switching, and embedding of control information. The fiber optic switching matrix module includes a switching submodule, an FPGA fiber optic board submodule, and a control board.
[0059] Among them, the switching submodule receives the first video splitting data of the optical fiber sending module and switches the video. Through switching, the video transmitted by the optical fiber sending module can be selected to the designated optical fiber board. The FPGA optical fiber board submodule transmits it to the connected control terminal through optical fiber for processing.
[0060] The FPGA fiber optic board submodule, namely the FPGA fiber optic board, realizes the input of the fiber optic link, realizes the conversion of the optical port to the electrical port to connect to the switching chip, and embeds the control information into the fiber optic link according to the host requirements.
[0061] The control board manages and controls the entire splicing control system, and receives the control management data of the control host. The control data includes splicing instructions, video overlay, video scaling, and video movement related control instructions, including the management data and status information of the entire splicing control system. The control board configures the switching chip through the SPI bus to switch the video. The control board communicates with the fiber board through the CAN bus according to the requirements of the control host, transmits the control management data to the fiber board and embeds it into the fiber data stream, and transmits it together with the video data. Through the combined processing of the control board and the switching submodule and the FPGA fiber board submodule, the video data is transmitted to the fiber splicing control terminal module for merging and processing, and finally the complete video data is obtained, which can improve the transmission stability of high-definition video while ensuring the ultra-high-definition video quality.
[0062] As one implementation method, the fiber optic switching matrix module includes a plurality of FPGA fiber optic board sub-modules, and the switching sub-module divides the plurality of first video split data after switching to a plurality of FPGA fiber optic board sub-modules respectively.
[0063] Specifically, the optical fiber switching matrix module of the embodiment of the present application is provided with a plurality of FPGA optical fiber board submodules, specifically a plurality of FPGA optical fiber board submodules corresponding to the number of optical fiber transmission modules. The switching chip, namely the switching submodule, after switching the video data, transmits the video data one by one to the corresponding FPGA optical fiber board submodule, so that the FPGA optical fiber board submodule can further process the corresponding first video split data and embed control information.
[0064] As one implementation method, the optical fiber splicing control terminal module includes:
[0065] An unpacking submodule, used for unpacking the second video split data according to the protocol;
[0066] A decompression submodule, used for decompressing and restoring the unpacked second video split data;
[0067] A video processing submodule, used for adjusting video parameters of the unpacked and decompressed second video split data;
[0068] The video superposition submodule is used to merge a plurality of second video split data to obtain output video data.
[0069] Reference Figure 4 Specifically, the fiber optic splicing control terminal module of the embodiment of the present application simultaneously receives the fiber optic signals from the multi-channel fiber optic switching matrix, converts them into electrical signals and enters the FPGA chip through the serdes interface of the FPGA. The unpacking submodule function module in the FPGA unpacks the data, and then goes to the DSC decompression module, corresponding to the DSC compression module of the fiber optic transmission module. The decompressed data enters the video processing submodule, that is, the VPSS module for video processing. The data processed by each VPSS module flows to the video superposition module for superposition and splicing. The superimposed data is output to the interface chip behind and output to the large screen display. The entire processing process of the embodiment of the present application is implemented in the FPGA chip, does not rely on the input card and the splicing processing card, and can improve the transmission stability of high-definition video while ensuring the quality of ultra-high-definition video.
[0070] Among them, the unpacking submodule is a serdes unpacking module, which calls the FPGA's high-speed transceiver serdes ip core to unpack the data according to the custom protocol and separate the compressed data stream.
[0071] The decompression submodule is a DSC decompression module, which uses display stream compression technology to decompress the video in real time, restore it to video data, and send it to the back-end module for processing.
[0072] The video processing submodule is the VPSS module, which mainly includes video processing modules such as cropping, scaling, caching, and roaming, and then outputs to the subsequent overlay module for processing.
[0073] The video overlay submodule realizes the overlay of multiple videos, performs splicing, and then outputs a new video data stream.
[0074] As one implementation method, the fiber optic splicing control terminal module includes several groups of unpacking submodules, decompression submodules and video processing submodules, and each group of unpacking submodules, decompression submodules and video processing submodules inputs the processed second video split data into the video overlay submodule.
[0075] Specifically, the optical fiber splicing control terminal module of the embodiment of the present application is provided with several groups of unpacking sub-modules, decompression sub-modules and video processing sub-modules. Each group obtains one of the second video split data for processing, and after obtaining the final video split data, it is transmitted to the video overlay module for overlay. After completing the splitting, transmission, processing and merging of the video data, high-quality video data is obtained, thereby improving the transmission stability of high-definition video while ensuring ultra-high-definition video quality, thereby meeting the control and application of large-screen splicing in command centers, control rooms, exhibition halls and other places.
[0076] The embodiment of the present application provides a fiber splicing control method based on FPGA, which is configured on a control board, including:
[0077] Obtain the status information of the control system and output the status information of the control system to the control host;
[0078] Obtain control data from the control host, including splicing instructions, video overlay instructions, video scaling instructions, and video movement control instructions. Send switching control instructions to the switching submodule based on the control data, and send embedded information to the FPGA fiber optic board submodule based on the control data.
[0079] Specifically, the control board mainly manages and controls the entire splicing control system, receives the control management data of the control host, and the control data includes splicing instructions, video overlay, video zoom, video movement related control instructions, and includes the management data and status information of the entire splicing control system. The control board configures the switching chip through the SPI bus to switch the video. The control board communicates with the fiber board through the CAN bus according to the requirements of the control host, transmits the control management data to the fiber board and embeds it into the fiber data stream, and outputs it together with the video data, so that the system can stably transmit high-definition video data.
[0080] An embodiment of the present application provides a device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute the FPGA-based optical fiber splicing control method as described above.
[0081] An embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute the aforementioned FPGA-based optical fiber splicing control method when running.
[0082] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described device and product can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.
[0083] In several embodiments provided in this application, it should be understood that the disclosed methods, systems, devices and program products may be implemented in other ways.
[0084] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0085] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims
1. An optical fiber splicing control system based on FPGA, characterized in that: include: The optical fiber sending module is used to collect the first video split data output by the front-end interface chip and pre-process the first video split data; The optical fiber switching matrix module is used to obtain a plurality of first video split data, perform switching control and information embedding on the first video split data, and obtain second video split data; The optical fiber splicing control terminal module is used to obtain a plurality of second video split data, decompress and merge the second video split data, and obtain output video data.
2. The FPGA-based optical fiber splicing control system according to claim 1, characterized in that: The optical fiber transmission module comprises: A video acquisition submodule, used for acquiring the first video split data output by the front-end interface chip; A compression submodule, used for compressing the first video split data; The packetization submodule is used to packetize and transmit the split data of the first video.
3. The FPGA-based optical fiber splicing control system according to claim 2, characterized in that: The optical fiber switching matrix module comprises: A switching submodule, used for obtaining the first video split data of the optical fiber sending module and switching the first video split data; The FPGA optical fiber board submodule is used to obtain the embedded information, embed the embedded information into the first video split data, and obtain the second video split data; The control board is used to receive control data from the control host and control the switching submodule and the FPGA optical fiber board submodule according to the control data.
4. The FPGA-based optical fiber splicing control system according to claim 3, characterized in that: The optical fiber splicing control terminal module includes: An unpacking submodule, used for unpacking the second video split data according to the protocol; A decompression submodule, used for decompressing and restoring the unpacked second video split data; A video processing submodule, used for adjusting video parameters of the unpacked and decompressed second video split data; The video superposition submodule is used to merge a plurality of second video split data to obtain output video data.
5. The FPGA-based optical fiber splicing control system according to claim 2, characterized in that: The optical fiber sending modules are provided in a plurality of numbers, and the plurality of optical fiber sending modules correspond to and collect a plurality of first video split data output by the front-end interface chip respectively.
6. The FPGA-based optical fiber splicing control system according to claim 4, characterized in that: The optical fiber switching matrix module includes a plurality of FPGA optical fiber board submodules, and the switching submodule divides the plurality of first video split data after switching to a plurality of FPGA optical fiber board submodules respectively; The optical fiber splicing control terminal module includes several groups of unpacking submodules, decompression submodules and video processing submodules. Each group of unpacking submodules, decompression submodules and video processing submodules inputs the processed second video split data into the video superposition submodule.
7. The FPGA-based optical fiber splicing control system according to claim 1, characterized in that: At least two optical fiber splicing control terminal modules are provided, which are used to simultaneously receive the second video splitting data output by the multi-channel optical fiber switching matrix.
8. A fiber splicing control method based on FPGA, characterized in that: The method is configured on a control board, and includes: Obtain the status information of the control system and output the status information of the control system to the control host; Obtain control data from the control host, including splicing instructions, video overlay instructions, video scaling instructions, and video movement control instructions. Send switching control instructions to the switching submodule based on the control data, and send embedded information to the FPGA fiber optic board submodule based on the control data.
9. A device, characterized in that: The optical fiber splicing control method based on FPGA of claim 9 is comprised of a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute the optical fiber splicing control method based on FPGA of claim 9.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program is configured to execute the FPGA-based optical fiber splicing control method of claim 9 when running.
Citation Information
Patent Citations
Digital video matrix
CN102082919A
Light emitting diode (LED) display screen splicing control system and LED display screen
CN102103826A
Video matrix stitching device and switching bottom plate thereof
CN105721795A
Cascaded processor fault processing method, system and device
CN107995529A
Splicing display method and display system
CN115988155A