Method of ultra-high-definition IP multimode gateway system based on x86 architecture ST2110 standard

Abstract

The invention provides a method of an ultra-high-definition IP multimode gateway system based on an x86 architecture ST2110 standard, and relates to the technical field of broadcast television and professional audio and video transmission. By configuring ST 2110 IP stream input and output parameters, bidirectional conversion between SDI signals and video, audio and auxiliary data IP streams is realized. According to the method, separation, packaging and parameter matching are carried out on the SDI data, audio and video time sequence synchronization is carried out, and then output is carried out, so that the flexibility and stability of media transmission and the multiplexing capability of existing IT infrastructures are effectively improved.

Description

Technical Field

[0001] This invention relates to the fields of broadcast television and professional audio and video transmission technology, and in particular to a method for an ultra-high-definition IP multi-mode gateway system based on the x86 architecture ST2110 standard. Background Technology

[0002] Traditional broadcast and media production environments typically rely on dedicated SDI (Serial Digital Interface) infrastructure, which performs well in terms of reliability and signal quality but has limitations in flexibility, scalability, and cost-effectiveness. With the increase in video resolution (such as 4K and 8K) and the maturity of IP (Internet Protocol) technology, the media industry has begun to seek more flexible, economical solutions that can leverage existing IT infrastructure. The SMPTE ST 2110 standard suite, developed by the Society of Motion Picture and Television Engineers (SMPTE), is a set of standards designed to define a new IP-based real-time media delivery framework for the professional broadcast and media industry. Development of this standard began in 2016, with its primary goal being to address the limitations of traditional SDI-based video and audio signal transmission systems. The introduction of the SMPTE ST 2110 standard marks a significant shift in the broadcast television industry from traditional SDI infrastructure to IP-based media delivery. This shift not only improves the efficiency and flexibility of media production but also reduces operating costs, promoting the digital transformation of the media industry.

[0003] The ST 2110 gateway is a key device that emerged in this context, its core task being to achieve bidirectional conversion between traditional SDI interfaces and IP-based ST 2110 streams. SDI interfaces transmit encapsulated audio, video, and auxiliary data composite signals over coaxial cables, bundling video, audio, and auxiliary data into a single serial stream. This transmission method makes it difficult to flexibly allocate media elements; for example, in broadcast program production, switchers only process video signals, and mixing consoles only process audio signals. Furthermore, an SDI source can typically only be used by one SDI receiver, often requiring additional SDI distributors and SDI matrix devices to allow multiple devices to use a single SDI source simultaneously. IP-based ST 2110 streams, on the other hand, use a separate transmission method, transmitting video, audio, and auxiliary data as independent IP streams. Each stream uses an independent multicast IP address, which receivers can subscribe to on demand. The multicast method also allows the sender to send data only once, while multiple receivers can receive it simultaneously, making media data transmission between devices more efficient and flexible.

[0004] Against this backdrop, existing ST 2110 gateways and their implementations still have significant shortcomings. On the one hand, many existing ST 2110 gateway devices employ dedicated hardware architectures or closed system designs, exhibiting strong dependence on hardware platforms and interface types. This results in high deployment and expansion costs, making it difficult to fully utilize general-purpose x86 servers and existing IT network resources, thus limiting the system's flexible configuration and scalability. On the other hand, existing technologies for the conversion process between SDI and ST 2110 streams primarily focus on basic encapsulation and decapsulation functions. They lack unified and configurable processing mechanisms for parameter configuration, data consistency verification, and audio / video timing synchronization control of video, audio, and auxiliary data during the conversion process. This can easily lead to timing drift, parameter mismatch, or data loss in scenarios involving multi-stream concurrency, switching between different signal formats, or complex production environments, affecting system stability and reliability. Therefore, there is an urgent need for a gateway method implemented on a general-purpose computing platform that can provide highly reliable, configurable, and consistent processing of SDI and ST 2110 streams to overcome the shortcomings of existing technologies. Summary of the Invention

[0005] To overcome the shortcomings of existing technologies, the purpose of this invention is to provide a method for an ultra-high-definition IP multi-mode gateway system based on the ST2110 standard of x86 architecture. By implementing bidirectional conversion between SDI and IP media streams that conform to the ST 2110 standard on a general x86 architecture, the system's reusability of existing IT infrastructure and overall deployment flexibility are improved.

[0006] To achieve the above objectives, the present invention provides the following solution: A method for an ultra-high-definition IP multimode gateway system based on the x86 architecture ST2110 standard includes: Select the interface number and signal type for the SDI input; Configure the parameters for the output and input of the ST 2110 IP stream; the parameters for configuring the output and input of the ST 2110 IP stream include the multicast IP address, port number, and RTP Payload Type of the video data IP stream, audio data IP stream, and auxiliary data IP stream, as well as the audio bit width; According to the signal format of the SDI input, SDI data is received from the SDI interface corresponding to the interface number of the SDI input, and the SDI data is separated into video data, audio data and auxiliary data. The audio data is converted into audio data with a bit width corresponding to the audio bit width. The video data, the converted audio data, and the auxiliary data are encapsulated into IP data packets that conform to the ST 2110 standard definition. The IP address, port number, and RTP Payload Type fields in the IP data packets are set to the multicast IP address, port number, and RTP Payload Type of the corresponding IP stream in the parameters of the ST 2110 IP stream output according to the parameters of the ST 2110 IP stream output. The IP data packets are then sent to the network switch via the network card. Select the interface number and signal type for the SDI output; The network switch receives IP data packets corresponding to the parameters input to the ST 2110 IP stream. It checks whether the RTP Payload Type field in the IP data packet is equal to the RTP Payload Type of the corresponding IP stream in the parameters input to the ST 2110 IP stream. If they are not equal, the corresponding IP data packet is discarded. If they are equal, the IP data packets of the video data IP stream are converted into SDI format video frames, the audio data in the IP data packets of the audio data IP stream are converted into SDI format audio frames using the audio bit width, and the IP data packets of the auxiliary data IP stream are converted into SDI format auxiliary data. After performing an audio-video timing synchronization process on the SDI format video frame and the SDI format audio frame, the SDI format video frame, the SDI format audio frame and the SDI format auxiliary data are assembled according to the signal format of the SDI output, and sent from the SDI interface corresponding to the interface number of the SDI output.

[0007] Preferably, the SDI data is separated into video data, audio data, and auxiliary data, including: For each SDI video frame received, the SDI data is separated once, and the separated video data, audio data, and auxiliary data are used as encapsulation input data respectively.

[0008] Preferably, the parameters of the ST 2110 IP stream output and the parameters of the ST 2110 IP stream input are remotely configured via Web access.

[0009] Preferably, the IP address, port number, and RTP Payload Type fields in the IP datagram are set to the multicast IP address, port number, and RTP Payload Type of the corresponding IP stream in the parameters output by the ST 2110 IP stream, according to the parameters output by the ST 2110 IP stream, including: Set the IP address, port number, and RTP Payload Type fields in the IP data packet of the video data IP stream to the multicast IP address, port number, and RTP Payload Type of the video data IP stream, respectively. Set the IP address, port number, and RTP Payload Type fields in the IP data packet of the audio data IP stream to the multicast IP address, port number, and RTP Payload Type of the audio data IP stream, respectively. The IP address, port number, and RTP Payload Type fields in the IP datagram of the auxiliary data IP stream are respectively set to the multicast IP address, port number, and RTP Payload Type of the auxiliary data IP stream.

[0010] Preferably, sending the IP data packets to the network switch via the network card includes: The program controls the network card to send the IP data packets, so that the IP data packets reach the network switch.

[0011] Preferably, receiving IP data packets from the network switch corresponding to the parameters input to the ST 2110 IP stream includes: The corresponding IP data packets are received from the multicast IP addresses and port numbers of the video data IP stream, the audio data IP stream, and the auxiliary data IP stream, respectively.

[0012] Preferably, the audio-video timing synchronization process for the SDI format video frames and the SDI format audio frames includes: Based on audio data sample count The number of samples in the current audio frame is calculated based on the audio data packet size, audio bit width, and number of channels. Initialize the number of output audio frames. And set the audio sampling rate 48000, and audio-video synchronization delay time Video frame rate; When the SDI format audio frame is received, the current operating system time is recorded as follows. ; When the SDI format audio frame is the first audio frame, set the first frame time. ; Otherwise, calculate the expected output time.

[0013] when The output process waits. Then output the current audio frame, and execute the following after output. .

[0014] Preferably, the interface number and signal type of the SDI input are selected, including: Select the interface number of the SDI input from among multiple SDI interfaces, and determine the SDI interface corresponding to the interface number of the SDI input as the SDI interface for receiving the SDI data. The format of the received SDI data is determined according to the signal standard.

[0015] The present invention discloses the following technical effects: This invention breaks away from the reliance on dedicated hardware platforms and closed devices in existing technologies by implementing an ultra-high-definition IP multimode gateway method compliant with the ST 2110 standard on an x86 general computing architecture. This enables the conversion between SDI and IP media transmission to be deployed in a general server environment, making full use of existing IT infrastructure resources. As a result, while ensuring broadcast-level reliability, the system's deployment flexibility and scalability are significantly improved, and the overall construction and maintenance costs are reduced.

[0016] This invention explicitly introduces a unified configuration mechanism for the output and input parameters of the ST 2110 IP stream at the method level, and sets multicast IP addresses, port numbers, and RTP payload types for video data IP streams, audio data IP streams, and auxiliary data IP streams respectively. At the same time, it introduces audio bit width parameters throughout the encapsulation and decapsulation process of audio data, ensuring strict consistency between SDI and ST 2110 streams at the parameter level from the source, effectively avoiding data loss or decoding abnormalities caused by parameter mismatch in the prior art.

[0017] This invention separates and processes the video, audio, and auxiliary data in the SDI composite signal, and encapsulates them into independent IP data packets conforming to the ST 2110 standard for multicast transmission. This enables various media elements to be subscribed to and processed independently on demand in the IP network, overcoming the technical defects of traditional SDI's "bundled transmission and difficulty in flexible allocation". It significantly improves the flexibility of signal scheduling, resource sharing, and concurrent access of multiple devices in the media production system.

[0018] This invention introduces an RTP Payload Type verification and audio / video timing synchronization mechanism during the IP-to-SDI output process. While ensuring that only matching IP data packets are converted and output, it effectively suppresses timing drift problems in complex scenarios such as multi-stream concurrency and signal format switching by performing audio / video timing synchronization on SDI format video frames and audio frames. This improves the stability of system operation and the reliability of output signals, thereby better meeting the practical application needs of ultra-high-definition broadcasting and professional media production. Attached Figure Description

[0019] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0020] Figure 1 A flowchart of the method provided in an embodiment of the present invention; Figure 2 This is a schematic diagram of the structure of an ultra-high-definition IP multimode gateway system based on the x86 architecture ST2110 standard provided in an embodiment of the present invention; Figure 3 A flowchart illustrating an ultra-high-definition IP multimode gateway system based on the x86 architecture ST2110 standard provided in an embodiment of the present invention; Figure 4 A flowchart of the audio and video timing synchronization process algorithm of the SDI output transmission module provided in this embodiment of the invention. Detailed Implementation

[0021] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0022] The purpose of this invention is to provide a method for an ultra-high-definition IP multi-mode gateway system based on the x86 architecture ST2110 standard. By uniformly configuring media stream parameters, independently encapsulating and transmitting them, and processing audio and video timing synchronization, the stability and reliability of media data transmission and conversion processes are enhanced.

[0023] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0024] Figure 1 The method flowchart provided in the embodiments of the present invention is as follows: Figure 1 As shown, this invention provides a method for an ultra-high-definition IP multi-mode gateway system based on the x86 architecture ST2110 standard, comprising: Step 100: Select the interface number and signal type for the SDI input; Step 200: Configure the parameters for the ST 2110 IP stream output and the ST 2110 IP stream input; the parameters for configuring the ST 2110 IP stream output and the ST 2110 IP stream input include the multicast IP address, port number, and RTP Payload Type for the video data IP stream, audio data IP stream, and auxiliary data IP stream, as well as the audio bit width; Step 300: Receive SDI data from the SDI interface corresponding to the SDI input interface number according to the SDI input signal format, and separate the SDI data into video data, audio data, and auxiliary data; Step 400: Convert the audio data into audio data with a bit width corresponding to the audio bit width. Encapsulate the video data, converted audio data, and auxiliary data into IP data packets that conform to the ST 2110 standard definition. Set the IP address, port number, and RTP Payload Type fields in the IP data packets according to the parameters output by the ST 2110 IP stream to the multicast IP address, port number, and RTP Payload Type of the corresponding IP stream in the parameters output by the ST 2110 IP stream. Then send the IP data packets to the network switch via the network card. Step 500: Select the interface number and signal type for SDI output; Step 600: Receive IP data packets corresponding to the parameters input to the ST 2110 IP stream from the network switch. Check if the RTP Payload Type field in the IP data packet is equal to the RTP Payload Type of the corresponding IP stream in the parameters input to the ST 2110 IP stream. If they are not equal, discard the corresponding IP data packet. If they are equal, convert the IP data packets of the video data IP stream into SDI format video frames, convert the audio data in the IP data packets of the audio data IP stream into SDI format audio frames with audio bit width, and convert the IP data packets of the auxiliary data IP stream into SDI format auxiliary data. Step 700: After performing audio and video timing synchronization on the SDI format video frame and the SDI format audio frame, assemble the SDI format video frame, SDI format audio frame and SDI format auxiliary data according to the signal format of the SDI output, and send them from the SDI interface corresponding to the interface number of the SDI output.

[0025] like Figure 2 As shown, the following modules are included: SDI input to ST 2110 IP stream output user configuration module 1, SDI input receiving module 2, ST2110 IP stream output module 3, ST 2110 IP stream input to SDI output user configuration module 4, ST 2110 IP stream input module 5, SDI output sending module 6, SDI board 7, and network switch 8.

[0026] The SDI input to ST 2110 IP stream output user configuration module 1 configures the SDI input receiving module 2. The SDI input receiving module 2 transmits the SDI video data, audio data, and auxiliary data received from the SDI board 7 to the ST 2110 IP stream output module 3. The ST 2110 IP stream output module 3 then sends the converted IP data packets to the network switch 8. The ST 2110 IP stream input to SDI output user configuration module 4 configures the ST 2110 IP stream input module 5. The ST 2110 IP stream input module 5 converts the IP data packets received from the network switch 8 into SDI video data, audio data, and auxiliary data, which are then transmitted to the SDI output sending module 6. The SDI output sending module 6 sends the SDI video frames to the SDI board 7.

[0027] like Figure 3 As shown, the method of using the system in this embodiment includes the following steps: ① On the user interface of the SDI input to ST 2110 IP stream output user configuration module, select the interface number of the SDI input. This number uniquely corresponds to the interface of the SDI board on the computer, and this interface will be used as the receiving interface of the SDI input.

[0028] ② Select a signal format, which is the format of the video signal input by SDI.

[0029] ③ Fill in the parameters for the ST 2110 IP stream output, including the multicast IP address, port number, RTP Payload Type for the video data IP stream, the multicast IP address, port number, RTP Payload Type, and audio bit width for the audio data IP stream, and the multicast IP address, port number, and RTP Payload Type for the auxiliary data IP stream.

[0030] ④ Based on the selected format in ②, the system's SDI input receiving module uses the driver of the SDI board to receive SDI data of the corresponding format from the SDI interface selected in ①. For each SDI video frame received, the video data, audio data, and auxiliary data of the SDI video frame are separated, and the separated data is passed to the system's ST 2110 IP stream output module.

[0031] ⑤ The ST 2110 IP stream output module converts the received SDI video data into IP data packets that conform to the ST 2110 standard definition. After setting the IP address, port number, and RTP Payload Type fields in the IP data packets to the IP address, port number, and RTP Payload Type of the video data IP stream filled in ③, the module sends the IP data packets through the network card controlled by the program. Finally, the IP data packets reach the network switch.

[0032] ⑥The ST 2110 IP stream output module converts the received SDI audio data into audio data with the bit width filled in ③, and then converts it into IP data packets that conform to the ST 2110 standard definition. After setting the IP address, port number, and RTP Payload Type fields in the IP data packets to the IP address, port number, and RTP Payload Type of the audio data IP stream filled in ③, the module controls the network card to send the IP data packets, and finally the IP data packets reach the network switch.

[0033] ⑦ The ST 2110 IP stream output module converts the received SDI auxiliary data into IP data packets that conform to the ST 2110 standard definition. After setting the IP address, port number, and RTP Payload Type fields in the IP data packets to the IP address, port number, and RTP Payload Type of the auxiliary data IP stream filled in ③, it controls the network card to send IP data packets, and finally the IP data packets reach the network switch.

[0034] ⑧ On the user interface of the ST 2110 IP stream input to SDI output user configuration module, select the interface number for SDI output. This number uniquely corresponds to the interface of the SDI board on the computer, and this interface will be used as the sending interface for SDI output.

[0035] 9. Select a signal format, which is the format of the video signal output by SDI.

[0036] ⑩ Enter the parameters for the ST 2110 IP stream input, including the multicast IP address, port number, RTP Payload Type for the video data IP stream, the multicast IP address, port number, RTP Payload Type, and audio bit width for the audio data IP stream, and the multicast IP address, port number, and RTP Payload Type for the auxiliary data IP stream.

[0037] ⑪ST 2110 IP stream input module controls the network card to receive IP data packets containing the multicast IP address and port number of the video data IP stream filled in ⑩ from the network switch. It checks whether the value of the RTP Payload Type field in the IP data packet is equal to the RTP Payload Type field of the video data IP stream filled in ⑩. If they are equal, the video data in the IP data packet is converted into an SDI format video frame, and then the SDI video frame is passed to the system's SDI output sending module. If the RTP Payload Type field is not equal, the IP data packet is discarded.

[0038] ⑫ST 2110 IP stream input module controls the network card to receive IP data packets containing the multicast IP address and port number of the audio data IP stream filled in ⑩ from the network switch. It checks whether the value of the RTP Payload Type field in the IP data packet is equal to the RTP Payload Type field of the audio data IP stream filled in ⑩. If they are equal, the audio data in the IP data packet is converted into an SDI format audio frame with the bit width of the audio data IP stream filled in ⑩, and then the SDI audio frame is passed to the system's SDI output sending module. If the RTP Payload Type field is not equal, the IP data packet is discarded.

[0039] ⑬ST 2110 IP Stream Input Module controls the network card to receive IP datagrams containing the multicast IP address and port number of the auxiliary data IP stream filled in ⑩ from the network switch. It checks whether the value of the RTP Payload Type field in the IP datagram is equal to the RTP Payload Type field of the auxiliary data IP stream filled in ⑩. If they are equal, the auxiliary data in the IP datagram is converted into SDI format auxiliary data, and then the SDI auxiliary data is passed to the system's SDI output sending module. If the RTP Payload Type field is not equal, the IP datagram is discarded.

[0040] ⑭ The SDI output transmission module receives SDI video frames, SDI audio frames, and SDI auxiliary data from the ST 2110 IP stream input module. After performing an audio-video timing synchronization process on the SDI video frames and SDI audio frames, it uses the driver of the SDI board to assemble the video frames, audio frames, and auxiliary data according to the standard selected in ⑨ and sends them from the SDI interface selected in ⑧.

[0041] Furthermore, such as Figure 4 As shown, the specific algorithm for audio and video timing synchronization in process ⑭ is as follows: The number of audio data samples N_samples in an audio frame = audio data packet size / audio bit width / number of channels; The number of audio frames output is n_frame = 0; The audio sampling rate is N_sample_rate = 48000; Audio-video synchronization delay time T_delay = 1 / video frame rate; I. When the SDI output transmitting module receives an SDI audio frame, record the current operating system time as T_a.

[0042] II. If the currently received SDI audio frame is the first audio frame received by the SDI output transmitting module, then the first frame time T_first = T_a. Then jump to execute VI.

[0043] III. Otherwise, calculate the expected output time T_b = T_first + (n_frame * N_samples / N_sample_rate) + T_delay for the current audio frame.

[0044] IV. Compare T_a and T_b. If T_b <= T_a, then jump to execute VI.

[0045] V. Otherwise, make the current output process wait for T_b - T_a seconds.

[0046] VI. Output the current audio frame, n_frame = n_frame + 1.

[0047] As an example, this invention can further introduce collaborative scheduling optimization at the CPU / GPU, network DMA, and cache levels: In the SDI↔IP bidirectional conversion link, the "receive-decapsulation / capsulation-bit width conversion-transmission" process is divided into several parallel processing segments. The estimated completion time of each segment on the CPU core, GPU queue, and DMA channel is calculated. Under the constraints of end-to-end latency and cache occupancy, the optimal resource mapping is selected, ensuring that high-throughput data movement follows DMA zero-copy paths as much as possible, and that computationally intensive segments are concentrated on the GPU or a fixed CPU core, thereby reducing the latency tail caused by cache jitter and context switching. The scheduling selection can be expressed using the following latency target:

[0048] in, The worst-case end-to-end completion latency for three types of services; These represent video data, audio data, and auxiliary data, respectively. The time consumed in receiving the IP datagram or SD1 data; The scheduling overhead of mapping the data to CPU / GPU execution queues and DMA channels; The computation time for encapsulation / decapsulation, bit width conversion and timing processing; The time taken to complete data transfer or zero-copy forwarding via DMA; The time taken to send to the network switch or to the SDI interface; This refers to the number of bytes occupied by this service in the cache / circular buffer; The maximum allowed total cache budget.

[0049] Furthermore, this invention can also independently develop an algorithm for fine-tuning the timing of each channel in IP / SDI bidirectional conversion: a linear clock model of "arrival time - media time" is established for video, audio, and auxiliary data respectively; the fixed offset and drift of each channel relative to the master clock are estimated online; and the media time of each channel is uniformly mapped to the same output time base before entering the audio and video timing synchronization process, thereby maintaining cross-channel consistency even with multi-stream concurrency and changes in link load. The following correction mapping can be used:

[0050] in, For the first Class Data The original media time of each unit (video frame / audio frame / auxiliary data unit) or the time converted from RTP timestamp; The corrected media timing; For channel The drift coefficient relative to the master clock; For channel A fixed offset relative to the master clock; For the selected reference channel (e.g., video channel); The calibration media timing for the reference channel; For channel The relative time after alignment with the reference channel is used to drive the subsequent assembly and transmission timing.

[0051] This invention can also design an adaptive recovery / reconstruction mechanism for jitter, packet loss, and PT mismatch in ST 2110 transmission: The receiver maintains an ordered, top-down RTP sequence and timestamp consistency check. If a PT mismatch is detected, a drop and fast resubscription strategy is triggered; if increased jitter is detected, the playback buffer is adaptively expanded; if packet loss is detected, without introducing a large amount of manual weighting, least-squares reconstruction based on "neighborhood consistency constraints" is used to generate approximate media data for missing units (interpolation of intra-frame blocks / lines for video, and interpolation of sample segments for audio), ensuring the continuity of the reconstructed media time. This can be expressed using the following buffer adaptation and reconstruction:

[0052] in, For the first The playback buffer depth obtained from the next update (in packets or frames); This refers to the jitter increment (non-negative deviation relative to the target interval) obtained statistically based on the arrival interval. The nominal interval of a media unit (determined by frame rate or audio packet period); For the first The reconstructed vector of missing media units; The observation vector is extracted from adjacent received media units (e.g., the boundary of adjacent frames, the endpoint of adjacent audio segments); The linear relation matrix, composed of "adjacent consistency constraints," is used to reconstruct the vectors to be reconstructed. Mapped to the observation domain; It is a 2-norm; This is the floor function.

[0053] The beneficial effects of this invention are as follows: (1) Strong compatibility: Based on the general computing advantages of x86 architecture, it is compatible with ST2110 series standards, supports multi-mode access and interoperability of ultra-high-definition signals through SDI boards, and is suitable for diverse scenarios such as IP studios, remote production, and high-definition monitoring. (2) Flexible expansion: It adopts a modular design and PCIe 4.0 expansion interface to support flexible upgrades and expansions of functional modules. When faced with new protocols and higher resolution signal processing requirements, there is no need to replace the entire hardware, reducing upgrade costs.

[0054] (3) Convenient management: The system's input configuration module and output configuration module can be remotely configured via the Web, which facilitates system maintenance and improves the management efficiency of the equipment.

[0055] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other.

[0056] This document uses specific examples to illustrate the principles and implementation methods of the present invention. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of the present invention. Furthermore, those skilled in the art will recognize that, based on the ideas of the present invention, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A method for an ultra-high-definition IP multi-mode gateway system based on the x86 architecture ST2110 standard, characterized in that, include: Select the interface number and signal type for the SDI input; Configure the parameters for the output and input of the ST 2110 IP stream; the parameters for configuring the output and input of the ST 2110 IP stream include the multicast IP address, port number, and RTP Payload Type of the video data IP stream, audio data IP stream, and auxiliary data IP stream, as well as the audio bit width; According to the signal format of the SDI input, SDI data is received from the SDI interface corresponding to the interface number of the SDI input, and the SDI data is separated into video data, audio data and auxiliary data. The audio data is converted into audio data with a bit width corresponding to the audio bit width. The video data, the converted audio data, and the auxiliary data are encapsulated into IP data packets that conform to the ST 2110 standard definition. The IP address, port number, and RTP PayloadType fields in the IP data packets are set to the multicast IP address, port number, and RTP Payload Type of the corresponding IP stream in the parameters of the ST 2110 IP stream output according to the parameters of the ST 2110 IP stream output. The IP data packets are then sent to the network switch via the network card. Select the interface number and signal type for the SDI output; The network switch receives IP data packets corresponding to the parameters input to the ST 2110 IP stream, and checks whether the RTP Payload Type field in the IP data packet is equal to the RTP Payload Type of the corresponding IP stream in the parameters input to the ST 2110 IP stream; if they are not equal, the corresponding IP data packet is discarded. If they are equal, the IP data packets of the video data IP stream are converted into video frames in SDI format, the audio data in the IP data packets of the audio data IP stream are converted into audio frames in SDI format with the audio bit width, and the IP data packets of the auxiliary data IP stream are converted into auxiliary data in SDI format. After performing an audio-video timing synchronization process on the SDI format video frame and the SDI format audio frame, the SDI format video frame, the SDI format audio frame and the SDI format auxiliary data are assembled according to the signal format of the SDI output, and sent from the SDI interface corresponding to the interface number of the SDI output.

2. The method of the ultra-high-definition IP multi-mode gateway system based on the x86 architecture ST2110 standard according to claim 1, characterized in that, The SDI data is separated into video data, audio data, and auxiliary data, including: For each SDI video frame received, the SDI data is separated once, and the separated video data, audio data, and auxiliary data are used as encapsulation input data respectively.

3. The method of the ultra-high-definition IP multi-mode gateway system based on the x86 architecture ST2110 standard according to claim 1, characterized in that, The parameters of the ST 2110 IP stream output and input can be remotely configured via Web access.

4. The method of the ultra-high-definition IP multi-mode gateway system based on the x86 architecture ST2110 standard according to claim 1, characterized in that, According to the parameters output by the ST 2110 IP stream, the IP address, port number, and RTP Payload Type fields in the IP datagram are respectively set to the multicast IP address, port number, and RTP Payload Type of the corresponding IP stream in the parameters output by the ST 2110 IP stream, including: Set the IP address, port number, and RTP Payload Type fields in the IP data packet of the video data IP stream to the multicast IP address, port number, and RTP Payload Type of the video data IP stream, respectively. Set the IP address, port number, and RTP Payload Type fields in the IP data packet of the audio data IP stream to the multicast IP address, port number, and RTP Payload Type of the audio data IP stream, respectively. The IP address, port number, and RTP Payload Type fields in the IP datagram of the auxiliary data IP stream are respectively set to the multicast IP address, port number, and RTP Payload Type of the auxiliary data IP stream.

5. The method of the ultra-high-definition IP multi-mode gateway system based on the x86 architecture ST2110 standard according to claim 1, characterized in that, Sending the IP data packets to the network switch via the network card includes: The program controls the network card to send the IP data packets, so that the IP data packets reach the network switch.

6. The method of the ultra-high-definition IP multi-mode gateway system based on the x86 architecture ST2110 standard according to claim 1, characterized in that, The network switch receives IP data packets corresponding to the parameters input to the ST 2110 IP stream, including: The corresponding IP data packets are received from the multicast IP addresses and port numbers of the video data IP stream, the audio data IP stream, and the auxiliary data IP stream, respectively.

7. The method of the ultra-high-definition IP multi-mode gateway system based on the x86 architecture ST2110 standard according to claim 1, characterized in that, Performing an audio-video timing synchronization process on the SDI format video frames and the SDI format audio frames includes: Based on audio data sample count The number of samples in the current audio frame is calculated based on the audio data packet size, audio bit width, and number of channels. Initialize the number of output audio frames. And set the audio sampling rate 48000, and audio-video synchronization delay time Video frame rate; When the SDI format audio frame is received, the current operating system time is recorded as follows. ; When the SDI format audio frame is the first audio frame, set the first frame time. ; Otherwise, calculate the expected output time. when The output process waits. Then output the current audio frame, and execute the following after output. .

8. The method of the ultra-high-definition IP multi-mode gateway system based on the x86 architecture ST2110 standard according to claim 1, characterized in that, Select the SDI input interface number and signal type, including: Select the interface number of the SDI input from among multiple SDI interfaces, and determine the SDI interface corresponding to the interface number of the SDI input as the SDI interface for receiving the SDI data. The format of the received SDI data is determined according to the signal standard.

Images