An airborne fibre channel multi-source video stream hybrid deterministic transmission method

Abstract

The present application relates to the technical field of computer communication, in particular to a kind of airborne fibre channel multi-source video stream mixed deterministic transmission method.The method is based on ICD file to the independent configuration of the collection mode, cache mode, cache depth and enable state of each video;Enabled video acquisition unit is collected video data in parallel according to configuration;Integrity check is carried out to video data;According to cache mode, the data that passes check is stored in line or frame buffer area, and effective video stream is formed;For all effective video stream, the time slot sequence of non-overlapping transmission is dynamically arranged, and independent transmission timer is set;In response to transmission timer trigger, video line data group framing is extracted from corresponding buffer area, and is sent through single fiber interface MAC.The present application realizes the mixed deterministic transmission of multi-source heterogeneous video stream on single optical fiber, simplifies wiring, ensures that transmission timing is controllable and delay is predictable.

Description

Technical Field

[0001] This invention relates to the field of computer communication technology, and more specifically to a method for deterministic transmission of multi-source video streams via an airborne fiber optic channel. Background Technology

[0002] As avionics systems evolve towards greater integration and modularity, the number of sensors integrated into airborne platforms is increasing, leading to a multi-source trend in video feeds. Modern aviation platforms typically require the simultaneous processing of image data from various heterogeneous video sources, such as electro-optical pods, synthetic aperture radar, and navigation cameras. These multi-source video streams are usually emitted from an integrated processing unit and need to be transmitted reliably and in real-time to a backend integrated display and control unit to provide situational awareness information to operators or for further image processing and analysis by the mission computer.

[0003] In traditional airborne video transmission systems, point-to-point dedicated cables are often used for single-channel video transmission. Point-to-point cable transmission has inherent drawbacks such as heavy and bulky cables, and susceptibility to interference from the complex electromagnetic environment of airborne systems.

[0004] More importantly, when faced with the need for concurrent transmission of multiple video streams, the aforementioned traditional methods still have the following significant shortcomings:

[0005] First, when multiple video streams need to be transmitted simultaneously, traditional solutions, limited by their point-to-point architecture, can only configure an independent physical link for each video stream, forming multiple parallel transmission channels. This multi-link solution leads to exceptionally complex system cabling, with the number and weight of cables increasing exponentially. This not only occupies valuable airborne space but also increases the difficulty and cost of system maintenance.

[0006] Second, multiple heterogeneous video sources often have different parameters such as resolution, frame rate, synchronization mode and pixel depth. Traditional single-channel video transmission methods are difficult to achieve flexible bandwidth allocation and resource integration in multi-channel concurrent scenarios, resulting in low bandwidth utilization of fiber optic links.

[0007] Third, when transmitting multiple heterogeneous video streams in a hybrid manner through a single optical fiber, a series of new technical challenges are faced: how to dynamically, fairly, and conflict-free allocate transmission time slots for multiple video streams on a single physical optical fiber; how to ensure the temporal integrity within each video stream and its transmission determinism in the hybrid stream; and how to flexibly schedule the transmission priority and bandwidth ratio of different video streams according to the real-time needs of the system.

[0008] Therefore, there is an urgent need in this field to propose a deterministic transmission scheme for multi-source video streams in airborne fiber optic channels, in order to solve the problem of efficient, reliable, and deterministic coexistence of multiple heterogeneous video streams on a single fiber optic channel, and to meet the multi-source video transmission requirements in complex avionics environments. Summary of the Invention

[0009] To address the shortcomings of existing technologies, this invention provides a method for deterministic transmission of multi-source video streams via an airborne fiber optic channel. The method aims to achieve hybrid transmission of multi-source heterogeneous video streams on a single fiber optic channel, while ensuring the timing integrity, transmission determinism, and dynamic schedulability of system resources for each video transmission.

[0010] To achieve the above objectives, the present invention provides the following technical solution:

[0011] A method for deterministic transmission of multi-source video streams via airborne fiber optic channel includes the following steps:

[0012] S1. Based on the ICD (Interface Control Document), the acquisition mode, buffer mode, buffer depth and enable status of each video channel are configured independently;

[0013] S2. Each enabled video acquisition unit identifies the synchronization signal according to the acquisition mode configured in the configuration and acquires its own corresponding video data in parallel; the integrity of the acquired video data is verified.

[0014] S3. Based on the configured caching mode, store the video data that has passed the integrity check into the corresponding line buffer or frame buffer, so that the video stream forms a valid video stream.

[0015] S4. Dynamically arrange the transmission time slot sequence for all valid video streams according to the ICD, so that the transmission time slots of any two valid video streams do not overlap on the time axis, and set an independent transmission timer for each valid video stream. The trigger time of the transmission timer corresponds to the transmission time slot allocated to that valid video stream.

[0016] S5. In response to the transmission timer trigger event, extract video data line by line from the line buffer or frame buffer of the corresponding valid video stream to obtain video line data; frame the video line data according to the Fibre Channel digital video transmission protocol to obtain framed data;

[0017] S6. Transmit the framed data through a single fiber optic interface MAC (Media Access Control).

[0018] Furthermore, in S2, the method for verifying the integrity of the acquired video data is as follows: according to the video format defined in the ICD, video data is received line by line. For each frame of video data, if the number of valid lines is continuous and the number of valid lines received is consistent with the preset value in the ICD, then the frame of video data is determined to have passed the integrity verification; otherwise, the frame of video data is determined to have failed the integrity verification, and the reception of subsequent lines of video data for that frame is stopped until the start of the next frame of video data.

[0019] Furthermore, in S3, storing the video data that has passed the integrity check into the corresponding line buffer or frame buffer includes:

[0020] If configured as a line-by-line caching mode, the video data that has passed the integrity check will be stored in the line buffer. Each time a line of video data is stored, the write pointer of the corresponding buffer will be updated.

[0021] If configured as frame-by-frame buffering mode, the video data that passes the integrity check will be stored in the frame buffer. Each time a line of video data is stored, the write pointer of the corresponding buffer will be updated. After a complete frame of video data has been stored, the frame will be marked as ready.

[0022] Furthermore, in S3, the row buffer or frame buffer adopts a double-buffer ping-pong storage method, which can store a maximum of one complete frame of video data.

[0023] Furthermore, in S4, the method for dynamically arranging the transmission time slot sequence is as follows:

[0024] Calculate the total transmission bandwidth required for all current valid video streams based on the video format defined by ICD and the number of currently valid video streams.

[0025] Based on the calculated total transmission bandwidth and the physical bandwidth of the fiber optic channel, determine whether it is possible to allocate non-overlapping transmission time slots on the time axis for all valid video streams;

[0026] If there are unarrangeable situations, the degradation strategy is executed iteratively. Each time, the lowest priority or the last added valid video stream is marked as invalid and removed from the current transmission sequence until all remaining valid video streams can be allocated to non-overlapping transmission slots on the time axis.

[0027] Furthermore, in S5, the method for obtaining video line data is as follows:

[0028] The system monitors the enable status, integrity verification results, and data status of each video stream in real time. When the transmission timer of a certain video stream is triggered, the system extracts video data line by line from the buffer corresponding to that video stream according to the caching mode configured in that video stream, and updates the read pointer of the corresponding buffer.

[0029] Furthermore, in S5, the framing method is as follows: add a container header, frame header, CRC (Cyclic Redundancy Check), and frame delimiter to the video line data according to the Fibre Channel digital video transmission protocol.

[0030] An airborne fiber channel multi-source video stream hybrid deterministic transmission system for implementing the above method includes:

[0031] The multi-channel video acquisition unit corresponds one-to-one with multiple external video sources and is used to acquire multiple video data in parallel.

[0032] The register group includes multiple sub-register groups, each corresponding to a multi-channel video acquisition unit, and is used to independently configure the acquisition mode, buffer mode, buffer depth, and enable state of each video channel based on the ICD.

[0033] The video data integrity verification unit is connected to each video acquisition unit and is used to verify the integrity of the acquired multi-channel video data.

[0034] The receiving management unit is connected to the video data integrity verification unit and is used to store the video data that has passed the integrity verification into the corresponding line buffer or frame buffer according to the configured caching mode, so that the video stream forms a valid video stream.

[0035] The hybrid transmission control unit, connected to the receiving management unit, is used to dynamically arrange the transmission time slot sequence for all valid video streams according to the ICD, so that the transmission time slots of any two valid video streams do not overlap on the time axis, and to set an independent transmission timer for each valid video stream, wherein the trigger time of the transmission timer corresponds to the transmission time slot allocated to that valid video stream.

[0036] The transmission scheduling management unit is connected to the hybrid transmission control unit and each buffer. It is used to extract video line data from the line buffer or frame buffer of the corresponding valid video stream in response to the transmission timer trigger event.

[0037] The framing unit, connected to the transmission scheduling management unit, is used to frame the extracted video line data.

[0038] The fiber optic interface MAC transmits the framed data through a single fiber optic interface.

[0039] Furthermore, the sub-register group includes:

[0040] The video interface enable register is used to control whether the video acquisition unit is enabled.

[0041] The video buffer mode register is used to define whether the video data is buffered line by line or frame by frame;

[0042] The video buffer depth register is used to define the buffer depth in line buffer mode;

[0043] The line buffer write pointer register and the line buffer read pointer register are used to indicate the write and read positions of valid data in the line buffer of this video channel;

[0044] The frame buffer write pointer register and the frame buffer read pointer register are used to indicate the write and read positions of valid data in the video frame buffer of that channel.

[0045] Compared with the prior art, the beneficial effects of the present invention are as follows:

[0046] (1) This invention solves the problem that existing technologies cannot flexibly adapt to heterogeneous video sources with different resolutions, frame rates and synchronization modes by independently configuring parameters for each video stream and storing video data into the row or frame buffer according to the configured caching mode. It realizes the flexible selection of row-based caching and frame-based caching, lays the foundation for subsequent deterministic scheduling, and significantly improves the configurability and versatility of the system.

[0047] (2) This invention dynamically arranges all valid video streams into a non-overlapping transmission time slot sequence on the time axis and sets an independent transmission timer for each video stream, which fundamentally solves the problem of time slot conflict and timing inaccuracy when multiple video streams are transmitted on a single optical fiber. It ensures that only one video stream occupies the optical fiber channel at any time, and realizes complete determinism in transmission. That is, the transmission time of each video stream is precisely controllable and the end-to-end delay is strictly predictable, which meets the stringent real-time requirements of the airborne environment.

[0048] (3) This invention monitors the status of each video stream in real time and responds to the trigger of the transmission timer, extracts video line data from the corresponding buffer, and encapsulates the extracted video line data according to the Fibre Channel digital video transmission protocol and sends it through a single fiber optic interface. This solves the problem of how to send and transmit multiple video streams in an orderly manner on a single fiber optic cable, realizes the orderly and conflict-free transmission of all video streams on the same physical link, replaces the traditional multi-link scheme, significantly simplifies system cabling, reduces the weight of airborne cables, and saves valuable airborne space.

[0049] (4) This invention solves the system robustness problem when data is abnormal and bandwidth resources are insufficient by performing real-time integrity verification on each video data and iteratively executing a degradation strategy when non-overlapping transmission time slots cannot be arranged. By removing the lowest priority or last added video stream and rearranging it, the transmission of key video streams is ensured to be unaffected, which significantly improves the reliability and stability of the system. Attached Figure Description

[0050] Figure 1This is a structural block diagram of the airborne fiber optic channel multi-source video stream hybrid deterministic transmission system in Embodiment 1 of the present invention;

[0051] Figure 2 This is a flowchart of the airborne fiber optic channel multi-source video stream hybrid deterministic transmission method in Embodiment 2 of the present invention. Detailed Implementation

[0052] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0053] Example 1

[0054] refer to Figure 1 This embodiment provides an airborne fiber optic channel multi-source video stream hybrid deterministic transmission system. The system includes an ICD management unit, a multi-channel video acquisition unit (video acquisition unit 1 to video acquisition unit n), a video data integrity verification unit, a register group, a receiving management unit, a line / frame buffer, a hybrid transmission control unit, a video transmission timer (transmission timer 1 to transmission timer n), a transmission scheduling management unit, a framing unit, a fiber optic interface MAC, and a debugging interface.

[0055] The ICD management unit serves as the system's configuration information center. By parsing the configuration parameters in the ICD, it provides a unified configuration benchmark for the initialization of the register group and the dynamic scheduling of each functional unit.

[0056] Each video acquisition unit corresponds to one of multiple external video sources. Each unit has a data input, a control input, and an output. Its data input connects to the corresponding external video source to receive raw video data. Its control input connects to the configuration output of the register group to receive configuration parameters such as the acquisition mode and enable status of that video source. Its output connects to the input of the video data integrity verification unit. Each enabled video acquisition unit operates independently and in parallel based on the received configuration parameters. While receiving raw video data, it simultaneously identifies the field synchronization and line synchronization signals in the raw video data to determine the position of the valid line and sends the received raw video data to the video data integrity verification unit.

[0057] The video data integrity verification unit has its data output terminal connected to the data input terminal of the receiving management unit, used to send video data that has passed integrity verification to the receiving management unit; its status output terminal is connected to the status input terminals of the receiving management unit and the sending scheduling management unit, respectively, used to report the integrity verification results of each video stream. This verification unit performs real-time verification of the continuity and integrity of the received video data according to the video format defined in the ICD. The specific verification method will be described in detail in Embodiment 2.

[0058] The register group serves as the unified configuration center for this system, containing n sub-register groups (sub-register group 1 to sub-register group n), with each of the n sub-register groups corresponding one-to-one with the n video streams. Each sub-register group includes a video interface enable register, a video buffer mode register, a video buffer depth register, a line buffer write pointer register, a line buffer read pointer register, a frame buffer write pointer register, and a frame buffer read pointer register.

[0059] The video interface enable register controls whether the video acquisition unit is enabled (activated). When the video interface enable register is set to 1, the corresponding video acquisition unit starts working; when it is set to 0, the video acquisition unit is disabled and does not participate in any subsequent processing.

[0060] The video buffer mode register defines whether the video data is buffered line by line or frame by frame. Line-by-line buffering mode is suitable for video streams with high real-time requirements, while frame-by-frame buffering mode is suitable for video streams with high data integrity requirements.

[0061] The video buffer depth register defines the maximum line buffer depth in line buffer mode, i.e., the maximum number of lines of data that can be buffered. This value can be configured according to video resolution and system latency requirements.

[0062] The line buffer write pointer register indicates the next writable position in the video line buffer. This register is updated by the receive management unit when data is stored; the write pointer increments each time a line of data is stored.

[0063] The line buffer read pointer register indicates the next readable position in the video line buffer. This register is updated by the transmit scheduling management unit when data is fetched; the read pointer increments each time a line of data is fetched.

[0064] The frame buffer write pointer register indicates the next writable position in the video frame buffer. This register is updated by the receive management unit when data is stored; the write pointer increments each time a line of data is stored.

[0065] The frame buffer read pointer register indicates the next readable position in the video frame buffer for that channel. This register is updated by the transmission scheduling management unit when data is fetched; the read pointer increments each time a line of data is fetched.

[0066] By using write pointers and read pointers in combination, the buffer can be reused cyclically and ping-pong operations can be achieved.

[0067] The configuration output terminals of the register group are connected to the control input terminal of the multi-channel video acquisition unit, the configuration input terminal of the receiving management unit, the configuration input terminal of the hybrid transmission control unit, and the configuration input terminal of the sending scheduling management unit, respectively. They are used to send configuration parameters such as the acquisition mode, buffer mode, buffer depth, and enable status of each video channel to each unit based on the ICD.

[0068] The receiving management unit has its data output connected to the write end of the line / frame buffer, used to store received video data into the corresponding buffer according to the configured buffering mode to obtain a valid video stream; its status output connected to the status input of the hybrid transmission control unit, used to report valid video stream information; and its notification output connected to the notification input of the sending scheduling management unit, used to send a data ready notification after each line of data or each complete frame of data is stored. The receiving management unit performs buffering processing on video data that has passed integrity verification according to the configured buffering mode as follows: if configured for line-by-line buffering mode, it stores the data line by line into the line buffer, updating the write pointer and sending a notification after each line is stored; if configured for frame-by-frame buffering mode, it stores the data line by line into the frame buffer, updating the write pointer after each line is stored, and marking the frame as ready and sending a notification after a complete frame of video data has been stored.

[0069] The line / frame buffer provides independent storage space for each video stream, employing a double-buffered ping-pong storage method, capable of storing a maximum of one complete video frame. Its read end connects to the data input end of the transmission scheduling management unit, allowing the unit to read video data line by line. Its control end connects to the read pointer output end of the transmission scheduling management unit, receiving read pointer update signals to maintain the buffer's read position. For the line buffer, when the write pointer and read pointer are equal, the corresponding buffer is empty; when the difference between the write and read pointers equals the configured line buffer depth, the line buffer is full. For the frame buffer, when the write pointer and read pointer are equal, the corresponding buffer is empty; when the difference between the write and read pointers equals the total number of lines in an image frame configured by the ICD, the frame buffer is full.

[0070] The hybrid transmission control unit, serving as the system's scheduling core, has its status feedback terminal connected to the status output terminal of the transmission scheduling management unit to receive transmission status feedback; its timer setting terminal connected to the setting input terminal of the video transmission timer to set an independent transmission timer for each valid video stream based on the arranged transmission time slot sequence; its time slot table output terminal connected to the time slot table input terminal of the transmission scheduling management unit to send the arranged transmission time slot sequence to the scheduling unit; and its degradation reporting terminal connected to the input terminal of the debug interface to report degradation rejection results when arrangement is not possible. This unit calculates the total transmission bandwidth required for all valid video streams based on the video format defined in the ICD and the number of currently valid video streams, and dynamically arranges non-overlapping transmission time slot sequences on the time axis for all valid video streams, ensuring that only one valid video stream's transmission timer is triggered at any given time. If it is not possible to allocate non-overlapping transmission time slots for all valid video streams, the degradation strategy is executed iteratively. Each time, the lowest priority or the last added valid video stream is marked as invalid and removed from the current transmission sequence. Transmission time slots are then rearranged for the remaining valid video streams until all remaining valid video streams can be allocated non-overlapping transmission time slots on the time axis. The removal results are reported through the debugging interface.

[0071] The video transmission timer sets up an independent timing channel for each video stream. Its trigger output is connected to the trigger signal input of the transmission scheduling management unit, and is used to send a trigger signal to the scheduling unit when the timer reaches the set time.

[0072] The transmission scheduling management unit connects its data output to the input of the framing unit, and is used to send the extracted video line data to the framing unit. The transmission scheduling management unit monitors the enable status, integrity verification results, and data status of each video stream in real time. When the transmission timer of a certain video stream is triggered, it extracts video data line by line from its corresponding buffer according to the buffering mode configured for that video stream, and updates the read pointer of the corresponding buffer.

[0073] The framing unit, whose output is connected to the input of the Fiber Optic Interface (MAC), is used to add container headers, frame headers, CRC, and frame delimiters to the video line data extracted from the buffer according to the Fiber Channel digital video transmission protocol. After completing the framing, the data is sent to the MAC layer.

[0074] The fiber optic interface MAC, whose output is connected to a single fiber optic link, is used to send out the frame data of all valid video streams sequentially according to the time sequence set by the hybrid transmission control unit.

[0075] The debugging interface allows external debugging equipment to monitor system status and perform fault analysis.

[0076] Example 2

[0077] refer to Figure 2 This embodiment provides a method for deterministic transmission of multi-source video streams via airborne fiber optic channels. Based on the system provided in Embodiment 1, the method proposed in this embodiment will be described in detail. The method proposed in this embodiment is executed according to the following steps:

[0078] S1. Based on ICD, the acquisition mode, buffer mode, buffer depth and enable status of each video channel are configured independently.

[0079] In this step, after the system powers on or resets, the ICD management unit reads and parses the ICD from external memory, writing the parsed configuration data into the corresponding sub-register group in the register group. After the register group completes initialization, it provides configuration parameters for each video channel. These parameters include: acquisition mode (e.g., progressive capture, interlaced capture), buffering mode (e.g., line-by-line buffering or frame-by-frame buffering), buffer depth (maximum line buffer depth in line buffering mode), and enable status (activated or disabled). These configuration parameters are sent through the register group's configuration output to the control input of the multi-channel video acquisition unit, the configuration input of the receiving management unit, the configuration input of the transmitting scheduling management unit, and the configuration input of the hybrid transmission control unit, controlling the operation mode of subsequent functional units.

[0080] S2. Each enabled video acquisition unit identifies the synchronization signal according to the acquisition mode and enable status in the configuration, and acquires its corresponding video data in parallel; the integrity of the acquired video data is verified.

[0081] In this step, each enabled video acquisition unit receives raw video data from an external video source through its data input terminal according to the acquisition mode configured in S1. At the same time, it identifies the field synchronization and line synchronization signals in the raw video data in real time to determine the position of the valid line, and sends the received raw video data to the input terminal of the video data integrity verification unit. The video data integrity verification unit performs integrity verification on the received raw video data.

[0082] The specific method for integrity verification is as follows: The video data integrity verification unit receives the raw video data sent by the video acquisition unit line by line according to the video format defined in the ICD, and records the number of valid lines received in the current image frame. For each frame of video data, the video data integrity verification unit checks whether the valid line count is continuous and whether the number of valid lines received is consistent with the preset value in the ICD. If the valid line count is continuous and the number of valid lines received is consistent with the preset value, the video data frame is determined to have passed the integrity verification; otherwise, the video data frame is determined to have failed the integrity verification, and the reception of subsequent video data of the current image frame is stopped until the start of the next frame of video data. The verification result is sent to the status input of the receiving management unit and the status input of the sending scheduling management unit through the status output terminal of the verification unit.

[0083] S3. Based on the configured caching mode, store the video data that has passed the integrity check into the corresponding line buffer or frame buffer, so that the video stream becomes a valid video stream.

[0084] In this step, the receiving management unit receives the verification result from the video data integrity verification unit through its status input terminal; it receives the video data that has passed the verification from the video data integrity verification unit through its data input terminal; and it receives the buffer mode configured in S1 through its configuration input terminal, and performs buffer processing on the received video data according to the received buffer mode.

[0085] The specific methods for cache processing are as follows:

[0086] If configured in line-by-line caching mode, the receiving management unit stores video data line by line into the corresponding line buffer through its data output terminal. Each time a line of video data is stored, the write pointer of the buffer is updated. At the same time, the receiving management unit sends a line of data ready notification to the sending scheduling management unit through its notification output terminal.

[0087] If configured in frame-by-frame buffering mode, the receiving management unit stores the received video data line by line into the corresponding frame buffer through its data output terminal. After each line of video data is stored, the write pointer of the buffer is updated. After a complete frame of video data is stored, the frame is marked as ready. At the same time, the receiving management unit sends a frame data ready notification to the sending scheduling management unit through its notification output terminal.

[0088] The video channel corresponding to the video data stored in the buffer becomes a valid video stream, qualified to participate in subsequent scheduling and transmission.

[0089] S4. Dynamically arrange the transmission time slot sequence for all valid video streams according to the ICD file, so that the transmission time slots of any two valid video streams do not overlap on the time axis, and set an independent transmission timer for each valid video stream.

[0090] In this step, the hybrid transmission control unit receives the transmission status feedback from the transmission scheduling management unit in real time through its status feedback terminal, obtains the number and identifier of the currently valid video streams from the reception management unit, and then performs the following operations:

[0091] The required transmission bandwidth for each valid video stream is calculated based on the video format parameters (resolution, frame rate, pixel depth, etc.) defined in the ICD file, and then the total transmission bandwidth required for all current valid video streams is obtained.

[0092] If the total transmission bandwidth does not exceed the physical bandwidth of the Fibre Channel, then all valid video streams are allocated non-overlapping transmission time slots on the time axis. If the total transmission bandwidth exceeds the physical bandwidth of the Fibre Channel and non-overlapping transmission time slots cannot be allocated, then a degradation strategy is executed: an iterative elimination operation is performed, each time marking the lowest priority valid video stream as invalid and removing it from the current transmission sequence, where the priority is determined according to the video stream priority identifier predefined in the ICD. If no priority identifier is defined in the ICD, then the last added valid video stream is marked as invalid and removed from the current transmission sequence, and transmission time slots are reassigned to the remaining valid video streams until all remaining valid video streams can be allocated non-overlapping transmission time slots on the time axis.

[0093] The removed video streams will no longer participate in subsequent scheduling and transmission. The removal result is sent to the debugging interface through the downgrade reporting terminal of the hybrid transmission control unit.

[0094] After the transmission time slots are orchestrated, the hybrid transmission control unit sets an independent transmission timer for each valid video stream through its timer setting terminal. The trigger time of each transmission timer precisely corresponds to the transmission time slot allocated to that video stream, ensuring that only one valid video stream's transmission timer is triggered at any given time. The time slot table generated by the orchestration is sent to the time slot table input terminal of the transmission scheduling management unit through the time slot table output terminal of the hybrid transmission control unit.

[0095] S5. In response to the transmit timer trigger event, extract video data line by line from the line buffer or frame buffer of the corresponding valid video stream to obtain video line data. Then, frame the extracted video line data according to the Fibre Channel digital video transmission protocol to obtain framed data.

[0096] In this step, the transmission scheduling management unit receives the verification results from the video data integrity verification unit and the data readiness notification from the reception management unit through its status input terminal, receives the trigger signal from the transmission timer through its trigger signal input terminal, and receives the time slot table from the hybrid transmission control unit through its time slot table input terminal. The transmission scheduling management unit also monitors the enable status, integrity verification results, and data status of each video stream in real time (determined by the relative positions of the write and read pointers).

[0097] When the transmission timer for a valid video stream is triggered, the transmission scheduling management unit, according to the buffering mode configured for that video stream, reads video data line by line from its corresponding buffer through its data input terminal to obtain video line data. For each line of data read, the read pointer of the buffer is updated through its read pointer output terminal, and the read video line data is sent to the input terminal of the framing unit through its data output terminal. During the reading process, if there is insufficient data in the buffer (an abnormal situation), an error handling mechanism is triggered, skipping the current transmission and reporting the error status to the hybrid transmission control unit through its status output terminal.

[0098] The framing unit receives video line data sent by the transmission scheduling and management unit through its input terminal, encapsulates the received video line data according to the Fibre Channel digital video transmission protocol, and adds a container header, frame header, CRC, and frame delimiter to form a standard Fibre Channel data frame, i.e., framed data. After completing the framing, the framing unit sends the framed data to the input terminal of the fiber optic interface MAC through its output terminal.

[0099] S6. The framed data is sent through a single fiber optic interface MAC.

[0100] In this step, the fiber optic interface MAC receives the framing data sent by the framing unit through its input end. As the only physical transmission port, it sends all the framing data, which are encapsulated from different valid video streams, sequentially to a single fiber optic link through its output end according to the time sequence set by the hybrid transmission control unit.

[0101] At this point, the hybrid deterministic transmission of multiple heterogeneous video streams over a single fiber optic channel is complete.

[0102] The specific embodiments of the present invention are provided to enable those skilled in the art to understand or implement the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention.

[0103] It should be understood that the present invention is not limited to the content already described above, and various modifications and changes can be made without departing from its scope. The scope of the present invention is limited only by the appended claims.

Claims

1. A method for deterministic transmission of multi-source video streams via airborne fiber optic channel, characterized in that, Includes the following steps: S1. Based on the interface control file (ICD), the acquisition mode, buffer mode, buffer depth, and enable status of each video channel are configured independently. S2. Each enabled video acquisition unit identifies the synchronization signal according to the acquisition mode configured in the configuration and acquires its own corresponding video data in parallel. Perform integrity verification on the collected video data; S3. Based on the configured caching mode, store the video data that has passed the integrity check into the corresponding line buffer or frame buffer, so that the video stream forms a valid video stream. S4. Dynamically arrange the transmission time slot sequence for all valid video streams according to the ICD, so that the transmission time slots of any two valid video streams do not overlap on the time axis, and set an independent transmission timer for each valid video stream. The trigger time of the transmission timer corresponds to the transmission time slot allocated to that valid video stream. The method for dynamically arranging the transmission time slot sequence is as follows: Calculate the total transmission bandwidth required for all current valid video streams based on the video format defined by ICD and the number of currently valid video streams. Based on the calculated total transmission bandwidth and the physical bandwidth of the fiber optic channel, determine whether it is possible to allocate non-overlapping transmission time slots on the time axis for all valid video streams; If there is a situation where it cannot be arranged, the degradation strategy is executed iteratively. Each time, the lowest priority or the last added valid video stream is marked as invalid and removed from the current transmission sequence until the remaining valid video streams can be allocated to non-overlapping transmission slots on the time axis. S5. In response to the transmit timer trigger event, extract video data line by line from the line buffer or frame buffer of the corresponding valid video stream to obtain video line data; frame the video line data according to the Fibre Channel Digital Video Transmission Protocol to obtain framed data; the framing method is to add a container header, frame header, CRC and frame delimiter to the video line data according to the Fibre Channel Digital Video Transmission Protocol. S6. The framed data is sent through a single fiber optic interface MAC.

2. The airborne fiber optic channel multi-source video stream hybrid deterministic transmission method according to claim 1, characterized in that, In S2, the method for verifying the integrity of the acquired video data is as follows: according to the video format defined in the ICD, video data is received line by line. For each frame of video data, if the number of valid lines is continuous and the number of valid lines received is consistent with the preset value in the ICD, then the frame of video data is determined to have passed the integrity verification; otherwise, the frame of video data is determined to have failed the integrity verification, and the reception of subsequent lines of video data for that frame is stopped until the start of the next frame of video data.

3. The airborne fiber optic channel multi-source video stream hybrid deterministic transmission method according to claim 1, characterized in that, In S3, storing the video data that has passed the integrity check into the corresponding line buffer or frame buffer includes: If configured as a line-by-line caching mode, the video data that has passed the integrity check will be stored in the line buffer. Each time a line of video data is stored, the write pointer of the corresponding buffer will be updated. If configured as frame-by-frame buffering mode, the video data that passes the integrity check will be stored in the frame buffer. Each time a line of video data is stored, the write pointer of the corresponding buffer will be updated. After a complete frame of video data has been stored, the frame will be marked as ready.

4. The airborne fiber optic channel multi-source video stream hybrid deterministic transmission method according to claim 1, characterized in that, In S3, the row buffer or frame buffer adopts a double-buffered ping-pong storage method, which can store a maximum of one complete frame of video data.

5. The airborne fiber optic channel multi-source video stream hybrid deterministic transmission method according to claim 1, characterized in that, In S5, the method for obtaining video line data is as follows: The system monitors the enable status, integrity verification results, and data status of each video stream in real time. When the transmission timer of a certain video stream is triggered, the system extracts video data line by line from the buffer corresponding to that video stream according to the caching mode configured in that video stream, and updates the read pointer of the corresponding buffer.

6. An airborne fiber optic channel multi-source video stream hybrid deterministic transmission system for implementing the method as described in any one of claims 1 to 5, characterized in that, include: The multi-channel video acquisition unit corresponds one-to-one with multiple external video sources and is used to acquire multiple video data in parallel. The register group includes multiple sub-register groups, each corresponding to a multi-channel video acquisition unit, and is used to independently configure the acquisition mode, buffer mode, buffer depth, and enable state of each video channel based on the ICD. The video data integrity verification unit is connected to each video acquisition unit and is used to verify the integrity of the acquired multi-channel video data. The receiving management unit is connected to the video data integrity verification unit and is used to store the video data that has passed the integrity verification into the corresponding line buffer or frame buffer according to the configured caching mode, so that the video stream forms a valid video stream. The hybrid transmission control unit, connected to the receiving management unit, is used to dynamically arrange the transmission time slot sequence for all valid video streams according to the ICD, so that the transmission time slots of any two valid video streams do not overlap on the time axis, and to set an independent transmission timer for each valid video stream, wherein the trigger time of the transmission timer corresponds to the transmission time slot allocated to that valid video stream. The transmission scheduling management unit is connected to the hybrid transmission control unit and each buffer. It is used to extract video line data from the line buffer or frame buffer of the corresponding valid video stream in response to the transmission timer trigger event. The framing unit, connected to the transmission scheduling management unit, is used to frame the extracted video line data. The fiber optic interface MAC transmits the framed data through a single fiber optic interface.

7. The airborne fiber optic channel multi-source video stream hybrid deterministic transmission system according to claim 6, characterized in that, The sub-register group includes: The video interface enable register is used to control whether the video acquisition unit is enabled. The video buffer mode register is used to define whether the video data is buffered line by line or frame by frame; The video buffer depth register is used to define the buffer depth in line buffer mode; The line buffer write pointer register and the line buffer read pointer register are used to indicate the write and read positions of valid data in the line buffer of this video channel; The frame buffer write pointer register and the frame buffer read pointer register are used to indicate the write and read positions of valid data in the video frame buffer of that channel.

Images