A distributed dual-stream video transmission and reception processing method, system and device

Abstract

The present invention discloses a distributed dual-stream video transmission and reception processing method, system, and device. The video transmission and processing method comprises: acquiring a video signal; duplicating the acquired video signal, and compressing the duplicated video signals using different compression algorithms to obtain a plurality of compressed video signals; and transmitting the plurality of compressed video signals to a receiving and processing system, so that the receiving and processing system respectively receives and decompresses the plurality of compressed video signals, monitors the operation of the decompression process, and determines a final output scheme of the video signal based on the operation and the plurality of decompressed video signals. The present invention can effectively adapt video transmission to different network environments, widely cover a variety of different application scenarios, improve the flexibility of video transmission processing, and ensure the continuity of video signal output under abnormal conditions, thereby solving the problem of frame loss.

Description

Technical Field

[0001] The present invention relates to the field of video transmission, and more specifically, to a distributed dual-stream video sending, receiving and processing method, system and device. Background Art

[0002] With the development of science and technology, people have higher and higher requirements for video transmission. They not only require the content of the transmitted video signal to be larger, but also require the application scenarios of video transmission to be more and more extensive.

[0003] As we all know, the original transmission bandwidth of a 1920x1080@60 video signal is as high as 3Gbps, which means that Gigabit Ethernet cannot transmit such a high-bandwidth video signal. Although 10 Gigabit Ethernet can transmit it, due to the high deployment cost, it is not widely accepted by users. Therefore, the video signal needs to be compressed to a certain level to be suitable for transmission on Gigabit Ethernet. Different compression algorithms provide different compression ratios. Shallow compression algorithms ensure visual losslessness and low latency of the image signal, while deep compression algorithms achieve low bit rates and are more suitable for transmission on low-bandwidth networks.

[0004] Typically, in local command and dispatch scenarios, since gigabit transmission over the LAN is guaranteed, the primary concern is visual losslessness and low latency of the video signal, so a low-compression-ratio algorithm should be used. In cross-regional joint command and dispatch scenarios, due to wide-area network bandwidth limitations, the primary concern is low-bandwidth transmission of the video signal, so a low-bandwidth algorithm should be used.

[0005] However, existing video transmission technologies can often only process a single type of compressed code stream to transmit video data. Video transmission is restricted by the network environment of fixed usage scenarios, resulting in poor transmission flexibility and inability to adapt to a variety of different network environments for video transmission.

[0006] In addition, in some special application scenarios, such as the military and the power industry, there are strict requirements on the quality and delay of video images. In the local area network, when the Gigabit Ethernet transmission bandwidth is guaranteed, it is preferred to use a shallow compression algorithm to process the video signal. However, sometimes due to the large number of network devices connected to the switch, there is a probability that the switch will be blocked. When the switch is blocked, the data processed by the shallow compression algorithm may also be blocked. Due to packet loss, the video image may be stuck and frames may be lost. The frame loss of the video signal may cause the flying objects in the military to not be fully visible, or misoperation in the power industry, which may cause serious safety accidents. Summary of the Invention

[0007] The present invention aims to overcome at least one defect (shortcoming) of the above-mentioned prior art and provide a distributed dual-stream video sending and receiving processing method, system and device for achieving a video transmission effect that effectively adapts to different network environments and effectively avoids video frame loss.

[0008] The technical solution adopted by the present invention is a distributed dual-stream video transmission processing method, comprising:

[0009] Acquire video signal;

[0010] The acquired video signal is copied, and the copied video signals are compressed using different compression algorithms to obtain a plurality of compressed video signals;

[0011] The multiple compressed video signals are used to be sent to a receiving and processing system so that the receiving and processing system respectively receives and decompresses the multiple compressed video signals and monitors the operation status of the decompression process. Based on the operation status and in combination with the multiple decompressed video signals, the final output scheme of the video signal is determined.

[0012] In the present invention, a variety of compression algorithms are used to compress the video signal, which effectively reduces the amount of video signal data and the bandwidth required for transmission, so that the video signal can be suitable for transmission in the existing network environment. At the same time, the video signal is compressed in different ways to obtain several channels of differently compressed data, and the different compressed data can effectively adapt to different network transmission environments, thereby making the compressed video signal widely adaptable to a variety of different application scenarios, and realizing intercommunication between different application scenarios, effectively improving the flexibility of video transmission processing.

[0013] Furthermore, the compression algorithm includes a shallow compression algorithm and a deep compression algorithm;

[0014] The acquired video signal is copied, and the copied video signals are compressed using different compression algorithms to obtain video signals after compression of several paths, specifically including:

[0015] The acquired video signal is copied, and the copied video signal is compressed using a shallow compression algorithm and a deep compression algorithm respectively to obtain a shallowly compressed video signal and a deeply compressed video signal.

[0016] In the present invention, the compression algorithm includes a shallow compression algorithm and a deep compression algorithm; the shallow compression algorithm and the deep compression algorithm are relative, and the compression degree of the video signal is different. The shallow compression algorithm has a relatively low compression degree for the video signal, and the deep compression algorithm has a relatively high compression degree for the video signal. Therefore, different degrees of compression can be achieved on the video signal to obtain different compressed data.

[0017] Furthermore, the obtained video signal is copied, and the copied video signal is compressed using a shallow compression algorithm and a deep compression algorithm respectively to obtain a shallowly compressed video signal and a deep compressed video signal, specifically including:

[0018] Adding a frame number to each frame image in the acquired video signal to obtain a serialized video frame signal;

[0019] The serialized video frame signal is copied, and the copied serialized video frame signal is compressed using a shallow compression algorithm and a deep compression algorithm respectively to obtain a shallowly compressed video signal and a deep compressed video signal.

[0020] In the present invention, before synchronously performing multiple compression processing on the video signal, it is necessary to add a frame number to each frame image in the video signal and then perform a copy operation. This is to ensure the uniformity and orderliness of the video signal undergoing multi-channel compression processing, and to facilitate the rapid and orderly finding of the correspondence between the data frames of different video signals obtained by different compression algorithms when the multiple video signals are subsequently processed, so that different video signals can be quickly switched for output, thereby improving the video transmission processing speed.

[0021] Furthermore, a frame number is added to each frame image of the acquired video signal to obtain serialized video frame data, specifically including:

[0022] Converting the acquired video signal from the RGB color gamut space to the YUV color gamut space to obtain a converted video signal;

[0023] A frame number is added to each frame image of the converted video signal to obtain serialized video frame data.

[0024] In the present invention, before serializing and copying the video signal, the video signal needs to be converted from the RGB color gamut space to the YUV color gamut space. The color gamut conversion step can facilitate the subsequent efficient processing of the image, improve the compression encoding quality, and thus improve the video transmission quality.

[0025] On the other hand, another technical solution adopted by the present invention is a distributed dual-stream video receiving and processing method, comprising:

[0026] Receiving the shallowly compressed video signal and the deeply compressed video signal described in the above-mentioned video transmission processing method;

[0027] Decompressing the shallowly compressed video signal and the deeply compressed video signal using corresponding decompression algorithms to obtain a shallowly decompressed video signal and a deeply decompressed video signal;

[0028] The operation status of the decompression process is monitored, and according to the operation status, a final output scheme of the video signal is determined in combination with the shallowly decompressed video signal and the deeply decompressed video signal.

[0029] After decompressing video signals using different compression algorithms using corresponding decompression algorithms, this technical solution can determine the output of the video signal based on the operating conditions during the decompression process, achieve redundancy in video transmission, and ensure that the output of the video signal does not lose frames, meeting applications with very strict requirements for video transmission.

[0030] Furthermore, the operation status of the decompression process is monitored, and according to the operation status, a final output scheme of the video signal is determined in combination with the shallowly decompressed video signal and the deeply decompressed video signal, specifically including:

[0031] Monitor the interrupt signal of the shallow decompression process;

[0032] When no interrupt signal of the shallow decompression process is received, the shallowly decompressed video signal is received and output;

[0033] When an interrupt signal of the shallow decompression process is received, the video signal after shallow decompression is switched to the video signal after deep decompression for output;

[0034] When the interrupt signal of the shallow decompression process disappears, the video signal after shallow decompression is switched back to output.

[0035] This technical solution monitors the interrupt signal of the shallow decompression process to determine whether to output the shallowly decompressed video signal or the deeply decompressed video signal, thereby ensuring that the video signal output is not lost. In this solution, the deeply compressed video signal is added while the shallowly compressed video signal is transmitted. This does not significantly increase the amount of data transmitted, but also ensures that if the video signal loses a frame, the lost video frame can be retrieved from the deeply decompressed video signal, ensuring the integrity of the video signal and meeting the specific application requirements of video transmission.

[0036] Furthermore, when an interrupt signal of the shallow decompression process is received, the video signal after shallow decompression is switched to the video signal after deep decompression for output; when the interrupt signal of the shallow decompression process disappears, the video signal after shallow decompression is switched back to be output, specifically including:

[0037] Assume that the frame number of the shallowly decompressed video signal currently being output is between the Nth frame and the N+1th frame, and that M-1 frames of video signal can be output within the duration of the interrupt signal of the shallow decompression process;

[0038] When an interrupt signal of the shallow decompression process is received, the shallow decompression process switches from receiving the shallowly decompressed video signal to receiving the deeply decompressed video signal, and outputs the video signal starting from the N+1th frame of the deeply decompressed video signal until the shallow decompression interrupt signal disappears after the N+M-1th frame of the deeply decompressed video signal is output;

[0039] When the interrupt signal of the shallow decompression process disappears, the process switches to receiving the N+Mth frame of the shallowly decompressed video signal for output.

[0040] During the decompression process of the compressed video signal, if an abnormal interruption occurs, the final output video signal will be stuck or lose frames, resulting in flickering screen, black screen, etc., and these problems will have a serious impact on the user. In the present invention, the video signals after shallow and deep compression are both decompressed to obtain shallow decompressed video signals and deep decompressed video signals respectively, and the operation of the decompression process is continuously monitored. When no interruption signal is received, the shallow decompressed video signal is output first. When an interruption signal of the shallow decompression process is received, it means that the shallow decompressed video signal has an output abnormality. Then, the video signal is switched to the deep decompressed video signal that is decompressed synchronously in time, and the image frame at the corresponding position is quickly found according to the frame number for output until the interruption signal disappears, and then the video signal output is switched back to the shallow decompressed video signal. The present invention synchronously decompresses video signals after shallow and deep compression processing to obtain shallowly decompressed video signals and deeply decompressed video signals, thereby realizing redundancy in video signal transmission. Even if an abnormal interruption occurs in the shallow decompression process, the final output video signal can be effectively guaranteed to be continuous, thereby solving the problem of frame loss.

[0041] On the other hand, another technical solution adopted by the present invention is a distributed dual-stream video transmission and processing system, comprising:

[0042] A video acquisition module, used to acquire video signals;

[0043] A processing module is used to copy the acquired video signal, and compress the copied video signals using different compression algorithms to obtain multiple compressed video signals;

[0044] The multiple compressed video signals are used to be sent to a receiving and processing system so that the receiving and processing system respectively receives and decompresses the multiple compressed video signals and monitors the operation status of the decompression process. Based on the operation status and in combination with the multiple decompressed video signals, the final output scheme of the video signal is determined.

[0045] On the other hand, another technical solution adopted by the present invention is a distributed dual-stream video receiving and processing system, comprising:

[0046] A video receiving module, configured to receive the shallowly compressed video signal and the deeply compressed video signal described in the above-mentioned video transmission processing method;

[0047] a decompression module, configured to decompress the shallowly compressed video signal and the deeply compressed video signal using corresponding decompression algorithms to obtain a shallowly decompressed video signal and a deeply decompressed video signal;

[0048] The fusion module is used to monitor the operation status of the decompression process, and determine the final output scheme of the video signal based on the operation status and the combination of the shallowly decompressed video signal and the deeply decompressed video signal.

[0049] On the other hand, another technical solution adopted by the present invention is an electronic device, including a memory and a processor, the memory storing a computer program, and the processor implementing the above-mentioned distributed dual-stream video sending processing method or the above-mentioned distributed dual-stream video receiving processing method when executing the computer program.

[0050] Compared with the prior art, the present invention has the following beneficial effects:

[0051] 1. In the present invention, a plurality of different compression algorithms are used to compress the video signal, effectively reducing the amount of video signal data and the bandwidth required for transmission, making the video signal suitable for transmission in the existing network environment. At the same time, the video signal is compressed in different ways to obtain multiple channels of differently compressed data, and the different compressed data can effectively adapt to different network transmission environments, thereby making the compressed video signal widely applicable to a variety of different application scenarios and achieving interoperability between different application scenarios, effectively improving the flexibility of video transmission processing;

[0052] 2. In the present invention, the video signals after shallow and deep compression processing are decompressed synchronously to obtain shallow and deep decompressed video signals, and the operation status of the decompression process is continuously monitored. When an interrupt signal of the shallow decompression process is received, the deep decompressed video signal output of the corresponding frame position is promptly switched to, and when the interrupt signal disappears, the shallow decompressed video signal output is switched back to, thereby realizing redundancy of video signal transmission, effectively ensuring the continuity of video signal output under abnormal circumstances, and solving the problem of frame loss. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] Figure 1 This is a flow chart of the video sending processing method in Example 1.

[0054] Figure 2 This is a specific flow chart of step S21 of the video sending processing method in Example 1.

[0055] Figure 3 This is a flow chart of the video receiving and processing method in Example 2.

[0056] Figure 4 This is a specific flow chart of step S6 of the video receiving and processing method in Example 2.

[0057] Figure 5 This is a structural diagram of the video sending and processing system in Example 3.

[0058] Figure 6 This is a structural diagram of the synchronization module 210 of the video sending processing system in Example 3.

[0059] Figure 7 This is a structural diagram of the video receiving and processing system in Example 4.

[0060] Figure 8 This is a schematic diagram of the principle of the fusion module 500 processing the interrupt signal of the shallow decompression process in Example 4.

[0061] Figure 9 This is a schematic diagram of the principle of implementing video preview by the fusion module 500 in Example 4.

[0062] Figure numerals: video acquisition module 100, synchronization module 210, color space conversion module 211, serialization module 212, copy module 213, shallow compression module 221, deep compression module 222, video receiving module 300, shallow decompression module 410, deep decompression module 420, fusion module 500. DETAILED DESCRIPTION

[0063] The accompanying drawings are for illustrative purposes only and are not to be construed as limiting the present invention. To better illustrate the following embodiments, some components in the accompanying drawings may be omitted, enlarged, or reduced in size, and do not represent actual product dimensions. Those skilled in the art will appreciate that some well-known structures and their descriptions may be omitted from the accompanying drawings.

[0064] Example 1

[0065] like Figure 1 As shown, this embodiment provides a distributed dual-stream video transmission processing method, including:

[0066] S1, obtain video signal;

[0067] S2. Copying the acquired video signal, and compressing the copied video signals using different compression algorithms to obtain a plurality of compressed video signals;

[0068] S3. The multiple compressed video signals are used to be sent to a receiving and processing system, so that the receiving and processing system respectively receives and decompresses the multiple compressed video signals, and monitors the operation status of the decompression process. According to the operation status, combined with the multiple decompressed video signals, the final output scheme of the video signal is determined.

[0069] Furthermore, the compression algorithm in step S2 includes a shallow compression algorithm and a deep compression algorithm; the shallow compression algorithm and the deep compression algorithm are relative, and the compression degree of the video signal is different. The shallow compression algorithm has a relatively low compression degree for the video signal, and the deep compression algorithm has a relatively high compression degree for the video signal.

[0070] In this embodiment, shallow and deep compression algorithms are used to perform different compression processing on the video signal, effectively reducing the amount of video signal data and the bandwidth required for transmission, so that the video signal can be suitable for transmission in the existing network environment, and the different compressed data obtained can effectively adapt to different network transmission environments, thereby making the compressed video signal widely adaptable to a variety of different application scenarios, and realizing interoperability between different application scenarios, effectively improving the flexibility of video transmission processing.

[0071] Step S2 copies the acquired video signal, and compresses the copied video signals using different compression algorithms to obtain several compressed video signals, specifically including:

[0072] S21. Copy the acquired video signal, and compress the copied video signal using a shallow compression algorithm and a deep compression algorithm, respectively, to obtain a shallowly compressed video signal and a deeply compressed video signal. In a specific implementation, assuming that one video signal is acquired, the video signal is copied to obtain two video signals: the original video signal and the copied video signal. One of the video signals is compressed using a shallow compression algorithm, and the other is compressed using a deep compression algorithm, to obtain a shallowly compressed video signal and a deeply compressed video signal, respectively.

[0073] Specifically, in this embodiment, between steps S1 and S2, it can also be determined whether A / D conversion is required based on the acquired video signal. If the acquired video signal is an analog signal, a step of converting the acquired video signal into a digital video signal through an A / D module can also be set, and then the converted digital video signal can be subsequently copied and compressed.

[0074] Further, such as Figure 2 As shown, step S21 specifically includes:

[0075] S211. Convert the acquired video signal from the RGB color gamut space to the YUV color gamut space to obtain a converted video signal. If the acquired video signal is in RGB format, the RGB format video signal can be converted to YUV format, which is beneficial to efficient image processing at the back end.

[0076] S212, adding a frame number to each frame image of the converted video signal to obtain serialized video frame data;

[0077] S213 , copying the serialized video frame signal, and compressing the copied serialized video frame signal using a shallow compression algorithm and a deep compression algorithm, respectively, to obtain a shallowly compressed video signal and a deeply compressed video signal.

[0078] In this embodiment, a frame number is added to each frame image in the video signal in order to ensure the uniformity and orderliness of the video signal undergoing multi-channel compression processing, and to facilitate the rapid and orderly finding of the correspondence between the data frames of different video signals when the multiple video signals are subsequently processed, thereby enabling rapid switching of different video signals for output and improving the video transmission processing speed.

[0079] Specifically, in this embodiment, for converting a video signal from an RGB color space to a YUV color space, the component conversion formulas may be performed in the following manner, but are not limited to this manner:

[0080] Y = 0.298R + 0.612G + 0.117B;

[0081] U=-0.168R-0.330G+0.498B+128;

[0082] V=0.449R-0.435G-0.083B+128.

[0083] Specifically, in this embodiment, the position for adding the frame number can be set at the Y component of the first row of each frame image. The frame number of each frame image starts from 0, increases to 255, and then cycles to 0, and so on.

[0084] During the transmission process of video signal compression or decompression, pixel scanning typically begins at the first row of the image frame. Frame codes are added to the first row of each frame to reduce marking time and enable quicker frame location during subsequent decompression and reception, thereby increasing video transmission speed. Furthermore, the frame numbers in the video signal start at 0, increment to 255, and then return to 0. This allows for the recycling of frame numbers, allowing for a more controlled number of frame numbers and reducing the space occupied by frame numbers within the image frame.

[0085] Example 2

[0086] like Figure 3 As shown, this embodiment provides a distributed dual-stream video receiving and processing method, including:

[0087] S4, receiving the shallowly compressed video signal and the deeply compressed video signal in embodiment 1;

[0088] S5. Decompress the shallowly compressed video signal and the deeply compressed video signal using corresponding decompression algorithms to obtain shallowly decompressed video signals and deeply decompressed video signals; the decompression algorithms correspond to the shallow compression algorithm and the deep compression algorithm in Example 1, respectively.

[0089] S6. Monitoring the operation status of the decompression process, and determining a final output scheme of the video signal based on the operation status and the video signal after shallow decompression and the video signal after deep decompression.

[0090] Specifically, in this embodiment, after step S5, the video signal finally outputted can be converted from a digital signal into an analog signal again via a D / A module and then outputted to a display screen via a video cable.

[0091] Further, such as Figure 4 As shown, step S5 specifically includes:

[0092] S51, monitoring the interrupt signal of the shallow decompression process;

[0093] S52: When no interrupt signal of the shallow decompression process is received, the shallowly decompressed video signal is received and outputted;

[0094] S53, when an interrupt signal of the shallow decompression process is received, switching from the shallowly decompressed video signal to the deeply decompressed video signal for output;

[0095] S54: When the interrupt signal of the shallow decompression process disappears, the video signal after shallow decompression is switched back to output.

[0096] Specifically, in order to ensure that the subsequent display output image does not have a black screen or a flickering screen, step S5 completes the interrupt processing within the vertical blanking period.

[0097] Furthermore, steps S53 and S54 specifically include:

[0098] Assume that the current moment is between the output frame numbered Nth frame after shallow decompression of the video signal and the frame numbered N+1th frame after shallow decompression of the video signal, and that M-1 frames of video signal can be output within the duration of the interrupt signal of the shallow decompression process;

[0099] When an interrupt signal of the shallow decompression process is received at the current moment, the shallow decompression process is switched from receiving the shallowly decompressed video signal to receiving the deeply decompressed video signal, and the deep decompressed video signal is output starting from the N+1th frame until the shallow decompression interrupt signal disappears when the deep decompression video signal is output at the N+M-1th frame;

[0100] When the interrupt signal of the shallow decompression process disappears, the process switches to receiving the N+Mth frame of the shallowly decompressed video signal for output.

[0101] During the decompression process of the compressed video signal, if an abnormal interruption occurs, the final output video signal will be stuck or have frames dropped, resulting in flickering or black screen, and these problems will have a serious impact on the user. In this embodiment, the video signals after shallow and deep compression are both decompressed to obtain shallow decompressed video signals and deep decompressed video signals, respectively, and the operation of the decompression process is continuously monitored. When no interruption signal is received, the shallow decompressed video signal is output first. When an interruption signal of the shallow decompression process is received, it means that the shallow decompressed video signal has an output abnormality, and the video signal is switched to the deep decompressed video signal that is decompressed synchronously in time. The image frame at the corresponding position is quickly found according to the frame number and outputted until the interruption signal disappears, and then the output is switched back to the shallow decompressed video signal. This embodiment simultaneously decompresses the video signals after shallow and deep compression processing to obtain shallowly decompressed video signals and deeply decompressed video signals, thereby achieving redundancy in video signal transmission. Even if an abnormal interruption occurs in the shallow decompression process, it can effectively ensure that the final output video signal is continuous, thereby solving the problem of frame loss.

[0102] Example 3

[0103] like Figure 5 As shown, this embodiment provides a distributed dual-stream video transmission and processing system, including:

[0104] The video acquisition module 100 is used to acquire a video signal;

[0105] A processing module is used to copy the acquired video signal, and compress the copied video signals using different compression algorithms to obtain multiple compressed video signals;

[0106] The multiple compressed video signals are used to be sent to a receiving and processing system so that the receiving and processing system respectively receives and decompresses the multiple compressed video signals and monitors the operation status of the decompression process. Based on the operation status and in combination with the multiple decompressed video signals, the final output scheme of the video signal is determined.

[0107] Specifically, the processing module includes: a synchronization module 210, a shallow compression module 221, and a deep compression module 222;

[0108] The synchronization module 210 is used to copy the acquired video signal and synchronously send it to the shallow compression module 221 and the deep compression module 222;

[0109] A shallow compression module 221 is configured to compress the copied video signal using a shallow compression algorithm to obtain a shallowly compressed video signal;

[0110] The deep compression module 222 is configured to compress the copied video signal using a deep compression algorithm to obtain a deeply compressed video signal.

[0111] In this embodiment, shallow and deep compression algorithms are used to perform different compression processing on the video signal, effectively reducing the amount of video signal data and the bandwidth required for transmission, so that the video signal can be suitable for transmission in the existing network environment, and the different compressed data obtained can effectively adapt to different network transmission environments, thereby making the compressed video signal widely adaptable to a variety of different application scenarios, and realizing interoperability between different application scenarios, effectively improving the flexibility of video transmission processing.

[0112] Specifically, in this embodiment, between the video acquisition module 100 and the synchronization module 210, it can also be determined whether A / D conversion is required based on the acquired video signal. If the acquired video signal is an analog signal, an A / D module can also be provided to convert the acquired video signal into a digital video signal, and then the converted digital video signal is subsequently copied and compressed.

[0113] Further, such as Figure 6 As shown, the synchronization module 210 includes:

[0114] The color gamut space conversion module 211 is used to convert the acquired video signal from the RGB color gamut space to the YUV color gamut space to obtain a converted video signal; if the acquired video signal is in RGB format, the RGB format video signal can be converted to YUV format, which is beneficial to efficient image processing at the back end.

[0115] A serialization module 212 is configured to add a frame number to each frame of the converted video signal to obtain serialized video frame data;

[0116] The copy module 213 is used to copy the serialized video frame signal, and send the copied serialized video frame signal to the shallow compression module 221 and the deep compression module 222 for compression processing to obtain a shallowly compressed video signal and a deeply compressed video signal.

[0117] In this embodiment, a frame number is added to each frame image in the video signal in order to ensure the uniformity and orderliness of the video signal undergoing multi-channel compression processing, and to facilitate the rapid and orderly finding of the correspondence between the data frames of different video signals when the multiple video signals are subsequently processed, thereby enabling rapid switching of different video signals for output and improving the video transmission processing speed.

[0118] Specifically, in this embodiment, for converting a video signal from an RGB color space to a YUV color space, the component conversion formulas may be performed in the following manner, but are not limited to this manner:

[0119] Y = 0.298R + 0.612G + 0.117B;

[0120] U=-0.168R-0.330G+0.498B+128;

[0121] V=0.449R-0.435G-0.083B+128.

[0122] Specifically, in this embodiment, the position for adding the frame number can be set at the Y component of the first row of each frame image. The frame number of each frame image starts from 0, increases to 255, and then cycles to 0, and so on.

[0123] During the transmission process of video signal compression or decompression, pixel scanning typically begins at the first row of the image frame. Frame codes are added to the first row of each frame to reduce marking time and enable quicker frame location during subsequent decompression and reception, thereby increasing video transmission speed. Furthermore, the frame numbers in the video signal start at 0, increment to 255, and then return to 0. This allows for the recycling of frame numbers, allowing for a more controlled number of frame numbers and reducing the space occupied by frame numbers within the image frame.

[0124] Example 4

[0125] like Figure 7 As shown, this embodiment provides a distributed dual-stream video receiving and processing system, including:

[0126] The video receiving module 300 is configured to receive the shallowly compressed video signal and the deeply compressed video signal described in Embodiment 1;

[0127] A decompression module is used to decompress the shallowly compressed video signal and the deeply compressed video signal using corresponding decompression algorithms to obtain shallowly decompressed video signals and deeply decompressed video signals; the decompression algorithms correspond to the shallow compression algorithm and the deep compression algorithm in Example 1, respectively.

[0128] The fusion module 500 is used to monitor the operation status of the decompression process, and determine the final output solution of the video signal based on the operation status and the combination of the shallowly decompressed video signal and the deeply decompressed video signal.

[0129] Specifically, the decompression module includes:

[0130] A shallow decompression module 410 is configured to decompress the shallowly compressed video signal using a shallow decompression algorithm to obtain a shallowly decompressed video signal;

[0131] The deep decompression module 420 is configured to decompress the deeply compressed video signal using a deep decompression algorithm to obtain a shallowly decompressed video signal.

[0132] Specifically, in this embodiment, a D / A module may be provided after the fusion module 500 to reconvert the digital video signal into an analog video signal output, and then output it to the display screen via a video cable for display.

[0133] Specifically, the fusion module 500 determines the final output solution of the video signal in the following steps:

[0134] Monitor the interrupt signal of the shallow decompression process;

[0135] When no interrupt signal of the shallow decompression process is received, the shallowly decompressed video signal is received and output;

[0136] When an interrupt signal of the shallow decompression process is received, the video signal after shallow decompression is switched to the video signal after deep decompression for output;

[0137] When the interrupt signal of the shallow decompression process disappears, the video signal after shallow decompression is switched back to output.

[0138] Specifically, such as Figure 8 As shown in the schematic diagram, upon receiving an interrupt signal from the shallow decompression process, the fusion module 500 implements a process flow for switching and outputting the shallow and deep decompressed video signals, including:

[0139] Assume that the current moment is between the output frame numbered Nth frame after shallow decompression of the video signal and the frame numbered N+1th frame after shallow decompression of the video signal, and that M-1 frames of video signal can be output within the duration of the interrupt signal of the shallow decompression process;

[0140] When an interrupt signal of the shallow decompression process is received at the current moment, the shallow decompression process is switched from receiving the shallowly decompressed video signal to receiving the deeply decompressed video signal, and the deep decompressed video signal is output starting from the N+1th frame until the shallow decompression interrupt signal disappears when the deep decompression video signal is output at the N+M-1th frame;

[0141] When the interrupt signal of the shallow decompression process disappears, the process switches to receiving the N+Mth frame of the shallowly decompressed video signal for output.

[0142] During the decompression process of the compressed video signal, if an abnormal interruption occurs, the final output video signal will be stuck or have frames dropped, resulting in flickering or black screen, and these problems will have a serious impact on the user. In this embodiment, the video signals after shallow and deep compression are both decompressed to obtain shallow decompressed video signals and deep decompressed video signals, respectively, and the operation of the decompression process is continuously monitored. When no interruption signal is received, the shallow decompressed video signal is output first. When an interruption signal of the shallow decompression process is received, it means that the shallow decompressed video signal has an output abnormality, and the video signal is switched to the deep decompressed video signal that is decompressed synchronously in time. The image frame at the corresponding position is quickly found according to the frame number and outputted until the interruption signal disappears, and then the output is switched back to the shallow decompressed video signal. This embodiment simultaneously decompresses the video signals after shallow and deep compression processing to obtain shallowly decompressed video signals and deeply decompressed video signals, thereby achieving redundancy in video signal transmission. Even if an abnormal interruption occurs in the shallow decompression process, it can effectively ensure that the final output video signal is continuous, thereby solving the problem of frame loss.

[0143] In addition, the fusion module 500 in this embodiment can also realize real-time preview of multi-channel video signals, so that when the operator switches the video signal, he can select which signal to switch through the real-time signal preview interface, which greatly improves the operator's experience.

[0144] Generally speaking, after a 1920x1080@60 video signal undergoes a shallow compression algorithm, its bit rate is above 300Mbps. Therefore, if you want to achieve 8-channel video real-time preview, the required transmission bandwidth is at least 2400Mbps, which far exceeds the transmission bandwidth of Gigabit Ethernet. Therefore, the 8-channel video real-time preview adopts a deep compression algorithm, which requires a bandwidth of less than 50Mbps. When one channel of shallowly compressed video signal is superimposed, the total bandwidth is 300Mbps+50Mbps=350Mbps, which is less than the transmission bandwidth of Gigabit Ethernet. The specific implementation principle is as follows: Figure 9 As shown, the fusion module 500 receives the 8-channel video signal output by the deep decompression module 420, and at the same time receives the video signal output by the shallow decompression module 410. After internal superposition processing, the 8-channel video preview signal is superimposed on the shallow decompressed video signal. At the same time, in order to achieve this processing without introducing delay, the superposition process uses the pixel clock alignment of the shallow decompressed video signal.

[0145] Example 5

[0146] This embodiment provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, it implements the distributed dual-stream video sending processing method described in Example 1 or the distributed dual-stream video receiving processing method described in Example 2.

[0147] Obviously, the above embodiments of the present invention are merely examples for the purpose of clearly illustrating the technical solutions of the present invention, and are not intended to limit the specific implementation methods of the present invention. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the claims of the present invention shall be included within the scope of protection of the claims of the present invention.

Claims

1. A distributed dual-stream video receiving and processing method, characterized in that: include: receiving a shallowly compressed video signal and a deeply compressed video signal; Decompressing the shallowly compressed video signal and the deeply compressed video signal using corresponding decompression algorithms to obtain a shallowly decompressed video signal and a deeply decompressed video signal; Monitor the interrupt signal of the shallow decompression process; when no interrupt signal of the shallow decompression process is received, receive the shallowly decompressed video signal for output; When an interrupt signal of the shallow decompression process is received, the video signal after shallow decompression is switched to the video signal after deep decompression for output; When the interrupt signal of the shallow decompression process disappears, the video signal after shallow decompression is switched back to output; Specifically, it is assumed that the current moment is between the output frame numbered as the shallowly decompressed video signal of the Nth frame and the output frame numbered as the shallowly decompressed video signal of the N+1th frame, and M-1 frames of video signal can be output within the duration of the interrupt signal; When an interrupt signal of the shallow decompression process is received at the current moment, the shallow decompression process is switched from receiving the shallowly decompressed video signal to receiving the deeply decompressed video signal, and the deep decompressed video signal is output starting from the N+1th frame until the shallow decompression interrupt signal disappears when the deep decompression video signal is output at the N+M-1th frame; When the interrupt signal of the shallow decompression process disappears, the process switches to receiving the N+Mth frame of the shallowly decompressed video signal for output.

2. A distributed dual-stream video transmission and processing method, characterized in that: include: Acquire video signal; The acquired video signal is copied, and the copied video signals are compressed using different compression algorithms to obtain a plurality of compressed video signals; The several compressed video signals are used to be sent to a receiving and processing system, so that the receiving and processing system adopts a distributed dual-stream video receiving and processing method as described in claim 1, respectively receives and decompresses the several compressed video signals, and monitors the operation status of the decompression process. According to the operation status, combined with the several decompressed video signals, the final output scheme of the video signal is determined.

3. The distributed dual-stream video transmission and processing method according to claim 2, characterized in that: The compression algorithm includes a shallow compression algorithm and a deep compression algorithm; The acquired video signal is copied, and the copied video signals are compressed using different compression algorithms to obtain video signals after compression of several paths, specifically including: The acquired video signal is copied, and the copied video signal is compressed using a shallow compression algorithm and a deep compression algorithm respectively to obtain a shallowly compressed video signal and a deeply compressed video signal.

4. A distributed dual-stream video transmission and processing method according to claim 3, characterized in that: The obtained video signal is copied, and the copied video signal is compressed using a shallow compression algorithm and a deep compression algorithm respectively to obtain a shallowly compressed video signal and a deep compressed video signal, specifically including: Adding a frame number to each frame image in the acquired video signal to obtain a serialized video frame signal; The serialized video frame signal is copied, and the copied serialized video frame signal is compressed using a shallow compression algorithm and a deep compression algorithm respectively to obtain a shallowly compressed video signal and a deep compressed video signal.

5. A distributed dual-stream video transmission and processing method according to claim 4, characterized in that: Add a frame number to each frame of the acquired video signal to obtain serialized video frame data, specifically including: Converting the acquired video signal from the RGB color gamut space to the YUV color gamut space to obtain a converted video signal; A frame number is added to each frame image of the converted video signal to obtain serialized video frame data.

6. A distributed dual-stream video transmission and processing system, characterized in that: include: A video acquisition module, used to acquire video signals; A processing module is used to copy the acquired video signal, and compress the copied video signals using different compression algorithms to obtain multiple compressed video signals; The several compressed video signals are used to be sent to a receiving and processing system, so that the receiving and processing system adopts a distributed dual-stream video receiving and processing method as described in claim 1, respectively receives and decompresses the several compressed video signals, and monitors the operation status of the decompression process. According to the operation status, combined with the several decompressed video signals, the final output scheme of the video signal is determined.

7. A distributed dual-stream video receiving and processing system, characterized in that: include: A video receiving module, configured to receive shallowly compressed video signals and deeply compressed video signals; a decompression module, configured to decompress the shallowly compressed video signal and the deeply compressed video signal using corresponding decompression algorithms to obtain a shallowly decompressed video signal and a deeply decompressed video signal; The fusion module is used to monitor the interrupt signal of the shallow decompression process; when no interrupt signal of the shallow decompression process is received, the shallow decompressed video signal is received and output; When an interrupt signal of the shallow decompression process is received, the video signal after shallow decompression is switched to the video signal after deep decompression for output; When the interrupt signal of the shallow decompression process disappears, the video signal after shallow decompression is switched back to output; Specifically, it is assumed that the current moment is between the output frame numbered as the shallowly decompressed video signal of the Nth frame and the output frame numbered as the shallowly decompressed video signal of the N+1th frame, and M-1 frames of video signal can be output within the duration of the interrupt signal; When an interrupt signal of the shallow decompression process is received at the current moment, the shallow decompression process is switched from receiving the shallowly decompressed video signal to receiving the deeply decompressed video signal, and the deep decompressed video signal is output starting from the N+1th frame until the shallow decompression interrupt signal disappears when the deep decompression video signal is output at the N+M-1th frame; When the interrupt signal of the shallow decompression process disappears, the process switches to receiving the N+Mth frame of the shallowly decompressed video signal for output.

8. An electronic device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the distributed dual-stream video sending and processing method according to any one of claims 2 to 5 or the distributed dual-stream video receiving and processing method according to claim 1 is implemented.

Images