Video frame scale transformation heterogeneous system and method
Through the video frame-scale transformation heterogeneous system and IFPWRR algorithm, video streaming transmission is optimized, and the traditional audio and video encoding formats are solved, and the efficient transmission and high-quality decoding of high-definition video streams are achieved.
Patent Information
- Application Number
- CN202310844607.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-07-11
- Publication Date
- 2025-01-14
AI Technical Summary
Traditional audio and video encoding formats are not suitable for network transmission, resulting in excessive burden on network bandwidth and CPU/GPU processing, especially in high-definition network video applications.
The video frame scale transform heterogeneous system is adopted to distinguish the video stream data frame types through the IFPWRR algorithm, and the data packets are weighted on multiple reliable paths according to the principle of I-frame and the first packet of each frame, optimize transmission, and simulate the reality with the simulation system. Network transmission scenarios to reduce latency and bandwidth usage.
It realizes optimized encoding and decoding, reduces CPU/GPU burden, improves video streaming quality and reliability, and is suitable for high-definition network video applications.
Smart Images
Figure CN119316359A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of video data transmission, and in particular to a video frame scale transformation heterogeneous system and method. Background Art
[0002] The Internet is an important source of information for people. Multimedia forms such as text, pictures and videos carry most of the information content. Among these multimedia forms, audio and video are the best carriers, and this is also the way people are more likely to accept information. However, the encoding format of audio and video is not specially designed for network transmission. The traditional DAT video format is designed for CD data storage. Videos encoded in this format need to obtain the complete file information before they can be played normally. Such a design is not suitable for applications such as network video on demand.
[0003] Audio and video enrich the information content of communication, but on the other hand, they also increase the network bandwidth and the processing burden of computer CPU / GPU. In terms of bandwidth, compared with text, video occupies a large amount of network bandwidth; in terms of CPU / GPU burden, text processing basically does not consume CPU, while video processing involves a process of encoding, compression, transmission, decoding, and playback. Especially with the increasing application of high-definition network video, this process will impose a heavier burden on the CPU / GPU. Summary of the invention
[0004] 1. Technical issues to be resolved
[0005] In view of the deficiencies of the prior art, the present invention provides a video frame scale transformation heterogeneous system and method, which has the advantages of optimizing encoding / decoding and transmitting video, reducing the burden on the CPU / GPU, and solving the problems raised in the above background technology.
[0006] (II) Technical solution
[0007] The present invention provides the following technical solutions: a video frame scale conversion heterogeneous system and method, including a video source, the video source is compressed and encoded and then transmitted through a network, and then transmitted to a video receiver for playback after decoding. In order to use reliable paths in a balanced manner and more effectively transmit video stream data, an IFPWRR algorithm is proposed. The algorithm distinguishes the frame types of video stream data, and according to the principle of limited I frames and limited first data packets of each frame, weightedly distributes data packets to multiple reliable paths according to packet loss rate for optimized transmission, thereby ensuring that the most important data in the video decoding process can be transmitted most completely, while also taking into account the load balancing on each path, and ultimately improving the quality of video stream transmission. The system also includes a video stream transmission simulation system, the simulation system consists of a simulation input data preparation module, a video stream transmission simulation module and a simulation output data processing module. The system is implemented based on a Linux operating system. The processing logic of the simulation system is to detect that the video stream data to be transmitted is encoded using FFmpeg, and simulate the transmission process of a real network through a simulation scene established by ns-3, and record the intermediate output during the simulation process and the output data after the simulation is completed into a file. Finally, the simulation effect is obtained and illustrated by analyzing the script and the program.
[0008] Preferably, the video stream transmission simulation module can simulate the transmission scenario of video stream data in a real network, and can output not only macro data such as packet loss and delay size during transmission, but also detailed data such as when and why a specific node discarded a certain data packet.
[0009] Preferably, the input data for simulation needs to be provided by a simulation input data preparation module, which provides various input parameters required for simulation and video data to be transmitted, and the video data is generated by encoding the original video file.
[0010] Preferably, the simulation output data processing module is responsible for analyzing and decoding the received video data packets: the analysis work is to calculate and process the packet loss situation of the original video data packets; the decoding work is to perform distortion decoding based on the received video data packet sequence, and compare the decoded video with the original video to calculate the video quality loss.
[0011] Preferably, a script is convenient for processing data in a Linux system. The present system is also composed of various scripts. The script can realize one-key simulation by calling a series of encoding and decoding programs, simulation programs and drawing programs.
[0012] Preferably, the video stream sending end connects the video encoding with the simulation, simulates the sending of the encoded data in the simulation system, and acts as a real video stream server function.
[0013] Preferably, the video stream receiving end will continuously monitor whether the port has received a data packet through the listening port set in the simulation. After receiving the data packet, it will automatically call the corresponding callback method to process it, that is, identify the identifier of the data packet, and identify it after verification. After verification, it means that the number of reports has been successfully transmitted from the video stream sending end to the receiving end through the heterogeneous network.
[0014] Preferably, heterogeneous network services need to establish a network environment for video stream transmission in simulation, and also need to provide interfaces for the simulation process to call; in terms of setting up the network environment, it is divided into setting up the Internet and setting up the LTE network. At the same time, the heterogeneous network needs to provide external calling interfaces to obtain each network node and IP address and set different routing schemes.
[0015] Compared with the prior art, the present invention provides a video frame scale conversion heterogeneous system and method, which has the following beneficial effects:
[0016] The heterogeneous system and method for video frame scale transformation is studied based on the video stream transmission technology of heterogeneous networks, mainly involving the selection of reliable paths in video stream transmission, the study of influencing factors of video stream transmission in heterogeneous networks, and multi-path load balancing processing of video stream transmission, optimizing encoding / decoding and compressing transmission video, combining mobile Internet technology, reducing the bandwidth occupied by video transmission during network video transmission, reducing the delay of video transmission, and comprehensively improving the video quality of the receiving end. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Figure 1 Schematic diagram of the video stream transmission process of the present invention. DETAILED DESCRIPTION
[0018] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0019] See also Figure 1A video frame scale transformation heterogeneous system and method, including a video source, which is compressed and encoded and then transmitted through a network, and then decoded and transmitted to a video receiver for playback. The system also includes a video stream transmission simulation system, which consists of a simulation input data preparation module, a video stream transmission simulation module and a simulation output data processing module. The system is implemented based on the Linux operating system. The processing logic of the simulation system is to detect the video stream data to be transmitted and encode it using FFmpeg, and simulate the transmission process of the real network through the simulation scene established by ns-3, and record the intermediate output during the simulation process and the output data after the simulation is completed into a file, and finally obtain the simulation effect and illustrate it by analyzing the script and program.
[0020] In the current complex network, multiple reliable paths can often be found. In order to use reliable paths in a balanced manner to transmit video stream data more effectively, the IFPWRR algorithm is proposed. This algorithm distinguishes the frame types of video stream data and, in accordance with the principle of limited I frames and limited first data packets of each frame, weights the data packets according to the packet loss rate to optimize transmission. This ensures that the most important data in the video decoding process can be transmitted most completely, while also taking into account the load balancing on each path, and ultimately improving the quality of video stream transmission.
[0021] The video stream transmission simulation module can simulate the transmission scenario of video stream data in a real network. It can output macro data such as packet loss and delay size during transmission, as well as detailed data on when and why a specific node discarded a data packet. The input data for simulation needs to be provided by the simulation input data preparation module. This module provides various input parameters required for simulation and video data to be transmitted. The video data is generated by encoding the original video file. The simulation output data processing module is responsible for analyzing and decoding the received video data packets: the analysis work is to calculate the packet loss of the original video data packets; the decoding work is to perform distortion decoding based on the received video data packet sequence, and compare the decoded video with the original video to calculate the video quality loss. It is convenient to use scripts to process data in the Linux system. This system is also composed of various scripts. The scripts are passed through By calling a series of encoding and decoding programs, simulation programs and drawing programs, one-click simulation can be achieved; the video stream sending end connects video encoding with simulation, and simulates the sending of the encoded data in the simulation system, acting as a real video stream server function; the video stream receiving end uses the listening port set in the simulation, and the receiving end will continuously listen to whether the port receives the data packet, and automatically call the corresponding callback method to process it after receiving the data packet, that is, to identify the identifier of the data packet, and after verification, it is the identifier, and after verification, it indicates the number of times the report is successfully transmitted from the video stream sending end to the receiving end through the heterogeneous network; heterogeneous network services need to establish a network environment for video stream transmission in the simulation, and also need to provide an interface for the simulation process to call; in terms of building the network environment, it is divided into building the Internet and building the LTE network. At the same time, the heterogeneous network needs to provide an external calling interface to obtain each network node and IP address and set different routing schemes.
[0022] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.
Claims
1. A video frame scaling heterogeneous system, characterized by: The invention includes a video source, which is transmitted through the network after being compressed and encoded, and then transmitted to the video receiver for playback after being decoded. In order to use reliable paths in a balanced manner and transmit video stream data more effectively, an IFPWRR algorithm is proposed. The algorithm distinguishes the frame types of video stream data and distributes the data packets to multiple reliable paths according to the packet loss rate according to the principle of limited I frames and limited first data packets of each frame to optimize transmission, thereby ensuring that the most important data in the video decoding process can be transmitted most completely, while also taking into account the load balancing on each path, and ultimately improving the quality of video stream transmission; The system also includes a video stream transmission simulation system, which consists of a simulation input data preparation module, a video stream transmission simulation module and a simulation output data processing module. The system is implemented based on the Linux operating system. The processing logic of the simulation system is to detect the video stream data to be transmitted and encode it using FFmpeg, and simulate the transmission process of the real network through the simulation scene established by ns-3, and record the intermediate output during the simulation process and the output data after the simulation is completed into a file. Finally, the simulation effect is obtained and illustrated by analyzing the script and program.
2. The video frame scaling heterogeneous system according to claim 1, characterized in that: The video stream transmission simulation module can simulate the transmission scenario of video stream data in a real network. It can output not only macro data such as packet loss and delay size during the transmission process, but also detailed data such as when and why a specific node discarded a certain data packet.
3. The video frame scaling heterogeneous system according to claim 1, characterized in that: The input data for simulation needs to be provided by the simulation input data preparation module. This module provides various input parameters required for simulation and video data to be transmitted. The video data is generated by encoding the original video file.
4. The video frame scaling heterogeneous system according to claim 1, characterized in that: The simulation output data processing module is responsible for analyzing and decoding the received video data packets: the analysis work is to calculate the packet loss of the original video data packets; the decoding work is to perform distortion decoding based on the received video data packet sequence, and compare the decoded video with the original video to calculate the video quality loss.
5. The video frame scaling heterogeneous system according to claim 1, characterized in that: The most convenient way to process data in Linux system is to use scripts. This system is also composed of various scripts. The scripts can realize one-click simulation by calling a series of encoding and decoding programs, simulation programs and drawing programs.
6. The video frame scaling heterogeneous system according to claim 1, characterized in that: The video stream sender connects the video encoding with the simulation, and simulates the sending of the encoded data in the simulation system, acting as a real video stream server.
7. The method of claim 1, wherein: The video stream receiving end will set up a listening port in the simulation. The receiving end will continuously monitor whether this port receives a data packet. After receiving the data packet, it will automatically call the corresponding callback method to process it, that is, identify the identifier of the data packet. After verification, it will be identified. After verification, it means that the number of reports has been successfully transmitted from the video stream sending end to the receiving end through the heterogeneous network.
8. The method of claim 7, wherein: Heterogeneous network services need to establish a network environment for video stream transmission in simulation, and also need to provide interfaces for the simulation process to call; in terms of setting up the network environment, it is divided into setting up the Internet and setting up the LTE network. At the same time, the heterogeneous network needs to provide external calling interfaces to obtain each network node and IP address and set different routing solutions.