Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Content based video package priority assignment method

An allocation method and priority technology, applied in the field of video transmission technology utilization, can solve problems such as affecting the perceived quality of transmitted video

Active Publication Date: 2017-11-21
SHANGHAI UNIV
View PDF5 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Different packaging strategies and error recovery mechanisms can also affect the perceived quality of transmitted video

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Content based video package priority assignment method
  • Content based video package priority assignment method
  • Content based video package priority assignment method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0050] Embodiment one: see Figure 1~6 , a content-based video packet priority assignment method, comprising the steps of:

[0051] a. Primary allocation of stream packet priority;

[0052] b. Spatial perception importance extraction: after the primary allocation of each frame image, calculate the salience and corresponding SSIM of each slice, and use the salience as the weighting factor of SSIM to represent the spatial perception quality, and the larger the value, the more important the spatial perception the higher the sex;

[0053] c. Binarize the value of spatial perception quality obtained in step b, and divide the video image into a salient area, which is set to "1" and a non-salient area, which is set to "0"; for each slice, the binary value Normalize the result, if it is non-zero, then the slice is judged to be spatially perceptually significant, otherwise it is non-perceptually significant;

[0054] d. Time domain perception importance extraction: Calculate the amp...

Embodiment 2

[0059] Step 1. Primary allocation of code stream packet priority: When 5 consecutive packets are lost, set the priority of the next packet to be high, and the priority index is directly written into the NAL header file; then judge the data type, if it is a parameter set, it has the highest priority; if it is an I, P frame, give it the second highest priority; if it is a B frame, go to step b. The code stream after video encoding takes NAL as the unit. During the transmission process of the code stream in the channel, the NAL header file of each data packet is first analyzed to determine its basic data type. If it is parameter set (PPS, SPS, VPS) information, which contains the encoding information of the entire video, it has the highest priority, ensuring that it cannot be lost during transmission; if it is I frame or P frame data, as a reference for subsequent frames, it has The second-highest priority, and the proportion of I frames and P frames in the video is relatively sm...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a content based video package priority assignment method. First, an initial slice priority sequence is obtained according to an NAL type. The priority of parameter set is the highest and the priority of I frame and P frame is second to the highest level. Then structural similarity of significance weight is used for indicating space domain perception importance and motion activity is used for indicating time domain perception importance, and space time domain perception priority is obtained through combination. The priority information is written into an NAL head file, so that external code flow cost is avoided. Channel analysis is performed on the NAL head file, and NAL type and time space domain perception priority indicators are acquired, so that the priority of each video package is determined. In a packet dropout network environment, packages with low priority are dropped first and video packages with high priority are protected. Error concealment is performed by adopting a simple method of copying the former frame at a decoding end, and then a decoded video is obtained. According to the invention, in a condition with identical package dropout rate, the video quality is higher than that employing a random package dropout method, so that video transmission robustness is improved.

Description

technical field [0001] The invention relates to a method for improving the robustness of video transmission, in particular to a packet loss method based on video content for priority allocation of packets, which is applied to the utilization of video transmission technology. Background technique [0002] When video streams are transmitted on the network, there are many factors that can cause video packet loss, such as network congestion, delay, and so on. Existing video coding methods such as HEVC use technologies such as intra-frame prediction, inter-frame prediction, and quantization. The loss of a certain frame may affect the decoding of other frames, resulting in error propagation and serious degradation of video quality. Therefore, the visual impact caused by different packet loss is different. By studying the error tolerance of different packet loss situations to establish a video packet priority transmission model, the impact of packet loss on video quality can be red...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N19/167H04N19/17H04N19/37H04N21/234H04L29/06
CPCH04L69/22H04N19/167H04N19/17H04N19/37H04N21/23418
Inventor 王永芳朱芸朱康华
Owner SHANGHAI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products