Video image restoration method, device and storage medium

Abstract

The present invention provides a video image repair method, device and storage medium, wherein the method includes: obtaining smooth blocks and edge blocks to be repaired in the received video frame, performing interpolation repair on the smooth blocks, using the edge blocks to be repaired The repaired image trains an adversarial network model, uses the trained adversarial network model to repair the image to be repaired in the edge block, and generates a repaired video frame. The video image repair method, device and storage medium of the present invention can reduce the data processing burden of the sender and the transmission pressure of the channel, avoid transmission delay, greatly reduce the complexity of model training, and ensure repair effect and improve repair efficiency.

Description

technical field [0001] The present invention relates to the technical field of image processing, and in particular, to a video image restoration method, device and storage medium. Background technique [0002] In the context of the rapid development of Internet and video services, and the rapid expansion of data volume due to 4K / 8K services, higher requirements are put forward for the reliability of CDN video quality. In the transmission of video in the existing IPTV system, once a bit error (Bit Error) or a packet loss (Packet Loss) occurs, the video quality will drop sharply (for example, a phenomenon such as a blurry screen occurs), which affects the user's viewing experience. For such problems, error control technologies such as FEC (Forward Error Correction) and ARQ (Automatic Repeat Request) and error concealment technologies are usually used to repair them. For example, based on the FEC principle, adding redundant data to the data sent by the sender has the disadvant...

AI Technical Summary

Problems solved by technology

For example, based on the FEC principle, adding redundant data to the data sent by the sender will occupy a certain amount of additional bandwidth; based on the ARQ principle, the packet loss retransmission request sent by the receiver to the packet loss retransmission server will Brings additional transmission delay, increases channel transmission pressure, and in bad channels, video transmission errors will still be unavoidable

For the error concealment technology, the improved interpolation method is usually used to conceal the error data, but it affects the recovery effect of the overall image feature law, and the restoration effect on the content of the pixel changes is not good.

Images