Video error masking method combined with 3D human face model

Abstract

The invention discloses a video error concealment method by integrating a 3D human face model, which can be used in the field of video telephone applications to process the errors occur during the video transmission by the error concealment in order to improve the subjective visual quality of the damaged region of the face image. some key feature points of the face are acquired and used in adjusting the 3D facial model, the position and shape information is established according to the key feature points, and the texture information of the model is also updated according to the current frame during the adjusting process, so as to achieve the specific 3D facial model which is corresponding to the matching of the current frame face image. The integration of the pre-conceal idea and the specific 3D facial model realizes more accurate concealment the for human face region, meanwhile the background region still adopts the traditional concealment method, and finally the combining edge between the face and the background adopts certain smoothing treatment measures, so as to significantly improve the concealment performance and subjective quality.

Description

technical field [0001] The invention belongs to the field of video transmission error recovery, and in particular relates to a method for recovering face image information lost during transmission at a video decoding end to improve video decoding quality. Background technique [0002] With the popularization and development of the Internet and wireless communication networks, more and more digital video signals are transmitted through such channels. Due to various channel and network errors, compressed video data will be damaged or lost during transmission or storage. In order to ensure the robustness of video transmission, an error recovery mechanism must be introduced. Error concealment technology (also known as error concealment, error concealment, etc.) is an error concealment method aimed at the decoding end. It mainly uses the characteristics that the human eye can tolerate a certain degree of image distortion, and uses the correlation of information in the time domain...

AI Technical Summary

Problems solved by technology

However, for the errors that occur in video transmission in these videophone application fields, the traditional error concealment method is basically used to cover up at present. Because the particularity of this type of application is not considered, the concealment effect is not satisfactory, especially for humans. There is a large error in the face area, and the masking effect is worse when the movement is violent or there are other disturbances (such as microphone movement, occluding the face, etc.)

Images