3 results about "Video texture" patented technology

The present application relates to the technical field of image processing, and more particularly to a video decoding and Unreal Engine rendering method based on GPU full-link zero-copy, which comprises the following steps: step one, hardware decoding of an input video code stream on a GPU, and construction of a motion vector description buffer for storing compressed domain motion vector information in macroblock order; step two, reading of the motion vector description buffer by a calculation shader on the GPU to generate a dynamic special effect control buffer corresponding to each macroblock; and step three, in the post-processing material of the Unreal Engine rendering module, taking a shared video texture resource as an input texture and outputting a video picture. The present application realizes unified management of pixel data and motion data without relying on a host processor and without excessively occupying video memory bandwidth, significantly reduces delay, and improves special effect stability and direction consistency.

Embodiments of the present disclosure provide a video texture migration method and device, electronic equipment and storage medium, which obtain an original video, perform feature extraction on a target frame in the original video to generate first feature information of the target frame, wherein the target frame is a video frame after an Nth video frame in the original video, and the first feature information represents an image structure contour of the target frame; perform feature fusion on the first feature information of the target frame and reference feature information to obtain second feature information of the target frame, wherein the reference feature information is used to represent an image structure contour of a reference frame, the reference frame is a video frame before the target frame, and the second feature information is the first feature information without random noise; and generate a texture migration video according to the second feature information of the target frame and corresponding texture feature information, wherein the texture feature information represents image texture details of a reference image, thereby avoiding frame flickering and improving the display effect of the texture migration video.

The application discloses a multi-view video saliency prediction method fusing spatial audio, a medium and equipment, and adopts an audio-video multi-modal fusion and cross-view alignment scheme.The application acquires time-synchronous multi-view video and audio signals and constructs a view order relationship, extracts video texture and motion feature fusion to obtain visual representation; the audio signal is subjected to time-frequency transformation and multi-scale coding to obtain audio content spectrum features.Through a sound source energy distribution estimation module, audio-video correlation features are modeled, multi-modal features are fused to obtain single-view saliency features; cross-view saliency alignment is completed relying on a bidirectional feature propagation mechanism, each view saliency distribution map is generated, and network training is performed through pixel-level loss supervision.The application fuses spatial audio semantic information, makes up for the defects of a single visual modal, improves the precision, robustness and view consistency of multi-view video saliency prediction, and is suitable for multimedia perception, intelligent visual detection and other scenes.