Real-time foreground object shadow generation method based on video image

Abstract

The invention discloses a foreground object shadow real-time generation method based on a video image, and the method comprises the steps: S1, solving a maximum external matrix of a foreground object extracted from the video image, and carrying out the distortion deformation of the object in the horizontal and vertical directions according to the light source position and the illumination direction, and generating a shadow map; S2, calculating the corresponding points of points on the foreground object on shadows on the planes to form a pair of feature points, obtaining multiple pairs of feature points through calculation in the same way, obtaining a transformation matrix between different planes through calculation by means of the multiple pairs of feature points, and determining the position and direction of the shadow of the object through the transformation matrix, wherein in the step, at least two points on the foreground object are selected as reference points; S3, calculating coordinates and the like of pixel points corresponding to all pixel points in the foreground object in the shadow area by using the transformation matrix in the step S2. According to the method, the problems of virtual studios, background fusion before image matting, object shadow missing or inconsistency in video image later editing and the like are solved.

Description

technical field [0001] The invention relates to the field of video image processing, and more specifically, to a method for generating shadows of foreground objects in real time based on video images. Background technique [0002] Object shadows are a common optical phenomenon. Adding foreground object shadows in applications such as post-editing of video images, background fusion before keying, and augmented reality can enhance the realism of video images and improve visual experience. In recent years, related technologies such as virtual studio, video image segmentation, and keying synthesis have developed rapidly, and they have been widely used in the fields of television and movies, variety entertainment, live broadcast, and military affairs. Whether it is the fusion of the foreground and background of 2D video images or the fusion of 3D virtual objects and real scenes, object shadows are an important element to enhance the sense of reality. Without shadows, objects appe...

AI Technical Summary

Problems solved by technology

[0008] The purpose of the present invention is to overcome the deficiencies of the prior art, provide a method for real-time generation of shadows of foreground objects based on video images, and solve the problems of virtual studios, background fusion before keying, and missing or inconsistent shadows of objects in post-editing of video images, etc.

Images