Holographic cabinet, dynamic virtual image video processing method and image processing method

Abstract

A method for processing a video of a dynamic virtual image with a shadow, a method for processing an image of a dynamic virtual image with a shadow, and a holographic cabinet are disclosed. The method for processing the video of a dynamic virtual image with a shadow includes the following steps: Step (1) acquiring an initial video of the virtual dynamic image; Step (2) generating a shadow corresponding to the dynamic posture of the virtual dynamic image in the initial video of Step (1) using processing software, thereby obtaining a shadow video corresponding to the dynamic image; Step (3) synchronously projecting the shadow video of Step (2) and the initial video of Step (1) onto the holographic cabinet, and displaying the virtual dynamic image with a shadow on the holographic cabinet. In this invention, the virtual dynamic image in the initial video of the virtual dynamic image is accompanied by a shadow during the display process, thereby making the virtual dynamic image more realistic and the 3D effect more realistic when viewed with the naked eye.

Description

Technical Field

[0001] This invention relates to the field of virtual human display technology, and in particular to a method for processing dynamic virtual image videos with shadows, a method for processing dynamic virtual image images with shadows, and a holographic cabinet. Background Technology

[0002] With the continuous development of technologies such as the internet, AI, and animation, the traditional method of using real people for scene introductions and demonstrations is gradually being replaced by virtual avatars. Virtual avatars can be virtual humans, virtual animals, virtual cartoon characters, etc. Using virtual avatars to introduce scenes in museums, stadiums, science and technology museums, etc., can overcome the shortcomings of real people, such as physical exertion and unnecessary waiting. With the advancement of technology, virtual avatars replacing real people in providing demonstrations and introductions have advantages such as realism and flexibility, and can also save human resources. Furthermore, it can expand application scenarios, such as remote virtual venue introductions via the internet, and nested virtual scene displays.

[0003] Virtual avatars in current technology are typically displayed inside holographic displays. A holographic display utilizes optical holography to generate virtual images. Specifically, it uses a directional, semi-transparent screen to display the optical holographic virtual image on its surface, thus forming a three-dimensional image. Currently, the expressions and movements of virtual humans displayed in holographic displays can highly simulate the form of a real human. However, existing virtual avatars do not exhibit the shadow effect under light; the displayed virtual avatars lack shadow effects, resulting in an overall less than ideal virtual avatar effect.

[0004] Therefore, in view of the shortcomings of the existing technology, it is necessary to provide a method for processing dynamic virtual image videos with shadows, a method for processing dynamic virtual image images with shadows, and a holographic cabinet to solve the shortcomings of the existing technology. Summary of the Invention

[0005] The first objective of this invention is to overcome the shortcomings of existing technologies by providing a method for processing dynamic virtual avatar videos with shadows. This method adds shadows during the display of the virtual avatar, thereby making the virtual avatar appear more realistic and providing a more immersive 3D effect when viewed with the naked eye.

[0006] The above-mentioned objectives of the present invention are achieved through the following technical measures:

[0007] A method for processing dynamic virtual avatar videos with shadows is provided, including the following steps:

[0008] Step (1): Obtain the initial video of the virtual avatar;

[0009] Step (2): Generate a shadow corresponding to the dynamic posture of the virtual dynamic image in the initial video of step (1) using processing software, and obtain the shadow video corresponding to the dynamic image.

[0010] Step (3): Simultaneously project the shadow video from step (2) and the initial video from step (1) onto the holographic cabinet, and display the virtual dynamic image with the shadow on the holographic cabinet.

[0011] Preferably, step (2) above includes the following steps:

[0012] Step (2.1): Import the initial video from step (1) into the processing software, then copy the virtual dynamic image as a shadow, add the DROP Shadow effect, and obtain the shadow layer;

[0013] Step (2.2): Create a new white solid layer. Based on the measurement data of the holographic cabinet, add a mask to cover the upper half of the shadow in the shadow layer of step (2.1). Only the lower half of the shadow in the shadow layer is shadowed, so that the white solid layer is on the first layer and the shadow layer is on the second layer. Then set the transparency and layer channel of the shadow layer.

[0014] Step (2.3): Duplicate the white solid layer and the shadow, so that the white solid layer is on the first layer and the shadow is on the second layer. Then set the opacity and layer channels of the shadow layer.

[0015] Step (2.4): Create a new Adjustment Layer and then adjust the effect;

[0016] Step (2.5): Duplicate the Adjustment Layer, and then adjust the Fast Radius, Iterations, and Blur Dimensions (blur direction).

[0017] Step (2.6): Duplicate the Adjustment Layer for the second time, and then adjust the Fast Radius, Iterations, and Blur Dimensions (blur direction).

[0018] Step (2.7): Combine the shadow layer and all adjustment layers into a single layer shadow, add the Bezier Warp effect, and generate the shadow video corresponding to the virtual dynamic image in the initial video of step (1).

[0019] Preferably, the processing software mentioned above is After Effects.

[0020] Preferably, the initial video is an initial video with an alpha channel.

[0021] Preferably, the above-mentioned holographic cabinet measurement data is the depth and corner position of the holographic cabinet matching box.

[0022] Preferably, step (3) above specifically involves merging the shadow video from step (2) with the initial video from step (1) into a single video and projecting it onto the holographic cabinet.

[0023] Preferably, step (3) above specifically involves adjusting the position of the shadow in the shadow video of step (2) in real time using the KINECT device to correspond to the position of the observer, and synchronously projecting the initial video of step (1) onto the holographic cabinet.

[0024] Preferably, step (3) above specifically includes the following steps:

[0025] Step (3.1): The KINECT device acquires and identifies the relative position of a single observer and the holographic cabinet in real time, and then sets the tracking coordinate point of the observer as S0(X0,Y0);

[0026] Step (3.2): Set the shadow in the current shadow video as a skeleton. The skeleton includes 3 nodes: head node A1, shadow corner node B1 and foot connection node C1. Obtain the midpoint S1(X1,Y1) of the connection line A1B1 between head node A1 and shadow corner node B1.

[0027] Step (3.3): When the position of S0(X0,Y0) changes, subtract the coordinates of S1(X1,Y1) in step (3.2) from the current coordinates of S0(X0,Y0) in real time to obtain the deformation point S2(X2,Y2). Then, take the deformation point S2(X2,Y2) as the midpoint connecting the top of the head and the corner of the shadow after deformation S2(X2,Y2), and keep the distance between the top of the head and the corner of the shadow unchanged and keep the coordinates of point C unchanged to obtain the deformed shadow. The three bone nodes of the deformed shadow are the top node A2, the corner of the shadow B2, and the foot connection node C.

[0028] Step (3.4): Modify the shadow video based on the deformed shadow obtained in step (3.3), and project the modified shadow video and the initial video in step (1) onto the holographic cabinet simultaneously.

[0029] A method for processing a video of a virtual avatar with a shadow according to the present invention includes the following steps: Step (1) obtaining an initial video of the virtual avatar; Step (2) generating a shadow corresponding to the dynamic posture of the virtual avatar in the initial video of Step (1) using processing software, thereby obtaining a shadow video corresponding to the avatar; Step (3) synchronously projecting the shadow video of Step (2) and the initial video of Step (1) onto a holographic display case, and displaying the virtual avatar with a shadow on the holographic display case. The virtual avatar in the initial video of the present invention adds a shadow during the display process, thereby making the virtual avatar more realistic and the 3D effect more realistic when viewing the virtual avatar with the naked eye.

[0030] The second objective of this invention is to overcome the shortcomings of existing technologies by providing a method for processing dynamic virtual avatar images with shadows. This method can generate shadows corresponding to the virtual avatar from the image frames of the initial video of the virtual avatar, making the virtual avatar appear more realistic and providing a more realistic 3D effect when viewed with the naked eye.

[0031] The above-mentioned objectives of the present invention are achieved through the following technical measures:

[0032] A method for processing dynamic virtual avatar images with shadows is provided, comprising the following steps:

[0033] Step (A): Select at least one frame from the initial video containing only virtual animated figures, define the image as a reference image, and import the reference image into Photoshop software;

[0034] Step (B): Offset the shadow in the reference image according to the light source angle, then adjust the segmentation ratio of the upper and lower halves of the shadow in the reference image according to the holographic cabinet measurement data, process the upper half of the shadow according to the light source angle, and finally merge the processed upper half of the shadow with the lower half of the shadow to obtain a dynamic virtual image with a shadow.

[0035] Preferably, step (B.1) above specifically includes the following steps:

[0036] Step (B.1.1): Select at least one frame from the initial video in step (A), define the image as a reference image, and import the reference image into the processing software;

[0037] Step (B.1.2): Offset the shadow in the reference image according to the light source angle, then adjust the segmentation ratio of the upper and lower halves of the shadow in the reference image according to the holographic cabinet measurement data, process the upper half of the shadow according to the light source angle, and finally merge the processed upper half of the shadow with the lower half of the shadow to obtain a dynamic virtual image with shadow.

[0038] Preferably, the above-mentioned holographic cabinet measurement data is the depth and corner position of the holographic cabinet matching box.

[0039] Preferably, the initial video is an initial video with an alpha channel.

[0040] Preferably, the above

[0041] Step (B.2) specifically includes the following steps:

[0042] Step (B.2.1): Define the reference image from step (B.1) as layer 1, then copy layer 1 to obtain layer 2, and set the grayscale of layer 2 to obtain the shadow in the reference image;

[0043] Step (B.2.2): Offset layer 2 according to the light source angle;

[0044] Step (B.2.3): Based on the measurement data of the holographic cabinet, divide layer 2 into upper and lower parts to obtain layer 3 containing the shadow of the upper body and layer 4 containing the shadow of the lower body;

[0045] Step (B.2.4): Connect the foot position in the lower half of the shadow of layer 4 to the foot position in layer 1, and use the tilt tool to tilt the foot position of layer 4.

[0046] Step (B.2.5): Connect the upper edge of the shadow in layer 3 with the lower edge of the shadow in layer 4 to form a merged layer 5;

[0047] Step (B.2.6): Scale layer 5 according to the angle of the light source;

[0048] Step (B.2.7): Adjust the opacity of layer 5;

[0049] Step (B.2.8): Blur layer 5.

[0050] In step (B.2.1), the grayscale processing method for layer 2 is to select color overlay in the blending options, and then set the values ​​of the R channel, G channel and B channel of the gray layer to 120-140 respectively.

[0051] In step (B.2.8), the blur tool in the filter options is used to blur layer 5, and the angle of motion blur is selected to be 25° to 30°.

[0052] In step (B.2.7), the transparency of layer 5 is adjusted to 60%–70%.

[0053] This invention discloses a method for processing a video containing a shadow-based dynamic virtual avatar, comprising the following steps: Step (A) Selecting at least one frame from an initial video containing only a virtual dynamic avatar, defining the image as a reference image, and importing the reference image into Photoshop software; Step (B) Offsetting the shadow in the reference image according to the light source angle, then adjusting the segmentation ratio of the upper and lower halves of the shadow in the reference image according to holographic cabinet measurement data, further processing the upper half of the shadow according to the light source angle, and finally merging the processed upper half of the shadow with the lower half of the shadow to obtain a dynamic virtual avatar image with a shadow. This invention generates a dynamic virtual avatar image with a shadow by acquiring at least one frame from an initial video containing a virtual dynamic avatar and then adding a shadow to this image, making the virtual dynamic avatar more realistic and providing a more realistic 3D effect when viewed with the naked eye.

[0054] The third objective of this invention is to overcome the shortcomings of existing technologies by providing a method for processing dynamic virtual avatar images with shadows. This method can generate shadows corresponding to the virtual avatar from the image frames of the initial video of the virtual avatar, making the virtual avatar appear more realistic and providing a more realistic 3D effect when viewed with the naked eye.

[0055] The above-mentioned objectives of the present invention are achieved through the following technical measures:

[0056] A holographic cabinet is provided, which uses the above-mentioned processing method for dynamic virtual image videos with shadows.

[0057] This invention provides a holographic display case that employs the aforementioned method for processing dynamic virtual image videos with shadows. When playing dynamic virtual image videos, the holographic display case adds shadows corresponding to the dynamic postures of the simulated dynamic image, thereby making the virtual dynamic image appear more realistic and the 3D effect more lifelike when viewed with the naked eye. Attached Figure Description

[0058] The invention will be further described with reference to the accompanying drawings, but the contents of the drawings do not constitute any limitation on the invention.

[0059] Figure 1 The image shows the result of a virtual dynamic image displayed in a holographic cabinet, obtained by a method for processing a video of a virtual image with a shadow.

[0060] Figure 2 This is a schematic diagram of step (2.1) in Example 2.

[0061] Figure 3 This is a schematic diagram of step (2.2) in Example 2.

[0062] Figure 4This is a schematic diagram of step (2.3) in Example 2.

[0063] Figure 5 This is a schematic diagram of step (2.6) in Example 2.

[0064] Figure 6 This is a schematic diagram of a video screenshot of a virtual dynamic image after adding a shadow, as shown in Example 2.

[0065] Figure 7 This is a schematic diagram of the shadow before deformation in Example 3.

[0066] Figure 8 This is a schematic diagram of the shadow after deformation in Example 3.

[0067] Figure 9 This is a schematic diagram of layer 1 and layer 2 in Example 5.

[0068] Figure 10 This is a schematic diagram of layer 3 and layer 4 in Example 5.

[0069] Figure 11 This is a schematic diagram of layer 5 in Example 5.

[0070] Figure 12 This is a schematic diagram of the dynamic virtual image with shadow in Example 5.

[0071] Figure 13 The virtual dynamic image result obtained by the processing method in Example 5 is shown in the figure. Detailed Implementation

[0072] The technical solution of the present invention will be further described in conjunction with the following embodiments.

[0073] Example 1

[0074] A method for processing dynamic virtual avatar videos with shadows includes the following steps:

[0075] Step (1): Obtain the initial video of the virtual avatar;

[0076] Step (2): Generate a shadow corresponding to the dynamic posture of the virtual dynamic image in the initial video of step (1) using processing software, and obtain the shadow video corresponding to the dynamic image.

[0077] Step (3): Simultaneously project the shadow video from step (2) and the initial video from step (1) onto the holographic cabinet, and display the virtual dynamic image with the shadow on the holographic cabinet.

[0078] Step (2) includes the following steps:

[0079] Step (2.1): Import the initial video from step (1) into the processing software, then copy the virtual dynamic image as a shadow, add the DROP Shadow effect, and obtain the shadow layer;

[0080] Step (2.2): Create a new white solid layer. Based on the measurement data of the holographic cabinet, add a mask to cover the upper half of the shadow in the shadow layer of step (2.1). Only the lower half of the shadow in the shadow layer is shadowed, so that the white solid layer is on the first layer and the shadow layer is on the second layer. Then set the transparency and layer channel of the shadow layer. Specifically, the transparency of the shadow layer is 40%, and the layer channel is Alpha.

[0081] Step (2.3): Duplicate the white solid layer and the shadow, so that the white solid layer is on the first layer and the shadow is on the second layer. Then set the opacity and layer channels of the shadow layer.

[0082] Step (2.4): Create a new Adjustment Layer and then adjust the effect. In this embodiment, the specific effect to add is Fast Box Blur.

[0083] Step (2.5): Duplicate the Adjustment Layer, and then adjust the Fast Radius, Iterations, and Blur Dimensions (blur direction).

[0084] Step (2.6): Duplicate the Adjustment Layer for the second time, and then adjust the Fast Radius, Iterations, and Blur Dimensions (blur direction).

[0085] Step (2.7): Combine the shadow layer and all adjustment layers into a single layer shadow, add the Bezier Warp effect, and generate the shadow video corresponding to the virtual dynamic image in the initial video of step (1).

[0086] The initial video used in this invention is an initial video with an alpha channel. The processing software is After Effects; the holographic cabinet measurement data is the depth and corner position of the holographic cabinet matching box.

[0087] Step (3) specifically involves merging the shadow video from step (2) with the initial video from step (1) into a single video and projecting it onto the holographic cabinet.

[0088] The method for processing the animated virtual avatar video with shadows adds shadows to the display of the virtual animated avatar in the initial video, thereby making the virtual animated avatar appear more realistic and the 3D effect more realistic when viewed with the naked eye.

[0089] Example 2

[0090] A method for processing dynamic virtual avatar videos with shadows, which is otherwise the same as in Example 1, except that:

[0091] In this embodiment, step (2.1) specifically sets the Shadow Color to black, the Opacity to 50%, the Direction angle to 240°, the Distance to 273, the Softness to 50, and the "Shadow Only" box to be checked. Figure 2 ;

[0092] Step (2.2) specifically involves setting the opacity of the shadow layer to 40% and using Alpha for the layer channel, such as... Figure 3 ;

[0093] Step (2.3) specifically involves setting the opacity of the shadow layer to 80% and using the Ain layer channel, such as... Figure 4 ;

[0094] Step (2.4) involves adding the effect Fast Box Blur, with a Fast Radius of 64, Iterations of 3, and Blur Dimensions set to horizontal.

[0095] In step (2.5), the specific Fast Radius is 64, Iterations is 3, and the Blur Dimensions direction is horizontal.

[0096] Step (2.6) specifically sets the Fast Radius to 40, Iterations to 3, and Blur Dimensions to Horizontal and Vertical (horizontal and vertical). Figure 5 ;

[0097] The parameters for the Bézier bend in step (2.6) are as follows:

[0098]

[0099]

[0100] After the above series of settings, the final result is a screenshot of the virtual dynamic image with added shadows, such as... Figure 6 As shown.

[0101] This embodiment uses the above parameter settings to make the virtual dynamic image display more realistic, and the 3D effect is more realistic when viewing the virtual dynamic image with the naked eye.

[0102] Example 3

[0103] A method for processing dynamic virtual avatar videos with shadows, such as... Figure 1 As shown, other features are the same as in Example 1, except that: step (3) specifically involves adjusting the position of the shadow in the shadow video of step (2) in real time using the KINECT device so that the position of the shadow corresponds to the position of the observer, and simultaneously projecting the virtual dynamic image video of step (1) onto the holographic cabinet.

[0104] The specific steps (3) include:

[0105] Step (3.1): The KINECT device collects and identifies the relative position of a single observer and the holographic cabinet in real time, and then sets the observer's tracking coordinate point as S0(X0,Y0), where X0 and Y0 are variables that the observer's head moves in front of the holographic cabinet screen;

[0106] Step (3.2): Set the shadow in the current shadow video as a skeleton. The skeleton includes 3 nodes: head node A1, shadow corner node B1, and foot connection node C1. Obtain the midpoint S1(X1,Y1) of the connection line A1B1 between the head node A1 and the shadow corner node B1, as shown below. Figure 7 ;

[0107] Step (3.3): When the position of S0(X0,Y0) changes, subtract the coordinates of S1(X1,Y1) from the coordinates of S1(X1,Y1) in step (3.2) from the current coordinates of S0(X0,Y0) to obtain the deformation point S2(X2,Y2). Then, use the deformation point S2(X2,Y2) as the midpoint connecting the top of the head and the corner of the shadow after deformation S2(X2,Y2), while keeping the distance between the top of the head and the corner of the shadow unchanged and keeping the coordinates of point C unchanged, to obtain the deformed shadow. The three skeletal nodes of the deformed shadow are the top node A2, the shadow corner node B2, and the foot connection node C, as shown below. Figure 8 ;

[0108] Step (3.4): Modify the shadow video based on the deformed shadow obtained in step (3.3), and project the modified shadow video and the initial video in step (1) onto the holographic cabinet simultaneously.

[0109] It should be noted that when the observer's head coordinates move to the left, the shadow in the current shadow video moves to the right relative to the center of the moving object; when the observer's head coordinates move to the right, the shadow in the current shadow video moves to the left relative to the center of the moving object. When the observer's head coordinates move downwards, the shadow in the current shadow video is relatively stretched; when the observer's head coordinates move upwards, the shadow in the current shadow video is relatively compressed.

[0110] Compared to Example 1, the shadow in the shadow video of this example can shift according to the observer's position, thereby further enhancing the naked-eye 3D effect.

[0111] Example 4

[0112] A holographic cabinet employs the processing method of any one of embodiments 1 to 3 for dynamic virtual image videos with shadows.

[0113] The holographic display case adds shadows to the virtual dynamic image displayed in the initial video, making the virtual dynamic image appear more realistic and the 3D effect more realistic when viewed with the naked eye.

[0114] Example 5

[0115] A method for processing dynamic virtual avatar images with shadows is provided. The dynamic virtual avatar images with shadows obtained by this method can be applied to the virtual dynamic avatar videos of holographic cabinets to generate shadow videos corresponding to the virtual dynamic avatars.

[0116] Specifically, as in the processing method for a dynamic virtual avatar video with a shadow, as described in Example 1, the presentation effect is evaluated by pre-obtaining a dynamic virtual avatar image with a shadow, and then the shadow is directly adjusted based on parameters such as the offset angle, tilt angle, and transparency of the dynamic virtual avatar image with a shadow. Alternatively, the processing method of this embodiment can be applied to all frames in the virtual dynamic avatar video, generating a corresponding dynamic virtual avatar image with a shadow for each frame, thereby obtaining the final output video.

[0117] The processing method for this animated virtual avatar image with a shadow includes the following steps:

[0118] Step (A): Select at least one frame from the initial video containing only virtual animated figures, define the image as a reference image, and import the reference image into Photoshop software;

[0119] Step (B): Offset the shadow in the reference image according to the light source angle, then adjust the segmentation ratio of the upper and lower halves of the shadow in the reference image according to the holographic cabinet measurement data, then process the upper half of the shadow according to the light source angle, and finally merge the processed upper half of the shadow with the lower half of the shadow to obtain a dynamic virtual image with a shadow, such as... Figure 13 .

[0120] The holographic cabinet measurement data of this invention refers to the depth and corner position of the holographic cabinet matching box. It should be noted that, in practice, based on the common depth of the holographic cabinet matching box, the typical ratio of the upper half to the lower half of the shadow is 7:1. The initial video of this invention is an initial video with an alpha channel.

[0121] Step (B) of the present invention specifically includes the following steps:

[0122] Step (B.1): Select at least one frame from the initial video in step (A), define the image as a reference image, and import the reference image into processing software, such as... Figure 9 ;

[0123] Step (B.2): Offset the shadow in the reference image according to the light source angle, then adjust the segmentation ratio of the upper and lower halves of the shadow in the reference image according to the holographic cabinet measurement data, process the upper half of the shadow according to the light source angle, and finally merge the processed upper half of the shadow with the lower half of the shadow to obtain a dynamic virtual image with shadow.

[0124] Step (B.2) specifically includes the following steps:

[0125] Step (B.2.1): Define the reference image from step (B.1) as layer 1, then copy layer 1 to obtain layer 2, and set the grayscale of layer 2 to obtain the shadow in the reference image, such as... Figure 10 ;

[0126] Step (B.2.2): Offset layer 2 according to the light source angle; in this embodiment, the offset is half a body length.

[0127] Step (B.2.3): Based on the holographic cabinet measurement data, layer 2 is divided into upper and lower parts, resulting in layer 3 containing the upper half of the shadow and layer 4 containing the lower half of the shadow, as shown below. Figure 11 ;

[0128] Step (B.2.4): Connect the foot position in the lower half of the shadow of layer 4 to the foot position in layer 1, and use the tilt tool to tilt the foot position of layer 4.

[0129] Step (B.2.5): Connect the upper edge of the shadow in layer 3 with the lower edge of the shadow in layer 4 to form a merged layer 5;

[0130] Step (B.2.6): Scale layer 5 according to the light source angle. In this embodiment, the specific offset is 45 degrees.

[0131] Step (B.2.7): Adjust the opacity of layer 5;

[0132] Step (B.2.8): Blur layer 5, as shown. Figure 12 .

[0133] In step (B.2.1) of this invention, the grayscale processing method for layer 2 specifically involves selecting the color overlay option in the blending settings, and then setting the values ​​of the R, G, and B channels of the grayscale layer to 120-140 respectively. It should be noted that in this embodiment, the values ​​of the R, G, and B channels are all set to 130.

[0134] In step (B.2.8) of this invention, layer 5 is blurred using the blur tool in the filter options, with an angle of 25° to 30° selected in the motion blur setting. It should be noted that the angle in this embodiment is 27°.

[0135] In step (B.2.7) of this invention, the transparency of layer 5 is adjusted to 60%–70%. It should be noted that in this embodiment, the transparency of layer 5 is adjusted to 65%.

[0136] The method for processing the dynamic virtual image with shadow can obtain a dynamic virtual image with shadow by adding a shadow. This dynamic virtual image with shadow can be applied to the virtual dynamic image video of the holographic cabinet to generate a shadow video corresponding to the virtual dynamic image.

[0137] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit the scope of protection of the present invention. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the essence and scope of the technical solutions of the present invention.

Claims

1. A method for processing dynamic virtual avatar videos with shadows, characterized in that, Includes the following steps: Step (1): Obtain the initial video of the virtual avatar; Step (2): Generate a shadow corresponding to the dynamic posture of the virtual dynamic image in the initial video of step (1) using processing software, and obtain the shadow video corresponding to the dynamic image. Step (3): Simultaneously project the shadow video from step (2) and the initial video from step (1) onto the holographic cabinet, and display the virtual dynamic image with the shadow on the holographic cabinet. Specifically, step (3) involves adjusting the position of the shadow in the shadow video of step (2) in real time using the KINECT device to match the position of the observer, and then synchronously projecting the initial video of step (1) onto the holographic cabinet. Step (3) specifically includes the following steps: Step (3.1): The KINECT device collects and identifies the relative position of a single observer and the holographic cabinet in real time, and then sets the tracking coordinate point of the observer as S0 (X0,Y0). Step (3.2): Set the shadow in the current shadow video as a skeleton. The skeleton includes 3 nodes: head node A1, shadow corner node B1 and foot connection node C1. Obtain the midpoint S1 (X1, Y1) of the connection line A1B1 between head node A1 and shadow corner node B1. Step (3.3): When the position of S0 (X0,Y0) changes, subtract the coordinates of S1 (X1,Y1) in step (3.2) from the current coordinates of S0 (X0,Y0) in real time to obtain the deformation point S2 (X2,Y2). Then, take the deformation point S2 (X2,Y2) as the midpoint connecting the top of the head and the corner of the shadow after deformation, and keep the distance between the top of the head and the corner of the shadow unchanged and keep the coordinates of point C unchanged to obtain the deformed shadow. The three bone nodes of the deformed shadow are the top node A2, the shadow corner node B2 and the foot connection node C. Step (3.4): Modify the shadow video based on the deformed shadow obtained in step (3.3), and project the modified shadow video and the initial video in step (1) onto the holographic cabinet simultaneously.

2. The method for processing dynamic virtual avatar videos with shadows according to claim 1, characterized in that, Step (2) includes the following steps: Step (2.1): Import the initial video from step (1) into the processing software, then copy the virtual dynamic image as a shadow, add the DROP Shadow effect, and obtain the shadow layer; Step (2.2): Create a new white solid layer. Based on the measurement data of the holographic cabinet, add a mask to cover the upper half of the shadow in the shadow layer of step (2.1). Only show the shadow position of the lower half of the shadow in the shadow layer, so that the white solid layer is the first layer and the shadow layer is the second layer. Then set the transparency and layer channel of the shadow layer. Step (2.3): Duplicate the white solid layer and the shadow, so that the white solid layer is on the first layer and the shadow is on the second layer. Then set the opacity and layer channels of the shadow layer. Step (2.4): Create a new Adjustment Layer and then adjust the effects; Step (2.5): Duplicate the Adjustment Layer, and then adjust the Fast Radius, Iterations, and Blur Dimensions (blur direction). Step (2.6): Duplicate the Adjustment Layer a second time, and then adjust the Fast Radius, Iterations, and Blur Dimensions (blur direction). Step (2.7): Combine the shadow layer and all adjustment layers into a single layer shadow, add the Bezier Warp effect, and generate the shadow video corresponding to the virtual dynamic image in the initial video of step (1).

3. The method for processing dynamic virtual avatar videos with shadows according to claim 2, characterized in that, The processing software is After Effects. The initial video is an initial video with an alpha channel; The measurement data of the holographic cabinet is the depth and corner position of the matching box of the holographic cabinet.

4. A holographic cabinet, characterized in that: The processing method for dynamic virtual avatar videos with shadows as described in any one of claims 1-3 is adopted.

Images