A virtual preview method, device and storage medium

Abstract

The present invention provides a virtual preview method, device and storage medium, which relate to the technical field of virtual production. By obtaining information on the type of a model to be photographed, and then switching the corresponding first type of model to the first model according to the information on the type of the model to be photographed, and switching the remaining types of models to the second model, the problem of a large amount of graphics card resources being occupied and the rendering picture not being smooth is solved. In addition, by obtaining human body motion information and virtual shooting position information and generating a virtual preview picture according to the human body motion information and the virtual shooting position information, the gap between the preview picture and the finished film is greatly reduced, thereby greatly reducing the possibility of errors in real shooting.

Description

Technical Field

[0001] The present invention relates to the technical field of virtual production, and in particular to a virtual preview method, device and storage medium. Background Art

[0002] Previz is the abbreviation of Pre-visualization, which can be translated as "visual preview". In the film production industry, the term Previz usually refers to the technology of visualizing some or all shots in a film before the film is officially shot. This technology can help the entire team have a holistic understanding of the plot content. The emergence of pre-performance technology can save film production time and reduce production costs.

[0003] In the early pre-production technology, filmmakers planned the final visual presentation of the film through storyboards, concept drawings, and physical model props. With the development of computer technology, animation pre-production technology has been widely used because of its more intuitive performance. The existing pre-production technology is to use low-poly and simple animations to produce shooting contents such as actor movement, framing, camera angle, and camera movement direction before the formal shooting, so as to provide reference for professionals such as directors and camera directors during shooting.

[0004] However, the existing pre-rehearsal technology has the disadvantage of being far from the finished film. There is also the problem that the content in the pre-rehearsal plan cannot be reproduced in the actual shooting. For example, the existing pre-rehearsal method is used to produce a shot that goes in from the co-pilot window and then out from the main driver's window. However, in the actual shooting, the cameraman has no way to hold the camera and pass through the two windows continuously to reproduce this shot. Even if a robotic arm is used to complete this action, possible collisions must be considered. Therefore, the existing pre-rehearsal plan has a series of problems that cannot truly restore the actual shooting scene. Summary of the invention

[0005] The purpose of the present invention is to solve the problems mentioned in the background technology and to provide a virtual preview method, device and storage medium.

[0006] To achieve the above object, the present invention first proposes a virtual preview method, comprising the following steps:

[0007] Generate one or more first models; generate a second model based on the first model, wherein the second model corresponds to the first model and has a lower number of model faces; obtain human body motion information and virtual shooting position information; obtain information on the type of model to be shot; according to the type information of the model to be shot, switch the corresponding first type model to the first model, and switch the remaining types of models to the second model; generate a virtual rehearsal screen based on the human body motion information and the virtual shooting position information.

[0008] Optionally, generating a preview picture according to human motion information and virtual shooting position information includes the following steps: mapping the human motion information to a human skeleton model; rendering the model scene in real time; and recording the model scene according to the virtual shooting position information.

[0009] Optionally, before recording the model scene according to the virtual shooting position information, the method further includes: detecting a real-time frame rate of the model scene, and when the real-time frame rate is less than the recording frame rate, switching all models in the model scene to a second model.

[0010] Optionally, all models in the model scene are switched to the first model under the premise of ensuring that the real-time frame rate is greater than the recording frame rate.

[0011] Optionally, the method further includes: acquiring human facial information, and generating corresponding facial expressions in the model scene according to the human facial information.

[0012] Optionally, the virtual shooting position information includes virtual camera position information, virtual guide rail position information, and virtual rocker arm position information.

[0013] The present invention also proposes a virtual rehearsal device, comprising: a first generation module, configured to generate one or more first models; a second generation module, configured to generate a second model based on the first model, wherein the second model corresponds to the first model and has a lower number of model faces; a first acquisition module, configured to acquire human body motion information and virtual shooting position information; a second acquisition module, configured to acquire type information of the model to be photographed; a switching module, configured to switch the corresponding first type model to the first model and the remaining types of models to the second model according to the type information of the model to be photographed; and a third generation module, configured to generate a virtual rehearsal screen based on the human body motion information and the virtual shooting position information.

[0014] Optionally, the third generation module also includes: a mapping module configured to map the human motion information to a human skeleton model; a rendering module configured to render the model scene in real time; and a recording module configured to record the model scene according to the virtual shooting position information.

[0015] The present invention also proposes a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the above-mentioned virtual preview method is implemented.

[0016] Beneficial effects of the present invention:

[0017] A virtual preview method of an embodiment of the present invention solves the problems of large-scale occupation of graphics card resources and unsmooth rendering of pictures by obtaining model type information to be photographed, and then switching the corresponding first type model to the first model according to the model type information to be photographed, and switching the remaining types of models to the second model. In addition, by obtaining human body motion information and virtual shooting position information and generating a virtual preview picture according to the human body motion information and the virtual shooting position information, the gap between the preview picture and the finished film is greatly reduced, thereby greatly reducing the possibility of errors in real shooting.

[0018] The features and advantages of the present invention will be described in detail through embodiments in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 This is one of the flowchart diagrams of a virtual preview method according to an embodiment of the present invention;

[0020] Figure 2 The second flowchart of a virtual preview method according to an embodiment of the present invention;

[0021] Figure 3 This is one of the structural block diagrams of a virtual rehearsal device according to an embodiment of the present invention;

[0022] Figure 4 This is the second structural block diagram of a virtual rehearsal device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0023] In order to facilitate understanding by those skilled in the art, the present invention will be further described in detail below in conjunction with specific embodiments.

[0024] Figure 1 The following is a schematic diagram showing a flow chart of a virtual preview method according to an embodiment of the present invention. Figure 1 As shown, the virtual preview method includes steps S10 to S60:

[0025] Step S10, generating one or more first models;

[0026] Step S20, generating a second model according to the first model, wherein the second model corresponds to the first model and has a lower number of model faces;

[0027] Step S30, obtaining human body motion information and virtual shooting position information;

[0028] Step S40, obtaining information on the type of model to be photographed;

[0029] Step S50, switching the corresponding first type model to the first model according to the type information of the model to be photographed, and switching the remaining types of models to the second model;

[0030] Step S60, generating a virtual preview screen according to the human body motion information and the virtual shooting position information.

[0031] In a virtual preview method of an embodiment of the present invention, by obtaining information on the type of model to be photographed, and then switching the corresponding first type model to the first model according to the type information of the model to be photographed, and switching the remaining types of models to the second model, the problems of graphics card resources being occupied in large quantities and rendering images being unsmooth are solved. In addition, by obtaining human body motion information and virtual shooting position information and generating a virtual preview image according to the human body motion information and the virtual shooting position information, the gap between the preview image and the finished film is greatly reduced, thereby greatly reducing the possibility of errors during actual shooting.

[0032] The following will describe in more detail the steps of the virtual preview method in the embodiment of the present invention in combination with the accompanying drawings and embodiments.

[0033] Step S10: generating one or more first models.

[0034] In one embodiment, the first model includes different types of models such as static object models, character skeleton models, hair fabric models, etc. The first model has high precision, which is reflected in the number of model faces of the first model.

[0035] By generating one or more first models with high precision, a more realistic visual effect is achieved compared to the existing pre-production technology using low-poly and simple animations.

[0036] It should be noted that the first model can be created by using modeling software such as Unreal Engine, Maya, 3dmax, etc., which will not be described in detail here.

[0037] Step S20: generating a second model according to the first model, wherein the second model corresponds to the first model and has a lower number of model faces.

[0038] In one embodiment, the second model has a lower number of model faces, and thus has a lower precision than the first model. In other embodiments, a third model, a fourth model, and other models with different numbers of faces may be generated, wherein the models represented by the third model and the fourth model may have fewer faces or more faces.

[0039] Step S30, obtaining human body motion information and virtual shooting position information.

[0040] In one embodiment, the human motion information captured by the optical positioning system is transmitted to MotionBuilder. The human motion information is mapped to the human skeleton model using MotionBuilder, and then the human skeleton model is transmitted to the Unreal Engine through Livelink and presented in real time in the human model of the model scene.

[0041] In one embodiment, human face information is obtained, and corresponding facial expressions are generated in the model scene according to the human face information. Specifically, the human face information is transmitted to the Unreal Engine through Livelink, and after being modified by the modification node, it is mapped to MorthTarget and presented in real time on the face of the human in the model scene.

[0042] Step S40: Obtain the information of the model type to be photographed.

[0043] In the prior art, for example, in a game application scenario, automatic switching is performed according to the distance of the object, that is, the distant view will automatically become blurred to save performance, and the close view will automatically become clear.

[0044] In this embodiment, models of different precision levels are switched according to different requirements without distinguishing between far and near. For example, if this shot is to photograph a person, first obtain the information of the model type to be photographed, and then switch the corresponding human model to the first model with higher precision according to the model type information, and switch the remaining type models to the second model with lower precision.

[0045] Step S50: Switch the corresponding first type of model to the first model according to the information of the model type to be photographed, and switch the remaining type of models to the second model.

[0046] Since the number of model faces of the high-precision model is relatively high, if there are dynamic light sources or ray tracing is enabled in the scene, the graphics card resources consumed by light calculation will also increase as the total number of faces in the scene increases, and the current graphics cards on the market cannot bear such a huge consumption. For rendering, we can accept several seconds or even several minutes to render a frame, but for real-time preview, at least 24 frames per second are required for the human eye to see a smooth picture.

[0047] In this embodiment, by switching the corresponding first type of model to the first model according to the information of the model type to be photographed, and switching the remaining type of models to the second model, the problems of a large amount of graphics card resources occupied by the high-precision model and the unsmooth rendering picture are solved.

[0048] Step S60: Generate a virtual preview picture according to the human motion information and the virtual shooting position information.

[0049] Please refer to Figure 2 Generating a preview screen according to human body motion information and virtual shooting position information specifically includes the following steps:

[0050] Step S61, mapping the human body motion information to a human body skeleton model.

[0051] Step S62: performing real-time rendering on the model scene.

[0052] Step S63: Record the model scene according to the virtual shooting position information.

[0053] The difference from shooting with a camera is that what you get is a picture, while recording a model scene gets a piece of data that can restore the shot picture.

[0054] In one embodiment, before recording the model scene according to the virtual shooting position information, it also includes: detecting the real-time frame rate of the model scene, and when the real-time frame rate is less than the recording frame rate, switching all models in the model scene to the second model. The recording frame rate represents how many data are sampled per second. If the real-time frame rate of the model scene is lower than the recording frame rate, insufficient sampled data will be caused, resulting in the recorded data not being able to restore the picture well. In addition, on the premise of ensuring that the real-time frame rate is greater than the recording frame rate, all models in the model scene can also be switched to the first model.

[0055] Based on the above virtual preview method, the embodiment of the present invention also provides a virtual preview device, such as Figure 3 As shown, the device includes the following modules:

[0056] A first generating module 100 is configured to generate one or more first models;

[0057] A second generating module 200 is configured to generate a second model according to the first model, wherein the second model corresponds to the first model and has a lower number of model faces;

[0058] The first acquisition module 300 is configured to acquire human body motion information and virtual shooting position information;

[0059] The second acquisition module 400 is configured to acquire the type information of the model to be photographed;

[0060] A switching module 500 is configured to switch the corresponding first type model to the first model and switch the remaining types of models to the second model according to the type information of the model to be photographed;

[0061] The third generating module 600 is configured to generate a virtual preview screen according to the human body motion information and the virtual shooting position information.

[0062] like Figure 4As shown, in one embodiment, the third generation module further includes:

[0063] A mapping module 610 is configured to map the human motion information to a human skeleton model;

[0064] A rendering module 620 is configured to render the model scene in real time;

[0065] The recording module 630 is configured to record the model scene according to the virtual shooting position information.

[0066] In summary, a virtual rehearsal device according to an embodiment of the present invention can be implemented in the form of a program and run on a computer device. The memory of the computer device can store various program modules constituting the virtual rehearsal device, such as: Figure 3 The first generation module 100, the second generation module 200, the first acquisition module 300, the second acquisition module 400, the switching module 500, and the third generation module 600 are shown. The program composed of each program module enables the processor to execute the steps of a virtual preview method of each embodiment of the present application described in this specification.

[0067] An embodiment of the present invention further provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps in a virtual preview method of each embodiment of the present application are implemented.

[0068] The technical features of the above embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0069] The above embodiments are explanations of the present invention, not limitations of the present invention. Any solution that is simply modified from the present invention belongs to the protection scope of the present invention. The above is only a preferred embodiment of the present invention. The protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should also be regarded as the protection scope of the present invention.

Claims

1. A virtual preview method, It is characterized in that The following steps are involved: generating one or more first models; generating a second model according to the first model, wherein the second model corresponds to the first model and has a lower number of model faces; Obtaining human body motion information and virtual shooting position information; Get the type information of the model to be photographed; According to the type information of the model to be photographed, the corresponding first type model is switched to the first model, and the remaining types of models are switched to the second model; Generate a virtual preview screen based on human body motion information and virtual shooting position information.

2. The virtual preview method according to claim 1, It is characterized in that Generating a virtual preview screen according to human body motion information and virtual shooting position information comprises the following steps: Mapping the human motion information to a human skeleton model; Real-time rendering of model scenes; The model scene is recorded according to the virtual shooting position information.

3. The virtual preview method according to claim 2, It is characterized in that Before recording the model scene according to the virtual shooting position information, the method further includes: detecting the real-time frame rate of the model scene, and when the real-time frame rate is less than the recording frame rate, switching all models in the model scene to the second model.

4. The virtual preview method according to claim 3, It is characterized in that Under the premise of ensuring that the real-time frame rate is greater than the recording frame rate, switch all models in the model scene to the first model.

5. The virtual preview method according to claim 1, It is characterized in that Also includes: Acquire human facial information, and generate corresponding facial expressions in the model scene according to the human facial information.

6. The virtual preview method according to claim 1, It is characterized in that The virtual shooting position information includes virtual camera position information, virtual guide rail position information, and virtual rocker arm position information.

7. A virtual rehearsal device, It is characterized in that include: A first generating module, configured to generate one or more first models; A second generating module is configured to generate a second model according to the first model, wherein the second model corresponds to the first model and has a lower number of model faces; A first acquisition module is configured to acquire human body motion information and virtual shooting position information; A second acquisition module is configured to acquire type information of the model to be photographed; A switching module is configured to switch the corresponding first type model to the first model according to the type information of the model to be photographed, and switch the remaining types of models to the second model; The third generating module is configured to generate a virtual preview screen according to the human body motion information and the virtual shooting position information.

8. The virtual rehearsal device according to claim 7, It is characterized in that The third generation module also includes: A mapping module, configured to map the human motion information to a human skeleton model; A rendering module is configured to render the model scene in real time; The recording module is configured to record the model scene according to the virtual shooting position information.

9. A computer-readable storage medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the virtual preview method according to any one of claims 1 to 6.

Images