An interactive shooting method, device and equipment of virtual delay video and medium

Abstract

The application discloses an interactive shooting method, device and equipment of virtual delay video and medium, and relates to the technical field of virtual reality, to solve the problem of low video image quality of the existing delay video synthesis scheme, comprising: obtaining a virtual scene to be shot; determining delay photography parameters of the virtual scene to be shot according to a shooting instruction triggered by a virtual delay photography interactive interface; and generating a virtual delay video by delay photography in the virtual scene to be shot according to the delay photography parameters; the application sets the delay photography parameters, parameterizes the virtual delay photography process according to the characteristics of real delay photography, and automatically generates a high-quality delay video in the virtual scene; and through the setting of a parameter adjustment area in the virtual delay photography interactive interface, the user can conveniently configure and adjust the delay photography parameters according to personal preferences and aesthetics, generate personalized virtual delay videos, and improve the user experience.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of virtual reality, and particularly relates to an interactive shooting method and device of virtual time-lapse video, equipment and a computer readable storage medium. BACKGROUND

[0002] With the development of three-dimensional reconstruction and virtual reality technologies, virtual applications such as entertainment and education in virtual scenes are increasingly attracting people's attention. Virtual time-lapse photography can automatically generate time-lapse videos (i.e. virtual time-lapse videos) in virtual scenes, which have potential applications such as artistic creation and entertainment in virtual scenes.

[0003] In the prior art, the dynamic changes of an existing time-lapse video are usually learned, and a given image is animated based on the learned dynamic changes to synthesize a time-lapse video; for example, time information is modeled using optical flow or long short-term memory network technology, and then a future frame is predicted based on a generative network (such as a generative adversarial network); however, these existing solutions mainly aim at video synthesis in real scenes, and when facing complex and variable virtual scenes, video synthesis may have problems such as time inconsistency and low fidelity. Therefore, how to provide an interactive shooting solution of virtual time-lapse video suitable for virtual scenes, so that users can conveniently configure time-lapse photography in virtual scenes according to their own needs, generate high-quality virtual time-lapse videos, and improve user experience, is a problem that needs to be solved at present. SUMMARY

[0004] The purpose of the present application is to provide an interactive shooting method, device, equipment and computer readable storage medium of virtual time-lapse video, to realize automatic time-lapse photography in virtual scenes that meets user needs, generate high-quality virtual time-lapse videos, and improve user experience.

[0005] To solve the above technical problems, the present application provides an interactive shooting method of virtual time-lapse video, comprising:

[0006] acquiring a virtual scene to be shot; wherein the virtual scene to be shot is a three-dimensional scene whose scene content changes over time;

[0007] determining time-lapse photography parameters of the virtual scene to be shot according to a shooting instruction triggered by a virtual time-lapse photography interactive interface; wherein the time-lapse photography parameters include shooting selection parameters, camera motion parameters and shooting time parameters, the shooting selection parameters include a shooting position and a shooting angle, the shooting time parameters include a shooting time range and a shooting time interval, and the virtual time-lapse photography interactive interface includes a parameter adjustment region for adjusting the shooting selection parameters, the camera motion parameters and / or the shooting time parameters;

[0008] According to the time-lapse photography parameter, time-lapse photography is performed in the virtual scene to be photographed to generate a virtual time-lapse video.

[0009] In some embodiments, the obtaining the virtual scene to be photographed comprises:

[0010] According to a scene selection instruction triggered by the virtual time-lapse photography interactive interface, the virtual scene to be photographed is determined from preset dynamic virtual scenes; wherein the virtual time-lapse photography interactive interface comprises a scene selection area for selecting the preset dynamic virtual scenes.

[0011] In some embodiments, the obtaining the virtual scene to be photographed comprises:

[0012] According to a scene new instruction triggered by the virtual time-lapse photography interactive interface, a three-dimensional model of a static virtual scene corresponding to the scene new instruction is obtained;

[0013] Using a three-dimensional engine, the three-dimensional model of the static virtual scene is processed to generate the virtual scene to be photographed.

[0014] In some embodiments, the using the three-dimensional engine to process the three-dimensional model of the static virtual scene to generate the virtual scene to be photographed comprises:

[0015] Using the three-dimensional engine, the three-dimensional model of the static virtual scene is scene rendered and dynamic elements are added to generate the virtual scene to be photographed; wherein the dynamic elements comprise character elements, traffic elements, weather elements and / or light elements.

[0016] In some embodiments, according to the scene new instruction triggered by the virtual time-lapse photography interactive interface, the three-dimensional model of the static virtual scene corresponding to the scene new instruction is obtained, comprising:

[0017] A real scene image corresponding to the scene new instruction is obtained;

[0018] According to the real scene image, the three-dimensional model of the static virtual scene is generated.

[0019] In some embodiments, the obtaining the virtual scene to be photographed comprises:

[0020] According to a scene display instruction triggered by the virtual time-lapse photography interactive interface, a preset scene display sub-interface is switched to display to display preview content of each preset dynamic virtual scene in the preset scene display sub-interface;

[0021] According to a scene selection instruction triggered by the preset scene display sub-interface, the virtual scene to be photographed is determined from the preset dynamic virtual scenes.

[0022] In some embodiments, the scene display instruction triggered according to the virtual time-lapse photography interaction interface further includes the following after switching to display the preset scene display sub-interface:

[0023] According to the preset scene new creation instruction triggered by the preset scene display sub-interface, a three-dimensional model of a static virtual scene corresponding to the preset scene new creation instruction is obtained.

[0024] The three-dimensional model of the static virtual scene is processed by using a three-dimensional engine to generate a preset dynamic virtual scene corresponding to the preset scene new creation instruction.

[0025] In some embodiments, the time-lapse photography in the virtual scene to be photographed according to the time-lapse photography parameters includes the following:

[0026] A virtual image sequence corresponding to the time-lapse photography parameters in the virtual scene to be photographed is generated.

[0027] A virtual time-lapse video is generated according to the virtual image sequence.

[0028] In some embodiments, the virtual time-lapse video is generated according to the virtual image sequence, including:

[0029] The exposure of each virtual image in the virtual image sequence is smoothed to obtain a processed virtual image sequence.

[0030] The processed virtual image sequence is synthesized to generate a virtual time-lapse video.

[0031] In some embodiments, the exposure of each virtual image in the virtual image sequence is smoothed to obtain a processed virtual image sequence, including:

[0032] The exposure of each virtual image in the virtual image sequence is subjected to a histogram equalization operation to obtain the processed virtual image sequence.

[0033] In some embodiments, the virtual image sequence corresponding to the time-lapse photography parameters in the virtual scene to be photographed is generated, including:

[0034] A virtual camera of the three-dimensional engine is used to render the virtual scene to be photographed according to the time-lapse photography parameters to generate the virtual image sequence.

[0035] In some embodiments, the shooting instruction triggered according to the virtual time-lapse photography interaction interface determines the time-lapse photography parameters of the virtual scene to be photographed, including:

[0036] The virtual time-lapse photography interactive interface displays a scene image corresponding to the custom parameter of the parameter adjustment region in the virtual scene to be photographed; wherein the custom parameter comprises a shooting scene selection custom parameter, a camera motion custom parameter and / or a shooting time custom parameter;

[0037] After the virtual time-lapse photography interactive interface triggers the shooting instruction, the time-lapse photography parameter is determined according to the custom parameter.

[0038] In some embodiments, the virtual time-lapse photography interactive interface displays a scene image corresponding to the custom parameter of the parameter adjustment region in the virtual scene to be photographed, comprising:

[0039] The time-lapse photography calculation optimal parameter corresponding to the virtual scene to be photographed is obtained, and the time-lapse photography calculation optimal parameter is determined as the initial custom parameter; wherein the time-lapse photography calculation optimal parameter is a photography parameter calculated by using an image aesthetic evaluation model, a video aesthetic evaluation model and a time-lapse aesthetic evaluation model, the time-lapse aesthetic evaluation model comprises a first time-lapse aesthetic evaluation model based on optical flow and a second time-lapse aesthetic evaluation model based on brightness and color, and the time-lapse photography calculation optimal parameter comprises a shooting scene selection optimal parameter, a camera motion optimal parameter and a shooting time optimal parameter;

[0040] The virtual time-lapse photography interactive interface displays a scene image corresponding to the initial custom parameter in the virtual scene to be photographed, and displays the initial custom parameter in the parameter adjustment region.

[0041] In some embodiments, before the virtual time-lapse photography interactive interface displays a scene image corresponding to the custom parameter of the parameter adjustment region in the virtual scene to be photographed, the method further comprises:

[0042] According to the operation mode display instruction triggered by the virtual time-lapse photography interactive interface, an operation mode selection sub-interface is switched to display each preset operation mode in the operation mode selection sub-interface; wherein the preset operation mode comprises an automatic operation mode, a semi-automatic operation mode and a custom operation mode;

[0043] According to the operation mode selection instruction triggered by the operation mode selection sub-interface, a target operation mode is determined from the preset operation mode;

[0044] If the target operation mode is the automatic operation mode, the time-lapse photography calculation optimal parameter is obtained, and the time-lapse photography calculation optimal parameter is determined as the time-lapse photography parameter, and the step of generating a virtual time-lapse video according to the time-lapse photography parameter in the virtual scene to be photographed is executed;

[0045] if the target operation mode is the semi-automatic operation mode, performing the step of obtaining the time-lapse calculation optimal parameters corresponding to the to-be-shot virtual scene, and determining the time-lapse calculation optimal parameters as initial custom parameters;

[0046] if the target operation mode is the custom operation mode, obtaining preset initial parameters corresponding to the to-be-shot virtual scene, and determining the preset initial parameters as initial custom parameters, performing the step of displaying, in the virtual time-lapse interactive interface, a scene image corresponding to the initial custom parameters in the to-be-shot virtual scene, and displaying the initial custom parameters in the parameter adjustment area; wherein the preset initial parameters include preset initial shooting selection parameters, preset initial camera motion parameters, and preset initial shooting time parameters.

[0047] In some embodiments, the obtaining of the time-lapse calculation optimal parameters corresponding to the to-be-shot virtual scene comprises:

[0048] obtaining the shooting selection optimal parameters by using the image aesthetic evaluation model;

[0049] obtaining the camera motion optimal parameters according to the shooting selection optimal parameters and the video aesthetic evaluation model;

[0050] obtaining the shooting time optimal parameters according to the shooting selection optimal parameters, the camera motion optimal parameters, and the time-lapse aesthetic evaluation model.

[0051] In some embodiments, the displaying, in the virtual time-lapse interactive interface, of the scene image corresponding to the custom parameters of the parameter adjustment area in the to-be-shot virtual scene comprises:

[0052] adjusting the shooting position in the shooting selection custom parameters according to a movement instruction triggered by a keyboard device; wherein the movement instruction includes a forward movement instruction, a backward movement instruction, a left movement instruction, and / or a right movement instruction;

[0053] updating and displaying, in the virtual time-lapse interactive interface, a scene image corresponding to the adjusted shooting position in the to-be-shot virtual scene, and displaying the adjusted shooting position in a shooting position coordinate display area in the parameter adjustment area.

[0054] In some embodiments, the displaying, in the virtual time-lapse interactive interface, of the scene image corresponding to the custom parameters of the parameter adjustment area in the to-be-shot virtual scene comprises:

[0055] Adjust a shooting position in the shooting framing customization parameter according to a movement instruction triggered by the keyboard device; wherein the movement instruction comprises a forward movement instruction, a backward movement instruction, a leftward movement instruction and / or a rightward movement instruction;

[0056] Calculate a time-lapse photography adjustment optimal parameter corresponding to the adjusted shooting position by using an image aesthetic evaluation model, a video aesthetic evaluation model and a time-lapse aesthetic evaluation model according to the adjusted shooting position; wherein the time-lapse aesthetic evaluation model comprises a first time-lapse aesthetic evaluation model based on optical flow and a second time-lapse aesthetic evaluation model based on brightness and color, and the time-lapse photography adjustment optimal parameter comprises a shooting framing adjustment optimal parameter, a camera motion adjustment optimal parameter and a shooting time adjustment optimal parameter, and a shooting position in the shooting framing adjustment optimal parameter is the adjusted shooting position;

[0057] Adjust the customization parameter by using the time-lapse photography adjustment optimal parameter.

[0058] Display a scene image corresponding to the adjusted customization parameter in the parameter adjustment region in the virtual time-lapse photography interactive interface.

[0059] In some embodiments, the displaying, in the virtual time-lapse photography interactive interface, a scene image corresponding to the customization parameter of the parameter adjustment region in the virtual scene to be photographed comprises:

[0060] Adjust a shooting angle in the shooting framing customization parameter according to a shooting angle adjustment instruction triggered by the virtual time-lapse photography interactive interface; wherein the parameter adjustment region comprises a shooting angle adjustment region, and the shooting angle adjustment region comprises a yaw angle sliding adjustment bar and a pitch angle sliding adjustment bar.

[0061] Display a scene image corresponding to the adjusted shooting angle in the virtual time-lapse photography interactive interface, and display the adjusted shooting angle in the shooting angle adjustment region.

[0062] In some embodiments, the displaying, in the virtual time-lapse photography interactive interface, a scene image corresponding to the customization parameter of the parameter adjustment region in the virtual scene to be photographed comprises:

[0063] Determine the camera motion customization parameter from a selectable shooting trajectory according to a motion trajectory selection instruction triggered by the virtual time-lapse photography interactive interface; wherein the parameter adjustment region comprises a shooting trajectory selection region for selecting the selectable shooting trajectory.

[0064] Display a trajectory schematic frame corresponding to the camera motion customization parameter in the virtual time-lapse photography interactive interface.

[0065] In some embodiments, the virtual time-lapse photography interactive interface displays the scene image corresponding to the custom parameter of the parameter adjustment region in the to-be-shot virtual scene, including:

[0066] According to the time range adjustment instruction triggered by the virtual time-lapse photography interactive interface, the starting time or the ending time of the shooting time range in the shooting time custom parameter is adjusted; wherein the parameter adjustment region includes a time range adjustment region, and the time range adjustment region includes a starting time sliding adjustment bar and an ending time sliding adjustment bar;

[0067] The virtual time-lapse photography interactive interface updates and displays the scene image corresponding to the adjusted starting time or ending time of the shooting time range in the to-be-shot virtual scene, and displays the adjusted shooting time range in the time range adjustment region.

[0068] In some embodiments, the virtual time-lapse photography interactive interface displays the scene image corresponding to the custom parameter of the parameter adjustment region in the to-be-shot virtual scene, including:

[0069] According to the dynamic element adjustment instruction triggered by the virtual time-lapse photography interactive interface, the adjustable dynamic element of the to-be-shot virtual scene is adjusted; wherein the virtual time-lapse photography interactive interface includes a dynamic element adjustment region for adjusting the adjustable dynamic element, the adjustable dynamic element includes a cloud element and / or a fog element in the weather element, and the dynamic element adjustment region includes a quantity adjustment bar and / or a motion speed adjustment bar corresponding to each of the adjustable dynamic elements;

[0070] The virtual time-lapse photography interactive interface updates and displays the scene image corresponding to the adjusted custom parameter in the to-be-shot virtual scene.

[0071] The application also provides an interactive shooting device for virtual time-lapse video, including:

[0072] A scene acquisition module is configured to acquire a to-be-shot virtual scene; wherein the to-be-shot virtual scene is a three-dimensional scene with time-varying scene content;

[0073] A parameter determination module is configured to determine time-lapse photography parameters of the to-be-shot virtual scene according to a shooting instruction triggered by a virtual time-lapse photography interactive interface; wherein the time-lapse photography parameters include shooting scene selection parameters, camera motion parameters, and shooting time parameters, the shooting scene selection parameters include a shooting position and a shooting angle, the shooting time parameters include a shooting time range and a shooting time interval, and the virtual time-lapse photography interactive interface includes a parameter adjustment region for adjusting the shooting scene selection parameters, the camera motion parameters, and / or the shooting time parameters.

[0074] a time-lapse shooting module, configured to perform time-lapse photography in the virtual scene to be shot according to the time-lapse photography parameters, and generate a virtual time-lapse video.

[0075] The application further provides an interactive shooting device for a virtual time-lapse video, comprising:

[0076] a memory, configured to store a computer program;

[0077] a processor, configured to execute the computer program to realize the steps of the interactive shooting method for a virtual time-lapse video.

[0078] The application further provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program, and the computer program is executed by a processor to realize the steps of the interactive shooting method for a virtual time-lapse video.

[0079] The application provides an interactive shooting method for a virtual time-lapse video, comprising: acquiring a virtual scene to be shot; wherein the virtual scene to be shot is a three-dimensional scene with scene content changing over time; determining time-lapse photography parameters of the virtual scene to be shot according to a shooting instruction triggered by a virtual time-lapse photography interactive interface; wherein the time-lapse photography parameters comprise shooting scene selection parameters, camera motion parameters and shooting time parameters, the shooting scene selection parameters comprise a shooting position and a shooting angle, the shooting time parameters comprise a shooting time range and a shooting time interval, and the virtual time-lapse photography interactive interface comprises a parameter adjustment region for adjusting the shooting scene selection parameters, the camera motion parameters and / or the shooting time parameters; performing time-lapse photography in the virtual scene to be shot according to the time-lapse photography parameters, and generating a virtual time-lapse video.

[0080] It can be seen that, by setting the time-lapse photography parameters, the application parameterizes the virtual time-lapse photography process according to the characteristics of real time-lapse photography, and can further generate a virtual time-lapse video corresponding to the time-lapse photography parameters in the dynamic virtual scene to be shot, realizes automatic generation of a high-quality time-lapse video in the virtual scene, and can thus simulate and test time-lapse photography in a real environment, guide time-lapse photography in the real world, save time and economic cost, and improve user experience by enabling the user to conveniently configure and adjust the time-lapse photography parameters according to personal preferences and aesthetics, and generate personalized virtual time-lapse videos. In addition, the application also provides an interactive shooting device for a virtual time-lapse video, which also has the above beneficial effects. BRIEF DESCRIPTION OF DRAWINGS

[0081] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0082] Figure 1 A flowchart illustrating an interactive virtual time-lapse video shooting method provided in an embodiment of the present invention;

[0083] Figure 2 This is a diagram illustrating the initial state of a virtual time-lapse photography interactive interface provided in an embodiment of the present invention.

[0084] Figure 3 This is a diagram illustrating a preset scene display sub-interface provided in an embodiment of the present invention.

[0085] Figure 4 This is a diagram illustrating an operation mode selection sub-interface provided in an embodiment of the present invention.

[0086] Figure 5 A flowchart illustrating another interactive method for capturing virtual time-lapse video provided in an embodiment of the present invention;

[0087] Figure 6 for Figure 2 The image shows a display of the custom parameter adjustment status of the virtual time-lapse photography interactive interface.

[0088] Figure 7 This is a diagram illustrating the effect of adjusting the shooting position according to an embodiment of the present invention;

[0089] Figure 8 This is a diagram illustrating the pitch angle adjustment effect provided in an embodiment of the present invention.

[0090] Figure 9 This is a diagram illustrating the yaw angle adjustment effect provided in an embodiment of the present invention;

[0091] Figure 10 This is a diagram illustrating the effect of camera motion trajectory adjustment provided in an embodiment of the present invention;

[0092] Figure 11 This is a diagram illustrating the effect of adjusting the shooting time range according to an embodiment of the present invention.

[0093] Figure 12 This is a diagram illustrating the effect of weather element regulation provided in an embodiment of the present invention;

[0094] Figure 13A flow chart of a calculation process of a time-lapse photography calculation optimal parameter provided by the embodiment of the present application is shown in FIG. 1.

[0095] Figure 14 A flow chart of a configuration process of a shooting optimal parameter provided by the embodiment of the present application is shown in FIG. 2.

[0096] Figure 15 A structure block diagram of an interactive shooting device of a virtual time-lapse video provided by the embodiment of the present application is shown in FIG. 3.

[0097] Figure 16 A simple structure schematic diagram of an interactive shooting device of a virtual time-lapse video provided by the embodiment of the present application is shown in FIG. 4.

[0098] Figure 17 A specific structure schematic diagram of an interactive shooting device of a virtual time-lapse video provided by the embodiment of the present application is shown in FIG. 5.

[0099] Figure 18 A structure schematic diagram of a computer readable storage medium provided by the embodiment of the present application is shown in FIG. 6. DETAILED DESCRIPTION

[0100] In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

[0101] Please refer to Figure 1 , Figure 1 A flow chart of an interactive shooting method of a virtual time-lapse video provided by the embodiment of the present application is shown in FIG. 7. The method can include:

[0102] Step 101: acquiring a virtual scene to be shot; wherein the virtual scene to be shot is a three-dimensional scene with scene content changing over time.

[0103] It can be understood that the virtual scene to be shot in the embodiment is a dynamic virtual scene that needs to be time-lapsed, and the dynamic virtual scene can be a three-dimensional scene with scene content changing over time. Correspondingly, the virtual scene to be shot (i.e. the dynamic virtual scene) can include dynamic elements (such as people, traffic, weather and light, etc.), and the dynamic elements can change in the dynamic virtual scene changing over time, such as people and vehicles can move in the areas (i.e. accessible areas) on the ground within the dynamic virtual scene, so that the movement of people and vehicles conforms to common sense.

[0104] Correspondingly, for the specific content of the virtual scene to be photographed in the present embodiment, the designer can set it according to the practical scene and user demand, such as the virtual scene to be photographed can include a three-dimensional model of a static virtual scene and a dynamic element; wherein the static virtual scene can be a virtual reproduction of a real scene, or a virtual scene that does not exist in reality, or even a surreal scene that breaks the limits of the real world; the dynamic element can include at least one of a character element, a traffic element, a weather element, and a light element, to reflect the dynamic changes of the dynamic virtual scene through the dynamic element.

[0105] It should be noted that in the present embodiment, the processor can obtain the virtual scene to be photographed after starting the virtual time-lapse photography interactive application, to complete time-lapse photography in the virtual scene to be photographed and generate a corresponding virtual time-lapse video. For example, the virtual time-lapse photography interactive application can be an interactive application based on a three-dimensional engine constructed by using a blueprint mechanism in the three-dimensional engine, to facilitate the generation of the virtual time-lapse video and the visual display of the custom parameters set by the user. For the specific way in which the processor obtains the virtual scene to be photographed in the present embodiment, the designer can set it according to the practical scene and user demand, such as the processor can directly receive the virtual scene to be photographed or read the stored virtual scene to be photographed. For example, in some embodiments, the processor can determine the virtual scene to be photographed from the preset dynamic virtual scene according to a scene selection instruction triggered by the virtual time-lapse photography interactive interface; wherein the virtual time-lapse photography interactive interface includes a scene selection area for selecting the preset dynamic virtual scene. In another embodiment, the processor can obtain the dynamic virtual scene corresponding to the scene new instruction as the virtual scene to be photographed according to the scene new instruction triggered by the virtual time-lapse photography interactive interface.

[0106] Correspondingly, the processor can also obtain a three-dimensional model of a static virtual scene; use the three-dimensional engine to process the three-dimensional model and generate the virtual scene to be photographed; such as the processor can use the three-dimensional engine to perform scene rendering on the three-dimensional model of the static virtual scene and add dynamic elements to generate the virtual scene to be photographed; wherein the dynamic elements include character elements, traffic elements, weather elements, and / or light elements; that is, the processor can add the three-dimensional model of the static virtual scene to the three-dimensional engine, use the three-dimensional engine to complete the rendering and display of the scene, and add dynamic elements (such as character, traffic, weather, and light elements) to construct and generate a dynamic virtual scene as the virtual scene to be photographed. For example, the processor can obtain the three-dimensional model of the static virtual scene corresponding to the scene new instruction according to the scene new instruction triggered by the virtual time-lapse photography interactive interface; use the three-dimensional engine to process the three-dimensional model of the static virtual scene and generate the virtual scene to be photographed.

[0107] Correspondingly, this embodiment does not limit the specific method by which the processor acquires the 3D model of the static virtual scene. For example, the processor can directly receive the 3D model of the static virtual scene. The processor can also generate the 3D model of the static virtual scene itself. For instance, the processor can use modeling software or a 3D model generation algorithm to generate the 3D model of the static virtual scene. For example, the processor can acquire real scene images, such as the real scene image corresponding to a scene creation instruction; and generate a 3D model of the static virtual scene based on the real scene image. For example, for images of real scenes in the real world (i.e., real scene images), the processor can use the image-based 3D reconstruction algorithm SFM (structure-from-motion) to reconstruct the real scene and obtain the corresponding 3D model of the static virtual scene. The real scene images can be collected from the internet or captured by drones or robots. For 3D models of virtual scenes that do not exist in reality, or even surreal scenes that break through the limitations of the real world, they can be constructed using modeling software or generated using a 3D model generation algorithm.

[0108] For example, such as Figure 2 As shown, after the virtual time-lapse photography interactive application is launched, the processor displays on the monitor. Figure 2 The virtual time-lapse photography interactive interface shown can be used as the main interface (Home screen). Users can use the mouse or touch to click the "Scene" virtual button (i.e., the scene display virtual button) in the virtual time-lapse photography interactive interface to trigger scene display commands and switch the display to the desired scene. Figure 3 The preset scene display sub-interface (SCENES interface) shows preset dynamic virtual scenes for two cities (Scene1-City and Scene2-City), preset dynamic virtual scenes for two towns (Scene3-Twon and Scene4-Twon), and a preset dynamic virtual scene for a real scene (Scene5-Real). Users can click on any preset dynamic virtual scene in the preset scene display sub-interface to trigger a scene selection command, using the selected preset dynamic virtual scene as the virtual scene to be filmed. Users can then automatically or by clicking the "Home" virtual button (i.e., the main interface switching virtual button) to switch back to the virtual time-lapse photography interactive interface. Users can also click... Figure 2The menu virtual key in the three virtual keys of the menu virtual key, the storage virtual key and the exit virtual key in the lower right corner of the illustrated virtual time-lapse photography interactive interface displays a configuration menu in the virtual time-lapse photography interactive interface, clicks a scene new menu item in the configuration menu, triggers a scene new instruction, reads a new dynamic virtual scene in a selected storage location, or reads a real scene image or a three-dimensional model of a static virtual scene to generate a new dynamic virtual scene, and takes the new dynamic virtual scene as a virtual scene to be photographed; correspondingly, the processor can also store the new dynamic virtual scene corresponding to the scene new instruction as a new preset dynamic virtual scene.

[0109] Correspondingly, in order to facilitate the selection and switching of the virtual scene to be photographed, a scene selection area for selecting a preset dynamic virtual scene can also be set in the virtual time-lapse photography interactive interface, so that the user can click the virtual keys corresponding to all or part of the preset dynamic virtual scenes in the scene selection area, trigger a scene selection instruction, and enable the processor to determine one of the preset dynamic virtual scenes selected by the user as the virtual scene to be photographed.

[0110] Step 102: According to the shooting instruction triggered by the virtual time-lapse photography interactive interface, determine the time-lapse photography parameters of the virtual scene to be photographed; wherein the time-lapse photography parameters include shooting selection parameters, camera motion parameters and shooting time parameters, the shooting selection parameters include shooting position and shooting angle, the shooting time parameters include shooting time range and shooting time interval, and the virtual time-lapse photography interactive interface includes a parameter adjustment area for adjusting the shooting selection parameters, the camera motion parameters and / or the shooting time parameters.

[0111] It should be noted that the time-lapse photography parameters in this embodiment can be parameters obtained by parameterizing the virtual time-lapse photography process according to the characteristics of real time-lapse photography. Time-lapse photography (or called time-lapse photography or time-lapse recording) is a shooting technique that compresses time. It usually shoots a group of images, which are then combined into a video (i.e. time-lapse video) in the later stage, which can play the process of several minutes or hours or even days in a short time in the form of video. In a time-lapse video, the slow change of objects or scenes can be compressed into a short time, which can present the strange and wonderful scenes that cannot be perceived by the naked eye. Virtual time-lapse photography can be time-lapse photography of objects or scenes in a dynamic virtual scene.

[0112] Correspondingly, for the specific content of the time-lapse photography parameters in the present embodiment, the designer can set them according to practical scenarios and user needs, such as the time-lapse photography parameters can include shooting framing parameters, shooting time parameters, and camera motion parameters (i.e., shooting trajectory); wherein the shooting framing parameters can include shooting position and shooting angle, and the shooting time parameters can include shooting time range and shooting time interval.

[0113] It can be understood that the virtual time-lapse photography interactive interface in the present embodiment can be an interface for interacting with the user to adjust all or part of the time-lapse photography parameters, i.e., the user adjusts the shooting framing parameters, the camera motion parameters, and / or the shooting time parameters in the parameter adjustment region of the virtual time-lapse photography interactive interface, so as to trigger a shooting instruction in the virtual time-lapse photography interactive interface and generate a virtual time-lapse video using the adjusted time-lapse photography parameters. Correspondingly, the virtual time-lapse photography interactive interface can also include a shooting virtual button (such as the “Save” virtual button or the “Show” virtual button in the virtual time-lapse photography interactive interface), so that the user can trigger a shooting instruction in the virtual time-lapse photography interactive interface by clicking the shooting virtual button with a mouse or touch. Figure 2

[0114] Correspondingly, for the shooting instruction triggered by the processor in the virtual time-lapse photography interactive interface in the present embodiment, the specific way of determining the time-lapse photography parameters of the virtual scene to be photographed, such as the processor can directly determine the time-lapse photography parameters according to the custom parameters in the parameter adjustment region of the virtual scene to be photographed after obtaining the shooting instruction triggered by the virtual time-lapse photography interactive interface; wherein the custom parameters include shooting framing custom parameters, camera motion custom parameters, and / or shooting time custom parameters. In order to facilitate the user to adjust the time-lapse photography parameters (i.e., custom parameters), the processor can display the scene image corresponding to the custom parameters in the parameter adjustment region of the virtual scene to be photographed in the virtual time-lapse photography interactive interface in the present embodiment; after triggering the shooting instruction in the virtual time-lapse photography interactive interface, the time-lapse photography parameters are determined according to the custom parameters. That is, the virtual time-lapse photography interactive application can display the corresponding scene image in the virtual time-lapse photography interactive interface according to the custom parameters set by the user, and visually show the user the feedback of the parameter adjustment effect in real time, so that the user can correct the custom parameters multiple times, and finally determine the custom parameters that meet their own aesthetic after triggering the shooting instruction.

[0115] ​Further, in the process of displaying the scene image corresponding to the custom parameter of the parameter adjustment region in the virtual time-lapse photography interaction interface, in order to facilitate the user to set the custom parameter and improve the quality of the virtual time-lapse video, the processor can first use the time-lapse photography calculation optimal parameter corresponding to the to-be-shot virtual scene obtained by pre-setting or algorithm calculation as the initial custom parameter, so that the user can adjust the custom parameter according to the own demand on the basis of the time-lapse photography calculation optimal parameter. In some embodiments, the processor can obtain the time-lapse photography calculation optimal parameter corresponding to the to-be-shot virtual scene, and determine the time-lapse photography calculation optimal parameter as the initial custom parameter; display the scene image corresponding to the initial custom parameter in the virtual time-lapse photography interaction interface, and display the initial custom parameter in the parameter adjustment region; wherein the time-lapse photography calculation optimal parameter is a photography parameter calculated by using an image aesthetics evaluation model, a video aesthetics evaluation model and a time-lapse aesthetics evaluation model, the time-lapse aesthetics evaluation model includes a first time-lapse aesthetics evaluation model based on optical flow and a second time-lapse aesthetics evaluation model based on brightness and color, and the time-lapse photography calculation optimal parameter includes a shooting scene selection optimal parameter, a camera motion optimal parameter and a shooting time optimal parameter.

[0116] Correspondingly, in some embodiments, the virtual time-lapse photography interaction application can set one or more operation modes, such as an automatic operation mode of generating a virtual time-lapse video directly according to time-lapse photography calculation of optimal parameters, a semi-automatic operation mode of calculating optimal parameters for time-lapse photography based on initial custom parameters, and / or a custom operation mode of preset initial parameters based on initial custom parameters. For example, before the virtual time-lapse photography interaction interface displays the scene image corresponding to the custom parameters in the parameter adjustment region of the virtual scene to be photographed, the processor can switch to display an operation mode selection sub-interface according to the operation mode display instruction triggered by the virtual time-lapse photography interaction interface, so as to display each preset operation mode in the operation mode selection sub-interface; wherein the preset operation modes include an automatic operation mode, a semi-automatic operation mode, and a custom operation mode; determine a target operation mode from the preset operation modes according to the operation mode selection instruction triggered by the operation mode selection sub-interface; if the target operation mode is the automatic operation mode, obtain the time-lapse photography calculation optimal parameters, and determine the time-lapse photography calculation optimal parameters as the time-lapse photography parameters, and proceed to step 103 to generate a corresponding virtual time-lapse video; if the target operation mode is the semi-automatic operation mode, execute the step of obtaining the time-lapse photography calculation optimal parameters corresponding to the virtual scene to be photographed, and determine the time-lapse photography calculation optimal parameters as the initial custom parameters, so as to facilitate user adjustment of the custom parameters; if the target operation mode is the custom operation mode, obtain the preset initial parameters corresponding to the virtual scene to be photographed, and determine the preset initial parameters as the initial custom parameters, and execute the step of displaying the scene image corresponding to the initial custom parameters in the virtual time-lapse photography interaction interface in the virtual scene to be photographed, and displaying the initial custom parameters in the parameter adjustment region, so that the user can adjust the custom parameters based on the preset initial parameters; wherein the preset initial parameters include preset initial shooting framing parameters, preset initial camera motion parameters, and preset initial shooting time parameters.

[0117] For example, the user can click the "Pattern" virtual button (i.e., the operation mode display virtual button) in the virtual time-lapse photography interaction interface shown in FIG. 1A to trigger the operation mode display instruction, and switch to display the operation mode selection sub-interface shown in FIG. 1B. Figure 2 For example, the user can click the "Pattern" virtual button (i.e., the operation mode display virtual button) in the virtual time-lapse photography interaction interface shown in FIG. 1A to trigger the operation mode display instruction, and switch to display the operation mode selection sub-interface shown in FIG. 1B. Figure 4The operation mode selection sub-interface (PATTERN interface) is shown to display three preset operation modes, i.e., an automatic operation mode (Automatic) calculated by a complete algorithm (Algorithm), a semi-automatic operation mode (Semi-automatic) combining algorithm calculation and manual interaction (Interaction), and a custom operation mode (Manual) of complete manual interaction (Interaction). A user can click any preset operation mode selection instruction triggered by the operation mode selection sub-interface to select a target operation mode, and automatically or by clicking the "Home" virtual key (i.e., the main interface switching virtual key) to switch back to the virtual time-lapse photography interface.

[0118] Correspondingly, the processor in this embodiment can also adjust the custom parameters according to parameter adjustment instructions (such as shooting angle adjustment instructions, motion trajectory selection instructions, and time range adjustment instructions) triggered by the parameter adjustment region in the virtual time-lapse photography interface.

[0119] Step 103: Perform time-lapse photography in the virtual scene to be photographed according to the time-lapse photography parameters, and generate a virtual time-lapse video.

[0120] It can be understood that the virtual time-lapse video in this embodiment can be a time-lapse video in the virtual scene to be photographed (i.e., a dynamic virtual scene). For the specific manner in which the processor performs time-lapse photography in the virtual scene to be photographed according to the time-lapse photography parameters to generate a virtual time-lapse video, a designer can set it by himself / herself. For example, the processor can generate a virtual image sequence corresponding to the time-lapse photography parameters in the virtual scene to be photographed, and generate a virtual time-lapse video according to the virtual image sequence. The virtual image sequence can include virtual images sorted in a shooting time sequence according to a shooting time range and a shooting time interval in the shooting time parameters. For example, the processor can use a virtual camera in a three-dimensional engine to render the virtual scene to be photographed according to the time-lapse photography parameters, and generate a virtual image sequence. That is, the virtual camera in the three-dimensional engine is used to shoot virtual images in the virtual scene to be photographed according to the time-lapse photography parameters, and a virtual image sequence is obtained.

[0121] Correspondingly, for the specific manner of generating the virtual time-lapse video according to the virtual image sequence, the designer can set it by himself, for example, the processor can directly synthesize the virtual image sequence to generate the virtual time-lapse video. Since the virtual camera cannot remain completely constant during shooting, unexpected exposure jumps may occur in some frames, resulting in flickering; in order to obtain better visual effects, the processor can first smooth the exposure of each virtual image in the virtual image sequence to obtain a processed virtual image sequence; and then synthesize the processed virtual image sequence to generate the virtual time-lapse video. That is, the processor can smooth the exposure in the virtual image sequence by smoothing the exposure of each virtual image in the virtual image sequence, thereby improving the visual effects of the virtual time-lapse video. For example, the processor can perform a histogram equalization operation on the exposure of each virtual image in the virtual image sequence to obtain a processed virtual image sequence; that is, the processor can smooth the exposure of each virtual image in the virtual image sequence by performing a histogram equalization operation.

[0122] In this embodiment, the virtual time-lapse photography parameter setting of the present embodiment can parameterize the virtual time-lapse photography process according to the characteristics of real time-lapse photography, and further generate a dynamic virtual time-lapse video corresponding to the time-lapse photography parameters in the virtual scene to be photographed, thereby realizing automatic generation of high-quality virtual time-lapse video, simulating the time-lapse photography in the real environment, guiding the time-lapse photography in the real world, saving time and economic cost; and through the setting of the parameter adjustment region in the virtual time-lapse photography interactive interface, the user can conveniently configure and adjust the time-lapse photography parameters according to his own preferences and aesthetics, conveniently generate personalized virtual time-lapse video, and improve the user experience.

[0123] Based on the above embodiment, the present embodiment further provides another interactive shooting method of virtual time-lapse video to facilitate the user to set the time-lapse photography parameters and improve the quality of the virtual time-lapse video. Correspondingly, please refer to Figure 5 , Figure 5 The flowchart of another interactive shooting method of virtual time-lapse video provided by the present embodiment. The method can include:

[0124] Step 201: according to the scene display instruction triggered by the virtual time-lapse photography interactive interface, switching to display a preset scene display sub-interface to display the preview content of each preset dynamic virtual scene in the preset scene display sub-interface.

[0125] It can be understood that in this step, the processor can directly enter the display of the virtual time-lapse photography interactive application as the main interface after starting the virtual time-lapse photography interactive application, for example, the virtual time-lapse photography interactive application can be directly displayed as the main interface after starting the virtual time-lapse photography interactive application. Figure 2The virtual time-lapse photography interaction interface is shown. Correspondingly, before the user triggers any instruction through the virtual time-lapse photography interaction interface, an operation step prompt box can be displayed on the virtual time-lapse photography interaction interface to prompt the use method of the virtual time-lapse photography interaction application; for example Figure 2 As shown, the operation step prompt box can include operation step prompt information of the virtual time-lapse photography interaction application, such as Figure 2 Step 1: choose scene, Step 2: choose pattern, Step 3: interaction, and Step 4: show result; the operation step prompt box can also include the name of the virtual time-lapse photography interaction application.

[0126] Correspondingly, the user can trigger a scene display instruction by clicking the “Scene” virtual button (i.e., scene display virtual button) in the virtual time-lapse photography interaction interface according to the operation step prompt information, using a mouse or touch, to switch to the preset scene display sub-interface shown in Figure 3 to display the preview content of each preset dynamic virtual scene, such as the preview image or preview video corresponding to each preset dynamic virtual scene, to facilitate the user to select the desired preset dynamic virtual scene.

[0127] It should be noted that the present embodiment is an example of selecting a preset dynamic virtual scene as a to-be-photographed virtual scene, and the user can also load a new dynamic virtual scene as a to-be-photographed virtual scene using the scene loading function. For example, in some embodiments, the processor can obtain a three-dimensional model of a static virtual scene according to a scene new creation instruction triggered by the virtual time-lapse photography interaction interface; process the three-dimensional model of the static virtual scene using a three-dimensional engine to generate a to-be-photographed virtual scene. As shown in Figure 2 The user can click the menu virtual button in the lower right corner of the virtual time-lapse photography interaction interface to display a configuration menu in the virtual time-lapse photography interaction interface, click the scene new creation menu item in the configuration menu to trigger a scene new creation instruction, read the three-dimensional model of the static virtual scene from the selected storage location to generate a new dynamic virtual scene, and use the new dynamic virtual scene as a to-be-photographed virtual scene; correspondingly, the processor can also store the new dynamic virtual scene corresponding to the scene new creation instruction as a new preset dynamic virtual scene, so that the user can directly select the new preset dynamic virtual scene in the preset scene display sub-interface in the future.

[0128] Step 202: Determine a to-be-photographed virtual scene from the preset dynamic virtual scenes according to a scene selection instruction triggered by the preset scene display sub-interface.

[0129] The user can click to select a preset dynamic virtual scene in the preset scene display sub-interface, trigger a scene selection instruction, and determine the preset dynamic virtual scene selected by the user as the virtual scene to be photographed.

[0130] Correspondingly, after the processor determines the virtual scene to be photographed from the preset dynamic virtual scene in this step, the virtual time-lapse photography interactive interface can be directly switched to display; or the virtual time-lapse photography interactive interface can be switched to display after the main interface switching instruction triggered by the preset scene display sub-interface is obtained, for example, as shown in the following figure, the user can click the “Home” virtual button (i.e., the main interface switching virtual button) to trigger the main interface switching instruction and return to the virtual time-lapse photography interactive interface. Figure 3

[0131] Further, before this step, the processor can also obtain a three-dimensional model of a static virtual scene corresponding to a preset scene creation instruction triggered by the preset scene display sub-interface according to the preset scene creation instruction; process the three-dimensional model of the static virtual scene by using a three-dimensional engine, and generate a preset dynamic virtual scene corresponding to the preset scene creation instruction, so as to realize the addition of the preset dynamic virtual scene. Correspondingly, the processor can also delete a corresponding preset dynamic virtual scene according to a preset scene deletion instruction triggered by the preset scene display sub-interface, so as to realize the deletion of the preset dynamic virtual scene.

[0132] Step 203: Switch to display an operation mode selection sub-interface according to an operation mode display instruction triggered by the virtual time-lapse photography interactive interface, so as to display each preset operation mode in the operation mode selection sub-interface; wherein the preset operation mode includes an automatic operation mode, a semi-automatic operation mode, and a custom operation mode.

[0133] Step 204: Determine a target operation mode from the preset operation mode according to an operation mode selection instruction triggered by the operation mode selection sub-interface.

[0134] It can be understood that the target operation mode in this step can be any preset operation mode, i.e., the preset operation mode selected by the user corresponding to the operation mode display instruction.

[0135] Step 205: If the target operation mode is the automatic operation mode, obtain a time-lapse photography calculation optimal parameter corresponding to the virtual scene to be photographed, and determine the time-lapse photography calculation optimal parameter as the time-lapse photography parameter, and proceed to step 211.

[0136] ​The time-lapse photography calculation optimal parameter is a photography parameter calculated by using an image aesthetic evaluation model, a video aesthetic evaluation model, and a time-lapse aesthetic evaluation model. The time-lapse aesthetic evaluation model includes a first time-lapse aesthetic evaluation model based on optical flow and a second time-lapse aesthetic evaluation model based on brightness and color. The time-lapse photography calculation optimal parameter includes a shooting scene selection optimal parameter, a camera motion optimal parameter, and a shooting time optimal parameter.

[0137] It can be understood that, in the embodiment, when the target operation mode is the automatic operation mode, i.e., the preset operation mode selected by the user is the automatic operation mode, the processor can obtain the time-lapse photography calculation optimal parameter corresponding to the virtual scene to be photographed, so as to use the time-lapse photography calculation optimal parameter as the time-lapse photography parameter, i.e., the shooting scene selection parameter, the camera motion parameter, and the shooting time parameter in the time-lapse photography parameter can be the shooting scene selection optimal parameter, the camera motion optimal parameter, and the shooting time optimal parameter in the time-lapse photography calculation optimal parameter respectively, so that the corresponding virtual time-lapse video is directly generated by using the time-lapse photography calculation optimal parameter.

[0138] Step 206: If the target operation mode is the semi-automatic operation mode, the time-lapse photography calculation optimal parameter corresponding to the virtual scene to be photographed is obtained, and the time-lapse photography calculation optimal parameter is determined as the initial custom parameter, and step 208 is entered.

[0139] The custom parameter includes a shooting scene selection custom parameter, a camera motion custom parameter, and a shooting time custom parameter.

[0140] Correspondingly, in the embodiment, when the target operation mode is the semi-automatic operation mode, i.e., the preset operation mode selected by the user is the semi-automatic operation mode, the processor can obtain the time-lapse photography calculation optimal parameter corresponding to the virtual scene to be photographed, so as to use the time-lapse photography calculation optimal parameter as the initial custom parameter in the parameter adjustment region in the virtual time-lapse photography interactive interface, i.e., the shooting scene selection custom parameter, the camera motion custom parameter, and the shooting time custom parameter in the custom parameter can be the shooting scene selection optimal parameter, the camera motion optimal parameter, and the shooting time optimal parameter in the time-lapse photography calculation optimal parameter respectively, so that the user can adjust the custom parameter on the basis of the time-lapse photography calculation optimal parameter.

[0141] Step 207: If the target operation mode is the custom operation mode, the preset initial parameter corresponding to the virtual scene to be photographed is obtained, and the preset initial parameter is determined as the initial custom parameter.

[0142] The preset initial parameter includes a preset initial shooting scene selection parameter, a preset initial camera motion parameter, and a preset initial shooting time parameter.

[0143] Correspondingly, in the case that the target operation mode is the custom operation mode, i.e., the preset operation mode selected by the user is the custom operation mode, the processor can obtain preset initial parameters corresponding to the virtual scene to be photographed, so as to use the preset initial parameters as initial custom parameters in the parameter adjustment region in the virtual time-lapse photography interactive interface, i.e., the shooting framing custom parameter, the camera motion custom parameter and the shooting time custom parameter in the custom parameters can be preset initial parameters including preset initial shooting framing parameters, preset initial camera motion parameters and preset initial shooting time parameters, so that the user can adjust the custom parameters on the basis of the optimal parameters calculated by the time-lapse photography.

[0144] Step 208: Display a scene image corresponding to the initial custom parameters in the virtual time-lapse photography interactive interface, and display the initial custom parameters in the parameter adjustment region in the virtual time-lapse photography interactive interface.

[0145] Correspondingly, as shown in Figure 2 and Figure 6 , after the user selects the custom operation mode or the semi-automatic operation mode, the virtual time-lapse photography interactive interface can display a scene image corresponding to the initial custom parameters in the virtual scene to be photographed, and the parameter adjustment region.

[0146] Correspondingly, the embodiments are not limited to the specific display manner of the parameter adjustment region and the scene image, as shown in Figure 6 , the parameter adjustment region can be displayed on the scene image with a preset transparency.

[0147] Step 209: Adjust the custom parameters according to the parameter adjustment instruction triggered by the parameter adjustment region in the virtual time-lapse photography interactive interface, and display a scene image corresponding to the adjusted custom parameters in the virtual scene to be photographed in the virtual time-lapse photography interactive interface, and display the adjusted custom parameters in the parameter adjustment region.

[0148] It should be noted that the embodiments are described by taking the virtual time-lapse video generation after the initial custom parameters are adjusted by step 210 after the scene image corresponding to the initial custom parameters in the virtual scene to be photographed is displayed as an example; step 210 can also not be performed, i.e., the user does not need to adjust the initial custom parameters, and directly triggers a shooting instruction in the virtual time-lapse photography interactive interface to generate a virtual time-lapse video by using the initial custom parameters. The embodiments do not make any limitation on this.

[0149] It can be understood that the parameter adjustment instruction in the embodiment can be an instruction for adjusting the custom parameter. The specific number and type of the parameter adjustment instruction in the embodiment can be set by the designer according to the use scenario and user demand, for example, the parameter adjustment instruction can include a movement instruction for adjusting the shooting position in the shooting scene selection custom parameter; for example, in some embodiments, the processor can adjust the shooting position in the shooting scene selection custom parameter according to the movement instruction triggered by the keyboard device; the virtual time-lapse photography interactive interface updates and displays the scene image corresponding to the adjusted shooting position in the to-be-shot virtual scene in the parameter adjustment region, and displays the adjusted shooting position (such as the xyz coordinates) in the shooting position coordinate display region in the parameter adjustment region. For example, the parameter adjustment region includes the “Location” display box in Figure 2 and Figure 6 . That is, as shown in Figure 7 , the user can freely move in the to-be-shot virtual scene through the preset movement direction keys (such as W, A, S, and D keys) on the keyboard, and the corresponding virtual time-lapse photography interactive interface displays the scene image of the corresponding movement position (i.e., the shooting position) and the coordinates of the corresponding shooting position in the shooting position coordinate display region.

[0150] Correspondingly, in another embodiment, the processor can also adjust the shooting position in the shooting scene selection custom parameter according to the movement instruction triggered by the keyboard device; calculate the time-lapse photography adjustment optimal parameter corresponding to the adjusted shooting position by using the image aesthetic evaluation model, the video aesthetic evaluation model, and the time-lapse aesthetic evaluation model according to the adjusted shooting position; adjust the custom parameter by using the time-lapse photography adjustment optimal parameter; display the scene image corresponding to the adjusted custom parameter in the to-be-shot virtual scene in the virtual time-lapse photography interactive interface, and display the adjusted custom parameter in the parameter adjustment region. The time-lapse aesthetic evaluation model includes a first time-lapse aesthetic evaluation model based on optical flow and a second time-lapse aesthetic evaluation model based on brightness and color, the time-lapse photography adjustment optimal parameter includes a shooting scene selection adjustment optimal parameter, a camera motion adjustment optimal parameter, and a shooting time adjustment optimal parameter, and the shooting position in the shooting scene selection adjustment optimal parameter is the adjusted shooting position. That is, after the user adjusts the shooting position in the custom parameter through the keyboard, the processor can calculate the time-lapse photography adjustment optimal parameter corresponding to the adjusted shooting position by using the image aesthetic evaluation model, the video aesthetic evaluation model, and the time-lapse aesthetic evaluation model based on the adjusted shooting position, so that the user can continue to adjust the custom parameter based on the time-lapse photography adjustment optimal parameter.

[0151] Correspondingly, the parameter adjustment instruction can also include a shooting angle adjustment instruction for adjusting the shooting angle in the shooting framing custom parameter; for example, in some embodiments, the processor can adjust the shooting angle in the shooting framing custom parameter according to the shooting angle adjustment instruction triggered by the virtual time-lapse photography interactive interface; the virtual time-lapse photography interactive interface updates and displays the scene image corresponding to the adjusted shooting angle in the virtual scene to be shot, and displays the adjusted shooting angle in the shooting angle adjustment area; wherein the parameter adjustment area includes the shooting angle adjustment area, such as the “Oritention (positioning)” display box in Figure 2 and Figure 6 . That is, as shown in Figure 8 , the user can adjust the pitch angle in the range of 0° to 360° by clicking or dragging the “Yaw” adjustment bar (i.e., the yaw angle sliding adjustment bar), trigger the shooting angle adjustment instruction, and the corresponding virtual time-lapse photography interactive interface will display the scene image corresponding to the yaw angle, and display the current yaw angle on the “Yaw” adjustment bar; as shown in Figure 9 , the user can adjust the pitch angle in the range of -90° to 90° by clicking or dragging the “Pitch” adjustment bar (i.e., the pitch angle sliding adjustment bar), trigger the shooting angle adjustment instruction, and the corresponding virtual time-lapse photography interactive interface will display the scene image corresponding to the pitch angle, and display the current pitch angle on the “Pitch” adjustment bar

[0152] Correspondingly, the parameter adjustment instruction can also include a motion trajectory selection instruction for adjusting the camera motion custom parameter; for example, in some embodiments, the processor can determine the camera motion custom parameter from the selectable shooting trajectory according to the motion trajectory selection instruction triggered by the virtual time-lapse photography interactive interface; the virtual time-lapse photography interactive interface displays the trajectory schematic box corresponding to the camera motion custom parameter; wherein the parameter adjustment area includes a shooting trajectory selection area for selecting the selectable shooting trajectory, such as the “Module (mode)” display box in Figure 2 and Figure 6 . That is, as shown in Figure 10 , the user can trigger the motion trajectory selection instruction by clicking the virtual keys (1-4 virtual keys) corresponding to the four selectable shooting trajectories (such as orbit, pan, still, and zoom) in the “Module” display box, and the corresponding virtual time-lapse photography interactive interface will display the trajectory schematic box of the selected one of the selectable shooting trajectories (i.e., the camera motion custom parameter), to prompt the user to the specific shooting trajectory of the selected one of the selectable shooting trajectories.

[0153] Correspondingly, the parameter adjustment instruction can further include a time range adjustment instruction for adjusting the shooting time range in the shooting time custom parameter; for example, the processor can adjust the start time or the end time of the shooting time range in the shooting time custom parameter according to the time range adjustment instruction triggered by the virtual time-lapse photography interactive interface; the virtual time-lapse photography interactive interface updates and displays the scene image corresponding to the adjusted start time or end time of the shooting time range in the virtual scene to be shot, and displays the adjusted shooting time range in the time range adjustment area; wherein the parameter adjustment area includes the time range adjustment area (such as the "Time-Set" display box in Figure 2 and Figure 6 ). As shown in Figure 11 , the user can adjust the start time and the end time of the shooting time range within 0 to 24 points by clicking or dragging the "Start" adjustment bar (i.e., the start time sliding adjustment bar) and the "End" adjustment bar (i.e., the end time sliding adjustment bar), trigger the time range adjustment instruction, and the corresponding virtual time-lapse photography interactive interface will display the scene image corresponding to the adjusted time (start time or end time), and display the adjusted shooting time range in the time range adjustment area.

[0154] Correspondingly, the parameter adjustment instruction can further include a time interval adjustment instruction for adjusting the shooting time interval in the shooting time custom parameter; for example, the processor can adjust the shooting time interval in the shooting time custom parameter according to the time interval adjustment instruction triggered by the virtual time-lapse photography interactive interface; display the adjusted shooting time interval in the time interval adjustment area; wherein the parameter adjustment area includes the time interval adjustment area (such as the "Time-t" display box in Figure 2 and Figure 6 ). That is, as shown in Figure 6 , the user can trigger the time interval adjustment instruction by clicking the virtual keys (10s, 20s, 30s, and 1min virtual keys) corresponding to the four selectable time intervals (10s, 20s, 30s, and 1min) in the "Time-t" display box, and the corresponding "Time-t" display box can highlight the virtual key corresponding to the selected selectable time interval to prompt the user to select the selectable time interval.

[0155] Correspondingly, the parameter adjustment instruction can also include a pose adjustment instruction for adjusting a set of custom parameters; for example, the processor can adjust all or most of the custom parameters according to the pose adjustment instruction triggered by the virtual time-lapse photography interactive interface, according to the custom parameter combination corresponding to the pose adjustment instruction; display the scene image corresponding to the adjusted custom parameters in the virtual time-lapse photography interactive interface, and display the adjusted custom parameter combination in the pose adjustment area; wherein the parameter adjustment area includes the pose adjustment area, such as the "Poselist" display box in Figure 2 and Figure 6 ; that is, as shown in Figure 6 , the user can trigger the pose adjustment instruction by clicking the virtual keys (1-4 virtual keys) corresponding to the four preset custom parameter combinations in the "Poselist" display box, and the corresponding virtual time-lapse photography interactive interface will display the scene image of the corresponding adjusted custom parameters. The "Poselist" display box can highlight the selected custom parameter combination corresponding to the virtual key to prompt the user to use the current custom parameter combination.

[0156] Further, in some embodiments, the virtual time-lapse photography interactive interface can also include a dynamic element adjustment area for adjusting adjustable dynamic elements, to adjust the adjustable dynamic elements (such as cloud elements and fog elements in weather elements) in the virtual scene to be photographed. For example, in some embodiments, the processor can adjust the adjustable dynamic elements of the virtual scene to be photographed according to the dynamic element adjustment instruction triggered by the virtual time-lapse photography interactive interface; update and display the scene image corresponding to the custom parameters in the adjusted virtual scene to be photographed in the virtual time-lapse photography interactive interface; wherein the virtual time-lapse photography interactive interface includes a dynamic element adjustment area for adjusting the adjustable dynamic elements, the adjustable dynamic elements include cloud elements and / or fog elements in weather elements, and the dynamic element adjustment area includes a quantity adjustment bar and / or a motion speed adjustment bar corresponding to each adjustable dynamic element. As shown in the scene images of the multiple fog weather on the upper side and the multiple cloud weather on the lower side in Figure 12 , the user can adjust the number of cloud elements and fog elements within the range from the minimum number (Min) to the maximum number (Max) by clicking or dragging the "Cloud" adjustment bar (i.e. the number adjustment bar of the cloud elements) and the "Fog" adjustment bar (i.e. the number adjustment bar of the fog elements) in the "Weather" display box (i.e. the dynamic element adjustment area), and the corresponding virtual time-lapse photography interactive interface will display the scene image of the corresponding adjusted adjustable dynamic elements, and display the adjusted number of cloud elements and fog elements in the "Weather" display box.

[0157] Step 210: After triggering the shooting instruction in the virtual time-lapse photography interactive interface, the time-lapse photography parameters are determined according to the custom parameters of the parameter adjustment region in the virtual scene to be shot.

[0158] It can be understood that in the embodiment, the processor can determine the time-lapse photography parameters according to the current custom parameters in the parameter adjustment region in the virtual scene to be shot after obtaining the shooting instruction triggered by the virtual time-lapse photography interactive interface; for example, the current custom parameters are directly used as the time-lapse photography parameters, that is, the shooting selection parameters, the camera motion parameters, and the shooting time parameters in the time-lapse photography parameters can be the shooting selection custom parameters, the camera motion custom parameters, and the shooting time custom parameters in the current custom parameters, respectively.

[0159] Step 211: Perform time-lapse photography in the virtual scene to be shot according to the time-lapse photography parameters, and generate a virtual time-lapse video.

[0160] In this embodiment, the step is similar to step 103, and will not be described here.

[0161] Based on the above embodiment, the process of obtaining the time-lapse photography calculation optimal parameters corresponding to the virtual scene to be shot in the above embodiment can be as shown in Figure 13 , and includes:

[0162] Step 301: Obtain the shooting selection optimal parameters by using the image aesthetics evaluation model.

[0163] It can be understood that the time-lapse photography calculation optimal parameters can include shooting selection optimal parameters, camera motion optimal parameters, and shooting time optimal parameters; the shooting selection optimal parameters can include a shooting position and a shooting angle.

[0164] For example, when the shooting position and the shooting angle in the shooting selection optimal parameters are not set to fixed values, as shown in Figure 14 , the step can include:

[0165] Step 3011: Traverse and sample the accessible region in the virtual scene to be shot to obtain a shooting sampling position.

[0166] It can be understood that the accessible region in this step can be a region in the virtual scene to be shot where a virtual camera can be set; for example, the processor can directly define the accessible region in the virtual scene to be shot according to the size (such as a bounding box) of the virtual scene to be shot, or the processor can define the ground region in the virtual scene to be shot as the accessible region in the virtual scene to be shot. This embodiment does not make any limitation in this regard.

[0167] Correspondingly, the specific manner of obtaining the shooting sampling positions by traversing and sampling the reachable region of the virtual scene to be shot by the processor in this step can be set by the designer, for example, the processor can traverse and sample the reachable region of the virtual scene to be shot according to the sampling distance interval to obtain the shooting sampling positions; that is, the processor can traverse and sample the possible shooting positions in the reachable region at the sampling distance interval to obtain each selectable shooting position (i.e., the shooting sampling position); wherein the height of each shooting sampling position can be the same, for example, the z-axis in the coordinates of the shooting sampling position L v v L

[0168] For example, the processor can traverse and sample the reachable region of the virtual scene to be shot at a preset fixed sampling distance interval to obtain the shooting sampling positions. In order to reduce the number of shooting sampling positions while ensuring that the possible optimal shooting position is not lost, the processor in this embodiment can obtain the sampling distance interval at the current sampling time according to the sampling distance interval at the last sampling time and the first aesthetic score at the last sampling time, so as to obtain the next shooting sampling position by using the sampling distance interval at the current sampling time and the current shooting sampling position when the next shooting sampling position needs to be sampled; that is, the distance between the shooting sampling positions in the reachable region can not be fixed.

[0169] For example, the processor can obtain the sampling distance interval at the current sampling time by Δd t is the sampling distance interval at the current sampling time; t is the current sampling time; Δd t-1 is the sampling distance interval at the last sampling time; is the first aesthetic score at the initial sampling time, that is, the first aesthetic score obtained by using the image aesthetic evaluation model at the 0th sampling time, that is, the first aesthetic score obtained by using the image aesthetic evaluation model at the first sampling time; is the first aesthetic score at the last sampling time, that is, the first aesthetic score obtained by using the image aesthetic evaluation model at the last sampling time, that is, the first aesthetic score obtained by using the image aesthetic evaluation model at the last sampling time.

[0170] Step 3012: Obtain the shooting sampling angle corresponding to each shooting sampling position; wherein the shooting sampling angle includes the yaw angle, the pitch angle and the roll angle.

[0171] It can be understood that in this step, the processor can sample the possible shooting angle for each shooting sampling position L v to obtain the shooting sampling angle A w ​= (a, b, g); a, b and g can be yaw angle, pitch angle and roll angle respectively.

[0172] In this embodiment, the specific manner in which the processor obtains the respective photographing sampling angle corresponding to each photographing sampling position is not limited, for example, the processor can obtain the respective photographing sampling angle corresponding to each photographing sampling position according to a sampling angle interval; for example, the processor can obtain the respective photographing sampling angle corresponding to each photographing sampling position according to a fixed sampling angle interval.

[0173] It should be noted that, in order to avoid the influence of camera rolling on the viewing effect of the virtual time-lapse video, the roll angle in each photographing sampling angle in this embodiment can be a fixed preset roll angle (such as 0°). The yaw angle in each photographing sampling angle in this embodiment can be within a preset yaw angle range, and the pitch angle in each photographing sampling angle can be within a preset pitch angle range.

[0174] Correspondingly, in this embodiment, the specific value range of the preset yaw angle range, the preset pitch angle range and the preset roll angle is not limited, for example, the preset yaw angle range can be [0°, 360°], the preset pitch angle range can be [-90°, 90°], and the preset roll angle can be 0°; that is, a ∈ [0°, 360°], b ∈ [-90°, 90°], and g = 0°.

[0175] Step 3013: generating a first evaluation image corresponding to each photographing sampling parameter using the virtual scene to be photographed; wherein each photographing sampling parameter comprises a photographing sampling position and a photographing sampling angle.

[0176] It can be understood that, in this step, the processor uses the photographing position and the corresponding photographing angle (i.e. photographing sampling parameter (L v , A w )) obtained at each sampling time to set the virtual camera pose at each sampling time, and uses the virtual camera to photograph the virtual scene to be photographed to obtain a series of images (i.e. first evaluation images).

[0177] Step 3014: obtaining a first aesthetic score corresponding to each first evaluation image using an image aesthetic evaluation model.

[0178] In the step, the processor can calculate the aesthetic scores of the obtained images (i.e., the first evaluation images) by using the image aesthetic evaluation model. The specific content of the image aesthetic evaluation model in the step can be set by the designer, for example, the same or similar structure as the existing image aesthetic evaluation model can be used for setting, for example, the image aesthetic evaluation model can effectively predict the aesthetic score of the image considering the factors of light, color and composition (i.e., the first aesthetic score). The image aesthetic evaluation model is an image aesthetic quality evaluation model based on pseudo-label and meta-weight learning.

[0179] Step 3015: determining the optimal shooting scene parameter from the shooting scene sampling parameters according to the first aesthetic score; wherein the optimal shooting scene parameter is any shooting scene sampling parameter.

[0180] It can be understood that the processor can select one shooting scene sampling parameter as the optimal shooting scene parameter from the shooting scene sampling parameters corresponding to the first evaluation images according to the first aesthetic score corresponding to each first evaluation image.

[0181] Correspondingly, the specific way in which the processor determines the optimal shooting scene parameter from the shooting scene sampling parameters according to the first aesthetic score in the embodiment can be set by the designer, for example, the processor can directly determine the shooting scene sampling parameter corresponding to the highest score as the optimal shooting scene parameter; for example, the processor can determine the optimal shooting scene parameter by Step 3015: determining the optimal shooting scene parameter from the shooting scene sampling parameters according to the first aesthetic score; wherein the optimal shooting scene parameter is any shooting scene sampling parameter. L and N A are the number of shooting sampling positions and shooting sampling angles, respectively; Q I is the image aesthetic evaluation model; the processor can also determine the shooting scene sampling parameter corresponding to the second highest score as the optimal shooting scene parameter.

[0182] Step 302: obtaining the optimal camera motion parameter according to the optimal shooting scene parameter and the video aesthetic evaluation model.

[0183] Understandably, since time-lapse videos typically capture changes over hours or even days, and complex camera movements can cause lens shake, four basic camera movements—orbit, pan, stand still, and zoom—can be chosen during virtual shooting to determine the shooting trajectory (i.e., the optimal camera movement parameters). Zoom refers to the virtual camera moving closer to or away from the subject; panning refers to moving the virtual camera horizontally from one side of the subject to the other; and orbit refers to focusing on the subject and moving the camera around it from one side to the other. These four shooting trajectories are the basic shooting trajectories, and new shooting trajectories can be combined or designed according to the desired effect.

[0184] Accordingly, in some embodiments, the processor can generate shooting points corresponding to each optional shooting trajectory based on shooting selection parameters and preset basic shooting trajectories; generate second evaluation image sequences corresponding to each optional shooting trajectory based on shooting points using a dynamic virtual scene; obtain second aesthetic scores corresponding to each second evaluation image sequence using a video aesthetic evaluation model; and determine optimal camera motion parameters from the optional shooting trajectories based on the second aesthetic scores; wherein, the preset basic shooting trajectories include at least one or at least two of orbiting, translation, stillness, and scaling, and each optional shooting trajectory includes one preset basic shooting trajectory or a combination of multiple preset basic shooting trajectories; the optimal camera motion parameters are any optional shooting trajectory.

[0185] In other words, the processor can utilize a set of shooting points Let N represent an optional shooting trajectory (i.e., a selectable shooting trajectory); where N p The number of shooting points on the selectable shooting trajectory can be specified; each shooting point can be decomposed into the corresponding shooting position and shooting angle of the virtual camera; the shooting position (i.e., the initial shooting position) and shooting angle (i.e., the initial shooting angle) of the initial shooting point can be the shooting position and shooting angle in the shooting selection parameters. Among them, the preset basic shooting trajectory for zooming in and out can be a fixed initial shooting angle, with the shooting position moving closer to or further away from the subject (e.g., the image center) from the initial shooting position; the preset basic shooting trajectory for translation can be a fixed initial shooting angle and initial shooting position with a fixed height (e.g., the z-axis value), changing the x-axis and y-axis values ​​to move the virtual camera from one side of the subject to the other; the preset basic shooting trajectory for orbiting can be a focus on the subject, a fixed initial shooting angle and initial shooting position with a fixed height (e.g., the z-axis value), changing the x-axis and y-axis values ​​to move the virtual camera around the subject from one side to the other.

[0186] Correspondingly, the processor can select the camera motion by using the video aesthetics evaluation model, set the virtual camera pose according to the selectable shooting track, and shoot the scene by using the virtual camera to obtain a series of image sequences (i.e., a second evaluation image sequence); calculate the aesthetic score (i.e., a second aesthetic score) of each image sequence obtained by shooting by using the video aesthetics evaluation model, and finally select the selectable shooting track with the highest aesthetic score as the optimal parameter of the camera motion. For example, the processor can determine the selectable shooting track corresponding to the second aesthetic score with the highest score as the optimal parameter of the camera motion; wherein P' is the optimal parameter of the camera motion, P1 is the first selectable shooting track, N is the number of selectable shooting tracks, and Q is the video aesthetics evaluation model. V N is the number of selectable shooting tracks, and Q is the video aesthetics evaluation model. V Q is the video aesthetics evaluation model.

[0187] Correspondingly, the specific content of the above-mentioned video aesthetics evaluation model can be set by the designer, such as using the same or similar structure as the model for evaluating the aesthetics of the video in the prior art, which is not limited in the embodiment.

[0188] Step 303: obtaining the optimal shooting time parameter according to the shooting scene selection optimal parameter, the camera motion optimal parameter and the time-lapse aesthetics evaluation model.

[0189] The time-lapse aesthetics evaluation model includes a first time-lapse aesthetics evaluation model based on optical flow and a second time-lapse aesthetics evaluation model based on brightness and color, and the shooting time optimal parameter includes a shooting time range and a shooting time interval.

[0190] It can be understood that due to the change of light, the same scene looks very different at different times of the day, and usually a striking time-lapse video is shot within a time range with obvious light changes; and a good time-lapse video should have high color harmony, and a series of time ranges for shooting (i.e., selectable time ranges) can be preset in the embodiment, such as at least one of the sunrise time range (such as 5 to 7), the morning time range (such as 8 to 10), the noon time range (such as 11 to 13), the afternoon time range (such as 16 to 18) and the sunset time range (such as 20 to 22).

[0191] Correspondingly, in the time-lapse video, the shooting objects with different motion speeds need to be shot with appropriate time intervals to achieve the effect of time compression; a series of selectable time intervals (i.e., selectable time intervals) are preset in the embodiment, such as at least one of 1s, 5s, 10s, 30s, 60s and 300s.

[0192] ​Correspondingly, the processor in this step can generate a third evaluation image sequence corresponding to each selectable time interval in each selectable time range according to the shooting scene selection parameters and the camera motion parameters; determine the shooting time interval of the shooting time optimal parameters by using the first time-lapse aesthetic evaluation model and the third evaluation image sequence; and determine the shooting time range of the shooting time optimal parameters by using the second time-lapse aesthetic evaluation model and the third evaluation image sequence. That is, the processor can adaptively select the shooting time interval and the time range of the shooting time optimal parameters by using the two time-lapse aesthetic evaluation models. Correspondingly, the processor in this step can also generate a fourth evaluation image sequence corresponding to each selectable time interval in each selectable time range and a fifth evaluation image sequence corresponding to the same selectable time interval in each selectable time range according to the shooting scene selection parameters and the camera motion parameters; determine the shooting time interval of the shooting time optimal parameters by using the first time-lapse aesthetic evaluation model and the fifth evaluation image sequence; and determine the shooting time range of the shooting time optimal parameters by using the second time-lapse aesthetic evaluation model and the fourth evaluation image sequence.

[0193] Wherein, for the specific way that the processor determines the shooting time interval of the shooting time optimal parameters by using the first time-lapse aesthetic evaluation model and the third evaluation image sequence, the designer can set it by himself, such as the processor can extract the optical flow of each frame of the third evaluation image in each third evaluation image sequence; detect the saliency region and the non-saliency region of each frame of the third evaluation image in each third evaluation image sequence; and obtain the third aesthetic score corresponding to each third evaluation image sequence by using the first time-lapse aesthetic evaluation model according to the optical flow, the saliency region and the non-saliency region of each frame of the third evaluation image in each third evaluation image sequence; and determine the shooting time interval from the selectable time interval according to the third aesthetic score; wherein the shooting time interval is any selectable time interval.

[0194] For example, the processor can use the optical flow-based time-lapse aesthetic evaluation function (i.e. the first time-lapse aesthetic evaluation model) to capture the speed of moving objects by using the optical flow, and adaptively select the shooting time interval according to the speed of the moving objects and the speed contrast between the moving objects and the static objects. Specifically, the processor can use an optical flow extraction algorithm to extract the optical flow of each frame of image (i.e. the third evaluation image) in the third evaluation image sequence j∈[1,N f ], N f is the number of third evaluation images in the third evaluation image sequence; and detect the saliency region in the image by using an image saliency detection algorithm, wherein the saliency region can be considered as a region with slow or even static motion, and the non-saliency region is considered as a region with fast motion, which are respectively represented as I fast and I slowThe aesthetic score (i.e., the third aesthetic score) of the image sequence is calculated based on the time-lapse aesthetic evaluation function based on optical flow, and the optional time interval with the highest aesthetic score is selected as the shooting time interval.

[0195] Correspondingly, the processor can... Calculate the third aesthetic score corresponding to the current third-evaluation image sequence; where N f This represents the number of third-evaluation images in the current third-evaluation image sequence. This refers to the non-salient region of the j-th frame of the third evaluation image in the current third evaluation image sequence. Let J be the optical flow of the j-th frame of the third evaluation image in the current third evaluation image sequence. This refers to the salient region of the j-th frame of the third evaluation image in the current third evaluation image sequence; the current third evaluation image sequence is any third evaluation image sequence.

[0196] Furthermore, each frame of the third evaluation image in the current third evaluation image sequence satisfies in, τ is the number of pixels in the non-salient region of the j-th frame of the third evaluation image in the current third evaluation image sequence; τ is a preset threshold, such as 0.5, which ensures the stability of the image sequence by setting the number of pixels in the non-salient region (i.e., fast-moving region) in the image to not exceed a certain threshold; w and h are the width and length of the third evaluation image in the current third evaluation image sequence, respectively.

[0197] Correspondingly, the processor can... The highest-scoring optional time interval was selected as the shooting time interval; where T t 'N represents the shooting time interval.' t This represents the number of selectable time intervals; the total selectable time range can be... E I (T t 1 (This can be an optional time range T) t 1 The corresponding third aesthetic score, such as using an optional time interval T t 1 N r The maximum value of the third aesthetic score in a third-evaluation image sequence, or by using an optional time interval T. t 1 The fifth evaluation of the image sequence is the third aesthetic score; N r The number of selectable time ranges, i.e., the total number of all third-evaluation image sequences, is N. r ×N t The total number of fifth-evaluation image sequences is N. t .

[0198] It should be noted that the specific method by which the processor uses the second time-delay aesthetic evaluation model and the third evaluation image sequence to determine the optimal shooting time range can be set by the designer. For example, the processor can calculate the brightness change of each third evaluation image sequence; calculate the color harmony of each third evaluation image sequence; and, based on the brightness change and color harmony of each third evaluation image sequence, use the second time-delay aesthetic evaluation model to obtain the corresponding fourth aesthetic score for each third evaluation image sequence; and, based on the fourth aesthetic score, determine the shooting time range from the selectable time range; wherein, the shooting time range is any selectable time range.

[0199] For example, in this embodiment, the processor can use a brightness calculation algorithm to calculate the brightness change L of the acquired third evaluation image sequence based on a brightness and color time-delay aesthetic evaluation function (i.e., the second time-delay aesthetic evaluation model). c The color harmony H is calculated using a color harmony calculation algorithm. c Using E R =L c ·H c Calculate the fourth aesthetic score for each of the third-evaluation image sequences; select the time range with the greatest brightness variation and the greatest color harmony as the shooting time range R. t '=(s t ',e t ').

[0200] in, For the first optional time range, N r The number of optional time ranges, the i-th optional time range 1≤i≤N r , and They are respectively The start and end times, 1≤i≤N r , for The corresponding fourth aesthetic score, if using an optional time range N t The maximum value of the fourth aesthetic score in a third-evaluation image sequence, or by using an optional time interval T. t 1 The fourth aesthetic score of the fourth evaluation image sequence; N t N represents the number of optional time intervals, i.e., the total number of all third-evaluation image sequences. r ×N t The total number of fourth-evaluation image sequences is N. r ;st 'and e t 'respectively represent the start time and the end time of the shooting time range.

[0201] It should be noted that the present embodiment is taken as an example of using the image aesthetic evaluation model, the video aesthetic evaluation model and the time-lapse aesthetic evaluation model to directly calculate the optimal parameters (such as the shooting scene selection optimal parameter, the camera motion optimal parameter and the shooting time optimal parameter) of the whole time-lapse photography corresponding to the to-be-shot virtual scene; accordingly, for the specific process of calculating the time-lapse photography adjustment optimal parameter corresponding to the adjusted shooting position according to the adjusted shooting position in the self-defined parameter in the above embodiment, using the image aesthetic evaluation model, the video aesthetic evaluation model and the time-lapse aesthetic evaluation model, and the specific process of calculating the time-lapse photography adjustment optimal parameter corresponding to the adjusted self-defined parameter according to the other parameters (such as the shooting angle and the shooting time range) adjusted in the self-defined parameter, using the image aesthetic evaluation model, the video aesthetic evaluation model and / or the time-lapse aesthetic evaluation model, a similar method provided in the present embodiment can be used for corresponding setting, and the present embodiment does not make any limitation in this regard.

[0202] Corresponding to the above method embodiment, the present embodiment also provides an interactive shooting device of a virtual time-lapse video, and the interactive shooting device of a virtual time-lapse video described below can be mutually corresponding to the interactive shooting method of a virtual time-lapse video described above.

[0203] Please refer to Figure 15 , Figure 15 FIG. 1 is a structural block diagram of an interactive shooting device of a virtual time-lapse video provided in the present embodiment. The device can include:

[0204] The scene acquisition module 10 is configured to acquire a to-be-shot virtual scene; wherein the to-be-shot virtual scene is a three-dimensional scene with time-varying scene content.

[0205] The parameter determination module 20 is configured to determine a time-lapse photography parameter of the to-be-shot virtual scene according to a shooting instruction triggered by a virtual time-lapse photography interactive interface; wherein the time-lapse photography parameter includes a shooting scene selection parameter, a camera motion parameter and a shooting time parameter, the shooting scene selection parameter includes a shooting position and a shooting angle, the shooting time parameter includes a shooting time range and a shooting time interval, and the virtual time-lapse photography interactive interface includes a parameter adjustment region for adjusting the shooting scene selection parameter, the camera motion parameter and / or the shooting time parameter.

[0206] The time-lapse shooting module 30 is configured to perform time-lapse photography in the to-be-shot virtual scene according to the time-lapse photography parameter, and generate a virtual time-lapse video.

[0207] In some embodiments, the scene obtaining module 10 is specifically configured to determine a virtual scene to be photographed from the preset dynamic virtual scenes according to a scene selection instruction triggered by the virtual time-lapse photography interactive interface; and the virtual time-lapse photography interactive interface comprises a scene selection area for selecting the preset dynamic virtual scenes.

[0208] In some embodiments, the scene obtaining module 10 can comprise:

[0209] a model obtaining sub-module configured to obtain a three-dimensional model of a static virtual scene corresponding to a scene new instruction according to the scene new instruction triggered by the virtual time-lapse photography interactive interface;

[0210] a scene generating sub-module configured to process the three-dimensional model of the static virtual scene by using a three-dimensional engine, and generate the virtual scene to be photographed.

[0211] In some embodiments, the scene generating sub-module can be specifically configured to perform scene rendering on the three-dimensional model of the static virtual scene by using the three-dimensional engine, and add dynamic elements to generate the virtual scene to be photographed; and the dynamic elements comprise a character element, a traffic element, a weather element, and / or a light element.

[0212] In some embodiments, the model obtaining sub-module can comprise:

[0213] an image obtaining unit configured to obtain a real scene image corresponding to the scene new instruction;

[0214] a model generating unit configured to generate the three-dimensional model of the static virtual scene according to the real scene image.

[0215] In some embodiments, the scene obtaining module 10 can comprise:

[0216] a scene sub-interface switching sub-module configured to switch a preset scene display sub-interface to display preview content of each preset dynamic virtual scene in the preset scene display sub-interface according to a scene display instruction triggered by the virtual time-lapse photography interactive interface;

[0217] a scene determining sub-module configured to determine the virtual scene to be photographed from the preset dynamic virtual scenes according to a scene selection instruction triggered by the preset scene display sub-interface.

[0218] In some embodiments, the scene obtaining module 10 can further comprise:

[0219] a preset scene model obtaining sub-module configured to obtain a three-dimensional model of a static virtual scene corresponding to a preset scene new instruction according to the preset scene new instruction triggered by the preset scene display sub-interface;

[0220] The preset scene generation submodule is configured to process a three-dimensional model of the static virtual scene by using a three-dimensional engine, and generate a preset dynamic virtual scene corresponding to the preset scene new creation instruction.

[0221] In some embodiments, the time-lapse shooting module 30 can include:

[0222] The sequence generation submodule is configured to generate a virtual image sequence corresponding to the time-lapse photography parameter in the virtual scene to be shot.

[0223] The video generation submodule is configured to generate a virtual time-lapse video according to the virtual image sequence.

[0224] In some embodiments, the video generation submodule can include:

[0225] The exposure smoothing unit is configured to perform smoothing processing on the exposure of each virtual image in the virtual image sequence to obtain a processed virtual image sequence.

[0226] The image synthesis unit is configured to synthesize the processed virtual image sequence to generate the virtual time-lapse video.

[0227] In some embodiments, the exposure smoothing unit can be specifically configured to perform a histogram equalization operation on the exposure of each virtual image in the virtual image sequence to obtain the processed virtual image sequence.

[0228] In some embodiments, the sequence generation submodule can be specifically configured to render the virtual scene to be shot according to the time-lapse photography parameter by using a virtual camera of the three-dimensional engine to generate the virtual image sequence.

[0229] In some embodiments, the parameter determination module 20 can include:

[0230] The scene display submodule is configured to display a scene image corresponding to the custom parameter of the parameter adjustment region in the virtual time-lapse photography interactive interface; wherein the custom parameter includes a shooting selection custom parameter, a camera motion custom parameter, and / or a shooting time custom parameter.

[0231] The parameter determination submodule is configured to determine the time-lapse photography parameter according to the custom parameter after triggering the shooting instruction in the virtual time-lapse photography interactive interface.

[0232] In some embodiments, the scene display submodule can include:

[0233] The semi-automatic unit is configured to obtain a time-lapse photography calculation optimal parameter corresponding to the virtual scene to be photographed, and determine the time-lapse photography calculation optimal parameter as an initial custom parameter; wherein the time-lapse photography calculation optimal parameter is a photography parameter calculated by using an image aesthetic evaluation model, a video aesthetic evaluation model and a time-lapse aesthetic evaluation model, the time-lapse aesthetic evaluation model includes a first time-lapse aesthetic evaluation model based on optical flow and a second time-lapse aesthetic evaluation model based on brightness and color, and the time-lapse photography calculation optimal parameter includes a shooting scene selection optimal parameter, a camera motion optimal parameter and a shooting time optimal parameter;

[0234] The initial display unit is configured to display a scene image corresponding to the initial custom parameter in the virtual time-lapse photography interactive interface, and display the initial custom parameter in a parameter adjustment region.

[0235] In some embodiments, the scene display sub-module can further include:

[0236] The operation mode sub-interface switching unit is configured to switch a display of an operation mode selection sub-interface according to an operation mode display instruction triggered by the virtual time-lapse photography interactive interface, so as to display each preset operation mode in the operation mode selection sub-interface; wherein the preset operation mode includes an automatic operation mode, a semi-automatic operation mode and a custom operation mode.

[0237] The operation mode determination unit is configured to determine a target operation mode from the preset operation mode according to an operation mode selection instruction triggered by the operation mode selection sub-interface, and send a start signal to the semi-automatic unit if the target operation mode is the semi-automatic operation mode.

[0238] The automatic unit is configured to obtain the time-lapse photography calculation optimal parameter if the target operation mode is the automatic operation mode, determine the time-lapse photography calculation optimal parameter as a time-lapse photography parameter, and send a start signal to the time-lapse shooting module 30.

[0239] The custom unit is configured to obtain a preset initial parameter corresponding to the virtual scene to be photographed if the target operation mode is the custom operation mode, determine the preset initial parameter as an initial custom parameter, and send a start signal to the initial display unit; wherein the preset initial parameter includes a preset initial shooting scene selection parameter, a preset initial camera motion parameter and a preset initial shooting time parameter.

[0240] In some embodiments, the semi-automatic unit can include:

[0241] The shooting scene selection calculation sub-unit is configured to obtain the shooting scene selection optimal parameter by using the image aesthetic evaluation model.

[0242] The camera motion calculation sub-unit is configured to obtain the camera motion optimal parameter according to the shooting scene selection optimal parameter and the video aesthetic evaluation model.

[0243] The shooting time calculation sub-unit is configured to obtain shooting time optimal parameters according to the shooting framing optimal parameters, the camera motion optimal parameters, and the time-lapse aesthetic evaluation model.

[0244] In some embodiments, the scene display sub-module can include:

[0245] The first shooting position adjustment unit is configured to adjust the shooting position in the shooting framing custom parameter according to a movement instruction triggered by the keyboard device, wherein the movement instruction includes a forward movement instruction, a backward movement instruction, a left movement instruction, and / or a right movement instruction.

[0246] The first shooting position adjustment display unit is configured to display, in the virtual time-lapse photography interactive interface, a scene image corresponding to the adjusted shooting position in the to-be-shot virtual scene, and display the adjusted shooting position in a shooting position coordinate display region in the parameter adjustment region.

[0247] In some embodiments, the scene display sub-module can include:

[0248] The second shooting position adjustment unit is configured to adjust the shooting position in the shooting framing custom parameter according to a movement instruction triggered by the keyboard device, wherein the movement instruction includes a forward movement instruction, a backward movement instruction, a left movement instruction, and / or a right movement instruction.

[0249] The optimal calculation unit is configured to calculate, according to the adjusted shooting position, a time-lapse photography adjustment optimal parameter corresponding to the adjusted shooting position by using the image aesthetic evaluation model, the video aesthetic evaluation model, and the time-lapse aesthetic evaluation model, wherein the time-lapse aesthetic evaluation model includes a first time-lapse aesthetic evaluation model based on optical flow and a second time-lapse aesthetic evaluation model based on brightness and color, the time-lapse photography adjustment optimal parameter includes shooting framing adjustment optimal parameters, camera motion adjustment optimal parameters, and shooting time adjustment optimal parameters, and the shooting position in the shooting framing adjustment optimal parameters is the adjusted shooting position.

[0250] The custom adjustment unit is configured to adjust the custom parameter by using the time-lapse photography adjustment optimal parameter.

[0251] The second shooting position adjustment display unit is configured to display, in the virtual time-lapse photography interactive interface, a scene image corresponding to the adjusted custom parameter in the to-be-shot virtual scene, and display the adjusted custom parameter in the parameter adjustment region.

[0252] In some embodiments, the scene display sub-module can include:

[0253] The shooting angle adjusting unit is configured to adjust the shooting angle in the shooting framing custom parameter according to a shooting angle adjusting instruction triggered by the virtual time-lapse photography interactive interface. The parameter adjusting region includes a shooting angle adjusting region, and the shooting angle adjusting region includes a yaw angle sliding adjustment bar and a pitch angle sliding adjustment bar.

[0254] The shooting angle adjusting display unit is configured to display a scene image corresponding to the adjusted shooting angle in the virtual time-lapse photography interactive interface, and display the adjusted shooting angle in the shooting angle adjusting region.

[0255] In some embodiments, the scene display sub-module can include:

[0256] The camera motion adjusting unit is configured to determine the camera motion custom parameter from the selectable shooting track according to a motion track selection instruction triggered by the virtual time-lapse photography interactive interface. The parameter adjusting region includes a shooting track selection region for selecting the selectable shooting track.

[0257] The camera motion adjusting display unit is configured to display a track schematic frame corresponding to the camera motion custom parameter in the virtual time-lapse photography interactive interface.

[0258] In some embodiments, the scene display sub-module can include:

[0259] The time range adjusting unit is configured to adjust the start time or the end time of the shooting time range in the shooting time custom parameter according to a time range adjusting instruction triggered by the virtual time-lapse photography interactive interface. The parameter adjusting region includes a time range adjusting region, and the time range adjusting region includes a start time sliding adjustment bar and an end time sliding adjustment bar.

[0260] The time range adjusting display unit is configured to display a scene image corresponding to the adjusted start time or the end time of the shooting time range in the virtual time-lapse photography interactive interface, and display the adjusted shooting time range in the time range adjusting region.

[0261] In some embodiments, the scene display sub-module can include:

[0262] The dynamic element adjusting unit is configured to adjust the adjustable dynamic element in the virtual scene to be photographed according to a dynamic element adjusting instruction triggered by the virtual time-lapse photography interactive interface. The virtual time-lapse photography interactive interface includes a dynamic element adjusting region for adjusting the adjustable dynamic element. The adjustable dynamic element includes a cloud element and / or a fog element in the weather element. The dynamic element adjusting region includes a quantity adjustment bar and / or a motion speed adjustment bar corresponding to each adjustable dynamic element.

[0263] The dynamic element adjustment display unit is configured to display an image of the virtual scene corresponding to the self-defined parameter in the virtual time-lapse photography interactive interface.

[0264] In this embodiment, the virtual time-lapse video corresponding to the time-lapse photography parameter in the dynamic virtual scene is generated by setting the time-lapse photography parameter and parameterizing the virtual time-lapse photography process according to the characteristics of real time-lapse photography, thereby realizing automatic generation of high-quality time-lapse video in the virtual scene, simulating and testing the time-lapse photography in the real environment, guiding the time-lapse photography in the real world, saving time and economic cost, and improving the user experience.

[0265] Corresponding to the above method embodiment, the present embodiment also provides an interactive shooting device of virtual time-lapse video, which can be correspondingly referred to the interactive shooting method of virtual time-lapse video described above.

[0266] Please refer to Figure 16 , Figure 16 A simple structure diagram of an interactive shooting device of virtual time-lapse video provided by the present embodiment is shown in the figure. The interactive shooting device of virtual time-lapse video can include:

[0267] The memory D1 is configured to store a computer program.

[0268] The processor D2 is configured to execute the computer program to realize the steps of the interactive shooting method of virtual time-lapse video provided by the above method embodiment.

[0269] Correspondingly, please refer to Figure 17 , Figure 17A specific structural schematic diagram of an interactive shooting device of a virtual time-lapse video provided by an embodiment of the present application is shown in FIG. 4. The interactive shooting device 410 can have great differences due to different configurations or performances, and can include one or more processors (Central Processing Units, CPUs) 422 (for example, one or more processors) and a memory 432, one or more storage media 430 (for example, one or more mass storage devices) storing application programs 442 or data 444. The memory 432 and the storage media 430 can be temporary storage or persistent storage. The programs stored in the storage media 430 can include one or more units (not shown in the figure), and each unit can include a series of instruction operations in the host. Further, the central processor 422 can be configured to communicate with the storage media 430 and execute the series of instruction operations in the storage media 430 on the interactive shooting device 410.

[0270] The interactive shooting device 410 can further include one or more power supplies 426, one or more wired or wireless network interfaces 450, one or more input / output interfaces 458, and / or one or more operating systems 441.

[0271] The interactive shooting device of a virtual time-lapse video provided by the embodiment of the present application can be specifically a server or a computer.

[0272] The steps in the interactive shooting method of a virtual time-lapse video described above can be implemented by the structure of the interactive shooting device of a virtual time-lapse video.

[0273] Corresponding to the above method embodiment, the embodiment of the present application further provides a computer readable storage medium. The computer readable storage medium described below can be correspondingly referred to the interactive shooting method of a virtual time-lapse video described above.

[0274] Please refer to Figure 18 , Figure 18 A specific structural schematic diagram of a computer readable storage medium provided by an embodiment of the present application is shown in FIG. 4. The computer readable storage medium 40 stores a computer program 41. When the computer program 41 is executed by a processor, the steps of the interactive shooting method of a virtual time-lapse video provided by the method embodiment described above are implemented.

[0275] The computer readable storage medium 40 can be specifically a U disk, a mobile hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and various storage media that can store program codes.

[0276] The various embodiments of the disclosure are described in a progressive manner in the specification, and each embodiment focuses on the difference from other embodiments. The same or similar parts between the various embodiments can be mutually referred to. For the apparatus, device and computer readable storage medium disclosed by the embodiments, since they correspond to the method disclosed by the embodiments, the description is relatively simple, and the relevant part can be referred to the method part.

[0277] The virtual delay video interactive shooting method, device, equipment and computer readable storage medium provided by the present application are described in detail above. The principles and implementation manners of the present application are described by applying specific examples. The above embodiment description is only used to help understand the method of the present application and its core idea. It should be pointed out that, for those skilled in the art, without departing from the principles of the present application, the present application can be improved and modified in several ways. These improvements and modifications also fall within the protection scope of the claims of the present application.

Claims

1. An interactive shooting method for virtual time-lapse video, characterized in that, include: Acquire a virtual scene to be photographed; wherein, the virtual scene to be photographed is a three-dimensional scene whose content changes over time; Based on the shooting command triggered by the virtual time-lapse photography interactive interface, the time-lapse photography parameters of the virtual scene to be photographed are determined; wherein, the time-lapse photography parameters include shooting scene selection parameters, camera motion parameters, and shooting time parameters, the shooting scene selection parameters include shooting position and shooting angle, the shooting time parameters include shooting time range and shooting time interval, and the virtual time-lapse photography interactive interface includes parameter adjustment areas for adjusting the shooting scene selection parameters, the camera motion parameters, and / or the shooting time parameters; the camera motion parameters are shooting trajectories, including at least one or at least two of orbiting, panning, stationary, and zooming; Based on the time-lapse photography parameters, time-lapse photography is performed within the virtual scene to be photographed, generating a virtual image sequence corresponding to the time-lapse photography parameters within the virtual scene to be photographed; and a virtual time-lapse video is generated based on the virtual image sequence.

2. The interactive shooting method for virtual time-lapse video according to claim 1, characterized in that, The acquisition of the virtual scene to be photographed includes: Based on the scene selection command triggered by the virtual time-lapse photography interactive interface, the virtual scene to be photographed is determined from the preset dynamic virtual scenes; wherein, the virtual time-lapse photography interactive interface includes a scene selection area for selecting the preset dynamic virtual scene.

3. The interactive shooting method for virtual time-lapse video according to claim 1, characterized in that, The acquisition of the virtual scene to be photographed includes: Based on the scene creation command triggered by the virtual time-lapse photography interactive interface, obtain the three-dimensional model of the static virtual scene corresponding to the scene creation command; Using a 3D engine, the 3D model of the static virtual scene is processed to generate the virtual scene to be photographed.

4. The interactive shooting method for virtual time-lapse video according to claim 3, characterized in that, The process of using a 3D engine to process the 3D model of the static virtual scene to generate the virtual scene to be photographed includes: Using the 3D engine, the 3D model of the static virtual scene is rendered, and dynamic elements are added to generate the virtual scene to be photographed; wherein, the dynamic elements include human elements, traffic elements, weather elements and / or lighting elements.

5. The interactive shooting method for virtual time-lapse video according to claim 3, characterized in that, Based on the scene creation command triggered by the virtual time-lapse photography interactive interface, obtain the 3D model of the static virtual scene corresponding to the scene creation command, including: Obtain the real scene image corresponding to the scene creation command; A 3D model of the static virtual scene is generated based on the real scene image.

6. The interactive shooting method for virtual time-lapse video according to claim 1, characterized in that, The acquisition of the virtual scene to be photographed includes: According to the scene display command triggered by the virtual time-lapse photography interactive interface, switch to display the preset scene display sub-interface, so as to display the preview content of each preset dynamic virtual scene in the preset scene display sub-interface; Based on the scene selection instruction triggered by the preset scene display sub-interface, the virtual scene to be photographed is determined from the preset dynamic virtual scene.

7. The interactive shooting method for virtual time-lapse video according to claim 6, characterized in that, After switching to display a preset scene display sub-interface based on the scene display command triggered by the virtual time-lapse photography interactive interface, the method further includes: Based on the preset scene creation command triggered by the preset scene display sub-interface, obtain the three-dimensional model of the static virtual scene corresponding to the preset scene creation command; Using a 3D engine, the 3D model of the static virtual scene is processed to generate a preset dynamic virtual scene corresponding to the preset scene creation command.

8. The interactive shooting method for virtual time-lapse video according to claim 1, characterized in that, The step of generating a virtual time-lapse video based on the virtual image sequence includes: The exposure of each virtual image in the virtual image sequence is smoothed to obtain the processed virtual image sequence; The processed virtual image sequence is synthesized to generate a virtual time-lapse video.

9. The interactive shooting method for virtual time-lapse video according to claim 8, characterized in that, The step of smoothing the exposure of each virtual image in the virtual image sequence to obtain the processed virtual image sequence includes: Histogram equalization is performed on the exposure of each virtual image in the virtual image sequence to obtain the processed virtual image sequence.

10. The interactive shooting method for virtual time-lapse video according to claim 1, characterized in that, Generating the virtual image sequence corresponding to the time-lapse photography parameters within the virtual scene to be photographed includes: Using a virtual camera powered by a 3D engine, the virtual scene to be photographed is rendered according to the time-lapse photography parameters to generate the virtual image sequence.

11. The interactive shooting method for virtual time-lapse video according to any one of claims 1 to 10, characterized in that, The step of determining the time-lapse photography parameters of the virtual scene to be photographed based on the shooting command triggered by the virtual time-lapse photography interactive interface includes: The virtual time-lapse photography interactive interface displays scene images corresponding to the custom parameters of the parameter adjustment area within the virtual scene to be photographed; wherein, the custom parameters include custom parameters for scene selection, custom parameters for camera movement, and / or custom parameters for shooting time; After the shooting command is triggered in the virtual time-lapse photography interactive interface, the time-lapse photography parameters are determined according to the custom parameters.

12. The interactive shooting method for virtual time-lapse video according to claim 11, characterized in that, The step of displaying the scene image corresponding to the custom parameters of the parameter adjustment area within the virtual scene to be photographed on the virtual time-lapse photography interactive interface includes: The optimal parameters for time-lapse photography calculation corresponding to the virtual scene to be photographed are obtained, and the optimal parameters for time-lapse photography calculation are determined as the initial custom parameters; wherein, the optimal parameters for time-lapse photography calculation are photographic parameters calculated using an image aesthetic evaluation model, a video aesthetic evaluation model, and a time-lapse aesthetic evaluation model, the time-lapse aesthetic evaluation model includes a first time-lapse aesthetic evaluation model based on optical flow and a second time-lapse aesthetic evaluation model based on brightness and color, and the optimal parameters for time-lapse photography calculation include optimal parameters for scene selection, optimal parameters for camera movement, and optimal parameters for shooting time; The virtual time-lapse photography interactive interface displays the scene image corresponding to the initial custom parameters within the virtual scene to be photographed, and displays the initial custom parameters in the parameter adjustment area.

13. The interactive shooting method for virtual time-lapse video according to claim 12, characterized in that, Before obtaining the optimal parameters for time-lapse photography calculation corresponding to the virtual scene to be photographed, and determining the optimal parameters for time-lapse photography calculation as the initial custom parameters, the method further includes: Based on the operation mode display command triggered by the virtual time-lapse photography interactive interface, switch the display of the operation mode selection sub-interface to display various preset operation modes; wherein, the preset operation modes include automatic operation mode, semi-automatic operation mode and custom operation mode. Based on the operation mode selection sub-interface triggered by the operation mode selection instruction, the target operation mode is determined from the preset operation modes; If the target operation mode is the automatic operation mode, then the optimal parameters for time-lapse photography calculation are obtained, and the optimal parameters for time-lapse photography calculation are determined as the time-lapse photography parameters. Then, the step of performing time-lapse photography in the virtual scene to be photographed according to the time-lapse photography parameters to generate a virtual time-lapse video is executed. If the target operation mode is the semi-automatic operation mode, then the step of obtaining the optimal time-lapse photography calculation parameters corresponding to the virtual scene to be photographed and determining the optimal time-lapse photography calculation parameters as the initial custom parameters is executed. If the target operation mode is the custom operation mode, then the preset initial parameters corresponding to the virtual scene to be shot are obtained, and the preset initial parameters are determined as the initial custom parameters. Then, the steps of displaying the scene image corresponding to the initial custom parameters in the virtual scene to be shot in the virtual time-lapse photography interactive interface and displaying the initial custom parameters in the parameter adjustment area are executed. The preset initial parameters include preset initial shooting scene selection parameters, preset initial camera motion parameters, and preset initial shooting time parameters.

14. The interactive shooting method for virtual time-lapse video according to claim 12, characterized in that, The step of obtaining the optimal parameters for time-lapse photography calculation corresponding to the virtual scene to be photographed includes: The optimal parameters for scene selection during shooting are obtained using the image aesthetic evaluation model. Based on the optimal shooting scene selection parameters and the video aesthetic evaluation model, the optimal camera motion parameters are obtained; The optimal shooting time parameter is obtained based on the optimal shooting location parameter, the optimal camera motion parameter, and the time-lapse aesthetic evaluation model.

15. The interactive shooting method for virtual time-lapse video according to claim 11, characterized in that, The step of displaying the scene image corresponding to the custom parameters of the parameter adjustment area within the virtual scene to be photographed on the virtual time-lapse photography interactive interface includes: The shooting position in the custom shooting selection parameters is adjusted according to the movement command triggered by the keyboard device; wherein, the movement command includes a forward movement command, a backward movement command, a left movement command, and / or a right movement command; The virtual time-lapse photography interactive interface updates and displays the scene image corresponding to the adjusted shooting position within the virtual scene to be photographed, and displays the adjusted shooting position in the shooting position coordinate display area within the parameter adjustment area.

16. The interactive shooting method for virtual time-lapse video according to claim 11, characterized in that, The step of displaying the scene image corresponding to the custom parameters of the parameter adjustment area within the virtual scene to be photographed on the virtual time-lapse photography interactive interface includes: The shooting position in the custom shooting selection parameters is adjusted according to the movement command triggered by the keyboard device; wherein, the movement command includes a forward movement command, a backward movement command, a left movement command, and / or a right movement command; Based on the adjusted shooting position, the optimal parameters for time-lapse photography adjustment corresponding to the adjusted shooting position are calculated using image aesthetics evaluation models, video aesthetics evaluation models, and time-lapse aesthetics evaluation models. The time-lapse aesthetics evaluation models include a first time-lapse aesthetics evaluation model based on optical flow and a second time-lapse aesthetics evaluation model based on brightness and color. The optimal parameters for time-lapse photography adjustment include optimal parameters for shooting scene selection, optimal parameters for camera motion adjustment, and optimal parameters for shooting time adjustment. The shooting position in the optimal parameters for shooting scene selection adjustment is the adjusted shooting position. The optimal parameters are adjusted using the time-lapse photography, and the custom parameters are also adjusted. The virtual time-lapse photography interactive interface displays the scene image corresponding to the adjusted custom parameters within the virtual scene to be photographed, and displays the adjusted custom parameters in the parameter adjustment area.

17. The interactive shooting method for virtual time-lapse video according to claim 11, characterized in that, The step of displaying the scene image corresponding to the custom parameters of the parameter adjustment area within the virtual scene to be photographed on the virtual time-lapse photography interactive interface includes: Based on the shooting angle adjustment command triggered by the virtual time-lapse photography interactive interface, the shooting angle in the shooting selection custom parameters is adjusted; wherein, the parameter adjustment area includes a shooting angle adjustment area, and the shooting angle adjustment area includes a yaw angle slider and a pitch angle slider; The virtual time-lapse photography interactive interface updates and displays the scene image corresponding to the adjusted shooting angle within the virtual scene to be photographed, and displays the adjusted shooting angle in the shooting angle adjustment area.

18. The interactive shooting method for virtual time-lapse video according to claim 11, characterized in that, The step of displaying the scene image corresponding to the custom parameters of the parameter adjustment area within the virtual scene to be photographed on the virtual time-lapse photography interactive interface includes: Based on the motion trajectory selection command triggered by the virtual time-lapse photography interactive interface, the camera motion custom parameters are determined from the selectable shooting trajectories; wherein, the parameter adjustment area includes a shooting trajectory selection area for selecting the selectable shooting trajectory; The virtual time-lapse photography interactive interface displays a trajectory diagram box corresponding to the camera motion custom parameters.

19. The interactive shooting method for virtual time-lapse video according to claim 11, characterized in that, The step of displaying the scene image corresponding to the custom parameters of the parameter adjustment area within the virtual scene to be photographed on the virtual time-lapse photography interactive interface includes: Based on the time range adjustment command triggered by the virtual time-lapse photography interactive interface, the start time or end time of the shooting time range in the shooting time custom parameters is adjusted; wherein, the parameter adjustment area includes a time range adjustment area, and the time range adjustment area includes a start time slider and an end time slider; The virtual time-lapse photography interactive interface updates and displays scene images corresponding to the start or end time of the adjusted shooting time range within the virtual scene to be photographed, and displays the adjusted shooting time range in the time range adjustment area.

20. The interactive shooting method for virtual time-lapse video according to claim 11, characterized in that, The step of displaying the scene image corresponding to the custom parameters of the parameter adjustment area within the virtual scene to be photographed on the virtual time-lapse photography interactive interface includes: According to the dynamic element adjustment command triggered by the virtual time-lapse photography interactive interface, the adjustable dynamic elements of the virtual scene to be photographed are adjusted; wherein, the virtual time-lapse photography interactive interface includes a dynamic element adjustment area for adjusting the adjustable dynamic elements, the adjustable dynamic elements include cloud elements and / or fog elements in weather elements, and the dynamic element adjustment area includes quantity adjustment bars and / or movement speed adjustment bars corresponding to each of the adjustable dynamic elements. The virtual time-lapse photography interface updates and displays the scene image corresponding to the custom parameters within the adjusted virtual scene to be photographed.

21. An interactive shooting device for virtual time-lapse video, characterized in that, include: The scene acquisition module is used to acquire the virtual scene to be photographed; wherein, the virtual scene to be photographed is a three-dimensional scene whose scene content changes over time; The parameter determination module is used to determine the time-lapse photography parameters of the virtual scene to be photographed based on the shooting instructions triggered by the virtual time-lapse photography interactive interface; wherein, the time-lapse photography parameters include shooting scene selection parameters, camera motion parameters, and shooting time parameters, the shooting scene selection parameters include shooting position and shooting angle, the shooting time parameters include shooting time range and shooting time interval, and the virtual time-lapse photography interactive interface includes parameter adjustment areas for adjusting the shooting scene selection parameters, the camera motion parameters, and / or the shooting time parameters; the camera motion parameters are shooting trajectories, including at least one or at least two of orbiting, panning, stationary, and zooming; The time-lapse photography module is used to perform time-lapse photography within the virtual scene to be photographed according to the time-lapse photography parameters, and generate a virtual time-lapse video. The time-lapse shooting module includes: The sequence generation submodule is used to generate a virtual image sequence corresponding to the time-lapse photography parameters within the virtual scene to be photographed; The video generation submodule is used to generate a virtual time-lapse video based on the virtual image sequence.

22. An interactive shooting device for virtual time-lapse video, characterized in that, include: Memory, used to store computer programs; A processor, configured to execute the computer program to implement the steps of the interactive shooting method for virtual time-lapse video as described in any one of claims 1 to 20.

23. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the interactive shooting method for virtual time-lapse video as described in any one of claims 1 to 20.

Images