Video editing method, device, electronic device and readable storage medium
By acquiring and reconstructing three-dimensional video scenes and providing user editing operations, the problem of difficulty in adding virtual three-dimensional elements in two-dimensional video editing in the prior art is solved, and higher universality and operability are achieved.
Patent Information
- Application Number
- CN202111629147.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-28
- Publication Date
- 2025-04-04
- Estimated Expiration
- 2041-12-28
AI Technical Summary
The existing video editing methods are mainly aimed at two-dimensional video scenes, and it is difficult to easily add virtual three-dimensional elements to the video data, resulting in poor universality and inconvenient operation.
By obtaining the original video data and the original three-dimensional scene information representing the real scene, the three-dimensional video scene is reconstructed, and the user can easily edit and generate target video data.
It realizes convenient and direct video editing in three-dimensional scenarios, solves the problem of inconvenience in adding virtual three-dimensional elements in the prior art, and improves the universality and operability of video editing.
Smart Images

Figure CN114401451B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present disclosure relate to the field of video technology, and more specifically, to a video editing method, device, electronic device, and computer-readable storage medium. The present disclosure also relates to a video acquisition method. Background Art
[0002] In recent years, with the rise of short videos (Instant Music Video), in order to meet people's needs for making short videos, various video acquisition tools and video editing tools have emerged. Based on these tools, users can create rich and diverse short video content.
[0003] Existing video editing methods usually edit two-dimensional video scenes. Such methods usually first collect two-dimensional video data based on a camera, then load the two-dimensional video data based on a video editing tool, and implement video editing by adding virtual elements to the two-dimensional video data.
[0004] It can be seen from this that the video editing methods in the prior art are only for two-dimensional video scenes, which means that when users need to add virtual three-dimensional elements to video data, such methods are usually not applicable, or even if such elements can be added, they are not convenient enough and have great limitations. Summary of the invention
[0005] One purpose of the present disclosure is to provide an image processing method to solve the problems of poor universality and inconvenience that may exist in existing video editing processing.
[0006] In a first aspect of the present disclosure, a video editing method is provided, the method comprising:
[0007] Acquire original video data and original three-dimensional scene information, wherein the original three-dimensional scene information is information representing a real scene in the process of acquiring the original video data;
[0008] Reconstructing a three-dimensional video scene according to the original video data and the original three-dimensional scene information;
[0009] An editing operation of a user on the three-dimensional video scene is received, and target video data is generated in response to the editing operation.
[0010] A second aspect of the present disclosure further provides a video acquisition method, the method comprising:
[0011] Receive user input operations;
[0012] In response to the input operation, original video data and original three-dimensional scene information are collected based on a preset augmented reality technology, wherein the original three-dimensional scene information is information representing a real scene during the process of collecting the original video data.
[0013] According to a third aspect of the present disclosure, a video editing device is provided, the device comprising:
[0014] An original data acquisition module, used to acquire original video data and original three-dimensional scene information, wherein the original three-dimensional scene information is information representing a real scene in the process of acquiring the original video data;
[0015] A 3D video scene reconstruction module, used to reconstruct a 3D video scene based on the original video data and the original 3D scene information;
[0016] The target video data generating module is used to receive a user's editing operation on the three-dimensional video scene, and generate target video data in response to the editing operation.
[0017] In a fourth aspect of the present disclosure, a video acquisition device is further provided, the device comprising:
[0018] A receiving module, used for receiving input operations from users;
[0019] The acquisition module is used to respond to the input operation and acquire original video data and original three-dimensional scene information based on a preset augmented reality technology, wherein the original three-dimensional scene information is used to represent the real scene in the process of acquiring the original video data.
[0020] According to a fifth aspect of the present disclosure, there is also provided an electronic device, including:
[0021] A memory for storing executable instructions;
[0022] The processor is used to operate the electronic device to execute the method described in the first aspect or the second aspect of the present disclosure under the control of the instruction.
[0023] According to the sixth aspect of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program that can be read and executed by a computer, and the computer program is used to execute the method according to the first aspect or the second aspect of the present disclosure when read and executed by the computer.
[0024] One beneficial effect of the embodiments of the present disclosure is that, according to the embodiments of the present disclosure, a video editing device obtains original video data and original three-dimensional scene information representing a real scene in the process of acquiring the original video data; and reconstructs a three-dimensional video scene based on the original video data and the original three-dimensional scene information; thereafter, the device can provide a user with a three-dimensional video scene on which editing operations can be conveniently and directly performed on the video data in a three-dimensional scene, and based on the three-dimensional video scene, the device can generate target video data by receiving the user's editing operation and responding to the editing operation.
[0025] Other features and advantages of the present specification will become apparent from the following detailed description of exemplary embodiments of the present specification with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the specification and, together with the description, serve to explain the principles of the specification.
[0027] Figure 1 It is a flowchart of a video editing method provided by an embodiment of the present disclosure.
[0028] Figure 2 It is a schematic diagram of triggering data collection provided by an embodiment of the present disclosure.
[0029] Figure 3 It is a flowchart of the three-dimensional scene reconstruction process provided by an embodiment of the present disclosure.
[0030] Figure 4 It is a flowchart of a video acquisition method provided by an embodiment of the present disclosure.
[0031] Figure 5 It is a principle block diagram of a video editing device provided by an embodiment of the present disclosure.
[0032] Figure 6 It is a principle block diagram of a video acquisition device provided by an embodiment of the present disclosure.
[0033] Figure 7 It is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION
[0034] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangement of components and steps, numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless otherwise specifically stated.
[0035] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.
[0036] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered as part of the specification.
[0037] In all examples shown and discussed herein, any specific values should be interpreted as merely exemplary and not as limiting. Therefore, other examples of the exemplary embodiments may have different values.
[0038] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.
[0039] <Method Example 1>
[0040] In recent years, with the continuous development of augmented reality technology, the traditional video editing methods based on two-dimensional video scenes have become increasingly inadequate in terms of universality and convenience. To solve this problem, related technologies also provide a video editing method that records video data containing virtual three-dimensional elements by adding virtual three-dimensional elements in real time based on augmented reality technology during the process of collecting video data. However, this method requires real-time video editing and processing, which has relatively large limitations.
[0041] To solve the above problems, the embodiments of the present disclosure provide a video editing method with strong universality and convenient for performing video editing in offline scenarios. Figure 1 , which is a flow chart of a video editing method provided in an embodiment of the present disclosure, the method can be implemented in a video editing device, and the video editing device can be a terminal device, for example, a mobile phone, a tablet computer, a personal computer, etc., which is not specifically limited here. For the convenience of explanation, in the embodiments of the present disclosure, unless otherwise specified, the video editing device implementing the method is an example of a mobile phone.
[0042] like Figure 1 As shown, the method of this embodiment may include the following steps S1100-S1300, which are described in detail below.
[0043] Step S1100, obtaining original video data and original three-dimensional scene information, wherein the original three-dimensional scene information is information representing a real scene in the process of collecting the original video data.
[0044] The original video data is video data collected by an image acquisition device, such as a camera.
[0045] The original three-dimensional scene information may be the camera posture data of each frame corresponding to each video frame of the original video data and the three-dimensional scene data representing the real scene, wherein the three-dimensional scene data may be at least one of the information such as scene model data, object occlusion information, scene recognition plane information, and scene anchor point information; the scene model data may specifically be scene mesh data; the object occlusion information may be information representing the occlusion relationship between objects in the real scene; the scene recognition plane information may be information representing the position and size of the plane in the real scene; the scene anchor point information may be information representing the key points of the real scene, and the anchor point information may generally be the geometric center of the real scene.
[0046] Specifically, in view of the problems that existing video editing methods all have poor universality when performing video editing on two-dimensional video scenes and cannot conveniently add virtual three-dimensional elements, in an embodiment of the present invention, a method is provided that can reconstruct a three-dimensional video scene based on original video data captured by a video acquisition device and three-dimensional scene information representing a real scene collected in the process of capturing the original video data, so that users can conveniently perform full-scene video editing processing based on the three-dimensional video scene.
[0047] In a specific implementation, the original video data and the three-dimensional scene information can be acquired by a video acquisition device corresponding to the video editing device. The video acquisition device and the video editing device can be located in the same terminal device, or can be located in different terminal devices respectively, without any special limitation here; wherein, when the two types of devices are located in different terminal devices, the original video data and the original three-dimensional scene information acquired by the video acquisition device can be provided to the video editing device in the form of video files, coded data packets, communication data frames, etc. The following first describes how the video acquisition device acquires the original video data and the three-dimensional scene information.
[0048] In one embodiment, the video acquisition device can acquire the original video data and the three-dimensional scene information based on the following steps: receiving a user's input operation; and in response to the input operation, acquiring the original video data and the original three-dimensional scene information based on a preset augmented reality technology.
[0049] Please see Figure 2 , which is a schematic diagram of triggering data collection provided by an embodiment of the present disclosure. Figure 2 As shown, the video acquisition device can be a terminal device, such as a camera device in a mobile phone. Specifically, after the user opens the camera device and enters the camera initial interface, he can click Figure 2The "AR" option shown in 201 is clicked, and then the recording component shown in 202 is clicked to trigger the camera device to collect the original video data and the original three-dimensional scene information based on the preset augmented reality technology.
[0050] It should be noted that, in the embodiments of the present disclosure, the preset augmented reality technology can be determined according to the technology type corresponding to the video acquisition device. For example, when the technology type is the first preset type, the original video data and the original three-dimensional scene information can be collected based on the ARkit (Augmented Reality ToolKit) technology; and when the technology type is the second preset type, the original video data and the original three-dimensional scene information can be collected based on the ARCore (Augmented Reality Core) technology; or, when the technology type is the third preset type, other technologies other than the ARkit technology and the ARCore technology can be used, such as the Simultaneous Localization And Mapping (SLAM) technology to collect the original video data and the original three-dimensional scene information.
[0051] After the video acquisition device acquires the original video data and the 3D scene information, the two types of information can be provided to the video editing device so that the video editing device can reconstruct the 3D video scene based on the two types of information for the user to perform video editing processing.
[0052] In a specific implementation, the video acquisition device can provide the original video data and the original three-dimensional scene information to the video editing device based on any one of the following items: first, encapsulating the original video data and the original three-dimensional scene information based on a first preset video file encapsulation format to obtain a first original video file, and sending the first original video file to the video editing device; second, encoding the original video data and the original three-dimensional scene information based on a preset video encoding protocol to obtain a target encoding package, and sending the target encoding package to the video editing device; third, encapsulating the original video data based on a second preset video file encapsulation format to obtain a second original video file, and storing the three-dimensional scene information in an original three-dimensional information file, and sending the second original video file and the original three-dimensional information file to the video editing device; fourth, encoding the original video data and the original three-dimensional scene information based on a preset communication protocol to obtain a target data frame, and sending the target data frame to the video editing device.
[0053] Specifically, after acquiring the original video data and the original three-dimensional scene information, the video acquisition device may encapsulate the original video data based on a video file, such as an MP4 file encapsulation format.
[0054] For example, the audio and video data in the original video data can be encoded according to any one of the video coding standards such as H264, H265 and VVC, and then the encoded code stream can be encapsulated according to the standard box protocol in the MP4 encapsulation format; and the original three-dimensional scene information can be encapsulated into an independent box using a custom protocol. For example, each frame of camera posture data in the three-dimensional scene information can be encapsulated separately in a box, and the three-dimensional scene data in the three-dimensional scene information can be encapsulated separately in one or more boxes; then, by encapsulating the above-obtained boxes into an MP4 file, and providing the MP4 file to a video editing device; the video editing device can obtain the original video data and the original three-dimensional scene information by parsing the MP4 file.
[0055] Of course, in specific implementation, the original video data and the original three-dimensional information file can also be provided to the video acquisition device by directly delivering the target coding package. For example, the original video data can be encoded based on the H264 coding standard to obtain the corresponding code stream data, and at the same time, the target coding package is obtained by encapsulating the above code stream data by filling each frame of camera posture data in the supplementary enhancement information field, i.e., the SEI field, and by carrying the three-dimensional scene data in the metadata, i.e., metadata, and providing the target coding package to the video acquisition device.
[0056] In addition, the original video data and the original three-dimensional scene information can also be provided to the video editing device by storing the original three-dimensional scene information in an external file as described in A3 above, wherein the second preset video file encapsulation format can be a video file encapsulation format based on a standard protocol, for example, it can be a standard MP4 file encapsulation format.
[0057] The above describes in detail how the video acquisition device acquires original video data and original three-dimensional scene information, and how to provide the two types of information to the video editing device; after the video editing device obtains the two types of information, it can perform three-dimensional video scene reconstruction based on the two types of information to provide the video editing scene to the user.
[0058] That is, after step S1100, step S1200 is executed to reconstruct the 3D video scene according to the original video data and the original 3D scene information.
[0059] Please see Figure 3 , which is a schematic diagram of the process of three-dimensional scene reconstruction provided by the embodiment of the present disclosure. Figure 3 As shown, the reconstructing of the three-dimensional video scene based on the original video data and the original three-dimensional scene information includes: step S1210, obtaining the camera posture data and three-dimensional scene data of each frame corresponding to the original video data according to the original three-dimensional scene information; step S1220, performing three-dimensional scene reconstruction processing according to the original video data, the camera posture data of each frame and the three-dimensional scene data to obtain the three-dimensional video scene.
[0060] Step S1300: receiving an editing operation of a user on the 3D video scene, and generating target video data in response to the editing operation.
[0061] After the 3D video scene is reconstructed in step S1200 , the user can perform 3D video editing based on the 3D video scene.
[0062] In one embodiment, the editing operation includes an operation of adding a virtual three-dimensional element; generating target video data in response to the editing operation includes: re-rendering the video data based on the added virtual three-dimensional element to generate target video data containing the virtual three-dimensional element.
[0063] In this embodiment, the virtual three-dimensional element may be an advertisement panel, a three-dimensional virtual object, a three-dimensional animation, a special effect or other virtual element.
[0064] In summary, according to the method provided by the embodiments of the present disclosure, a video editing device obtains original video data and original three-dimensional scene information representing a real scene in the process of acquiring the original video data; and reconstructs a three-dimensional video scene based on the original video data and the original three-dimensional scene information; thereafter, the device can provide a user with a three-dimensional video scene on which editing operations can be conveniently and directly performed on the video data in a three-dimensional scene. Based on the three-dimensional video scene, the device can generate target video data by receiving the user's editing operation and responding to the editing operation.
[0065] <Method Example 2>
[0066] Corresponding to the above method embodiment 1, the embodiment of the present disclosure also provides a video acquisition method, please refer to Figure 4 , which is a flow chart of the video acquisition method provided in an embodiment of the present disclosure. The method can be implemented by a video acquisition device, which can specifically be a terminal device, for example, a mobile phone, a tablet computer, a personal computer, etc., and is not specifically limited here.
[0067] like Figure 4 As shown, the method of this embodiment may include the following steps S4100-S4200, which are described in detail below.
[0068] Step S4100, receiving user input operation.
[0069] Step S4200, in response to the input operation, original video data and original three-dimensional scene information are collected based on a preset augmented reality technology, wherein the original three-dimensional scene information is information representing a real scene during the process of collecting the original video data.
[0070] In one embodiment, after obtaining the original video data and the original three-dimensional scene information, the method provides the original video data and the original three-dimensional scene information to the video editing device through any one of the following items: first, encapsulating the original video data and the original three-dimensional scene information based on a first preset video file encapsulation format to obtain a first original video file, and sending the first original video file to the video editing device; second, encoding the original video data and the original three-dimensional scene information based on a preset video encoding protocol to obtain a target encoding package, and sending the target encoding package to the video editing device; third, encapsulating the original video data based on a second preset video file encapsulation format to obtain a second original video file, and storing the three-dimensional scene information in an original three-dimensional information file, and sending the second original video file and the original three-dimensional information file to the video editing device; fourth, encoding the original video data and the original three-dimensional scene information based on a preset communication protocol to obtain a target data frame, and sending the target data frame to the video editing device.
[0071] <Device Example 1>
[0072] Corresponding to the above method embodiment 1, in this embodiment, a video editing device is also provided, such as Figure 5 As described above, the device 500 may include an original data acquisition module 510 , a 3D video scene reconstruction module 520 and a target video data generation module 530 .
[0073] The original data acquisition module 510 is used to acquire original video data and original three-dimensional scene information, wherein the original three-dimensional scene information is information representing a real scene in the process of collecting the original video data; the three-dimensional video scene reconstruction module 520 is used to reconstruct a three-dimensional video scene based on the original video data and the original three-dimensional scene information; the target video data generation module 530 is used to receive a user's editing operation on the three-dimensional video scene, and generate target video data in response to the editing operation.
[0074] <Device Example 2>
[0075] Corresponding to the above method embodiment 2, in this embodiment, a video acquisition device is also provided, such as Figure 6 As described above, the device 600 may include a receiving module 610 and a collecting module 620 .
[0076] The receiving module 610 is used to receive user input operations; the acquisition module 620 is used to respond to the input operations and acquire original video data and original three-dimensional scene information based on a preset augmented reality technology, wherein the original three-dimensional scene information is information representing a real scene during the process of acquiring the original video data.
[0077] <Equipment Embodiment>
[0078] In this embodiment, an electronic device is also provided. Figure 7 As described above, the electronic device 700 may include a processor 720 and a memory 710, wherein the memory 710 is used to store executable instructions; the processor 720 is used to operate the electronic device according to the control of the instructions to execute the method according to any embodiment of the present disclosure.
[0079] <Computer Readable Storage Medium Embodiment>
[0080] This embodiment provides a computer-readable storage medium, in which executable commands are stored. When the executable commands are executed by a processor, the method described in any method embodiment of this specification is executed.
[0081] The flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to the multiple embodiments of this specification. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of an instruction, and a part of a module, a program segment or an instruction contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or the flowchart, and the combination of the boxes in the block diagram and / or the flowchart can be implemented by a dedicated hardware-based system that performs the specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that it is equivalent to implement it by hardware, implement it by software, and implement it by combining software and hardware.
[0082] The embodiments of the present specification have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The choice of terms used herein is intended to best explain the principles of the embodiments, practical applications, or technical improvements in the marketplace, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein. The scope of this application is defined by the appended claims.
Claims
1. A video editing method, characterized in that: include: Acquire original video data and original 3D scene information, wherein the original 3D scene information is information representing a real scene in the process of acquiring the original video data, and the original video data and the original 3D scene information are acquired by a video acquisition device based on a preset augmented reality technology; According to the original three-dimensional scene information, obtaining camera posture data of each frame and three-dimensional scene data corresponding to the original video data, wherein the three-dimensional scene data includes at least one of scene model data, object occlusion information, scene recognition plane information and scene anchor point information; Performing a three-dimensional scene reconstruction process according to the original video data, the camera posture data of each frame and the three-dimensional scene data to obtain a three-dimensional video scene; An editing operation of a user on the three-dimensional video scene is received, and target video data is generated in response to the editing operation.
2. The method according to claim 1, characterized in that The editing operation includes an operation of adding a virtual three-dimensional element; The step of generating target video data in response to the editing operation comprises: The video data rendering process is re-performed based on the added virtual three-dimensional element to generate target video data containing the virtual three-dimensional element.
3. The method according to claim 1, characterized in that The obtaining of the original video data and the original three-dimensional scene information includes at least one of the following: Receiving a first original video file obtained by encapsulating the original video data and the original three-dimensional scene information by a video acquisition device based on a first preset video file encapsulation format, and obtaining the original video data and the original three-dimensional scene information by parsing the first original video file; Receiving a target coding packet obtained by encoding the original video data and the original three-dimensional scene information by the video acquisition device based on a preset video coding protocol, and obtaining the original video data and the original three-dimensional scene information by parsing the target coding packet; receiving a second original video file and an original 3D information file provided by the video acquisition device, and obtaining the original video data and the original 3D scene information by parsing the second original video file and the original 3D information file, wherein the second original video file is obtained by encapsulating the original video data by the acquisition terminal based on a second preset video file encapsulation format, and the original 3D information file is used to store the 3D scene information; A target data frame is obtained by encoding the original video data and the original three-dimensional scene information based on a preset communication protocol, provided by the video acquisition device, and the original video data and the original three-dimensional scene information are obtained by parsing the target data frame.
4. A video acquisition method, characterized in that: The method is applied to a video acquisition device, and the method comprises: Receive user input operations; In response to the input operation, original video data and original three-dimensional scene information are collected based on a preset augmented reality technology, wherein the original three-dimensional scene information is information representing a real scene in the process of collecting the original video data, and the original three-dimensional scene information includes camera pose data for each frame corresponding to each video frame of the original video data and three-dimensional scene data representing a real scene, and the three-dimensional scene data includes at least one of scene model data, object occlusion information, scene recognition plane information and scene anchor point information; the original video data, the camera pose data for each frame and the three-dimensional scene data are used to perform three-dimensional scene reconstruction processing to obtain a three-dimensional video scene, and the three-dimensional video scene is used to receive a user's editing operation on the three-dimensional video scene, and generate target video data in response to the editing operation.
5. The method according to claim 4, characterized in that After obtaining the original video data and the original 3D scene information, the method provides the original video data and the original 3D scene information to a video editing device by any one of the following: Encapsulating the original video data and the original three-dimensional scene information based on a first preset video file encapsulation format to obtain a first original video file, and sending the first original video file to the video editing device; Encoding the original video data and the original three-dimensional scene information based on a preset video encoding protocol to obtain a target encoding packet, and sending the target encoding packet to the video editing device; encapsulating the original video data based on a second preset video file encapsulation format to obtain a second original video file, storing the 3D scene information in the original 3D information file, and sending the second original video file and the original 3D information file to the video editing device; The original video data and the original three-dimensional scene information are encoded based on a preset communication protocol to obtain a target data frame, and the target data frame is sent to the video editing device.
6. A video editing device, characterized in that: include: An original data acquisition module is used to acquire original video data and original three-dimensional scene information, wherein the original three-dimensional scene information is information representing a real scene in the process of acquiring the original video data, and the original video data and the original three-dimensional scene information are acquired by a video acquisition device based on a preset augmented reality technology; A 3D video scene reconstruction module, configured to obtain, based on the original 3D scene information, camera pose data for each frame and 3D scene data corresponding to the original video data, wherein the 3D scene data includes at least one of scene model data, object occlusion information, scene recognition plane information, and scene anchor point information; and to perform 3D scene reconstruction processing based on the original video data, the camera pose data for each frame, and the 3D scene data to obtain a 3D video scene; The target video data generating module is used to receive a user's editing operation on the three-dimensional video scene, and generate target video data in response to the editing operation.
7. A video acquisition device, characterized in that: include: A receiving module, used for receiving input operations from users; The acquisition module is used to collect original video data and original three-dimensional scene information based on a preset augmented reality technology in response to the input operation, wherein the original three-dimensional scene information is used to represent the real scene in the process of collecting the original video data, and the original three-dimensional scene information includes camera posture data of each frame corresponding to each video frame of the original video data and three-dimensional scene data representing the real scene, and the three-dimensional scene data includes at least one of scene model data, object occlusion information, scene recognition plane information and scene anchor point information; the original video data, the camera posture data of each frame and the three-dimensional scene data are used to perform three-dimensional scene reconstruction processing to obtain a three-dimensional video scene, and the three-dimensional video scene is used to receive a user's editing operation on the three-dimensional video scene, and generate target video data in response to the editing operation.
8. An electronic device, characterized in that: include: A memory for storing executable instructions; A processor is used to operate the electronic device to execute the method according to any one of claims 1 to 5 under the control of the instruction.
9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program that can be read and executed by a computer, and the computer program is used to execute the method according to any one of claims 1 to 5 when being read and executed by the computer.
Citation Information
Patent Citations
Virtual three-dimensional scene editing system, method and device
CN109803094A
Reconstructing views of real world 3D scenes
CN110322542A