Editing method and device of multimedia data, electronic equipment and storage medium
Patent Information
- Application Number
- CN202211430044.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-15
- Publication Date
- 2026-10-09
- Estimated Expiration
- 2042-11-15
AI Technical Summary
[0003]相关技术中,多媒体数据的编辑功能有限,使得多媒体数据与多媒体画面往往相对固定,从而导致多媒体数据的展示效果相对生硬,缺乏灵活性,影响用户体验
[0020]The technical solution of this disclosure embodiment displays a multimedia data editing interface by receiving an editing trigger operation. The multimedia data editing interface displays a screen preview area and a multimedia data editing area. The multimedia data editing area includes a screen editing sub-area and a camera editing sub-area. The screen editing sub-area displays scene configuration items, providing users with a richer interactive interface. By receiving a scene addition operation based on the scene configuration items, the added 3D virtual scene is displayed in the screen preview area, and the corresponding main configuration item is displayed in the screen editing sub-area. Furthermore, by receiving a main configuration operation for the main configuration items, the configured scene main image is displayed relative to the virtual scene image in the screen preview area, enabling previewing of both the virtual scene image and the scene main image. Based on this, by receiving a camera setting operation based on the camera editing sub-area, the image displayed in the screen preview area is used as the broadcast image of the multimedia data under the camera setting operation, enabling more flexible editing of the multimedia data broadcast image and thus improving the user experience of the multimedia data.
Smart Images

Figure CN115830224B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to computer technology, and more particularly to a method, apparatus, electronic device, and storage medium for editing multimedia data. Background Technology
[0002] Virtual studio technology is a product of the combined development of cutting-edge modern information technology and traditional multimedia data production techniques. Currently, editing virtual multimedia data often requires professionals to use a large amount of specialized hardware and software to create the multimedia data.
[0003] In related technologies, the limited editing functions of multimedia data often result in relatively fixed multimedia data and multimedia images, leading to a relatively rigid and inflexible display effect that affects the user experience. Summary of the Invention
[0004] This disclosure provides a method, apparatus, electronic device, and storage medium for editing multimedia data, enabling more flexible editing of multimedia data broadcast footage.
[0005] In a first aspect, embodiments of this disclosure provide a method for editing multimedia data, the method comprising:
[0006] In response to an edit trigger operation, a multimedia data editing interface is displayed, wherein the multimedia data editing interface displays a screen preview area and a multimedia data editing area, the multimedia data editing area includes a screen editing sub-area and a camera editing sub-area, and the screen editing sub-area displays scene configuration items;
[0007] The system receives a scene addition operation based on the scene configuration items, displays the added 3D virtual scene in the screen preview area, and displays the main configuration items corresponding to the virtual scene in the screen editing sub-area.
[0008] Receive the main configuration operation for the main configuration item, and display the configured scene main screen and the virtual scene screen relative to each other in the screen preview area;
[0009] Receives a lens setting operation input based on the lens editing sub-region, and uses the image displayed in the image preview area as the broadcast image of multimedia data under the lens set based on the lens setting operation.
[0010] Secondly, embodiments of this disclosure also provide a multimedia data editing apparatus, the apparatus comprising:
[0011] The editing interface display module is used to display the multimedia data editing interface in response to the editing trigger operation. The multimedia data editing interface displays a screen preview area and a multimedia data editing area. The multimedia data editing area includes a screen editing sub-area and a camera editing sub-area. The screen editing sub-area displays scene configuration items.
[0012] The virtual scene adding module is used to receive a scene adding operation based on the scene configuration items, display the added 3D virtual scene in the screen preview area, and display the main configuration items corresponding to the virtual scene in the screen editing sub-area.
[0013] The scene main body configuration module is used to receive the main body configuration operation for the main body configuration item, and display the configured scene main body screen relative to the virtual scene screen in the screen preview area;
[0014] The broadcast display module is used to receive the lens setting operation input based on the lens editing sub-area, and to use the image displayed in the image preview area as the broadcast image of multimedia data under the lens set based on the lens setting operation.
[0015] Thirdly, embodiments of this disclosure also provide an electronic device, the electronic device comprising:
[0016] One or more processors;
[0017] Storage device for storing one or more programs.
[0018] When the one or more programs are executed by the one or more processors, the one or more processors implement any of the multimedia data editing methods described above.
[0019] Fourthly, embodiments of this disclosure also provide a storage medium containing computer-executable instructions, wherein the computer-executable instructions, when executed by a computer processor, are used to perform any of the multimedia data editing methods described above.
[0020] The technical solution of this disclosure embodiment displays a multimedia data editing interface by receiving an editing trigger operation. The multimedia data editing interface displays a screen preview area and a multimedia data editing area. The multimedia data editing area includes a screen editing sub-area and a camera editing sub-area. The screen editing sub-area displays scene configuration items, providing users with a richer interactive interface. By receiving a scene addition operation based on the scene configuration items, the added 3D virtual scene is displayed in the screen preview area, and the corresponding main configuration item is displayed in the screen editing sub-area. Furthermore, by receiving a main configuration operation for the main configuration items, the configured scene main image is displayed relative to the virtual scene image in the screen preview area, enabling previewing of both the virtual scene image and the scene main image. Based on this, by receiving a camera setting operation based on the camera editing sub-area, the image displayed in the screen preview area is used as the broadcast image of the multimedia data under the camera setting operation, enabling more flexible editing of the multimedia data broadcast image and thus improving the user experience of the multimedia data. Attached Figure Description
[0021] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.
[0022] Figure 1 A flowchart illustrating a multimedia data editing method provided in an embodiment of this disclosure;
[0023] Figure 2 This is a schematic diagram of the multimedia data editing interface in a multimedia data editing method provided in this embodiment of the present disclosure;
[0024] Figure 3 This is a schematic diagram of the scene configuration items in a multimedia data editing method provided in this embodiment of the present disclosure;
[0025] Figure 4 This is a schematic diagram of the lens configuration item in a multimedia data editing method provided in this embodiment of the present disclosure;
[0026] Figure 5 A flowchart illustrating a multimedia data editing method provided in an embodiment of this disclosure;
[0027] Figure 6 This is a flowchart illustrating a multimedia data editing method provided in an embodiment of this disclosure;
[0028] Figure 7 This is a schematic diagram of the interface for the cutout material configuration item in a multimedia data editing method provided in this embodiment of the present disclosure;
[0029] Figure 8 This is a flowchart illustrating a multimedia data editing method provided in an embodiment of this disclosure;
[0030] Figure 9 This is a flowchart illustrating a multimedia data editing method provided in an embodiment of this disclosure;
[0031] Figure 10 This is a flowchart illustrating a multimedia data editing method provided in an embodiment of this disclosure;
[0032] Figure 11 This is a schematic diagram of the structure of a multimedia data editing device provided in an embodiment of this disclosure;
[0033] Figure 12 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation
[0034] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.
[0035] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.
[0036] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.
[0037] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.
[0038] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".
[0039] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.
[0040] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.
[0041] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application, server, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.
[0042] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.
[0043] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.
[0044] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.
[0045] Figure 1 This is a flowchart illustrating a multimedia data editing method provided in an embodiment of the present disclosure. The embodiments of the present disclosure are applicable to the situation of editing multimedia data. The method can be executed by a multimedia data editing device, which can be implemented in the form of software and / or hardware, or optionally, by an electronic device, such as a mobile terminal, a PC, or a server.
[0046] like Figure 1 As shown, the method in this embodiment may specifically include:
[0047] S110. In response to the edit trigger operation, a multimedia data editing interface is displayed, wherein the multimedia data editing interface displays a screen preview area and a multimedia data editing area, the multimedia data editing area includes a screen editing sub-area and a camera editing sub-area, and the screen editing sub-area displays scene configuration items.
[0048] In this context, an editing trigger operation can be understood as a trigger operation used to edit multimedia data. There are various ways to generate an editing trigger operation. Specifically, it can be an operation to open an application or URL for editing multimedia data; or, a trigger operation applied to a pre-set control or menu item for displaying the multimedia data editing interface. In this embodiment, after receiving the user's input to open an application or URL for editing multimedia data; or after receiving a trigger operation applied to a pre-set control or menu item for displaying the multimedia data editing interface, the multimedia data editing interface can be displayed.
[0049] In this embodiment of the disclosure, the multimedia data editing interface can be understood as a visual interface for editing multimedia data. Multimedia data can be understood as multimedia data processed based on at least one set of multimedia data resources, and which can be used for broadcasting in a preset broadcasting space. In this embodiment of the disclosure, multimedia data resources can be understood as resources that can be used to configure the broadcasting screen of multimedia data, for example, including at least one of virtual scene resources, video sources, or scene materials. The preset broadcasting space can be a live broadcast room and / or a television station, etc. Multimedia data editing interface (see...) Figure 2 The interface can display a preview area and a multimedia data editing area. The preview area is used to preview the multimedia data. In other words, it can be used to play the multimedia data. The multimedia data editing area is used to edit the multimedia data. This area can include a video editing sub-area and a camera editing sub-area. The camera editing sub-area is used to configure the correspondence between the multimedia data and the displayed camera shots. The video editing sub-area can also display scene configuration items. These items allow you to configure the 3D virtual scene used for the multimedia data.
[0050] It should be noted that the arrangement of the preview area and the multimedia data editing area in the multimedia data editing interface can be set according to actual needs, and no specific limitation is made here.
[0051] S120. Receive a scene addition operation based on the scene configuration item input, display the added 3D virtual scene in the screen preview area, and display the main configuration item corresponding to the virtual scene in the screen editing sub-area.
[0052] The scene addition operation can be understood as an operation used to add a 3D virtual scene to multimedia data. The scene addition operation can trigger the display of the added 3D virtual scene's image in the preview area and the display of the corresponding main configuration item in the screen editing sub-area. The virtual scene image can be obtained by rendering a 3D virtual scene. It is understood that the displayed image of the virtual scene is associated with the camera parameters of the virtual camera in the 3D virtual scene. The main scene image can be obtained by rendering the main subject corresponding to the 3D virtual scene. For example, the main subject corresponding to the virtual scene image can be a 3D studio model, screen display materials (such as images, videos, etc.) displayed on a virtual screen, and people or objects in a real scene. A 3D virtual scene can be understood as a 3D scene constructed based on computer vision technology. Specifically, a 3D virtual scene can include one or more scene elements, which can be constructed based on 3D models. In practical applications, the number of 3D models in a 3D virtual scene can be one, two, or more. The screen editing sub-area can include at least one main configuration item. The main configuration item can be understood as a configuration item used to configure the main scene image corresponding to the virtual scene image.
[0053] In one embodiment, receiving a scene addition operation based on the scene configuration item input, and displaying the added 3D virtual scene in the preview area, may include: receiving an operation on the scene configuration item (…). Figure 3 The "Scene Selection" option triggers a scene selection interface. This interface displays at least one 3D virtual scene item. These items may include 3D virtual scene items that have not yet been downloaded. Figure 3 The scene item with the download icon in the middle) and the downloaded 3D virtual scene item ( Figure 3 (Scene items without a download icon). In response to a trigger operation applied to a 3D virtual scene item, the selected 3D virtual scene item's 3D virtual scene can be used as an added 3D virtual scene, the virtual scene image of the added 3D virtual scene can be obtained, and the virtual scene image can be displayed in the screen preview area.
[0054] In another embodiment, receiving a scene addition operation based on the scene configuration item input, and displaying the added 3D virtual scene in the screen preview area, may include: receiving a drag operation on a 3D virtual scene item in the scene selection interface; and displaying the virtual scene of the 3D virtual scene corresponding to the 3D virtual scene item dragged to a preset area in the screen preview area. The preset area may be the screen preview area or other areas in the multimedia data editing interface besides the screen preview area.
[0055] In this embodiment of the disclosure, after displaying the virtual scene image of the added three-dimensional virtual scene in the screen preview area, the main configuration items corresponding to the virtual scene image can be determined, and the main configuration items can be displayed in the screen editing sub-area to receive user input based on the screen editing sub-area to configure the main configuration items corresponding to the virtual scene image.
[0056] S130. Receive the main configuration operation for the main configuration item, and display the configured scene main screen and the virtual scene screen relative to each other in the screen preview area.
[0057] The main configuration operation can be understood as the operation used to configure the main scene image corresponding to the virtual scene image based on the main configuration items. The configured main scene image can be understood as the image obtained after configuring the main scene image based on the main configuration operation applied to the main configuration items.
[0058] Specifically, by receiving a main configuration operation applied to the main configuration item, the main configuration information of the main configuration item can be obtained. Then, based on the main configuration information, the configured scene main screen can be obtained. After obtaining the configured scene main screen, the configured scene main screen and the virtual scene screen relative to it can be displayed in the screen preview area.
[0059] Optionally, receiving a main configuration operation for the main configuration item and displaying the configured main scene image relative to the virtual scene image in the preview area may include: receiving a trigger operation acting on the area where the main configuration item is located, and displaying at least one main configuration sub-item corresponding to the main configuration item based on the trigger operation. After receiving a configuration operation for at least one main configuration sub-item, configuration information for each main configuration sub-item can be obtained. Then, based on the configuration information of each main configuration sub-item, the configured main scene image can be obtained. After obtaining the configured main scene image, the configured main scene image and the virtual scene image can be displayed relative to each other in the preview area.
[0060] S140. Receive a lens setting operation input based on the lens editing sub-region, and use the image displayed in the image preview area as the broadcast image of multimedia data under the lens set based on the lens setting operation.
[0061] The camera setup operation can be used to set the relationship between the footage displayed in the preview area and the camera. The camera setup operation can include at least one of camera binding, camera addition, and camera deletion operations. A camera binding operation can be understood as an operation used to bind a camera from a specific viewpoint to the footage displayed in the preview area. In other words, a camera binding operation can be used to bind a virtual scene image and / or the main scene image to the camera being operated on. The camera editing sub-area can include at least one camera configuration item. A camera configuration item can be used to bind a camera from the viewpoint corresponding to the camera configuration item to the footage displayed in the preview area.
[0062] Optionally, receiving a lens setting operation input based on the lens editing sub-region, and using the image displayed in the image preview area as the broadcast image of multimedia data under the lens set based on the lens setting operation, includes: receiving a lens binding operation input based on the lens editing sub-region, and using the image displayed in the image preview area as the broadcast image of multimedia data under the lens bound based on the lens binding operation.
[0063] Specifically, a trigger operation is received that applies to a lens configuration item within the lens editing sub-region. Based on the click operation, the edit state of the clicked lens configuration item is set to editable. An editable lens configuration item may include a screen binding sub-option. This screen binding sub-option may include options corresponding to screens that can be bound to the lens or options corresponding to screens that are not bound to the lens. Upon receiving an operation applying to an option corresponding to a screen that can be bound to the lens (e.g., a screen identifier, such as...), the system... Figure 4 The trigger operation of "Frame 1" in the image can bind the frame corresponding to that option to the lens. Further, upon receiving a trigger operation applied to an option whose frame is not bound to the lens, the binding relationship between the lens and the frame can be released. In the disclosed embodiments, optionally, a correspondence between the 3D virtual scene and the lens configuration item is pre-established. Different 3D virtual scenes can correspond to the same or different lens configuration items. One 3D virtual scene can correspond to one or more lens configuration items. Further, each lens configuration item can bind a virtual scene frame under a set of camera parameters in the 3D virtual scene.
[0064] In this embodiment of the disclosure, after receiving a lens binding operation input based on the lens editing sub-region, the image from the shooting perspective of the bound lens can be obtained and displayed in the image preview area. The image displayed in the image preview area can then be used as the broadcast image of multimedia data under the bound lens.
[0065] Based on the above embodiments, the multimedia data editing method further includes: receiving a display adjustment operation for at least one lens configuration item, and adjusting the display mode of the at least one lens configuration item in the lens configuration sub-area.
[0066] The display adjustment operation can be used to adjust the display method of lens configuration items in the lens configuration sub-area. The display adjustment operation can include a display position adjustment operation and / or a display quantity adjustment operation. The display position adjustment operation can be understood as an operation used to adjust the position of the lens configuration item in the lens configuration sub-area. The display quantity adjustment operation can be understood as an operation used to add or delete lens configuration items in the lens configuration sub-area.
[0067] In this embodiment of the disclosure, adjusting the display method of the at least one lens configuration item in the lens configuration sub-area may include: adjusting the number of the at least one lens configuration item displayed in the lens configuration sub-area.
[0068] In one embodiment, adjusting the number of at least one lens configuration item displayed in the lens configuration sub-area may include: receiving a trigger operation applied to a lens configuration item, which may display a delete control for deleting the lens configuration item. Upon receiving a trigger operation applied to the delete control, the lens configuration item displayed in the lens configuration sub-area may be deleted.
[0069] In another embodiment, adjusting the number of at least one lens configuration item displayed in the lens configuration sub-area may include: upon receiving a trigger operation applied to a lens configuration item, displaying an add control for adding a lens configuration item. Upon receiving a trigger operation applied to the add control, a lens configuration item may be added in the lens configuration sub-area.
[0070] In this embodiment of the disclosure, adjusting the display method of the at least one lens configuration item in the lens configuration sub-area may include: adjusting the display position of the at least one lens configuration item in the lens configuration sub-area. Specifically, receiving a drag operation applied to a lens configuration item, and adjusting the display position of the at least one lens configuration item in the lens configuration sub-area based on the drag operation. The display position adjustment operation includes, but is not limited to, inserting the dragged lens configuration item at the end of the drag, or swapping the positions of the dragged lens configuration item and the lens configuration item at the end of the drag.
[0071] The technical solution of this disclosure embodiment displays a multimedia data editing interface by receiving an editing trigger operation. This interface includes a preview area and a multimedia data editing area, which further comprises a preview area and a camera editing sub-area. The preview area displays scene configuration items, providing users with a richer interactive interface. By receiving a scene addition operation based on the scene configuration items, the added 3D virtual scene is displayed in the preview area, and the corresponding main configuration items are displayed in the preview area. Furthermore, by receiving a main configuration operation for the main configuration items, the configured scene main image is displayed relative to the virtual scene image in the preview area, enabling flexible and personalized editing of both the virtual scene and the scene main image. Based on this, by receiving a camera setting operation based on the camera editing sub-area, the image displayed in the preview area is used as the broadcast image of the multimedia data under the bound camera, achieving flexible configuration of the multimedia data broadcast image.
[0072] Figure 5 This is a flowchart illustrating a multimedia data editing method provided in an embodiment of this disclosure. Based on the above embodiments, the technical solution of this embodiment optionally further includes: receiving a scene adjustment operation on the virtual scene displayed in the preview area; determining camera parameters of the virtual camera in the three-dimensional virtual scene based on the scene adjustment operation; and displaying the virtual scene image of the three-dimensional virtual scene under the camera parameters in the preview area. For detailed implementation, please refer to the description of this embodiment. Technical features that are the same as or similar to those in the foregoing embodiments will not be repeated here.
[0073] like Figure 5 As shown, the method in this embodiment may specifically include:
[0074] S210. In response to the edit trigger operation, the multimedia data editing interface is displayed. The multimedia data editing interface displays a screen preview area and a multimedia data editing area. The multimedia data editing area includes a screen editing sub-area and a camera editing sub-area. The screen editing sub-area displays scene configuration items.
[0075] S220. Receive a scene addition operation based on the scene configuration item input, display the virtual scene screen of the added three-dimensional virtual scene in the screen preview area, and display the main configuration item corresponding to the virtual scene screen in the screen editing sub-area.
[0076] S230. Receive the main configuration operation for the main configuration item, and display the configured scene main screen and the virtual scene screen relative to each other in the screen preview area.
[0077] S240: Receive a lens setting operation input based on the lens editing sub-region, and use the image displayed in the image preview area as the broadcast image of multimedia data under the lens set based on the lens setting operation.
[0078] S250: Receive scene adjustment operation for the virtual scene displayed in the preview area.
[0079] The scene adjustment operation can be understood as an operation used to adjust the virtual scene image. In other words, the scene adjustment operation can be used to adjust the virtual scene image from one viewpoint to another. Optionally, receiving the scene adjustment operation for the virtual scene image displayed in the preview area can be receiving an operation input by the user based on an input device to adjust the virtual scene image displayed in the preview area. The device can be a physical input device (e.g., a mouse and / or keyboard) and a virtual input device (e.g., a virtual keyboard). The virtual camera can be understood as a device used to capture images of the 3D virtual scene. The camera parameters of the virtual camera can be used to indicate the shooting angle of the virtual camera capturing the 3D virtual scene. For example, receiving key operations input by the user based on a keyboard to adjust the virtual scene image.
[0080] S260. Determine the camera parameters of the virtual camera in the three-dimensional virtual scene based on the scene image adjustment operation.
[0081] Specifically, the operation information for adjusting the scene image is determined. This operation information may include position adjustment information and / or angle adjustment information. Then, based on the position adjustment information and / or angle adjustment information, the camera parameters of the virtual camera in the 3D virtual scene can be determined. The position adjustment information can be information obtained after adjusting the position of the virtual camera in the 3D virtual scene. The angle adjustment information can be information obtained after rotating the lens of the virtual camera in the 3D virtual scene.
[0082] S270. Display the virtual scene of the three-dimensional virtual scene under the camera parameters in the preview area.
[0083] Specifically, the virtual scene image of the 3D virtual scene under the specified camera parameters is acquired, and the virtual scene image is displayed in the preview area. The method for acquiring the virtual scene image of the 3D virtual scene under the specified camera parameters can be as follows: a virtual camera based on the camera parameters takes a picture of the 3D virtual scene. This results in the virtual scene image of the 3D virtual scene under the specified camera parameters.
[0084] Based on the above embodiments, the multimedia data editing method further includes: receiving a scene save operation for the virtual scene displayed in the screen preview area, generating a lens configuration item based on the camera parameters corresponding to the virtual scene, and displaying the lens configuration item in the lens editing sub-area.
[0085] The scene saving operation can be understood as the operation used to save the virtual scene displayed in the preview area.
[0086] Specifically, upon receiving a trigger operation applied to the virtual scene displayed in the preview area, a prompt interface can be displayed to save or cancel saving the triggered virtual scene. This prompt interface may include a save control for saving the virtual scene and a cancel control for canceling saving. After receiving a trigger operation applied to the save control, the camera parameters corresponding to the virtual scene can be determined. Lens configuration items can then be generated based on these camera parameters. After generating the configuration items, the generated lens configuration items can be displayed in the lens editing sub-area.
[0087] The technical solution of this disclosure embodiment, by receiving a scene adjustment operation for the virtual scene displayed in the preview area, and determining the camera parameters of the virtual camera in the three-dimensional virtual scene based on the scene adjustment operation; and displaying the virtual scene of the three-dimensional virtual scene under the camera parameters in the preview area, can realize personalized adjustment of the shooting perspective of the three-dimensional virtual scene and enrich the visualization presentation effect of multimedia data.
[0088] Figure 6 This is a flowchart illustrating a multimedia data editing method provided in an embodiment of this disclosure. Based on the above embodiments, the technical solution of this embodiment optionally includes a background cutout material configuration item; the step of receiving a main configuration operation for the main configuration item and displaying the configured scene main image relative to the virtual scene image in the image preview area includes: receiving a background cutout material configuration operation for the background cutout material configuration item, performing background cutout processing on the configured background cutout material to obtain the scene main image, and displaying the scene main image relative to the virtual scene image in the image preview area. For detailed implementation, please refer to the description of this embodiment. Technical features that are the same as or similar to those in the foregoing embodiments will not be repeated here.
[0089] like Figure 6 As shown, the method in this embodiment may specifically include:
[0090] S310. In response to the edit trigger operation, a multimedia data editing interface is displayed, wherein the multimedia data editing interface displays a screen preview area and a multimedia data editing area, the multimedia data editing area includes a screen editing sub-area and a camera editing sub-area, and the screen editing sub-area displays scene configuration items.
[0091] S320. Receive a scene addition operation based on the scene configuration item input, display the added 3D virtual scene image in the screen preview area, and display the main configuration item corresponding to the virtual scene image in the screen editing sub-area. The main configuration item includes the cutout material configuration item.
[0092] In this embodiment of the disclosure, the cutout material configuration item can be understood as a configuration item for cutting out cutout materials. The cutout materials may include video and / or images. The cutout material configuration item may include at least one of a signal source configuration sub-item, a lens configuration sub-item, and a cutout method configuration sub-item. The signal source configuration sub-item can be understood as an option for configuring the source of the cutout material. The lens configuration sub-item can be understood as a configuration item for binding the image to a display lens. The cutout method configuration sub-item can be understood as a configuration item for setting the cutout method for the material. Optionally, the material cutout method can be a cutout method in green screen mode. The cutout method in green screen mode may include at least one of intelligent cutout, custom parameter cutout, and cutout using a triggered image.
[0093] S330: Receive the cutout material configuration operation for the cutout material configuration item, perform cutout processing on the configured cutout material to obtain the main scene image, and display the main scene image and the virtual scene image relative to each other in the screen preview area.
[0094] In this embodiment of the disclosure, receiving a trigger operation applied to the cutout material configuration item can display at least one of the signal source configuration sub-item, lens configuration sub-item, and cutout method configuration sub-item corresponding to the cutout material configuration item.
[0095] In one embodiment, receiving a trigger operation applied to a signal source configuration sub-item can display a signal source selection dropdown list containing multiple signal source options. Upon receiving a selection operation applied to a signal source option in the signal source selection dropdown list, background cutout material can be obtained based on the selected signal source, i.e., the configured background cutout material can be obtained.
[0096] In one embodiment, receiving a trigger operation applied to a lens configuration sub-item allows displaying a control corresponding to the lens configuration sub-item for binding the lens and image under a preset viewpoint. The preset viewpoint may include at least one of the following: long-range view, left panoramic view, panoramic view, medium view, right panoramic view, left medium view, right medium view, left close-up view, long-range view, and right close-up view. Upon receiving a trigger operation applied to the control for binding the lens and image under the long-range view, the cutout material bound to the lens under the long-range view can be used as the main scene image and displayed in the image preview area.
[0097] In one embodiment, when the cutout material bound to a distant view is displayed as the main scene image in the preview area, the configuration items for the cutout material are received. Figure 7The "Material Keying" trigger operation can display keying method settings options for configuring the material keying method. Keying method settings options can include at least one of the following: smart parameter settings, custom parameter settings, and image cropping settings. Upon receiving a trigger operation that applies to at least one of the smart parameter settings, custom parameter settings, or image cropping settings, the configured keying material can be processed based on the trigger operation.
[0098] In this embodiment of the disclosure, after receiving a trigger operation applied to the smart parameter setting item, the smart parameter setting item's cutout smart recommendation parameter value can be obtained; then, the configured cutout material can be processed based on the cutout smart recommendation parameter value.
[0099] In this embodiment of the disclosure, after receiving a trigger operation applied to a custom parameter setting item, a cutout parameter setting interface corresponding to the selected setting item for setting the cutout material can be displayed; after receiving a setting operation applied to the cutout parameter setting interface for receiving input, the cutout parameter value for setting the cutout material can be obtained; and then the configured cutout material can be processed based on the cutout parameter value.
[0100] In this embodiment of the disclosure, after receiving a trigger operation applied to at least one of the image cropping settings, a cropping frame corresponding to the cutout material is displayed in the image preview area. After receiving a cropping operation applied to the cropping frame, the configured cutout material can be processed based on the cropping operation.
[0101] In this embodiment of the disclosure, after the configured cutout material is processed, the cropped cutout material can be rendered. The rendered image can then be used as the main scene image. Furthermore, the main scene image and the virtual scene image can be displayed relative to each other in the image preview area.
[0102] In this embodiment of the disclosure, in order to facilitate image cutout, the cutout material can be a green screen background material containing a scene theme.
[0103] S340. Receive a lens setting operation input based on the lens editing sub-region, and use the image displayed in the image preview area as the broadcast image of multimedia data under the lens set based on the lens setting operation.
[0104] The technical solution of this disclosure embodiment receives a cutout material configuration operation for the cutout material configuration item, performs cutout processing on the configured cutout material to obtain the main scene image, and displays the main scene image and the virtual scene image relative to each other in the screen preview area. It supports the addition of personalized and diverse scene theme images, and can achieve fine integration of the main scene image and the virtual scene image. It is especially suitable for scenes that combine virtual scene images with real-world shooting images, and supports real-time cutout processing of cutout materials, thereby improving the editing efficiency of multimedia data.
[0105] Figure 8 This is a flowchart illustrating a multimedia data editing method provided in an embodiment of this disclosure. Based on the above embodiments, the technical solution of this embodiment optionally includes a scene material configuration item; the step of receiving a main configuration operation for the main configuration item and displaying the configured scene main image relative to the virtual scene image in the image preview area includes: receiving a scene material configuration operation for the scene material configuration item, using the configured scene material image as the scene main image, and displaying the scene main image relative to the virtual scene image in the image preview area. For detailed implementation, please refer to the description of this embodiment. Technical features that are the same as or similar to those in the foregoing embodiments will not be repeated here.
[0106] like Figure 8 As shown, the method in this embodiment may specifically include:
[0107] S410. In response to the edit trigger operation, a multimedia data editing interface is displayed, wherein the multimedia data editing interface displays a screen preview area and a multimedia data editing area, the multimedia data editing area includes a screen editing sub-area and a camera editing sub-area, and the screen editing sub-area displays scene configuration items.
[0108] S420. Receive a scene addition operation based on the scene configuration item input, display the added 3D virtual scene in the screen preview area, and display the main configuration item corresponding to the virtual scene in the screen editing sub-area. The main configuration item includes scene material configuration item.
[0109] The scene material configuration item can be understood as a configuration item used to configure scene materials. Scene materials can include 3D materials and / or 2D materials. Scene materials can be materials with special effects or materials without special effects. The scene material configuration item can include at least one of the following: add material settings sub-item, adjust material settings sub-item, and delete material settings sub-item. The add material settings sub-item can be used to add materials to the 3D virtual scene. The adjust material settings sub-item can be used to adjust materials in the scene. The delete material settings sub-item can be used to delete materials in the 3D virtual scene.
[0110] S430: Receive a scene material configuration operation for the scene material configuration item, use the configured scene material screen as the main scene screen, and display the main scene screen and the virtual scene screen relative to each other in the screen preview area.
[0111] The scene material configuration operation can be understood as an operation used to configure materials in a 3D virtual scene based on scene material configuration items. Scene material configuration operations can include at least one of the following: adding scene materials, adjusting scene materials, deleting scene materials, and naming scene materials. Adding scene materials is the operation of adding scene materials to a 3D virtual scene. Adjusting scene materials can be used to adjust scene materials in a 3D virtual scene, for example, adjusting the position and / or size of scene materials in the 3D virtual scene. Deleting scene materials is the operation of deleting scene materials from a 3D virtual scene.
[0112] In this embodiment of the disclosure, receiving a trigger operation applied to a scene material configuration item in the screen editing sub-area can display a scene material configuration interface for configuring scene materials. The scene material configuration interface may include at least one of the following: add material settings sub-item, at least one added scene material sub-item, adjust material settings sub-item corresponding to each added scene material sub-item, and delete material settings sub-item corresponding to each added scene material sub-item.
[0113] In one embodiment, upon receiving a trigger operation applied to an item in the "Add Material Settings" sub-item, a scene material resource library interface can be displayed. The scene material resource library interface may include at least one scene material option, a selection confirmation control, and a selection cancellation control. Upon receiving a selection operation applied to at least one scene material option in the scene material resource library interface, the scene material corresponding to the selected scene material item can be determined. Upon receiving a trigger operation applied to the selection confirmation control, the scene material corresponding to the selected scene material item can be added to the 3D virtual scene in the preview area, and the added scene material item is displayed in the 3D virtual scene in the scene material configuration interface; that is, the added scene material sub-item is displayed in the scene material configuration interface. It is understood that upon receiving a trigger operation applied to the selection cancellation control, the selection of the scene material item in the scene material resource library interface can be cancelled.
[0114] In one embodiment, upon receiving a trigger operation applied to an adjustment setting sub-item corresponding to an added scene material sub-item, a material parameter adjustment interface can be displayed for adjusting the scene material corresponding to the added scene material sub-item. The material parameter adjustment interface may display material size adjustment items and / or material position setting items. The material size adjustment item can be used to adjust the size of the scene material. The material position setting item can be used to set the position of the scene material. Upon receiving an adjustment operation applied to the material size adjustment item, the target size of the scene material can be determined. Then, the scene material displayed in the 3D virtual scene in the preview area can be scaled and displayed in the preview area at the target size. Upon receiving a parameter value (e.g., spatial coordinate value) input to the material position adjustment item, the scene material can be displayed in the 3D virtual scene in the preview area at the position corresponding to the input parameter value.
[0115] In one embodiment, upon receiving a trigger operation that acts on the delete material setting sub-item corresponding to the added scene material sub-item, the scene material corresponding to the added scene material sub-item in the 3D virtual scene can be deleted, and the added scene material sub-item in the scene material configuration interface can also be deleted.
[0116] Based on the above embodiments, after configuring the scene materials in the 3D virtual scene using scene material configuration operations, the configured scene materials can be rendered. This yields the configured scene material image. At this point, the configured scene material image can be used as the main scene image. Furthermore, the main scene image and the virtual scene image can be displayed relative to each other in the preview area.
[0117] In this embodiment of the disclosure, the method further includes: after receiving a trigger operation on a text box containing a material name in an added scene material sub-item, the editing state of the text box can be changed to an editable state. After receiving material name information input from the text box in the editable state, the input material name information can be used as the material name of the scene material corresponding to the added scene material sub-item.
[0118] S440. Receive a lens setting operation input based on the lens editing sub-region, and use the image displayed in the image preview area as the broadcast image of multimedia data under the lens set based on the lens setting operation.
[0119] The technical solution of this disclosure embodiment, by receiving a scene material configuration operation for the scene material configuration item, uses the configured scene material screen as the main scene screen, and displays the main scene screen and the virtual scene screen relative to each other in the screen preview area, can realize personalized configuration of scene materials and further enrich the display effect of multimedia data.
[0120] Figure 9 This is a flowchart illustrating a multimedia data editing method provided in an embodiment of this disclosure. Based on the above embodiments, the technical solution of this embodiment optionally includes a virtual screen configuration item; receiving a main configuration operation for the main configuration item and displaying the configured scene main image and the virtual scene image relative to each other in the screen preview area includes: when the virtual scene image displayed in the screen preview area includes a virtual screen, receiving a virtual screen configuration operation for the virtual screen configuration item, using the configured screen display material as the scene main image, and displaying the scene main image in the virtual screen. For detailed implementation, please refer to the description of this embodiment. Technical features that are the same as or similar to those in the foregoing embodiments will not be repeated here.
[0121] like Figure 9 As shown, the method in this embodiment may specifically include:
[0122] S510. In response to the edit trigger operation, a multimedia data editing interface is displayed, wherein the multimedia data editing interface displays a screen preview area and a multimedia data editing area, the multimedia data editing area includes a screen editing sub-area and a camera editing sub-area, and the screen editing sub-area displays scene configuration items.
[0123] S520. Receive a scene addition operation based on the scene configuration item input, display the added 3D virtual scene screen in the screen preview area, and display the main configuration item corresponding to the virtual scene screen in the screen editing sub-area. The main configuration item includes the virtual screen configuration item.
[0124] The virtual screen configuration items can be understood as configuration items used to configure the virtual screen. The virtual screen can be understood as a screen used to display display materials. Display materials can include at least one of video materials, text materials, and image materials. Video materials can be in formats such as mp4, avi, and wmv. Image materials can be in formats such as jpg, png, or gif. The virtual screen configuration items can include multimedia material settings sub-items and / or signal source settings sub-items. The multimedia material settings sub-item can be used to configure multimedia materials when the display materials on the virtual screen originate from multimedia materials, such as adding and / or deleting multimedia materials. The signal source settings sub-item can be used to configure the signal source when the display materials on the virtual screen originate from a signal source.
[0125] S530, if the virtual scene displayed in the preview area includes a virtual screen, receive a virtual screen configuration operation for the virtual screen configuration item, use the configured screen display material as the main scene image, and display the main scene image in the virtual screen.
[0126] The virtual screen configuration operation can be understood as an operation used to configure the virtual screen displayed in the virtual scene. The virtual screen configuration operation can include at least one of the following: adding screen display materials, deleting screen display materials, playing screen display materials, and pausing screen display materials. Specifically, the adding screen display materials operation can be used to add screen display materials to the virtual screen. The deleting screen display materials operation can be used to delete screen display materials from the virtual screen. The playing screen display materials operation can be used to control the playback of screen display materials in the virtual screen. The pausing screen display materials operation can be used to control the pause playback of screen display materials playing in the virtual screen.
[0127] In this embodiment of the disclosure, when the virtual scene displayed in the preview area includes a virtual screen, receiving a trigger operation acting on the virtual screen configuration item can display multimedia material setting sub-items and / or signal source setting sub-items corresponding to the virtual screen configuration item. Optionally, the multimedia material setting sub-items and / or signal source setting sub-items can be displayed in the form of a drop-down list.
[0128] Based on the above embodiments, upon receiving a trigger operation applied to a multimedia material settings sub-item for the virtual screen, a material addition control for adding screen display materials to the virtual screen can be displayed in the screen editing sub-area. Upon receiving a trigger operation applied to the material addition control, the user can be redirected to the storage space for storing screen display materials. Upon receiving a selection operation applied to at least one screen display material in the storage space, the selected screen display material can be determined. The selected screen display material can then be added to the virtual screen.
[0129] Based on the above embodiments, upon receiving a trigger operation applied to added screen display material corresponding to the virtual screen, the added screen display material can be displayed in the screen preview area, and at least one of a play control, a pause control, and a delete control can be displayed in the screen editing sub-area. The play control can be used to control the playback of the screen display material in the virtual screen. The pause control can be used to pause the playback of the screen display material playing in the virtual screen. The delete control can be used to delete the added screen display material corresponding to the virtual screen. Upon receiving a control trigger operation applied to the play control, the screen display material can be controlled to play in the virtual screen. Upon receiving a control trigger operation applied to the pause control, the playback of the screen display material playing in the virtual screen can be paused. Upon receiving a control trigger operation applied to the delete control, the added screen display material corresponding to the virtual screen can be deleted.
[0130] Based on the above embodiments, receiving a trigger operation applied to a signal source setting sub-item allows for the display of at least one signal source option in the form of a drop-down list. Upon receiving a selection operation applied to a signal source option, the selected signal source can be determined. Subsequently, configured screen display materials can be obtained based on the signal source.
[0131] S540: Receive a lens setting operation input based on the lens editing sub-region, and use the image displayed in the image preview area as the broadcast image of multimedia data under the lens set based on the lens setting operation.
[0132] The technical solution of this disclosure embodiment, by receiving a virtual screen configuration operation for the virtual screen configuration item when the virtual scene screen displayed in the screen preview area includes a virtual screen, uses the configured screen display material as the main scene screen, and displays the main scene screen in the virtual screen, can realize personalized configuration of the content displayed in the virtual screen, enriching the screen content of multimedia data.
[0133] Figure 10This is a flowchart illustrating a multimedia data editing method provided in an embodiment of this disclosure. Based on the above embodiments, the technical solution of this embodiment optionally includes, after displaying the configured main scene image relative to the virtual scene image in the image preview area, receiving an image adjustment operation for the main scene image and adjusting the main scene image, wherein the image adjustment operation includes at least one of image size adjustment, image color adjustment, image brightness adjustment, image sharpening parameter adjustment, image contrast adjustment, image display direction adjustment, and image position adjustment. For detailed implementation, please refer to the description of this embodiment. Technical features that are the same as or similar to those in the foregoing embodiments will not be repeated here.
[0134] like Figure 10 As shown, the method in this embodiment may specifically include:
[0135] S610. In response to the edit trigger operation, a multimedia data editing interface is displayed, wherein the multimedia data editing interface displays a screen preview area and a multimedia data editing area, the multimedia data editing area includes a screen editing sub-area and a camera editing sub-area, and the screen editing sub-area displays scene configuration items.
[0136] S620. Receive a scene addition operation based on the scene configuration item input, display the added 3D virtual scene in the screen preview area, and display the main configuration item corresponding to the virtual scene in the screen editing sub-area.
[0137] S630. Receive the main configuration operation for the main configuration item, and display the configured scene main screen and the virtual scene screen relative to each other in the screen preview area.
[0138] S640. Receive a screen adjustment operation for the main scene screen, adjust the main scene screen, and update the configured main scene screen displayed in the screen preview area to the adjusted main scene screen.
[0139] Image adjustment operations can be understood as operations used to adjust the main image of a scene. Image adjustment operations can include at least one of the following: image size adjustment, image color adjustment, image brightness adjustment, image sharpening parameter adjustment, image contrast adjustment, image display orientation adjustment, and image position adjustment. Image size adjustment can include cropping, enlarging, or shrinking the main image of the scene.
[0140] In this embodiment, receiving a trigger operation applied to a main configuration item allows the display of a screen adjustment interface for adjusting the main scene image. The screen adjustment interface can display screen adjustment items for adjusting the main scene image. These screen adjustment items may include at least one of the following: screen cropping controls, screen zoom-in controls, screen zoom-out controls, screen color adjustments, screen brightness adjustments, screen sharpening parameter adjustments, screen contrast adjustments, screen display orientation adjustments, and screen display coordinate settings. Upon receiving a trigger operation applied to any screen adjustment item in the screen adjustment interface, the main scene image can be adjusted based on the parameters of the set screen adjustment item.
[0141] Understandably, the image cropping control can be used to crop the main subject of the scene. The image zoom-in control can be used to zoom in on the main subject of the scene. The image zoom-out control can be used to zoom out on the main subject of the scene. The image color adjustment can be used to adjust the color of the main subject of the scene. The image brightness adjustment can be used to adjust the brightness of the main subject of the scene. The image sharpening parameter adjustment can be used to adjust the sharpening parameters of the main subject of the scene to modify the sharpening effect. The image contrast adjustment can be used to adjust the contrast between light and dark areas of the main subject of the scene. The image display orientation adjustment can be used to adjust the display orientation of the main subject of the scene. The image display coordinate setting can be used to adjust the display coordinates of the main subject of the scene.
[0142] Based on the above embodiments, the multimedia data editing method further includes: receiving a reference object addition operation with a preset size input to the virtual scene screen, and displaying the added reference object in the virtual scene screen; receiving a position adjustment operation for the reference object, and adjusting the display position of the reference object in the virtual scene screen.
[0143] The reference object addition operation can be understood as adding a reference object of a preset size to a virtual scene. The reference object can be a two-dimensional image or a three-dimensional model. In this embodiment of the invention, a three-dimensional character model of a preset size is used as the reference object. When the reference object is a three-dimensional character model, the preset size can be the height of the preset three-dimensional character model. The preset size can be a size pre-set for the reference object according to actual needs.
[0144] In this embodiment of the disclosure, receiving an operation to add a reference object of a preset size to the virtual scene screen, and displaying the added reference object in the virtual scene screen, may include: receiving a trigger operation on a scene material configuration item in the screen editing sub-area, and displaying a material adding control for adding scene materials in the screen editing sub-area. After receiving a control trigger operation on the material adding control, a material display interface containing at least one scene material may be displayed. The material display interface may display at least one reference object. After receiving a selection operation on a reference object in the material display interface, the selected reference object may be determined, and the reference object of the selected reference object may be displayed in the virtual scene screen in the screen preview area.
[0145] It should be noted that, in this embodiment of the present disclosure, after adding reference objects to the virtual scene, the main scene in the virtual scene can be adjusted based on the reference objects, thereby improving the realism of the multimedia data screen.
[0146] In this embodiment of the disclosure, receiving a position adjustment operation on the reference object, and adjusting the display position of the reference object in the virtual scene image, may include: receiving a drag operation on the reference object in the virtual scene image within the preview area. Based on the drag operation, the display position of the reference object in the virtual scene image is adjusted.
[0147] Optionally, after receiving the operation to add a reference object of a preset size for the virtual scene, the multimedia data editing method further includes: displaying a coordinate configuration item corresponding to the reference object. The coordinate configuration item can be used to configure the display coordinates of the reference object in the three-dimensional virtual scene. Receiving the position adjustment operation for the reference object, and adjusting the display position of the reference object in the virtual scene, may include: receiving a drag operation applied to the reference object, adjusting the reference object to the dragged position in the virtual scene, and updating the coordinate information in the coordinate configuration item based on the coordinate information of the dragged position; and / or, receiving a coordinate configuration operation for the coordinate configuration item, adjusting the reference object to the position in the virtual scene corresponding to the configured coordinate information for display.
[0148] The drag position can be understood as the position obtained by adjusting the display position of the reference object based on a drag operation applied to it. The coordinate information in the coordinate configuration item is updated based on the coordinate information of the drag position. This ensures consistency between the coordinate information of the drag position and the coordinate information in the coordinate configuration item, allowing users to promptly understand changes in the coordinates of the reference object's display position.
[0149] The process of receiving a coordinate configuration operation for the coordinate configuration item and adjusting the reference object to the position in the virtual scene corresponding to the configured coordinate information for display can include: after receiving coordinate information input based on the coordinate configuration item, using the input coordinate information as the configured coordinate information for the reference object in the virtual scene. This allows the reference object to be adjusted to the position in the virtual scene corresponding to the configured coordinate information for display.
[0150] In one application scenario, a reference object can be adjusted to a preset position and displayed in comparison with the subject of the scene to be adjusted in the multimedia data screen. Furthermore, the position and / or size information of the subject of the scene to be adjusted can be adjusted based on the size information of the reference object.
[0151] S650: Receive a lens setting operation input based on the lens editing sub-region, and use the image displayed in the image preview area as multimedia data for broadcast under the lens set based on the lens setting operation.
[0152] The technical solution of this disclosure embodiment, by receiving an image adjustment operation for the main scene image, adjusts the main scene image, thereby enabling adjustments to the image size, color, brightness, sharpening parameters, contrast, display direction, and position of the main scene image, further improving the quality of the main scene image.
[0153] Figure 11 This is a schematic diagram of the structure of a multimedia data editing device provided in an embodiment of the present disclosure, as shown below. Figure 11 As shown, the device includes: an editing interface display module 710, a virtual scene addition module 720, a scene main configuration module 730, and a broadcast screen display module 740.
[0154] The editing interface display module 710 is used to display a multimedia data editing interface in response to an editing trigger operation. The multimedia data editing interface displays a preview area and a multimedia data editing area, which includes a preview area and a camera editing sub-area. The preview area displays scene configuration items. The virtual scene adding module 720 is used to receive a scene adding operation based on the scene configuration items, display the added 3D virtual scene in the preview area, and display the corresponding main configuration items in the preview area. The scene main configuration module 730 is used to receive a main configuration operation for the main configuration items, and display the configured scene main image relative to the virtual scene image in the preview area. The broadcast image display module 740 is used to receive a camera setting operation based on the camera editing sub-area, and display the image displayed in the preview area as the broadcast image of the multimedia data under the camera setting based on the camera setting operation.
[0155] The technical solution of this disclosure embodiment displays a multimedia data editing interface by receiving an editing trigger operation. The multimedia data editing interface displays a screen preview area and a multimedia data editing area. The multimedia data editing area includes a screen editing sub-area and a camera editing sub-area. The screen editing sub-area displays scene configuration items, providing users with a richer interactive interface. By receiving a scene addition operation based on the scene configuration items, the added 3D virtual scene is displayed in the screen preview area, and the corresponding main configuration item is displayed in the screen editing sub-area. Furthermore, by receiving a main configuration operation for the main configuration items, the configured scene main image is displayed relative to the virtual scene image in the screen preview area, enabling flexible and personalized editing of the virtual scene image and the scene main image. Based on this, by receiving a camera setting operation based on the camera editing sub-area, the image displayed in the screen preview area is used as the broadcast image of the multimedia data under the camera setting based on the camera setting operation, achieving flexible configuration of the multimedia data broadcast image.
[0156] Based on the above-mentioned optional technical solutions, the multimedia data editing device may optionally further include a scene adjustment module; wherein, the scene adjustment module is used to receive a scene adjustment operation for the virtual scene displayed in the screen preview area, determine the camera parameters of the virtual camera in the three-dimensional virtual scene based on the scene adjustment operation, and display the virtual scene of the three-dimensional virtual scene under the camera parameters in the screen preview area.
[0157] Based on the above-mentioned optional technical solutions, the multimedia data editing device may optionally include a scene image saving module; wherein, the scene image saving module is used to receive a scene image saving operation for the virtual scene image displayed in the image preview area, generate a lens configuration item based on the camera parameters corresponding to the virtual scene image, and display the lens configuration item in the lens editing sub-area.
[0158] Based on the above-mentioned optional technical solutions, the multimedia data editing device may optionally further include a lens configuration item adjustment module; wherein, the lens configuration item adjustment module is used to receive a display adjustment operation for at least one lens configuration item, and adjust the display mode of the at least one lens configuration item in the lens configuration sub-area, wherein the display adjustment operation includes a display position adjustment operation and / or a display quantity adjustment operation.
[0159] Based on the above optional technical solutions, the main configuration item may optionally include a cutout material configuration item; correspondingly, the scene main configuration module 730 is used to receive a cutout material configuration operation for the cutout material configuration item, perform cutout processing on the configured cutout material to obtain the scene main image, and display the scene main image and the virtual scene image relative to each other in the image preview area.
[0160] Based on the above optional technical solutions, optionally, the main configuration item includes a scene material configuration item; correspondingly, the scene main configuration module 730 is used to receive a scene material configuration operation for the scene material configuration item, use the configured scene material screen as the scene main screen, and display the scene main screen and the virtual scene screen relative to each other in the screen preview area.
[0161] Based on the above optional technical solutions, optionally, the main configuration item includes a virtual screen configuration item; correspondingly, the scene main configuration module 730 is used to receive a virtual screen configuration operation for the virtual screen configuration item when the virtual scene screen displayed in the screen preview area includes a virtual screen, and to use the configured screen display material as the scene main screen and display the scene main screen in the virtual screen.
[0162] Based on the above-mentioned optional technical solutions, the multimedia data editing device may optionally further include a scene main image adjustment operation module; correspondingly, the scene main image adjustment operation module is used to receive an image adjustment operation for the scene main image after the configured scene main image and the virtual scene image are displayed relative to each other in the image preview area, and to adjust the scene main image, wherein the image adjustment operation includes at least one of image size adjustment, image color adjustment, image brightness adjustment, image sharpening parameter adjustment, image contrast adjustment, image display direction adjustment, and image position adjustment.
[0163] Based on the above-mentioned optional technical solutions, the multimedia data editing device may optionally include: a reference object operation module, which includes a reference object adding unit and a reference object position adjustment unit;
[0164] The reference object adding unit is used to receive a reference object adding operation with a preset size input to the virtual scene screen, and display the added reference object in the virtual scene screen; the reference object position adjusting unit is used to receive a reference object position adjusting operation, and adjust the display position of the reference object in the virtual scene screen.
[0165] Based on the above-mentioned optional technical solutions, the multimedia data editing device may optionally further include a coordinate configuration item display module, used to display the coordinate configuration item corresponding to the reference object after receiving the reference object addition operation with a preset size input for the virtual scene screen; correspondingly, the reference object position adjustment unit is used to receive a drag operation applied to the reference object, adjust the reference object to the drag position in the virtual scene screen, and update the coordinate information in the coordinate configuration item based on the coordinate information of the drag position; and / or, receive a coordinate configuration operation for the coordinate configuration item, and adjust the reference object to the position in the virtual scene screen corresponding to the configured coordinate information for display.
[0166] Based on the above optional technical solutions, optionally, the lens setting operation includes a lens binding operation, which is used to bind the virtual scene image and / or the main scene image to the operated lens; the broadcast image display module 740 is used to receive the lens binding operation input based on the lens editing sub-area, and use the image displayed in the image preview area as the broadcast image of multimedia data under the lens bound based on the lens binding operation.
[0167] The multimedia data editing apparatus provided in this disclosure can execute the multimedia data editing method provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects for executing the method.
[0168] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the protection scope of the embodiments of this disclosure.
[0169] Figure 12 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Reference is made below. Figure 12 It illustrates an electronic device suitable for implementing embodiments of the present disclosure (e.g., Figure 12 The diagram below shows the structure of the terminal device or server 800. The terminal device in this embodiment may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and vehicle terminals (e.g., vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. Figure 12 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.
[0170] like Figure 12 As shown, the electronic device 800 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 801, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage device 808 into a random access memory (RAM) 803. The RAM 803 also stores various programs and data required for the operation of the electronic device 800. The processing unit 801, ROM 802, and RAM 803 are interconnected via a bus 804. An edit / output (I / O) interface 805 is also connected to the bus 804.
[0171] Typically, the following devices can be connected to I / O interface 805: input devices 806 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 807 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 808 including, for example, magnetic tapes, hard disks, etc.; and communication devices 809. Communication device 809 allows electronic device 800 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 12 An electronic device 800 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.
[0172] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 809, or installed from a storage device 808, or installed from a ROM 802. When the computer program is executed by a processing device 801, it performs the functions defined in the methods of embodiments of this disclosure.
[0173] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.
[0174] The electronic device provided in this embodiment and the multimedia data editing method provided in the above embodiments belong to the same inventive concept. Technical details not described in detail in this embodiment can be found in the above embodiments, and this embodiment has the same beneficial effects as the above embodiments.
[0175] This disclosure provides a computer storage medium storing a computer program that, when executed by a processor, implements the multimedia data editing method provided in the above embodiments.
[0176] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.
[0177] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol, such as HTTP (Hypertext Transfer Protocol), and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or future-developed networks.
[0178] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.
[0179] The aforementioned computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to: in response to an edit trigger operation, display a multimedia data editing interface, wherein the multimedia data editing interface displays a screen preview area and a multimedia data editing area, the multimedia data editing area includes a screen editing sub-area and a camera editing sub-area, and the screen editing sub-area displays scene configuration items;
[0180] The system receives a scene addition operation based on the scene configuration items, displays the added 3D virtual scene in the screen preview area, and displays the main configuration items corresponding to the virtual scene in the screen editing sub-area.
[0181] Receive the main configuration operation for the main configuration item, and display the configured scene main screen and the virtual scene screen relative to each other in the screen preview area;
[0182] Receives a lens setting operation input based on the lens editing sub-region, and uses the image displayed in the image preview area as the broadcast image of multimedia data under the lens set based on the lens setting operation.
[0183] Computer program code for performing the operations of this disclosure can be written in one or more programming languages or a combination thereof, including but not limited to object-oriented programming languages such as Java, Smalltalk, and C++, as well as conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0184] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.
[0185] The units described in the embodiments of this disclosure can be implemented in software or in hardware. The name of a unit does not necessarily limit the unit itself; for example, the first acquisition unit can also be described as "a unit that acquires at least two Internet Protocol addresses".
[0186] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.
[0187] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
[0188] According to one or more embodiments of this disclosure, [Example 1] provides a method for editing multimedia data, including:
[0189] In response to an edit trigger operation, a multimedia data editing interface is displayed, wherein the multimedia data editing interface displays a screen preview area and a multimedia data editing area, the multimedia data editing area includes a screen editing sub-area and a camera editing sub-area, and the screen editing sub-area displays scene configuration items;
[0190] The system receives a scene addition operation based on the scene configuration items, displays the added 3D virtual scene in the screen preview area, and displays the main configuration items corresponding to the virtual scene in the screen editing sub-area.
[0191] Receive the main configuration operation for the main configuration item, and display the configured scene main screen and the virtual scene screen relative to each other in the screen preview area;
[0192] Receives a lens setting operation input based on the lens editing sub-region, and uses the image displayed in the image preview area as the broadcast image of multimedia data under the lens set based on the lens setting operation.
[0193] According to one or more embodiments of this disclosure, [Example 2] provides a method for editing multimedia data, further comprising: receiving a scene adjustment operation for a virtual scene displayed in the screen preview area; determining camera parameters of a virtual camera in the three-dimensional virtual scene based on the scene adjustment operation; and displaying a virtual scene of the three-dimensional virtual scene under the camera parameters in the screen preview area.
[0194] According to one or more embodiments of this disclosure, [Example 3] provides a method for editing multimedia data, which further includes: receiving a scene image saving operation for the virtual scene image displayed in the image preview area, generating a lens configuration item based on camera parameters corresponding to the virtual scene image, and displaying the lens configuration item in a lens editing sub-area.
[0195] According to one or more embodiments of this disclosure, [Example 4] provides a method for editing multimedia data, further comprising: receiving a display adjustment operation for at least one lens configuration item, adjusting the display mode of the at least one lens configuration item in the lens configuration sub-region, wherein the display adjustment operation includes a display position adjustment operation and / or a display quantity adjustment operation.
[0196] According to one or more embodiments of this disclosure, [Example 5] provides a method for editing multimedia data, including: the main configuration item includes a cutout material configuration item;
[0197] The step of receiving the main configuration operation for the main configuration item and displaying the configured scene main screen relative to the virtual scene screen in the screen preview area includes:
[0198] The system receives a cutout material configuration operation for the cutout material configuration item, performs cutout processing on the configured cutout material to obtain the main scene image, and displays the main scene image and the virtual scene image relative to each other in the image preview area.
[0199] According to one or more embodiments of this disclosure, [Example Six] provides a method for editing multimedia data, including: the main configuration item includes a scene material configuration item;
[0200] The step of receiving the main configuration operation for the main configuration item and displaying the configured scene main screen relative to the virtual scene screen in the screen preview area includes:
[0201] Receive scene material configuration operation for scene material configuration items, use the configured scene material screen as the main scene screen, and display the main scene screen and the virtual scene screen relative to each other in the screen preview area.
[0202] According to one or more embodiments of this disclosure, [Example Seven] provides a method for editing multimedia data, including: the main configuration item includes a virtual screen configuration item;
[0203] The step of receiving the main configuration operation for the main configuration item and displaying the configured scene main screen relative to the virtual scene screen in the screen preview area includes:
[0204] If the virtual scene displayed in the preview area includes a virtual screen, a virtual screen configuration operation is received for the virtual screen configuration item, the configured screen display material is used as the main scene image, and the main scene image is displayed in the virtual screen.
[0205] According to one or more embodiments of this disclosure, [Example Eight] provides a method for editing multimedia data, which, after displaying the configured main scene image relative to the virtual scene image in the image preview area, further includes:
[0206] The system receives an image adjustment operation for the main image of the scene and adjusts the main image of the scene. The image adjustment operation includes at least one of the following: image size adjustment, image color adjustment, image brightness adjustment, image sharpening parameter adjustment, image contrast adjustment, image display direction adjustment, and image position adjustment.
[0207] According to one or more embodiments of this disclosure, [Example Nine] provides a method for editing multimedia data, further comprising:
[0208] Receive an input operation to add a reference object of a preset size for the virtual scene screen, and display the added reference object in the virtual scene screen;
[0209] The system receives a position adjustment operation for the reference object and adjusts the display position of the reference object in the virtual scene.
[0210] According to one or more embodiments of this disclosure, [Example 10] provides a method for editing multimedia data, which, after receiving an operation to add a reference object of a preset size for the virtual scene screen, further includes: displaying a coordinate configuration item corresponding to the reference object;
[0211] The receiving of the position adjustment operation for the reference object, adjusting the display position of the reference object in the virtual scene image, includes:
[0212] Receive a drag operation applied to the reference object, adjust the reference object to the drag position in the virtual scene, and update the coordinate information in the coordinate configuration item based on the coordinate information of the drag position; and / or,
[0213] The system receives a coordinate configuration operation for the coordinate configuration item and adjusts the reference object to the position in the virtual scene that corresponds to the configured coordinate information for display.
[0214] According to one or more embodiments of this disclosure, [Example 11] provides a method for editing multimedia data, wherein the lens setting operation includes a lens binding operation, the lens binding operation being used to bind virtual scene images and / or scene main images to the operated lens;
[0215] The step of receiving a lens setting operation input based on the lens editing sub-region and using the image displayed in the image preview area as the broadcast image of multimedia data under the lens set based on the lens setting operation includes: receiving a lens binding operation input based on the lens editing sub-region and using the image displayed in the image preview area as the broadcast image of multimedia data under the lens bound based on the lens binding operation.
[0216] According to one or more embodiments of this disclosure, [Example Twelve] provides a multimedia data editing apparatus, including:
[0217] The editing interface display module is used to display the multimedia data editing interface in response to the editing trigger operation. The multimedia data editing interface displays a screen preview area and a multimedia data editing area. The multimedia data editing area includes a screen editing sub-area and a camera editing sub-area. The screen editing sub-area displays scene configuration items.
[0218] The virtual scene adding module is used to receive a scene adding operation based on the scene configuration items, display the added 3D virtual scene in the screen preview area, and display the main configuration items corresponding to the virtual scene in the screen editing sub-area.
[0219] The scene main body configuration module is used to receive the main body configuration operation for the main body configuration item, and display the configured scene main body screen relative to the virtual scene screen in the screen preview area;
[0220] The broadcast display module is used to receive lens setting operations input based on the lens editing sub-area, and to use the image displayed in the image preview area as the broadcast image of multimedia data under the bound lens.
[0221] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.
[0222] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.
[0223] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.
Claims
1. A method for editing multimedia data, characterized in that, include: In response to an edit trigger operation, a multimedia data editing interface is displayed, wherein the multimedia data editing interface displays a screen preview area and a multimedia data editing area, the multimedia data editing area includes a screen editing sub-area and a camera editing sub-area, and the screen editing sub-area displays scene configuration items; The system receives a scene addition operation based on the scene configuration items, displays the added 3D virtual scene in the screen preview area, and displays the main configuration items corresponding to the virtual scene in the screen editing sub-area. The 3D virtual scene is a 3D scene constructed based on computer vision technology, and the virtual scene image is rendered based on the 3D virtual scene. Receive the main configuration operation for the main configuration item, and display the configured scene main screen and the virtual scene screen relative to each other in the screen preview area; The system receives a lens setting operation input based on the lens editing sub-region, and uses the image displayed in the image preview area as the broadcast image of multimedia data under the lens set based on the lens setting operation. The lens setting operation is used to generate or select a lens configuration item, and the lens configuration item corresponds to a set of camera parameters of the virtual camera in the three-dimensional virtual scene.
2. The multimedia data editing method according to claim 1, characterized in that, Also includes: Receive scene adjustment operations for the virtual scene displayed in the preview area; The camera parameters of the virtual camera in the three-dimensional virtual scene are determined based on the scene image adjustment operation. The preview area displays the 3D virtual scene under the camera parameters.
3. The multimedia data editing method according to claim 2, characterized in that, Also includes: The system receives a scene save operation for the virtual scene displayed in the preview area, generates a lens configuration item based on the camera parameters corresponding to the virtual scene, and displays the lens configuration item in the lens editing sub-area.
4. The multimedia data editing method according to claim 1, characterized in that, Also includes: The system receives a display adjustment operation for at least one lens configuration item, and adjusts the display method of the at least one lens configuration item in the lens configuration sub-area, wherein the display adjustment operation includes a display position adjustment operation and / or a display quantity adjustment operation.
5. The multimedia data editing method according to claim 1, characterized in that, The main configuration items include the image cutout material configuration items; The step of receiving the main configuration operation for the main configuration item and displaying the configured scene main screen relative to the virtual scene screen in the screen preview area includes: The system receives a cutout material configuration operation for the cutout material configuration item, performs cutout processing on the configured cutout material to obtain the main scene image, and displays the main scene image and the virtual scene image relative to each other in the image preview area.
6. The multimedia data editing method according to claim 1, characterized in that, The main configuration items include scene material configuration items; The step of receiving the main configuration operation for the main configuration item and displaying the configured scene main screen relative to the virtual scene screen in the screen preview area includes: Receive scene material configuration operation for scene material configuration items, use the configured scene material screen as the main scene screen, and display the main scene screen and the virtual scene screen relative to each other in the screen preview area.
7. The multimedia data editing method according to claim 1, characterized in that, The main configuration items include virtual screen configuration items; The step of receiving the main configuration operation for the main configuration item and displaying the configured scene main screen relative to the virtual scene screen in the screen preview area includes: If the virtual scene displayed in the preview area includes a virtual screen, a virtual screen configuration operation is received for the virtual screen configuration item, the configured screen display material is used as the main scene image, and the main scene image is displayed in the virtual screen.
8. The multimedia data editing method according to claim 1, characterized in that, After displaying the configured main scene image relative to the virtual scene image in the preview area, the method further includes: The system receives an image adjustment operation for the main image of the scene and adjusts the main image of the scene. The image adjustment operation includes at least one of the following: image size adjustment, image color adjustment, image brightness adjustment, image sharpening parameter adjustment, image contrast adjustment, image display direction adjustment, and image position adjustment.
9. The multimedia data editing method according to claim 8, characterized in that, Also includes: Receive an input operation to add a reference object of a preset size for the virtual scene screen, and display the added reference object in the virtual scene screen; The system receives a position adjustment operation for the reference object and adjusts the display position of the reference object in the virtual scene.
10. The method for editing multimedia data according to claim 9, characterized in that, After receiving the operation of adding a reference object of a preset size input for the virtual scene image, the method further includes: Display the coordinate configuration items corresponding to the reference object; The receiving of the position adjustment operation for the reference object, adjusting the display position of the reference object in the virtual scene image, includes: Receive a drag operation applied to the reference object, adjust the reference object to the drag position in the virtual scene, and update the coordinate information in the coordinate configuration item based on the coordinate information of the drag position; and / or, The system receives a coordinate configuration operation for the coordinate configuration item and adjusts the reference object to the position in the virtual scene that corresponds to the configured coordinate information for display.
11. The multimedia data editing method according to claim 1, characterized in that, The camera setting operation includes a camera binding operation, which is used to bind the virtual scene image and / or the main scene image to the camera being operated on. The step of receiving a lens setting operation based on the lens editing sub-region, and using the image displayed in the preview area as the broadcast image of multimedia data under the lens set based on the lens setting operation, includes: Receive a lens binding operation input based on the lens editing sub-region, and use the image displayed in the image preview area as multimedia data for broadcast under the lens bound based on the lens binding operation.
12. A multimedia data editing device, characterized in that, include: The editing interface display module is used to display the multimedia data editing interface in response to the editing trigger operation. The multimedia data editing interface displays a screen preview area and a multimedia data editing area. The multimedia data editing area includes a screen editing sub-area and a camera editing sub-area. The screen editing sub-area displays scene configuration items. The virtual scene adding module is used to receive a scene adding operation based on the scene configuration items input, display the added 3D virtual scene in the screen preview area, and display the main configuration items corresponding to the virtual scene in the screen editing sub-area. The 3D virtual scene is a 3D scene constructed based on computer vision technology, and the virtual scene image is rendered based on the 3D virtual scene. The scene main body configuration module is used to receive the main body configuration operation for the main body configuration item, and display the configured scene main body screen relative to the virtual scene screen in the screen preview area; The broadcast display module is used to receive the lens setting operation input based on the lens editing sub-area, and to use the image displayed in the image preview area as the broadcast image of multimedia data under the lens set based on the lens setting operation. The lens setting operation is used to generate or select a lens configuration item, and the lens configuration item corresponds to a set of camera parameters of the virtual camera in the three-dimensional virtual scene.
13. An electronic device, characterized in that, The electronic device includes: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the multimedia data editing method as described in any one of claims 1-11.
14. A storage medium containing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a computer processor, are used to perform the multimedia data editing method as described in any one of claims 1-11.
Citation Information
Patent Citations
Control method and device of virtual camera in virtual studio, implementation method of virtual studio, virtual studio system, computer readable storage medium and electronic equipment
CN111698390A
Image generation method and device for virtual studio, medium and electronic equipment
CN113436343A
Live broadcast picture display method and device, electronic equipment and storage medium
CN114584797A