Material generating method and apparatus, device, and storage medium

Abstract

According to embodiments of the present disclosure, provided are a material generating method and apparatus. The method comprises: in response to a preset operation received in a media editing interface, presenting a material generating interface, wherein the material generating interface comprises a canvas component; in response to a first interaction operation received via the canvas component, presenting, in the canvas component, graphical content corresponding to the first interaction operation; presenting, in a preview component of the media editing interface, a first material generated on the basis of the graphical content; and in response to a second interaction operation received via the material generating interface, adding a target material determined on the basis of the first material to the media editing interface. In this way, the embodiments of the present disclosure can effectively improve material generating efficiency.

Description

A method, apparatus, device, and storage medium for generating materials. Technical Field

[0001] The exemplary embodiments disclosed herein generally relate to the field of computers, and particularly to a method, apparatus, device, and computer-readable storage medium for generating material. Background Technology

[0002] With the development of internet technology, people's demand for image editing is gradually increasing, and the generation and editing of materials is an important part of image editing. Material generation technology can quickly generate diverse materials according to user needs, providing users with an intelligent material generation channel. Summary of the Invention

[0003] In a first aspect of this disclosure, a method for generating media content is provided. The method includes: in response to a preset operation received in a media editing interface, presenting a media generation interface, the media generation interface including a canvas component; in response to a first interactive operation received via the canvas component, presenting graphic content corresponding to the first interactive operation in the canvas component; presenting a first media content generated based on the graphic content in a preview component of the media editing interface; and in response to a second interactive operation received via the media generation interface, adding a target media content determined based on the first media content to the media editing interface.

[0004] In a second aspect of this disclosure, an apparatus for generating source material is provided. The apparatus includes: a first presentation module configured to present a source material generation interface in response to a preset operation received in a media editing interface, the source material generation interface including a canvas component; a second presentation module configured to present graphic content corresponding to a first interactive operation received via the canvas component in response to a first interactive operation received via the canvas component; a third presentation module configured to present first source material generated based on the graphic content in a preview component of the media editing interface; and an adding module configured to add target source material determined based on the first source material to the media editing interface in response to a second interactive operation received via the source material generation interface.

[0005] In a third aspect of this disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the device to perform the method of the first aspect.

[0006] In a fourth aspect of this disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program that can be executed by a processor to implement the method of the first aspect.

[0007] It should be understood that the content described in this content section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0008] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0009] Figure 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure may be implemented;

[0010] Figures 2A to 2E show example interfaces generated from materials according to some embodiments of the present disclosure;

[0011] Figure 3 shows a flowchart of an example process for generating materials according to some disclosed embodiments;

[0012] Figure 4 shows a schematic structural block diagram of an example apparatus for material generation according to some embodiments of the present disclosure; and

[0013] Figure 5 shows a block diagram of an electronic device capable of implementing several embodiments of the present disclosure. Detailed Implementation

[0014] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0015] It should be noted that the headings of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and embodiments of any type may be included under any section / subsection. Furthermore, embodiments described in any section / subsection may be combined in any way with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0016] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0017] The embodiments of this disclosure may involve user data, data acquisition, and / or use. All of these aspects comply with applicable laws, regulations, and relevant provisions. In the embodiments of this disclosure, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, in implementing the embodiments of this disclosure, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained in accordance with relevant laws and regulations through appropriate means. The specific methods of notification and / or authorization may vary depending on the actual situation and application scenario, and the scope of this disclosure is not limited in this respect.

[0018] In this specification and the embodiments, any processing of personal information will be carried out only under the premise of legality (such as obtaining the consent of the personal information subject, or being necessary for the performance of a contract), and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information other than that necessary for basic functions will not affect the user's use of basic functions.

[0019] As mentioned above, with the development of internet technology, people's demand for image editing is gradually increasing, and the generation and editing of materials is an important part of image editing. Material generation technology can quickly generate diverse materials according to user needs, providing users with a diverse and intelligent material generation channel.

[0020] Embodiments of this disclosure propose a media generation scheme. The scheme includes: responding to a preset operation received in a media editing interface, presenting a media generation interface, the media generation interface including a canvas component; responding to a first interactive operation received via the canvas component, presenting graphic content corresponding to the first interactive operation in the canvas component; presenting a first media generated based on the graphic content in a preview component of the media editing interface; and responding to a second interactive operation received via the media generation interface, adding a target media determined based on the first media to the media editing interface.

[0021] In this way, embodiments of this disclosure can generate target materials using graphic content corresponding to the first interactive operation, effectively reducing the steps required to generate target materials and thus significantly improving the efficiency of material generation. Furthermore, embodiments of this disclosure present a preview component within the canvas component, allowing users to view the generated materials more intuitively through the preview component, thereby enhancing the user's interactive experience.

[0022] The following section provides a detailed description of various example implementations of this scheme, with reference to the accompanying drawings.

[0023] Example Environment

[0024] Figure 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in Figure 1, the example environment 100 may include an electronic device 110.

[0025] In this example environment 100, electronic device 110 may run an application 120 that supports content generation. Application 120 may be any suitable type of application for content generation, and examples may include, but are not limited to, social applications, content sharing applications, image editing applications, or other suitable applications. User 140 may interact with application 120 via electronic device 110 and / or its attached devices.

[0026] In environment 100 of Figure 1, if application 120 is active, electronic device 110 can use application 120 to present interface 150 for supporting material generation.

[0027] In some embodiments, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, VR / AR devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).

[0028] Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for the application 120 in electronic device 110 that supports material generation.

[0029] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection may include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections; the embodiments of this disclosure are not limited in this respect. In the embodiments of this disclosure, server 130 and electronic device 110 can achieve signaling interaction through the communication connection between them.

[0030] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0031] The following description will continue with reference to the accompanying drawings, which will provide some exemplary embodiments of this disclosure.

[0032] Example Interaction

[0033] Figures 2A to 2E illustrate example interfaces 200A to 200E according to some embodiments of the present disclosure. Interfaces 200A to 200E may be provided, for example, by the electronic device 110 shown in Figure 1.

[0034] In some embodiments, upon receiving a media editing request, the electronic device 110 may present a media editing interface. Such a media editing request may be a selection by the user 140 of editing controls associated with target media content, such as image content or video content. The media editing interface includes a media selection panel.

[0035] As an example, as shown in Figure 2A, when the electronic device 110 receives a media editing request, it can display an interface 200A, which may be a media editing interface. Interface 200A includes a media editing panel 210, which contains the media content to be edited. The media content to be edited 210 may be, for example, a photo or video uploaded by the user 140. In some scenarios, the electronic device 110 can also receive a user's shooting request to perform a shooting task. After the shooting task is completed, the electronic device 110 can display the captured photo in the media editing panel 210, using the photo as the media content to be edited 210.

[0036] After the electronic device 110 presents interface 200A, it can also provide a media selection panel 215 within interface 200A. The media selection panel 215 includes multiple media, which can be preset media or media previously generated by the electronic device 110. The electronic device 110 can also present multiple selection controls in the media selection panel 215, each associated with a different type of media. Media types can include, for example, "popular," animal, or food types. Here, "popular" indicates that the media under this type are a group of media whose content has been used more than a threshold number of times within a preset time period. In this way, the electronic device 110 can provide the user 140 with diverse interactive elements, thereby enriching the interactive effects of media editing.

[0037] In some scenarios, the electronic device 110 can receive the user's selection of the target sticker via the material selection panel 215, so as to add the target sticker to the media content 210 to be edited.

[0038] In some embodiments, the electronic device 110, in response to a preset operation received in the media editing interface, presents a media generation interface, which includes a canvas component. As an example, as shown in FIG2A, the electronic device 110 can receive a preset operation from the user 140 via interface 200A. Such a preset operation could be, for example, a long press operation, a swipe operation, a selection operation of a preset control in interface 200A, or other appropriate operation by the user 140 on the media content 210. After receiving the preset operation via interface 200A, the electronic device 110 can present interface 200B as shown in FIG2B, which could be, for example, a media generation interface. Interface 200B can be used to receive user interaction operations to present media generated based on those interaction operations.

[0039] In some scenarios, the electronic device 110 can also display a canvas component 220 in the interface 200B. The electronic device 110 can receive user interaction operations through the canvas component 220, such interaction operations as drawing operations.

[0040] In some embodiments, the electronic device 110 may provide a media generation entry point in the media selection panel 215. The electronic device 110 may present a media generation interface in response to the media generation entry point being selected.

[0041] As an example, as shown in Figure 2A, the electronic device 110 can provide a material generation entry 225 in the material selection panel 215. When the material generation entry 225 is selected by the user 140, the electronic device 110 can present the material generation interface as shown in Figure 2B.

[0042] In some embodiments, the electronic device 110, in response to a first interactive operation received via the canvas component, presents graphic content corresponding to the first interactive operation in the canvas component. As an example, as shown in FIG2C, the electronic device 110 can acquire the user's first interactive operation via the canvas component 220, the first interactive operation being, for example, a drawing operation. Once the user's drawing operation is acquired, the electronic device 110 can present graphic content 230 corresponding to that drawing operation in the canvas component 220.

[0043] In some scenarios, the electronic device 110 can also provide a set of brush tools in the canvas component 220. When the electronic device 110 receives the user 140's selection of a target brush tool, it can provide the user 140 with the painting effect corresponding to the target brush tool.

[0044] In some embodiments, the electronic device 110 presents a first material generated based on the graphic content in a media editing preview component. As an example, as shown in FIG2C, after presenting the graphic content 230, the electronic device 110 can present a preview component 240 in the canvas component 220. The preview component 240 allows the user 140 to view the rendering effect of the material even when it is not yet determined. In some scenarios, the electronic device 110 can present the first material 245 in real time via the preview component 240 during the user 140's drawing process. The first material 245 is at least generated based on the graphic content 230. Embodiments of this disclosure can present the first material during the user 140's drawing process via the preview component 240, enabling the user 140 to view the rendering effect of the first material in a timely manner, thereby allowing the user to modify the graphic content 230 based on the rendering effect. In this way, embodiments of this disclosure can effectively improve the user 140's interactive experience and increase the efficiency of material generation.

[0045] In some scenarios, as shown in Figure 2D, the electronic device 110 can also receive additional interactive operations from the user 140. These additional interactive operations could be, for example, the user 140 continuing to draw or modifying the graphic content 230 (e.g., modifying the shape, color, size, etc. of the graphic content 230). Furthermore, the electronic device 110 can present the graphic content 235 in the canvas component 220 and present the adjusted first material 250 in the preview component 240.

[0046] In some embodiments, the electronic device 110 can acquire second input information. As an example, as shown in FIG2D, the electronic device 110 can acquire the second input information of the user 140 via the canvas component 220. Such second input information can, for example, be used with the graphic content 235 to generate the first material 250.

[0047] In some embodiments, the electronic device 110 can obtain the second descriptive text via a second input control in the canvas component. As an example, as shown in FIG2D, the electronic device 110 can present a second input control 255 in the canvas component 220. The second input control 255 is used to receive user input. When the user 140 performs an input operation on the second input control 255, the electronic device 110 can obtain the second descriptive text corresponding to the input operation via the second input control 255. In this way, the electronic device 110 can provide the user 140 with the first material 250 based on the descriptive information input by the user 140, thereby enriching the generated material style and improving the effect of material generation.

[0048] In some embodiments, electronic device 110 may receive a selection of at least one second candidate option from a second set of candidate options presented in a canvas component. As an example, as shown in FIG2D, electronic device 110 may present a second set of candidate options 260 in canvas component 220. Electronic device 110 may receive the user's selection of the second candidate options via the second set of candidate options 260 to generate first material 250 using the second candidate options and graphic content 235. The second set of candidate options 260 may be determined by a generative model based on the graphic content 235. For example, if the graphic content 235 is a circle, then the second set of candidate options 260 may be "Earth," "football," "cricket," "3D," "2D," etc. The generative model may be a machine learning method for generating graphs with specific graph structures. By learning graph structure features such as node connection patterns, degree distributions, and clustering coefficients in real graph data, it can construct random graphs similar to real graph data. The generative model may be, for example, any suitable generative model such as a generative adversarial network model, a variational autoencoder, or a diffusion model.

[0049] In some embodiments, after the electronic device 110 receives the second input information, it can present a first material determined based on the second input information and the graphic content in the preview component. As an example, as shown in FIG2D, after receiving the second input information, the electronic device 110 can present the first material 250 in the preview component 240. The first material 250 can be generated by a generative model based on the graphic content 235 and the second input information. The graphic content 235 can be, for example, a "smiley face" graphic, and the second input information can be, for example, a "bar".

[0050] In some embodiments, after the first material is presented, the electronic device 110 can also obtain adjustment information (e.g., first input information) from the user 140 regarding the first material via a preview component, so as to present the target material in the preview component. The target material here can be generated by a generation model based on the first input information and the first material. Specifically, the electronic device 110 can obtain the first input information. As an example, as shown in FIG2E, the electronic device 110 can receive a selection operation from the user 140 regarding the preview component 240, and present the preview component 240 in the interface 200E at a preset ratio. Further, the electronic device 110 can obtain the first input information via the preview component 240, such first input information, for example, can be used with the first material 250 to generate the target material.

[0051] In some embodiments, the electronic device 110 may obtain first descriptive text via a first input control in a preview component. Target material includes second material generated by a generative model based on the first descriptive text and the first material.

[0052] As an example, electronic device 110 may provide a first input control 265 in preview component 240. Electronic device 265 may use the first input control 265 to obtain first descriptive text in order to present second material in preview component 240. The second material here may, for example, be generated by a generative model based on the first descriptive text and the first material 250.

[0053] In other embodiments, the electronic device 110 may receive a selection of at least one first candidate from a first set of candidate options presented in the preview component. The target material includes third material generated by a generation model based on the first material and preset prompts corresponding to at least one first candidate.

[0054] As an example, as shown in Figure 2E, the electronic device 110 can also provide a first set of candidate options 270 in the preview component 240. The electronic device 110 can present the first set of candidate options 270 in the preview component 240. The electronic device 110 can receive the user's selection of the first candidate options via the first set of candidate options 270 to obtain first input information. Here, the first set of candidate options 270 can be determined by the generative model based on the first material 250.

[0055] Furthermore, after the first input information is acquired by the electronic device 110, the electronic device 110 can present the target material determined based on the first input information and the first material in the preview component. For example, after the first input information is acquired by the electronic device 110, the electronic device 110 can send the first input information and the first material 250 to the server 130 to generate the target material using the generative model in the server 130. After the target material is generated, the electronic device 110 can request the target material from the server 130 to present it in the preview component 240. In this way, the electronic device 110 can provide the target material to the user 140 based on the user 140's input information, thereby simplifying the material generation process and improving the efficiency of material generation.

[0056] In some embodiments, the electronic device 110 can receive editing operations on the first material via a preview component to determine the target material. As an example, the electronic device 110 can also receive editing operations on the first material from the user 140 via the preview component 240. Such editing operations could be, for example, adjusting the structure or color of the first material 250. For instance, changing the first material 250 from a circle to a square, or changing the first material 250 from blue to red. After receiving the editing operation from the user 140, the electronic device 110 can determine the target material based on that editing operation.

[0057] In some embodiments, the electronic device 110 may also present an indicator element in the preview component 240. As shown in FIG2E, the electronic device 110 may provide an indicator element 275 in the preview component 240 to indicate that the presentation effect of the material in the preview component 240 is allowed to be adjusted. Further, the electronic device 110 may receive adjustment operations from the user 140 on the target material through the preview component 240. Such adjustment operations may include, for example, adjusting the presentation angle of the target material, adjusting the relative position of the target material in the preview component, adjusting the perspective effect of the target material, etc. Perspective effect refers to the method and visual effect of reproducing the spatial sense and three-dimensionality of an object on the screen.

[0058] In some embodiments, in response to a second interactive operation received via the media generation interface, the electronic device 110 adds a target media determined based on the first media to the media editing interface. As an example, as shown in FIG2D, the electronic device 110 may provide a selection control 280 in the canvas component. The electronic device 110 may receive the second interactive operation from the user 140 via the selection control 280, the second interactive operation being, for example, a selection operation by the user 140 on the selection control 280. When the second interactive operation is selected, the electronic device 110 may add the target media to the interface 200A (i.e., the media editing interface), where the target media may be the first media or other media generated from the first media.

[0059] In some scenarios, after receiving a second interactive operation, the electronic device 110 can present an additional component associated with the target material. This additional component may include, for example, a publishing control. The second interactive operation here could be, for example, a long press on the target material. After presenting the additional component, the electronic device 110 can obtain the user's publishing selection via the additional component and, in response to the selection of the additional control, add the target material to the media editing interface.

[0060] In this way, embodiments of this disclosure can generate corresponding materials from graphic content, thereby reducing the interactive operations required to generate materials and improving the efficiency of material generation.

[0061] In some embodiments, the electronic device 110 can add target footage to the media editing panel 210 or the footage selection panel 215. Specifically, the electronic device 110 can add target footage to the media editing panel and / or the footage selection panel in response to a second interactive operation received via the footage generation interface.

[0062] As an example, after presenting the aforementioned add-on component, the electronic device 110 can display a favorites control within that add-on component. The electronic device 110 can receive a second interaction operation from the user 140 (the second interaction operation here could be, for example, selecting the favorites control) to add the target material to the material selection panel 215.

[0063] As another example, electronic device 110 can receive a second interactive operation from user 140 via a selection control 280. Such a second interactive operation could be, for example, selecting the selection control 280. After the selection control 280 is selected, electronic device 110 can add the target material to media editing panel 210.

[0064] In this way, embodiments of this disclosure can generate target materials using graphic content corresponding to the first interactive operation, which greatly reduces the steps required to generate target materials, thereby effectively improving the efficiency of material generation. Furthermore, embodiments of this disclosure present a preview component within the canvas component, allowing users to view the generated materials more intuitively through the preview component, thus enhancing the user's interactive experience.

[0065] Example process

[0066] Figure 4 shows a flowchart of an example process 300 for generating material according to some embodiments of the present disclosure. Process 300 can be implemented at electronic device 110. Process 300 will now be described with reference to Figure 1.

[0067] As shown in Figure 3, in box 310, electronic device 110 responds to a preset operation received in the media editing interface and presents a material generation interface, which includes a canvas component.

[0068] In frame 320, electronic device 110 responds to a first interactive operation received via canvas component and presents graphic content corresponding to the first interactive operation in canvas component.

[0069] In frame 330, electronic device 110 presents the first material generated based on the graphic content in the preview component of the media editing interface.

[0070] In frame 340, electronic device 110 responds to a second interactive operation received via the material generation interface by adding target material determined based on the first material to the media editing interface.

[0071] In some embodiments, process 300 further includes: acquiring first input information; and presenting target material determined based on the first input information and the first material in a preview component.

[0072] In some embodiments, obtaining the first input information via the preview component includes obtaining a first descriptive text via a first input control in the preview component, wherein the target material includes a second material generated by a generation model based on the first descriptive text and the first material.

[0073] In some embodiments, obtaining first input information via the preview component includes receiving a selection of at least one first candidate from a first set of candidate options presented in the preview component, wherein the target material includes a third material generated by a generation model based on the first material and preset prompts corresponding to the at least one first candidate.

[0074] In some embodiments, presenting a first material generated based on the graphic content in the preview component of the media editing interface includes: acquiring second input information; and presenting the first material determined based on the second input information and the graphic content in the preview component.

[0075] In some embodiments, obtaining the second input information via the canvas component includes obtaining second descriptive text via a second input control in the canvas component.

[0076] In some embodiments, obtaining the second input information via the canvas component includes receiving a selection of at least one second candidate from a second set of candidates presented in the canvas component.

[0077] In some embodiments, process 300 further includes: receiving an editing operation on the first material via the preview component to determine the target material.

[0078] In some embodiments, the media editing interface includes a media editing panel and a material selection panel. The material selection panel includes a material generation entry point. In response to a preset operation received in the media editing interface, presenting the material generation interface includes: presenting the material generation interface in response to the material generation entry point being selected.

[0079] In some embodiments, adding the target material determined by the first material to the media editing interface includes: in response to the second interactive operation received via the material generation interface, adding the target material to the media editing panel and / or the material selection panel in the media editing interface.

[0080] Example devices and equipment

[0081] Embodiments of this disclosure also provide corresponding apparatus for implementing the methods or processes described above. Figure 4 shows a schematic structural block diagram of an example apparatus 400 for material generation according to certain embodiments of this disclosure. Apparatus 400 may be implemented as or included in electronic device 110. The various modules / components in apparatus 400 may be implemented by hardware, software, firmware, or any combination thereof.

[0082] As shown in Figure 4, the device 400 includes: a first presentation module 410 configured to present a material generation interface in response to a preset operation received in the media editing interface, the material generation interface including a canvas component; a second presentation module 420 configured to present graphic content corresponding to the first interactive operation received via the canvas component in response to a first interactive operation received via the canvas component; a third presentation module 430 configured to present a first material generated based on the graphic content in a preview component of the media editing interface; and an adding module 440 configured to add target material determined based on the first material to the media editing interface in response to a second interactive operation received via the material generation interface.

[0083] In some embodiments, the device 400 further includes a first acquisition module configured to acquire first input information and present the target material determined based on the first input information and the first material in the preview component.

[0084] In some embodiments, the first acquisition module is further configured to: acquire a first descriptive text via a first input control in the preview component, wherein the target material includes a second material generated by a generation model based on the first descriptive text and the first material.

[0085] In some embodiments, the acquisition module is further configured to: receive a selection of at least one first candidate from a first set of candidate options presented in the preview component, wherein the target material includes a third material generated by a generation model based on the first material and a preset prompt word corresponding to the at least one first candidate.

[0086] In some embodiments, the third presentation module 430 is further configured to: acquire second input information; and present the first material determined based on the second input information and the graphic content in the preview component.

[0087] In some embodiments, the third presentation module 430 is further configured to: obtain second descriptive text via a second input control in the canvas component.

[0088] In some embodiments, the third presentation module 430 is further configured to receive a selection of at least one second candidate from a second set of candidates presented in the canvas component.

[0089] In some embodiments, the device 400 further includes a receiving module configured to receive editing operations on the first material via the preview component to determine the target material.

[0090] In some embodiments, the media editing interface includes a media editing panel and a media selection panel, wherein the media selection panel includes a media generation entry point. The first presentation module is further configured to present the media generation interface in response to the selection of the media generation entry point.

[0091] In some embodiments, the adding module is further configured to: in response to the second interactive operation received via the material generation interface, add the target material to the media editing panel and / or the material selection panel in the media editing interface.

[0092] As shown in Figure 5, the electronic device 500 is in the form of a general-purpose electronic device. Components of the electronic device 500 may include, but are not limited to, one or more processors or processing units 510, memory 520, storage devices 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. The processing unit 510 may be a physical or virtual processor and is capable of performing various processes according to programs stored in the memory 520. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of the electronic device 500.

[0093] Electronic device 500 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 500.

[0094] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks may be provided. In these cases, each drive may be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0095] Communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of components of electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0096] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).

[0097] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0098] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0099] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0100] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0101] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0102] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for generating source materials, comprising: In response to a preset operation received in the media editing interface, a material generation interface is presented, which includes a canvas component; In response to a first interactive operation received via the canvas component, graphical content corresponding to the first interactive operation is presented in the canvas component; In the preview component of the media editing interface, the first material generated based on the graphic content is presented; as well as In response to a second interactive operation received via the material generation interface, the target material determined based on the first material is added to the media editing interface.

2. The method according to claim 1, further comprising: Obtain the first input information; as well as The target material, determined based on the first input information and the first material, is presented in the preview component.

3. The method according to claim 2, wherein obtaining the first input information via the preview component includes: A first descriptive text is obtained via a first input control in the preview component, wherein the target material includes a second material generated by a generation model based on the first descriptive text and the first material.

4. The method of claim 2, wherein obtaining the first input information via the preview component includes: The selection of at least one first candidate from a first set of candidate options presented in the preview component is received, wherein the target material includes a third material generated by a generation model based on the first material and a preset prompt word corresponding to the at least one first candidate.

5. The method according to claim 1, wherein presenting the first material generated based on the graphic content in the preview component of the media editing interface includes: Obtain the second input information; as well as The first material, determined based on the second input information and the graphic content, is presented in the preview component.

6. The method of claim 5, wherein obtaining the second input information via the canvas component comprises: The second descriptive text is obtained via the second input control in the canvas component.

7. The method of claim 5, wherein obtaining the second input information via the canvas component comprises: Receive selection of at least one second candidate from the second set of candidates presented in the canvas component.

8. The method according to claim 1, further comprising: The target material is determined by receiving editing operations on the first material via the preview component.

9. The method according to claim 1, wherein the media editing interface includes a media editing panel and a material selection panel, the material selection panel including a material generation entry point, and in response to a preset operation received in the media editing interface, presenting a material generation interface includes: In response to the selection of the material generation entry point, the material generation interface is displayed.

10. The method according to claim 9, wherein adding the target material determined by the first material to the media editing interface comprises: In response to the second interactive operation received via the media generation interface, the target media is added to the media editing panel and / or the media selection panel in the media editing interface.

11. An apparatus for generating materials, comprising: The first presentation module is configured to present a material generation interface in response to a preset operation received in the media editing interface, the material generation interface including a canvas component; The second presentation module is configured to, in response to a first interactive operation received via the canvas component, present graphic content in the canvas component corresponding to the first interactive operation; The third presentation module is configured to present the first material generated based on the graphic content in the preview component of the media editing interface; as well as The add module is configured to add target material determined based on the first material to the media editing interface in response to a second interactive operation received via the material generation interface.

12. An electronic device, comprising: At least one processing unit; as well as At least one memory, coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 10 when executed by the at least one processing unit.

13. A computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to implement the method according to any one of claims 1 to 10.

Images