Method and apparatus for generating media content, device, and storage medium

Abstract

Embodiments of the present disclosure relate to a method and apparatus for generating media content, a device, and a storage medium. The method provided herein comprises: presenting first media content in a first area of an interface, and presenting second media content in a second area of the interface; in response to receiving a preset operation, updating at least part of an area of a second background image of the second media content on the basis of a first background image of the first media content; and generating target media content on the basis of the first media content and the updated second media content.

Description

Methods, apparatus, devices and storage media for generating media content

[0001] This application claims priority to Chinese Patent Application No. 202510131490.7, filed on February 5, 2025, entitled "Method, Apparatus, Device and Storage Medium for Generating Media Content", the entire contents of which are incorporated herein by reference. Technical Field

[0002] The exemplary embodiments disclosed herein relate generally to the field of computers, and more particularly to methods, apparatus, devices, and computer-readable storage media for generating media content. Background Technology

[0003] With the development of social networking, photography, and special effects software, a variety of entertaining and fun applications have emerged, allowing users to perform background removal and other processing on photos or video clips to simulate the effect of multiple people shooting together. Summary of the Invention

[0004] In a first aspect of this disclosure, a method for generating media content is provided. The method includes: presenting first media content in a first area of ​​an interface and presenting second media content in a second area of ​​the interface; in response to receiving a preset operation, updating at least a portion of a second background image of the second media content based on a first background image of the first media content; and generating target media content based on the first media content and the updated second media content.

[0005] In a second aspect of this disclosure, an apparatus for generating media content is provided. The apparatus includes: a first presentation module configured to present first media content in a first area of ​​an interface and second media content in a second area of ​​the interface; a first update module configured to, in response to receiving a preset operation, update at least a portion of a second background image of the second media content based on a first background image of the first media content; and a generation module configured to generate target media content based on the first media content and the updated second media content.

[0006] In a third aspect of this disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.

[0007] In a fourth aspect of this disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores computer-executable instructions that can be executed by a processor to implement the method of the first aspect.

[0008] In a fifth aspect of this disclosure, a computer program product is provided. The computer program product is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.

[0009] It should be understood that the content described in this content section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0010] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0011] Figure 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure may be implemented;

[0012] Figures 2A to 2I illustrate example interfaces according to some embodiments of the present disclosure;

[0013] Figure 3 illustrates a flowchart of an example process for generating media content according to some embodiments of the present disclosure;

[0014] Figure 4 shows a schematic structural block diagram of an example apparatus for generating media content according to some embodiments of the present disclosure; and

[0015] Figure 5 shows a block diagram of an electronic device capable of implementing several embodiments of the present disclosure. Detailed Implementation

[0016] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0017] It should be noted that the headings of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and embodiments of any type may be included under any section / subsection. Furthermore, embodiments described in any section / subsection may be combined in any way with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0018] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0019] The embodiments of this disclosure may involve user data, data acquisition, and / or use. All of these aspects comply with applicable laws, regulations, and relevant provisions. In the embodiments of this disclosure, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, in implementing the embodiments of this disclosure, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained in accordance with relevant laws and regulations through appropriate means. The specific methods of notification and / or authorization may vary depending on the actual situation and application scenario, and the scope of this disclosure is not limited in this respect.

[0020] In this specification and the embodiments, any processing of personal information will be carried out only under the premise of legality (such as obtaining the consent of the personal information subject, or being necessary for the performance of a contract), and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information other than that necessary for basic functions will not affect the user's use of basic functions.

[0021] In the description of embodiments of this disclosure, the term "co-production" and similar terms should be understood as the merging of images from at least two media contents to form new media content. In a media content creation scenario, a second user can generate co-production media content based on the first media content published or sent by the first user. The generated co-production media content includes at least a portion of the first media content and content filmed or uploaded by the second user.

[0022] As mentioned above, users can perform techniques such as background removal on photos or video clips to simulate the effect of a group photo. Taking the combination of people from two photos into one as an example, traditionally, users need to manually cut out the people from one photo using background removal and overlay them onto the other photo. This process is cumbersome and the quality of the resulting group photo cannot be guaranteed.

[0023] Embodiments of this disclosure propose a scheme for generating media content. According to the scheme, first media content can be presented in a first area of ​​the interface, and second media content can be presented in a second area of ​​the interface; further, in response to receiving a preset operation, at least a portion of the second background image of the second media content can be updated based on the first background image of the first media content; additionally, target media content can be generated based on the first media content and the updated second media content.

[0024] Based on this approach, embodiments of this disclosure can quickly update at least a portion of the second background image of the second media content based on the first background image of the first media content. This allows for convenient and higher-quality background fusion without requiring users to perform tedious image cutout methods, thereby improving the efficiency of generating target media content based on the first media content and the updated second media content.

[0025] Therefore, the embodiments of this disclosure can generate target media content for background fusion of first media content and second media content more efficiently, and improve the quality of background fusion while improving the efficiency of interface interaction.

[0026] The following section provides a detailed description of various example implementations of this scheme, with reference to the accompanying drawings.

[0027] Example Environment

[0028] Figure 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in Figure 1, the example environment 100 may include an electronic device 110.

[0029] In this example environment 100, electronic device 110 may run an application 120 that supports the generation of media content. Application 120 may be any suitable type of application for generating media content, examples of which may include, but are not limited to, instant messaging applications, media content editing applications, video applications, social applications, or other suitable applications. User 140 may interact with application 120 via electronic device 110 and / or its attached devices.

[0030] In environment 100 of Figure 1, if application 120 is active, electronic device 110 can use application 120 to present interface 150 for supporting interface interaction.

[0031] In some embodiments, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, VR / AR devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).

[0032] Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for applications 120 that support content presentation in electronic devices 110.

[0033] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection may include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections; the embodiments of this disclosure are not limited in this respect. In the embodiments of this disclosure, server 130 and electronic device 110 can achieve signaling interaction through the communication connection between them.

[0034] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0035] The following description will continue with reference to the accompanying drawings, which will provide some exemplary embodiments of this disclosure.

[0036] Example Interaction

[0037] The following description refers to Figures 2A to 2I to illustrate some example interaction processes according to embodiments of the present disclosure. Figures 2A to 2I show example interfaces 200A to 200I according to some embodiments of the present disclosure, which may be provided, for example, by the electronic device 110 shown in Figure 1.

[0038] In some embodiments, the electronic device 110 may present an interface 200A as shown in FIG2A. As an example, such an interface 200A may be an interface for generating media content, such as a co-production interface or an editing interface for co-production content. Taking the interface 200A as a co-production interface as an example, such an interface 200A may include a media content preview area 211, which can preview at least two media contents to be co-produced. Such media content may include videos or images, etc. For example, the media content preview area 211 may include areas 212 and 213. The electronic device 110 may present media content 214 (e.g., images, videos, etc.) in area 212 and media content 215 (e.g., images, videos, etc.) in area 213. For ease of distinction, exemplarily, such area 212 may be a first area, and correspondingly, area 213 may be a second area; media content 214 may be first media content, and media content 215 may be second media content. Alternatively, such area 212 can be a second area, and correspondingly, area 213 can be a first area, media content 214 can be second media content, and media content 215 can be first media content. The following embodiments of this disclosure will be described exemplarily with area 213 corresponding to the viewfinder. It should be understood that such area 212 can also correspond to the viewfinder, and specific implementations can be found in the following embodiments of this disclosure.

[0039] In some embodiments, such an interface 200A may be presented at the request of a user 221. For example, the user 221 may trigger the generation of an interactive request associated with first media content and / or second media content, and the electronic device 110, in response to receiving such an interactive request, presents such an interface 200A.

[0040] As examples, such an interface 200A can be provided by application 120. Such application 120 can be, for example, an instant messaging application, and can present interface 200B as shown in Figure 2B. Interface 200B can be the interface for a conversation between user 221 (also referred to as user 1) and user 222 (also referred to as user 2). Furthermore, such interface 200B can provide a message 223 sent by user 222, which user 221 or user 222 can trigger the generation of target media content (e.g., co-production media content) based on the media content associated with such message 223. As an example, taking user 221 triggering a corresponding operation, user 221 can trigger the control 224 associated with the message 223 sent by user 222 to trigger the presentation of interface 200A.

[0041] As examples, user 221 can also trigger message 223 in interface 200B, thereby triggering electronic device 110 to display interface 200C as shown in FIG. 2C. Electronic device 110 can display preview content 231 of the media content associated with message 223 in such interface 200C, and further provide controls 232 for triggering the generation of target media content. Thus, user 221 can trigger the generation of media content based on such media content 231 by triggering control 232 in interface 200C. Further, electronic device 110 can display media content 214 corresponding to such message 223 in such interface 200A; for example, such media content 214 can be the media content associated with message 223.

[0042] As examples, such application 120 may also be a media content application. Such application 120 can provide a media content stream, and user 221 can trigger a synchronized video with a first published work within the media content stream provided by application 120. For example, a synchronized video with the first work can be triggered based on the display page of the first work in the media stream. Thus, electronic device 110 can present such a first work in area 212 of such interface 200A as such media content 214.

[0043] In some embodiments, such media content 214 can also be media content uploaded by user 221, such as uploaded images, uploaded videos, etc. Thus, electronic device 110 can use such media content uploaded by the user as media content 214 and present it in area 212 of such interface 200A.

[0044] Based on this, user 221 can trigger a synchronized recording with such media content 214. As an example, user 221 can provide such media content 215. For instance, such media content 215 could include a live image of user 221 captured by the viewfinder. Furthermore, such media content 215 could also be images, videos, etc., uploaded by user 221.

[0045] In some embodiments, the electronic device 110 can receive a user's preset operation in the interface 200A to update the background image of the media content 214 or the background image of the media content 215. As an example, such a preset operation may include a drag operation on the interactive control 216 in the interface 200A. For instance, the electronic device 110 may display interactive controls 216 associated with areas 212 and 213 in the interface 200A, and the user 221 may drag such interactive controls 216. Thus, the electronic device 110 can receive the user 221's drag operation on the interactive control 216 (e.g., dragging left or right), thereby updating the background image of the media content 214 or the background image of the media content 215.

[0046] Furthermore, the electronic device 110 can determine at least a partial area based on the position to which the user 221 drags the interactive control 216. For example, if the user 221 drags the interactive control 216 to half of the media content 214, the electronic device 110 can update the background image of half of the media content 214. As another example, if the user 221 drags the interactive control 216 to one-third of the media content 215, the electronic device 110 can update the background image of one-third of the media content 215.

[0047] In some embodiments, the electronic device 110 can determine the at least partial area based on at least one operational attribute of such a preset operation, thereby allowing the user 221 to more precisely control the extent of the at least partial area. For example, such at least one operational attribute could indicate a drag operation, a swipe operation, etc. For instance, if the user swipes the interactive control 216 to the left, the electronic device 110 can determine that the at least partial area is the entire area of ​​the background image of the media content 214. As another example, if the user drags the interactive control 216 to the left, the electronic device 110 can determine the proportion of the at least partial area relative to the background image of the media content 214 based on the position to which the interactive control 216 is dragged.

[0048] In some embodiments, the electronic device 110 may update at least a portion of the second background image during the execution of such a preset operation, thereby changing such a portion of the image as the preset operation is performed. For example, the electronic device 110 may update the affected background image in real time based on the user 221's drag operation on the interactive control 216. Thus, during the user's dragging of the interactive control 216, the electronic device 110 synchronously updates such a portion of the image based on the position to which the user drags the interactive control 216.

[0049] The following example illustrates how a user 221 drags the interactive control 216 to any position of the media content 215 (e.g., the rightmost position of the media content preview area 211) or any position of the media content 214 (e.g., the leftmost position of the media content preview area 211).

[0050] In some embodiments, according to the interface 200D shown in FIG. 2D, if the user 221 drags the interactive control 216 to the right, the electronic device 110 can update at least a portion of the background image (also referred to as the second background image) of the media content 215 based on the background image (also referred to as the first background image) of the media content 214. Further, according to the interface 200E shown in FIG. 2E, the electronic device 110 can present media content 241, which may include the media content 214 and the updated media content 215. As an example, according to the media content 241, the updated image corresponding to at least a portion of the updated media content 215 and the background image of the media content 214 have continuous screen content.

[0051] In some embodiments, the updated image corresponding to at least a portion of such updated media content 214 can be generated from the background image of media content 215. As an example, electronic device 110 can utilize image expansion tools to expand the background image or media content 215 to obtain such an updated image. For example, electronic device 110 can utilize a model to expand the background image or media content 215 to generate such an updated image. As an example, the model can include any suitable generative model, which can, for example, implement image content expansion based on a received image. Such a model can be deployed on electronic device 110 or on a third-party electronic device and can be invoked by electronic device 110 to implement such image content expansion.

[0052] In some embodiments, user 221 can intervene in the generation process of such an updated image. For example, user 221 can input at least one parameter in such an interface 200A and trigger the determination of such an updated image based on such at least one parameter. As an example, such at least one parameter may indicate information including but not limited to background style, background pattern, background color, etc. As an example, such at least one parameter can be input by user 221 inputting text, or by user 221 triggering some controls (such as text input controls, sticker addition controls, special effects controls, etc.). Thus, such an updated image can better meet the user's expectations.

[0053] As an example, at least one parameter may include a prompt word input by user 221, which is provided to the generative model to control the generation of the background image.

[0054] In some embodiments, the electronic device 110 may also generate multiple candidate images for the user 221 to choose from, thereby providing a higher quality updated image. Specifically, the electronic device 110 may generate a set of candidate images based on the background image of such media content 215. Then, the user 211 may select a first image from such a set of candidate images and trigger the determination of such a first image as the updated image.

[0055] In some embodiments, when the electronic device 110 presents such media content 241 to the user 221, the user 221 can also trigger a second operation to replace at least a portion of such content with a second image, thereby further improving the quality of the media content 241. For example, such a second operation could instruct the regeneration of an updated image or the replacement of an updated image, etc. For example, such a second image could be regenerated by the electronic device 110 based on the aforementioned updated image generation method, or it could be quickly switched by the user 221 from a plurality of candidate images pre-generated by the electronic device 110. Such a plurality of candidate images may include, for example, some candidate images from a set of candidate images pre-generated by the electronic device 110, or a set of candidate images pre-generated by the electronic device 110 based on the aforementioned updated image generation method, etc.

[0056] In some embodiments, according to the interface 200F shown in FIG. 2F, if the user 221 drags the interactive control 216 to the right, the electronic device 110 can update at least a portion of the background image (also referred to as the second background image) of the media content 214 based on the background image (also referred to as the first background image) of the media content 215. Further, according to the interface 200G shown in FIG. 2G, the electronic device 110 can present media content 242, which may include the media content 215 and the updated media content 214. As an example, according to the media content 242, the updated image corresponding to at least a portion of the background image of the updated media content 214 and the background image of the media content 215 have continuous screen content.

[0057] As examples, the updated image corresponding to at least a portion of the background image of media content 215 can be determined by expanding the viewfinder's framing area using electronic device 110. For instance, if user 221 drags an interactive control 216 to the right, electronic device 211 updates the viewfinder's framing area as the interactive control 216 is dragged to, and the image captured by the expanded framing area becomes the updated image corresponding to at least a portion of the background image of media content 214.

[0058] In some embodiments, the electronic device 110 can support user 221 in marking foreground and / or background areas, thereby improving the accuracy and flexibility of background replacement. For example, the user can mark such foreground and / or background areas by clicking, smearing, etc. Furthermore, the electronic device 110 can determine elements in media content 214 or media content 215 that serve as foreground and / or background areas, such as people, objects, outlines, etc., based on the user's marking operations. Therefore, the electronic device 110 can retain elements serving as foreground areas during subsequent background updates, thereby improving the creative effect of the subsequently generated target media content.

[0059] In some embodiments, according to the interface 200H shown in FIG2H, the user can further edit the generated media content 242 (e.g., add text, add stickers, add brush doodles, crop, etc.) to obtain target media content (e.g., media content 241 or media content 242) with better creative effect.

[0060] In some embodiments, the electronic device 110 may present an interface 200I as shown in FIG. 2I (e.g., an editing interface for co-op content). Such an interface 200I may include a co-op content preview area 251, which may display at least two co-op clips to be edited. As an example, such co-op clips may be recorded by a user (e.g., user 221 or user 222), uploaded by a user, or selected by a user from a media library. As an example, the co-op content preview area 251 may include areas 252 and 253. Areas 252 and 253 may display two co-op clips associated with the same user or different users. For example, area 252 may display co-op clip 254, and area 253 may display co-op clip 255. Such co-op clips 254 and 255 may be images or videos from different scenes.

[0061] Furthermore, the electronic device 110 can support users in editing such duet footage 254 and 255 to create duet content in the same scene as shown in Figure 2H. As an example, the electronic device 110 can expand the corresponding duet footage based on the user's drag-and-drop operation on control 256. For instance, if the user drags control 256 to the left, the electronic device 110 can expand the background image of duet footage 255 to update the background image of duet footage 254. Similarly, if the user drags control 256 to the right, the electronic device 110 can expand the background image of duet footage 254 to update the background image of duet footage 255.

[0062] In some embodiments, the electronic device 110 can determine the corresponding expanded at least a portion of the area based on the position to which the user drags such an interactive control 256. For example, if the user drags such an interactive control 256 to half the distance of the duet material 254, the electronic device 110 can expand the background image of such a duet material 255 to half the background image of the duet material 254.

[0063] In some embodiments, the image content expansion of the background image of the co-production material 254 (or co-production material 255) can be implemented using the model described above to improve the quality of the image content expansion. For example, the electronic device 110 can use the model to expand the co-production material 254 (or co-production material 255) to generate an expanded image, and use the expanded image to update the background image of the co-production material 255 (or the background image of the co-production material 254).

[0064] In some embodiments, the user can also control the generation process of such extended images (e.g., inputting at least one parameter, selecting from multiple candidates, triggering the replacement of extended images, etc.), as described above. Thus, the electronic device 110 can generate synchronized content that meets the user's expectations.

[0065] In some embodiments, in response to generating target media content, user 221 can share such target media content, thereby allowing other users to trigger the viewing of such target media content. As an example, user 221 can trigger the sending of a second message corresponding to such target media content in a session with user 222. Such a second message can indicate a reference to message 223 (also referred to as the first message), thereby allowing user 221 or user 222 to intuitively obtain information that such target media content is created in response to the media content corresponding to message 223.

[0066] As an example, user 221 can also trigger the release of a second work corresponding to the target media content. In order to improve the efficiency of users obtaining the desired information from such a second work, electronic device 110 can also present an access entry corresponding to the first work on the viewing interface of such a second work. Thus, users can quickly view the original first work that was co-produced through such a second work.

[0067] In some embodiments, the electronic device 110 can also associate such target media content with preset tags. For example, such preset tags could be tags like "co-production," indicating that such target media content is generated based on such first and second media content. Furthermore, such preset tags can be configured to trigger the presentation of a content viewing interface to display multiple media contents associated with such preset tags. Thus, user 221 can view similar co-production works more quickly, thereby improving the efficiency of user 221's interaction with the interface. Furthermore, user 221 can directly view multiple media contents associated with such preset tags, thereby further improving the efficiency of user 221 obtaining desired information from the interface.

[0068] In this way, the embodiments of this disclosure can quickly update at least a portion of the second background image of the second media content based on the first background image of the first media content. This eliminates the need for users to perform tedious image cutout methods, thereby achieving higher quality background fusion and improving the efficiency of generating target media content based on the first media content and the updated second media content.

[0069] Therefore, the embodiments of this disclosure can generate target media content for background fusion of first media content and second media content more efficiently, and improve the quality of background fusion while improving the efficiency of interface interaction.

[0070] Example process

[0071] Figure 3 shows a flowchart of an example process 300 for generating media content according to some embodiments of the present disclosure. Process 300 can be implemented at electronic device 110. Process 300 is described below with reference to Figure 1.

[0072] As shown in Figure 3, in box 310, the electronic device 110 presents first media content in the first area of ​​the interface and second media content in the second area of ​​the interface.

[0073] At frame 320, in response to receiving a preset operation, electronic device 110 updates at least a portion of the second background image of the second media content based on the first background image of the first media content.

[0074] At box 330, electronic device 110 generates target media content based on first media content and updated second media content.

[0075] In some embodiments, the updated image and the first background image corresponding to at least a portion of the region have continuous screen content.

[0076] In some embodiments, the updated image corresponding to at least a portion of the region is generated based on the first background image.

[0077] In some embodiments, process 300 further includes: using a model to expand a first background image or first media content to generate an updated image.

[0078] In some embodiments, the updated image corresponding to at least a portion of the region is also determined based on at least one parameter input by the user.

[0079] In some embodiments, process 300 further includes: presenting a set of candidate images generated based on a first background image; and determining the first image as the updated image in response to the selection of the first image from the set of candidate images.

[0080] In some embodiments, process 300 further includes: in response to receiving a second operation, replacing at least a portion of a region with a second image, the second image being generated based on a first background image.

[0081] In some embodiments, the first region corresponds to a viewfinder, the first media content includes a live image captured by the viewfinder, and the updated image corresponding to at least a portion of the region is determined by expanding the viewfinder's framing area.

[0082] In some embodiments, the first background image or the second background image is determined based on a user's marking operation, which indicates a foreground area and / or a background area in the first media content or the second media content.

[0083] In some embodiments, at least a portion of the region is determined based on at least one operational attribute of a preset operation.

[0084] In some embodiments, process 300 further includes: updating at least a portion of a second background image during the execution of a preset operation, wherein at least a portion of the region is changed as the execution process proceeds.

[0085] In some embodiments, process 300 further includes: displaying interactive controls associated with the first region and the second region in the interface; and receiving drag operations on the interactive controls as preset operations.

[0086] In some embodiments, at least a portion of the area is determined based on the position to which the interactive control is dragged.

[0087] In some embodiments, process 300 further includes: presenting an interface in response to receiving an interactive request associated with first media content and / or second media content.

[0088] In some embodiments, the first media content and / or the second media content corresponds to a first message sent in the session, and the process 300 further includes: sending a second message in the session corresponding to the target media content, the second message indicating a reference to the first message.

[0089] In some embodiments, the first media content and / or the second media content correspond to the published first work, and the process 300 further includes: publishing the second work corresponding to the target media content, and the viewing interface of the second work includes an access point corresponding to the first work.

[0090] In some embodiments, process 300 further includes: associating target media content with a preset tag, the preset tag indicating that the target media content is generated based on first media content and second media content.

[0091] In some embodiments, a preset tag is configured to trigger the presentation of a content viewing interface, which displays multiple media contents associated with the preset tag.

[0092] Example devices and equipment

[0093] Embodiments of this disclosure also provide corresponding apparatus for implementing the methods or processes described above. Figure 4 shows a schematic structural block diagram of an example apparatus 400 for generating media content according to certain embodiments of this disclosure. Apparatus 400 may be implemented as or included in electronic device 110. The various modules / components in apparatus 400 may be implemented by hardware, software, firmware, or any combination thereof.

[0094] As shown in Figure 4, the device 400 includes a first presentation module 410, configured to present first media content in a first area of ​​the interface and second media content in a second area of ​​the interface; a first update module 420, configured to update at least a portion of the second background image of the second media content based on the first background image of the first media content in response to receiving a preset operation; and a generation module 430, configured to generate target media content based on the first media content and the updated second media content.

[0095] In some embodiments, the updated image and the first background image corresponding to at least a portion of the region have continuous screen content.

[0096] In some embodiments, the updated image corresponding to at least a portion of the region is generated based on the first background image.

[0097] In some embodiments, the apparatus 400 further includes a providing module configured to generate an updated image by extending the first background image or first media content using a model.

[0098] In some embodiments, the updated image corresponding to at least a portion of the region is also determined based on at least one parameter input by the user.

[0099] In some embodiments, the apparatus 400 further includes a determining module configured to: present a set of candidate images generated based on a first background image; and determine the first image as the updated image in response to the selection of the first image from the set of candidate images.

[0100] In some embodiments, the apparatus 400 further includes a replacement module configured to: in response to receiving a second operation, replace at least a portion of a region with a second image, the second image being generated based on a first background image.

[0101] In some embodiments, the first region corresponds to a viewfinder, the first media content includes a live image captured by the viewfinder, and the updated image corresponding to at least a portion of the region is determined by expanding the viewfinder's framing area.

[0102] In some embodiments, the first background image or the second background image is determined based on a user's marking operation, which indicates a foreground area and / or a background area in the first media content or the second media content.

[0103] In some embodiments, at least a portion of the region is determined based on at least one operational attribute of a preset operation.

[0104] In some embodiments, the apparatus 400 further includes a second update module configured to update at least a portion of a second background image during the execution of a preset operation, wherein the at least a portion of the region changes as the execution process proceeds.

[0105] In some embodiments, the device 400 further includes a receiving module configured to: display interactive controls associated with the first area and the second area in the interface; and receive drag operations on the interactive controls as preset operations.

[0106] In some embodiments, at least a portion of the area is determined based on the position to which the interactive control is dragged.

[0107] In some embodiments, the device 400 further includes a second presentation module configured to present an interface in response to receiving an interaction request associated with the first media content and / or the second media content.

[0108] In some embodiments, the first media content and / or the second media content corresponds to a first message sent in a session, and the apparatus 400 further includes a sending module configured to send a second message corresponding to the target media content in a session, the second message indicating a reference to the first message.

[0109] In some embodiments, the first media content and / or the second media content correspond to the published first work, and the device 400 further includes a publishing module configured to: publish the second work corresponding to the target media content, and the viewing interface of the second work includes an access point corresponding to the first work.

[0110] In some embodiments, the device 400 further includes an association module configured to associate target media content with a preset tag, wherein the preset tag indicates that the target media content is generated based on the first media content and the second media content.

[0111] In some embodiments, a preset tag is configured to trigger the presentation of a content viewing interface, which displays multiple media contents associated with the preset tag.

[0112] The modules included in device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the modules in device 400 can be implemented at least partially by one or more hardware logic components. By way of example, and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SoCs), complex programmable logic devices (CPLDs), and so on.

[0113] Figure 5 shows a block diagram of an electronic device 500 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device 500 shown in Figure 5 is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. The electronic device 500 shown in Figure 5 can be used to implement the electronic device 110 of Figure 1 or the device 400 of Figure 4.

[0114] As shown in Figure 5, electronic device 500 is in the form of a general-purpose electronic device. Components of electronic device 500 may include, but are not limited to, one or more processors 510 or processing units, memory 520, storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 500.

[0115] Electronic device 500 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 500.

[0116] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks may be provided. In these cases, each drive may be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0117] Communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of components of electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0118] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0119] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0120] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0121] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0122] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0123] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0124] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for generating media content, comprising: The first media content is presented in the first area of ​​the interface, and the second media content is presented in the second area of ​​the interface; In response to receiving a preset operation, at least a portion of the second background image of the second media content is updated based on the first background image of the first media content; as well as Based on the first media content and the updated second media content, target media content is generated.

2. The method according to claim 1, wherein the updated image corresponding to the at least partial region and the first background image have continuous image content.

3. The method according to claim 1 or 2, wherein the updated image corresponding to at least a portion of the region is generated based on the first background image.

4. The method according to claim 3, further comprising: The updated image is generated by expanding the first background image or the first media content using a model.

5. The method of claim 3, wherein the updated image corresponding to the at least partial region is further determined based on at least one parameter input by the user.

6. The method according to claim 3, further comprising: Present a set of candidate images generated based on the first background image; as well as In response to the selection of a first image from the set of candidate images, the first image is determined as the updated image.

7. The method according to claim 3, further comprising: In response to receiving a second operation, the at least a portion of the region is replaced with a second image, the second image being generated based on the first background image.

8. The method according to any one of claims 1 to 7, wherein the first region corresponds to a viewfinder, the first media content includes a live image captured by the viewfinder, and the updated image corresponding to the at least partial region is determined by expanding the framing area of ​​the viewfinder.

9. The method according to any one of claims 1 to 8, wherein the first background image or the second background image is determined based on a user's marking operation, the marking operation indicating a foreground area and / or background area in the first media content or the second media content.

10. The method according to any one of claims 1 to 9, wherein the at least partial region is determined based on at least one operational attribute of the preset operation.

11. The method according to any one of claims 1 to 10, further comprising: During the execution of the preset operation, at least a portion of the second background image is updated, wherein the at least a portion of the image is changed as the execution process proceeds.

12. The method according to any one of claims 1 to 11, further comprising: The interface displays interactive controls associated with the first area and the second area; as well as Receive drag and drop operations on the interactive control as the preset operation.

13. The method of claim 12, wherein the at least partial region is determined based on the position to which the interactive control is dragged.

14. The method according to any one of claims 1 to 13, further comprising: The interface is presented in response to receiving an interaction request associated with the first media content and / or the second media content.

15. The method of claim 14, wherein the first media content and / or the second media content corresponds to a first message sent in the session, the method further comprising: A second message corresponding to the target media content is sent during the session, the second message indicating a reference to the first message.

16. The method of claim 14, wherein the first media content and / or the second media content corresponds to the published first work, the method further comprising: Publish a second work corresponding to the target media content, and the viewing interface of the second work includes an access point corresponding to the first work.

17. The method according to any one of claims 1 to 16, further comprising: The target media content is associated with a preset tag, which indicates that the target media content is generated based on the first media content and the second media content.

18. The method of claim 17, wherein the preset tag is configured to trigger the presentation of a content viewing interface, the content viewing interface presenting multiple media contents associated with the preset tag.

19. An apparatus for generating media content, comprising: The first presentation module is configured to present first media content in a first area of ​​the interface and second media content in a second area of ​​the interface. The first update module is configured to, in response to receiving a preset operation, update at least a portion of the second background image of the second media content based on the first background image of the first media content; as well as The generation module is configured to generate target media content based on the first media content and the updated second media content.

20. An electronic device, comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 18 when executed by the at least one processor.

21. A computer-readable storage medium having stored thereon computer-executable instructions that can be executed by a processor to implement the method according to any one of claims 1 to 18.

22. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 18.

Images