Method and device for generating media content, equipment and storage medium

Abstract

The embodiment of the invention relates to a method and device for generating media content, equipment and a storage medium. The method comprises the steps of determining a target image based on input information of a user; the target image and control information are provided for the target model, the control information at least indicates a first mirror operation parameter associated with the foreground part of the target image and a second mirror operation parameter associated with the background part of the target image, and the first mirror operation parameter is different from the second mirror operation parameter; and obtaining video content generated by the target model. In this way, the embodiments of the present disclosure can generate media content with higher quality.

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for generating media content. Background Art

[0002] With the development of computer technology, artificial intelligence technology has gradually been applied to the generation of various types of media content. For example, some video generation models can support users to input text or images to generate corresponding video content. However, such a generation process is usually difficult to control, which may result in some generated media content not meeting user expectations. Summary of the invention

[0003] In a first aspect of the present disclosure, a media editing method is provided. The method includes: determining a target image based on user input information; providing the target image and control information to a target model, the control information at least indicating a first camera movement parameter associated with a foreground portion of the target image and a second camera movement parameter associated with a background portion of the target image, the first camera movement parameter being different from the second camera movement parameter; and obtaining video content generated by the target model.

[0004] In a second aspect of the present disclosure, a device for generating media content is provided. The device includes: a determination module configured to determine a target image based on user input information; a providing module configured to provide the target image and control information to a target model, the control information at least indicating a first camera movement parameter associated with a foreground portion of the target image and a second camera movement parameter associated with a background portion of the target image, the first camera movement parameter being different from the second camera movement parameter; and an acquisition module configured to acquire video content generated by the target model.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0007] It should be understood that the contents described in this content section are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0009] Figure 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented;

[0010] Figure 2 A flowchart showing a process for generating media content according to some embodiments of the present disclosure is shown;

[0011] FIG. 3A to FIG. 3C A schematic diagram of generating video content based on an input image is shown;

[0012] Figure 4 A block diagram showing an apparatus for generating media content according to some embodiments of the present disclosure; and

[0013] Figure 5 A block diagram of an electronic device capable of implementing various embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0014] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0015] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0016] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0017] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0018] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0019] The term "in response to" as used herein refers to a state in which a corresponding event occurs or a condition is satisfied. It will be understood that the timing of executing a subsequent action executed in response to the event or condition is not necessarily strongly related to the time when the event occurs or the condition is satisfied. For example, in some cases, the subsequent action may be executed immediately when the event occurs or the condition is satisfied; while in other cases, the subsequent action may be executed some time after the event occurs or the condition is satisfied.

[0020] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0021] It should be noted that the titles of any sections / subsections provided herein are not restrictive. Various embodiments are described throughout this article, and any type of embodiment may be included under any section / subsection. In addition, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0022] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.

[0023] As briefly mentioned above, some video generation models can support users to input text or images to generate corresponding video content. However, such a generation process is usually difficult to control, which results in some generated media content not meeting the user's expectations.

[0024] In view of this, an embodiment of the present disclosure proposes a scheme for generating media content. The scheme includes: determining a target image based on user input information; providing the target image and control information to a target model, the control information at least indicating a first camera movement parameter associated with a foreground portion of the target image and a second camera movement parameter associated with a background portion of the target image, the first camera movement parameter being different from the second camera movement parameter; and obtaining video content generated by the target model. In this way, the embodiment of the present disclosure can generate higher quality media content.

[0025] In this way, the embodiments of the present disclosure can improve the quality of the video content generated by the model by providing the camera movement parameters of the foreground and background parts as control signals to the generation model.

[0026] Example embodiments of the present disclosure are described below with reference to the accompanying drawings.

[0027] Example Environment

[0028] Figure 1 1 is a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. Figure 1 As shown, example environment 100 may include electronic device 110 .

[0029] In this example environment 100, an electronic device 110 may run an application 120 for generating media content. The application 120 may be any suitable type of application for editing media content, examples of which may include, but are not limited to, photo editing applications, video editing applications, content sharing applications, etc. A user 140 may interact with the application 120 via the electronic device 110 and / or its attached devices.

[0030] exist Figure 1 In the environment 100, if the application 120 is active, the electronic device 110 may present an interface 150 corresponding to the application 120. The interface 150 may include various pages provided by the application 120, such as an editing page for media content. For example, a media editing application may display media content to be edited and a plurality of controls for editing, and the user 140 may select a corresponding control to edit the media content.

[0031] In some embodiments, the electronic device 110 communicates with the server 130 to provide services for the application 120. The server 150 can provide management, configuration, maintenance of applications or websites, and identification of target objects in picture content.

[0032] The electronic device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable game terminals, VR / AR devices, personal communication systems (PCS) devices, personal navigation devices, personal digital assistants (PDA), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio broadcast receivers, e-book devices, game devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface for the user (such as "wearable" circuits, etc.).

[0033] The server 130 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and big data and artificial intelligence platforms. The server 130 may include, for example, a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, etc. The server 130 may provide background services for the application 120 that supports virtual scenes in the electronic device 110.

[0034] A communication connection may be established between the server 130 and the electronic device 110. The communication connection may be established in a wired manner or a wireless manner. The communication connection may include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, etc., and the embodiments of the present disclosure are not limited in this respect. In the embodiments of the present disclosure, the server 130 and the electronic device 110 may implement signaling interaction through the communication connection between the two.

[0035] It should be understood that the structure and function of the various elements in the environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure.

[0036] Various example implementations of the present disclosure will be described in detail below.

[0037] Example Process

[0038] The following will refer to Figure 2An example process of generating media content according to an embodiment of the present disclosure is described below. Figure 2 2 shows a flow chart of an example process 200 for generating media content. The process may be implemented, for example, by a suitable electronic device or combination of electronic devices (e.g., Figure 1 The electronic device 110, the server 130, or a combination of one or more of these devices) is implemented. Figure 1 The process 200 is described below.

[0039] like Figure 2 As shown, in box 210, the electronic device 110 or the server 130 determines a target image based on user input information.

[0040] In some embodiments, the user's input information may include the user's input image. Further, the electronic device 110 or the server 130 may determine whether the input image includes a preset object. In some embodiments, such a preset object may include any pre-specified object, such as an animal object or a human object.

[0041] Further, if the input image includes a preset object, the electronic device 110 or the server 130 may also determine whether the input image satisfies the condition. Specifically, the electronic device 110 or the server 130 may determine whether the condition is satisfied based on the position and / or size of the preset object in the input image. For example, the electronic device 110 or the server 130 may determine whether the preset object is displayed in the center, or whether its size is larger or smaller than the preset size.

[0042] Furthermore, if the input image does not meet the condition, the electronic device 110 or the server 130 may also determine the target image by adjusting the input image.

[0043] As some examples, the electronic device 110 or the server 130 may obtain the target image by cropping the input image so that the target image has a preset size. As another example, the electronic device 110 or the server 130 may also adjust the input image so that the display position of the preset object in the target image meets a preset condition. For example, the preset object may be displayed in the center of the adjusted image.

[0044] As another example, the electronic device 110 or the server 130 may also adjust the input image so that the display ratio of the preset object in the target image meets the preset condition. As an example, the electronic device 110 or the server 130 may crop the input image so that the ratio of the preset object in the target image meets the condition. Alternatively, the electronic device 110 or the server 130 may also reduce the display ratio of the preset object by expanding the input image so that the display ratio of the preset object is large.

[0045] In this way, embodiments of the present disclosure may improve the regularity of the images provided to the model, thereby improving the quality of the generated video content.

[0046] In some embodiments, if the user's input image does not include a preset object, the electronic device 110 or the server 130 may determine the target image by, for example, cropping the input image so that the target image may match the input specification of the model.

[0047] In some embodiments, the user's input information may also include text information or other information, and the target image may also include an image generated based on the user's input information.

[0048] In box 220, the electronic device 110 or the server 130 provides a target image and control information to the target model, the control information indicating at least a first camera movement parameter associated with a foreground portion of the target image and a second camera movement parameter associated with a background portion of the target image, wherein the first camera movement parameter is different from the second camera movement parameter.

[0049] In some embodiments, the target model may include a video generation model. Further, the video generation model may obtain a target image and control information as input. Specifically, the control information may indicate a first camera movement parameter associated with a foreground portion of the target image. Additionally, the control information may also indicate a second camera movement parameter associated with a background portion of the target image.

[0050] In some embodiments, the first camera movement parameter corresponds to a first zoom parameter of a first zoom camera movement, and the second camera movement parameter includes a second zoom parameter of a second zoom camera movement, and the direction of the first zoom camera movement is opposite to that of the second zoom camera movement.

[0051] As an example, the first zooming motion may include a zoom-in motion to zoom in on a foreground portion of a target image, and the second zooming motion may include a zoom-out motion to zoom out on a background portion of a target image.

[0052] In some embodiments, the first camera movement parameter may include a forward multiple, and the second camera movement parameter may include a zoom-out multiple. In some embodiments, the value of the first camera movement parameter may be, for example, less than the second camera movement parameter, so that the foreground portion presents a smaller movement and the background portion presents a larger movement.

[0053] The training process of the target model will be further described below. In some embodiments, the training device may sample a video and determine a plurality of units in the sample video, wherein the plurality of units may correspond to a plurality of preset motion types.

[0054] As an example, the cells corresponding to the edge zones may represent a background that remains almost static with minimal motion. Drag cells may allow for more complex and flexible control, where the user may, for example, utilize six degrees of freedom (6-DOF) motion guidance to precisely manipulate these cells. Additionally, brush cells may, for example, be controlled by a motion intensity value.

[0055] In some embodiments, the training device may further generate training control signals corresponding to the multiple units based on motion information (eg, motion trajectories) of such multiple units in the sample video.

[0056] For example, the training device can construct a trajectory function for each motion unit, which can describe the motion of a point in 3D space over time. Further, the training device can decompose the trajectory function of each unit into a rigid term and an additional term. Different types of units can correspond to different signal expression patterns. For example, the motion intensity of the edge zone is always 0, while the motion intensity of the brush unit is specified by the user.

[0057] Furthermore, the training device may generate a training control signal corresponding to the target unit based on the signal expression pattern and the target motion information of the target unit.

[0058] Thus, the training device can construct training control signals corresponding to multiple units, and can train the target model based on the training control signals and the first frame image of the sample video.

[0059] In this way, the target model can identify and define different motion units according to the user's input and the characteristics of the video content, and provide independent control signals for each unit, thereby achieving fine management and operation of different motion and control tasks in the video synthesis process.

[0060] In block 230 , the electronic device 110 or the server 130 obtains video content generated by the target model.

[0061] In some embodiments, the electronic device 110 or the server 130 may also post-process the video content output by the model as the final generated result.

[0062] In some embodiments, in order to ensure the continuity of the picture, the electronic device 110 or the server 130 may adjust the multiple video frames in the video content generated by the target model based on the image content corresponding to the preset object in the input image. As an example, when the user's input image includes a preset object, the electronic device 110 or the server 130 may use the image content corresponding to the preset object in the input image to replace the image area corresponding to the preset object in the multiple video frames.

[0063] Taking the preset objects including facial objects as an example, the electronic device 110 or the server 130 can use the facial image in the user input image to replace the facial area in the generated video frame, so that the face in the provided video content can maintain consistency, thereby improving the quality of the provided video content.

[0064] by Figure 3A As an example, the electronic device 110 or the server 130 may determine the target image 310 based on the user's input information. Figure 3B As shown, the electronic device 110 or the server 130 can obtain a first camera movement parameter corresponding to the foreground portion 320 of the target image 310 and a second camera movement parameter corresponding to the background portion 330. In some embodiments, the first camera movement parameter and / or the second camera movement parameter may include preset parameters, or may also be based on parameters configured by the user.

[0065] Further, the target model can be generated based on the target image 310, the first camera movement parameter and the second camera movement parameter. Figure 3C The video content 340 is shown. In the video content 340, foreground portion 350 may present a zoom-in camera effect, for example, and background portion 360 may present a zoom-out camera effect.

[0066] In this way, the embodiments of the present disclosure can improve the quality of the video content generated by the model by providing the camera movement parameters of the foreground and background parts as control signals to the generation model.

[0067] Example devices and equipment

[0068] The embodiments of the present disclosure also provide corresponding devices for implementing the above methods or processes. Figure 4 A schematic structural block diagram of an apparatus 400 for generating media content according to some embodiments of the present disclosure is shown. The apparatus 400 may be implemented as or included in a terminal device 110. Each module / component in the apparatus 400 may be implemented by hardware, software, firmware, or any combination thereof.

[0069] like Figure 4 As shown, the device 400 includes a determination module 410, which is configured to determine a target image based on user input information; a providing module 420, which is configured to provide a target image and control information to a target model, the control information at least indicating a first camera movement parameter associated with a foreground portion of the target image and a second camera movement parameter associated with a background portion of the target image, the first camera movement parameter being different from the second camera movement parameter; and an acquisition module 430, which is configured to acquire video content generated by the target model.

[0070] In some embodiments, the determination module 410 is further configured to obtain an input image of a user; determine whether the input image includes a preset object; and in response to the input image including the preset object, adjust the input image to determine a target image.

[0071] In some embodiments, adjusting the input image includes at least one of the following: cropping the input image so that the target image has a preset size; adjusting the input image so that the display position of a preset object in the target image meets preset conditions; adjusting the input image so that the display ratio of the preset object in the target image meets preset conditions.

[0072] In some embodiments, the determination module 410 is further configured to determine the target image by cropping the input image in response to whether the input image includes a preset object.

[0073] In some embodiments, the apparatus 400 further includes an adjustment module configured to adjust a plurality of video frames in the video content based on image content corresponding to a preset object in the input image; and provide the adjusted video content to the user.

[0074] In some embodiments, the adjustment module is further configured to replace the image area corresponding to the preset object in the multiple video frames with the image content.

[0075] In some embodiments, the first camera movement parameter corresponds to a first zoom parameter of a first zoom camera movement, and the second camera movement parameter includes a second zoom parameter of a second zoom camera movement, and the direction of the first zoom camera movement is opposite to that of the second zoom camera movement.

[0076] In some embodiments, the target model is trained based on the following process: obtaining a sample video; determining multiple units in the sample video, the multiple units corresponding to multiple preset motion types; generating multiple training control signals corresponding to the multiple units based on motion information of the multiple units in the sample video; and training the target model based on the multiple training control signals and the sample video.

[0077] In some embodiments, generating multiple training control signals corresponding to multiple units includes: determining a signal expression pattern corresponding to the motion type based on the motion type of a target unit among the multiple units; and generating a training control signal corresponding to the target unit based on the signal expression pattern and the target motion information of the target unit.

[0078] The units included in the device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units can be implemented using software and / or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the units in the device 400 can be implemented at least in part by one or more hardware logic components. As an example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0079] Figure 5 1 shows a block diagram of an electronic device 500 in which one or more embodiments of the present disclosure may be implemented. It should be understood that Figure 5 The electronic device 500 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. Figure 5 The electronic device 500 shown can be used to implement Figure 1 An electronic device 110.

[0080] like Figure 5 As shown, the electronic device 500 is in the form of a general electronic device. The components of the electronic device 500 may include, but are not limited to, one or more processors or processing units 510, a memory 520, a storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. The processing unit 510 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 520. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 500.

[0081] The electronic device 500 typically includes a plurality of computer storage media. Such media may be any accessible media that is accessible to the electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 520 may be a volatile memory (e.g., registers, caches, random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 530 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data and may be accessed within the electronic device 500.

[0082] The electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Figure 5 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. The memory 520 may include a computer program product 525 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.

[0083] The communication unit 540 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 500 can be implemented in a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 500 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0084] The input device 550 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 560 may be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 500 may also communicate with one or more external devices (not shown) through the communication unit 540 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 500, or communicate with any device that allows the electronic device 500 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0085] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0086] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0087] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0088] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0089] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0090] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. A method for generating media content, comprising: Determine a target image based on user input information; providing the target image and control information to a target model, the control information indicating at least a first camera movement parameter associated with a foreground portion of the target image and a second camera movement parameter associated with a background portion of the target image, the first camera movement parameter being different from the second camera movement parameter; and The video content generated by the target model is obtained.

2. The method according to claim 1, wherein determining the target image based on the user's input information comprises: Acquire an input image of the user; Determining whether the input image includes a preset object; as well as In response to the input image including the preset object, the input image is adjusted to determine the target image.

3. The method of claim 2, wherein adjusting the input image comprises at least one of: Cropping the input image so that the target image has a preset size; Adjusting the input image so that the display position of the preset object in the target image meets a preset condition; The input image is adjusted so that the display ratio of the preset object in the target image meets a preset condition.

4. The method according to claim 2, wherein based on the user's input information, determining the target image further comprises: In response to whether the input image includes the preset object, the target image is determined by cropping the input image.

5. The method according to claim 2, further comprising: Adjusting a plurality of video frames in the video content based on image content corresponding to the preset object in the input image; as well as The adjusted video content is provided to the user.

6. The method according to claim 5, wherein adjusting the plurality of video frames based on image content corresponding to the preset object in the input image comprises: The image area corresponding to the preset object in the multiple video frames is replaced by the image content.

7. The method according to claim 1, wherein the first camera movement parameter corresponds to a first zoom parameter of a first zoom camera movement, and the second camera movement parameter includes a second zoom parameter of a second zoom camera movement, and the direction of the first zoom camera movement is opposite to that of the second zoom camera movement.

8. The method of claim 1, wherein the target model is trained based on the following process: Get sample video; Determining a plurality of units in the sample video, the plurality of units corresponding to a plurality of preset motion types; Based on the motion information of the multiple units in the sample video, generating multiple training control signals corresponding to the multiple units; as well as The target model is trained based on the multiple training control signals and the sample video.

9. The method according to claim 8, wherein generating a plurality of training control signals corresponding to the plurality of units comprises: Based on a motion type of a target unit among the plurality of units, determining a signal expression pattern corresponding to the motion type; as well as Based on the signal expression pattern and the target motion information of the target unit, a training control signal corresponding to the target unit is generated.

10. An apparatus for generating media content, comprising: A determination module is configured to determine a target image based on user input information; a providing module configured to provide the target image and control information to a target model, the control information indicating at least a first camera movement parameter associated with a foreground portion of the target image and a second camera movement parameter associated with a background portion of the target image, the first camera movement parameter being different from the second camera movement parameter; and The acquisition module is configured to acquire the video content generated by the target model.

11. An electronic device, comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 9 when executed by the at least one processing unit.

12. A computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the method according to any one of claims 1 to 9 when executed by a processor.

Images