Media data generation method and apparatus, and device, medium and program product
Patent Information
- Application Number
- PCT/CN2025/101515
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-06-25
- Filing Date
- 2025-06-17
- Publication Date
- 2026-01-02
Smart Images

Figure CN2025101515_02012026_PF_FP_ABST
Abstract
Description
Media data generation method, device, equipment, medium and program product
[0001] The present application claims priority to Chinese Patent Application No. 202410832343.8, filed on June 25, 2024, the disclosure of which is incorporated herein in its entirety as part of the present application. TECHNICAL FIELD
[0002] Embodiments of the present disclosure relate to a media data generation method, device, equipment, medium and program product. BACKGROUND
[0003] With the development of computer technology, more and more users create media data such as images and videos through image generation tools. For example, a video frame can be generated through an image generation tool, and then the video frame is combined according to a timestamp to obtain a video. However, the video frame generated by the image generation tool has a phenomenon that the character material between the video frames is not coherent, resulting in a discontinuous plot of the generated video. SUMMARY
[0004] The present disclosure provides a media data generation method, device, equipment, medium and program product, which can solve the problem of discontinuous plot caused by incoherent character material.
[0005] In a first aspect, the embodiments of the present disclosure provide a media data generation method, comprising:
[0006] displaying a character display area in a target generation page, the character display area comprising at least one character material, wherein the character material represents character media data generated based on reference information;
[0007] in response to a character setting operation in the character display area, displaying target character material in a target input area in the target generation page;
[0008] in response to a text input operation in the target input area in the target generation page, displaying target text in the target input area, wherein the target text is used to describe the intended content of the media data;
[0009] in response to a generation operation in the target generation page, displaying generated media data in the target generation page, wherein the media data is generated based on the target character material and the target text.
[0010] In a second aspect, the embodiments of the present disclosure also provide a media data generation device, comprising:
[0011] a display module, configured to display a character display area in a target generation page, the character display area comprising at least one character material, wherein the character material represents character media data generated based on reference information;
[0012] a setting operation, configured to display a target character material in a target input area in the target generation page in response to a character setting operation in the character display area;
[0013] an input module, configured to display a target text in the target input area in the target generation page in response to a text input operation in the target input area in the target generation page, wherein the target text is used to describe an expected content of the media data;
[0014] a generation module, configured to display generated media data in the target generation page in response to a generation operation in the target generation page, wherein the media data is generated based on the target character material and the target text.
[0015] In a third aspect, the present disclosure provides an electronic device, comprising:
[0016] one or more processors;
[0017] a storage device configured to store one or more programs,
[0018] when the one or more programs are executed by the one or more processors, the one or more processors implement the media data generation method according to any embodiment of the present disclosure.
[0019] In a fourth aspect, the present disclosure provides a storage medium comprising computer executable instructions for performing the media data generation method according to any embodiment of the present disclosure when executed by a computer processor. BRIEF DESCRIPTION OF DRAWINGS
[0020] The above and other features, advantages, and aspects of the present disclosure will become more apparent by describing in detail the embodiments thereof with reference to the attached drawings. Throughout the drawings, the same or similar reference numerals refer to the same or similar elements. It should be understood that the drawings are schematic and elements and features are not necessarily to scale.
[0021] FIG. 1 is a flow diagram of a media data generation method according to an embodiment of the present disclosure;
[0022] FIG. 2a is a schematic diagram of a target generation page according to an embodiment of the present disclosure;
[0023] FIG. 2b is a schematic diagram of another target generation page according to an embodiment of the present disclosure;
[0024] FIG. 2c is a schematic diagram of another target generation page according to an embodiment of the present disclosure;
[0025] FIG. 2d is a schematic diagram of another target generation page according to an embodiment of the present disclosure;
[0026] FIG. 3 is a schematic diagram of another target generation page according to an embodiment of the present disclosure;
[0027] FIG. 4 is a schematic diagram of another target generation page according to an embodiment of the present disclosure;
[0028] FIG. 5 is a schematic diagram of a role creation method in a media data generation method according to an embodiment of the present disclosure;
[0029] FIG. 6a is a schematic diagram of a role creation page according to an embodiment of the present disclosure;
[0030] FIG. 6b is a schematic diagram of another role creation page according to an embodiment of the present disclosure;
[0031] FIG. 6c is a schematic diagram of another role creation page according to an embodiment of the present disclosure;
[0032] FIG. 6d is a schematic diagram of another role creation page according to an embodiment of the present disclosure;
[0033] FIG. 7 is a schematic diagram of a role material redrawing process according to an embodiment of the present disclosure;
[0034] FIG. 8 is a schematic diagram of another media data generation method according to an embodiment of the present disclosure;
[0035] FIG. 9 is a schematic diagram of a media data generation device structure according to an embodiment of the present disclosure;
[0036] FIG. 10 is a schematic diagram of an electronic device structure according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0037] Embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings. While certain embodiments of the present disclosure will be illustrated and described, it is well understood that the present disclosure is not limited to these embodiments, but is capable of many arrangements not specifically shown or described. Thus, many modifications and variations can be made in the techniques described and suggested herein without departing from the scope of the present disclosure. It is therefore requested that the present disclosure be interpreted not by the abstract of the disclosure, but rather by the claims.
[0038] It should be understood that the various steps of the method embodiments of the present disclosure can be performed in different orders and / or in parallel. Furthermore, the method embodiments can include additional steps and / or omit performing the steps shown. The scope of the present disclosure is not limited in this respect.
[0039] The term "include" and variations thereof as used herein mean "to include, without limitation." The term "based on" means "based at least in part on." The term "one embodiment" means "at least one embodiment." The term "another embodiment" means "at least one additional embodiment." The term "some embodiments" means "at least some embodiments." Related terms shall be construed accordingly.
[0040] It should be noted that the terms "first", "second", etc. mentioned in the disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.
[0041] It should be noted that the modification of "one" or "multiple" mentioned in the disclosure is illustrative and not limiting, and those skilled in the art should understand that unless the context clearly indicates otherwise, it should be understood as "one or more".
[0042] The names of the messages or information exchanged between the devices in the embodiments of the disclosure are only for illustrative purposes, and are not used to limit the scope of the messages or information.
[0043] It can be understood that before using the technical solutions disclosed in the embodiments of the disclosure, the type, use range, use scenario, etc. of the personal information involved in the disclosure should be informed to the user and the authorization of the user should be obtained in a proper manner according to relevant laws and regulations.
[0044] For example, in response to receiving the active request of the user, prompt information is sent to the user to explicitly prompt the user that the operation requested to be performed will require obtaining and using the personal information of the user. Thus, the user can voluntarily choose whether to provide personal information to the electronic device, application program, server or storage medium, etc. software or hardware performing the operation of the technical solutions of the disclosure according to the prompt information.
[0045] As an optional but not limiting implementation manner, in response to receiving the active request of the user, the manner of sending prompt information to the user may, for example, be a pop-up window manner, and the prompt information may, for example, be presented in the form of text in the pop-up window. In addition, the pop-up window may also carry selection controls for the user to select "agree" or "disagree" to provide personal information to the electronic device.
[0046] It can be understood that the above notification and user authorization process is only illustrative, and does not limit the implementation manner of the disclosure, and other manners meeting the relevant laws and regulations can also be applied to the implementation manner of the disclosure.
[0047] It can be understood that the data involved in the technical solution (including but not limited to the data itself, the acquisition or use of the data) should comply with the requirements of the corresponding laws, regulations and relevant provisions.
[0048] FIG. 1 is a flowchart of a media data generation method provided by an embodiment of the present disclosure. The embodiment of the present disclosure is applicable to a case where media data is generated based on a specified character material to make the character materials between the media data coherent, for example, the media data includes pictures or videos, etc. The method can be executed by a media data generation device. The device can be implemented in the form of software and / or hardware. Optionally, the device is implemented by an electronic device, which can be a mobile terminal, a PC terminal, or a server, etc.
[0049] As shown in FIG. 1, the method includes:
[0050] S110, displaying a character display area in a target generation page, the character display area including at least one character material.
[0051] The character material represents character media data generated based on reference information. The character media data includes images and texts, etc. The reference information includes texts and / or reference images, etc. The character represents a subject object in the generated media data. In the media data, the subject object is an object distinguished from the background environment. For example, the character includes a person, an animal, a virtual object, an animated character, or an alien, etc.
[0052] The target generation page represents an interactive page of an image generation tool for generating media data such as images or videos. For example, the image generated by the target generation page is a video frame constituting a story video. After the video frame is generated, the video frame is added to a target editing track to generate the story video. Optionally, the story video can also be added with audio or other transition effects, which are not limited in the embodiment of the present disclosure.
[0053] The character display area represents a display area of at least one character material in the target generation page. For example, the character display area can be displayed in the form of a pop-up window, and at least one character material is displayed in the form of an image and a text in the pop-up window. The image corresponding to the character material can be a thumbnail or other small icon convenient for display. The text corresponding to the character material can include a character name. Optionally, the text corresponding to the character material can also include a character description, etc.
[0054] Exemplarily, in response to a character display operation in the target generation page, a character display area is displayed in the target generation page, the character display area including at least one character material.
[0055] Optionally, the role display operation comprises a click operation on a role setting control in the target generation page, or an input operation of a role setting character in the target input area.
[0056] The target input area represents an area in the target generation page for inputting media data. For example, the target input area is an input box in the target generation page, in which text can be inputted, and an image can also be inputted by using a preset role setting character.
[0057] FIG. 2a is a schematic diagram of a target generation page according to an embodiment of the present disclosure. As shown in FIG. 2a, when a click operation on a role setting control 210 in a target generation page 200 is detected, a role display area 220 is displayed in the target generation page 200. The role display area 220 comprises at least one role material. The role material can be displayed in the form of an image combined with text.
[0058] FIG. 2b is a schematic diagram of another target generation page according to an embodiment of the present disclosure. As shown in FIG. 2b, when an input operation of a role setting character 240 in a target input area 230 in a target generation page 200 is detected, a role display area 220 is displayed in the target generation page 200. The role display area 220 comprises at least one role material. The role material can be displayed in the form of an image combined with text.
[0059] S120, in response to a role setting operation in the role display area, displaying a target role material in the target input area in the target generation page.
[0060] The target role material is a role material for generating media data determined based on the role setting operation. In the present embodiment, the role setting operation represents an operation of determining a target role material from the role materials displayed in the role display area. For example, the role setting operation can comprise a role selection operation or a role switching operation. The role selection operation is used to select a target role material from the role materials displayed in the role display area. The role switching operation is used to switch the target role material based on the role materials displayed in the role display area.
[0061] For example, in response to a role setting operation in the role display area, a target role material corresponding to the role setting operation is displayed at a target position in the target input area.
[0062] The target position can represent a preset position in the target input area for displaying the target role material. For example, the target position can comprise a cursor position.
[0063] In the embodiments of the present disclosure, displaying the target role material in the target input area can include: displaying a thumbnail or other small icon corresponding to the target role material in the target input area, and the name of the role with the role setting character can also be displayed. FIG. 2c is a schematic diagram of another target generation page provided by the embodiments of the present disclosure. As shown in FIG. 2c, if the mouse hovers over the combined character 240 of the role setting character and the name of the role in the target input area 230, the role details 250 corresponding to the target role material are displayed. For example, if the mouse hovers over the name of the role A, a pop-up window displays the image and the role description of the role A, so that the user can view the detailed information of the target role material, and thus determine whether to continue to generate media data based on the target role material.
[0064] Optionally, the method further includes: in response to a role setting operation in the role display area, displaying the target role material at a position corresponding to the role setting control.
[0065] In the embodiments of the present disclosure, displaying the target role material at the position corresponding to the role setting control can include: displaying a thumbnail, the name of the role and the role description of the target role material at the position corresponding to the role setting control, so as to display the style of the role selected by the user.
[0066] FIG. 2d is a schematic diagram of another target generation page provided by the embodiments of the present disclosure. As shown in FIG. 2d, the role setting control 210 is displayed in the target generation page 200, and the role display area 220 is displayed by clicking the role setting control 210. The role display area 220 includes at least one role material, and the role material includes a role thumbnail and a role name. In response to a role selection operation on the target role material, the role thumbnail 260 and the combined character 240 of the role setting character and the name of the role are inserted at the cursor position in the target input area 230. In response to a mouse hovering operation on the combined character 240, the role details 250 corresponding to the target role material are displayed through the pop-up window 270.
[0067] FIG. 3 is a schematic diagram of another target generation page provided by the embodiments of the present disclosure. As shown in FIG. 3, the target input area 310 is displayed in the target generation page 300. If the role setting character is input in the target input area 310, the role display area 320 is displayed. The role display area 330 includes at least one role material, and the role material includes a role thumbnail and a role name. In response to a role selection operation on the target role material, the role thumbnail 340 and the combined character 350 of the role setting character and the name of the role are displayed at the corresponding position of the role setting character in the target input area 310.
[0068] S130, in response to a text input operation in the target input area of the target generation page, displaying target text in the target input area.
[0069] The target text is used to describe the expected content of the media data. For example, a user generates a video with a story, and usually inputs the concept information of each video frame in the target input area. For example, the concept information includes at least one of the background-related elements such as time, place, event, composition method and presentation effect, and at least one of the target object-related elements such as target object, object posture and presentation effect. For example, the concept information of the video frame can be determined based on the text input in the target input area. The target object in the video frame is determined based on the target role material displayed in the target input area.
[0070] In S140, in response to the generation operation in the target generation page, the generated media data is displayed in the target generation page.
[0071] The media data is generated based on the target role material and the target text. The image can be generated based on the target role material and the target text by using a pre-trained image generation model, as the media data. Alternatively, after the image is generated based on the pre-trained image generation model, the image is used as a video frame to form a video, as the media data. Specifically, the image and the text included in the target role material and the target text are input into the image generation model, and the image is generated based on the image generation model. For example, the image generation model generates the image based on the expected content described in the target text and the target role material.
[0072] The image generation model is a generative model based on a deep learning algorithm, which learns the data distribution of a given training set and then generates new images as close as possible to the training set. The training set is a set of images. The pre-trained image generation model in the embodiment of the present disclosure is trained to generate a new image containing the target role material based on the target text as a prompt, and the picture effect of the new image meets the requirements of the target text.
[0073] FIG. 4 is a schematic diagram of another target generation page provided by the embodiment of the present disclosure. As shown in FIG. 4, the generation control 420 is displayed in the target generation page 410. If the generation control 420 is clicked, the image is generated based on the target role material and the target text, and the generated image 430 is displayed in the target generation page 410.
[0074] The technical solution of the embodiments of the present disclosure is to display at least one role material in the role display area for the user to select a target role material. Since the target generation page includes a target input area, based on the role setting operation in the role display area, the target role material is displayed in the target input area in the target generation page. Based on the text input operation in the target input area, the target text is displayed in the target input area. Based on the generation operation in the target generation page, the media data is generated by combining the target role material and the target text, and the generated media data is displayed in the target generation page. The embodiments of the present disclosure can realize that the user-selected target role material is presented in different media data, thereby ensuring the coherence of the role material between the media data, so as to make the plot of the media data continuous. In addition, since the role material is generated based on the role expectation, the media data can be more consistent with the creation expectation, and the user experience can be improved.
[0075] FIG. 5 is a flowchart of a role creation method in a media data generation method according to an embodiment of the present disclosure. The embodiments of the present disclosure additionally limit the role creation step on the basis of the above-mentioned embodiments. In actual application scenarios, each person has different creative ideas for media data creation, and may not be able to find a target role material that meets the expectation in the pre-set candidate role material. Alternatively, if there is no candidate role material, the user needs to create a role material by himself. It should be noted that after the role material is created, it can be saved as a candidate role material in the role material library associated with the user account for subsequent use by the user.
[0076] As shown in FIG. 5, the method includes:
[0077] S510, in response to the role creation operation in the target generation page, a role creation page is displayed, and the role creation page includes a role creation control.
[0078] The role creation operation is used to trigger the role creation process. If the role creation operation in the target generation page is detected, the role creation page is displayed. The role creation page represents an interactive page for creating a role material. For example, the role creation page includes a role name input area and a role creation control. The role creation control is used to determine the role creation mode and trigger the display of the role setting area in the corresponding mode. Optionally, the role creation control includes a generated role control and an imported role control. The role setting area corresponding to the generated role control includes a role description input area and the like. The role setting area corresponding to the imported role control includes a reference image input area and the like.
[0079] Exemplarily, the role setting control is displayed in the target generation page. If there is no candidate material, the role setting control in the target generation page is clicked to display the role creation page. If there is candidate material, the role setting control in the target generation page is clicked to display the role display area. The role display area includes a target control, which is a control for triggering the role creation process. If a click operation on the target control is detected, the role creation page is displayed.
[0080] S520, in response to the interactive operation on the role creation control, a role setting area is displayed in the role creation page, and the role setting area is used to set a role description text or a role reference image.
[0081] Exemplarily, if the generated role control in the role creation page is selected, a role description input area and a role generation control are displayed in the role creation page, so that the user can input a role description text in the role description input area, and generate a new role material in the form of a text-to-image by clicking the role generation control.
[0082] Optionally, if the imported role control in the role creation page is selected, a reference image input area is displayed in the role creation page, so that the user can import a role reference image based on the reference image input area, and generate a new role material based on the role reference image.
[0083] FIG. 6a is a schematic diagram of a role creation page provided by an embodiment of the present disclosure. As shown in FIG. 6a, the role creation page 610 includes a generated role control 620 and an imported role control 630, and a role name input area 640. If the generated role control 620 is selected, the role creation page 610 further includes a role description input area 650 and a role generation control 660. If the imported role control 630 is selected, the role creation page 610 further includes a reference image input area 670. It should be noted that the selected control is represented by a red box, which is the generated role control 620 or the imported role control 630.
[0084] S530, in response to the interactive operation in the role setting area, a newly created role material is displayed in the role creation page.
[0085] The newly created role material is generated based on the role description text and / or the role reference image.
[0086] Fig. 6b is a schematic diagram of another role creation page according to an embodiment of the present disclosure. If a text input operation is detected in the role description input area 650, the role description text corresponding to the text input operation is displayed in the role description input area 650. If a click operation is detected on the role generation control 660, the role description text is input into a pre-trained image generation model, and an image of a new role material is generated based on the role description text by the image generation model. The new role material is determined based on the newly generated image and the role description text. The newly created role material is displayed in the role creation page 610.
[0087] Fig. 6c is a schematic diagram of yet another role creation page according to an embodiment of the present disclosure. The role creation page 610 includes a role description input area 650, a result display area 680, and an edit history display area 690. The role description input area 650 is for role description text. The result display area 680 is for role materials. The edit history display area 690 includes the generation results of the role materials by the generation model. If a generation result in the edit history display area 690 is selected, the role material displayed in the result display area 680 is switched accordingly.
[0088] Fig. 6d is a schematic diagram of yet another role creation page according to an embodiment of the present disclosure. If a click operation is detected on the reference image input area 670, an image selection window 680 is displayed. The image selection window 680 includes candidate images. The candidate images can be full-body or half-body images of a target object. The target object can be a person or an animal. If a selection operation is detected on a candidate image, the selected candidate image is displayed in the reference image input area 670 as a role reference image. The role reference image is input into a pre-trained image recognition model, and the target object in the role reference image is recognized by the image recognition model to output an object text description corresponding to the target object. A new role material is determined based on the role reference image and the object text description. The newly created role material is displayed in the role creation page 610.
[0089] Optionally, at least one role material can be generated based on the role creation page and stored in a role material library as a candidate material.
[0090] Optionally, in response to an interactive operation on a target role adjustment control in the role adjustment control set, an adjustment window is displayed, the adjustment window including the newly created role material and a role adjustment item; and in response to an interactive operation on the role adjustment item, an adjusted role material is displayed in the role creation page.
[0091] The role adjustment control set includes at least one of an image editing control such as a partial redrawing control, an expansion control, and an elimination control. The partial redrawing control is used to trigger redrawing editing of a locally non-expected area in the newly created role material to obtain a role material meeting expectations. If the newly created role material is a partial picture, the expansion control is used to trigger an operation of expanding the partial picture to obtain a full-body picture. The elimination control is used to trigger elimination of unwanted content from the newly created role material.
[0092] Illustratively, in response to a click operation on the partial redrawing control in the role adjustment control set, a redrawing window is displayed. The redrawing window includes a role material, a redrawing option, a text input box, and a redrawing trigger control. The role material is preprocessed based on the redrawing option, where the preprocessing includes at least one of scaling processing, erasing processing, or smearing processing. The role description text for the role material is included in the text input box. In response to an interactive operation on the text input box, the role description text is updated. In response to a click operation on the redrawing trigger control, a new text picture is generated based on the updated role description text in the text input box and the preprocessed role material, and a redrawing role material is obtained.
[0093] Optionally, in response to a click operation on the expansion control in the role adjustment control set, an expansion window is displayed. The role material displayed in the expansion window is a half-body picture, a text input box, and an expansion trigger control. The role description text for the role material is included in the text input box. In response to an interactive operation on the text input box, the role description text is updated. In response to a click operation on the expansion trigger control, the role material is expanded based on the updated role description text in the text input box, and a full-body picture is obtained.
[0094] Optionally, in response to a click operation on the elimination control in the role adjustment control set, an elimination window is displayed. The elimination window includes a role material, an elimination tool, and an elimination trigger control. The role material is smeared based on the elimination tool. In response to a click operation on the elimination trigger control, a new role material is generated based on the role material and the object to be eliminated, where the new role material does not include the object to be eliminated.
[0095] FIG. 7 is a schematic diagram of a role material redrawing process according to an embodiment of the present disclosure. As shown in FIG. 7, the partial redrawing control, the zoom-in control, and the erasing control are displayed in the form of a toolbar 720 in a role creation page 710. In response to a selection operation on the partial redrawing control, a redrawing window 730 is displayed. The redrawing window 730 includes a newly created role material 731, redrawing options 732, a text input box 733, and a redrawing trigger control 734. The redrawing options include a zoom-in option, a smearing option, or an erasing option. The role material 731 can be zoomed in or zoomed out by the zoom-in option. The smearing option can be used to mark a region to be adjusted 740 in the role material 731 in the redrawing window 730. The erasing option can be used to adjust the range of the region to be adjusted 740 in an erasing manner. The text input box can be used to input a text description of the redrawing expectation. When a click operation on the redrawing trigger control 734 is detected, the role material 731 in the region to be adjusted 740 is redrawn based on the text description in the text input box 733, and an adjusted role material 750 is obtained and displayed in the role creation page 710.
[0096] The technical scheme of the embodiment of the present disclosure displays a role creation page through a role creation operation, determines a role setting area displayed in the role creation page based on the interactive operation of the role creation control in the role creation page, generates a role material based on the set role description text or role reference image through the interactive operation in the role setting area, and displays the role material in the role creation page. Thus, a quick and convenient role creation method is provided to create a role material meeting the role expectation of a user. Since the role material meeting the role expectation can be generated, and the role material can be directly selected when generating media data, the efficiency of generating media data can be improved.
[0097] FIG. 8 is a flowchart of another media data generation method according to an embodiment of the present disclosure. The embodiment of the present disclosure is based on the above-mentioned embodiments, and limits the step of updating the role material in the role display area.
[0098] As shown in FIG. 8, the method includes the following steps.
[0099] S810, displaying a role display area in a target generation page, the role display area including at least one role material.
[0100] S820, displaying a role update control in a position corresponding to the role material in the role display area.
[0101] The role updating control includes at least one role updating item. Optionally, the role updating item is a role material editing item, a role material deleting item, or a text editing item. It should be noted that the text editing item is usually displayed at a corresponding position of the generated role material in response to a triggering operation of the role importing control, so as to correct the deviation of the role description text generated by the image generation method. If the role material is generated in response to a triggering operation of the role generating control, the text editing item is not displayed at the corresponding position of the role material.
[0102] In the embodiments of the present disclosure, the role material editing item is used to trigger a role material editing operation, including image updating and text updating of the role material. The role material deleting item is used to trigger a role material deleting operation. The text editing item is used to trigger text editing of the role material.
[0103] S830, in response to the interactive operation on the role updating item, the updated role material is displayed in the role display area.
[0104] For example, in response to the click operation on the role material editing item, the role creation page is displayed; and in response to the updating operation on the role creation page, the updated role material is displayed in the role display area.
[0105] For example, the updating operation includes updating the role description text, so as to achieve the effect of modifying the role material by the image generation method.
[0106] Since the image updating and text updating of the role material triggered by the role material editing item need to be performed in the role creation page, the role creation page is displayed in response to the click operation on the role updating item. The role description text in the role setting area of the role creation page is modified. If the click operation on the role generating control is detected, the updated role material is generated based on the modified role description text, and the updated role material is displayed in the role creation page. If the save button is clicked, the role material in the role display area is updated based on the updated role material, so as to display the updated role material in the role display area.
[0107] Optionally, in response to the interactive operation on the role updating item, the updated role material is displayed in the role display area, including: in response to the click operation on the text editing item, a text editing area is displayed in the target generation page; and in response to the updating operation on the text editing area, the updated text is displayed in the role display area.
[0108] Since the text editing item is usually displayed at a corresponding position of the character material generated based on the imported character control, and the deviation correction operation on the character description text is triggered through the text editing item, the image of the character material does not need to be modified. When a click operation on the text editing item is detected, the text editing area can be displayed in the target generation page, and the character description text is modified in the text editing area. If it is detected that the save button is clicked, the character description text in the character display area is synchronously updated based on the updated character material, so as to display the updated text in the character display area.
[0109] S840, in response to a character setting operation in the character display area, displaying target character material in the target generation page.
[0110] S850, in response to a text input operation in the target input area in the target generation page, displaying target text in the target input area.
[0111] S860, in response to a generation operation in the target generation page, displaying generated media data in the target generation page.
[0112] The technical scheme of the embodiment of the present disclosure displays a character update control in a position corresponding to the character material in the character display area, updates the character material based on the interaction operation of the character update control, and displays the updated character material in the character display area. The present disclosure realizes the update of the character material in the target generation page, and completes the deletion of the character and the text editing operation in the target generation page, which can simplify the update process of the character material. For the character material editing operation, the character creation page can be conveniently switched through the character update control in the target generation page.
[0113] FIG. 9 is a structure schematic diagram of a media data generation device provided by an embodiment of the present disclosure. The device can be realized in the form of software and / or hardware, and can be realized by an electronic device such as a mobile terminal, a PC terminal or a server.
[0114] As shown in FIG. 9, the device includes a display module 910, a setting operation 920, an input module 930 and a generation module 940.
[0115] The display module 910 is configured to display a character display area in a target generation page, and the character display area includes at least one character material, wherein the character material represents a character media data generated based on reference information.
[0116] The setting operation 920 is configured to display target character material in the target input area in the target generation page in response to a character setting operation in the character display area.
[0117] The input module 930 is configured to, in response to a text input operation in a target input area in the target generation page, display target text in the target input area, where the target text is used to describe an expected content of the media data.
[0118] The generation module 940 is configured to, in response to a generation operation in the target generation page, display generated media data in the target generation page, where the media data is generated based on the target role material and the target text.
[0119] Optionally, the role material is generated in the following manner:
[0120] In response to a role creation operation in the target generation page, a role creation page is displayed, and the role creation page includes a role creation control.
[0121] In response to an interaction operation on the role creation control, a role setting area is displayed in the role creation page, and the role setting area is used to set a role description text or a role reference image.
[0122] In response to an interaction operation in the role setting area, a newly created role material is displayed in the role creation page, where the newly created role material is generated based on the role description text and / or the role reference image.
[0123] The role creation page further includes a role adjustment control set, and the method further includes:
[0124] In response to an interaction operation on a target role adjustment control in the role adjustment control set, an adjustment window is displayed, and the adjustment window includes the newly created role material and a role adjustment item.
[0125] In response to an interaction operation on the role adjustment item, an adjusted role material is displayed in the role creation page.
[0126] Optionally, the display module 910 is specifically configured to:
[0127] In response to a role display operation in the target generation page, a role display area is displayed in the target generation page, and the role display area includes at least one role material.
[0128] Optionally, the role display operation includes a click operation on a role setting control in the target generation page, or an input operation of a role setting character in the target input area.
[0129] Optionally, the setting module 920 is specifically configured to:
[0130] In response to a role setting operation in the role display area, the target role material is displayed at a position corresponding to the role setting control.
[0131] Optionally, the role setting operation includes a role selection operation or a role switching operation.
[0132] Optionally, the method further comprises:
[0133] A role update control is displayed at a position corresponding to the role material in the role display area, wherein the role update control includes at least one role update item.
[0134] In response to an interactive operation on the role update item, an updated role material is displayed in the role display area.
[0135] Optionally, the role update item is a role material editing item, a role material deleting item, or a text editing item.
[0136] Optionally, in response to the interactive operation on the role update item, the updated role material is displayed in the role display area, including:
[0137] In response to a click operation on the role material editing item, a role creation page is displayed.
[0138] In response to an update operation on the role creation page, an updated role material is displayed in the role display area.
[0139] Optionally, in response to the interactive operation on the role update item, the updated role material is displayed in the role display area, including:
[0140] In response to a click operation on the text editing item, a text editing area is displayed in the target generation page.
[0141] In response to an update operation on the text editing area, an updated text is displayed in the role display area.
[0142] The media data generation apparatus provided by the embodiments of the present disclosure can execute the media data generation method provided by any of the embodiments of the present disclosure, and has the corresponding function modules and beneficial effects of executing the method.
[0143] It should be noted that each unit and module included in the above apparatus is only divided according to the function logic, but is not limited to the above division, as long as the corresponding function can be implemented; in addition, the specific name of each functional unit is only for convenient mutual distinction, and does not limit the protection scope of the embodiments of the present disclosure.
[0144] FIG. 10 is a structural diagram of an electronic device according to an embodiment of the disclosure. Hereinafter, referring to FIG. 10, a structural diagram of an electronic device (e.g., a terminal device or a server in FIG. 10) 1000 suitable for implementing an embodiment of the disclosure will be described. The terminal device in an embodiment of the disclosure can include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet Personal Computer), a PMP (Portable Multimedia Player), a car terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in FIG. 10 is only an example, and should not impose any limitation on the functions and use range of an embodiment of the disclosure.
[0145] As shown in FIG. 10, the electronic device 1000 can include a processing device (e.g., a central processing unit, a graphic processing unit, or the like) 1001, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1008 into a random access memory (RAM) 1003. In the RAM 1003, various programs and data required for the operation of the electronic device 1000 are also stored. The processing device 1001, the ROM 1002, and the RAM 1003 are connected to each other through a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.
[0146] Generally, the following devices can be connected to the I / O interface 1005: an input device 1006 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, and the like; an output device 1007 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, and the like; a storage device 1008 including, for example, a magnetic tape, a hard disk, and the like; and a communication device 1009. The communication device 1009 can allow the electronic device 1000 to communicate with other devices wirelessly or by wire to exchange data. Although FIG. 10 shows the electronic device 1000 having various devices, it should be understood that all of the shown devices are not required to be implemented or provided. More or less devices can be alternatively implemented or provided.
[0147] In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts can be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for executing the methods illustrated by the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network by the communication apparatus 1009, or installed from the storage apparatus 1008, or installed from the ROM 1002. When the computer program is executed by the processing apparatus 1001, the above-mentioned functions defined in the methods of embodiments of the present disclosure are executed.
[0148] The names of the messages or information exchanged between the plurality of devices in the embodiments of the present disclosure are only for illustrative purposes, and are not intended to limit the scope of the messages or information.
[0149] The electronic device provided by the embodiments of the present disclosure and the media data generation method provided by the above-mentioned embodiments belong to the same inventive concept, and the technical details not described in detail in the present embodiment can be referred to the above-mentioned embodiments, and the present embodiment has the same beneficial effects as the above-mentioned embodiments.
[0150] The embodiments of the present disclosure provide a computer storage medium, which stores a computer program, and the program is executed by a processor to implement the media data generation method provided by the above-mentioned embodiments.
[0151] It should be noted that the computer-readable medium described above can be a computer-readable signal medium or a computer-readable storage medium or any combination thereof. The computer-readable storage medium, for example, can be, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any suitable combination of the foregoing. More specific examples of the computer-readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the disclosure, the computer-readable storage medium can be any tangible medium that contains or stores a program used or used in conjunction with an instruction execution system, apparatus or device. In the disclosure, the computer-readable signal medium can include a data signal carried in a baseband or as a part of a carrier wave, which carries computer-readable program code. Such a propagated data signal can take various forms, including but not limited to an electromagnetic signal, an optical signal or any suitable combination of the foregoing. The computer-readable signal medium can also be any computer-readable medium other than the computer-readable storage medium, which can send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained in the computer-readable medium can be transmitted by any suitable medium, including but not limited to a wire, a cable, a RF (radio frequency) or the like, or any suitable combination of the foregoing.
[0152] In some embodiments, the client, server can communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet, and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.
[0153] The computer-readable medium described above can be contained in the electronic device described above; or can exist separately without being assembled into the electronic device.
[0154] The computer-readable medium described above carries one or more programs, when the one or more programs are executed by the electronic device, the electronic device:
[0155] The role display area is displayed in the target generation page, and the role display area includes at least one role material, wherein the role material represents role media data generated based on reference information;
[0156] In response to a role setting operation in the role display area, a target role material is displayed in a target input area in the target generation page;
[0157] In response to a text input operation in the target input area in the target generation page, a target text is displayed in the target input area, wherein the target text is used to describe an expected content of the media data;
[0158] In response to a generation operation in the target generation page, generated media data is displayed in the target generation page, wherein the media data is generated based on the target role material and the target text.
[0159] Computer program code for carrying out operations of the present disclosure can be written in any of one or more programming languages or combinations of languages including object or visual programming languages such as Java, Smalltalk, C++ or conventional procedural programming languages such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).
[0160] The flow and block diagrams in the drawings show architectural, functional, and operational architectures of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flow and block diagrams can represent a module, a segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may
[0161] The units described in the embodiments of the present disclosure can be implemented by software or by hardware. In some cases, the name of the unit does not constitute a limitation on the unit itself.
[0162] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, and without limitation, illustrative types of hardware logic components that can be used include Field-programmable Gate Arrays (FPGAs), Application-specific Integrated Circuits (ASICs), Application-specific Standard Products (ASSPs), System-on-a-chip systems (SOCs), Complex Programmable Logic Devices (CPLDs), etc.
[0163] In the context of the present disclosure, a machine-readable medium can be a tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium will include one or more lines of a program of a processor, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0164] The above description is merely exemplary of the present disclosure and the application of the principles thereof. It is not intended to limit the disclosure to the precise forms disclosed. Rather, it is intended to cover such alternatives, modifications, and equivalents as can be suggested by the principles of the disclosure and other printed publications that are prior art to the present disclosure. For example, it should be apparent that the disclosed technology can be implemented in a variety of computing system environments. Therefore, other implementations that are apparent to those of ordinary skill in the art, and that are within the scope of the present disclosure, are included in the present disclosure.
[0165] Furthermore, while operations are depicted in a particular, chronological sequence in this disclosure, this should not be understood as requiring that such operations be performed in the order described or that all operations be performed. In certain circumstances, multitasking and parallel processing can be advantageous. Likewise, the specific sequence of operations illustrated in the above discussion can not be required in all instances. Certain features described in the context of separate embodiments can be combined with each other. Conversely, various features described in the context of a single embodiment can be separated and performed by separate embodiments.
[0166] Although the subject matter has been described in language specific to structural features and / or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
Claims
1. A method for generating media data, comprising: displaying a character display area in a target generation page, the character display area comprising at least one character material, wherein the character material represents character media data generated based on reference information; in response to a character setting operation in the character display area, displaying a target character material in a target input area in the target generation page; in response to a text input operation in the target input area in the target generation page, displaying a target text in the target input area, wherein the target text is used to describe an intended content of the media data; in response to a generation operation in the target generation page, displaying a generated media data in the target generation page, wherein the media data is generated based on the target character material and the target text.
2. The method of claim 1, wherein, a generation manner of the character material comprises: in response to a character creation operation in the target generation page, displaying a character creation page, the character creation page comprising a character creation control; in response to an interaction operation on the character creation control, displaying a character setting area in the character creation page, the character setting area being used to set a character description text or a character reference image; in response to an interaction operation in the character setting area, displaying a newly created character material in the character creation page, wherein the newly created character material is generated based on the character description text and / or the character reference image.
3. The method of claim 2, wherein, the character creation page further comprises a set of character adjustment controls, and the method further comprises: in response to an interaction operation on a target character adjustment control in the set of character adjustment controls, displaying an adjustment window, the adjustment window comprising the newly created character material and a character adjustment item; in response to an interaction operation on the character adjustment item, displaying an adjusted character material in the character creation page.
4. The method according to any one of claims 1 to 3, wherein, the displaying of the character display area in the target generation page, the character display area comprising at least one character material, comprises: in response to a character display operation in the target generation page, displaying a character display area in the target generation page, the character display area comprising at least one character material.
5. The method of claim 4, wherein, the character display operation comprises a click operation on a character setting control in the target generation page, or an input operation of a character setting character in the target input area. 6.The method of claim 5, further comprising: in response to a character setting operation in the character display area, displaying the target character material at a position corresponding to the character setting control.
7. The method according to any one of claims 1 to 6, wherein, the character setting operation comprises a character selection operation or a character switching operation. 8.The method of any one of claims 1-7, further comprising: displaying a character update control at a position corresponding to the character material in the character display area, wherein the character update control comprises at least one character update item; in response to an interaction operation on the character update item, displaying an updated character material in the character display area.
9. The method of claim 8, wherein, the character update item is a character material editing item, a character material deleting item, or a text editing item.
10. The method of claim 9, wherein, the displaying of the updated character material in the character display area in response to the interaction operation on the character update item comprises: In response to a click operation on the role material editing item, a role creation page is displayed; In response to an update operation in the role creation page, the updated role material is displayed in the role display area.
11. The method of claim 9, wherein, The response to the interaction operation on the role update item includes: In response to a click operation on the text editing item, a text editing area is displayed in the target generation page; In response to an update operation on the text editing area, the updated text is displayed in the role display area.
12. A media data generation apparatus, comprising: a display module configured to display a role display area in a target generation page, the role display area including at least one role material, wherein the role material represents a role media data generated based on reference information; a setting operation configured to display a target role material in a target input area in the target generation page in response to a role setting operation in the role display area; an input module configured to display a target text in the target input area in response to a text input operation in the target input area in the target generation page, wherein the target text is used to describe an intended content of the media data; a generation module configured to display a generated media data in the target generation page in response to a generation operation in the target generation page, wherein the media data is generated based on the target role material and the target text.
13. An electronic device, comprising: one or more processors; a storage device configured to store one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the media data generation method of any one of claims 1-11.
14. A storage medium containing computer-executable instructions, wherein, The computer executable instructions, when executed by a computer processor, perform the media data generation method of any one of claims 1-11.
15. A computer program product comprising a computer program, wherein, The computer program, when executed by a processor, implements the media data generation method of any one of claims 1-11.
Citation Information
Patent Citations
Video editing method and device, computer equipment, storage medium and product
CN115129212A
Video generation method and device, medium and electronic equipment
CN117596452A
Video generation method and device, equipment, storage medium and program product
CN117692699A
Adaptive editing experience for mixed media content
US20240127512A1