Multimedia data sending method, terminal, and server

By generating first layout information and determining the derived area of ​​multimedia data in a personalized manner according to user-set parameters, the problems of low accuracy and efficiency of derived area data in the prior art are solved, and efficient and accurate multimedia data generation is achieved.

WO2025195263A1PCT designated stage Publication Date: 2025-09-25HUAWEI TECH CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2025/082165
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-03-21
Filing Date
2025-03-12
Publication Date
2025-09-25

AI Technical Summary

Technical Problem

When existing multimedia technologies generate derived regional data in different fields, they are prone to fail to retain the content that users need to retain, thereby reducing the accuracy and efficiency of the derived regional data.

Method used

By responding to the user's layout setting operation, first layout information corresponding to the first multimedia data is generated, and second multimedia data containing the first area is generated based on the layout information, ensuring that the key content in the original multimedia data is retained, and the generation method of the derived area is personalized according to the setting parameters such as industry type, target size and correlation index.

Benefits of technology

It realizes personalized generation of derived area data, improves the accuracy and generation efficiency of derived area data, ensures the visibility of content required by users, and avoids the loss of retained content.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2025082165_25092025_PF_FP_ABST
    Figure CN2025082165_25092025_PF_FP_ABST
Patent Text Reader

Abstract

The present application is suitable for the technical field of data processing, and provides a multimedia data sending method, a terminal, and a server. The method comprises: in response to a layout setting operation initiated by a user, on the basis of a setting parameter corresponding to the layout setting operation, generating first layout information corresponding to first multimedia data specified by the user, wherein the first layout information is used for determining a first area in the first multimedia data; and on the basis of the first layout information, generating at least one second multimedia data comprising the first area. In the technical solution provided by the present application, a first area needing to be retained by a user can be accurately determined, so as to generate derived area data retaining area data of the first area in original multimedia data, thereby improving the generation accuracy of the derived area data, and also improving the efficiency of generating the derived area data in batches.
Need to check novelty before this filing date? Find Prior Art

Description

Multimedia data transmission method, terminal and server

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on March 21, 2024, with application number 202410332849.2 and application name “A method, terminal and server for sending multimedia data”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application belongs to the field of data processing technology, and in particular relates to a method, terminal, and server for sending multimedia data. Background Art

[0003] Multimedia, as the primary medium for presenting content today, is widely used in various fields. Efficiently and accurately generating the multimedia data required by users has become a key focus. Existing multimedia technologies allow users to import desired multimedia data, such as images and videos, into pre-set templates, thereby batch-generating multiple derived region data consistent with the template's layout structure. These templates can define fixed reserved and adjusted regions.

[0004] However, since different fields require different contents to be retained, when generating derived region data using the above method, the contents required by the user in the original multimedia data may not be retained, thereby reducing the accuracy of the generated derived region data. Summary of the Invention

[0005] The embodiments of the present application provide a method, terminal and server for sending multimedia data, which can solve the problem in existing multimedia technology that the same template is used to generate derivative area data in different fields, which easily leads to the inability to retain the content required by the user, thereby reducing the accuracy of the generated derivative area data.

[0006] In a first aspect, an embodiment of the present application provides a method for generating multimedia data, which is applied to a terminal. The method for generating multimedia data includes:

[0007] In response to a layout setting operation initiated by a user, generating first layout information corresponding to the first multimedia data specified by the user according to setting parameters corresponding to the layout setting operation; the first layout information is used to determine a first area in the first multimedia data;

[0008] At least one second multimedia data including the first area is generated based on the first layout information.

[0009] The implementation of the embodiment of the present application has the following beneficial effects: based on the user's layout setting operation, first layout information corresponding to the first multimedia data is generated, and then when generating the derived region data corresponding to the first multimedia data, that is, when generating the second multimedia data, the region data of the first region in the first multimedia data is retained according to the first layout information, thereby obtaining the second multimedia data containing the region data of the first region, thereby achieving the purpose of personalized generation of the derived region data. Compared with existing multimedia technologies, the multimedia data generation method provided by the embodiment of the present application does not use the same template for data derivation for all multimedia data, but can personalize the corresponding first layout information based on the user's setting operation and the original multimedia data specified by the user, thereby accurately determining the first region that the user needs to retain, thereby generating the derived region data that retains the region data of the first region in the original multimedia data, thereby improving the accuracy of the generation of the derived region data and also improving the efficiency of batch generation of the derived region data.

[0010] In a possible implementation of the first aspect, the first layout information is further used to determine a second region in the first multimedia data, and generating at least one second multimedia data including the first region based on the first layout information includes:

[0011] generating at least one derived region data associated with the second region;

[0012] The second multimedia data is generated according to the first region data of the first region and the derived region data.

[0013] In a possible implementation of the first aspect, the setting parameter includes a derivation number N; and the generating at least one derived area data associated with the second area includes:

[0014] generating N pieces of derived region data associated with the second region;

[0015] The generating the second multimedia data according to the first region data and the derived region data of the first region includes:

[0016] N pieces of the second multimedia data are generated based on the N pieces of the derived region data and the first region data.

[0017] In a possible implementation of the first aspect, the setting parameters include an association index; and the generating at least one derived area data associated with the second area includes:

[0018] performing semantic recognition on the second region data of the second region to obtain semantic description information of the second region;

[0019] At least one of the derived region data is generated according to the association index and the semantic description information.

[0020] In a possible implementation of the first aspect, the setting parameter includes a target size; and generating, based on the first layout information, at least one second multimedia data including the first area includes:

[0021] At least one second multimedia data matching the target size is generated based on the first layout information.

[0022] In a possible implementation of the first aspect, in response to a layout setting operation initiated by the user, generating first layout information corresponding to the first multimedia data specified by the user according to setting parameters corresponding to the layout setting operation includes:

[0023] determining, from the first multimedia data, at least one first region corresponding to the industry type according to the industry type corresponding to the first multimedia data;

[0024] The first layout information is generated according to at least one of the first regions.

[0025] In a possible implementation of the first aspect, before determining, from the first multimedia data, at least one first area corresponding to the industry type corresponding to the first multimedia data, the method includes:

[0026] In response to the layout setting operation, the industry type corresponding to the first multimedia data is determined.

[0027] In a possible implementation of the first aspect, after generating, in response to a layout setting operation initiated by the user, first layout information corresponding to the first multimedia data specified by the user according to setting parameters corresponding to the layout setting operation, further comprising:

[0028] In response to an adjustment operation initiated by a user based on the first layout information, performing layout adjustment on the first layout information to generate second layout information;

[0029] At least one second multimedia data including the first area is generated based on the second layout information.

[0030] In a possible implementation of the first aspect, in response to a layout setting operation initiated by the user, generating first layout information corresponding to the first multimedia data specified by the user according to setting parameters corresponding to the layout setting operation includes:

[0031] In response to a layout setting operation initiated by a user, sending a setting data packet to a server; the setting data packet includes the setting parameters and the first multimedia data;

[0032] Receive the first layout information fed back by the server.

[0033] In a possible implementation of the first aspect, generating, based on the first layout information, at least one second multimedia data including the first area includes:

[0034] Sending layout confirmation information about the first layout information to the server; the layout confirmation information includes the first layout information or second layout information obtained by adjusting the first layout information;

[0035] The server generates at least one second multimedia data according to the layout confirmation information and the setting parameters.

[0036] In a second aspect, an embodiment of the present application provides a device for generating multimedia data, which is applied to a terminal. The device includes:

[0037] a layout setting unit, configured to generate, in response to a layout setting operation initiated by a user, first layout information corresponding to the first multimedia data specified by the user according to setting parameters corresponding to the layout setting operation; the first layout information being used to determine a first region in the first multimedia data;

[0038] A derivation unit is configured to generate at least one second multimedia data including the first area based on the first layout information.

[0039] In a possible implementation of the second aspect, the deriving unit includes:

[0040] a derived region generating unit, configured to generate at least one derived region data associated with the second region;

[0041] The derived region merging unit is configured to generate the second multimedia data according to the first region data of the first region and the derived region data.

[0042] In a possible implementation of the second aspect, the setting parameter includes a derivation number N; the derivation region generating unit is specifically configured to generate N derivation region data associated with the second region;

[0043] The derived region merging unit is specifically configured to generate N pieces of the second multimedia data based on the N pieces of the derived region data and the first region data.

[0044] In a possible implementation manner of the second aspect, the setting parameters include a correlation index; and the derived region generating unit includes:

[0045] a semantic description determining unit, configured to perform semantic recognition on the second region data of the second region to obtain semantic description information of the second region;

[0046] The semantic derivation unit is configured to generate at least one of the derived region data according to the association index and the semantic description information.

[0047] In a possible implementation manner of the second aspect, the setting parameter includes a target size; and the deriving unit includes:

[0048] A size adjustment unit is configured to generate at least one second multimedia data that matches the target size based on the first layout information.

[0049] In a possible implementation of the second aspect, the layout setting unit includes:

[0050] an industry type determining unit, configured to determine, from the first multimedia data, at least one first region corresponding to the industry type according to the industry type corresponding to the first multimedia data;

[0051] The first region generating unit is configured to generate the first layout information according to at least one first region.

[0052] In a possible implementation of the second aspect, the generating device further includes:

[0053] An industry type setting unit is configured to determine the industry type corresponding to the first multimedia data in response to the layout setting operation.

[0054] In a possible implementation of the second aspect, the generating device further includes:

[0055] a layout adjustment unit, configured to adjust the first layout information in response to an adjustment operation initiated by a user based on the first layout information, and generate second layout information;

[0056] The second layout generating unit is configured to generate at least one second multimedia data including the first area based on the second layout information.

[0057] In a possible implementation of the second aspect, the layout setting unit includes:

[0058] a setting data packet sending unit, configured to send a setting data packet to a server in response to a layout setting operation initiated by a user; the setting data packet includes the setting parameters and the first multimedia data;

[0059] The first layout information receiving unit is configured to receive the first layout information fed back by the server.

[0060] In a possible implementation of the second aspect, the deriving unit includes:

[0061] a layout confirmation information sending unit, configured to send layout confirmation information about the first layout information to the server; the layout confirmation information includes the first layout information or second layout information obtained by adjusting the first layout information;

[0062] The second layout derivation unit is configured to receive at least one second multimedia data generated by the server according to the layout confirmation information and the setting parameters.

[0063] In a third aspect, an embodiment of the present application provides a method for generating multimedia data, which is applied to a server. The method for generating multimedia data includes:

[0064] Receiving a setting data packet sent by a terminal; the setting data packet includes first multimedia data and setting parameters determined based on a user's layout setting operation;

[0065] determining, based on the setting data packet, layout confirmation information corresponding to the first multimedia data; the layout confirmation information being used to determine a first region in the first multimedia data;

[0066] At least one second multimedia data including the first area is generated according to the layout confirmation information and the setting parameters.

[0067] In a possible implementation of the third aspect, the layout confirmation information includes first layout information;

[0068] The determining, based on the setting data packet, layout confirmation information corresponding to the first multimedia data includes:

[0069] generating first layout information corresponding to the first multimedia data based on the setting data packet;

[0070] sending the first layout information to the terminal;

[0071] The generating, according to the layout confirmation information and the setting parameters, at least one second multimedia data including the first area includes:

[0072] In response to the confirmation instruction sent by the terminal, at least one second multimedia data is generated according to the first layout information and setting parameters.

[0073] In a possible implementation of the third aspect, the layout confirmation information includes second layout information;

[0074] After sending the first layout information to the terminal, the method further includes:

[0075] In response to the adjustment instruction sent by the terminal, performing layout adjustment on the first layout information based on the adjustment instruction to obtain second layout information;

[0076] The generating, according to the layout confirmation information and the setting parameters, at least one second multimedia data including the first area includes:

[0077] At least one second multimedia data is generated according to the second layout information and the setting parameters.

[0078] In a possible implementation of the third aspect, the layout confirmation information is further used to determine a second area in the first multimedia data, and generating at least one second multimedia data including the first area based on the layout confirmation information and the setting parameters includes:

[0079] generating at least one derived region data associated with the second region;

[0080] The second multimedia data is generated according to the first region data of the first region and the derived region data.

[0081] In a possible implementation of the third aspect, the setting parameter includes a derivation number N; and the generating at least one derived area data associated with the second area includes:

[0082] generating N pieces of derived region data associated with the second region;

[0083] The generating the second multimedia data according to the first region data and the derived region data of the first region includes:

[0084] N pieces of the second multimedia data are generated based on the N pieces of the derived region data and the first region data.

[0085] In a possible implementation of the third aspect, the setting parameters include an association index; and the generating at least one derived area data associated with the second area includes:

[0086] performing semantic recognition on the second region data of the second region to obtain semantic description information of the second region;

[0087] At least one of the derived region data is generated according to the association index and the semantic description information.

[0088] In a possible implementation of the third aspect, the setting parameters include a target size; and generating, according to the layout confirmation information and the setting parameters, at least one second multimedia data including the first area includes:

[0089] Based on the layout confirmation information, at least one second multimedia data matching the target size is generated.

[0090] In a possible implementation of the third aspect, the setting parameter includes an industry type corresponding to the first multimedia data, and determining, based on the setting data packet, layout confirmation information corresponding to the first multimedia data includes:

[0091] According to the industry type corresponding to the first multimedia data, determining at least one first area corresponding to the industry type from the first multimedia data;

[0092] The layout confirmation information is obtained according to at least one of the first regions.

[0093] In a fourth aspect, an embodiment of the present application provides a device for generating multimedia data, which is applied to a server. The device for generating multimedia data includes:

[0094] A setting receiving unit, configured to receive a setting data packet sent by a terminal; the setting data packet includes first multimedia data and setting parameters determined based on a user's layout setting operation;

[0095] a layout confirmation unit, configured to determine layout confirmation information corresponding to the first multimedia data based on the setting data packet; the layout confirmation information is used to determine a first area in the first multimedia data;

[0096] The derivative data generating unit is configured to generate at least one second multimedia data including the first area according to the layout confirmation information and the setting parameters.

[0097] In a possible implementation of the fourth aspect, the layout confirmation information includes first layout information;

[0098] The layout confirmation unit includes:

[0099] a first layout information determining unit, configured to generate first layout information corresponding to the first multimedia data based on the setting data packet;

[0100] a first layout information sending unit, configured to send the first layout information to the terminal;

[0101] The derivative data generating unit includes:

[0102] The first derivative data generating unit is configured to generate at least one second multimedia data according to the first layout information and setting parameters in response to a confirmation instruction sent by the terminal.

[0103] In a possible implementation of the fourth aspect, the layout confirmation information includes second layout information;

[0104] The generating device also includes:

[0105] a second layout information determining unit, configured to, in response to an adjustment instruction sent by the terminal, perform layout adjustment on the first layout information based on the adjustment instruction to obtain second layout information;

[0106] The derivative data generating unit includes:

[0107] The second derivative data generating unit is configured to generate at least one second multimedia data according to the second layout information and the setting parameters.

[0108] In a possible implementation of the fourth aspect, the layout confirmation information is further used to determine a second area in the first multimedia data, and the derivative data generation unit includes:

[0109] a derived region data generating unit, configured to generate at least one derived region data associated with the second region;

[0110] The derived region merging unit is configured to generate the second multimedia data according to the first region data of the first region and the derived region data.

[0111] In a possible implementation of the fourth aspect, the setting parameter includes a derivation number N; the derived region data generating unit is specifically configured to generate N derived region data associated with the second region;

[0112] The derived region merging unit is specifically configured to generate N pieces of the second multimedia data based on the N pieces of the derived region data and the first region data.

[0113] In a possible implementation of the fourth aspect, the setting parameters include a correlation index; and the derived region data generating unit includes:

[0114] a semantic description determining unit, configured to perform semantic recognition on the second region data of the second region to obtain semantic description information of the second region;

[0115] The semantic description generating unit is configured to generate at least one of the derived region data according to the association index and the semantic description information.

[0116] In a possible implementation manner of the fourth aspect, the setting parameter includes a target size; and the derived data generating unit includes:

[0117] A size adjustment unit is configured to generate at least one second multimedia data that matches the target size based on the layout confirmation information.

[0118] In a possible implementation of the fourth aspect, the setting parameter includes an industry type corresponding to the first multimedia data, and the derived data generating unit includes:

[0119] an industry type confirmation unit, configured to determine, from the first multimedia data, at least one first region corresponding to the industry type according to the industry type corresponding to the first multimedia data;

[0120] The layout confirmation information generating unit is configured to obtain the layout confirmation information according to at least one of the first regions.

[0121] In a fifth aspect, an embodiment of the present application provides a terminal comprising: a memory, a processor, and a program stored in the memory, wherein when the processor executes the program, the steps in the method for generating multimedia data described in the first aspect are implemented.

[0122] In a sixth aspect, an embodiment of the present application provides a server comprising: a memory, a processor, and a program stored in the memory, wherein when the processor executes the program, the steps in the method for generating multimedia data described in the first aspect are implemented.

[0123] In a seventh aspect, an embodiment of the present application provides a readable storage medium, which stores a program. When the program is executed by a processor, it implements the steps in the method for generating multimedia data described in any one of the first aspect or the third aspect.

[0124] In an eighth aspect, an embodiment of the present application provides a program product, which, when executed on a device, enables the device to execute the steps of the method for generating multimedia data described in any one of the first aspect or the third aspect.

[0125] In a ninth aspect, an embodiment of the present application provides a system for generating multimedia data, which comprises a terminal as described in any one of the fifth aspects and a server as described in any one of the sixth aspects.

[0126] It can be understood that the beneficial effects of the second to ninth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0127] FIG1 is a schematic diagram of an existing method for generating promotional images in batches;

[0128] FIG2 is a schematic diagram of another existing method for generating promotional images in batches;

[0129] FIG3 is a schematic diagram of a derivative image generated based on an existing method for generating promotional images;

[0130] FIG4 is a schematic diagram of an application scenario of the method for generating multimedia data provided by an embodiment of the present application;

[0131] FIG5 is a flowchart of a method for generating multimedia data according to an embodiment of the present application;

[0132] FIG6 is a schematic diagram of an operation of generating derivative multimedia data according to an embodiment of the present application;

[0133] FIG7 is a schematic diagram of setting operations for the above-mentioned type of setting items provided in one embodiment of the present application;

[0134] FIG8 is a schematic diagram of first layout information provided by an embodiment of the present application;

[0135] FIG9 is a schematic diagram showing a comparison between original multimedia data and derived multimedia data provided by an embodiment of the present application;

[0136] FIG10 is a schematic diagram of generating derivative multimedia data based on a target size according to an embodiment of the present application;

[0137] FIG11 is a schematic diagram of generating multiple multimedia data based on derived data according to an embodiment of the present application;

[0138] FIG12 is a schematic diagram of generating derivative multimedia data according to an embodiment of the present application;

[0139] FIG13 is a schematic diagram of generating derivative multimedia data according to an embodiment of the present application;

[0140] FIG14 is a schematic diagram of storage of derivative multimedia data provided by an embodiment of the present application;

[0141] FIG15 is a schematic diagram of an application scenario of the method for generating multimedia data provided by another embodiment of the present application;

[0142] FIG16 is an interactive flow chart of a method for generating multimedia data provided in an embodiment of the present application;

[0143] FIG17 is a flowchart of a method for generating multimedia data provided by an embodiment of the present application on the server side;

[0144] FIG18 is a structural block diagram of a device for generating multimedia data applied to a terminal according to an embodiment of the present application;

[0145] FIG19 is a structural block diagram of a device for generating multimedia data applied to a server according to an embodiment of the present application;

[0146] FIG20 is a schematic structural diagram of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0147] In the following description, specific details such as specific system structures and techniques are provided for purposes of illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obscuring the description of the present application with unnecessary detail.

[0148] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or collections thereof.

[0149] It will also be understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0150] As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0151] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0152] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof all mean "including but not limited to," unless otherwise specifically emphasized.

[0153] With the continuous advancement of electronicization, the carriers of information promotion are gradually shifting from paper media to electronic media. Therefore, how to efficiently batch generate the electronic media content required by users, such as multimedia data such as videos and images used for information promotion, has become a focus of attention. Existing multimedia technology can batch generate multimedia data by importing fixed templates. Specifically, there are two methods:

[0154] Method 1:

[0155] Figure 1 shows a schematic diagram of an existing method for batch-generating promotional images. As shown in Figure 1 , a user can generate a promotional image, namely, Image 1, based on product promotion needs. Image 1 includes product-related promotional content, such as the product name, brand logo, or brand slogan. If a user needs to batch-generate derivative images based on Image 1, they can import Image 1 into Template 1, as shown in Figure 1 . Region 1 in Template 1 is an area containing elements native to the template, which can generate different regional content using a random generation algorithm. Region 2 is an area for displaying user-imported images. For example, Region 1 imported by the user can be displayed within Region 2. The resulting derivative images can be shown as Images 2 and 3 in Figure 1 . Image 2 and Image 3 display different content in Region 1, while the content displayed in Region 2 is the same as Image 1 imported by the user. This allows for the generation of derivative images related to the same promotional image based on the same promotional image.

[0156] However, in the aforementioned promotional image generation method, while the content within Region 1 can be adjusted according to a random generation algorithm and merged with user-input images in Region 2 to generate a large number of derivative images, Region 2 only occupies a portion of the derivative image. This may result in users not being able to effectively perceive the desired product content. Specifically, when viewing the derivative image, users' attention will be distracted by irrelevant random content in Region 1, thereby reducing the derivative image's effectiveness in promoting the product and resulting in lower visibility of the product's promotional content.

[0157] Method 2:

[0158] FIG2 shows a schematic diagram of another existing method for batch generating promotional images. Referring to FIG2 , the user's promotional image is image 1, which includes area 1 containing promotional content and area 2 containing background content. If the user needs to batch generate derivative images related to the above-mentioned image 1, the image 1 can be imported into template 2 as shown in FIG2 , which includes area 3 for generating random content and area 4 for retaining the original content. At this time, if area 1 containing promotional content in image 1 overlaps with area 4 for retaining the original content in template 2, corresponding derivative content can be randomly generated for the overlapping portion of area 2 and area 4 through template 2, thereby generating the image 2 shown in FIG2 , wherein the content of area 4 can generate different content according to a random generation algorithm, thereby generating derivative images related to image 1 in batches by changing the content of area 4.

[0159] However, in the above-mentioned method of generating promotional images, since the area for retaining content and the area for random content in template 2 are fixed, if the area 1 for displaying promotional content in the user's promotional image 1 overlaps with the above-mentioned area 3, the required promotional content may be lost. By way of example, FIG3 shows a schematic diagram of a derivative image generated based on the existing method of generating promotional images. As shown in FIG3 , the area 1 for displaying promotional content in image 3 overlaps with the area 3 for generating random content in template 2. Therefore, when generating a derivative image of image 3 through template 2, part of the text in area 1 will be lost, resulting in image 4 as shown in FIG3 . At this time, the user can only manually adjust the above-mentioned template 2 so that template 2 can adapt to the promotional image input each time, thereby reducing the efficiency of generating derivative images.

[0160] Therefore, in order to solve the problem of existing technologies for batch generation of multimedia data, the visibility of the content that the user needs to retain in the batch-generated derivative multimedia data is reduced compared with the user's original multimedia data, and since the template is fixed, the retained content cannot be dynamically adjusted according to the multimedia data, resulting in the loss of the required promotional content. The present application provides a method for generating multimedia data, which can maintain the visibility of the content that the user needs to retain and avoid the loss of retained content while realizing batch generation of derivative multimedia data.

[0161] Example 1:

[0162] Exemplarily, Figure 4 shows a schematic diagram of an application scenario of the multimedia data generation method provided by an embodiment of the present application. Referring to Figure 4, in this application scenario, the execution subject of the above-mentioned multimedia data generation method is specifically a terminal, which can be a terminal device such as a smart phone, a laptop computer, a tablet computer, a desktop computer, etc. An application for batch generation of derivative multimedia data can be installed in the above-mentioned terminal, and the user can batch generate derivative multimedia data through the application running in the terminal.

[0163] The following describes in detail the implementation process of the method for generating multimedia data provided by an embodiment of the present application. In conjunction with the application scenario of Figure 4, Figure 5 shows an implementation flow chart of the method for generating multimedia data provided by an embodiment of the present application. Referring to Figure 5, the method for generating multimedia data provided by an embodiment of the present application specifically includes five steps, namely: a step of setting derivative parameters S501, a step of importing original multimedia data S502, a step of setting data processing S503, a step of confirming layout information S504, and a step of generating derived multimedia data S505. The specific implementation process of the above five steps is detailed as follows:

[0164] In S501, the terminal device receives a layout setting operation initiated by a user and determines at least one setting parameter input by the user; wherein the setting parameters include: industry type, target size, derivative quantity, and correlation index.

[0165] In this embodiment, an application for batch generating derivative multimedia data can be installed on the terminal. The user can start the above application on the terminal to display the corresponding operation interface on the terminal, and initiate the layout setting operation for the derived multimedia data in the operation interface, so as to realize personalized settings for the regional layout of the derived multimedia data to improve the accuracy of the layout information and the fit with the user's promotion needs.

[0166] For example, FIG6 shows an operational diagram of generating derivative multimedia data provided by an embodiment of the present application. Referring to FIG6 (a), a plurality of different applications are installed on the terminal, including an application 61 for batch generating derivative multimedia data. The user can open the aforementioned application 61 to open the corresponding batch generation operation interface, as shown in FIG6 (b). The aforementioned operation interface includes a plurality of setting items, namely, a size setting item 62, a derivative quantity setting item 63, a type setting item 64, and a correlation setting item 65. The user can set each of the above setting items in the operation interface according to their own needs, that is, initiate the corresponding layout setting operation.

[0167] In some implementations, the layout setting operation initiated by the user may specifically include the following setting parameters, which correspond to the operation of setting the setting items 62 to 65 in FIG. 6 , and are specifically described as follows:

[0168] Setting parameter 1: target size

[0169] In this embodiment, the user can set the size of the derived multimedia data. In this case, the user can enter a target size, such as 720*1080, in the size setting item 62, thereby limiting the aspect ratio of the derived multimedia data. In some implementation scenarios, the target size can be 720cm*1080cm, meaning a specific size can also be set. In some implementation scenarios, the target size can also be 720 pixels (pi)*1080pi, meaning that the size of the derived multimedia data can be determined while also setting the resolution of the derived multimedia data. The specific target size input can be set based on actual circumstances, and the dimension of the size setting is not limited herein.

[0170] In some implementations, if the size of the derived multimedia data is the same as the size of the original multimedia data, the size setting item 62 may be configured as a default value, that is, no content is input into the setting item 62 .

[0171] In some implementations, the user may also set a default size in the application. When the user does not set the size setting item 62 , the derived multimedia data may be set to the default size.

[0172] In some implementations, the above-mentioned operation interface may also include a check control for a default size, such as control 611. If the user checks the above-mentioned default size, the size of the derived multimedia data will be set to a preset default size, that is, the user does not need to fill in the size every time, thereby improving the user's operating efficiency.

[0173] Set parameter 2: Derived quantity

[0174] In this embodiment, the user can set the desired amount of derivative multimedia data. The user can modify the value in the derivative quantity setting item 63 to quantitatively generate a specified amount of derivative multimedia data. For example, if the user wants to publish different promotional images on six platforms, then in addition to the generated original multimedia data, five additional derivative promotional images are required. In this case, the user can enter 6 in the derivative quantity setting item 63 to initiate the setting operation for the derivative quantity.

[0175] In some implementations, the user may also set a default derivative quantity in the application. For example, if the default derivative quantity is 6, when the user does not set the derivative quantity setting item 63, the derived multimedia data may be set to the default derivative quantity.

[0176] In some implementations, if the user has not set the derivative quantity setting item 63, the derivative quantity may be set to the same as the derivative quantity during the last user operation. For example, the terminal application may establish a corresponding operation database for different users, recording each user's operation record for batch generation of derivative multimedia data. The operation record includes relevant information about each batch of generated derivative multimedia data, such as the number of generated derivative multimedia data. Based on this, if it is detected that the user has not set the derivative quantity for this time, the derivative quantity corresponding to the last operation can be obtained from the operation record as the derivative quantity for the current batch of generated derivative multimedia data.

[0177] Setting parameter 3: Industry type

[0178] In this embodiment, the user can specify the industry type of the imported original multimedia data. In order to accurately locate the area to be retained (i.e., the first area) from the original multimedia data, the user can specify the industry type of the original multimedia data in the above operation interface, that is, set the above type setting item 64. Since the layout of multimedia data is often related to the industry type corresponding to the product to be promoted, setting the industry type can facilitate the subsequent determination of the area in the original multimedia data where content needs to be retained (i.e., the first area).

[0179] For example, FIG7 shows a schematic diagram of the operation of setting the above-mentioned type setting items provided by an embodiment of the present application. Referring to FIG7 (a), the user can set the above-mentioned type setting item 64 after importing the original multimedia data (or before importing the multimedia data). By clicking the above-mentioned type setting item 64, a corresponding drop-down menu, i.e., menu 71, will be displayed, as shown in FIG7 (b). The above-mentioned industry types can be divided according to the industry to which the user promoting the multimedia data belongs. That is, the above-mentioned menu 71 can display multiple candidate industry types, such as e-commerce, reading, audio and video entertainment, tool software, games, social networking, news information, travel and transportation, automobiles, life services, finance, real estate, education, healthcare, etc. Of course, the above-mentioned industry types can also be divided according to other methods, such as categorizing according to the content of the multimedia data, such as games, electrical appliances, food, medical care, etc. The specific method of dividing the industry types is not limited. The user can select one of the above-mentioned multiple candidate types as the industry type corresponding to the original multimedia data. For example, select "e-commerce" as the industry type, and then the setting item 64 will be filled with the corresponding industry type, as shown in FIG7 (c).

[0180] In some implementations, the above operation interface may further include an automatic identification option 72 . When the user clicks the above option 72 , the application may perform type identification on the multimedia data imported by the user.

[0181] Because different industry types require different content to be retained, for example, if the industry type is an appliance type, the content to be retained is content related to the target appliance, including the appliance model and other related information; if the industry type is a game type, the content to be retained is the game name, game logo, and main characters, etc. That is, the focus of the content to be retained varies depending on the industry type. In order to improve the accuracy of subsequent first area recognition, the industry type can be set, that is, the type setting item 64 can be layout-set to improve the accuracy of subsequent recognition.

[0182] In some implementations, the user can first import the above-mentioned original multimedia data. The application installed on the terminal for batch generating derivative multimedia data can determine the industry type corresponding to the original multimedia data by performing data analysis on the above-mentioned original multimedia data, and display it in the above-mentioned type setting item 64. If the industry type automatically identified by the application does not meet the user's classification expectations for the original multimedia data, the industry type of the original multimedia data can be adjusted by clicking the above-mentioned type setting item 64; if the industry type automatically identified by the application is consistent with the user's classification expectations for the original multimedia data, there is no need to adjust the above-mentioned industry type, thereby improving the user's operating efficiency.

[0183] In some implementations, the user can also set a default industry type in the application, such as setting the default industry type to the appliance type. When the user does not set the above type setting item 64, the industry type can be set to the default industry type, such as the appliance type.

[0184] Setting parameter 4: correlation index

[0185] In this embodiment, the user can set the degree of content association between the derived multimedia data and the original multimedia data. The above-mentioned operation interface includes a correlation setting item 65. The user can adjust the degree of content association between the derived multimedia data and the original data by setting the correlation index in the above-mentioned correlation setting item 65. For example, the above-mentioned correlation index can be a numerical value, such as any numerical value between 1 and 5, wherein the higher the numerical value of the above-mentioned correlation index, the higher the degree of content association between the two; conversely, the lower the numerical value of the above-mentioned correlation index, the lower the degree of content association between the two. Optionally, the above-mentioned numerical value can be any numerical value between 0% and 100%. For example, if 80 is filled in the correlation setting item 65, it means that the correlation index is 80%. The setting of the specific numerical range can be determined according to actual conditions and is not limited here.

[0186] In some implementations, the content entered into the correlation setting item 65 may also be a degree descriptor, such as strong, medium, or weak. The user may enter the corresponding degree descriptor into the correlation setting item 65 based on the degree of correlation between the two. The application that batch generates derivative multimedia data may determine the correlation index corresponding to each degree descriptor based on the correspondence between the degree descriptors and the correlation index.

[0187] In this embodiment, an application for batch-generating derivative multimedia data can generate at least one derivative multimedia data item corresponding to the original multimedia data item, wherein content that needs to be retained exists between the original multimedia data item and the derivative multimedia data item, namely, the content of the first region. The remaining content outside the first region can be randomly generated using a correlation algorithm applied to the application. Therefore, the aforementioned correlation index can be set to determine the degree of correlation between the randomly generated content and the original multimedia data item, thereby enabling targeted control of the randomly generated region content and improving the accuracy of the random content in the derivative multimedia data item.

[0188] In some implementations, the user may also set a default correlation index in the application, such as setting the default correlation index to 80%. When the user does not set the correlation setting item 65, the correlation index may be set to a default value, such as 80%.

[0189] In S502 , the terminal device obtains original multimedia data in response to a data import operation initiated by the user.

[0190] In some implementations, the original multimedia data may be image data, video data, document data, web page data, or other multimedia data, and the data type of the multimedia data is not specifically limited.

[0191] In this embodiment, when the terminal starts the above-mentioned application for batch generating derivative multimedia data, the corresponding operation interface also includes a multimedia data import control. Through the above-mentioned import control, the original multimedia data used to generate the derivative multimedia data (i.e., the above-mentioned first multimedia data) is imported into the application, so that derivative multimedia data based on the original multimedia data can be generated.

[0192] 6 as an example, as shown in FIG6 (b), the above setting operation interface also includes a multimedia data import area 66. The user can import original multimedia data in the above import area 66.

[0193] For example, in response to a user clicking on the import area 66, the terminal generates a multimedia data selection interface, as shown in FIG6(c). The user can select multimedia data from local storage areas, such as the photo album folder 67 and the video folder 68, or download original multimedia data from a cloud server, such as a network disk 69. After the user completes the selection of original multimedia data, for example, selecting image 1, they can click the import control 610 to import the original multimedia data into the above-mentioned application, thereby obtaining the corresponding import completion operation interface, as shown in FIG6(d), and then continue to set other setting items.

[0194] It should be noted that the user can set various setting items first and then import the original multimedia data, or can import the original multimedia data first and then set various setting items. The execution order of the above two operations is not limited here.

[0195] In S503 , the terminal device determines first layout information of the original multimedia data according to the setting parameters in response to the setting completion operation initiated by the user.

[0196] In this embodiment, after completing the settings, the user can click the next control as shown in (d) in Figure 6 to generate corresponding layout information through the application for batch-generating derivative multimedia data. The settings interface includes user-entered settings parameters, such as the aforementioned industry type, target size, number of derivatives, and correlation index. Based on the settings parameters, the electronic device can perform a layout analysis on the original multimedia data imported by the user, determine at least one area for content retention, namely, the aforementioned first area, and generate first layout information based on the first area.

[0197] In some possible implementations, the step of determining the first layout information may include:

[0198] S503.1: Determine the industry type of the original multimedia data according to the setting parameters.

[0199] S503.2: Identify the reserved area in the original multimedia data according to the industry type and determine at least one first area.

[0200] In this embodiment, different industry types require different content to be retained. Therefore, the electronic device first extracts the industry type from the setting parameters (wherein the industry type can be manually selected by the user or automatically identified by the electronic device after analyzing the original multimedia data) and determines the corresponding retained content based on the industry type. After determining the required retained content, the electronic device can identify the area corresponding to the retained content from the original multimedia data and use it as the first area.

[0201] For example, FIG8 shows a schematic diagram of the first layout information provided by an embodiment of the present application. Referring to FIG8 (a), the original multimedia data imported by the user is image data, which includes area 1 for the product name and area 2 for the product appearance. Based on the user's layout setting operation, the above-mentioned industry type is determined to be an appliance type, so it can be determined that the content to be retained is the appliance name and the appliance appearance. Therefore, by performing image analysis on the image data imported by the user, the areas to be retained, namely area 1 and area 2, can be determined, and the first layout information is obtained based on the above-mentioned two areas, as shown in FIG8 (b).

[0202] S503.3: Determine at least one derived region (ie, second region) in the original multimedia data according to the first region.

[0203] In this embodiment, the first region is the area where content is retained. Therefore, the electronic device can determine a derivative region, i.e., a second region, from other regions of the original multimedia data other than the first region, from which random derivation can be performed. In some possible implementations, all regions other than the first region can be used as derivative regions, or a portion of the regions other than the first region can be selected as derivative regions. The specific method can be determined based on actual circumstances.

[0204] S503.4: Display first layout information including the first area and the second area.

[0205] In this embodiment, after the electronic device determines the first area and the second area, it can display a prompt interface containing the first layout information in the application for batch generating derivative multimedia data, as shown in (b) in Figure 8, so that the user can confirm whether the first layout information determined by the application is correct.

[0206] In S504 , the terminal device generates layout confirmation information in response to the layout confirmation operation input by the user.

[0207] In this embodiment, the terminal device can display the determined first layout information. If the user does not need to adjust the first layout information, he or she can directly click the confirmation control in the interface, such as the control 81 in (b) of FIG8 .

[0208] In a possible implementation, in S504, the method may further include: the terminal adjusting the first layout information in response to an adjustment operation initiated by the user based on the first layout information to generate second layout information.

[0209] In this embodiment, after the terminal determines the first layout information corresponding to the original multimedia data through the above application, the corresponding first layout information can be displayed in the above operation interface, as shown in (b) of Figure 8. The user can determine whether the first area identified by the application is accurate based on the above first layout information, or judge whether it is necessary to adjust the setting parameters that have been set, such as the industry type and the number of derivatives that have been set. If the user does not need to adjust the first layout information, the user can click the above confirmation control 81. If the user does not need to adjust the first layout information, the terminal can perform S505 according to the first layout information; conversely, if the user needs to adjust the first layout information, the user can drag the mark boxes corresponding to the above areas 1 and 2 to adjust the position of the first area identified by the application. Of course, in addition to adjusting the position of the first area, the size of the above mark box can also be adjusted, that is, the size of the first area can be adjusted. The specific adjustment method can be set according to actual conditions.

[0210] In one possible implementation, the above-mentioned adjustment operation also includes an operation of adding the first area. The confirmation interface of the above-mentioned first layout information may also include a control 82 for adding an area. The user can click the above-mentioned control 82 to add a mark box for selecting the first area to add the first area that the user needs to retain.

[0211] In a possible implementation, the above adjustment operation also includes a deletion operation of the first area. The confirmation interface of the above first layout information may also include a control 83 for area deletion. The user can click the above control 83 to select the first area to be deleted from the identified first area.

[0212] In some implementations, the first layout information further includes an area derived from the original multimedia data, namely, the second area, such as area 3 in FIG8( b ). In addition to adjusting the first area, the user can also adjust the second area.

[0213] In S505 , the terminal generates at least one second multimedia data including the first area based on the first layout information.

[0214] In this embodiment, after determining the first layout information corresponding to the original multimedia data, the terminal can generate derivative multimedia data corresponding to the original multimedia data (i.e., the aforementioned second multimedia data) based on the first layout information. Since the first layout information determines the content to be retained in the original multimedia data, i.e., the content displayed in the first area, the content displayed in the first area is retained in the derivative multimedia data.

[0215] Exemplarily, FIG9 shows a schematic diagram of a comparison between the original multimedia data and the derived multimedia data provided by an embodiment of the present application. Referring to FIG9 (a), the original multimedia data is an image data, namely, image 1, which includes an area 1 for the product name and an area 2 for the product appearance. The above two areas are areas that need to be retained, namely, the first area in the first layout information. When the terminal generates the derived multimedia data corresponding to the original multimedia data, the contents of the above two areas will be retained, and the corresponding algorithm will be used to generate content that has a certain degree of correlation with other areas of the original multimedia data except the above two areas, namely, image 2 and image 3 shown in FIG9 (b) are obtained. Among them, compared with image 1, the positions of the above two areas in the entire image of image 2 are consistent with those of image 1, that is, the positions and contents of the two areas are not changed, and the contents other than the above two areas are adjusted.

[0216] In some implementations, the position of the regions retaining content within the image may change, as shown in Image 3 in Figure 9(b). Compared to Image 1, Image 3 retains the content of the two regions, but their relative positions within the overall image have changed. The display positions of the two regions can be determined based on factors such as an aesthetic engine and the overall image composition. The display position of the first region within the derived multimedia data is not limited herein.

[0217] Corresponding to the above-mentioned multiple setting parameters, that is, when generating derivative multimedia data, the terminal can also perform corresponding operations according to different setting parameters, which are specifically described as follows:

[0218] Execution content 1: Response to the execution content corresponding to the target size

[0219] In this embodiment, if the original size of the original multimedia data is inconsistent with the target size in the first layout information, the terminal can generate derivative multimedia data corresponding to the target size. For example, Figure 10 shows a schematic diagram of generating derivative multimedia data based on the target size provided by an embodiment of the present application. Referring to (a) in Figure 10, the original multimedia data is an image data, namely image 1. The size of image 1 is 4:3, and the target size obtained after the user adjusts it is 1:1. The sizes of the two are inconsistent. The terminal will generate derivative multimedia data according to the specifications of the target size, such as image 2 shown in (b) in 10. Similarly, the content retained in image 1 (ie, area 1 and area 2) will also be displayed in image 2, namely area 3 and area 4.

[0220] In some implementations, to ensure visibility of the content, the area sizes of the region 1 and the region 3 are the same, and the area sizes of the region 2 and the region 4 are the same.

[0221] Execution content 2: Response to the execution content corresponding to the derived quantity

[0222] In this embodiment, the setting parameters of the first layout information record include a derivative quantity, which can be set by the user or determined based on the default setting. The specific determination method can refer to the relevant description of S501 and will not be repeated here. Wherein, the derivative quantity is N, and N is a positive integer greater than 0, then the terminal will generate N derivative multimedia data. Wherein, each derivative multimedia data contains the display content of the first area. The terminal can generate N derivative area data associated with the display content of the second area based on the derivative quantity N, and merge each derivative area data with the display content in the first area that needs to be retained (i.e., the first area data), thereby obtaining a corresponding number of N derivative multimedia data.

[0223] For example, FIG11 shows a schematic diagram of generating multiple multimedia data based on derived data provided by an embodiment of the present application. Referring to FIG11 , the number of derivatives is 3. The terminal can extract the first region data (i.e., region 1) of the first region from the original multimedia data (i.e., image 1), and generate three different derived region data, i.e., regions 2 to 4, based on the semantic description information and association index corresponding to the second region. The three regions are then merged with region 1 to obtain images 2 to 4, thereby achieving the purpose of generating multiple derived multimedia data.

[0224] Execution content 3: Execution content corresponding to the correlation index

[0225] In this embodiment, the terminal device may determine the degree of association between the derived region data in the multimedia data and the second region data corresponding to the second region based on a correlation index. If the correlation index indicates a higher degree of association between the two, the generated derived region data and the second region data have a greater similarity; conversely, if the correlation index indicates a lower degree of association between the two, the similarity between the derived region data and the second region data has a lower similarity.

[0226] In some implementations, the process of generating the derived multimedia data according to the correlation index may specifically include the following steps:

[0227] Step 1: Divide the original multimedia data into regions according to the first region to obtain first region data corresponding to the first region and second region data corresponding to the second region.

[0228] In this embodiment, the terminal can divide the original multimedia data into regions according to the position of the first region in the original multimedia data in the first layout information. For example, Figure 12 shows a schematic diagram of generating derived multimedia data provided by an embodiment of the present application. Referring to Figure 12, the terminal can generate a mask 1 as shown in Figure 12 according to the position of the first region in the original multimedia data in the first layout information, wherein, in the above-mentioned mask 1, the pixel value corresponding to the first region can be set to 0, and the pixel value corresponding to the second region can be set to 255. The terminal can merge the above-mentioned mask 1 with the original multimedia data (i.e., image 1) to obtain the first region data corresponding to the first region, i.e., obtain the above-mentioned element 1 and element 2, and the second region data corresponding to the second region, i.e., element 3, so as to realize the division of the regional data of different regions.

[0229] Step 2: Perform semantic recognition on the second region data of the second region to obtain semantic description information of the second region.

[0230] In this embodiment, after dividing the original multimedia data, the terminal obtains the second area data corresponding to the second area, and performs semantic recognition on the second area data, that is, converts the multimedia data represented by graphics into semantic description information represented by text, so that derived area data that has a certain correlation with the content can be generated according to the correlation index, thereby achieving the purpose of content-oriented derivation and improving the accuracy of derived area data generation.

[0231] In some implementations, the semantic recognition algorithm may specifically be a multimodal model, and the semantic description information corresponding to the second region data is extracted through the multimodal model.

[0232] Continuing to refer to FIG12 , the terminal may import the second region data into the semantic recognition algorithm to determine the semantic description information corresponding to element 3, i.e., for example, “two young men are walking on the road, the one on the left is wearing short sleeves, and the one on the right is wearing long sleeves.”

[0233] Step 3: Generate at least one of the derived region data according to the association index and the semantic description information.

[0234] In this embodiment, the terminal can determine the degree of association between the content of the derived region data and the second region data based on the association index. For example, if the value of the association index is large, it means that the degree of association between the derived region data and the second region data is high. In this case, the derived region data can generate corresponding derived region content based on the above-mentioned semantic description information.

[0235] For example, referring to FIG12 , the value of the above correlation index is high, which means that the derived area data and the second area data have a strong correlation. At this time, the semantic description information corresponding to the derived area data can be “two young people are walking on the road, the young person on the left is wearing short sleeves, and the young person on the right is wearing short sleeves”, thereby obtaining derived element 1 and derived element 2, wherein the difference between the above derived element 1 and derived element 2 is the relative position relationship between the two young people. For example, in derived element 1, the two young people are walking side by side, while in derived element 2, the two young people are not walking side by side, but one is in front and the other is behind.

[0236] If the value of the above correlation index is low, it means that the correlation between the derived region data and the second region data is weak. At this time, the semantic description information corresponding to the derived region data can be "two trees on the mountain, the tree on the left is blooming, and the tree on the right is not blooming", thereby obtaining derived element 3.

[0237] Step 4: Merge each derived region data with the first region data of the first region to obtain each derived multimedia data.

[0238] In this embodiment, the terminal may merge the generated derived region data with the first region data corresponding to the first region. The display position of the first region data during the merging may be consistent with or inconsistent with the original multimedia data. In some implementations, the terminal may import the derived region data and the first region data into a preset image synthesis model, such as an image model constructed based on an aesthetic engine, to obtain the corresponding derived multimedia data.

[0239] For example, Figure 13 illustrates a schematic diagram of generating derived multimedia data according to an embodiment of the present application. As shown in Figure 13 , the terminal may merge element 1 and element 2 with derived element 1, thereby generating derived image 1, wherein the position of the element corresponding to the first region in derived image 1 is consistent with that in image 1.

[0240] The terminal may merge element 1 and element 2 with derived element 2 to obtain derived image 2, wherein the position of the element corresponding to the first area in the derived image 1 may be different from the position in image 1.

[0241] In some implementations, if the target size is inconsistent with the original size of the original multimedia data, the size of the generated derivative region data is determined based on the target size, and the size of the first region data corresponding to the first region can remain consistent with the size in the original multimedia data. Since the target size of the derived region data is larger than the size of the first region data, when the above two types of region data are merged, the size of the synthesized derivative multimedia data is determined by the target size of the derived region data.

[0242] In this embodiment, the above-mentioned industry type is specifically used to determine the first area in the original multimedia data, that is, to generate the first layout information. Therefore, in the process of generating the derived multimedia data, corresponding operations may not be performed according to the above-mentioned industry type.

[0243] In some implementations, when determining the derived region data in the derived multimedia data, the derived region data may be generated based on the association index and the aforementioned industry type. Specifically, when generating the derived region data based on the semantic description information corresponding to the second region, the corresponding derived region data may be generated based on the association index, the industry type, and the semantic description information. For example, if the aforementioned industry type is electrical appliances, and electrical appliances are generally used indoors, then when generating the derived region data, the multimedia data may be set to an indoor setting, such as a home, classroom, or office. The semantic description information and the association index are then combined to generate derived region data for indoor settings.

[0244] In some implementations, if the user adjusts the first layout information, that is, after obtaining the corresponding second layout information, S502 may specifically include: the terminal generating, based on the second layout information, at least one second multimedia data item including the first region. The specific method for generating the second multimedia data item based on the second layout information is the same as the method for generating the second multimedia data item based on the first layout information. For a detailed description, please refer to the above description and will not be repeated here.

[0245] In this embodiment, after generating the derivative multimedia data, the terminal can store the derived multimedia data in the memory of the terminal; or, based on the user's operation, select part or all of the derived multimedia data for storage. For example, FIG14 shows a schematic diagram of the storage of derived multimedia data provided by an embodiment of the present application. After obtaining the derived multimedia data, the terminal can display the generated multiple derived multimedia data on the corresponding page, such as images 1 to 3 in FIG14. The user can select the derived multimedia data to be exported from the above multiple images, such as selecting image 1 and image 2, and clicking the export control 141 to store the selected images in the memory of the terminal.

[0246] As can be seen from the above, in a method for generating multimedia data provided by an embodiment of the present application, the terminal can generate first layout information corresponding to the first multimedia data according to the user's layout setting operation, and then when generating the derived regional data corresponding to the first multimedia data, that is, when generating the second multimedia data, the terminal retains the regional data of the first region in the first multimedia data according to the first layout information, thereby obtaining the second multimedia data containing the regional data of the first region, thereby achieving the purpose of personalized generation of derived regional data. Compared with existing multimedia technologies, the method for generating multimedia data provided by an embodiment of the present application does not use the same template for data derivation for all multimedia data, but can personalize the corresponding first layout information according to the user's setting operation and the original multimedia data specified by the user, thereby accurately determining the first region that the user needs to retain, thereby generating derived regional data that retains the regional data of the first region in the original multimedia data, thereby improving the accuracy of the generation of derived regional data and also improving the efficiency of batch generation of derived regional data.

[0247] Example 2:

[0248] Exemplarily, Figure 15 shows a schematic diagram of an application scenario of the multimedia data generation method provided by another embodiment of the present application. Referring to Figure 15, in this application scenario, the above-mentioned multimedia data generation method is applied to a multimedia data generation system, and the multimedia data generation system includes a terminal 151 and a server 152. The terminal 151 can be a terminal device such as a smart phone, a laptop computer, a tablet computer, a desktop computer, etc. An application for batch generation of derivative multimedia data can be installed in the above-mentioned terminal 151, and users can batch generate derivative multimedia data through the application running in the terminal.

[0249] Different from the first embodiment, the application installed in the terminal 151 in this embodiment can hand over the layout recognition of the original multimedia data and the related operations of generating derivative multimedia data to the server 152, that is, the application is used to generate a corresponding operation interface to collect the original multimedia data imported by the user and set parameters through the terminal 151, and upload the above-collected data to the server 152, thereby reducing the computing pressure of the terminal 151 when generating multimedia data in batches.

[0250] The following describes in detail the interactive process of the method for generating multimedia data provided by an embodiment of the present application. In conjunction with the application scenario of FIG15 , FIG16 shows an interactive flow chart of the method for generating multimedia data provided by an embodiment of the present application. Referring to FIG16 , the method for generating multimedia data provided by an embodiment of the present application specifically includes S1601 to S1606. The specific implementation process is described in detail as follows:

[0251] In S1601, the terminal sends a setting data packet to the server in response to a layout setting operation initiated by the user; the setting data packet includes the setting parameters and the first multimedia data.

[0252] In this embodiment, an application for batch generating derivative multimedia data is installed on the terminal. Through the operation interface generated by the application, the original multimedia data imported by the user (i.e., the first multimedia data) can be obtained, and the corresponding setting parameters can be determined based on the layout setting operation initiated by the user. The specific method of obtaining the setting parameters can be found in the relevant descriptions of S501 and S502 in Example 1, which will not be repeated here.

[0253] In this embodiment, after the terminal obtains the original multimedia data and layout parameters imported by the user through the application, it can encapsulate the above two types of data to obtain a setting data packet, and send the setting data packet to the server.

[0254] In S1602, the server determines first layout information corresponding to the first multimedia data based on the setting data packet sent by the terminal.

[0255] In this embodiment, after receiving a configuration data packet sent by the terminal via an application, the server may extract configuration parameters from the configuration data packet and determine first layout information based on the configuration parameters and the original multimedia data. The first layout information includes the first region to be retained. The manner in which the server determines the first layout information can be found in the description of the terminal determining the first layout information in S503 and is not further described here.

[0256] In S1603, the terminal receives the first layout information fed back by the server.

[0257] In this embodiment, the server may send the determined first layout information to the terminal, so that the user can determine through the terminal whether the first area in the first layout information needs to be adjusted.

[0258] In S1604, the terminal sends layout confirmation information about the first layout information to the server.

[0259] In this embodiment, if the user does not need to adjust the first layout information, the terminal may generate layout confirmation information according to the first layout information, and send the layout confirmation information to the server.

[0260] In this embodiment, if the user needs to adjust the first area in the first layout information, they can initiate a corresponding adjustment operation. The terminal can obtain the second layout information adjusted from the first layout information based on the user's adjustment operation. The specific implementation method for obtaining the second layout information can be found in the relevant operations for determining the second layout information in S501, and will not be repeated here. After obtaining the second layout information based on the user's adjustment operation, the terminal can generate layout confirmation information based on the second layout information and send the layout confirmation information to the server.

[0261] In S1605 , the server generates at least one second multimedia data including the first area according to the layout confirmation information and the setting parameters.

[0262] In this embodiment, after receiving the layout confirmation information sent by the terminal, the server can divide the original multimedia data according to the first layout information or the second layout information included in the layout confirmation information, and then generate a corresponding number and size of derivative multimedia data according to the set parameters. The specific implementation method of generating the derivative multimedia data can be found in the relevant description of S502 and will not be repeated here.

[0263] In S1606 , the terminal receives at least one second multimedia data sent by the server.

[0264] In this embodiment, when the server generates derivative multimedia data corresponding to the original multimedia data, it can send it to the terminal through the application. The terminal can store the derivative multimedia data in the local memory, or it can choose to store part or all of the derivative multimedia data in the local memory according to the user's operation.

[0265] In the embodiments of the present application, the layout confirmation of the original multimedia data and the generation of the derived data are performed by the server, which can reduce the computing pressure of the terminal and the size of the algorithms included in the applications installed in the terminal. On the other hand, because the server can train relevant algorithms (such as the layout information recognition algorithm and the derived area data generation algorithm) through big data, the server can complete the generation of the derived multimedia data and the layout recognition task, which can improve the accuracy of the derived multimedia data and thus enhance the user experience.

[0266] Example 3:

[0267] Compared to Example 2, which describes the method for generating multimedia data provided by the present application from the perspective of interaction between a terminal and a server, Example 3 describes the method for generating multimedia data provided by the present application from the perspective of a server. For example, FIG17 shows a flowchart of the implementation of the method for generating multimedia data provided by an embodiment of the present application on the server side, which is described in detail as follows:

[0268] In S1701, a setting data packet sent by a terminal is received; the setting data packet includes first multimedia data and setting parameters determined based on a layout setting operation of a user;

[0269] In S1702, based on the setting data packet, layout confirmation information corresponding to the first multimedia data is determined; the layout confirmation information is used to determine a first area in the first multimedia data;

[0270] In S1703, at least one second multimedia data including the first area is generated according to the layout confirmation information and the setting parameters.

[0271] Optionally, the layout confirmation information includes first layout information;

[0272] The determining, based on the setting data packet, layout confirmation information corresponding to the first multimedia data includes:

[0273] generating first layout information corresponding to the first multimedia data based on the setting data packet;

[0274] sending the first layout information to the terminal;

[0275] The generating, according to the layout confirmation information and the setting parameters, at least one second multimedia data including the first area includes:

[0276] In response to the confirmation instruction sent by the terminal, at least one second multimedia data is generated according to the first layout information and setting parameters.

[0277] Optionally, the layout confirmation information includes second layout information;

[0278] After sending the first layout information to the terminal, the method further includes:

[0279] In response to the adjustment instruction sent by the terminal, performing layout adjustment on the first layout information based on the adjustment instruction to obtain second layout information;

[0280] The generating, according to the layout confirmation information and the setting parameters, at least one second multimedia data including the first area includes:

[0281] At least one second multimedia data is generated according to the second layout information and the setting parameters.

[0282] Optionally, the layout confirmation information is further used to determine a second area in the first multimedia data, and generating at least one second multimedia data including the first area according to the layout confirmation information and the setting parameters includes:

[0283] generating at least one derived region data associated with the second region;

[0284] The second multimedia data is generated according to the first region data of the first region and the derived region data.

[0285] Optionally, the setting parameters include a derivation number N; and the generating at least one derived area data associated with the second area includes:

[0286] generating N pieces of derived region data associated with the second region;

[0287] The generating the second multimedia data according to the first region data and the derived region data of the first region includes:

[0288] N pieces of the second multimedia data are generated based on the N pieces of the derived region data and the first region data.

[0289] Optionally, the setting parameters include an association index; and the generating of at least one derived area data associated with the second area includes:

[0290] performing semantic recognition on the second region data of the second region to obtain semantic description information of the second region;

[0291] At least one of the derived region data is generated according to the association index and the semantic description information.

[0292] Optionally, the setting parameters include a target size; and generating at least one second multimedia data including the first area according to the layout confirmation information and the setting parameters includes:

[0293] Based on the layout confirmation information, at least one second multimedia data matching the target size is generated.

[0294] Optionally, the setting parameter includes an industry type corresponding to the first multimedia data, and determining layout confirmation information corresponding to the first multimedia data based on the setting data packet includes:

[0295] According to the industry type corresponding to the first multimedia data, determining at least one first area corresponding to the industry type from the first multimedia data;

[0296] The layout confirmation information is obtained according to at least one of the first regions.

[0297] Example 4:

[0298] Corresponding to the relevant steps executed by the terminal in the multimedia data generation method of the above-mentioned embodiments 1 and 2, Figure 18 shows a structural block diagram of the multimedia data generation device applied to the terminal provided by the embodiment of the present application. For the sake of convenience of explanation, only the parts related to the embodiment of the present application are shown.

[0299] As shown in FIG18 , the multimedia data generating device includes:

[0300] a layout setting unit 181 configured to generate, in response to a layout setting operation initiated by a user, first layout information corresponding to the first multimedia data specified by the user according to setting parameters corresponding to the layout setting operation; the first layout information being used to determine a first region in the first multimedia data;

[0301] The derivation unit 182 is configured to generate at least one second multimedia data including the first area based on the first layout information.

[0302] Optionally, the derivative unit includes:

[0303] a derived region generating unit, configured to generate at least one derived region data associated with the second region;

[0304] The derived region merging unit is configured to generate the second multimedia data according to the first region data of the first region and the derived region data.

[0305] Optionally, the setting parameters include a derivation number N; the derivation region generating unit is specifically configured to generate N derivation region data associated with the second region;

[0306] The derived region merging unit is specifically configured to generate N pieces of the second multimedia data based on the N pieces of the derived region data and the first region data.

[0307] Optionally, the setting parameters include a correlation index; and the derived region generating unit includes:

[0308] a semantic description determining unit, configured to perform semantic recognition on the second region data of the second region to obtain semantic description information of the second region;

[0309] The semantic derivation unit is configured to generate at least one of the derived region data according to the association index and the semantic description information.

[0310] Optionally, the setting parameter includes a target size; and the deriving unit includes:

[0311] A size adjustment unit is configured to generate at least one second multimedia data that matches the target size based on the first layout information.

[0312] Optionally, the layout setting unit includes:

[0313] an industry type determining unit, configured to determine, from the first multimedia data, at least one first region corresponding to the industry type according to the industry type corresponding to the first multimedia data;

[0314] The first region generating unit is configured to generate the first layout information according to at least one first region.

[0315] Optionally, the generating device further includes:

[0316] An industry type setting unit is configured to determine the industry type corresponding to the first multimedia data in response to the layout setting operation.

[0317] Optionally, the generating device further includes:

[0318] a layout adjustment unit, configured to adjust the first layout information in response to an adjustment operation initiated by a user based on the first layout information, and generate second layout information;

[0319] The second layout generating unit is configured to generate at least one second multimedia data including the first area based on the second layout information.

[0320] Optionally, the layout setting unit includes:

[0321] a setting data packet sending unit, configured to send a setting data packet to a server in response to a layout setting operation initiated by a user; the setting data packet includes the setting parameters and the first multimedia data;

[0322] The first layout information receiving unit is configured to receive the first layout information fed back by the server.

[0323] Optionally, the derivative unit includes:

[0324] a layout confirmation information sending unit, configured to send layout confirmation information about the first layout information to the server; the layout confirmation information includes the first layout information or second layout information obtained by adjusting the first layout information;

[0325] The second layout derivation unit is configured to receive at least one second multimedia data generated by the server according to the layout confirmation information and the setting parameters.

[0326] Embodiment 5:

[0327] Corresponding to the relevant steps executed by the server in the multimedia data generation method of the above embodiment 2, Figure 19 shows a structural block diagram of the multimedia data generation device applied to the server provided by the embodiment of the present application. For the sake of convenience of explanation, only the parts related to the embodiment of the present application are shown.

[0328] As shown in FIG19 , the multimedia data generating device includes:

[0329] The setting receiving unit 191 is configured to receive a setting data packet sent by a terminal; the setting data packet includes first multimedia data and setting parameters determined based on a user's layout setting operation;

[0330] a layout confirmation unit 192 configured to determine layout confirmation information corresponding to the first multimedia data based on the setting data packet; the layout confirmation information is used to determine a first region in the first multimedia data;

[0331] The derivative data generating unit 193 is configured to generate at least one second multimedia data including the first area according to the layout confirmation information and the setting parameters.

[0332] Optionally, the layout confirmation information includes first layout information;

[0333] The layout confirmation unit includes:

[0334] a first layout information determining unit, configured to generate first layout information corresponding to the first multimedia data based on the setting data packet;

[0335] a first layout information sending unit, configured to send the first layout information to the terminal;

[0336] The derivative data generating unit includes:

[0337] The first derivative data generating unit is configured to generate at least one second multimedia data according to the first layout information and setting parameters in response to a confirmation instruction sent by the terminal.

[0338] Optionally, the layout confirmation information includes second layout information;

[0339] The generating device also includes:

[0340] a second layout information determining unit, configured to, in response to an adjustment instruction sent by the terminal, perform layout adjustment on the first layout information based on the adjustment instruction to obtain second layout information;

[0341] The derivative data generating unit includes:

[0342] The second derivative data generating unit is configured to generate at least one second multimedia data according to the second layout information and the setting parameters.

[0343] Optionally, the layout confirmation information is further used to determine a second area in the first multimedia data, and the derivative data generation unit includes:

[0344] a derived region data generating unit, configured to generate at least one derived region data associated with the second region;

[0345] The derived region merging unit is configured to generate the second multimedia data according to the first region data of the first region and the derived region data.

[0346] Optionally, the setting parameter includes a derivation number N; the derived region data generating unit is specifically configured to generate N derived region data associated with the second region;

[0347] The derived region merging unit is specifically configured to generate N pieces of the second multimedia data based on the N pieces of the derived region data and the first region data.

[0348] Optionally, the setting parameters include a correlation index; and the derived region data generating unit includes:

[0349] a semantic description determining unit, configured to perform semantic recognition on the second region data of the second region to obtain semantic description information of the second region;

[0350] The semantic description generating unit is configured to generate at least one of the derived region data according to the association index and the semantic description information.

[0351] Optionally, the setting parameters include a target size; and the derivative data generating unit includes:

[0352] A size adjustment unit is configured to generate at least one second multimedia data that matches the target size based on the layout confirmation information.

[0353] Optionally, the setting parameter includes an industry type corresponding to the first multimedia data, and the derived data generating unit includes:

[0354] an industry type confirmation unit, configured to determine, from the first multimedia data, at least one first region corresponding to the industry type according to the industry type corresponding to the first multimedia data;

[0355] The layout confirmation information generating unit is configured to obtain the layout confirmation information according to at least one of the first regions.

[0356] Figure 20 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. As shown in Figure 20, the electronic device 20 of this embodiment includes: at least one processor 200 (only one processor is shown in Figure 20, and the number of processors can match the number of chips actually included in the electronic device in the embodiment), a memory 201, and a program 202 stored in the memory 201 and executable on the at least one processor 200. When the processor 200 executes the program 202, the steps of any of the above-mentioned information sending method or information receiving method embodiments are implemented.

[0357] The electronic device 20 may be the aforementioned server, terminal, etc. The electronic device may include, but is not limited to, a processor 200 and a memory 201. Those skilled in the art will appreciate that FIG20 is merely an example of the electronic device 20 and does not limit the electronic device 20. The electronic device 20 may include more or fewer components than shown, or may combine certain components or different components. For example, the electronic device may also include input and output electronic devices, network access electronic devices, etc.

[0358] The processor 200 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. A general-purpose processor may be a microprocessor or any conventional processor.

[0359] In some embodiments, the memory 201 may be an internal storage unit of the electronic device 20, such as a hard disk or memory of the electronic device 20. In other embodiments, the memory 201 may also be an external storage electronic device of the electronic device 20, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device 20. Furthermore, the memory 201 may also include both an internal storage unit of the electronic device 20 and an external storage electronic device. The memory 201 is used to store an operating system, an application program, a boot loader (BootLoader), data, and other programs, such as the program code of the program. The memory 201 may also be used to temporarily store data that has been output or is to be output.

[0360] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of this application. Their specific functions and technical effects can be found in the method embodiment section and will not be repeated here.

[0361] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0362] An embodiment of the present application also provides an electronic device, which includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, wherein the processor implements the steps of any of the above-mentioned method embodiments when executing the computer program.

[0363] An embodiment of the present application further provides a readable storage medium, wherein the readable storage medium stores a program, and when the program is executed by a processor, the steps in the above-mentioned various method embodiments can be implemented.

[0364] An embodiment of the present application provides a program product. When the program product is run on an electronic device, the electronic device can implement the steps in the above-mentioned various method embodiments when executing the program product.

[0365] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the process in the above-mentioned embodiment method by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, it can implement the steps of each of the above-mentioned method embodiments. The computer program includes computer program code, which can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium can at least include: any entity or device that can carry the computer program code to the camera / electronic device, recording medium, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0366] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0367] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.

Claims

1. A method for generating multimedia data, characterized in that: Applied to a terminal, the method for generating multimedia data includes: In response to a layout setting operation initiated by a user, generating first layout information corresponding to the first multimedia data specified by the user according to setting parameters corresponding to the layout setting operation; the first layout information is used to determine a first area in the first multimedia data; At least one second multimedia data including the first area is generated based on the first layout information.

2. The generation method according to claim 1, characterized in that The first layout information is further used to determine a second region in the first multimedia data. Generating at least one second multimedia data including the first region based on the first layout information includes: generating at least one derived region data associated with the second region; The second multimedia data is generated according to the first region data of the first region and the derived region data.

3. The generation method according to claim 2, characterized in that The setting parameters include a derivation number N; and the generating at least one derived area data associated with the second area includes: generating N pieces of derived region data associated with the second region; The generating the second multimedia data according to the first region data and the derived region data of the first region includes: N pieces of the second multimedia data are generated based on the N pieces of the derived region data and the first region data.

4. The generation method according to claim 2, characterized in that The setting parameters include an association index; and the generating of at least one derived area data associated with the second area includes: performing semantic recognition on the second region data of the second region to obtain semantic description information of the second region; At least one of the derived region data is generated according to the association index and the semantic description information.

5. The generation method according to any one of claims 1 to 4, characterized in that: The setting parameters include a target size; and generating at least one second multimedia data including the first area based on the first layout information includes: At least one second multimedia data matching the target size is generated based on the first layout information.

6. The generation method according to any one of claims 1 to 5, characterized in that: The step of generating, in response to a layout setting operation initiated by a user and according to setting parameters corresponding to the layout setting operation, first layout information corresponding to the first multimedia data specified by the user includes: determining, from the first multimedia data, at least one first region corresponding to the industry type according to the industry type corresponding to the first multimedia data; The first layout information is generated according to at least one of the first regions.

7. The generation method according to any one of claim 6, characterized in that: Before determining at least one first area corresponding to the industry type from the first multimedia data according to the industry type corresponding to the first multimedia data, the method includes: In response to the layout setting operation, the industry type corresponding to the first multimedia data is determined.

8. The generation method according to any one of claims 1 to 7, characterized in that: After generating, in response to the layout setting operation initiated by the user, first layout information corresponding to the first multimedia data specified by the user according to the setting parameters corresponding to the layout setting operation, the method further includes: In response to an adjustment operation initiated by a user based on the first layout information, performing layout adjustment on the first layout information to generate second layout information; At least one second multimedia data including the first area is generated based on the second layout information.

9. The generation method according to any one of claims 1 to 8, characterized in that: The step of generating, in response to a layout setting operation initiated by a user and according to setting parameters corresponding to the layout setting operation, first layout information corresponding to the first multimedia data specified by the user includes: In response to a layout setting operation initiated by a user, sending a setting data packet to a server; the setting data packet includes the setting parameters and the first multimedia data; Receive the first layout information fed back by the server.

10. The generation method according to claim 8, characterized in that The generating, based on the first layout information, at least one second multimedia data including the first area includes: Sending layout confirmation information about the first layout information to the server; the layout confirmation information includes the first layout information or second layout information obtained by adjusting the first layout information; The server generates at least one second multimedia data according to the layout confirmation information and the setting parameters.

11. A method for generating multimedia data, characterized in that: Applied to a server, the method for generating multimedia data includes: Receiving a setting data packet sent by a terminal; the setting data packet includes first multimedia data and setting parameters determined based on a user's layout setting operation; determining, based on the setting data packet, layout confirmation information corresponding to the first multimedia data; the layout confirmation information being used to determine a first region in the first multimedia data; At least one second multimedia data including the first area is generated according to the layout confirmation information and the setting parameters.

12. The generation method according to claim 11, characterized in that: The layout confirmation information includes first layout information; The determining, based on the setting data packet, layout confirmation information corresponding to the first multimedia data includes: generating first layout information corresponding to the first multimedia data based on the setting data packet; sending the first layout information to the terminal; The generating, according to the layout confirmation information and the setting parameters, at least one second multimedia data including the first area includes: In response to the confirmation instruction sent by the terminal, at least one second multimedia data is generated according to the first layout information and setting parameters.

13. The generation method according to claim 12, characterized in that: The layout confirmation information includes second layout information; After sending the first layout information to the terminal, the method further includes: In response to the adjustment instruction sent by the terminal, performing layout adjustment on the first layout information based on the adjustment instruction to obtain second layout information; The generating, according to the layout confirmation information and the setting parameters, at least one second multimedia data including the first area includes: At least one second multimedia data is generated according to the second layout information and the setting parameters.

14. The generation method according to claim 11, characterized in that The layout confirmation information is further used to determine a second region in the first multimedia data, and generating at least one second multimedia data including the first region according to the layout confirmation information and the setting parameters includes: generating at least one derived region data associated with the second region; The second multimedia data is generated according to the first region data of the first region and the derived region data.

15. The generation method according to claim 14, characterized in that: The setting parameters include a derivation number N; and the generating at least one derived area data associated with the second area includes: generating N pieces of derived region data associated with the second region; The generating the second multimedia data according to the first region data and the derived region data of the first region includes: N pieces of the second multimedia data are generated based on the N pieces of the derived region data and the first region data.

16. The generation method according to claim 14, characterized in that The setting parameters include an association index; and the generating of at least one derived area data associated with the second area includes: performing semantic recognition on the second region data of the second region to obtain semantic description information of the second region; At least one of the derived region data is generated according to the association index and the semantic description information.

17. The generation method according to any one of claims 11 to 16, characterized in that: The setting parameters include a target size; and generating at least one second multimedia data including the first area according to the layout confirmation information and the setting parameters includes: Based on the layout confirmation information, at least one second multimedia data matching the target size is generated.

18. The generation method according to any one of claims 11 to 17, characterized in that: The setting parameter includes an industry type corresponding to the first multimedia data, and determining layout confirmation information corresponding to the first multimedia data based on the setting data packet includes: According to the industry type corresponding to the first multimedia data, determining at least one first area corresponding to the industry type from the first multimedia data; The layout confirmation information is obtained according to at least one of the first regions.

19. An electronic device, characterized in that: The electronic device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the method according to any one of claims 1 to 10 or the steps of the method according to any one of claims 11 to 18 are implemented.

20. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 10 or the steps of the method according to any one of claims 11 to 18 are implemented.

Citation Information

Patent Citations

  • Multimedia data sending method, terminal and server

    CN120692254A

  • Image processing method and device, electronic equipment and storage medium

    CN114676360A

  • Image processing method and device

    CN114972847A

  • Design template and material generation method, computing device and storage medium

    CN114997105A

  • Image generation method and device, electronic equipment and storage medium

    CN117670658A