Multimedia data sending method, terminal and server
By generating the first layout information according to the user's layout setting, the problem that the existing multimedia technology cannot retain the content required by the user is solved, and high-accuracy and high-efficiency generation of derived area data is achieved.
Patent Information
- Application Number
- CN202410332849.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-03-21
- Publication Date
- 2025-09-23
AI Technical Summary
When existing multimedia technologies generate derived regional data in different fields, it is easy for them to fail to retain the content that users need to retain, resulting in a decrease in the accuracy of the derived regional data.
By responding to the user's layout setting operation, first layout information corresponding to the first multimedia data is generated, and second multimedia data including the first area is generated based on the layout information, ensuring that the content required by the user is retained in the derived area data.
It realizes personalized generation of derived area data, improves the accuracy and efficiency of derived area data generation, and ensures the visibility of content required by users.
Smart Images

Figure CN120692254A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of data processing technology, and in particular relates to a method, terminal, and server for sending multimedia data. Background Art
[0002] Multimedia, as the primary medium for presenting content today, is widely used in various fields. Efficiently and accurately generating the multimedia data required by users has become a key focus. Existing multimedia technologies allow users to import desired multimedia data, such as images and videos, into pre-set templates, thereby batch-generating multiple derived region data consistent with the template's layout structure. These templates can define fixed reserved and adjusted regions.
[0003] However, since different fields require different contents to be retained, when generating derived region data using the above method, the contents required by the user in the original multimedia data may not be retained, thereby reducing the accuracy of the generated derived region data. Summary of the Invention
[0004] The embodiments of the present application provide a method, terminal and server for sending multimedia data, which can solve the problem in existing multimedia technology that the same template is used to generate derivative area data in different fields, which easily leads to the inability to retain the content required by the user, thereby reducing the accuracy of the generated derivative area data.
[0005] In a first aspect, an embodiment of the present application provides a method for generating multimedia data, which is applied to a terminal. The method for generating multimedia data includes:
[0006] In response to a layout setting operation initiated by a user, generating first layout information corresponding to the first multimedia data specified by the user according to setting parameters corresponding to the layout setting operation; the first layout information is used to determine a first area in the first multimedia data;
[0007] At least one second multimedia data including the first area is generated based on the first layout information.
[0008] The implementation of the embodiment of the present application has the following beneficial effects: based on the user's layout setting operation, first layout information corresponding to the first multimedia data is generated, and then when generating the derived region data corresponding to the first multimedia data, that is, when generating the second multimedia data, the region data of the first region in the first multimedia data is retained according to the first layout information, thereby obtaining the second multimedia data containing the region data of the first region, thereby achieving the purpose of personalized generation of the derived region data. Compared with existing multimedia technologies, the multimedia data generation method provided by the embodiment of the present application does not use the same template for data derivation for all multimedia data, but can personalize the corresponding first layout information based on the user's setting operation and the original multimedia data specified by the user, thereby accurately determining the first region that the user needs to retain, thereby generating the derived region data that retains the region data of the first region in the original multimedia data, thereby improving the accuracy of the generation of the derived region data and also improving the efficiency of batch generation of the derived region data.
[0009] In a possible implementation of the first aspect, the first layout information is further used to determine a second region in the first multimedia data, and generating at least one second multimedia data including the first region based on the first layout information includes:
[0010] generating at least one derived region data associated with the second region;
[0011] The second multimedia data is generated according to the first region data of the first region and the derived region data.
[0012] In a possible implementation of the first aspect, the setting parameter includes a derivation number N; and the generating at least one derived area data associated with the second area includes:
[0013] generating N pieces of derived region data associated with the second region;
[0014] The generating the second multimedia data according to the first region data and the derived region data of the first region includes:
[0015] N pieces of the second multimedia data are generated based on the N pieces of the derived region data and the first region data.
[0016] In a possible implementation of the first aspect, the setting parameters include an association index; and the generating at least one derived area data associated with the second area includes:
[0017] performing semantic recognition on the second region data of the second region to obtain semantic description information of the second region;
[0018] At least one of the derived region data is generated according to the association index and the semantic description information.
[0019] In a possible implementation of the first aspect, the setting parameter includes a target size; and generating, based on the first layout information, at least one second multimedia data including the first area includes:
[0020] At least one second multimedia data matching the target size is generated based on the first layout information.
[0021] In a possible implementation of the first aspect, in response to a layout setting operation initiated by the user, generating first layout information corresponding to the first multimedia data specified by the user according to setting parameters corresponding to the layout setting operation includes:
[0022] According to the industry type corresponding to the first multimedia data, determining at least one first area corresponding to the industry type from the first multimedia data;
[0023] The first layout information is generated according to at least one of the first regions.
[0024] In a possible implementation of the first aspect, before determining, from the first multimedia data, at least one first area corresponding to the industry type corresponding to the first multimedia data, the method includes:
[0025] In response to the layout setting operation, the industry type corresponding to the first multimedia data is determined.
[0026] In a possible implementation of the first aspect, after generating, in response to a layout setting operation initiated by the user, first layout information corresponding to the first multimedia data specified by the user according to setting parameters corresponding to the layout setting operation, further comprising:
[0027] In response to an adjustment operation initiated by a user based on the first layout information, performing layout adjustment on the first layout information to generate second layout information;
[0028] At least one second multimedia data including the first area is generated based on the second layout information.
[0029] In a possible implementation of the first aspect, in response to a layout setting operation initiated by the user, generating first layout information corresponding to the first multimedia data specified by the user according to setting parameters corresponding to the layout setting operation includes:
[0030] In response to a layout setting operation initiated by a user, sending a setting data packet to a server; the setting data packet includes the setting parameters and the first multimedia data;
[0031] Receive the first layout information fed back by the server.
[0032] In a possible implementation of the first aspect, generating, based on the first layout information, at least one second multimedia data including the first area includes:
[0033] Sending layout confirmation information about the first layout information to the server; the layout confirmation information includes the first layout information or second layout information obtained by adjusting the first layout information;
[0034] The server generates at least one second multimedia data according to the layout confirmation information and the setting parameters.
[0035] In a second aspect, an embodiment of the present application provides a device for generating multimedia data, which is applied to a terminal. The device includes:
[0036] a layout setting unit, configured to generate, in response to a layout setting operation initiated by a user, first layout information corresponding to the first multimedia data specified by the user according to setting parameters corresponding to the layout setting operation; the first layout information being used to determine a first region in the first multimedia data;
[0037] A derivation unit is configured to generate at least one second multimedia data including the first area based on the first layout information.
[0038] In a possible implementation of the second aspect, the deriving unit includes:
[0039] a derived region generating unit, configured to generate at least one derived region data associated with the second region;
[0040] The derived region merging unit is configured to generate the second multimedia data according to the first region data of the first region and the derived region data.
[0041] In a possible implementation of the second aspect, the setting parameter includes a derivation number N; the derivation region generating unit is specifically configured to generate N derivation region data associated with the second region;
[0042] The derived region merging unit is specifically configured to generate N pieces of the second multimedia data based on the N pieces of the derived region data and the first region data.
[0043] In a possible implementation manner of the second aspect, the setting parameters include a correlation index; and the derived region generating unit includes:
[0044] a semantic description determining unit, configured to perform semantic recognition on the second region data of the second region to obtain semantic description information of the second region;
[0045] The semantic derivation unit is configured to generate at least one of the derived region data according to the association index and the semantic description information.
[0046] In a possible implementation manner of the second aspect, the setting parameter includes a target size; and the deriving unit includes:
[0047] A size adjustment unit is configured to generate at least one second multimedia data that matches the target size based on the first layout information.
[0048] In a possible implementation of the second aspect, the layout setting unit includes:
[0049] an industry type determining unit, configured to determine, from the first multimedia data, at least one first region corresponding to the industry type according to the industry type corresponding to the first multimedia data;
[0050] The first region generating unit is configured to generate the first layout information according to at least one first region.
[0051] In a possible implementation of the second aspect, the generating device further includes:
[0052] An industry type setting unit is configured to determine the industry type corresponding to the first multimedia data in response to the layout setting operation.
[0053] In a possible implementation of the second aspect, the generating device further includes:
[0054] a layout adjustment unit, configured to adjust the first layout information in response to an adjustment operation initiated by a user based on the first layout information, and generate second layout information;
[0055] The second layout generating unit is configured to generate at least one second multimedia data including the first area based on the second layout information.
[0056] In a possible implementation of the second aspect, the layout setting unit includes:
[0057] a setting data packet sending unit, configured to send a setting data packet to a server in response to a layout setting operation initiated by a user; the setting data packet includes the setting parameters and the first multimedia data;
[0058] The first layout information receiving unit is configured to receive the first layout information fed back by the server.
[0059] In a possible implementation of the second aspect, the deriving unit includes:
[0060] a layout confirmation information sending unit, configured to send layout confirmation information about the first layout information to the server; the layout confirmation information includes the first layout information or second layout information obtained by adjusting the first layout information;
[0061] The second layout derivation unit is configured to receive at least one second multimedia data generated by the server according to the layout confirmation information and the setting parameters.
[0062] In a third aspect, an embodiment of the present application provides a method for generating multimedia data, which is applied to a server. The method for generating multimedia data includes:
[0063] Receiving a setting data packet sent by a terminal; the setting data packet includes first multimedia data and setting parameters determined based on a user's layout setting operation;
[0064] determining, based on the setting data packet, layout confirmation information corresponding to the first multimedia data; the layout confirmation information being used to determine a first region in the first multimedia data;
[0065] At least one second multimedia data including the first area is generated according to the layout confirmation information and the setting parameters.
[0066] In a possible implementation of the third aspect, the layout confirmation information includes first layout information;
[0067] The determining, based on the setting data packet, layout confirmation information corresponding to the first multimedia data includes:
[0068] generating first layout information corresponding to the first multimedia data based on the setting data packet;
[0069] sending the first layout information to the terminal;
[0070] The generating, according to the layout confirmation information and the setting parameters, at least one second multimedia data including the first area includes:
[0071] In response to the confirmation instruction sent by the terminal, at least one second multimedia data is generated according to the first layout information and setting parameters.
[0072] In a possible implementation of the third aspect, the layout confirmation information includes second layout information;
[0073] After sending the first layout information to the terminal, the method further includes:
[0074] In response to the adjustment instruction sent by the terminal, performing layout adjustment on the first layout information based on the adjustment instruction to obtain second layout information;
[0075] The generating, according to the layout confirmation information and the setting parameters, at least one second multimedia data including the first area includes:
[0076] At least one second multimedia data is generated according to the second layout information and the setting parameters.
[0077] In a possible implementation of the third aspect, the layout confirmation information is further used to determine a second area in the first multimedia data, and generating at least one second multimedia data including the first area based on the layout confirmation information and the setting parameters includes:
[0078] generating at least one derived region data associated with the second region;
[0079] The second multimedia data is generated according to the first region data of the first region and the derived region data.
[0080] In a possible implementation of the third aspect, the setting parameter includes a derivation number N; and the generating at least one derived area data associated with the second area includes:
[0081] generating N pieces of derived region data associated with the second region;
[0082] The generating the second multimedia data according to the first region data and the derived region data of the first region includes:
[0083] N pieces of the second multimedia data are generated based on the N pieces of the derived region data and the first region data.
[0084] In a possible implementation of the third aspect, the setting parameters include an association index; and the generating at least one derived area data associated with the second area includes:
[0085] performing semantic recognition on the second region data of the second region to obtain semantic description information of the second region;
[0086] At least one of the derived region data is generated according to the association index and the semantic description information.
[0087] In a possible implementation of the third aspect, the setting parameters include a target size; and generating, according to the layout confirmation information and the setting parameters, at least one second multimedia data including the first area includes:
[0088] Based on the layout confirmation information, at least one second multimedia data matching the target size is generated.
[0089] In a possible implementation of the third aspect, the setting parameter includes an industry type corresponding to the first multimedia data, and determining, based on the setting data packet, layout confirmation information corresponding to the first multimedia data includes:
[0090] According to the industry type corresponding to the first multimedia data, determining at least one first area corresponding to the industry type from the first multimedia data;
[0091] The layout confirmation information is obtained according to at least one of the first regions.
[0092] In a fourth aspect, an embodiment of the present application provides a device for generating multimedia data, which is applied to a server. The device for generating multimedia data includes:
[0093] A setting receiving unit, configured to receive a setting data packet sent by a terminal; the setting data packet includes first multimedia data and setting parameters determined based on a user's layout setting operation;
[0094] a layout confirmation unit, configured to determine layout confirmation information corresponding to the first multimedia data based on the setting data packet; the layout confirmation information is used to determine a first area in the first multimedia data;
[0095] The derivative data generating unit is configured to generate at least one second multimedia data including the first area according to the layout confirmation information and the setting parameters.
[0096] In a possible implementation of the fourth aspect, the layout confirmation information includes first layout information;
[0097] The layout confirmation unit includes:
[0098] a first layout information determining unit, configured to generate first layout information corresponding to the first multimedia data based on the setting data packet;
[0099] a first layout information sending unit, configured to send the first layout information to the terminal;
[0100] The derivative data generating unit includes:
[0101] The first derivative data generating unit is configured to generate at least one second multimedia data according to the first layout information and setting parameters in response to a confirmation instruction sent by the terminal.
[0102] In a possible implementation of the fourth aspect, the layout confirmation information includes second layout information;
[0103] The generating device also includes:
[0104] a second layout information determining unit, configured to, in response to an adjustment instruction sent by the terminal, perform layout adjustment on the first layout information based on the adjustment instruction to obtain second layout information;
[0105] The derivative data generating unit includes:
[0106] The second derivative data generating unit is configured to generate at least one second multimedia data according to the second layout information and the setting parameters.
[0107] In a possible implementation of the fourth aspect, the layout confirmation information is further used to determine a second area in the first multimedia data, and the derivative data generation unit includes:
[0108] a derived region data generating unit, configured to generate at least one derived region data associated with the second region;
[0109] The derived region merging unit is configured to generate the second multimedia data according to the first region data of the first region and the derived region data.
[0110] In a possible implementation of the fourth aspect, the setting parameter includes a derivation number N; the derived region data generating unit is specifically configured to generate N derived region data associated with the second region;
[0111] The derived region merging unit is specifically configured to generate N pieces of the second multimedia data based on the N pieces of the derived region data and the first region data.
[0112] In a possible implementation of the fourth aspect, the setting parameters include a correlation index; and the derived region data generating unit includes:
[0113] a semantic description determining unit, configured to perform semantic recognition on the second region data of the second region to obtain semantic description information of the second region;
[0114] The semantic description generating unit is configured to generate at least one of the derived region data according to the association index and the semantic description information.
[0115] In a possible implementation manner of the fourth aspect, the setting parameter includes a target size; and the derived data generating unit includes:
[0116] A size adjustment unit is configured to generate at least one second multimedia data that matches the target size based on the layout confirmation information.
[0117] In a possible implementation of the fourth aspect, the setting parameter includes an industry type corresponding to the first multimedia data, and the derived data generating unit includes:
[0118] an industry type confirmation unit, configured to determine, from the first multimedia data, at least one first region corresponding to the industry type according to the industry type corresponding to the first multimedia data;
[0119] The layout confirmation information generating unit is configured to obtain the layout confirmation information according to at least one of the first regions.
[0120] In a fifth aspect, an embodiment of the present application provides a terminal comprising: a memory, a processor, and a program stored in the memory, wherein when the processor executes the program, the steps in the method for generating multimedia data described in the first aspect are implemented.
[0121] In a sixth aspect, an embodiment of the present application provides a server comprising: a memory, a processor, and a program stored in the memory, wherein when the processor executes the program, the steps in the method for generating multimedia data described in the first aspect are implemented.
[0122] In a seventh aspect, an embodiment of the present application provides a readable storage medium, which stores a program. When the program is executed by a processor, it implements the steps in the method for generating multimedia data described in any one of the first aspect or the third aspect.
[0123] In an eighth aspect, an embodiment of the present application provides a program product, which, when executed on a device, enables the device to execute the steps of the method for generating multimedia data described in any one of the first aspect or the third aspect.
[0124] In a ninth aspect, an embodiment of the present application provides a system for generating multimedia data, which comprises a terminal as described in any one of the fifth aspects and a server as described in any one of the sixth aspects.
[0125] It can be understood that the beneficial effects of the second to ninth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0126] Figure 1This is a schematic diagram of an existing method for batch generating promotional images;
[0127] Figure 2 This is a schematic diagram of another existing method for batch generating promotional images;
[0128] Figure 3 It is a schematic diagram of a derivative image generated based on the existing method of generating a promotional image;
[0129] Figure 4 This is a schematic diagram of an application scenario of the method for generating multimedia data provided in one embodiment of the present application;
[0130] Figure 5 This is a flowchart of a method for generating multimedia data according to an embodiment of the present application;
[0131] Figure 6 This is a schematic diagram of an operation for generating derivative multimedia data provided by an embodiment of the present application;
[0132] Figure 7 This is a schematic diagram of the setting operation for the above-mentioned type of setting items provided in one embodiment of the present application;
[0133] Figure 8 is a schematic diagram of first layout information provided by an embodiment of the present application;
[0134] Figure 9 is a schematic diagram comparing original multimedia data and derived multimedia data provided by an embodiment of the present application;
[0135] Figure 10 This is a schematic diagram of generating derived multimedia data based on a target size according to an embodiment of the present application;
[0136] Figure 11 This is a schematic diagram of generating multiple multimedia data based on derived data provided by an embodiment of the present application;
[0137] Figure 12 This is a schematic diagram of generating derived multimedia data provided by an embodiment of the present application;
[0138] Figure 13 This is a schematic diagram of generating derived multimedia data provided by an embodiment of the present application;
[0139] Figure 14 This is a schematic diagram of storage of derived multimedia data provided by an embodiment of the present application;
[0140] Figure 15 This is a schematic diagram of an application scenario of the method for generating multimedia data provided by another embodiment of the present application;
[0141] Figure 16This is an interactive flow chart of a method for generating multimedia data provided by an embodiment of the present application;
[0142] Figure 17 This is a flowchart of a method for generating multimedia data provided by an embodiment of the present application on the server side;
[0143] Figure 18 This is a structural block diagram of a device for generating multimedia data applied to a terminal provided in an embodiment of the present application;
[0144] Figure 19 This is a structural block diagram of a device for generating multimedia data applied to a server provided in an embodiment of the present application;
[0145] Figure 20 It is a structural diagram of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION
[0146] In the following description, specific details such as specific system structures and techniques are provided for purposes of illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obscuring the description of the present application with unnecessary detail.
[0147] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or collections thereof.
[0148] It will also be understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
[0149] As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.
[0150] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.
[0151] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof all mean "including but not limited to," unless otherwise specifically emphasized.
[0152] With the continuous advancement of electronicization, the carriers of information promotion are gradually shifting from paper media to electronic media. Therefore, how to efficiently batch generate the electronic media content required by users, such as multimedia data such as videos and images used for information promotion, has become a focus of attention. Existing multimedia technology can batch generate multimedia data by importing fixed templates. Specifically, there are two methods:
[0153] Method 1:
[0154] Figure 1 A schematic diagram of an existing method for generating promotional images in batches is shown. Figure 1 As shown, users can generate a promotional image, i.e., Image 1, based on product promotion needs. Image 1 contains product-related promotional content, such as product name, brand label logo, or brand slogan. If users need to generate derivative images of Image 1 in batches, they can import Image 1 into Figure 1 In the template 1, the area 1 in the template 1 is the area with the elements of the template. The area can generate different area contents through a random generation algorithm. The area 2 is the area for displaying the user-imported image. For example, the area 1 imported by the user can be displayed in the above-mentioned area 2. The final synthesized derivative image can be as follows Figure 1 The image 2 shown and Figure 3 Among them, the display contents of image 2 and image 3 in the above-mentioned area 1 are different, while the display contents in area 2 are both image 1 imported by the user, thereby realizing the generation of derivative images related to the same promotional image based on the same promotional image.
[0155] However, in the aforementioned promotional image generation method, while the content within Region 1 can be adjusted according to a random generation algorithm and merged with user-input images in Region 2 to generate a large number of derivative images, Region 2 only occupies a portion of the derivative image. This may result in users not being able to effectively perceive the desired product content. Specifically, when viewing the derivative image, users' attention will be distracted by irrelevant random content in Region 1, thereby reducing the derivative image's effectiveness in promoting the product and resulting in lower visibility of the product's promotional content.
[0156] Method 2:
[0157] Figure 2 2 shows another existing schematic diagram of batch generation of promotional images. Referring to FIG2, the user's promotional image is image 1, which includes area 1 containing promotional content and area 2 containing background content. If the user needs to batch generate derivative images based on the above image 1, the image 1 can be imported into the following format: Figure 2 In the template 2 in the image, the template 2 includes an area 3 for generating random content and an area 4 for retaining the original content. At this time, if the area 1 of the promotional content included in the image 1 overlaps with the area 4 of the template 2 that retains the original content, the template 2 can be used to randomly generate corresponding derivative content for the overlapping part of area 2 and area 4, thereby generating Figure 2 In the image 2 shown, the content of area 4 can generate different content according to a random generation algorithm, so that by changing the content of area 4, derivative images related to image 1 can be generated in batches.
[0158] However, in the above-mentioned promotional image generation method, since the reserved content area and the random content area in the template 2 are fixed, if the area 1 for displaying promotional content in the user's promotional image 1 overlaps with the above-mentioned area 3, the required promotional content may be lost. Figure 3 A schematic diagram showing a derived image generated based on the existing method of generating a promotional image. Figure 3 As shown, the area 1 displaying the promotional content in image 3 overlaps with the area 3 generating random content in template 2. Therefore, when the derivative image of image 3 is generated by template 2, part of the text in area 1 will be lost, resulting in the following Figure 3 The image shown is 4. At this time, the user can only manually adjust the template 2 so that the template 2 can adapt to the promotion image input each time, thereby reducing the efficiency of generating derivative images.
[0159] Therefore, in order to solve the problem of existing technologies for batch generation of multimedia data, the visibility of the content that the user needs to retain in the batch-generated derivative multimedia data is reduced compared with the user's original multimedia data, and since the template is fixed, the retained content cannot be dynamically adjusted according to the multimedia data, resulting in the loss of the required promotional content. The present application provides a method for generating multimedia data, which can maintain the visibility of the content that the user needs to retain and avoid the loss of retained content while realizing batch generation of derivative multimedia data.
[0160] Example 1:
[0161] For example, Figure 4 A schematic diagram showing an application scenario of the method for generating multimedia data provided by an embodiment of the present application is shown. Figure 4 As shown, in this application scenario, the execution subject of the above-mentioned multimedia data generation method is specifically a terminal, which can be a terminal device such as a smart phone, a laptop computer, a tablet computer, a desktop computer, etc., and an application for batch generation of derivative multimedia data can be installed in the above-mentioned terminal. The user can batch generate derivative multimedia data through the application running in the terminal.
[0162] The following describes in detail the implementation process of the method for generating multimedia data provided in the embodiment of the present application. Figure 4 Application scenarios, Figure 5 A flowchart showing a method for generating multimedia data according to an embodiment of the present invention is shown. Figure 5 As shown, the multimedia data generation method provided in the embodiment of the present application specifically includes five steps, namely: a derivative parameter setting step S501, an original multimedia data importing step S502, a data processing step S503, a layout information confirmation step S504, and a derived multimedia data generation step S505. The specific implementation process of the above five steps is detailed as follows:
[0163] In S501, the terminal device receives a layout setting operation initiated by a user and determines at least one setting parameter input by the user; wherein the setting parameters include: industry type, target size, derivative quantity, and correlation index.
[0164] In this embodiment, an application for batch generating derivative multimedia data can be installed on the terminal. The user can start the above application on the terminal to display the corresponding operation interface on the terminal, and initiate the layout setting operation for the derived multimedia data in the operation interface, so as to realize personalized settings for the regional layout of the derived multimedia data to improve the accuracy of the layout information and the fit with the user's promotion needs.
[0165] For example, Figure 6FIG2 shows an operation diagram of generating derivative multimedia data provided by an embodiment of the present application. Figure 6 As shown in (a), the terminal has multiple different applications installed, including an application 61 for batch generating derivative multimedia data. The user can open the corresponding batch generation operation interface by opening the above application 61, such as Figure 6 (b) in the figure. The above operation interface includes multiple setting items, including size setting item 62, derivative quantity setting item 63, type setting item 64, and association setting item 65. Users can set each of these setting items according to their needs within the operation interface, thereby initiating the corresponding layout setting operation.
[0166] In some implementations, the layout setting operation initiated by the user may specifically include the following setting parameters, namely, Figure 6 The detailed description of the operation for setting items 62 to 65 is as follows:
[0167] Setting parameter 1: target size
[0168] In this embodiment, the user can set the size of the derived multimedia data. In this case, the user can enter a target size, such as 720*1080, in the size setting item 62, thereby limiting the aspect ratio of the derived multimedia data. In some implementation scenarios, the target size can be 720cm*1080cm, meaning a specific size can also be set. In some implementation scenarios, the target size can also be 720 pixels (pi)*1080pi, meaning that the size of the derived multimedia data can be determined while also setting the resolution of the derived multimedia data. The specific target size input can be set based on actual circumstances, and the dimension of the size setting is not limited herein.
[0169] In some implementations, if the size of the derived multimedia data is the same as the size of the original multimedia data, the size setting item 62 may be configured as a default value, that is, no content is input into the setting item 62 .
[0170] In some implementations, the user may also set a default size in the application. When the user does not set the size setting item 62 , the derived multimedia data may be set to the default size.
[0171] In some implementations, the above-mentioned operation interface may also include a check control for a default size, such as control 611. If the user checks the above-mentioned default size, the size of the derived multimedia data will be set to a preset default size, that is, the user does not need to fill in the size every time, thereby improving the user's operating efficiency.
[0172] Set parameter 2: Derived quantity
[0173] In this embodiment, the user can set the desired amount of derivative multimedia data. The user can modify the value in the derivative quantity setting item 63 to quantitatively generate a specified amount of derivative multimedia data. For example, if the user wants to publish different promotional images on six platforms, then in addition to the generated original multimedia data, five additional derivative promotional images are required. In this case, the user can enter 6 in the derivative quantity setting item 63 to initiate the setting operation for the derivative quantity.
[0174] In some implementations, the user may also set a default derivative quantity in the application. For example, if the default derivative quantity is 6, when the user does not set the derivative quantity setting item 63, the derived multimedia data may be set to the default derivative quantity.
[0175] In some implementations, if the user has not set the derivative quantity setting item 63, the derivative quantity may be set to the same as the derivative quantity during the last user operation. For example, the terminal application may establish a corresponding operation database for different users, recording each user's operation record for batch generation of derivative multimedia data. The operation record includes relevant information about each batch of generated derivative multimedia data, such as the number of generated derivative multimedia data. Based on this, if it is detected that the user has not set the derivative quantity for this time, the derivative quantity corresponding to the last operation can be obtained from the operation record as the derivative quantity for the current batch of generated derivative multimedia data.
[0176] Setting parameter 3: Industry type
[0177] In this embodiment, the user can specify the industry type of the imported original multimedia data. In order to accurately locate the area to be retained (i.e., the first area) from the original multimedia data, the user can specify the industry type of the original multimedia data in the above operation interface, that is, set the above type setting item 64. Since the layout of multimedia data is often related to the industry type corresponding to the product to be promoted, setting the industry type can facilitate the subsequent determination of the area in the original multimedia data where content needs to be retained (i.e., the first area).
[0178] For example, Figure 7 Schematic diagram of setting operation for the above-mentioned type setting items provided by an embodiment of the present application is shown. Figure 7 As shown in (a) in FIG. 1 , the user can set the above-mentioned type setting item 64 after importing the original multimedia data (or before importing the multimedia data). By clicking the above-mentioned type setting item 64, a corresponding drop-down menu, i.e., menu 71, is displayed. Figure 7 (b) in the above. The above industry types can be divided according to the industry to which the promotion user of the multimedia data belongs, that is, the above menu 71 can display multiple candidate industry types, such as e-commerce, reading, audio and video entertainment, tool software, games, social networking, news information, travel and transportation, automobiles, life services, finance, real estate, education, medical care, etc. Of course, the above industry types can also be divided according to other methods, such as classification according to the content of the multimedia data, such as games, electrical appliances, food, medical care, etc., and there is no limitation on the specific method of dividing industry types. The user can select one of the above multiple candidate types as the industry type corresponding to the original multimedia data, for example, select "e-commerce" as the industry type, and then the setting item 64 will fill in the corresponding industry type, such as Figure 7 As shown in (c) in .
[0179] In some implementations, the above operation interface may further include an automatic identification option 72 . When the user clicks the above option 72 , the application may perform type identification on the multimedia data imported by the user.
[0180] Because different industry types require different content to be retained, for example, if the industry type is an appliance type, the content to be retained is content related to the target appliance, including the appliance model and other related information; if the industry type is a game type, the content to be retained is the game name, game logo, and main characters, etc. That is, the focus of the content to be retained varies depending on the industry type. In order to improve the accuracy of subsequent first area recognition, the industry type can be set, that is, the type setting item 64 can be layout-set to improve the accuracy of subsequent recognition.
[0181] In some implementations, the user can first import the above-mentioned original multimedia data. The application installed on the terminal for batch generating derivative multimedia data can determine the industry type corresponding to the original multimedia data by performing data analysis on the above-mentioned original multimedia data, and display it in the above-mentioned type setting item 64. If the industry type automatically identified by the application does not meet the user's classification expectations for the original multimedia data, the industry type of the original multimedia data can be adjusted by clicking the above-mentioned type setting item 64; if the industry type automatically identified by the application is consistent with the user's classification expectations for the original multimedia data, there is no need to adjust the above-mentioned industry type, thereby improving the user's operating efficiency.
[0182] In some implementations, the user can also set a default industry type in the application, such as setting the default industry type to the appliance type. When the user does not set the above type setting item 64, the industry type can be set to the default industry type, such as the appliance type.
[0183] Setting parameter 4: correlation index
[0184] In this embodiment, the user can set the degree of content association between the derived multimedia data and the original multimedia data. The above-mentioned operation interface includes a correlation setting item 65. The user can adjust the degree of content association between the derived multimedia data and the original data by setting the correlation index in the above-mentioned correlation setting item 65. For example, the above-mentioned correlation index can be a numerical value, such as any numerical value between 1 and 5, wherein the higher the numerical value of the above-mentioned correlation index, the higher the degree of content association between the two; conversely, the lower the numerical value of the above-mentioned correlation index, the lower the degree of content association between the two. Optionally, the above-mentioned numerical value can be any numerical value between 0% and 100%. For example, if 80 is filled in the correlation setting item 65, it means that the correlation index is 80%. The setting of the specific numerical range can be determined according to actual conditions and is not limited here.
[0185] In some implementations, the content entered into the correlation setting item 65 may also be a degree descriptor, such as strong, medium, or weak. The user may enter the corresponding degree descriptor into the correlation setting item 65 based on the degree of correlation between the two. The application that batch generates derivative multimedia data may determine the correlation index corresponding to each degree descriptor based on the correspondence between the degree descriptors and the correlation index.
[0186] In this embodiment, an application for batch-generating derivative multimedia data can generate at least one derivative multimedia data item corresponding to the original multimedia data item, wherein content that needs to be retained exists between the original multimedia data item and the derivative multimedia data item, namely, the content of the first region. The remaining content outside the first region can be randomly generated using a correlation algorithm applied to the application. Therefore, the aforementioned correlation index can be set to determine the degree of correlation between the randomly generated content and the original multimedia data item, thereby enabling targeted control of the randomly generated region content and improving the accuracy of the random content in the derivative multimedia data item.
[0187] In some implementations, the user may also set a default correlation index in the application, such as setting the default correlation index to 80%. When the user does not set the correlation setting item 65, the correlation index may be set to a default value, such as 80%.
[0188] In S502 , the terminal device obtains original multimedia data in response to a data import operation initiated by the user.
[0189] In some implementations, the original multimedia data may be image data, video data, document data, web page data, or other multimedia data, and the data type of the multimedia data is not specifically limited.
[0190] In this embodiment, when the terminal starts the above-mentioned application for batch generating derivative multimedia data, the corresponding operation interface also includes a multimedia data import control. Through the above-mentioned import control, the original multimedia data used to generate the derivative multimedia data (i.e., the above-mentioned first multimedia data) is imported into the application, so that derivative multimedia data based on the original multimedia data can be generated.
[0191] Continue with Figure 6 For example, see Figure 6 As shown in (b) of FIG. 5 , the setting operation interface further includes a multimedia data import area 66 . Users can import original multimedia data in the import area 66 .
[0192] For example, in response to the user's click operation on the import area 66, the terminal generates a selection interface for multimedia data, such as Figure 6 As shown in (c) in FIG, the user can select multimedia data from local storage areas, such as the album folder 67 and the video folder 68, or download original multimedia data from a cloud server, such as a network disk 69. After the user completes the selection of original multimedia data, for example, selecting image 1, the user can click the import control 610 to import the original multimedia data into the above application, thereby obtaining the corresponding import completion operation interface, as shown in FIG. Figure 6 As shown in (d), continue to set other setting items.
[0193] It should be noted that the user can set various setting items first and then import the original multimedia data, or can import the original multimedia data first and then set various setting items. The execution order of the above two operations is not limited here.
[0194] In S503 , the terminal device determines first layout information of the original multimedia data according to the setting parameters in response to the setting completion operation initiated by the user.
[0195] In this embodiment, after completing the settings, the user can click Figure 6 The next step, shown in (d), generates corresponding layout information through an application that batch generates derivative multimedia data. The settings interface includes user-entered settings parameters, such as the aforementioned industry type, target size, number of derivatives, and correlation index. Based on the settings parameters, the electronic device can perform a layout analysis on the original multimedia data imported by the user, determine at least one area for content retention, namely, the aforementioned first area, and generate first layout information based on the first area.
[0196] In some possible implementations, the step of determining the first layout information may include:
[0197] S503.1: Determine the industry type of the original multimedia data according to the setting parameters.
[0198] S503.2: Identify the reserved area in the original multimedia data according to the industry type and determine at least one first area.
[0199] In this embodiment, different industry types require different content to be retained. Therefore, the electronic device first extracts the industry type from the setting parameters (wherein the industry type can be manually selected by the user or automatically identified by the electronic device after analyzing the original multimedia data) and determines the corresponding retained content based on the industry type. After determining the required retained content, the electronic device can identify the area corresponding to the retained content from the original multimedia data and use it as the first area.
[0200] For example, Figure 8 FIG1 shows a schematic diagram of first layout information provided by an embodiment of the present application. Figure 8 As shown in (a) of FIG, the original multimedia data imported by the user is an image data, which includes area 1 for the product name and area 2 for the product appearance. According to the user's layout setting operation, the above-mentioned industry type is determined to be an electrical appliance type, so it can be determined that the content to be retained is the electrical appliance name and the electrical appliance appearance. Therefore, by performing image analysis on the image data imported by the user, the areas to be retained, namely the above-mentioned area 1 and area 2, can be determined, and the first layout information is obtained based on the above-mentioned two areas, as shown in FIG. Figure 8 As shown in (b) in .
[0201] S503.3: Determine at least one derived region (ie, second region) in the original multimedia data according to the first region.
[0202] In this embodiment, the first region is the area where content is retained. Therefore, the electronic device can determine a derivative region, i.e., a second region, from other regions of the original multimedia data other than the first region, from which random derivation can be performed. In some possible implementations, all regions other than the first region can be used as derivative regions, or a portion of the regions other than the first region can be selected as derivative regions. The specific method can be determined based on actual circumstances.
[0203] S503.4: Display first layout information including the first area and the second area.
[0204] In this embodiment, after determining the first area and the second area, the electronic device can display a prompt interface containing the first layout information in the application for batch generating derivative multimedia data, such as Figure 8As shown in (b) in the figure, the user can confirm whether the first layout information determined by the application is correct.
[0205] In S504 , the terminal device generates layout confirmation information in response to the layout confirmation operation input by the user.
[0206] In this embodiment, the terminal device can display the determined first layout information. If the user does not need to adjust the first layout information, he can directly click the confirmation control in the interface, such as Figure 8 Control 81 in (b) in FIG.
[0207] In a possible implementation, in S504, the method may further include: the terminal adjusting the first layout information in response to an adjustment operation initiated by the user based on the first layout information to generate second layout information.
[0208] In this embodiment, after the terminal determines the first layout information corresponding to the original multimedia data through the above application, the corresponding first layout information can be displayed in the above operation interface, such as Figure 8 As shown in (b) in the figure, the user can determine whether the first area identified by the application is accurate based on the above-mentioned first layout information, or determine whether it is necessary to adjust the already set setting parameters, such as the already set industry type and derivative quantity. If the user does not need to adjust the first layout information, the user can click the above-mentioned confirmation control 81. In the case where the user does not need to adjust the first layout information, the terminal can perform the operation S505 based on the first layout information; conversely, if the user needs to adjust the first layout information, the user can drag the above-mentioned mark boxes corresponding to area 1 and area 2 to adjust the position of the first area identified by the application. Of course, in addition to adjusting the position of the first area, the size of the above-mentioned mark box can also be adjusted, that is, the size of the first area can be adjusted. The specific adjustment method can be set according to the actual situation.
[0209] In one possible implementation, the above-mentioned adjustment operation also includes an operation of adding the first area. The confirmation interface of the above-mentioned first layout information may also include a control 82 for adding an area. The user can click the above-mentioned control 82 to add a mark box for selecting the first area to add the first area that the user needs to retain.
[0210] In a possible implementation, the above adjustment operation also includes a deletion operation of the first area. The confirmation interface of the above first layout information may also include a control 83 for area deletion. The user can click the above control 83 to select the first area to be deleted from the identified first area.
[0211] In some implementations, the first layout information further includes an area derived from the original multimedia data, namely the second area, such as Figure 8 In addition to adjusting the first area, the user can also adjust the second area to adjust the second area.
[0212] In S505 , the terminal generates at least one second multimedia data including the first area based on the first layout information.
[0213] In this embodiment, after determining the first layout information corresponding to the original multimedia data, the terminal can generate derivative multimedia data corresponding to the original multimedia data (i.e., the aforementioned second multimedia data) based on the first layout information. Since the first layout information determines the content to be retained in the original multimedia data, i.e., the content displayed in the first area, the content displayed in the first area is retained in the derivative multimedia data.
[0214] For example, Figure 9 A schematic diagram showing the comparison between the original multimedia data and the derived multimedia data provided by an embodiment of the present application is shown. Figure 9 As shown in (a) of FIG, the original multimedia data is an image data, namely, image 1, which includes area 1 for the product name and area 2 for the product appearance. Both areas need to be retained, namely, the first area in the first layout information. When the terminal generates derivative multimedia data corresponding to the original multimedia data, the contents of the two areas are retained, and the corresponding algorithm is used to generate content that has a certain degree of correlation with other areas of the original multimedia data except the two areas, that is, the content obtained. Figure 9 (b) shows images 2 and 3. Compared with image 1, the positions of the two regions in image 2 are consistent with those in image 1. That is, the positions and contents of the two regions are not changed, and the contents other than the two regions are adjusted.
[0215] In some implementations, the position of the above-mentioned area where the content is retained in the image may be changed, such as Figure 9 Image 3 is displayed in (b) of the image. Compared to Image 1, Image 3 retains the content of the two aforementioned regions, but their relative positions within the overall image have changed. The display positions of the two regions can be determined based on factors such as the aesthetic engine and the overall image composition. The display position of the first region in the derived multimedia data is not limited here.
[0216] Corresponding to the above-mentioned multiple setting parameters, that is, when generating derivative multimedia data, the terminal can also perform corresponding operations according to different setting parameters, which are specifically described as follows:
[0217] Execution content 1: Response to the execution content corresponding to the target size
[0218] In this embodiment, if the original size of the original multimedia data is inconsistent with the target size in the first layout information, the terminal can generate derivative multimedia data corresponding to the target size. Figure 10 A schematic diagram of generating derivative multimedia data based on target size according to an embodiment of the present application is shown. Figure 10 As shown in (a) of FIG10 , the original multimedia data is an image data, namely, Image 1, which has a size of 4:3. However, the target size obtained after user adjustment is 1:1. Since the two sizes are inconsistent, the terminal generates derived multimedia data according to the specifications of the target size, such as Image 2 shown in (b) of FIG10 . Similarly, the content retained in Image 1 (i.e., Regions 1 and 2) will also be displayed in Image 2, i.e., Regions 3 and 4.
[0219] In some implementations, to ensure visibility of the content, the area sizes of the region 1 and the region 3 are the same, and the area sizes of the region 2 and the region 4 are the same.
[0220] Execution content 2: Response to the execution content corresponding to the derived quantity
[0221] In this embodiment, the setting parameters of the first layout information record include a derivative quantity, which can be set by the user or determined based on the default setting. The specific determination method can refer to the relevant description of S501 and will not be repeated here. Wherein, the derivative quantity is N, and N is a positive integer greater than 0, then the terminal will generate N derivative multimedia data. Wherein, each derivative multimedia data contains the display content of the first area. The terminal can generate N derivative area data associated with the display content of the second area based on the derivative quantity N, and merge each derivative area data with the display content in the first area that needs to be retained (i.e., the first area data), thereby obtaining a corresponding number of N derivative multimedia data.
[0222] For example, Figure 11 FIG2 shows a schematic diagram of generating multiple multimedia data based on derivative data provided by an embodiment of the present application. Figure 11 As shown, the number of derivatives is 3. The terminal can extract the first region data (i.e., region 1) of the first region from the original multimedia data (i.e., image 1), and generate 3 different derived region data, i.e., region 2 to region 4, based on the semantic description information and correlation index corresponding to the second region, and merge the above three regions with region 1 respectively to obtain images 2 to image 4, thereby achieving the purpose of generating multiple derived multimedia data.
[0223] Execution content 3: Execution content corresponding to the correlation index
[0224] In this embodiment, the terminal device may determine the degree of association between the derived region data in the multimedia data and the second region data corresponding to the second region based on a correlation index. If the correlation index indicates a higher degree of association between the two, the generated derived region data and the second region data have a greater similarity; conversely, if the correlation index indicates a lower degree of association between the two, the similarity between the derived region data and the second region data has a lower similarity.
[0225] In some implementations, the process of generating the derived multimedia data according to the correlation index may specifically include the following steps:
[0226] Step 1: Divide the original multimedia data into regions according to the first region to obtain first region data corresponding to the first region and second region data corresponding to the second region.
[0227] In this embodiment, the terminal may divide the original multimedia data into regions according to the position of the first region in the original multimedia data in the first layout information. For example, Figure 12 FIG1 shows a schematic diagram of generating derivative multimedia data provided by an embodiment of the present application. Figure 12 As shown, the terminal can generate the following according to the position of the first area in the original multimedia data in the first layout information: Figure 12 , wherein, in the mask 1, the pixel value corresponding to the first region can be set to 0, and the pixel value corresponding to the second region can be set to 255. The terminal can merge the mask 1 with the original multimedia data (i.e., image 1), thereby obtaining the first region data corresponding to the first region, i.e., the element 1 and the element 2, and the second region data corresponding to the second region, i.e., the element 3, so as to realize the division of the region data of different regions.
[0228] Step 2: Perform semantic recognition on the second region data of the second region to obtain semantic description information of the second region.
[0229] In this embodiment, after dividing the original multimedia data, the terminal obtains the second area data corresponding to the second area, and performs semantic recognition on the second area data, that is, converts the multimedia data represented by graphics into semantic description information represented by text, so that derived area data that has a certain correlation with the content can be generated according to the correlation index, thereby achieving the purpose of content-oriented derivation and improving the accuracy of derived area data generation.
[0230] In some implementations, the semantic recognition algorithm may specifically be a multimodal model, and the semantic description information corresponding to the second region data is extracted through the multimodal model.
[0231] Continue to see Figure 12 As shown, the terminal can import the second area data into the semantic recognition algorithm to determine the semantic description information corresponding to element 3, that is, for example, "two young people are walking on the road, the young man on the left is wearing short sleeves, and the young man on the right is wearing long sleeves."
[0232] Step 3: Generate at least one of the derived region data according to the association index and the semantic description information.
[0233] In this embodiment, the terminal can determine the degree of association between the content of the derived region data and the second region data based on the association index. For example, if the value of the association index is large, it means that the degree of association between the derived region data and the second region data is high. In this case, the derived region data can generate corresponding derived region content based on the above-mentioned semantic description information.
[0234] For example, see Figure 12 As shown, the value of the above correlation index is high, which means that the derived area data and the second area data have a strong correlation. At this time, the semantic description information corresponding to the derived area data can be "two young people are walking on the road, the young man on the left is wearing short sleeves, and the young man on the right is wearing short sleeves", thereby obtaining derived element 1 and derived element 2, wherein the difference between the above derived element 1 and derived element 2 can be the relative position relationship between the two young people. For example, in derived element 1, the two young people are walking side by side, while in derived element 2, the two young people are not walking side by side, but one is in front and the other is behind.
[0235] If the value of the above correlation index is low, it means that the correlation between the derived region data and the second region data is weak. At this time, the semantic description information corresponding to the derived region data can be "two trees on the mountain, the tree on the left is blooming, and the tree on the right is not blooming", thereby obtaining derived element 3.
[0236] Step 4: Merge each derived region data with the first region data of the first region to obtain each derived multimedia data.
[0237] In this embodiment, the terminal may merge the generated derived region data with the first region data corresponding to the first region. The display position of the first region data during the merging may be consistent with or inconsistent with the original multimedia data. In some implementations, the terminal may import the derived region data and the first region data into a preset image synthesis model, such as an image model constructed based on an aesthetic engine, to obtain the corresponding derived multimedia data.
[0238] For example, Figure 13 FIG1 shows a schematic diagram of generating derivative multimedia data provided by an embodiment of the present application. Figure 13 As shown, the terminal can merge element 1 and element 2 with the derived element 1 respectively to obtain a derived image 1, wherein the position of the element corresponding to the first area in the derived image 1 is consistent with the position in image 1.
[0239] The terminal may merge element 1 and element 2 with derived element 2 to obtain derived image 2, wherein the position of the element corresponding to the first area in the derived image 1 may be different from the position in image 1.
[0240] In some implementations, if the target size is inconsistent with the original size of the original multimedia data, the size of the generated derivative region data is determined based on the target size, and the size of the first region data corresponding to the first region can remain consistent with the size in the original multimedia data. Since the target size of the derived region data is larger than the size of the first region data, when the above two types of region data are merged, the size of the synthesized derivative multimedia data is determined by the target size of the derived region data.
[0241] In this embodiment, the above-mentioned industry type is specifically used to determine the first area in the original multimedia data, that is, to generate the first layout information. Therefore, in the process of generating the derived multimedia data, corresponding operations may not be performed according to the above-mentioned industry type.
[0242] In some implementations, when determining the derived region data in the derived multimedia data, the derived region data may be generated based on the association index and the aforementioned industry type. Specifically, when generating the derived region data based on the semantic description information corresponding to the second region, the corresponding derived region data may be generated based on the association index, the industry type, and the semantic description information. For example, if the aforementioned industry type is electrical appliances, and electrical appliances are generally used indoors, then when generating the derived region data, the multimedia data may be set to an indoor setting, such as a home, classroom, or office. The semantic description information and the association index are then combined to generate derived region data for indoor settings.
[0243] In some implementations, if the user adjusts the first layout information, that is, after obtaining the corresponding second layout information, S502 may specifically include: the terminal generating, based on the second layout information, at least one second multimedia data item including the first region. The specific method for generating the second multimedia data item based on the second layout information is the same as the method for generating the second multimedia data item based on the first layout information. For a detailed description, please refer to the above description and will not be repeated here.
[0244] In this embodiment, after generating the derived multimedia data, the terminal may store the derived multimedia data in the terminal's memory; or may select part or all of the derived multimedia data for storage according to the user's operation. Figure 14 The following is a schematic diagram showing the storage of derived multimedia data provided by an embodiment of the present application. After obtaining the derived multimedia data, the terminal can display the generated multiple derived multimedia data on the corresponding page, such as Figure 14 The user can select the derived multimedia data to be exported from the above multiple images, such as selecting image 1 and image 2 and clicking the export control 141 to store the selected images in the terminal's memory.
[0245] As can be seen from the above, in a method for generating multimedia data provided by an embodiment of the present application, the terminal can generate first layout information corresponding to the first multimedia data according to the user's layout setting operation, and then when generating the derived regional data corresponding to the first multimedia data, that is, when generating the second multimedia data, the terminal retains the regional data of the first region in the first multimedia data according to the first layout information, thereby obtaining the second multimedia data containing the regional data of the first region, thereby achieving the purpose of personalized generation of derived regional data. Compared with existing multimedia technologies, the method for generating multimedia data provided by an embodiment of the present application does not use the same template for data derivation for all multimedia data, but can personalize the corresponding first layout information according to the user's setting operation and the original multimedia data specified by the user, thereby accurately determining the first region that the user needs to retain, thereby generating derived regional data that retains the regional data of the first region in the original multimedia data, thereby improving the accuracy of the generation of derived regional data and also improving the efficiency of batch generation of derived regional data.
[0246] Example 2:
[0247] For example, Figure 15 A schematic diagram showing an application scenario of the method for generating multimedia data provided by another embodiment of the present application is shown. Figure 15 As shown, in this application scenario, the above-mentioned method for generating multimedia data is applied to a multimedia data generation system, and the multimedia data generation system includes a terminal 151 and a server 152. The terminal 151 can be a terminal device such as a smart phone, a laptop computer, a tablet computer, a desktop computer, etc. An application for batch generation of derivative multimedia data can be installed in the above-mentioned terminal 151, and the user can batch generate derivative multimedia data through the application running in the terminal.
[0248] Different from the first embodiment, the application installed in the terminal 151 in this embodiment can hand over the layout recognition of the original multimedia data and the related operations of generating derivative multimedia data to the server 152, that is, the application is used to generate a corresponding operation interface to collect the original multimedia data imported by the user and set parameters through the terminal 151, and upload the above-collected data to the server 152, thereby reducing the computing pressure of the terminal 151 when generating multimedia data in batches.
[0249] The following describes in detail the interactive process of the method for generating multimedia data provided by the embodiment of the present application. Figure 15 Application scenarios, Figure 16 An interactive flow chart showing a method for generating multimedia data according to an embodiment of the present application is shown. Figure 16 As shown, the method for generating multimedia data provided in the embodiment of the present application specifically includes S1601 to S1606, and the specific implementation process is detailed as follows:
[0250] In S1601, the terminal sends a setting data packet to the server in response to a layout setting operation initiated by the user; the setting data packet includes the setting parameters and the first multimedia data.
[0251] In this embodiment, an application for batch generating derivative multimedia data is installed on the terminal. Through the operation interface generated by the application, the original multimedia data imported by the user (i.e., the first multimedia data) can be obtained, and the corresponding setting parameters can be determined based on the layout setting operation initiated by the user. The specific method of obtaining the setting parameters can be found in the relevant descriptions of S501 and S502 in Example 1, which will not be repeated here.
[0252] In this embodiment, after the terminal obtains the original multimedia data and layout parameters imported by the user through the application, it can encapsulate the above two types of data to obtain a setting data packet, and send the setting data packet to the server.
[0253] In S1602, the server determines first layout information corresponding to the first multimedia data based on the setting data packet sent by the terminal.
[0254] In this embodiment, after receiving a configuration data packet sent by the terminal via an application, the server may extract configuration parameters from the configuration data packet and determine first layout information based on the configuration parameters and the original multimedia data. The first layout information includes the first region to be retained. The manner in which the server determines the first layout information can be found in the description of the terminal determining the first layout information in S503 and is not further described here.
[0255] In S1603, the terminal receives the first layout information fed back by the server.
[0256] In this embodiment, the server may send the determined first layout information to the terminal, so that the user can determine through the terminal whether the first area in the first layout information needs to be adjusted.
[0257] In S1604, the terminal sends layout confirmation information about the first layout information to the server.
[0258] In this embodiment, if the user does not need to adjust the first layout information, the terminal may generate layout confirmation information according to the first layout information, and send the layout confirmation information to the server.
[0259] In this embodiment, if the user needs to adjust the first area in the first layout information, they can initiate a corresponding adjustment operation. The terminal can obtain the second layout information adjusted from the first layout information based on the user's adjustment operation. The specific implementation method for obtaining the second layout information can be found in the relevant operations for determining the second layout information in S501, and will not be repeated here. After obtaining the second layout information based on the user's adjustment operation, the terminal can generate layout confirmation information based on the second layout information and send the layout confirmation information to the server.
[0260] In S1605 , the server generates at least one second multimedia data including the first area according to the layout confirmation information and the setting parameters.
[0261] In this embodiment, after receiving the layout confirmation information sent by the terminal, the server can divide the original multimedia data according to the first layout information or the second layout information included in the layout confirmation information, and then generate a corresponding number and size of derivative multimedia data according to the set parameters. The specific implementation method of generating the derivative multimedia data can be found in the relevant description of S502 and will not be repeated here.
[0262] In S1606 , the terminal receives at least one second multimedia data sent by the server.
[0263] In this embodiment, when the server generates derivative multimedia data corresponding to the original multimedia data, it can send it to the terminal through the application. The terminal can store the derivative multimedia data in the local memory, or it can choose to store part or all of the derivative multimedia data in the local memory according to the user's operation.
[0264] In the embodiments of the present application, the layout confirmation of the original multimedia data and the generation of the derived data are performed by the server, which can reduce the computing pressure of the terminal and the size of the algorithms included in the applications installed in the terminal. On the other hand, because the server can train relevant algorithms (such as the layout information recognition algorithm and the derived area data generation algorithm) through big data, the server can complete the generation of the derived multimedia data and the layout recognition task, which can improve the accuracy of the derived multimedia data and thus enhance the user experience.
[0265] Example 3:
[0266] Compared with the second embodiment, the second embodiment describes the method for generating multimedia data provided by the embodiment of the present application from the perspective of interaction between the terminal and the server, while the third embodiment describes the method for generating multimedia data provided by the embodiment of the present application from the perspective of the server. For example, Figure 17 The following is a flowchart illustrating a method for generating multimedia data provided by an embodiment of the present application on the server side, which is specifically described as follows:
[0267] In S1701, a setting data packet sent by a terminal is received; the setting data packet includes first multimedia data and setting parameters determined based on a layout setting operation of a user;
[0268] In S1702, based on the setting data packet, layout confirmation information corresponding to the first multimedia data is determined; the layout confirmation information is used to determine a first area in the first multimedia data;
[0269] In S1703, at least one second multimedia data including the first area is generated according to the layout confirmation information and the setting parameters.
[0270] Optionally, the layout confirmation information includes first layout information;
[0271] The determining, based on the setting data packet, layout confirmation information corresponding to the first multimedia data includes:
[0272] generating first layout information corresponding to the first multimedia data based on the setting data packet;
[0273] sending the first layout information to the terminal;
[0274] The generating, according to the layout confirmation information and the setting parameters, at least one second multimedia data including the first area includes:
[0275] In response to the confirmation instruction sent by the terminal, at least one second multimedia data is generated according to the first layout information and setting parameters.
[0276] Optionally, the layout confirmation information includes second layout information;
[0277] After sending the first layout information to the terminal, the method further includes:
[0278] In response to the adjustment instruction sent by the terminal, performing layout adjustment on the first layout information based on the adjustment instruction to obtain second layout information;
[0279] The generating, according to the layout confirmation information and the setting parameters, at least one second multimedia data including the first area includes:
[0280] At least one second multimedia data is generated according to the second layout information and the setting parameters.
[0281] Optionally, the layout confirmation information is further used to determine a second area in the first multimedia data, and generating at least one second multimedia data including the first area according to the layout confirmation information and the setting parameters includes:
[0282] generating at least one derived region data associated with the second region;
[0283] The second multimedia data is generated according to the first region data of the first region and the derived region data.
[0284] Optionally, the setting parameters include a derivation number N; and the generating at least one derived area data associated with the second area includes:
[0285] generating N pieces of derived region data associated with the second region;
[0286] The generating the second multimedia data according to the first region data and the derived region data of the first region includes:
[0287] N pieces of the second multimedia data are generated based on the N pieces of the derived region data and the first region data.
[0288] Optionally, the setting parameters include an association index; and the generating of at least one derived area data associated with the second area includes:
[0289] performing semantic recognition on the second region data of the second region to obtain semantic description information of the second region;
[0290] At least one of the derived region data is generated according to the association index and the semantic description information.
[0291] Optionally, the setting parameters include a target size; and generating at least one second multimedia data including the first area according to the layout confirmation information and the setting parameters includes:
[0292] Based on the layout confirmation information, at least one second multimedia data matching the target size is generated.
[0293] Optionally, the setting parameter includes an industry type corresponding to the first multimedia data, and determining layout confirmation information corresponding to the first multimedia data based on the setting data packet includes:
[0294] According to the industry type corresponding to the first multimedia data, determining at least one first area corresponding to the industry type from the first multimedia data;
[0295] The layout confirmation information is obtained according to at least one of the first regions.
[0296] Example 4:
[0297] Corresponding to the relevant steps executed by the terminal in the method for generating multimedia data in the first and second embodiments above, Figure 18 A structural block diagram of a device for generating multimedia data applied to a terminal provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.
[0298] See also Figure 18 As shown, the multimedia data generating device includes:
[0299] a layout setting unit 181 configured to generate, in response to a layout setting operation initiated by a user, first layout information corresponding to the first multimedia data specified by the user according to setting parameters corresponding to the layout setting operation; the first layout information being used to determine a first region in the first multimedia data;
[0300] The derivation unit 182 is configured to generate at least one second multimedia data including the first area based on the first layout information.
[0301] Optionally, the derivative unit includes:
[0302] a derived region generating unit, configured to generate at least one derived region data associated with the second region;
[0303] The derived region merging unit is configured to generate the second multimedia data according to the first region data of the first region and the derived region data.
[0304] Optionally, the setting parameters include a derivation number N; the derivation region generating unit is specifically configured to generate N derivation region data associated with the second region;
[0305] The derived region merging unit is specifically configured to generate N pieces of the second multimedia data based on the N pieces of the derived region data and the first region data.
[0306] Optionally, the setting parameters include a correlation index; and the derived region generating unit includes:
[0307] a semantic description determining unit, configured to perform semantic recognition on the second region data of the second region to obtain semantic description information of the second region;
[0308] The semantic derivation unit is configured to generate at least one of the derived region data according to the association index and the semantic description information.
[0309] Optionally, the setting parameter includes a target size; and the deriving unit includes:
[0310] A size adjustment unit is configured to generate at least one second multimedia data that matches the target size based on the first layout information.
[0311] Optionally, the layout setting unit includes:
[0312] an industry type determining unit, configured to determine, from the first multimedia data, at least one first region corresponding to the industry type according to the industry type corresponding to the first multimedia data;
[0313] The first region generating unit is configured to generate the first layout information according to at least one first region.
[0314] Optionally, the generating device further includes:
[0315] An industry type setting unit is configured to determine the industry type corresponding to the first multimedia data in response to the layout setting operation.
[0316] Optionally, the generating device further includes:
[0317] a layout adjustment unit, configured to adjust the first layout information in response to an adjustment operation initiated by a user based on the first layout information, and generate second layout information;
[0318] The second layout generating unit is configured to generate at least one second multimedia data including the first area based on the second layout information.
[0319] Optionally, the layout setting unit includes:
[0320] a setting data packet sending unit, configured to send a setting data packet to a server in response to a layout setting operation initiated by a user; the setting data packet includes the setting parameters and the first multimedia data;
[0321] The first layout information receiving unit is configured to receive the first layout information fed back by the server.
[0322] Optionally, the derivative unit includes:
[0323] a layout confirmation information sending unit, configured to send layout confirmation information about the first layout information to the server; the layout confirmation information includes the first layout information or second layout information obtained by adjusting the first layout information;
[0324] The second layout derivation unit is configured to receive at least one second multimedia data generated by the server according to the layout confirmation information and the setting parameters.
[0325] Embodiment 5:
[0326] Corresponding to the relevant steps executed by the server in the method for generating multimedia data in the second embodiment above, Figure 19 A structural block diagram of a multimedia data generation device applied to a server provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.
[0327] See also Figure 19 As shown, the multimedia data generating device includes:
[0328] The setting receiving unit 191 is configured to receive a setting data packet sent by a terminal; the setting data packet includes first multimedia data and setting parameters determined based on a user's layout setting operation;
[0329] a layout confirmation unit 192 configured to determine layout confirmation information corresponding to the first multimedia data based on the setting data packet; the layout confirmation information is used to determine a first region in the first multimedia data;
[0330] The derivative data generating unit 193 is configured to generate at least one second multimedia data including the first area according to the layout confirmation information and the setting parameters.
[0331] Optionally, the layout confirmation information includes first layout information;
[0332] The layout confirmation unit includes:
[0333] a first layout information determining unit, configured to generate first layout information corresponding to the first multimedia data based on the setting data packet;
[0334] a first layout information sending unit, configured to send the first layout information to the terminal;
[0335] The derivative data generating unit includes:
[0336] The first derivative data generating unit is configured to generate at least one second multimedia data according to the first layout information and setting parameters in response to a confirmation instruction sent by the terminal.
[0337] Optionally, the layout confirmation information includes second layout information;
[0338] The generating device also includes:
[0339] a second layout information determining unit, configured to, in response to an adjustment instruction sent by the terminal, perform layout adjustment on the first layout information based on the adjustment instruction to obtain second layout information;
[0340] The derivative data generating unit includes:
[0341] The second derivative data generating unit is configured to generate at least one second multimedia data according to the second layout information and the setting parameters.
[0342] Optionally, the layout confirmation information is further used to determine a second area in the first multimedia data, and the derivative data generation unit includes:
[0343] a derived region data generating unit, configured to generate at least one derived region data associated with the second region;
[0344] The derived region merging unit is configured to generate the second multimedia data according to the first region data of the first region and the derived region data.
[0345] Optionally, the setting parameter includes a derivation number N; the derived region data generating unit is specifically configured to generate N derived region data associated with the second region;
[0346] The derived region merging unit is specifically configured to generate N pieces of the second multimedia data based on the N pieces of the derived region data and the first region data.
[0347] Optionally, the setting parameters include a correlation index; and the derived region data generating unit includes:
[0348] a semantic description determining unit, configured to perform semantic recognition on the second region data of the second region to obtain semantic description information of the second region;
[0349] The semantic description generating unit is configured to generate at least one of the derived region data according to the association index and the semantic description information.
[0350] Optionally, the setting parameters include a target size; and the derivative data generating unit includes:
[0351] A size adjustment unit is configured to generate at least one second multimedia data that matches the target size based on the layout confirmation information.
[0352] Optionally, the setting parameter includes an industry type corresponding to the first multimedia data, and the derived data generating unit includes:
[0353] an industry type confirmation unit, configured to determine, from the first multimedia data, at least one first region corresponding to the industry type according to the industry type corresponding to the first multimedia data;
[0354] The layout confirmation information generating unit is configured to obtain the layout confirmation information according to at least one of the first regions.
[0355] Figure 20 This is a schematic diagram of the structure of an electronic device provided in one embodiment of the present application. Figure 20 As shown, the electronic device 20 of this embodiment includes: at least one processor 200 ( Figure 20 Only one processor is shown, and the number of processors can match the number of chips actually included in the electronic device in the embodiment), a memory 201 and a program 202 stored in the memory 201 and executable on the at least one processor 200, wherein the processor 200 implements the steps in any of the above-mentioned information sending method or information receiving method embodiments when executing the program 202.
[0356] The electronic device 20 may be the above-mentioned server, terminal, etc. The electronic device may include, but is not limited to, a processor 200 and a memory 201. It will be understood by those skilled in the art that Figure 20 This is merely an example of the electronic device 20 and does not constitute a limitation on the electronic device 20 . The electronic device 20 may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, it may also include input and output electronic devices, network access electronic devices, etc.
[0357] The processor 200 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. A general-purpose processor may be a microprocessor or any conventional processor.
[0358] In some embodiments, the memory 201 may be an internal storage unit of the electronic device 20, such as a hard disk or memory of the electronic device 20. In other embodiments, the memory 201 may also be an external storage electronic device of the electronic device 20, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device 20. Furthermore, the memory 201 may also include both an internal storage unit of the electronic device 20 and an external storage electronic device. The memory 201 is used to store an operating system, an application program, a boot loader (BootLoader), data, and other programs, such as the program code of the program. The memory 201 may also be used to temporarily store data that has been output or is to be output.
[0359] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of this application. Their specific functions and technical effects can be found in the method embodiment section and will not be repeated here.
[0360] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.
[0361] An embodiment of the present application also provides an electronic device, which includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, wherein the processor implements the steps of any of the above-mentioned method embodiments when executing the computer program.
[0362] An embodiment of the present application further provides a readable storage medium, wherein the readable storage medium stores a program, and when the program is executed by a processor, the steps in the above-mentioned various method embodiments can be implemented.
[0363] An embodiment of the present application provides a program product. When the program product is run on an electronic device, the electronic device can implement the steps in the above-mentioned various method embodiments when executing the program product.
[0364] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the process in the above-mentioned embodiment method by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, it can implement the steps of each of the above-mentioned method embodiments. The computer program includes computer program code, which can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium can at least include: any entity or device that can carry the computer program code to the camera / electronic device, recording medium, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.
[0365] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.
[0366] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.
Claims
1. A method for generating multimedia data, characterized in that: Applied to a terminal, the method for generating multimedia data includes: In response to a layout setting operation initiated by a user, generating first layout information corresponding to the first multimedia data specified by the user according to setting parameters corresponding to the layout setting operation; the first layout information is used to determine a first area in the first multimedia data; At least one second multimedia data including the first area is generated based on the first layout information.
2. The generation method according to claim 1, characterized in that The first layout information is further used to determine a second region in the first multimedia data. Generating at least one second multimedia data including the first region based on the first layout information includes: generating at least one derived region data associated with the second region; The second multimedia data is generated according to the first region data of the first region and the derived region data.
3. The generation method according to claim 2, characterized in that The setting parameters include a derivation number N; and the generating at least one derived area data associated with the second area includes: generating N pieces of derived region data associated with the second region; The generating the second multimedia data according to the first region data and the derived region data of the first region includes: N pieces of the second multimedia data are generated based on the N pieces of the derived region data and the first region data.
4. The generation method according to claim 2, characterized in that The setting parameters include an association index; and the generating of at least one derived area data associated with the second area includes: performing semantic recognition on the second region data of the second region to obtain semantic description information of the second region; At least one of the derived region data is generated according to the association index and the semantic description information.
5. The generation method according to any one of claims 1 to 4, characterized in that: The setting parameters include a target size; and generating at least one second multimedia data including the first area based on the first layout information includes: At least one second multimedia data matching the target size is generated based on the first layout information.
6. The generation method according to any one of claims 1 to 5, characterized in that: The step of generating, in response to a layout setting operation initiated by a user and according to setting parameters corresponding to the layout setting operation, first layout information corresponding to the first multimedia data specified by the user includes: According to the industry type corresponding to the first multimedia data, determining at least one first area corresponding to the industry type from the first multimedia data; The first layout information is generated according to at least one of the first regions.
7. The generation method according to any one of claim 6, characterized in that: Before determining at least one first area corresponding to the industry type from the first multimedia data according to the industry type corresponding to the first multimedia data, the method includes: In response to the layout setting operation, the industry type corresponding to the first multimedia data is determined.
8. The generation method according to any one of claims 1 to 7, characterized in that: After generating, in response to the layout setting operation initiated by the user, first layout information corresponding to the first multimedia data specified by the user according to the setting parameters corresponding to the layout setting operation, the method further includes: In response to an adjustment operation initiated by a user based on the first layout information, performing layout adjustment on the first layout information to generate second layout information; At least one second multimedia data including the first area is generated based on the second layout information.
9. The generation method according to any one of claims 1 to 8, characterized in that: The step of generating, in response to a layout setting operation initiated by a user and according to setting parameters corresponding to the layout setting operation, first layout information corresponding to the first multimedia data specified by the user includes: In response to a layout setting operation initiated by a user, sending a setting data packet to a server; the setting data packet includes the setting parameters and the first multimedia data; Receive the first layout information fed back by the server.
10. The generation method according to claim 8, characterized in that The generating, based on the first layout information, at least one second multimedia data including the first area includes: Sending layout confirmation information about the first layout information to the server; the layout confirmation information includes the first layout information or second layout information obtained by adjusting the first layout information; The server generates at least one second multimedia data according to the layout confirmation information and the setting parameters.
11. A method for generating multimedia data, characterized in that: Applied to a server, the method for generating multimedia data includes: Receiving a setting data packet sent by a terminal; the setting data packet includes first multimedia data and setting parameters determined based on a user's layout setting operation; determining, based on the setting data packet, layout confirmation information corresponding to the first multimedia data; the layout confirmation information being used to determine a first region in the first multimedia data; At least one second multimedia data including the first area is generated according to the layout confirmation information and the setting parameters.
12. The generation method according to claim 11, characterized in that: The layout confirmation information includes first layout information; The determining, based on the setting data packet, layout confirmation information corresponding to the first multimedia data includes: generating first layout information corresponding to the first multimedia data based on the setting data packet; sending the first layout information to the terminal; The generating, according to the layout confirmation information and the setting parameters, at least one second multimedia data including the first area includes: In response to the confirmation instruction sent by the terminal, at least one second multimedia data is generated according to the first layout information and setting parameters.
13. The generation method according to claim 12, characterized in that: The layout confirmation information includes second layout information; After sending the first layout information to the terminal, the method further includes: In response to the adjustment instruction sent by the terminal, performing layout adjustment on the first layout information based on the adjustment instruction to obtain second layout information; The generating, according to the layout confirmation information and the setting parameters, at least one second multimedia data including the first area includes: At least one second multimedia data is generated according to the second layout information and the setting parameters.
14. The generation method according to claim 11, characterized in that The layout confirmation information is further used to determine a second region in the first multimedia data, and generating at least one second multimedia data including the first region according to the layout confirmation information and the setting parameters includes: generating at least one derived region data associated with the second region; The second multimedia data is generated according to the first region data of the first region and the derived region data.
15. The generation method according to claim 14, characterized in that: The setting parameters include a derivation number N; and the generating at least one derived area data associated with the second area includes: generating N pieces of derived region data associated with the second region; The generating the second multimedia data according to the first region data and the derived region data of the first region includes: N pieces of the second multimedia data are generated based on the N pieces of the derived region data and the first region data.
16. The generation method according to claim 14, characterized in that The setting parameters include an association index; and the generating of at least one derived area data associated with the second area includes: performing semantic recognition on the second region data of the second region to obtain semantic description information of the second region; At least one of the derived region data is generated according to the association index and the semantic description information.
17. The generation method according to any one of claims 11 to 16, characterized in that: The setting parameters include a target size; and generating at least one second multimedia data including the first area according to the layout confirmation information and the setting parameters includes: Based on the layout confirmation information, at least one second multimedia data matching the target size is generated.
18. The generation method according to any one of claims 11 to 17, characterized in that: The setting parameter includes an industry type corresponding to the first multimedia data, and determining layout confirmation information corresponding to the first multimedia data based on the setting data packet includes: According to the industry type corresponding to the first multimedia data, determining at least one first area corresponding to the industry type from the first multimedia data; The layout confirmation information is obtained according to at least one of the first regions.
19. An electronic device, characterized in that: The electronic device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the method according to any one of claims 1 to 10 or the steps of the method according to any one of claims 11 to 18 are implemented.
20. A computer-readable storage medium storing a computer program, wherein: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 10 or the steps of the method according to any one of claims 11 to 18 are implemented.
Citation Information
Cited By
Multimedia data sending method, terminal, and server
EP4770047A1
Multimedia data sending method, terminal, and server
WO2025195263A1