Multimedia data sending method, terminal, and server

Abstract

The present application is suitable for the technical field of data processing, and provides a multimedia data sending method, a terminal, and a server. The method comprises: in response to a layout setting operation initiated by a user, on the basis of a setting parameter corresponding to the layout setting operation, generating first layout information corresponding to first multimedia data specified by the user, wherein the first layout information is used for determining a first area in the first multimedia data; and on the basis of the first layout information, generating at least one second multimedia data comprising the first area. In the technical solution provided by the present application, a first area needing to be retained by a user can be accurately determined, so as to generate derived area data retaining area data of the first area in original multimedia data, thereby improving the generation accuracy of the derived area data, and also improving the efficiency of generating the derived area data in batches.

Description

A method for transmitting multimedia data, a terminal, and a server.

[0001] This application claims priority to Chinese Patent Application No. 202410332849.2, filed on March 21, 2024, entitled "A Method for Transmitting Multimedia Data, Terminal and Server", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application belongs to the field of data processing technology, and in particular relates to a method for transmitting multimedia data, a terminal, and a server. Background Technology

[0003] Multimedia, as the primary medium for content presentation today, is widely used in various fields. How to efficiently and accurately generate the multimedia data needed by users has become a key focus. Existing multimedia technologies can import multimedia data that users want to publish, such as images and videos, into a preset template, thereby generating multiple derived area data that are consistent with the layout structure of the template in batches. The template can be defined with fixed reserved areas and adjustable areas.

[0004] However, since different fields require different content to be retained, when generating derivative area data using the above method, it may be impossible to retain the content that the user needs to retain in the original multimedia data, thereby reducing the accuracy of the generated derivative area data. Summary of the Invention

[0005] This application provides a method, terminal, and server for sending multimedia data, which can solve the problem in existing multimedia technologies where using the same template to generate derivative area data in different fields can easily result in the inability to retain the content that the user needs to keep, thus reducing the accuracy of the generated derivative area data.

[0006] In a first aspect, embodiments of this application provide a method for generating multimedia data, applied to a terminal, the method for generating multimedia data including:

[0007] In response to a layout setting operation initiated by the user, first layout information corresponding to the first multimedia data specified by the user is generated according to the setting parameters corresponding to the layout setting operation; the first layout information is used to determine a first region in the first multimedia data.

[0008] Based on the first layout information, at least one second multimedia data containing the first region is generated.

[0009] Implementing the embodiments of this application has the following beneficial effects: Based on the user's layout settings, first layout information corresponding to the first multimedia data is generated. Then, when generating the derived area data corresponding to the first multimedia data (i.e., when generating the second multimedia data), the area data of the first region in the first multimedia data is retained according to the first layout information, thereby obtaining the second multimedia data containing the area data of the first region. This achieves the purpose of personalized generation of derived area data. Compared with existing multimedia technologies, the multimedia data generation method provided in this application does not use the same template for data derivation for all multimedia data. Instead, it can personalizedly determine the corresponding first layout information based on the user's settings and the original multimedia data specified by the user, thereby accurately determining the first region that the user needs to retain. This generates derived area data that retains the area data of the first region in the original multimedia data, thereby improving the accuracy of derived area data generation and also increasing the efficiency of batch generation of derived area data.

[0010] In one possible implementation of the first aspect, the first layout information is further used to determine a second region in the first multimedia data, and the step of generating at least one second multimedia data containing the first region based on the first layout information includes:

[0011] Generate at least one derived region data associated with the second region;

[0012] The second multimedia data is generated based on the first region data of the first region and the derived region data.

[0013] In one possible implementation of the first aspect, the setting parameters include the number of derivatives N; generating at least one derivative region data associated with the second region includes:

[0014] Generate N derived region data associated with the second region;

[0015] The step of generating the second multimedia data based on the first region data and the derived region data of the first region includes:

[0016] Based on the N derived region data and the first region data, N second multimedia data are generated.

[0017] In one possible implementation of the first aspect, the setting parameters include a correlation index; generating at least one derived region data associated with the second region includes:

[0018] Semantic recognition is performed on the second region data of the second region to obtain semantic description information of the second region;

[0019] At least one of the derived region data is generated based on the correlation index and the semantic description information.

[0020] In one possible implementation of the first aspect, the setting parameters include a target size; generating at least one second multimedia data containing the first region based on the first layout information includes:

[0021] Based on the first layout information, at least one second multimedia data matching the target size is generated.

[0022] In one possible implementation of the first aspect, the step of responding to a user-initiated layout setting operation and generating first layout information corresponding to the user-specified first multimedia data based on setting parameters corresponding to the layout setting operation includes:

[0023] Based on the industry type corresponding to the first multimedia data, at least one first region corresponding to the industry type is determined from the first multimedia data;

[0024] The first layout information is generated based on at least one of the first regions.

[0025] In one possible implementation of the first aspect, before determining at least one first region corresponding to the industry type from the first multimedia data based on the industry type corresponding to the first multimedia data, the method includes:

[0026] In response to the layout setting operation, the industry type corresponding to the first multimedia data is determined.

[0027] In one possible implementation of the first aspect, after generating the first layout information corresponding to the first multimedia data specified by the user based on the setting parameters corresponding to the layout setting operation in response to the user-initiated layout setting operation, the method further includes:

[0028] In response to an adjustment operation initiated by the user based on the first layout information, the first layout information is adjusted to generate second layout information;

[0029] Based on the second layout information, at least one piece of second multimedia data containing the first region is generated.

[0030] In one possible implementation of the first aspect, the step of responding to a user-initiated layout setting operation and generating first layout information corresponding to the user-specified first multimedia data based on setting parameters corresponding to the layout setting operation includes:

[0031] In response to a layout setting operation initiated by the user, a setting data packet is sent to the server; the setting data packet includes the setting parameters and the first multimedia data;

[0032] Receive the first layout information fed back by the server.

[0033] In one possible implementation of the first aspect, generating at least one second multimedia data containing the first region based on the first layout information includes:

[0034] Send layout confirmation information about the first layout information to the server; the layout confirmation information includes the first layout information or second layout information obtained by adjusting the first layout information;

[0035] The receiving server generates at least one piece of the second multimedia data based on the layout confirmation information and the setting parameters.

[0036] Secondly, embodiments of this application provide a multimedia data generation apparatus, applied to a terminal, the generation apparatus comprising:

[0037] The layout setting unit is used to respond to a layout setting operation initiated by the user and generate first layout information corresponding to the first multimedia data specified by the user according to the setting parameters corresponding to the layout setting operation; the first layout information is used to determine a first region in the first multimedia data.

[0038] A derivative unit is configured to generate at least one second multimedia data containing the first region based on the first layout information.

[0039] In one possible implementation of the second aspect, the derived unit includes:

[0040] A derived region generation unit is used to generate at least one derived region data associated with the second region;

[0041] The derived region merging unit is used to generate the second multimedia data based on the first region data and the derived region data of the first region.

[0042] In one possible implementation of the second aspect, the setting parameters include the number of derivatives N; the derivative region generation unit is specifically used to generate N derivative region data associated with the second region;

[0043] The derived region merging unit is specifically used to generate N second multimedia data based on N derived region data and the first region data.

[0044] In one possible implementation of the second aspect, the setting parameters include a correlation index; the derived region generation unit includes:

[0045] A semantic description determination unit is used to perform semantic recognition on the second region data of the second region to obtain semantic description information of the second region.

[0046] A semantic derivation unit is used to generate at least one of the derived region data based on the correlation index and the semantic description information.

[0047] In one possible implementation of the second aspect, the setting parameters include a target size; the derived unit includes:

[0048] A size adjustment unit is used to generate at least one second multimedia data that matches the target size based on the first layout information.

[0049] In one possible implementation of the second aspect, the layout setting unit includes:

[0050] An industry type determination unit is used to determine at least one first region corresponding to the industry type from the first multimedia data based on the industry type corresponding to the first multimedia data.

[0051] The first region generation unit is configured to generate the first layout information based on at least one first region.

[0052] In one possible implementation of the second aspect, the generating apparatus further includes:

[0053] An industry type setting unit is used to determine the industry type corresponding to the first multimedia data in response to the layout setting operation.

[0054] In one possible implementation of the second aspect, the generating apparatus further includes:

[0055] The layout adjustment unit is used to respond to the adjustment operation initiated by the user based on the first layout information, adjust the layout of the first layout information, and generate the second layout information.

[0056] The second layout generation unit is used to generate at least one of the second multimedia data containing the first region based on the second layout information.

[0057] In one possible implementation of the second aspect, the layout setting unit includes:

[0058] The data packet sending unit is configured to send a setting data packet to the server in response to a layout setting operation initiated by the user; the setting data packet includes the setting parameters and the first multimedia data.

[0059] The first layout information receiving unit is used to receive the first layout information fed back by the server.

[0060] In one possible implementation of the second aspect, the derived unit includes:

[0061] A layout confirmation information sending unit is used to send layout confirmation information about the first layout information to the server; the layout confirmation information includes the first layout information or second layout information obtained by adjusting the first layout information.

[0062] The second layout derivation unit is used to receive at least one of the second multimedia data generated by the server based on the layout confirmation information and the setting parameters.

[0063] Thirdly, embodiments of this application provide a method for generating multimedia data, applied to a server, the method for generating multimedia data including:

[0064] The receiving terminal sends a setting data packet; the setting data packet includes first multimedia data and setting parameters determined based on the user's layout setting operation;

[0065] Based on the configured data packet, layout confirmation information corresponding to the first multimedia data is determined; the layout confirmation information is used to determine the first region in the first multimedia data.

[0066] Based on the layout confirmation information and the setting parameters, at least one second multimedia data containing the first region is generated.

[0067] In one possible implementation of the third aspect, the layout confirmation information includes first layout information;

[0068] The step of determining the layout confirmation information corresponding to the first multimedia data based on the set data packet includes:

[0069] Based on the configured data packet, first layout information corresponding to the first multimedia data is generated;

[0070] Send the first layout information to the terminal;

[0071] The step of generating at least one second multimedia data containing the first region based on the layout confirmation information and the setting parameters includes:

[0072] In response to the confirmation command sent by the terminal, at least one piece of the second multimedia data is generated based on the first layout information and the setting parameters.

[0073] In one possible implementation of the third aspect, the layout confirmation information includes second layout information;

[0074] After sending the first layout information to the terminal, the method further includes:

[0075] In response to the adjustment command sent by the terminal, the first layout information is adjusted based on the adjustment command to obtain the second layout information;

[0076] The step of generating at least one second multimedia data containing the first region based on the layout confirmation information and the setting parameters includes:

[0077] At least one piece of the second multimedia data is generated based on the second layout information and the setting parameters.

[0078] In one possible implementation of the third aspect, the layout confirmation information is further used to determine a second region in the first multimedia data, and the step of generating at least one second multimedia data containing the first region based on the layout confirmation information and the setting parameters includes:

[0079] Generate at least one derived region data associated with the second region;

[0080] The second multimedia data is generated based on the first region data of the first region and the derived region data.

[0081] In one possible implementation of the third aspect, the setting parameters include the number of derivatives N; generating at least one derivative region data associated with the second region includes:

[0082] Generate N derived region data associated with the second region;

[0083] The step of generating the second multimedia data based on the first region data and the derived region data of the first region includes:

[0084] Based on the N derived region data and the first region data, N second multimedia data are generated.

[0085] In one possible implementation of the third aspect, the setting parameters include a correlation index; generating at least one derived region data associated with the second region includes:

[0086] Semantic recognition is performed on the second region data of the second region to obtain semantic description information of the second region;

[0087] At least one of the derived region data is generated based on the correlation index and the semantic description information.

[0088] In one possible implementation of the third aspect, the setting parameters include a target size; generating at least one second multimedia data containing the first region based on the layout confirmation information and the setting parameters includes:

[0089] Based on the layout confirmation information, at least one second multimedia data matching the target size is generated.

[0090] In one possible implementation of the third aspect, the setting parameters include the industry type corresponding to the first multimedia data, and determining the layout confirmation information corresponding to the first multimedia data based on the setting data packet includes:

[0091] Based on the industry type corresponding to the first multimedia data, at least one first region corresponding to the industry type is determined from the first multimedia data;

[0092] The layout confirmation information is obtained based on at least one of the first regions.

[0093] Fourthly, embodiments of this application provide a multimedia data generation apparatus, applied to a server, the multimedia data generation apparatus comprising:

[0094] A receiving unit is configured to receive a setting data packet sent by a terminal; the setting data packet includes first multimedia data and setting parameters determined based on the user's layout setting operation.

[0095] The layout confirmation unit is used to determine layout confirmation information corresponding to the first multimedia data based on the setting data packet; the layout confirmation information is used to determine a first region in the first multimedia data.

[0096] A derivative data generation unit is used to generate at least one second multimedia data containing the first region based on the layout confirmation information and the setting parameters.

[0097] In one possible implementation of the fourth aspect, the layout confirmation information includes first layout information;

[0098] The layout confirmation unit includes:

[0099] The first layout information determining unit is used to generate first layout information corresponding to the first multimedia data based on the setting data packet;

[0100] The first layout information sending unit is used to send the first layout information to the terminal;

[0101] The derived data generation unit includes:

[0102] The first derivative data generation unit is configured to generate at least one second multimedia data in response to a confirmation command sent by the terminal, based on the first layout information and setting parameters.

[0103] In one possible implementation of the fourth aspect, the layout confirmation information includes second layout information;

[0104] The generating apparatus also includes:

[0105] The second layout information determination unit is used to respond to the adjustment instruction sent by the terminal, and adjust the first layout information based on the adjustment instruction to obtain the second layout information;

[0106] The derived data generation unit includes:

[0107] The second derivative data generation unit is used to generate at least one of the second multimedia data based on the second layout information and the setting parameters.

[0108] In one possible implementation of the fourth aspect, the layout confirmation information is further used to determine a second region in the first multimedia data, and the derived data generation unit includes:

[0109] A derived region data generation unit is used to generate at least one derived region data associated with the second region;

[0110] The derived region merging unit is used to generate the second multimedia data based on the first region data and the derived region data of the first region.

[0111] In one possible implementation of the fourth aspect, the setting parameters include the number of derivatives N; the derivative region data generation unit is specifically used to generate N derivative region data associated with the second region;

[0112] The derived region merging unit is specifically used to generate N second multimedia data based on N derived region data and the first region data.

[0113] In one possible implementation of the fourth aspect, the setting parameters include a correlation index; the derived region data generation unit includes:

[0114] A semantic description determination unit is used to perform semantic recognition on the second region data of the second region to obtain semantic description information of the second region.

[0115] A semantic description generation unit is used to generate at least one of the derived region data based on the correlation index and the semantic description information.

[0116] In one possible implementation of the fourth aspect, the setting parameters include a target size; the derived data generation unit includes:

[0117] A size adjustment unit is used to generate at least one second multimedia data that matches the target size based on the layout confirmation information.

[0118] In one possible implementation of the fourth aspect, the setting parameters include the industry type corresponding to the first multimedia data, and the derived data generation unit includes:

[0119] An industry type confirmation unit is used to determine at least one first region corresponding to the industry type from the first multimedia data based on the industry type corresponding to the first multimedia data.

[0120] A layout confirmation information generation unit is used to obtain the layout confirmation information based on at least one of the first regions.

[0121] Fifthly, embodiments of this application provide a terminal, including: a memory, a processor, and a program stored in the memory, wherein the processor executes the program to implement the steps in the multimedia data generation method described in the first aspect.

[0122] In a sixth aspect, embodiments of this application provide a server, including: a memory, a processor, and a program stored in the memory, wherein the processor executes the program to implement the steps in the multimedia data generation method described in the first aspect.

[0123] In a seventh aspect, embodiments of this application provide a readable storage medium storing a program that, when executed by a processor, implements the steps in the multimedia data generation method described in any one of the first or third aspects.

[0124] Eighthly, embodiments of this application provide a program product that, when run on a device, causes the device to perform the steps in the multimedia data generation method described in any one of the first or third aspects above.

[0125] In a ninth aspect, embodiments of this application provide a multimedia data generation system, which includes a terminal as described in any of the fifth aspects and a server as described in any of the sixth aspects.

[0126] It is understood that the beneficial effects of aspects two through nine above can be found in the relevant descriptions in aspect one above, and will not be repeated here. Attached Figure Description

[0127] Figure 1 is a schematic diagram of an existing method for batch generating promotional images;

[0128] Figure 2 is a schematic diagram of another existing method for batch generating promotional images;

[0129] Figure 3 is a schematic diagram of the derived images generated based on the existing promotional image generation method;

[0130] Figure 4 is a schematic diagram of an application scenario of the multimedia data generation method provided in an embodiment of this application;

[0131] Figure 5 is a flowchart illustrating the implementation of a multimedia data generation method according to an embodiment of this application;

[0132] Figure 6 is a schematic diagram of the operation of generating derivative multimedia data according to an embodiment of this application;

[0133] Figure 7 is a schematic diagram of setting the above-mentioned type of setting items according to an embodiment of this application;

[0134] Figure 8 is a schematic diagram of first layout information provided in an embodiment of this application;

[0135] Figure 9 is a comparative diagram of the original multimedia data and the derived multimedia data provided in an embodiment of this application;

[0136] Figure 10 is a schematic diagram of generating derived multimedia data based on a target size according to an embodiment of this application;

[0137] Figure 11 is a schematic diagram of generating multiple multimedia data based on derived data according to an embodiment of this application;

[0138] Figure 12 is a schematic diagram of the generation of derived multimedia data provided in an embodiment of this application;

[0139] Figure 13 is a schematic diagram of the generation of derived multimedia data provided in an embodiment of this application;

[0140] Figure 14 is a schematic diagram of the storage of derived multimedia data provided in an embodiment of this application;

[0141] Figure 15 is a schematic diagram of an application scenario of the multimedia data generation method provided in another embodiment of this application;

[0142] Figure 16 is an interactive flowchart of a multimedia data generation method provided in an embodiment of this application;

[0143] Figure 17 is a flowchart of the implementation of a multimedia data generation method provided in an embodiment of this application on the server side;

[0144] Figure 18 is a structural block diagram of a multimedia data generation device for a terminal provided in an embodiment of this application;

[0145] Figure 19 is a structural block diagram of a multimedia data generation device applied to a server provided in an embodiment of this application;

[0146] Figure 20 is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0147] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.

[0148] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.

[0149] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0150] As used in this application specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrase "if determined" or "if detected [the described condition or event]" may be interpreted, depending on the context, as meaning "once determined," "in response to determination," "once detected [the described condition or event]," or "in response to detection [the described condition or event]."

[0151] Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0152] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0153] With the continuous advancement of digitalization, the medium for information dissemination is gradually shifting from print media to electronic media. Therefore, how to efficiently generate electronic media content needed by users in batches, such as multimedia data like videos and images for information dissemination, has become a key focus. Existing multimedia technologies can generate multimedia data in batches by importing fixed templates, specifically in the following two ways:

[0154] Method 1:

[0155] Figure 1 illustrates a schematic diagram of a method for batch generating promotional images. Referring to Figure 1, a user can generate a promotional image (Image 1) based on the product's promotional needs. Image 1 contains product-related promotional content, such as the product name, brand logo, or brand slogan. If the user needs to generate derivative images based on Image 1 in batches, Image 1 can be imported into template 1 as shown in Figure 1. Region 1 in template 1 is a region with built-in template elements, and this region can generate different content using a random generation algorithm. Region 2 is used to display the user-imported images; for example, the user-imported Region 1 can be displayed in Region 2. The resulting derivative images can be Image 2 and Image 3 as shown in Figure 1. Image 2 and Image 3 display different content in Region 1, while both display the user-imported Image 1 in Region 2. This achieves the generation of derivative images related to the same promotional image.

[0156] However, while the above-mentioned method of generating promotional images can adjust the content within region 1 using a random generation algorithm and merge it with the user-imported image in region 2 to generate a large number of derivative images, region 2 only occupies a portion of the derivative images. This may result in the product content to be promoted not being effectively known to users. In other words, when users view derivative images, their attention will be diverted to irrelevant random content in region 1, thus reducing the effectiveness of the derivative images in promoting the product; that is, the visibility of the product's promotional content is low.

[0157] Method 2:

[0158] Figure 2 illustrates another existing method for batch generating promotional images. Referring to Figure 2, the user's promotional image is image 1, which contains region 1 (promotional content) and region 2 (background content). If the user needs to batch generate derivative images related to image 1, image 1 can be imported into template 2 as shown in Figure 2. Template 2 contains region 3 (generating random content) and region 4 (preserving the original content). If region 1 (promotional content) in image 1 overlaps with region 4 (preserving the original content) in template 2, template 2 can randomly generate corresponding derivative content for the overlapping portion, thus generating image 2 as shown in Figure 2. The content of region 4 can be generated differently according to a random generation algorithm, thereby batch generating derivative images related to image 1 by changing the content of region 4.

[0159] However, in the above-described method of generating promotional images, since the areas for reserved content and random content in template 2 are fixed, if area 1 in the user's promotional image 1, used to display promotional content, overlaps with area 3, the required promotional content may be lost. For example, Figure 3 shows a schematic diagram of a derived image generated based on the existing method of generating promotional images. Referring to Figure 3, area 1 in image 3, which displays promotional content, overlaps with area 3 in template 2, which generates random content. Therefore, when generating a derived image of image 3 using template 2, some text in area 1 will be lost, resulting in image 4 as shown in Figure 3. In this case, the user must manually adjust template 2 to adapt it to each input promotional image, thus reducing the efficiency of generating derived images.

[0160] Therefore, in order to address the problem that existing technologies for batch generating multimedia data have reduced visibility of the content that users need to retain compared to the user's original multimedia data, and that the fixed templates prevent dynamic adjustment of the retained content based on the multimedia data, resulting in the loss of the desired promotional content, this application provides a multimedia data generation method that can achieve batch generation of derivative multimedia data while maintaining the visibility of the content that users need to retain and avoiding the loss of retained content.

[0161] Example 1:

[0162] For example, Figure 4 shows an application scenario diagram of the multimedia data generation method provided in an embodiment of this application. Referring to Figure 4, in this application scenario, the execution subject of the above-mentioned multimedia data generation method is a terminal. The terminal can be a smartphone, laptop, tablet computer, desktop computer or other terminal device. An application for batch generation of derivative multimedia data can be installed in the terminal. Users can achieve batch generation of derivative multimedia data by using the application running in the terminal.

[0163] The following describes in detail the implementation process of the multimedia data generation method provided in the embodiments of this application. Referring to the application scenario in Figure 4, Figure 5 shows a flowchart of the implementation of the multimedia data generation method provided in an embodiment of this application. As shown in Figure 5, the multimedia data generation method provided in the embodiments of this application specifically includes five steps: a derivation parameter setting step S501, an original multimedia data import step S502, a data processing setting step S503, a layout information confirmation step S504, and a derivation multimedia data generation step S505. The specific implementation process of the above five steps is detailed below:

[0164] In S501, the terminal device receives a layout setting operation initiated by the user and determines at least one setting parameter input by the user; wherein, the setting parameters include: industry type, target size, number of derivatives, and correlation index.

[0165] In this embodiment, an application for batch generation of derivative multimedia data can be installed on the terminal. Users can launch the application on the terminal to display the corresponding operation interface and initiate layout settings for the derivative multimedia data within the operation interface. This enables personalized settings for the regional layout of the derivative multimedia data, thereby improving the accuracy of the layout information and its alignment with the user's promotional needs.

[0166] For example, Figure 6 illustrates an operation diagram for generating derivative multimedia data according to an embodiment of this application. Referring to Figure 6(a), multiple different applications are installed on the terminal, including an application 61 for batch generating derivative multimedia data. Users can open the application 61 to access the corresponding batch generation operation interface, as shown in Figure 6(b). This operation interface includes multiple settings, such as size settings 62, derivative quantity settings 63, type settings 64, and correlation settings 65. Users can configure these settings according to their needs within this operation interface, i.e., initiate the corresponding layout setting operation.

[0167] In some implementations, the layout setting operation initiated by the user may specifically include the following setting parameters, which correspond to the operation of setting items 62 to 65 in Figure 6, as described in detail below:

[0168] Setting parameter 1: Target size

[0169] In this embodiment, the user can set the size of the derived multimedia data. The user can input a target size in the size setting item 62, such as 720*1080, which defines the aspect ratio of the derived multimedia data. In some implementation scenarios, the target size can be 720cm*1080cm, meaning a specific size can be set. In some implementation scenarios, the target size can also be 720 pixels (pi)*1080pi, meaning that while determining the size of the derived multimedia data, the resolution of the derived multimedia data can also be set. The specific target size input can be set according to the actual situation; the dimensions of the size setting are not limited here.

[0170] In some implementations, if the derived multimedia data has the same size as the original multimedia data, the above size setting item 62 can be configured to the default value, that is, no content is input for this setting item 62.

[0171] In some implementations, users can also set a default size in the application. If the user does not set the size setting item 62 mentioned above, the derived multimedia data can be set to the default size.

[0172] In some implementations, the above-mentioned operation interface may also include a checkbox for a default size, such as control 611. If the user checks the default size, the size of the derived multimedia data will be set to the preset default size, so that the user does not need to fill in the size every time, thereby improving the user's operation efficiency.

[0173] Setting parameter 2: Number of derivatives

[0174] In this embodiment, the user can set the number of derivative multimedia data to be generated. The user can modify the value in the derivative quantity setting item 63 above to quantitatively generate a specified number of derivative multimedia data. For example, if the user needs to publish different promotional images on 6 platforms, in addition to the already generated original multimedia data, an additional 5 derivative promotional images are needed. In this case, the user can enter 6 in the derivative quantity setting item 63 above, which initiates the setting operation for the derivative quantity.

[0175] In some implementations, users can also set a default number of derivatives in the application. For example, the default number of derivatives is 6. If the user does not set the above-mentioned derivative number setting item 63, the derivative multimedia data can be set as the default number of derivatives.

[0176] In some implementations, when the user does not set the aforementioned derivative quantity setting 63, the derivative quantity can be set to the same as the derivative quantity during the previous user operation. For example, the terminal application can establish corresponding operation databases for different users, recording the operation records of each batch generation of derivative multimedia data. These operation records contain relevant information about the derivative multimedia data generated in each batch, such as the quantity of derivative multimedia data generated. Based on this, when it is detected that the user has not set the derivative quantity for this operation, the derivative quantity corresponding to the previous operation can be obtained from the aforementioned operation records and used as the derivative quantity for the current batch generation of derivative multimedia data.

[0177] Setting parameter 3: Industry type

[0178] In this embodiment, the user can specify the industry type of the imported original multimedia data. To accurately locate the area to be retained (i.e., the first area mentioned above) from the original multimedia data, the user can specify the industry type of the original multimedia data in the aforementioned interface, i.e., set the type setting item 64. Since the layout of multimedia data is often related to the industry type of the product to be promoted, setting the industry type facilitates the subsequent determination of the area in the original multimedia data where content needs to be retained (i.e., the first area).

[0179] For example, Figure 7 shows a schematic diagram of setting the above-mentioned type setting item according to an embodiment of this application. Referring to Figure 7(a), the user can set the above-mentioned type setting item 64 after importing the original multimedia data (or before importing the multimedia data). By clicking the above-mentioned type setting item 64, the corresponding drop-down menu, i.e., menu 71, will be displayed, as shown in Figure 7(b). The above-mentioned industry type can be divided according to the industry of the user who promoted the multimedia data. That is, the above-mentioned menu 71 can display multiple candidate industry types, such as e-commerce, reading, audio-visual entertainment, utility software, games, social networking, news information, travel, automobiles, life services, finance, real estate, education, medical and health, etc. Of course, the above-mentioned industry type can also be divided according to other methods, such as classifying according to the content of the multimedia data, such as games, appliances, food, medical, etc. The specific method of dividing industry types is not limited. The user can select one of the above-mentioned multiple candidate types as the industry type corresponding to the original multimedia data. For example, if "e-commerce" is selected as the industry type, the setting item 64 will then be filled with the corresponding industry type, as shown in Figure 7(c).

[0180] In some implementations, the above-mentioned operation interface may also include an automatic recognition option 72. When the user clicks the above-mentioned option 72, the application can perform type recognition on the multimedia data imported by the user.

[0181] Because different industry types require different content to be retained—for example, if the industry type is electrical appliances, the content to be retained includes information related to the target electrical appliance, as well as the appliance model and other relevant information; if the industry type is games, the content to be retained includes the game name, game logo, and main characters, etc.—the emphasis of the content to be retained will differ depending on the industry type. To improve the accuracy of subsequent first-area recognition, the above-mentioned industry type can be set, i.e., layout settings can be performed on type setting item 64, thereby improving the accuracy of subsequent recognition.

[0182] In some implementations, users can first import the original multimedia data. An application installed on the terminal that generates batch-derived multimedia data can then analyze the original multimedia data to determine its corresponding industry type, which is displayed in the type setting item 64. If the industry type automatically identified by the application does not match the user's expected classification of the original multimedia data, the user can adjust the industry type by clicking the type setting item 64. If the industry type automatically identified by the application matches the user's expected classification of the original multimedia data, no adjustment is needed, thus improving user efficiency.

[0183] In some implementations, users can also set a default industry type in the application. For example, the default industry type can be set to the appliance type. If the user does not set the above type setting item 64, the industry type can be set to the default industry type, such as the appliance type.

[0184] Setting parameter 4: Correlation index

[0185] In this embodiment, the user can set the strength of the correlation between the derived multimedia data and the original multimedia data. The aforementioned interface includes a correlation setting item 65. The user can adjust the correlation between the derived multimedia data and the original data by setting the correlation index in this item. For example, the correlation index can be a numerical value, such as any value between 1 and 5. A higher correlation index value indicates a stronger correlation between the two data points; conversely, a lower correlation index value indicates a weaker correlation. Optionally, the value can be any value between 0% and 100%. For example, entering 80 in the correlation setting item 65 indicates a correlation index of 80%. The specific numerical range can be determined based on actual circumstances and is not limited here.

[0186] In some implementations, the content entered in the aforementioned correlation setting item 65 can also be a degree descriptor, such as strong, medium, weak, etc. Users can enter the corresponding degree descriptor in the aforementioned correlation setting item 65 according to the degree of correlation between the two. Applications that generate derivative multimedia data in batches can determine the correlation index corresponding to each degree descriptor based on the correspondence between degree descriptors and correlation indicators.

[0187] In this embodiment, the application for batch generation of derived multimedia data can generate at least one derived multimedia data corresponding to the original multimedia data. There is content that needs to be retained between the original multimedia data and the derived multimedia data, namely the content of the first region. Other content besides the first region can be randomly generated using the application's relevant algorithms. Therefore, by setting the aforementioned correlation index, the degree of content correlation between the randomly generated content and the original multimedia data can be determined, thereby enabling targeted control of the randomly generated region content and improving the accuracy of random content in the derived multimedia data.

[0188] In some implementations, users can also set a default correlation index in the application, such as setting the default correlation index to 80%. When the user does not set the correlation setting item 65 mentioned above, the correlation index can be set to the default value, such as 80%.

[0189] In S502, the terminal device responds to a user-initiated data import operation and acquires the original multimedia data.

[0190] In some implementations, the aforementioned original multimedia data can be multimedia data such as image data, video data, document data, and web page data, without specifying the data type of the multimedia data.

[0191] In this embodiment, when the terminal launches the application for batch generation of derivative multimedia data, the corresponding operation interface also includes a multimedia data import control. Through the import control, the original multimedia data (i.e., the first multimedia data mentioned above) used to generate derivative multimedia data is imported into the application, thereby enabling the generation of derivative multimedia data based on the original multimedia data.

[0192] Continuing with Figure 6 as an example, as shown in Figure 6(b), the above-mentioned settings interface also includes a multimedia data import area 66. Users can import raw multimedia data into the import area 66.

[0193] For example, in response to the user's click on the import area 66, the terminal generates a multimedia data selection interface, as shown in Figure 6(c). The user can select multimedia data from local storage areas, such as the photo folder 67 and video folder 68, or download the original multimedia data from a cloud server, such as cloud storage 69. After the user completes the selection of the original multimedia data, for example, by selecting image 1, they can click the import control 610 to import the original multimedia data into the application, thus obtaining the corresponding import completion interface, as shown in Figure 6(d), and then continue to set other settings.

[0194] It should be noted that users can either set the various settings first and then import the original multimedia data, or import the original multimedia data first and then set the various settings. The execution order of the two operations is not restricted here.

[0195] In S503, the terminal device responds to the user-initiated setup completion operation and determines the first layout information of the original multimedia data based on the setting parameters.

[0196] In this embodiment, after completing the settings, the user can click the "Next" control shown in Figure 6(d) to generate corresponding layout information through an application that generates batch derivative multimedia data. The settings interface includes user-input parameters such as industry type, target size, number of derivatives, and correlation index. The electronic device can perform layout analysis on the user-imported original multimedia data based on the settings parameters, determine at least one area for content retention (the first area mentioned above), and generate first layout information based on the first area.

[0197] In some possible implementations, the steps for determining the first layout information described above may include:

[0198] S503.1: Determine the industry type of the original multimedia data based on the setting parameters.

[0199] S503.2: Identify the reserved areas in the original multimedia data according to the industry type, and determine at least one first area.

[0200] In this embodiment, different industry types require different content to be retained. Therefore, the electronic device first extracts the industry type from the setting parameters (wherein, the industry type can be manually selected by the user or automatically identified by the electronic device after data analysis of the original multimedia data), and determines the corresponding content to be retained based on the industry type. After determining the required content to be retained, the electronic device can identify the area corresponding to the above-mentioned content to be retained from the original multimedia data and use it as the first area.

[0201] For example, Figure 8 shows a schematic diagram of the first layout information provided in an embodiment of this application. Referring to Figure 8(a), the original multimedia data imported by the user is image data, which includes region 1 containing the product name and region 2 containing the product appearance. Based on the user's layout settings, the industry type is determined to be an appliance type. Therefore, it can be determined that the content to be retained is the appliance name and appliance appearance. Thus, by performing image analysis on the image data imported by the user, the regions to be retained, namely region 1 and region 2, can be determined, and the first layout information is obtained based on the two regions, as shown in Figure 8(b).

[0202] S503.3: Determine at least one derived region (i.e., a second region) in the original multimedia data based on the first region.

[0203] In this embodiment, the first region is the region for content preservation. Therefore, the electronic device can determine a derived region, i.e., a second region, from the original multimedia data in other regions besides the first region. In some possible implementations, all regions other than the first region can be used as derived regions, or a portion of the regions other than the first region can be selected as derived regions. The specific implementation can be determined according to the actual situation.

[0204] S503.4: Display first layout information including the first area and the second area.

[0205] In this embodiment, after the electronic device determines the first region and the second region, it can display a prompt interface containing the first layout information in the application that generates derivative multimedia data in batches, as shown in Figure 8(b), so that the user can confirm whether the first layout information determined by the application is correct.

[0206] In S504, the terminal device generates layout confirmation information in response to the layout confirmation operation input by the user.

[0207] In this embodiment, the terminal device can display the determined first layout information. If the user does not need to adjust the first layout information, he / she can directly click the confirmation control in the interface, as shown by control 81 in Figure 8(b).

[0208] In one possible implementation, S504 may further include: the terminal responding to an adjustment operation initiated by the user based on the first layout information, adjusting the layout of the first layout information, and generating second layout information.

[0209] In this embodiment, after the terminal determines the first layout information corresponding to the original multimedia data through the above application, it can display the corresponding first layout information in the above operation interface, as shown in Figure 8(b). The user can determine whether the first area identified by the application is accurate based on the first layout information, or determine whether it is necessary to adjust the settings parameters that have been set, such as the industry type and derivative quantity that have been set. If the user does not need to adjust the first layout information, he / she can click the above confirmation control 81. If the user does not need to adjust the first layout information, the terminal can perform the operation of S505 based on the first layout information. Conversely, if the user needs to adjust the first layout information, he / she can adjust the position of the first area identified by the application by dragging the marker boxes corresponding to the above area 1 and area 2. Of course, in addition to adjusting the position of the first area, the size of the above marker boxes can also be adjusted, that is, the size of the first area can be adjusted. The specific adjustment method can be set according to the actual situation.

[0210] In one possible implementation, the above adjustment operation also includes the addition of a first region. The confirmation interface for the first layout information may also include a region addition control 82. Users can click on the control 82 to add a marker box for selecting the first region, thereby adding the first region that the user wants to keep.

[0211] In one possible implementation, the above adjustment operation also includes a deletion operation of the first region. The confirmation interface of the first layout information may also include a region deletion control 83. The user can click the control 83 to select the first region to be deleted from the already identified first regions.

[0212] In some implementations, the first layout information mentioned above also includes a region derived from the original multimedia data, namely the second region mentioned above, such as region 3 in Figure 8(b). In addition to adjusting the first region, the user can also adjust the second region to modify the first region.

[0213] In S505, the terminal generates at least one second multimedia data containing the first region based on the first layout information.

[0214] In this embodiment, after determining the first layout information corresponding to the original multimedia data, the terminal can generate derived multimedia data (i.e., the second multimedia data mentioned above) corresponding to the original multimedia data based on the first layout information. Since the first layout information determines the content to be retained in the original multimedia data, i.e., the content displayed in the first area, the content displayed in the first area will be retained in the derived multimedia data.

[0215] For example, Figure 9 shows a comparison diagram between original multimedia data and derived multimedia data provided in an embodiment of this application. Referring to Figure 9(a), the original multimedia data is image data, namely image 1. Image 1 includes region 1 containing the product name and region 2 containing the product appearance. Both regions are areas that need to be retained, namely the first region in the first layout information. When the terminal generates derived multimedia data corresponding to the original multimedia data, the content of the above two regions is retained, and content with a certain degree of correlation to other regions of the original multimedia data other than the above two regions is generated through a corresponding algorithm, that is, image 2 and image 3 shown in Figure 9(b) are obtained. Among them, compared with image 1, the positions of the above two regions in the whole image are consistent with those of image 1, that is, the positions and contents of the two regions are not changed, and other contents other than the above two regions are adjusted.

[0216] In some implementations, the position of the regions containing the retained content within the image can be changed, as shown in Image 3 in Figure 9(b). Compared to Image 1, Image 3 retains the content of the two regions mentioned above, but the relative positions of these two regions within the entire image have changed. The display positions of these two regions can be determined based on factors such as the aesthetic engine and the overall image composition; therefore, the display position of the first region in the derived multimedia data is not limited here.

[0217] Corresponding to the above-mentioned multiple setting parameters, when the terminal generates derived multimedia data, it can also perform corresponding operations according to different setting parameters, as described in detail below:

[0218] Execution content 1: Execution content in response to the target size.

[0219] In this embodiment, if the original size of the original multimedia data is inconsistent with the target size in the first layout information, the terminal can generate derived multimedia data corresponding to the target size. For example, FIG10 illustrates a schematic diagram of generating derived multimedia data based on a target size according to an embodiment of this application. Referring to FIG10(a), the original multimedia data is image data, i.e., image 1, with a size of 4:3, while the target size obtained by the user after adjustment is 1:1. Since the sizes are inconsistent, the terminal will generate derived multimedia data according to the specifications of the target size, such as image 2 as shown in FIG10(b). Similarly, the content retained in image 1 (i.e., region 1 and region 2) will also be displayed in image 2, i.e., region 3 and region 4.

[0220] In some implementations, to ensure the visibility of the retained content, the area sizes of regions 1 and 3 are the same, and the area sizes of regions 2 and 4 are the same.

[0221] Execution content 2: Execution content corresponding to the derived quantity

[0222] In this embodiment, the setting parameters of the first layout information record include the number of derivatives. This number can be user-set or determined based on default settings. For details on how it is determined, please refer to the relevant description in S501, which will not be repeated here. Wherein, the number of derivatives is N, where N is a positive integer greater than 0. The terminal will then generate N derivative multimedia data. Each derivative multimedia data contains the display content of the first area. The terminal can generate N derivative area data associated with the display content of the second area based on the number of derivatives N, and merge each derivative area data with the display content (i.e., the first area data) in the first area that needs to be retained, thereby obtaining the corresponding number of N derivative multimedia data.

[0223] For example, Figure 11 shows a schematic diagram of generating multiple multimedia data based on derived data according to an embodiment of this application. Referring to Figure 11, the number of derivatives is 3. The terminal can extract the first region data (i.e., region 1) of the first region from the original multimedia data (i.e., image 1), and generate 3 different derived region data, i.e., region 2 to region 4, according to the semantic description information and correlation index corresponding to the second region. The three regions are then merged with region 1 respectively to obtain images 2 to 4, thereby achieving the purpose of generating multiple derived multimedia data.

[0224] Execution content 3: Execution content corresponding to the relevance index

[0225] In this embodiment, the terminal device can determine the degree of correlation between the derived region data and the corresponding second region data in the multimedia data based on the correlation index. If the correlation index indicates a higher degree of correlation between the two, the greater the similarity between the generated derived region data and the second region data; conversely, if the correlation index indicates a lower degree of correlation between the two, the smaller the similarity between the derived region data and the second region data.

[0226] In some implementations, the process of generating derived multimedia data based on relevance indicators may specifically include the following steps:

[0227] Step 1: Based on the first region, divide the original multimedia data into regions to obtain the first region data corresponding to the first region and the second region data corresponding to the second region.

[0228] In this embodiment, the terminal can divide the original multimedia data into regions based on the position of the first region in the first layout information within the original multimedia data. For example, Figure 12 shows a schematic diagram of the generation of derived multimedia data according to an embodiment of this application. Referring to Figure 12, the terminal can generate a mask 1 as shown in Figure 12 based on the position of the first region in the first layout information within the original multimedia data. In the mask 1, the pixel value corresponding to the first region can be set to 0, while the pixel value corresponding to the second region can be set to 255. The terminal can merge the mask 1 with the original multimedia data (i.e., image 1) to obtain the first region data corresponding to the first region, i.e., elements 1 and 2, and the second region data corresponding to the second region, i.e., element 3, thereby enabling the division of region data for different areas.

[0229] Step 2: Perform semantic recognition on the second region data of the second region to obtain the semantic description information of the second region.

[0230] In this embodiment, the terminal divides the original multimedia data to obtain the second region data corresponding to the second region, and performs semantic recognition on the second region data, that is, converts the multimedia data represented by graphics into semantic description information represented by text. In this way, it can generate derivative region data that is related to the content based on the correlation index, thereby achieving the purpose of content-oriented derivation and improving the accuracy of derivative region data generation.

[0231] In some implementations, the semantic recognition algorithm can be a multimodal model, which extracts the semantic description information corresponding to the data in the second region.

[0232] Referring to Figure 12, the terminal can import the data of the second region into the semantic recognition algorithm to determine the semantic description information corresponding to element 3, such as "two young people are walking on the road, the young man on the left is wearing short sleeves and the young man on the right is wearing long sleeves".

[0233] Step 3: Generate at least one of the derived region data based on the correlation index and the semantic description information.

[0234] In this embodiment, the terminal can determine the degree of correlation between the content of the derived region data and the second region data based on the correlation index. For example, a larger correlation index indicates a higher degree of correlation between the derived region data and the second region data. In this case, the derived region data can generate corresponding derived region content based on the semantic description information described above.

[0235] For example, referring to Figure 12, a higher value of the correlation index indicates a strong correlation between the derived region data and the second region data. In this case, the semantic description information corresponding to the derived region data can be "two young people are walking on the road, the young person on the left is wearing a short-sleeved shirt, and the young person on the right is wearing a short-sleeved shirt," thus obtaining derived element 1 and derived element 2. The difference between derived element 1 and derived element 2 can be the relative positional relationship between the two young people. For example, in derived element 1, the two young people are walking side by side, while in derived element 2, the two young people are not walking side by side, but one is in front and the other is behind.

[0236] If the value of the above correlation index is low, it means that the correlation between the data in the derived region and the data in the second region is weak. In this case, the semantic description information corresponding to the data in the derived region can be "two trees on the mountain, the tree on the left is in bloom, and the tree on the right is not in bloom", thus obtaining derived element 3.

[0237] Step 4: Merge the data from each derived region with the data from the first region of the first region to obtain the derived multimedia data.

[0238] In this embodiment, the terminal can merge the generated derived region data with the first region data corresponding to the first region. The display position of the first region data during merging can be consistent with the original multimedia data, or it can be inconsistent. In some implementations, the terminal can import the derived region data and the first region data into a preset image synthesis model, such as an image model built based on an aesthetic engine, to obtain the corresponding derived multimedia data.

[0239] For example, Figure 13 shows a schematic diagram of the generation of derived multimedia data provided in an embodiment of this application. Referring to Figure 13, the terminal can merge element 1 and element 2 with derived element 1 to obtain derived image 1, wherein the position of the element corresponding to the first region in the derived image 1 is consistent with the position in image 1.

[0240] The terminal can merge element 1 and element 2 with derived element 2 to obtain derived image 2. The position of the element corresponding to the first region in the derived image 1 may be different from the position in image 1.

[0241] In some implementations, if the target size is inconsistent with the original size of the original multimedia data, the size of the generated derived region data is determined based on the target size, while the size of the first region data corresponding to the first region can be kept consistent with the size in the original multimedia data. Since the target size of the derived region data is larger than the size of the first region data, when merging the above two types of region data, the size of the synthesized derived multimedia data is determined by the target size of the derived region data.

[0242] In this embodiment, the industry type is specifically used to determine the first region in the original multimedia data, that is, to generate the first layout information. Therefore, in the process of generating the derived multimedia data, it is not necessary to perform the corresponding operation according to the industry type.

[0243] In some implementations, when determining the derived region data within the derived multimedia data, the derived region data can be generated based on the correlation index and the aforementioned industry type. That is, when generating derived region data based on the semantic description information corresponding to the second region, the corresponding derived region data can be generated based on the correlation index, industry type, and semantic description information. For example, if the aforementioned industry type is electrical appliances, and electrical appliances are generally used in indoor scenarios, then when generating the derived region data, the scenario of the multimedia data can be set to an indoor scenario, such as a home, classroom, or office. Then, combining the semantic description information and the correlation index, derived region data for an indoor scenario can be generated.

[0244] In some implementations, if the user adjusts the first layout information to obtain the corresponding second layout information, S502 can specifically be: the terminal generates at least one second multimedia data containing the first region based on the second layout information. The specific method of generating the second multimedia data based on the second layout information is the same as the method of generating the second multimedia data based on the first layout information; for details, please refer to the above description, which will not be repeated here.

[0245] In this embodiment, after generating derivative multimedia data, the terminal can store the derivative multimedia data in the terminal's memory; alternatively, the user can select to store some or all of it according to their operation. For example, Figure 14 shows a schematic diagram of derivative multimedia data storage provided in an embodiment of this application. After obtaining the derivative multimedia data, the terminal can display multiple generated derivative multimedia data sets on the corresponding page, as shown in images 1 to 3 in Figure 14. The user can select the derivative multimedia data to be exported from the multiple images, such as selecting images 1 and 2, and clicking the export control 141 to store the selected images in the terminal's memory.

[0246] As can be seen from the above, in the multimedia data generation method provided by the embodiments of this application, the terminal can generate first layout information corresponding to the first multimedia data according to the user's layout settings. Then, when generating the derived area data corresponding to the first multimedia data, that is, when generating the second multimedia data, the area data of the first area in the first multimedia data is retained according to the first layout information, thereby obtaining the second multimedia data containing the area data of the first area, thus achieving the purpose of personalized generation of derived area data. Compared with existing multimedia technologies, the multimedia data generation method provided by the embodiments of this application does not use the same template for data derivation for all multimedia data. Instead, it can personalizedly determine the corresponding first layout information according to the user's settings and the original multimedia data specified by the user, thereby accurately determining the first area that the user needs to retain, and generating derived area data that retains the area data of the first area in the original multimedia data. This improves the accuracy of derived area data generation and also improves the efficiency of batch generation of derived area data.

[0247] Example 2:

[0248] For example, Figure 15 shows an application scenario diagram of the multimedia data generation method provided in another embodiment of this application. Referring to Figure 15, in this application scenario, the multimedia data generation method is applied to a multimedia data generation system. The multimedia data generation system includes a terminal 151 and a server 152. The terminal 151 can be a terminal device such as a smartphone, laptop, tablet, or desktop computer. An application for batch generation of derived multimedia data can be installed in the terminal 151. Users can achieve batch generation of derived multimedia data through the application running in the terminal.

[0249] Unlike Embodiment 1, the application installed on terminal 151 in this embodiment can delegate the layout recognition of the original multimedia data and the related operations of generating derived multimedia data to server 152. That is, the application generates the corresponding operation interface to collect the original multimedia data and setting parameters imported by the user through terminal 151, and uploads the collected data to server 152, thereby reducing the computational pressure on terminal 151 when generating multimedia data in batches.

[0250] The following describes in detail the interactive process of the multimedia data generation method provided in the embodiments of this application. Referring to the application scenario in Figure 15, Figure 16 shows an interactive flowchart of the multimedia data generation method provided in an embodiment of this application. As shown in Figure 16, the multimedia data generation method provided in the embodiments of this application specifically includes S1601 to S1606, and the specific implementation process is detailed below:

[0251] In S1601, the terminal responds to the layout setting operation initiated by the user by sending a setting data packet to the server; the setting data packet includes the setting parameters and the first multimedia data.

[0252] In this embodiment, an application for batch generation of derivative multimedia data is installed on the terminal. Through the operation interface generated by the application, the original multimedia data (i.e., the first multimedia data) imported by the user can be obtained, and the corresponding setting parameters can be determined based on the layout setting operation initiated by the user. For the specific method of obtaining the setting parameters, please refer to the relevant descriptions of S501 and S502 in Embodiment 1, which will not be repeated here.

[0253] In this embodiment, after the terminal obtains the original multimedia data and layout parameters imported by the user through the application, it can encapsulate the above two types of data to obtain a setting data packet and send the setting data packet to the server.

[0254] In S1602, the server determines the first layout information corresponding to the first multimedia data based on the setting data packet sent by the terminal.

[0255] In this embodiment, after receiving the setting data packet sent by the terminal through the application, the server can extract the setting parameters from the setting data packet and determine the first layout information based on the setting parameters and the aforementioned original multimedia data; the first layout information includes a first area that needs to be retained. The method by which the server determines the first layout information can be found in the relevant description of the terminal determining the first layout information in S503, and will not be repeated here.

[0256] In S1603, the terminal receives the first layout information fed back by the server.

[0257] In this embodiment, the server can send the determined first layout information to the terminal so that the user can determine through the terminal whether the first area in the first layout information needs to be adjusted.

[0258] In S1604, the terminal sends layout confirmation information about the first layout information to the server.

[0259] In this embodiment, if the user does not need to adjust the first layout information, the terminal can generate layout confirmation information based on the first layout information and send the layout confirmation information to the server.

[0260] In this embodiment, if a user needs to adjust the first area in the first layout information, they can initiate a corresponding adjustment operation. The terminal can obtain the second layout information after adjusting the first layout information based on the user's adjustment operation. The specific implementation of obtaining the second layout information can be found in the relevant operation of determining the second layout information in S501, and will not be repeated here. After obtaining the second layout information based on the user's adjustment operation, the terminal can generate layout confirmation information based on the second layout information and send the layout confirmation information to the server.

[0261] In S1605, the server generates at least one second multimedia data containing the first region based on the layout confirmation information and the setting parameters.

[0262] In this embodiment, after receiving the layout confirmation information sent by the terminal, the server can divide the original multimedia data according to the first layout information or the second layout information contained in the layout confirmation information, and then generate a corresponding number and size of derived multimedia data according to the set parameters. The specific implementation method for generating the derived multimedia data can be found in the relevant description of S502, and will not be repeated here.

[0263] In S1606, the terminal receives at least one second multimedia data sent by the server.

[0264] In this embodiment, the server generates derivative multimedia data corresponding to the original multimedia data, which can be sent to the terminal through an application. The terminal can store the derivative multimedia data in its local memory, or select some or all of the derivative multimedia data to be stored in its local memory according to the user's operation.

[0265] In this embodiment, the layout confirmation of the original multimedia data and the generation of derived data are handled by the server, which reduces the computational burden on the terminal and the size of the algorithms included in the applications installed on the terminal. On the other hand, since the server can train relevant algorithms (such as layout information recognition algorithms and derived area data generation algorithms) using big data, having the server complete the tasks of generating derived multimedia data and identifying the layout can improve the accuracy of the derived multimedia data, thereby enhancing the user experience.

[0266] Example 3:

[0267] Compared to Embodiment 2, which describes the multimedia data generation method provided by this application from the perspective of interaction between the terminal and the server, Embodiment 3 describes the multimedia data generation and delivery method provided by this application from the perspective of the server. For example, Figure 17 shows a flowchart of the implementation of the multimedia data generation method provided by an embodiment of this application on the server side, as described in detail below:

[0268] In S1701, a setting data packet sent by the receiving terminal is received; the setting data packet includes first multimedia data and setting parameters determined based on the user's layout setting operation;

[0269] In S1702, based on the setting data packet, layout confirmation information corresponding to the first multimedia data is determined; the layout confirmation information is used to determine the first region in the first multimedia data.

[0270] In S1703, based on the layout confirmation information and the setting parameters, at least one second multimedia data containing the first region is generated.

[0271] Optionally, the layout confirmation information includes first layout information;

[0272] The step of determining the layout confirmation information corresponding to the first multimedia data based on the set data packet includes:

[0273] Based on the configured data packet, first layout information corresponding to the first multimedia data is generated;

[0274] Send the first layout information to the terminal;

[0275] The step of generating at least one second multimedia data containing the first region based on the layout confirmation information and the setting parameters includes:

[0276] In response to the confirmation command sent by the terminal, at least one piece of the second multimedia data is generated based on the first layout information and the setting parameters.

[0277] Optionally, the layout confirmation information includes second layout information;

[0278] After sending the first layout information to the terminal, the method further includes:

[0279] In response to the adjustment command sent by the terminal, the first layout information is adjusted based on the adjustment command to obtain the second layout information;

[0280] The step of generating at least one second multimedia data containing the first region based on the layout confirmation information and the setting parameters includes:

[0281] At least one piece of the second multimedia data is generated based on the second layout information and the setting parameters.

[0282] Optionally, the layout confirmation information is further used to determine a second region in the first multimedia data, and the step of generating at least one second multimedia data containing the first region based on the layout confirmation information and the setting parameters includes:

[0283] Generate at least one derived region data associated with the second region;

[0284] The second multimedia data is generated based on the first region data of the first region and the derived region data.

[0285] Optionally, the setting parameters include the number of derivatives N; generating at least one derivative region data associated with the second region includes:

[0286] Generate N derived region data associated with the second region;

[0287] The step of generating the second multimedia data based on the first region data and the derived region data of the first region includes:

[0288] Based on the N derived region data and the first region data, N second multimedia data are generated.

[0289] Optionally, the setting parameters include a correlation index; generating at least one derived region data associated with the second region includes:

[0290] Semantic recognition is performed on the second region data of the second region to obtain semantic description information of the second region;

[0291] At least one of the derived region data is generated based on the correlation index and the semantic description information.

[0292] Optionally, the setting parameters include a target size; generating at least one second multimedia data containing the first region based on the layout confirmation information and the setting parameters includes:

[0293] Based on the layout confirmation information, at least one second multimedia data matching the target size is generated.

[0294] Optionally, the setting parameters include the industry type corresponding to the first multimedia data, and determining the layout confirmation information corresponding to the first multimedia data based on the setting data packet includes:

[0295] Based on the industry type corresponding to the first multimedia data, at least one first region corresponding to the industry type is determined from the first multimedia data;

[0296] The layout confirmation information is obtained based on at least one of the first regions.

[0297] Example 4:

[0298] Corresponding to the relevant steps performed by the terminal in the multimedia data generation methods of Embodiment 1 and Embodiment 2 above, Figure 18 shows a structural block diagram of the multimedia data generation device applied to the terminal provided in the embodiments of this application. For ease of explanation, only the parts related to the embodiments of this application are shown.

[0299] As shown in Figure 18, the multimedia data generation device includes:

[0300] The layout setting unit 181 is used to respond to a layout setting operation initiated by the user and generate first layout information corresponding to the first multimedia data specified by the user according to the setting parameters corresponding to the layout setting operation; the first layout information is used to determine a first region in the first multimedia data.

[0301] The derivative unit 182 is used to generate at least one second multimedia data containing the first region based on the first layout information.

[0302] Optionally, the derived unit includes:

[0303] A derived region generation unit is used to generate at least one derived region data associated with the second region;

[0304] The derived region merging unit is used to generate the second multimedia data based on the first region data and the derived region data of the first region.

[0305] Optionally, the setting parameters include the number of derivatives N; the derivative region generation unit is specifically used to generate N derivative region data associated with the second region;

[0306] The derived region merging unit is specifically used to generate N second multimedia data based on N derived region data and the first region data.

[0307] Optionally, the setting parameters include a correlation index; the derived region generation unit includes:

[0308] A semantic description determination unit is used to perform semantic recognition on the second region data of the second region to obtain semantic description information of the second region.

[0309] A semantic derivation unit is used to generate at least one of the derived region data based on the correlation index and the semantic description information.

[0310] Optionally, the setting parameters include the target size; the derived unit includes:

[0311] A size adjustment unit is used to generate at least one second multimedia data that matches the target size based on the first layout information.

[0312] Optionally, the layout setting unit includes:

[0313] An industry type determination unit is used to determine at least one first region corresponding to the industry type from the first multimedia data based on the industry type corresponding to the first multimedia data.

[0314] The first region generation unit is configured to generate the first layout information based on at least one first region.

[0315] Optionally, the generating apparatus further includes:

[0316] An industry type setting unit is used to determine the industry type corresponding to the first multimedia data in response to the layout setting operation.

[0317] Optionally, the generating apparatus further includes:

[0318] The layout adjustment unit is used to respond to the adjustment operation initiated by the user based on the first layout information, adjust the layout of the first layout information, and generate the second layout information.

[0319] The second layout generation unit is used to generate at least one of the second multimedia data containing the first region based on the second layout information.

[0320] Optionally, the layout setting unit includes:

[0321] The data packet sending unit is configured to send a setting data packet to the server in response to a layout setting operation initiated by the user; the setting data packet includes the setting parameters and the first multimedia data.

[0322] The first layout information receiving unit is used to receive the first layout information fed back by the server.

[0323] Optionally, the derived unit includes:

[0324] A layout confirmation information sending unit is used to send layout confirmation information about the first layout information to the server; the layout confirmation information includes the first layout information or second layout information obtained by adjusting the first layout information.

[0325] The second layout derivation unit is used to receive at least one of the second multimedia data generated by the server based on the layout confirmation information and the setting parameters.

[0326] Example 5:

[0327] Corresponding to the relevant steps performed by the server in the multimedia data generation method of Embodiment 2 above, Figure 19 shows a structural block diagram of the multimedia data generation device applied to the server provided in this application embodiment. For ease of explanation, only the parts related to this application embodiment are shown.

[0328] As shown in Figure 19, the multimedia data generation device includes:

[0329] The receiving unit 191 is configured to receive a setting data packet sent by the terminal; the setting data packet includes first multimedia data and setting parameters determined based on the user's layout setting operation.

[0330] The layout confirmation unit 192 is used to determine layout confirmation information corresponding to the first multimedia data based on the setting data packet; the layout confirmation information is used to determine a first region in the first multimedia data.

[0331] The derived data generation unit 193 is used to generate at least one second multimedia data containing the first region based on the layout confirmation information and the setting parameters.

[0332] Optionally, the layout confirmation information includes first layout information;

[0333] The layout confirmation unit includes:

[0334] The first layout information determining unit is used to generate first layout information corresponding to the first multimedia data based on the setting data packet;

[0335] The first layout information sending unit is used to send the first layout information to the terminal;

[0336] The derived data generation unit includes:

[0337] The first derivative data generation unit is configured to generate at least one second multimedia data in response to a confirmation command sent by the terminal, based on the first layout information and setting parameters.

[0338] Optionally, the layout confirmation information includes second layout information;

[0339] The generating apparatus also includes:

[0340] The second layout information determination unit is used to respond to the adjustment instruction sent by the terminal, and adjust the first layout information based on the adjustment instruction to obtain the second layout information;

[0341] The derived data generation unit includes:

[0342] The second derivative data generation unit is used to generate at least one of the second multimedia data based on the second layout information and the setting parameters.

[0343] Optionally, the layout confirmation information is further used to determine a second region in the first multimedia data, and the derived data generation unit includes:

[0344] A derived region data generation unit is used to generate at least one derived region data associated with the second region;

[0345] The derived region merging unit is used to generate the second multimedia data based on the first region data and the derived region data of the first region.

[0346] Optionally, the setting parameters include the number of derivatives N; the derivative region data generation unit is specifically used to generate N derivative region data associated with the second region;

[0347] The derived region merging unit is specifically used to generate N second multimedia data based on N derived region data and the first region data.

[0348] Optionally, the setting parameters include a correlation index; the derived region data generation unit includes:

[0349] A semantic description determination unit is used to perform semantic recognition on the second region data of the second region to obtain semantic description information of the second region.

[0350] A semantic description generation unit is used to generate at least one of the derived region data based on the correlation index and the semantic description information.

[0351] Optionally, the setting parameters include the target size; the derived data generation unit includes:

[0352] A size adjustment unit is used to generate at least one second multimedia data that matches the target size based on the layout confirmation information.

[0353] Optionally, the setting parameters include the industry type corresponding to the first multimedia data, and the derived data generation unit includes:

[0354] An industry type confirmation unit is used to determine at least one first region corresponding to the industry type from the first multimedia data based on the industry type corresponding to the first multimedia data.

[0355] A layout confirmation information generation unit is used to obtain the layout confirmation information based on at least one of the first regions.

[0356] Figure 20 is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. As shown in Figure 20, the electronic device 20 of this embodiment includes: at least one processor 200 (only one processor is shown in Figure 20, and the number of processors may match the actual number of chips included in the electronic device in the embodiment), a memory 201, and a program 202 stored in the memory 201 and executable on the at least one processor 200. When the processor 200 executes the program 202, it implements the steps in any of the above-described information sending method or information receiving method embodiments.

[0357] The electronic device 20 may be the server, terminal, etc., as described above. This electronic device may include, but is not limited to, a processor 200 and a memory 201. Those skilled in the art will understand that FIG20 is merely an example of the electronic device 20 and does not constitute a limitation on the electronic device 20. It may include more or fewer components than illustrated, or combine certain components, or different components; for example, it may also include input / output electronic devices, network access electronic devices, etc.

[0358] The processor 200 may be a Central Processing Unit (CPU), or it may be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.

[0359] In some embodiments, the memory 201 may be an internal storage unit of the electronic device 20, such as a hard disk or memory of the electronic device 20. In other embodiments, the memory 201 may be an external storage device of the electronic device 20, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the electronic device 20. Furthermore, the memory 201 may include both internal and external storage devices of the electronic device 20. The memory 201 is used to store the operating system, applications, bootloader, data, and other programs, such as program code. The memory 201 can also be used to temporarily store data that has been output or will be output.

[0360] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.

[0361] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0362] This application also provides an electronic device, which includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, wherein the processor executes the computer program to implement the steps in any of the above method embodiments.

[0363] This application also provides a readable storage medium storing a program that, when executed by a processor, implements the steps described in the various method embodiments above.

[0364] This application provides a program product that, when run on an electronic device, enables the electronic device to perform the steps described in the various method embodiments above.

[0365] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments of this application can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include at least: any entity or device capable of carrying computer program code to a photographic device / electronic device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electrical carrier signals or telecommunication signals.

[0366] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0367] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A method for generating multimedia data, characterized in that, Applied to a terminal, the method for generating the multimedia data includes: In response to a layout setting operation initiated by the user, first layout information corresponding to the first multimedia data specified by the user is generated according to the setting parameters corresponding to the layout setting operation; the first layout information is used to determine a first region in the first multimedia data. Based on the first layout information, at least one second multimedia data containing the first region is generated.

2. The generation method according to claim 1, characterized in that, The first layout information is further used to determine a second region in the first multimedia data, and the step of generating at least one second multimedia data containing the first region based on the first layout information includes: Generate at least one derived region data associated with the second region; The second multimedia data is generated based on the first region data of the first region and the derived region data.

3. The generation method according to claim 2, characterized in that, The setting parameters include the number of derivatives N; generating at least one derivative region data associated with the second region includes: Generate N derived region data associated with the second region; The step of generating the second multimedia data based on the first region data and the derived region data of the first region includes: Based on the N derived region data and the first region data, N second multimedia data are generated.

4. The generation method according to claim 2, characterized in that, The setting parameters include a correlation index; generating at least one derived region data associated with the second region includes: Semantic recognition is performed on the second region data of the second region to obtain semantic description information of the second region; At least one of the derived region data is generated based on the correlation index and the semantic description information.

5. The generation method according to any one of claims 1-4, characterized in that, The setting parameters include the target size; the step of generating at least one second multimedia data containing the first region based on the first layout information includes: Based on the first layout information, at least one second multimedia data matching the target size is generated.

6. The generation method according to any one of claims 1-5, characterized in that, The method of responding to a user-initiated layout setting operation, generating first layout information corresponding to the user-specified first multimedia data based on the setting parameters corresponding to the layout setting operation, includes: Based on the industry type corresponding to the first multimedia data, at least one first region corresponding to the industry type is determined from the first multimedia data; The first layout information is generated based on at least one of the first regions.

7. The generation method according to any one of claims 6, characterized in that, Before determining at least one first region corresponding to the industry type from the first multimedia data based on the industry type corresponding to the first multimedia data, the process includes: In response to the layout setting operation, the industry type corresponding to the first multimedia data is determined.

8. The generation method according to any one of claims 1-7, characterized in that, After generating the first layout information corresponding to the first multimedia data specified by the user based on the setting parameters corresponding to the layout setting operation in response to the user-initiated layout setting operation, the method further includes: In response to an adjustment operation initiated by the user based on the first layout information, the first layout information is adjusted to generate second layout information; Based on the second layout information, at least one piece of second multimedia data containing the first region is generated.

9. The generation method according to any one of claims 1-8, characterized in that, The method of responding to a user-initiated layout setting operation, generating first layout information corresponding to the user-specified first multimedia data based on the setting parameters corresponding to the layout setting operation, includes: In response to a layout setting operation initiated by the user, a setting data packet is sent to the server; the setting data packet includes the setting parameters and the first multimedia data; Receive the first layout information fed back by the server.

10. The generation method according to claim 8, characterized in that, The step of generating at least one second multimedia data containing the first region based on the first layout information includes: Send layout confirmation information about the first layout information to the server; the layout confirmation information includes the first layout information or second layout information obtained by adjusting the first layout information; The receiving server generates at least one piece of the second multimedia data based on the layout confirmation information and the setting parameters.

11. A method for generating multimedia data, characterized in that, Applied to a server, the method for generating the multimedia data includes: The receiving terminal sends a setting data packet; the setting data packet includes first multimedia data and setting parameters determined based on the user's layout setting operation; Based on the configured data packet, layout confirmation information corresponding to the first multimedia data is determined; the layout confirmation information is used to determine the first region in the first multimedia data. Based on the layout confirmation information and the setting parameters, at least one second multimedia data containing the first region is generated.

12. The generation method according to claim 11, characterized in that, The layout confirmation information includes first layout information; The step of determining the layout confirmation information corresponding to the first multimedia data based on the set data packet includes: Based on the configured data packet, first layout information corresponding to the first multimedia data is generated; Send the first layout information to the terminal; The step of generating at least one second multimedia data containing the first region based on the layout confirmation information and the setting parameters includes: In response to the confirmation command sent by the terminal, at least one piece of the second multimedia data is generated based on the first layout information and the setting parameters.

13. The generation method according to claim 12, characterized in that, The layout confirmation information includes second layout information; After sending the first layout information to the terminal, the method further includes: In response to the adjustment command sent by the terminal, the first layout information is adjusted based on the adjustment command to obtain the second layout information; The step of generating at least one second multimedia data containing the first region based on the layout confirmation information and the setting parameters includes: At least one piece of the second multimedia data is generated based on the second layout information and the setting parameters.

14. The generation method according to claim 11, characterized in that, The layout confirmation information is further used to determine a second region in the first multimedia data. The step of generating at least one second multimedia data containing the first region based on the layout confirmation information and the setting parameters includes: Generate at least one derived region data associated with the second region; The second multimedia data is generated based on the first region data of the first region and the derived region data.

15. The generation method according to claim 14, characterized in that, The setting parameters include the number of derivatives N; generating at least one derivative region data associated with the second region includes: Generate N derived region data associated with the second region; The step of generating the second multimedia data based on the first region data and the derived region data of the first region includes: Based on the N derived region data and the first region data, N second multimedia data are generated.

16. The generation method according to claim 14, characterized in that, The setting parameters include a correlation index; generating at least one derived region data associated with the second region includes: Semantic recognition is performed on the second region data of the second region to obtain semantic description information of the second region; At least one of the derived region data is generated based on the correlation index and the semantic description information.

17. The generation method according to any one of claims 11-16, characterized in that, The setting parameters include a target size; generating at least one second multimedia data containing the first region based on the layout confirmation information and the setting parameters includes: Based on the layout confirmation information, at least one second multimedia data matching the target size is generated.

18. The generation method according to any one of claims 11-17, characterized in that, The setting parameters include the industry type corresponding to the first multimedia data, and the step of determining the layout confirmation information corresponding to the first multimedia data based on the setting data packet includes: Based on the industry type corresponding to the first multimedia data, at least one first region corresponding to the industry type is determined from the first multimedia data; The layout confirmation information is obtained based on at least one of the first regions.

19. An electronic device, characterized in that, The electronic device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, implements the steps of the method as claimed in any one of claims 1 to 10, or the steps of the method as claimed in any one of claims 11 to 18.

20. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method as claimed in any one of claims 1 to 10, or the steps of the method as claimed in any one of claims 11 to 18.

Images