Multimedia Processing Method, Apparatus, Device, and Medium

The multimedia processing method addresses inefficiencies in multi-image editing by enabling users to select templates with sub-templates, automatically assign images, and provide a preview interface for simultaneous editing, enhancing efficiency.

JP2025521312AInactive Publication Date: 2025-07-08BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2024574518
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2022-08-23
Filing Date
2023-08-16
Publication Date
2025-07-08
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing image editing software requires users to manually select and apply separate templates for each image, leading to inefficiencies when editing multiple images, as users need to find and apply templates individually, resulting in time-consuming operations.

Method used

A multimedia processing method that allows users to select a template with multiple sub-templates, upload original images, and automatically determine corresponding images for each sub-template, displaying a preview interface with editing controls to adjust multiple images simultaneously.

Benefits of technology

This method streamlines the editing process for multiple images by allowing simultaneous application of templates and editing controls, reducing time and improving efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025521312000001_ABST
    Figure 2025521312000001_ABST
Patent Text Reader

Abstract

Embodiments of the present disclosure relate to a multimedia processing method, apparatus, device, and medium. The method includes: obtaining a target template corresponding to the template selection command, including a plurality of image sub-templates, in response to receiving a template selection command by a user; receiving at least one original image uploaded by the user for the target template; determining an original image corresponding to the image sub-template, and obtaining a plurality of target images based on the image sub-template and the original image corresponding to the image sub-template; and when previewing the plurality of target images, displaying a preview effect of the plurality of target images corresponding to the target template on an image preview interface including an image editing control for adjusting the plurality of target images. Embodiments of the present disclosure can effectively shorten the time taken for multi-image editing and improve multi-image editing efficiency.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application claims the priority of Chinese Patent Application No. 202211012666.X filed on August 23, 2022, and all the content disclosed in the Chinese patent application is incorporated herein by reference.

[0002] Embodiments of the present disclosure relate to a multimedia processing method, apparatus, device, and medium.

Background Art

[0003] Currently, multimedia is widely used in daily life and work. Taking multimedia images as an example, in order to endow an image with the desired expression effect, after taking a picture, in order to add materials such as filters, texts, stickers, and special effects to the image, combine images, change the size, etc., that is, edit (retouch) the image, the number of users is increasing.

[0004] Many image editing softwares provide users with image editing templates, and users can directly use the image editing templates to quickly edit one image. However, as a result of investigations, the inventors have found that when it is desired to complete a work including a plurality of images, until a plurality of edited images are obtained, it is necessary to separately find the necessary image editing templates for each image to be edited, and perform operations such as importing the image, adjusting the template, and editing, and as a result, it takes time and the efficiency is low.

Summary of the Invention

Problems to be Solved by the Invention

[0005] To solve the above technical problems, or at least partially solve the above technical problems, the present disclosure provides a multimedia processing method, apparatus, device, and medium.

Means for Solving the Problems

[0006] In response to receiving a template selection command from a user, obtaining a target template corresponding to the template selection command, the target template including a plurality of image sub-templates Receiving at least one original image uploaded by the user for the target template Determining an original image corresponding to the image sub-template, and obtaining a plurality of target images based on the image sub-template and the original image corresponding to the image sub-template When previewing the plurality of target images, displaying a preview effect of the plurality of target images corresponding to the target template on an image preview interface including an image editing control for adjusting the plurality of target images A multimedia processing method is provided, including the above steps

[0007] Optionally, the step of determining an original image corresponding to the image sub-template includes: allocating the original image to the image sub-template according to a preset order according to the order of the image sub-template in the target template and the number of images that can be edited by the image sub-template; and determining an original image corresponding to the image sub-template based on the allocation result

[0008] Optionally, the step of determining an original image corresponding to the image sub-template based on the allocation result includes For an image sub-template whose number of allocated original images is equal to the number of images that can be edited, using the original image allocated to the image sub-template as the original image corresponding to the image sub-template For an image sub-template where the number of original images assigned is less than the number of images that can be edited, obtaining a complementary image for the image sub-template, and using the original image assigned to the image sub-template and the complementary image as the original images corresponding to the image sub-template, wherein the complementary image is obtained by copying one or more of the original images according to a preset method, the step of For an image sub-template to which no original image is assigned, determining that there is no original image corresponding to the image sub-template, and discarding the image sub-template, including.

[0009] Optionally, the step of determining the original image corresponding to the image sub-template includes the step of obtaining the template information of the image sub-template and the image information of the original image, Based on the template information and the image information, determining the original image corresponding to each image sub-template, wherein the original images corresponding to different image sub-templates are the same or different, the step of

[0010] Optionally, the template information of the image sub-template includes the material information of each image sub-template, the number of images that can be edited by each image sub-template, and the total number of the image sub-templates, and the image information of the original image includes the content information of the original image and the total number of the original images.

[0011] Optionally, the step of displaying the preview effect of a plurality of target images corresponding to the target template on an image preview interface is Based on the order of the plurality of image sub-templates in the target template, including the step of displaying the plurality of target images on the image preview interface.

[0012] Optionally, the step of displaying the plurality of target images on the image preview interface comprises: sequentially displaying each of the plurality of target images as a main view on the image preview interface; and array-displaying thumbnails of the plurality of target images on the image preview interface, wherein the size of the thumbnails is smaller than the size of the main view, and the order of sequentially displaying the plurality of target images as main views and the order of arrangement of the thumbnails of the plurality of target images both match the order in the target template of the image sub-template corresponding to the plurality of target images.

[0013] Optionally, the image editing control includes an image content editing control, and the method comprises: in response to the image content editing control being triggered, switching the image preview interface to an image editing interface, and displaying an image to be edited among the plurality of target images on the image editing interface including a plurality of sub-controls for editing the content of the image to be edited; and editing the image to be edited based on a trigger operation on the target sub-control in response to the target sub-control among the plurality of sub-controls being triggered.

[0014] Optionally, the image editing interface further includes a thumbnail display control, and the method further comprises: when the thumbnail display control is in a first state, array-displaying thumbnails of the plurality of target images on the image editing interface; and when the thumbnail display control is in a second state, hiding the thumbnails of the plurality of target images on the image editing interface.

[0015] Optionally, the step of arranging and displaying thumbnails of the plurality of target images on the image editing interface includes: determining an arrangement and display position of the thumbnails of the plurality of target images in the image editing interface according to a content editing operation on the image to be edited by the user; and arranging and displaying the thumbnails of the plurality of target images on the image editing interface based on the arrangement and display position.

[0016] Optionally, the image editing control includes a sorting control and / or an image deletion control, and the method further includes: adjusting a display order of the plurality of target images based on a trigger operation on the sorting control in response to the sorting control being triggered; and deleting a target image corresponding to a trigger operation on the image deletion control in response to the image deletion control being triggered.

[0017] Optionally, the plurality of target images have corresponding multimedia related resources, and the multimedia related resources are multimedia resources for broadcasting while carousel-displaying the plurality of target images.

[0018] Embodiments of the present disclosure include: a target template acquisition module for acquiring a target template corresponding to the template selection command, the target template including a plurality of image editing sub-templates, in response to receiving a template selection command from the user; an original image receiving module for receiving at least one original image uploaded by the user for the target template; Determine the original image corresponding to the image sub-template, and obtain a plurality of target images based on the image sub-template and the original image corresponding to the image sub-template, a target image acquisition module; When previewing the plurality of target images, a target image preview module for displaying a preview effect of the plurality of target images corresponding to the target template on an image preview interface including an image editing control for adjusting the plurality of target images, a multimedia processing apparatus is provided.

[0019] Embodiments of the present disclosure are a processor, a memory for storing executable instructions, and include, The processor is arranged to read the executable instructions from the memory and execute the executable instructions to implement any of the above multimedia processing methods, an electronic device is provided.

[0020] Embodiments of the present disclosure are a computer-readable storage medium storing a computer program for executing any of the above multimedia processing methods is provided.

[0021] It should be understood that the content described in this part is not intended to identify the main or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will be readily understood from the following description.

Brief Description of the Drawings

[0022] The drawings incorporated in the specification and constituting a part of the specification show embodiments consistent with the present disclosure and are used to explain the principles of the present disclosure together with the specification. To more clearly explain the technical solutions in the embodiments of the present disclosure, the drawings necessary for use in the embodiments will be briefly described below. It is obvious to those skilled in the art that other drawings can be obtained based on these drawings without creative effort.

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Modes for Carrying Out the Invention

[0023] Hereinafter, the aspects of the present disclosure will be further described so that the above objects, features, and advantages of the present disclosure can be more clearly understood. It should be noted that the embodiments and features in the embodiments of the present disclosure may be combined with each other as long as they do not conflict.

[0024] In the following description, many specific details are set forth to facilitate a thorough understanding of the present disclosure. However, the present disclosure may be practiced in other ways different from those described herein. Obviously, the embodiments in the specification are only a part of the embodiments of the present disclosure, not all embodiments.

[0025] In response to receiving a template selection command from a user, obtain a target template (including a plurality of image sub-templates) corresponding to the template selection command, then receive at least one original image uploaded by the user for the target template, further determine the original image corresponding to the image sub-template, and obtain a plurality of target images based on the image sub-template and the original image corresponding to the image sub-template. Also, when previewing a plurality of target images, display the preview effect of the plurality of target images corresponding to the target template on an image preview interface. The image preview interface includes an image editing control for adjusting the plurality of target images. In the above form, a plurality of target images can be directly obtained from the target template including a plurality of image sub-templates and the original image uploaded by the user, and when the user previews the images, the user can also use the image editing control to adjust the target images, which is very convenient, can effectively shorten the time taken for multi-image editing, and can improve the multi-image editing efficiency. FIG. 1 is a schematic flowchart of a multimedia processing method according to an embodiment of the present disclosure. This method may be executed by a multimedia processing device, and this device may be implemented using software and / or hardware, and generally may be integrated into an electronic device. In actual applications, the image processing method can be applied to a client having an image editing function, a mini-program, a web page, etc., but is not limited herein. As shown in FIG. 1, the method mainly includes the following steps S102 to S108.

[0026] Step S102: In response to receiving a template selection command from a user, obtain a target template corresponding to the template selection command, including a plurality of image sub-templates.

[0027] In related technologies as well, image templates are provided, but most of them are individual image templates and can only generate one edited image. On the other hand, the target template according to the embodiments of the present disclosure includes a plurality of image sub-templates and has the ability to generate a plurality of edited images at once. Each image sub-template (also referred to as an image editing sub-template) can be used for editing at least one image. For example, the image sub-template contains editing record information, and this editing record information may indicate how to edit the image. As an example, it indicates how to synthesize a predetermined material with the image and / or how to combine a plurality of images to obtain an edited image. The materials used for editing the image in the image sub-template may be, for example, text, stickers, filters, special effects, etc., but are not limited here.

[0028] In actual applications, one or more series of templates may be displayed on the template display interface. Each series of templates includes a plurality of image sub-templates, and the user may select a desired series of templates from the template display interface. When a template selection command by the user is received, the template selected by the user is set as the target template.

[0029] In some exemplary embodiments, the similarity between different image sub-templates among the target templates is greater than a preset similarity threshold. Here, the similarity is determined by one or more of the materials, editing methods, and template themes used for each of the different image sub-templates. That is, any of the materials, editing methods, and template themes used for the image sub-templates are factors that affect the evaluation of the similarity between different image sub-templates. When there are multiple influencing factors, the similarity evaluation results for each influencing factor may be weighted to obtain an overall similarity evaluation result. As can be understood, usually, there are certain similar features among different image sub-templates belonging to the same template. For example, the same text content, the same filter, etc. are used in different sub-templates. For example, stickers are placed in the upper right corner of the image, or different layer layouts are similar, etc., and the editing methods of different sub-templates are similar. For example, the template themes of different sub-templates are the same. As an example, the template theme for any of the different sub-templates is something like "Celebrate holidays" or "Recall old times".

[0030] There is similarity between different image sub-templates among the target templates, so that in a plurality of images edited by the target templates, the overall effect is unified, and thereby a systematic style effect is provided to the user. In the embodiments of the present disclosure, when the user attempts to obtain a plurality of edited images at once, usually, considering fully that these images have commonalities such as the same theme of the images and the same feeling presented to the user, a template integrating sub-templates with a predetermined similarity is provided to the user, thereby greatly shortening the time for the user to search for templates with similarity, enabling the user to edit images at once using the templates, and obtaining a plurality of edited images with a predetermined commonality.

[0031] Step S104: Receive at least one original image uploaded by the user for the target template.

[0032] In the embodiments of the present disclosure, the number of original images is not limited and may be one or more. In some exemplary embodiments, the user may upload all the original images that need to be edited for the target template. For example, the target template may recommend to the user to upload N original images so that the user uploads the original images in a batch for the first time. Also, for example, the target template may not limit the number of images, and the user may upload the original images as needed. Later, the target template may be adjusted according to the number of sub-templates that may be included in itself, the number of images that can be edited by the sub-templates, or the number of original images. In some other exemplary embodiments, the user may upload the corresponding original image for each of the image sub-templates in the target template. For example, based on the sample image of each image sub-template, the corresponding original image may be uploaded, but this is not limited herein.

[0033] Step S106: Determine the original image corresponding to the image sub-template, and obtain a plurality of target images based on the image sub-template and the original image corresponding to the image sub-template.

[0034] As can be understood, although there are multiple image sub-templates, since the original images uploaded by the user can be one or more, in the embodiments of the present disclosure, when receiving the original image from the user, the original image corresponding to the image sub-template is determined. For example, the original image corresponding to each image sub-template is assigned. For the image sub-template to which the original image is assigned, the corresponding original image is edited, and for the image sub-template to which the original image is not assigned (for example, when there are few original images), it may be discarded, or the original image previously assigned may be copied. All of the above are merely exemplary descriptions and are not intended to be limiting here. For each image sub-template to which the original image is assigned, the original image corresponding to this image sub-template is edited by this image sub-template to obtain the target image corresponding to this image sub-template.

[0035] In actual applications, the original images corresponding to different image sub-templates may be the same or different. For example, if the user uploads only one original image for the target template, all image sub-templates will perform editing on this original image. Also, for example, if the user uploads multiple original images at once, but the number of multiple original images is less than the number of image sub-templates, the original image corresponding to each image sub-template may be determined according to a preset strategy, and the original images corresponding to different image sub-templates may be the same or different. Also, for example, when the user uploads the corresponding original image for each image sub-template, each image sub-template may perform editing on the corresponding original image. In actual applications, one image sub-template may correspond to one or more original images, or one original image may correspond to one or more image sub-templates. All of the above are merely exemplary descriptions and should not be regarded as limiting.

[0036] Step S108: When previewing a plurality of target images, display the preview effect of the plurality of target images corresponding to the target template on an image preview interface including editing controls for adjusting the plurality of target images.

[0037] In actual application, when a predetermined preview trigger condition is satisfied, a plurality of target images may be previewed. The preview trigger condition may be receiving a preview command by the user. That is, when receiving the preview command, it is determined to preview a plurality of target images. The preview trigger condition may also be detecting the completion of editing of the original image by the image sub-template. That is, by default, when obtaining the target image, it is directly previewed. To enable the user to easily check, the preview effect of the plurality of target images may be displayed on the image preview interface. Also, the image editing controls included in the image preview interface enable the user to adjust the target images according to their own needs. Note that the image editing controls may include, for example, controls for editing the content of the target image, or may include, for example, controls for adjusting the order of the plurality of target images, or controls for deleting the target image, etc. Further, the image editing controls may be controls displayed on the interface or controls that are not displayed on the interface, but the embodiments of the present disclosure do not limit the functions, display forms, and numbers of the image editing controls.

[0038] In the above form, a plurality of target images can be directly obtained from the target template including a plurality of image sub-templates and the original image uploaded by the user. And when the user previews the images, the user can also use the image editing controls to adjust the target images. The convenience is very high, the time taken for multi-image editing can be effectively shortened, and the multi-image editing efficiency can be improved.

[0039] In actual applications, on the template display page, in order for the user to clearly and visually understand the editing effect of the template of the candidate series, an effect diagram which is an image obtained by editing a sample image using the template of the candidate series corresponding to at least one template of the candidate series may be displayed. The effect diagram of the template of the candidate series includes the effect diagrams corresponding to each image sub-template. Then, based on the effect diagram corresponding to the template of the candidate series, the user selects a target template from at least one template of the candidate series. When it is detected that the user triggers a template of a certain candidate series, for example, triggers a use button corresponding to a template of a certain candidate series, it is assumed that a template selection command delivered by the user is received. As an example, in the interface schematic diagram shown in FIG. 2, the template display interface is specifically shown. For ease of understanding, FIG. 2 schematically shows four templates of candidate series. Note that on the template display interface, the effect diagrams of the templates of each candidate series are shown. Use buttons corresponding to the templates of each candidate series are arranged. When the user triggers this use button, it is regarded that a template selection command by the user is received, and the series template selected by the user from the templates of the candidate series on the template display page (that is, the series template corresponding to the use button triggered by the user) is the target template.

[0040] Furthermore, in an embodiment of the present disclosure, a template preview interface may be provided to the user. For example, when a target template is selected by the user through a template display interface, the interface switches to the template preview interface, and as shown in FIG. 3, the target template may be further displayed on the template preview interface. As an example, on the template preview interface, an effect diagram of each sub-template in the target template may be displayed. In some specific embodiments, on the template preview interface, the effect diagrams of each image sub-template in the target template are displayed in the form of a carousel, and at a predetermined position, effect thumbnails of all sub-templates are displayed. Furthermore, while the effect diagram is being displayed on the template preview interface, music matching the target template may be played. Additionally, relevant information of the target template may be displayed on the template preview interface, and the relevant information may be, for example, template creator information, template style theme, etc., but is not limited herein. Through the template preview interface, the user can more accurately understand the content of the target template, which is advantageous for the user to determine whether to continue with image editing using the target template. The template preview interface also includes a usage control, a bookmark control, a comment control, etc. When the user triggers the usage control of the template preview interface, it enters the subsequent original image upload operation. When the user triggers the bookmark control, the target template is added to the user's favorites to facilitate subsequent calls by the user. When the user triggers the comment control, comments of other users on the target template can be viewed, and the user himself / herself may also issue comments, thus promoting the understanding of the template and communication between users. It should be noted that FIG. 3 is merely an illustrative explanation and should not be construed as limiting.

[0041] In some embodiments, when the user determines to use the target template, an image upload interface may be provided to the user. As shown in FIG. 4, the user may import a plurality of original images that need to be edited. The plurality of original images imported into the template may be from the user's portfolio or photo album. Also, any of the image sub-templates in the target template supports editing for one or more original images. Note that any of the image sub-templates supports editing for one or more original images, but one sub-template can generate only one target image. As shown in FIG. 4, Sub-template 1 has two image pits (Image A and Image B), that is, it can support editing for two original images, and the two edited original images may be combined in Sub-template 1 into one target image.

[0042] When the user uploads an original image for the target template, and the target template includes a plurality of image sub-templates, the embodiments of the present disclosure provide two ways to determine the original image corresponding to the image sub-template.

[0043] Method 1: Execute with reference to the following steps A to B.

[0044] Step A: According to the order of the image sub-templates in the target template and the number of images that can be edited by the image sub-templates, assign the original images to the image sub-templates according to a preset order.

[0045] Understandably, the images that can be edited by the image sub - templates can be one or more. This preset order can be the order of the images selected by the user from a portfolio or photo album or the order of the uploaded images. The original images may be assigned to the image sub - templates one by one according to the preset order. For ease of understanding, it is exemplified as follows. The target template includes sub - template 1, sub - template 2, and sub - template 3. The number of images that can be edited by sub - template 1 is 2, the number of images that can be edited by sub - template 2 is 1, and the number of images that can be edited by sub - template 3 is 3. Also, assuming that 6 original images (image 1 to image 6 in order) are uploaded by the user, image 1 and image 2 are respectively assigned to sub - template 1. If sub - template 1 includes two image pits, image 1 and image 2 are assigned to these two image pits according to a predetermined order (for example, from top to bottom or from left to right), image 3 is assigned to sub - template 2, and image 4 to image 6 are assigned to sub - template 3.

[0046] Step B: Determine the original images corresponding to the image sub - templates based on the assignment results.

[0047] In actual applications, the embodiments of the present disclosure can reduce the requirements for the number of images uploaded by the user. Instead of requiring the number of original images uploaded by the user to be equal to the number of images that can be edited by the image sub - templates, a solution is provided where the number of original images uploaded by the user is smaller than the number of images that can be edited by the image sub - templates. For ease of understanding, it may be implemented with reference to the following three cases B1 - B3.

[0048] B1: For an image sub-template where the number of original images assigned is equal to the number of images that can be edited, use the original images assigned to the image sub-template as the original images corresponding to the image sub-template. For example, Image 1 and Image 2 assigned to Sub-template 1 are the original images corresponding to the sub-template.

[0049] B2: For an image sub-template where the number of original images assigned is less than the number of images that can be edited, obtain a complementary image for the image sub-template, and use the original images and the complementary image assigned to the image sub-template as the original images corresponding to the image sub-template. The complementary image is obtained by copying one or more of the original images in a preset manner.

[0050] As an example, assume that the target template includes Sub-template 1, Sub-template 2, and Sub-template 3. The number of images that can be edited by Sub-template 1 is 2, the number of images that can be edited by Sub-template 2 is 1, and the number of images that can be edited by Sub-template 3 is 3. Also, assume that only 5 original images (Image 1 to Image 5) are uploaded by the user. According to the above method, if only 2 original images are assigned to Sub-template 3, a complementary image for Sub-template 3 can be obtained. This complementary image may be obtained by copying one of the 2 original images assigned to Sub-template 3, or it may be obtained by copying one of the original images from Image 1 to Image 5. In actual application, an original image randomly selected may be copied, or an original image may be selected and copied according to a preset strategy (such as material similarity, style similarity, etc.), or the image to be copied may be specified by the user, but it is not limited here. In the above method, all the image pits of Sub-template 3 may be filled.

[0051] B3: For an image sub-template to which the original image is not assigned, if it is determined that there is no original image corresponding to the image sub-template, the image sub-template is discarded.

[0052] As an example, assume that the target template includes sub-template 1, sub-template 2, sub-template 3, and sub-template 4, the number of images that can be edited by sub-template 1 is 2, the number of images that can be edited by sub-template 2 is 1, the number of images that can be edited by sub-template 3 is 3, the number of images that can be edited by sub-template 4 is 2, and only 5 original images are uploaded by the user. According to the above method, all necessary original images are assigned to sub-template 1 to sub-template 2. After the last 2 original images are assigned to sub-template 3, 1 original image is additionally copied, and sub-template 3 also obtains the corresponding original image. Sub-template 4 has no original image assigned. In this case, sub-template 4 is directly discarded.

[0053] According to the above method, the limitation on the number of images uploaded by the user is reduced. For the image sub-template to which part of the images are assigned, complement is performed by image copying, and the image sub-template to which the images are assigned is directly discarded, so as to meet the user's need for image editing, make the use of the template more flexible, and effectively improve the user's experience when using the template.

[0054] Method 2: It may be executed with reference to the following steps a to b.

[0055] Step a: Obtain the template information of the image sub-template and the image information of the original image.

[0056] In some specific embodiments, the template information of the image sub-template includes the material information of each image sub-template (such as material category, material content, etc.), the number of images that can be edited by each image sub-template, and the total number of image sub-templates, and the image information of the original image includes the content information of the original image and the total number of the original images.

[0057] Step b: Based on the template information and the image information, determine the original image corresponding to each image sub-template, and the original images corresponding to different image sub-templates may be the same or different.

[0058] Specifically, when implementing, based on the template information and the image information, determine the degree of matching between each image sub-template and the original image, and thereby, based on the degree of matching, determine the original image corresponding to each image sub-template. As an example, assume that the text material of an image sub-template is "lovely child" and the content information of a certain original image includes children, then the image sub-template and the original image match. Also, when the number of original images is less than the number of images that can be edited by the target template, the original images may be supplemented by copying or the like.

[0059] According to the above method, based on the degree of matching between the image sub-template and the original image, adaptively assign the original image that matches the image sub-template to the image sub-template to achieve an intelligent matching effect and better meet the user's needs for image editing. Also, since the user does not need to perform the matching by himself / herself, it effectively reduces the user's time and effort for image editing and effectively improves the user's experience of using the template.

[0060] Determine the original image corresponding to the image sub-template, and obtain a plurality of target images based on the image sub-template and the original image corresponding to the image sub-template. When previewing the target images, the preview effects of the plurality of target images corresponding to the target template may be displayed on the image preview interface. In some embodiments, based on the order of the plurality of image sub-templates in the target template, the plurality of target images may be displayed on the image preview interface. As can be understood, for each image sub-template, one corresponding target image is generated, and based on the order of the plurality of image sub-templates in the target template, the generated plurality of target images are displayed on the image preview interface in the same order. Since the order of each image sub-template in the target template is known to the user, it is more consistent with the psychological expectations of the user when viewing the preview effects of the plurality of target images.

[0061] In some specific embodiments, the step of displaying the plurality of target images on the image preview interface includes the step of sequentially displaying each of the target images on the image preview interface as the main view, and the step of arranging and displaying the thumbnails of the plurality of target images on the image preview interface.

[0062] Here, the size of the thumbnail is smaller than the size of the main view, and both the order of sequentially displaying the target images as the main view and the order of arrangement of the thumbnails of the target images are consistent with the order in the target template of the image sub-template corresponding to the target image. For ease of understanding, reference may be made to the interface schematic diagram shown in FIG. 5. According to the above method, the user can not only examine the details of the target image in detail through the main view, but also examine the overall representation effect of the plurality of target images through the thumbnails, which is advantageous for the user to visually grasp the preview effects of the plurality of target images in terms of details and the whole.

[0063] To further improve the user's image editing experience and make the results of image editing more in line with the user's needs, image editing controls may be provided to the user in the image preview interface. As shown in FIG. 5, simple editing controls are illustrated but not limiting. As an example, the image editing control includes one or more of an image content editing control, an order adjustment control, and an image deletion control, which will be described below respectively.

[0064] In some specific embodiments, the image editing control includes an image content editing control, and the method further includes the following steps (1) to (2).

[0065] (1) In response to the image content editing control being triggered, switch the image preview interface to an image editing interface, and display the image to be edited among the plurality of target images in an image editing interface including a plurality of sub-controls for editing the content of the image to be edited. Each sub-control has a different function. For example, it includes, but is not limited to, an image switching control, a filter control, a text control, a special effect control, etc. For ease of understanding, as shown in FIG. 6, the image editing interface includes the image to be edited and a plurality of function controls for editing the image. When the user triggers the filter control, a plurality of filters that can be selected by the user and applied to the target image are further displayed. Note that FIG. 6 is only an illustration and should not be understood as a limitation.

[0066] (2) In response to the triggering of a target sub-control among a plurality of sub-controls, an image to be edited is edited based on a trigger operation on the target sub-control. The user may further individually edit the target image using the sub-control as needed to suit their needs, thereby greatly improving the flexibility and convenience of image editing by the user.

[0067] In some embodiments, the image editing interface further includes a thumbnail display control. As an example, in FIG. 6, there is a thumbnail display control on one side of the completion control indicating the completion of editing, and the user may change the corresponding state by the trigger thumbnail display control. In the embodiments of the present disclosure, there are the following two cases according to the state of the thumbnail display control.

[0068] Case 1: When the thumbnail display control is in the first state, thumbnails of a plurality of target images are arranged and displayed on the image editing interface. According to such a method, when the user edits the current target image, the user can examine the detailed effects of other target images through the thumbnails, which is advantageous for the user to integrate the information of all target images to edit the current image to be edited, and the image obtained by the editing is adjusted according to the user's needs.

[0069] In some specific embodiments, according to the content editing operation of the user on the image to be edited, the arrangement display positions of the thumbnails of a plurality of target images in the image editing interface may be determined. Then, based on the arrangement display positions, the thumbnails of the plurality of target images may be arranged and displayed on the image editing interface. For example, as a result of detection, when the user edits image A in target image 1 shown in FIG. 6, the thumbnails of the plurality of target images may be arranged and displayed above image A. As a result of detection, when the user edits image B in target image 1 shown in FIG. 6, the thumbnails of the plurality of target images may be arranged and displayed above image B. Such a method is advantageous for the user to simply and efficiently check the preview effects of all target images when editing an image, and contributes to the improvement of image editing efficiency.

[0070] In some other specific embodiments, the arrangement display positions of the thumbnails of a plurality of target images in the image editing interface may be fixed. For example, they may be arranged above or below the image to be edited, etc., but are not limited here.

[0071] Case 2: When the thumbnail display control is in the second state, the thumbnails of a plurality of target images in the image editing interface are made invisible. If the user needs to check the thumbnails of the plurality of target images, these thumbnails may be left invisible. In this case, the thumbnails in FIG. 6 are not displayed.

[0072] In the embodiments of the present disclosure, the user may optionally select whether to display the thumbnails of a plurality of target images in the image editing interface, thereby improving the user's image editing experience.

[0073] As described above, the user can enter the image editing interface by triggering the image editing control on the image preview page, and through the image editing interface, the user can individually edit the target image that needs to be edited, thereby adjusting the target image more flexibly as needed.

[0074] In some exemplary embodiments, the image editing control includes a sequence adjustment control, and the above multimedia processing method further includes a step of adjusting the display order of a plurality of target images based on a trigger operation on the sequence adjustment control in response to the sequence adjustment control being triggered.

[0075] To enable the user to directly trigger the control to adjust the order of the target images, the sequence adjustment control may be a control displayed on the image preview interface, or the sequence adjustment control may be an invisible control. For example, it may be associated with the thumbnail of each target image in the image preview interface. When it is detected that the user drags the thumbnail, it is regarded that the user triggers the sequence adjustment control, and the display order of the plurality of target images is adjusted according to the user's dragging method.

[0076] According to the above method, the user is not limited to the order of each sub-template in the target template, and may flexibly adjust the display order of the plurality of target images, so that the display order of the plurality of finally displayed target images can be adjusted according to the user's needs.

[0077] In some exemplary embodiments, the image editing control includes an image deletion control, and the above multimedia processing method further includes a step of deleting the target image corresponding to the trigger operation on the image deletion control in response to the image deletion control being triggered.

[0078] To enable the user to directly trigger the control and easily delete unwanted target images, the image deletion control may be a control displayed on the image preview interface, or the image deletion control may be a hidden control. For example, it may be associated with the thumbnail of each target image in the image preview interface. When it is detected that the user operates the thumbnail in a specific manner (such as a long press, double click, etc.), the user is considered to have triggered the image deletion control, and the target image corresponding to the trigger operation on the image deletion control is deleted.

[0079] According to the above method, the user is not limited to the order of each sub-template in the target template, and may flexibly adjust the display order of multiple target images. As a result, the display order of the multiple finally displayed target images can be adjusted according to the user's needs.

[0080] In some exemplary embodiments, the image preview interface also displays music information that matches the target template. The image preview interface further includes a music switching control. The above multimedia processing method further includes the steps of: displaying a music list in response to the music switching control being triggered; and switching the music that matches the target template to the target music corresponding to the music selection operation in response to a music selection operation based on the music list.

[0081] In an embodiment of the present disclosure, in order to enhance the charm of multimedia, matching music is also associated with the target template. The theme of the matching music may be the same as the theme of the target template, for example, a "cute" theme or a "nostalgic" theme. Information such as the music name and singer of the matching music may be shown on the image preview interface. Furthermore, it is also supported that the user switches the matching music by the music switching control and finally displays the desired music. Thereafter, in the process of displaying a plurality of target images in the form of a carousel, the target music selected by the user may be played, and overall, multimedia information combining the desired images and music of the user is displayed.

[0082] The plurality of target images may be displayed as the main view in the form of a carousel on the image preview interface, and at the same time, the target music may also be played. The user can change the currently displayed main view by switching the main view or clicking on the thumbnail, and in this process, the playback of the target music is not affected.

[0083] In some embodiments, the plurality of target images have corresponding multimedia-related resources, and the multimedia-related resources are multimedia resources that are played while the plurality of target images are being displayed in the carousel. The multimedia-related resources may be music, or may be narration voices, animations, etc., but are not limited here.

[0084] The plurality of target images and multimedia-related resources generated based on the target template may be packaged to form a multimedia resource package. The multimedia resource package can be uploaded to a predetermined platform for display or sharing.

[0085] As described above, in the above - mentioned method according to the embodiments of the present disclosure, multiple target images can be directly obtained from a target template including a plurality of image sub - templates and the original image uploaded by the user. Also, the user can adjust the target images by using image editing controls during image preview. It is very simple and efficient, effectively shortening the time taken for multi - image editing, improving the multi - image editing efficiency, and efficiently obtaining multimedia resources that meet the needs.

[0086] Corresponding to the aforementioned multimedia processing method, FIG. 7 is a structural schematic diagram of a multimedia processing apparatus according to an embodiment of the present disclosure. The apparatus may be implemented by software and / or hardware, and generally may be integrated into an electronic device. As shown in FIG. 7, it includes a target template acquisition module 702, an original image reception module 704, a target image acquisition module 706, and a target image preview module 708.

[0087] The target template acquisition module 702 is used to acquire a target template corresponding to a template selection command, including a plurality of image editing sub - templates, in response to receiving a template selection command by the user.

[0088] The original image reception module 704 is used to receive at least one original image uploaded by the user for the target template.

[0089] The target image acquisition module 706 is used to determine the original image corresponding to the image sub - template and obtain a plurality of target images based on the image sub - template and the original image corresponding to the image sub - template.

[0090] When the target image preview module 708 previews a plurality of target images, it is used to display the preview effects of the plurality of target images corresponding to the target template on an image preview interface including image editing controls for adjusting the plurality of target images.

[0091] The above device can directly obtain a plurality of target images from a target template including a plurality of image sub-templates and the original image uploaded by the user. Also, the user can adjust the target image by using the image editing controls during image preview. It is very simple and efficient, can effectively shorten the time taken for multi-image editing, and improve the multi-image editing efficiency.

[0092] In some embodiments, the target image acquisition module 706 is specifically used to assign the original image to the image sub-template according to a preset order according to the order of the image sub-templates in the target template and the number of images that can be edited by the image sub-template, and to determine the original image corresponding to the image sub-template based on the assignment result.

[0093] In some embodiments, the target image acquisition module 706 is specifically configured to, for an image sub-template in which the number of originally assigned images is equal to the number of images that can be edited, use the originally assigned image of the image sub-template as the original image corresponding to the image sub-template; for an image sub-template in which the number of originally assigned images is less than the number of images that can be edited, obtain a complementary image of the image sub-template, and use the originally assigned image of the image sub-template and the complementary image as the original image corresponding to the image sub-template, where the complementary image is obtained by copying one or more of the original images in a preset manner; and for an image sub-template to which no original image is assigned, determine that there is no original image corresponding to the image sub-template, and use this to discard the image sub-template.

[0094] In some embodiments, the target image acquisition module 706 is specifically configured to obtain the template information of the image sub-template and the image information of the original image, and is used to determine the original image corresponding to each image sub-template based on the template information and the image information, and the original images corresponding to different image sub-templates may be the same or different.

[0095] In some embodiments, in the target image acquisition module 706, specifically, the template information of the image sub-template includes the material information of each image sub-template, the number of images that can be edited by each image sub-template, and the total number of the image sub-templates, and the image information of the original image includes the content information of the original image and the total number of the original images.

[0096] In some embodiments, the target image preview module 708 is specifically configured to display the plurality of target images on an image preview interface based on the order of the plurality of image sub-templates in the target template.

[0097] In some embodiments, the target image preview module 708 is specifically used for sequentially displaying each of the target images as a main view on the image preview interface, and for arranging and displaying thumbnails of the plurality of target images on the image preview interface. The size of the thumbnails is smaller than the size of the main view. Both the order of sequentially displaying the target images as the main view and the arrangement order of the thumbnails of the target images are consistent with the order in the target template of the image sub-template corresponding to the target image.

[0098] In some embodiments, the image editing control includes an image content editing control. In response to the image content editing control being triggered, the apparatus switches the image preview interface to an image editing interface, and displays the image to be edited among the plurality of target images on the image editing interface including a plurality of sub-controls for editing the content of the image to be edited. The apparatus further includes a content editing module for editing the image to be edited based on a trigger operation on the target sub-control in response to the target sub-control among the plurality of sub-controls being triggered.

[0099] In some embodiments, the image editing interface further includes a thumbnail display control. The apparatus further includes a thumbnail display module for arranging and displaying thumbnails of the plurality of target images on the image editing interface when the thumbnail display control is in a first state, and for hiding the thumbnails of the plurality of target images in the image editing interface when the thumbnail display control is in a second state.

[0100] In some embodiments, the thumbnail display module is specifically used to determine the arrangement display positions of the thumbnails of the plurality of target images in the image editing interface according to the content editing operation performed by the user on the image to be edited, and to arrange and display the thumbnails of the plurality of target images on the image editing interface based on the arrangement display positions.

[0101] In some embodiments, the image editing control includes a sequence adjustment control and / or an image deletion control, and the apparatus a sequence adjustment module for adjusting the display sequence of the plurality of target images based on a trigger operation on the sequence adjustment control in response to the sequence adjustment control being triggered; and a deletion module for deleting a target image corresponding to a trigger operation on the image deletion control in response to the image deletion control being triggered.

[0102] In some embodiments, the plurality of target images have corresponding multimedia related resources, and the multimedia related resources are multimedia resources for playing while displaying the plurality of target images in a carousel.

[0103] The multimedia processing apparatus according to the embodiments of the present disclosure executes the multimedia processing method according to any one of the embodiments of the present disclosure, and includes a functional module and beneficial effects corresponding to the execution method.

[0104] For the specific operation procedures of the above apparatus embodiments, for the sake of convenience and brevity of description, those skilled in the art can clearly understand that the corresponding procedures in the method embodiments can be referred to, and thus will not be repeated here.

[0105] Embodiments of the present disclosure include a processor and a memory for storing processor-executable instructions. The processor reads the executable instructions from the memory and executes the instructions to provide an electronic device that implements the above multimedia processing method.

[0106] FIG. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. As shown in FIG. 8, the electronic device 800 includes one or more processors 801 and a memory 802.

[0107] The processor 801 may be a central processing unit (CPU) or another form of processing unit having data processing capabilities and / or instruction execution capabilities, and may control other components of the electronic device 800 to execute desired functions.

[0108] The memory 802 may include one or more computer program products that can include various forms of computer-readable storage media such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory. The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage media, and the processor 801 executes the instructions to implement the multimedia processing method and / or other desired functions of the embodiments of the present disclosure above. Also, various contents such as input signals, signal components, noise components, etc. may be stored in the computer-readable storage media.

[0109] In one example, the electronic device 800 may further include an input device 803 and an output device 804, and these components are interconnected by a bus system and / or other forms of connection mechanisms (not shown).

[0110] Furthermore, the input device 803 may include, for example, a keyboard, a mouse, etc.

[0111] This output device 804 can output various information such as the determined distance information and direction information to the outside. This output device 804 may include, for example, a display, a speaker, a printer, a communication network, and remote output devices connected thereto.

[0112] Of course, in FIG. 8, for simplicity, only some of the components of this electronic device 800 related to the present disclosure are shown, and components such as buses and input / output interfaces are omitted. Furthermore, the electronic device 800 may include any other appropriate components according to specific applications.

[0113] In addition to the above methods and devices, embodiments of the present disclosure may also be a computer program product including computer program instructions that, when executed by a processor, cause the processor to execute the multimedia processing method according to the embodiments of the present disclosure.

[0114] The computer program product can be programmed with program code for executing the operations of the embodiments of the present disclosure in any combination of one or more programming languages including object-oriented programming languages such as Java and C++, and conventional procedural programming languages such as the "C" language. The program code can be executed completely on the user's computing device, partially executed on the user device, executed as an independent software package, partially executed on the user's computing device, partially executed on a remote computing device, or executed completely on a remote computing device or server.

[0115] Furthermore, embodiments of the present disclosure may also be a computer-readable storage medium storing computer program instructions that, when executed by a processor, cause the processor to execute the multimedia processing method according to the embodiments of the present disclosure.

[0116] The computer-readable storage medium may employ any combination of one or more readable media. The readable media may be a readable signal medium or a readable storage medium. The readable storage medium includes, but is not limited to, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or any combination thereof. More specific examples (a non-exhaustive list) of the readable storage medium include an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0117] Embodiments of the present disclosure further provide a computer program product including a computer program / instructions which, when executed by a processor, implement the multimedia processing method in the embodiments of the present disclosure.

[0118] In this specification, relational terms such as "first" and "second" are used solely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual such relationship or order between these entities or operations. Further, the terms "comprises", "comprising", or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Further, unless otherwise limited, elements defined by the phrase "comprising..." do not preclude the presence of additional identical elements in the process, method, article, or apparatus that comprises the element.

[0119] The above description is only specific embodiments of the present disclosure and can be understood or implemented by those skilled in the art. Various modifications to these examples will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other examples without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not limited to these examples described herein, but conforms to the broadest scope consistent with the principles and novel features described herein.

Claims

1. A multimedia processing method, comprising: responding to receiving a template selection instruction from a user, obtaining a target template corresponding to the template selection instruction, the target template including a plurality of image sub-templates; receiving at least one original image uploaded by the user for the target template; determining an original image corresponding to the image sub-template, and obtaining a plurality of target images based on the image sub-template and the original image corresponding to the image sub-template; when previewing the plurality of target images, displaying a preview effect of the plurality of target images corresponding to the target template on an image preview interface including an image editing control for adjusting the plurality of target images.

2. The step of determining the original image corresponding to the image sub-template includes: assigning the original images to the image sub-templates according to a preset order according to the order of the image sub-templates in the target template and the number of images that can be edited by the image sub-templates; determining an original image corresponding to the image sub-template based on the assignment result.

3. The step of determining the original image corresponding to the image sub-template based on the assignment result includes: for an image sub-template in which the number of assigned original images is equal to the number of images that can be edited, using the original image assigned to the image sub-template as the original image corresponding to the image sub-template; for an image sub-template in which the number of assigned original images is less than the number of images that can be edited, obtaining a complementary image of the image sub-template, and using the original image assigned to the image sub-template and the complementary image as the original image corresponding to the image sub-template, where the complementary image is obtained by copying one or more of the original images in a preset manner. For an image sub-template to which an original image is not assigned, determining that there is no original image corresponding to the image sub-template and discarding the image sub-template, the method according to claim 2, comprising:

4. The step of determining the original image corresponding to the image sub-template is obtaining template information of the image sub-template and image information of the original image; and determining, based on the template information and the image information, an original image corresponding to each image sub-template, wherein the original images corresponding to different image sub-templates are the same or different, the method according to claim 1, comprising:

5. The template information of the image sub-template includes material information of each image sub-template, the number of images that can be edited by each image sub-template, and the total number of the image sub-templates, and the image information of the original image includes content information of the original image and the total number of the original images, the method according to claim 4.

6. The step of displaying, on an image preview interface, a preview effect of a plurality of target images corresponding to the target template is displaying the plurality of target images on the image preview interface based on the order of the plurality of image sub-templates in the target template, the method according to claim 1.

7. The step of displaying the plurality of target images on the image preview interface is sequentially displaying each of the plurality of target images as a main view on the image preview interface; and arranging and displaying thumbnails of the plurality of target images on the image preview interface, wherein the size of the thumbnail is smaller than the size of the main view, and the order of sequentially displaying the plurality of target images as the main view and the order of arrangement of the thumbnails of the plurality of target images both coincide with the order in the target template of the image sub-templates corresponding to the plurality of target images, the method according to claim 6.

8. The image editing control includes an image content editing control. In response to the image content editing control being triggered, switching the image preview interface to an image editing interface, and displaying an image to be edited among the plurality of target images on the image editing interface including a plurality of sub-controls for editing the content of the image to be edited; In response to a target sub-control among the plurality of sub-controls being triggered, editing the image to be edited based on a trigger operation on the target sub-control. The method according to any one of claims 1 to 7 further includes the above steps.

9. The image editing interface further includes a thumbnail display control. When the thumbnail display control is in a first state, arranging and displaying thumbnails of the plurality of target images on the image editing interface; When the thumbnail display control is in a second state, hiding the thumbnails of the plurality of target images in the image editing interface. The method according to claim 8 further includes the above steps.

10. The step of arranging and displaying thumbnails of the plurality of target images on the image editing interface includes: Determining an arrangement display position of the thumbnails of the plurality of target images in the image editing interface according to a content editing operation on the image to be edited by the user; Based on the arrangement display position, arranging and displaying thumbnails of the plurality of target images on the image editing interface. The method according to claim 9 includes the above steps.

11. The image editing control includes an order adjustment control and / or an image deletion control. In response to the order adjustment control being triggered, adjusting the display order of the plurality of target images based on a trigger operation on the order adjustment control; In response to the image deletion control being triggered, deleting a target image corresponding to a trigger operation on the image deletion control. The method according to any one of claims 1 to 10 further includes the above steps.

12. The method according to any one of claims 1 to 11, wherein the plurality of target images have corresponding multimedia-related resources, and the multimedia-related resources are multimedia resources for broadcasting while carousel-displaying the plurality of target images.

13. A multimedia processing apparatus, comprising: A target template acquisition module for acquiring a target template corresponding to the template selection command, the target template including a plurality of image editing sub-templates, in response to receiving a template selection command by a user; An original image reception module for receiving at least one original image uploaded by the user for the target template; A target image acquisition module for determining an original image corresponding to the image editing sub-template and obtaining a plurality of target images based on the image editing sub-template and the original image corresponding to the image editing sub-template; A target image preview module for displaying, when previewing the plurality of target images, a preview effect of the plurality of target images corresponding to the target template on an image preview interface including an image editing control for adjusting the plurality of target images.

14. An electronic device, comprising: A processor; A memory for storing executable instructions, wherein the processor is arranged to read the executable instructions from the memory and execute the executable instructions to implement the multimedia processing method according to any one of claims 1 to 12.

15. A computer-readable storage medium storing a computer program for executing the multimedia processing method according to any one of claims 1 to 12. A computer-readable storage medium storing a computer program for executing the multimedia processing method according to any one of claims 1 to 12.

Citation Information

Patent Citations

  • Software and system for customizing presentation of digital image

    JP2004054923A

  • Picture layout display program and picture layout display device

    JP2008310684A

  • Information processor and control method thereof and program

    JP2019008456A

  • Information processing method, information processing equipment and program

    JP2019067237A