Image processing method and device, equipment and storage medium

Abstract

The embodiment of the invention relates to an image processing method and device, equipment and a storage medium, and the method comprises the steps: receiving a first image material inputted by a user, and determining a first editing effect material which is configured with first mapping information, the first mapping information is used for representing a relative display position relation between the first editing effect material and the main body object of the first main body type, and then, when it is determined that the first image material comprises the main body object of the first main body type, the first editing effect material is displayed on the first image material according to the first mapping information. Visibly, according to the embodiment of the invention, the first editing effect material can be displayed based on the first mapping information configured by the first editing effect material, so that the display effect of maintaining the relative display position relationship between the first editing effect material and the main body object of the first main body type in the first image material is presented; and the image processing modes are enriched.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of data processing, and particularly relates to an image processing method and device, equipment and a storage medium. BACKGROUND

[0002] With the continuous development of image processing technology, people's functional requirements related to image processing are also increasingly diversified.

[0003] In order to meet people's diversified functional requirements of image processing, how to further enrich the way of image processing is a technical problem to be solved at present. SUMMARY

[0004] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides an image processing method, device, equipment and storage medium.

[0005] In a first aspect, the embodiments of the present disclosure provide an image processing method, which comprises:

[0006] receiving a first image material input by a user;

[0007] determining a first editing effect material; wherein the first editing effect material is configured with first mapping information, and the first mapping information is used to represent a relative display position relationship between the first editing effect material and a subject object of a first subject type;

[0008] in response to the first image material including a subject object of the first subject type, displaying the first editing effect material on the first image material according to the first mapping information.

[0009] In an optional implementation, the displaying the first editing effect material on the first image material according to the first mapping information in response to the first image material including a subject object of the first subject type comprises:

[0010] in response to the first image material including a subject object of the first subject type, controlling the first editing effect material to be displayed on the first image material according to the first mapping information, and the display position of the first editing effect material follows the display position of the first subject object; wherein the first subject object belongs to the subject object of the first subject type in the first image material.

[0011] In an optional implementation, after the determining the first editing effect material, the method further comprises:

[0012] displaying a subject following control;

[0013] The method further includes:

[0014] In response to a follow function start operation triggered based on the subject follow control, it is determined whether the first image material includes a subject object of the first subject type, and after it is determined that the first image material includes a subject object of the first subject type, the first editing effect material is displayed on the first image material according to the first mapping information.

[0015] In an optional implementation, after the follow function start operation triggered based on the subject follow control, the method further includes:

[0016] determining a second editing effect material; wherein the second editing effect material is configured with second mapping information, and the second mapping information is used to represent a relative display position relationship between the second editing effect material and a subject object of a second subject type;

[0017] In response to the first image material including a subject object of the second subject type, the second editing effect material is displayed on the first image material according to the second mapping information.

[0018] In an optional implementation, the determining a first editing effect material includes:

[0019] In response to an application trigger operation for a target image editing template, an editing effect material carried in the target image editing template is determined as a first editing effect material.

[0020] In an optional implementation, the method further includes:

[0021] In response to the first image material including a plurality of subject objects of the first subject type, a subject object switching control is displayed.

[0022] In response to a trigger operation for the subject object switching control, the first editing effect material is controlled to be displayed on the first image material by switching from a display position following the first subject object to a display position following a second subject object according to the first mapping information; wherein the second subject object belongs to the subject objects of the first subject type in the first image material.

[0023] In an alternative implementation, the step of controlling the first editing effect material to be displayed following the display position of the second subject object on the first image material according to the first mapping information comprises:

[0024] In response to a triggering operation on the subject object switching control, icons corresponding to the plurality of subject objects of the first subject type are displayed.

[0025] In response to a triggering operation on the icon of the second subject object, the first editing effect material is controlled to be displayed following the display position of the second subject object on the first image material according to the first mapping information.

[0026] In an alternative implementation, after the step of displaying the first editing effect material on the first image material according to the first mapping information, the method further comprises:

[0027] A display position adjustment operation on the first editing effect material is received, and a relative display position relationship between the first editing effect material and the first subject object after the display position adjustment is recorded as third mapping information.

[0028] In an alternative implementation, after the step of recording the relative display position relationship between the first editing effect material and the first subject object after the display position adjustment as third mapping information, the method further comprises:

[0029] In response to a triggering operation of switching from the first image material to a second image material, it is determined whether the second image material includes a subject object of the first subject type.

[0030] In response to the second image material including a subject object of the first subject type, the first editing effect material is controlled to be displayed following a display position of a third subject object on the second image material according to the third mapping information, wherein the third subject object belongs to the subject object of the first subject type.

[0031] In an alternative implementation, the first image material belongs to a dynamic type of image, and the dynamic type of image is composed of a plurality of continuous image frames.

[0032] The first editing effect material belongs to at least one of the following material types: a filter, a sticker, a text, a graffiti, a mosaic, an imported picture, and a background picture.

[0033] In an alternative implementation, after displaying the first edit effect material on the first image material according to the first mapping information, the method further comprises:

[0034] In response to a template publishing operation, the first image material on which the first edit effect material is displayed is acquired, and an image editing template is generated and published based on the first image material; wherein the first edit effect material configured with the first mapping information is carried in the image editing template.

[0035] In a second aspect, the present disclosure provides an image processing apparatus, comprising:

[0036] A receiving module configured to receive a first image material input by a user;

[0037] A first determining module configured to determine a first edit effect material; wherein the first edit effect material is configured with first mapping information, and the first mapping information is used to represent a relative display position relationship between the first edit effect material and a subject object of a first subject type;

[0038] A first displaying module configured to, in response to the first image material including a subject object of the first subject type, display the first edit effect material on the first image material according to the first mapping information.

[0039] In a third aspect, the present disclosure provides an electronic device, comprising: a processor; a memory configured to store executable instructions of the processor; and the processor configured to read the executable instructions from the memory and execute the instructions to implement the image processing method provided by the embodiments of the present disclosure.

[0040] In a fourth aspect, the present disclosure provides a computer readable storage medium, which stores a computer program, and the computer program is used to execute the image processing method provided by the embodiments of the present disclosure.

[0041] In a fifth aspect, the present disclosure provides a computer program product, which comprises computer programs / instructions, and the computer programs / instructions are executed by a processor to implement the above method.

[0042] Compared with the prior art, the technical solutions provided by the embodiments of the present disclosure have at least the following advantages:

[0043] In the image processing method provided by the embodiment of the present disclosure, a first image material input by a user is received, and a first editing effect material is determined, wherein the first editing effect material is configured with first mapping information, the first mapping information is used to represent a relative display position relationship between the first editing effect material and a subject object of a first subject type, and then when it is determined that the first image material includes the subject object of the first subject type, the first editing effect material is displayed on the first image material according to the first mapping information. After the embodiment of the present disclosure determines that the first image material input by the user includes the subject object of the first subject type, the relative display position relationship between the first editing effect material and the subject object represented by the first mapping information configured by the first editing effect material is used to control the display of the first editing effect material on the first image material. It can be seen that the embodiment of the present disclosure can display the first editing effect material based on the first mapping information configured by the first editing effect material, so as to present the display effect of maintaining the relative display position relationship between the first editing effect material and the subject object of the first subject type in the first image material, and enrich the image processing mode. BRIEF DESCRIPTION OF DRAWINGS

[0044] The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings. The same or similar components are denoted by the same or similar reference numerals throughout the drawings.

[0045] Figure 1 A page interaction schematic diagram provided in the related art;

[0046] Figures 2-5 A page interaction schematic diagram provided by the embodiment of the present disclosure;

[0047] Figure 6 A structural schematic diagram of an image processing device provided by the embodiment of the present disclosure;

[0048] Figure 7 A structural schematic diagram of an electronic device provided by the embodiment of the present disclosure. DETAILED DESCRIPTION

[0049] Embodiments of the present disclosure will be described in more detail by making reference to the drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms, and should not be interpreted as being limited to the embodiments set forth herein, rather, these embodiments are provided to make the present disclosure more thorough and complete. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes, and are not intended to limit the protection scope of the present disclosure.

[0050] It should be understood that each step recited in the method embodiments of the present disclosure can be performed in different orders and / or in parallel. In addition, the method embodiments can include additional steps and / or omit performing the steps shown. The scope of the present disclosure is not limited in this respect.

[0051] The term "comprising" and variations thereof as used herein are open-ended, that is, "comprising but not limited to." The term "based on" means "based, at least in part, on." The term "one embodiment" means "at least one embodiment." The term "another embodiment" means "at least one additional embodiment." The term "some embodiments" means "at least some embodiments." Related terms have corresponding meanings.

[0052] It should be noted that the terms "first", "second", and the like in the present disclosure are merely used to distinguish different devices, modules or units, and do not imply the order or interdependence of the functions performed by these devices, modules or units.

[0053] It should be noted that the terms "one", "multiple" in the present disclosure are illustrative and not restrictive, and those skilled in the art should understand that "one or more" should be understood unless otherwise explicitly indicated in the context.

[0054] The names of the messages or information exchanged between the devices in the embodiments of the present disclosure are only for illustrative purposes, and are not intended to limit the scope of the messages or information.

[0055] In the field of image processing, a user can add sticker, doodle and other editing effect materials to the input image material to achieve the desired display effect. However, in related image processing technology, the editing effect material is usually displayed on the screen in a fixed position, and lacks a correlation between the editing effect material and the main object in the image material, resulting in problems such as blocking the main object and position deviation of the effect editing material, which affects the overall display effect. For example, Figure 1 As shown in FIG. 1, a page interaction schematic diagram provided in the related art is shown. After the user adds the editing effect material 102 to the image material 101, the editing effect material 102 is displayed on the screen in the image material based on the preset coordinates. The editing effect material 102 and the main object (face) have a position deviation, resulting in poor display effect.

[0056] Therefore, how to further enrich the way of image processing and improve the user's image processing experience is a technical problem that needs to be solved at present.

[0057] The embodiment of the present disclosure provides an image processing method, receiving a first image material input by a user, and determining a first editing effect material, wherein the first editing effect material is configured with first mapping information, the first mapping information is used to represent a relative display position relationship between the first editing effect material and a subject object of a first subject type, and then when it is determined that the first image material includes the subject object of the first subject type, the first editing effect material is displayed on the first image material according to the first mapping information. The embodiment of the present disclosure controls the display of the first editing effect material on the first image material according to the relative display position relationship between the first editing effect material and the subject object represented by the first mapping information configured by the first editing effect material after determining that the first image material input by the user includes the subject object of the first subject type. It can be seen that the embodiment of the present disclosure can display the first editing effect material based on the first mapping information configured by the first editing effect material, so as to present the display effect of maintaining the relative display position relationship between the first editing effect material and the subject object of the first subject type in the first image material, and enrich the image processing mode.

[0058] The embodiment of the present disclosure provides an image processing method, as shown in the figure, Figure 2 The embodiment of the present disclosure provides an image processing method, as shown in the figure, Figure 2 The method comprises the following steps:

[0059] S201: receiving a first image material input by a user.

[0060] The image processing method provided by the embodiment of the present disclosure can be applied to a client, for example, the client can include a client deployed on a smart phone, a client deployed on a tablet computer, etc.

[0061] In the embodiment of the present disclosure, the first image material can be any image material input by a user, specifically, the first image material can be a static type image or a dynamic type image, wherein the dynamic type image is composed of continuous multiple frames of images, which can present continuous pictures of a period of time before and after image shooting, and the dynamic effect is derived from the sequential playing of multiple frames of images. The dynamic type image includes LivePhoto and the like, LivePhoto refers to a plurality of image sequences recorded before and after the shutter is pressed for about 1.5 seconds during shooting, which shows the dynamic moment during shooting by continuous playing. The static type image corresponds to the dynamic type image, and the static type image is an image composed of a single frame of picture, and the picture content is fixed and unchanged. It can be seen that the image processing method provided by the embodiment of the present disclosure is also applicable to dynamic type images.

[0062] The first image material can have multiple sources. Specifically, the first image material can be an image material selected from a user album page, or an image material obtained by a camera, etc.

[0063] In an optional embodiment, the first image material can be obtained by triggering an import material control. Specifically, when a triggering operation on the import material control is received, a user album page is displayed, and the user album page displays multiple image materials. When a selection operation on at least one image material in the multiple image materials is received, the at least one image material is taken as the first image material.

[0064] S202: Determine the first editing effect material.

[0065] The first editing effect material is configured with first mapping information, and the first mapping information is used to represent the relative display position relationship between the first editing effect material and the subject object of the first subject type.

[0066] In the embodiments of the present disclosure, after receiving the first image material input by the user, the first editing effect material can be added to the first image material to optimize the display effect of the first image material and improve the image processing experience of the user.

[0067] The first editing effect material is a pre-set editing effect material, which includes style, style, color, color, etc. The first editing effect material can include at least one of the following material types: filter, sticker, text, graffiti, mosaic, imported picture, and background picture. The background picture can refer to a picture used as a basic background in the image processing process.

[0068] The first editing effect material in the embodiments of the present disclosure is pre-configured with first mapping information, which is used to represent the relative display position relationship between the first editing effect material and the subject object of the first subject type. That is, the first editing effect material is not fixed at an absolute position on the image material, but establishes a relative display position relationship with the subject object through the first mapping information.

[0069] The first mapping information may include information on parameters used to describe the relative position between the first editing effect material and the main object of the first main type. The parameters may include spatial position parameters. The spatial position parameters specifically include offset, proportional relationship, rotation angle, etc. The offset is used to describe the distance of the first editing effect material relative to the boundary of the main object of the first main type (such as the sticker is 20 pixels away from the left boundary of the face); the proportional relationship is used to define the ratio of the size of the first editing effect material to the main object of the first main type (such as the width of the sticker is 50% of the width of the face); the rotation angle is used to determine the angle at which the first editing effect material rotates following the main object of the first main type (such as the sticker remains perpendicular to the central axis of the face).

[0070] The first subject type can be a preset subject type. For example, the first subject type can include a person type, an animal type, an object type, etc. The subject object of the first subject type can be a component or the entirety of the first subject type. For example, the subject object of a person type can be a face, eyes, limbs, clothing, etc., and the subject object of an object type can be the entire product. Each editing effect material is pre-set with a corresponding subject type and subject object of that subject type through metadata. For example, the subject type corresponding to the glasses sticker is the person type in the image material, and the subject object is the person's eyes.

[0071] In an optional implementation manner, the first editing effect material may be an editing effect material selected by a user in an editing effect material library.

[0072] like Figure 3 , which is a schematic diagram of a page interaction provided by an embodiment of the present disclosure, displays an image material 301 and editing effect materials of various material types, including a "sticker" type material. When a selection operation is received for an editing effect material 302 of the sticker type, it is used as the first editing effect material.

[0073] In another optional implementation, the first editing effect material may also be the editing effect material carried in the target image editing template, wherein the target image editing template is a pre-set image editing framework, which contains editing effect materials of at least one material type such as filters, stickers, text, graffiti, mosaics, imported pictures and base maps, and is used to process image materials. The target image editing template may be an image editing template selected by the user in the template library. Specifically, when an application trigger operation for the target image editing template is received, the editing effect material carried by the target image editing template is obtained, and the editing effect material is determined as the first editing effect material. The application trigger operation for the target image editing template may be a trigger operation such as a click or long press on the application control.

[0074] S203: in response to the first image material including the subject object of the first subject type, displaying the first editing effect material on the first image material according to the first mapping information.

[0075] In the embodiments of the present disclosure, after receiving the first image material and determining the first editing effect material, and identifying the subject object in the first image material, if the first image material includes the subject object of the first subject type, the display coordinates of the first editing effect material can be calculated according to the first mapping information configured by the first editing effect material, and the first editing effect material is displayed on the first image material.

[0076] In an optional implementation, the first editing effect material can be displayed according to the display position of the first subject object. Specifically, when the first image material includes the subject object of the first subject type, the first editing effect material is displayed on the first image material according to the display position of the first subject object according to the first mapping information, and the subject object in the first image material can be identified based on a subject detection algorithm. That is, the first editing effect material dynamically adjusts the display position of the first subject object, and is not fixed at a certain position on the first image material, so as to present the display effect of maintaining the relative display position relationship between the first editing effect material and the subject object of the first subject type in the first image material.

[0077] Specifically, the first editing effect material directly acts on the first subject object. Specifically, the first editing effect material is superimposed on the first subject object based on the display position of the first subject object in the first image material to achieve the following effect. For example, when a hat sticker is added to a face, the sticker is directly overlaid on the upper area of the face, and the sticker moves when the face moves.

[0078] As shown in the above Figure 3 In the page interaction schematic diagram shown in the above

[0079] On the basis of the above-mentioned embodiments, the specific manner in which the first editing effect material follows the first subject object can also be to apply the first editing effect material to a subject background region of the first subject object. Specifically, based on the display position of the first subject object in the first image material, the display region of the background is determined by image segmentation and other related technologies, and then the first editing effect material is applied to the background region, so that the relative position between the first editing effect material and the first subject object remains unchanged. For example, when adding a sticker of a smiling face behind a person, the smiling face in the background region moves synchronously with the person.

[0080] On the basis of the above-mentioned embodiments, the specific manner in which the first editing effect material follows the first subject object can also be to interpose the first editing effect material between the first subject object and the background. Specifically, based on the display position of the first subject object, the background region is determined, and then the first editing effect material is inserted between the first subject object and the background region to form a layer order relationship of the background, the first editing effect material, and the first subject object. For example, a sticker of wings is inserted between the first subject object and the background, and when the first subject object moves, the sticker forms a following effect between the first subject object and the background.

[0081] In another alternative implementation, if the first image material is a dynamic type of image, after receiving the first image material and determining the first editing effect material, the first image material is subjected to identification processing. When no subject object of the first subject type is identified in the first frame of the first image material, the first editing effect material is hidden at this time, and the first image material is continuously played. When the above-mentioned subject object is identified during the playing process, the first editing effect material is displayed on the first image material according to the first mapping information.

[0082] Since the first mapping information is configured in advance for the first editing effect material in the embodiments of the present disclosure, when the user adds the first editing effect material to the first image material, the first editing effect material can be displayed on the first image material based on the first mapping information on the premise that the first image material includes a subject object of the first subject type, so as to present a display effect of maintaining the relative display position relationship between the first editing effect material and the subject object of the first subject type in the first image material.

[0083] In an alternative implementation, after the first editing effect material is displayed on the first image material according to the first mapping information configured for the first editing effect material, in order to meet the personalized needs of the user, the user can also trigger a display position adjustment operation (such as rotation and scaling) for the first editing effect material, and after the display position adjustment operation ends, the relative display position relationship between the first editing effect material after the display position adjustment and the first subject object is recorded to form third mapping information.

[0084] Specifically, when a display position adjustment operation for the first editing effect material is received, the relative display position relationship between the first editing effect material and the first main object after the display position adjustment is calculated in real time, and the relative display position relationship between the two is recorded as the third mapping information.

[0085] After recording the third mapping information, if the user needs to replace the first image material, the disclosed embodiment also supports the function of implementing the editing effect material following the main object based on the updated third mapping information. Specifically, when a trigger operation is received to switch from the first image material to the second image material, it is first determined whether the second image material includes a main object of the first main type. Then, if it is determined that the second image material includes a main object of the first main type, the first editing effect material is controlled to be displayed on the second image material following the display position of the third main object based on the third mapping information. The second image material is the image material after replacement, and the third main object is the main object of the first main type.

[0086] It can be seen that after the image material is replaced, the embodiment of the present disclosure can display the first editing effect material based on the third mapping information to present a display effect that maintains the relative display position relationship between the first editing effect material and the main object of the first main type in the second image material, further enhancing the user's image processing experience.

[0087] In another optional embodiment, after displaying the first editing effect material on the first image material according to the first mapping information configured for the first editing effect material, to further meet the user's personalized needs, the user can also trigger a display position adjustment operation (such as zooming in, zooming out, or rotating) for the first image material. After the display position adjustment operation is completed, the display position adjustment information is obtained, and the display position of the first editing effect material is adjusted based on the display position adjustment information. That is, the relative display position relationship between the first editing effect material and the main object of the first main type in the first image material is maintained in real time. For example, if the first image material is zoomed out, the first editing effect material is also zoomed out in the same proportion.

[0088] As mentioned above Figure 3 In the page interaction diagram shown, in the process of displaying the editing effect material 302 on the image material 301 according to the mapping information, when a display position adjustment operation (such as rotation) for the image material 301 is received, the display position of the image material 301 is adjusted, and the display position adjustment information of the image material is obtained after the display position adjustment, and the display position of the editing effect material 302 is adjusted based on the display position adjustment information to maintain the relative display position relationship between the editing effect material 302 and the main object of the first main type in the image material 301.

[0089] It can be seen that after the display position adjustment operations such as scaling and rotating the image material are performed, the embodiment of the present disclosure automatically and synchronously adjusts the display position of the editing effect material, thereby ensuring that the relative position relationship between the editing effect material and the main object remains unchanged.

[0090] In an optional embodiment, after the first editing effect material is displayed on the first image material according to the first mapping information, a template publishing operation may be triggered for the first image material to which the first editing effect material is applied. That is, an image editing template is created based on the first image material to which the first editing effect material is applied. Specifically, when a template publishing operation is received, the first image material displaying the first editing effect material is obtained, and an image editing template is generated and published based on the first image material, wherein the image editing template carries the first editing effect material configured with the first mapping information. The template publishing operation may be triggered by a click, long press, or other triggering operation on the template publishing control.

[0091] The disclosed embodiments provide an image processing method that receives a first image material input by a user and determines a first editing effect material, wherein the first editing effect material is configured with first mapping information, the first mapping information being used to characterize the relative display position relationship between the first editing effect material and a subject object of a first subject type. Subsequently, when it is determined that the first image material includes a subject object of the first subject type, the first editing effect material is displayed on the first image material according to the first mapping information. After determining that the first image material input by the user includes a subject object of the first subject type, the disclosed embodiments control the display of the first editing effect material on the first image material based on the relative display position relationship between the first editing effect material and the subject object as represented by the first mapping information configured for the first editing effect material. It can be seen that the disclosed embodiments can display the first editing effect material based on the first mapping information configured for the first editing effect material to present a display effect that maintains the relative display position relationship between the first editing effect material and the subject object of the first subject type in the first image material, thereby enriching the image processing method.

[0092] In an optional embodiment, after receiving the first image material input by the user and determining the first editing effect material, a subject follow control can also be displayed. The subject follow control is a pre-set control, and the user can switch the follow function on and off by triggering the subject follow control.

[0093] Specifically, a subject follow control is displayed. If a follow function activation operation is received based on the subject follow control, the first image material is first identified as including a subject object of the first subject type. After determining that the first image material includes a subject object of the first subject type, the first editing effect material is displayed on the first image material based on the first mapping information configured for the first editing effect material. The follow function activation operation triggered by the subject follow control can be a click, double-click, or long-press trigger operation on the closed subject follow control.

[0094] like Figure 4 As shown, it is a schematic diagram of another page interaction provided by an embodiment of the present disclosure. After receiving the image material 401 input by the user and determining the editing effect material 402, the subject follow control 403 is displayed. The current subject follow control 403 is in a closed state. When the follow function start operation triggered by the subject follow control 403 is received, it is identified whether the image material 401 includes a subject object of the first subject type, and after determining that the image material 401 includes a subject object of the first subject type, the editing effect material 402 is displayed on the image material 401 according to the mapping information configured by the editing effect material 402.

[0095] It can be seen that by displaying the subject follow control, the user can choose whether to enable the follow function as needed, for example, turn it on when a dynamic follow effect is required.

[0096] In an optional embodiment, after the user triggers the follow function based on the subject follow control, a second editing effect material can also be added to the first image material, wherein the second editing effect material can be any editing effect material other than the first editing effect material, and the second editing effect material can belong to at least one material type among filters, stickers, text, graffiti, mosaics, imported pictures and base maps.

[0097] Specifically, when a selection operation is received for any editing effect material, it is used as the second editing effect material, and then, it is identified whether the first image material includes a subject object of the second subject type. When it is identified that the first image material contains a subject object of the second subject type, the second editing effect material is displayed on the first image material according to the second mapping information.

[0098] It can be seen that based on the operation of triggering the follow function based on the subject follow control, when new editing effect materials are subsequently added to the first image material, the new editing effect materials can be displayed based on the mapping information to present a display effect that maintains the relative display position relationship between the editing effect material and the subject object of the first subject type in the first image material, thereby further enhancing the user's image processing experience.

[0099] In an alternative embodiment, after receiving the first image material input by the user and determining the first editing effect material, if it is identified that the first image material includes a plurality of subject objects of the first subject type (such as a plurality of human faces), a subject object switching control can also be displayed. The user triggers the subject object switching control to switch different subject objects, so that the first editing effect material is switched from following the original first subject object to following a second subject object, wherein the second subject object and the first subject object belong to the first subject type, and the two are different subject objects of the first subject type.

[0100] Specifically, when it is identified that the first image material includes a plurality of subject objects of the first subject type, the subject object switching control is displayed, and when a triggering operation on the subject object switching control is received, the first editing effect material is controlled to be displayed on the first image material from the display position following the first subject object to the display position following the second subject object according to the first mapping information configured by the first editing effect material.

[0101] In an alternative embodiment, when a triggering operation on the subject object switching control is received, the subject objects can be switched in a preset order. The preset order is a pre-set order, and specifically, the preset order can be sorted according to the area proportion size of the plurality of subject objects of the first subject type, the distance from the center of the picture, and the like. For example, when there are three human faces in the image material, the area proportion size is sorted as “human face 1 (largest), human face 2, human face 3”, and after the subject object switching control is triggered to switch, the subject objects are switched in the above order in a cycle. Each time the subject object switching control is clicked, the current subject object is switched to the next subject object in the above order, and when the last subject object in the above order is reached, the first subject object is returned, and the cycle is repeated.

[0102] In another alternative embodiment, when a triggering operation on the subject object switching control is received, a candidate subject object panel can also be displayed, which displays icons corresponding to the plurality of subject objects of the first subject type, so as to facilitate the user to flexibly select the switched subject object. Specifically, when a triggering operation on the subject object switching control is received, a candidate subject object panel is displayed, which displays icons corresponding to the plurality of subject objects of the first subject type. When a triggering operation on the icon of the second subject object is received, the first editing effect material is controlled to be displayed on the first image material from the display position following the first subject object to the display position following the second subject object according to the first mapping information.

[0103] As Figure 5As shown, another page interaction schematic diagram provided by the embodiment of the present disclosure is shown. After receiving the image material 501 input by the user, determining the editing effect material 502, and displaying the editing effect material on the image material based on the mapping information, if it is identified that the image material 501 includes the subject object 503 of the first subject type and the subject object 504 of the first subject type, the subject object switching control 505 is displayed. When a trigger operation for the subject object switching control 505 is received, the candidate subject object panel is displayed. The candidate subject object panel displays icons corresponding to a plurality of subject objects respectively, and the icons include the icon 506 of the subject object 503 and the icon 507 of the subject object 504. When a trigger operation for the icon 507 of the subject object 504 is received, the editing effect material 502 is controlled to be displayed on the image material according to the mapping information, and the display position of the subject object 503 is switched to the display position of the subject object 504.

[0104] It can be seen that when the image material includes a plurality of subject objects of the same subject type, the user can flexibly switch the subject object followed by the editing effect material by triggering the subject object switching control, thereby further improving the image processing experience of the user.

[0105] In order to realize the above-mentioned embodiment, the present disclosure further provides an image processing device. Figure 6 As shown, the device includes: Figure 6

[0106] The receiving module 601 is configured to receive a first image material input by a user.

[0107] The first determining module 602 is configured to determine a first editing effect material. The first editing effect material is configured with first mapping information. The first mapping information is used to represent the relative display position relationship between the first editing effect material and the subject object of the first subject type.

[0108] The first display module 603 is configured to display the first editing effect material on the first image material according to the first mapping information in response to the first image material including the subject object of the first subject type.

[0109] In an optional implementation, the first display module is specifically configured to:

[0110] ​in response to the first image material including the subject object of the first subject type, display the first editing effect material on the first image material according to the first mapping information, so as to follow the display position of the first subject object; wherein the first subject object belongs to the subject object of the first subject type in the first image material.

[0111] In an optional implementation, the apparatus further includes:

[0112] The second display module is configured to display a subject following control.

[0113] The first display module is specifically configured to:

[0114] in response to a following function starting operation triggered based on the subject following control, determine whether the first image material includes the subject object of the first subject type, and after determining that the first image material includes the subject object of the first subject type, display the first editing effect material on the first image material according to the first mapping information.

[0115] In an optional implementation, the apparatus further includes:

[0116] The second determining module is configured to determine a second editing effect material; wherein the second editing effect material is configured with second mapping information, and the second mapping information is used to represent a relative display position relationship between the second editing effect material and a subject object of a second subject type.

[0117] The third display module is configured to, in response to the first image material including the subject object of the second subject type, display the second editing effect material on the first image material according to the second mapping information.

[0118] In an optional implementation, the first determining module is specifically configured to:

[0119] in response to an application triggering operation for a target image editing template, determine an editing effect material carried in the target image editing template as the first editing effect material.

[0120] In an optional implementation, the apparatus further includes:

[0121] The fourth display module is configured to, in response to the first image material including a plurality of subject objects of the first subject type, display a subject object switching control.

[0122] The switching display module is configured to, in response to a triggering operation of the subject object switching control, control the first editing effect material to be displayed on the first image material according to the first mapping information, and switch from being displayed following the display position of the first subject object to being displayed following the display position of a second subject object; the second subject object belongs to the first subject type of subject object in the first image material.

[0123] In an optional implementation, the switching display module comprises:

[0124] The display sub-module is configured to, in response to a triggering operation of the subject object switching control, display icons corresponding to the plurality of first subject type of subject objects respectively.

[0125] The switching sub-module is configured to, in response to a triggering operation of an icon of a second subject object, control the first editing effect material to be displayed on the first image material according to the first mapping information, and switch from being displayed following the display position of the first subject object to being displayed following the display position of the second subject object.

[0126] In an optional implementation, the apparatus further comprises:

[0127] The adjusting module is configured to receive a display position adjusting operation of the first editing effect material, and record a relative display position relationship between the first editing effect material and the first subject object after the display position is adjusted, as third mapping information.

[0128] In an optional implementation, the apparatus further comprises:

[0129] The third determining module is configured to, in response to a triggering operation of switching from the first image material to a second image material, determine whether the first subject type of subject object is included in the second image material.

[0130] The display module is configured to, in response to the first subject type of subject object being included in the second image material, control the first editing effect material to be displayed on the second image material according to the third mapping information, and follow a display position of a third subject object; the third subject object belongs to the first subject type of subject object.

[0131] In an optional implementation, the first image material belongs to a dynamic type of image, the dynamic type of image is composed of a plurality of continuous image frames, and the first editing effect material belongs to at least one of a material type of filter, sticker, text, graffiti, mosaic, imported picture, and bottom picture.

[0132] In an optional implementation, the apparatus further comprises:

[0133] The generating module is configured to, in response to a template publishing operation, acquire the first image material on which the first editing effect material is displayed, and generate and publish an image editing template based on the first image material; wherein the image editing template carries the first editing effect material configured with the first mapping information.

[0134] The image processing apparatus provided by the embodiments of the present disclosure receives a first image material input by a user and determines a first editing effect material, wherein the first editing effect material is configured with first mapping information, and the first mapping information is used to represent a relative display position relationship between the first editing effect material and a subject object of a first subject type. Then, when it is determined that the first image material includes the subject object of the first subject type, the first editing effect material is displayed on the first image material according to the first mapping information. After the embodiments of the present disclosure determine that the first image material input by the user includes the subject object of the first subject type, the first editing effect material is displayed on the first image material according to the relative display position relationship between the first editing effect material and the subject object represented by the first mapping information configured by the first editing effect material. It can be seen that the embodiments of the present disclosure can display the first editing effect material based on the first mapping information configured by the first editing effect material, so as to present a display effect of maintaining the relative display position relationship between the first editing effect material and the subject object of the first subject type in the first image material, and enrich the image processing manner.

[0135] In addition to the method and the apparatus described above, the embodiments of the present disclosure further provide a computer-readable storage medium, wherein instructions are stored in the computer-readable storage medium, and when the instructions are run on a terminal device, the terminal device implements the image processing method provided by the embodiments of the present disclosure.

[0136] The embodiments of the present disclosure further provide a computer program product, wherein the computer program product includes computer programs / instructions, and the computer programs / instructions are executed by a processor to implement the image processing method provided by the embodiments of the present disclosure.

[0137] In addition, the embodiments of the present disclosure further provide an electronic device, as shown in Figure 7 may include:

[0138] The processor 701, the memory 702, the input device 703 and the output device 704. The number of processors 701 in the electronic device can be one or more, Figure 7 In some embodiments of the present disclosure, the processor 701, the memory 702, the input device 703 and the output device 704 can be connected through a bus or other means, wherein, Figure 7 In some embodiments of the present disclosure, the processor 701, the memory 702, the input device 703 and the output device 704 can be connected through a bus or other means, wherein,

[0139] The memory 702 can be used to store software programs and modules, and the processor 701 can execute various function applications and image processing of the electronic device by running the software programs and modules stored in the memory 702. The memory 702 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, application programs required for at least one function, and the like. In addition, the memory 702 can include a high-speed random access memory, and can further include a non-volatile memory such as at least one disk storage device, a flash memory device, or other volatile solid state memory device. The input device 703 can be used to receive input digital or character information, and to generate signal input related to user settings and function control of the electronic device.

[0140] In particular, in the present embodiment, the processor 701 loads the executable file corresponding to the process of one or more application programs into the memory 702 according to the following instructions, and runs the application programs stored in the memory 702 by the processor 701, thereby realizing the various functions of the above-mentioned electronic device.

[0141] It should be noted that, in this paper, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is any such actual relationship or order between the entities or operations. Moreover, the terms "include", "contain" or any other variants thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or device. Without more limitations, the element defined by the statement "including a" does not exclude the presence of another identical element in the process, method, article or device including the element.

[0142] The above is only a specific embodiment of the present disclosure, which enables those skilled in the art to understand or implement the present disclosure. Various modifications of these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to these embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An image processing method, characterized in that: The method comprises: receiving a first image material input by a user; Determine a first editing effect material; wherein the first editing effect material is configured with first mapping information, and the first mapping information is used to represent a relative display position relationship between the first editing effect material and a subject object of a first subject type; In response to the first image material including a subject object of the first subject type, the first editing effect material is displayed on the first image material according to the first mapping information.

2. The image processing method according to claim 1, wherein: In response to the first image material including the subject object of the first subject type, displaying the first editing effect material on the first image material according to the first mapping information includes: In response to the first image material including a subject object of the first subject type, the first editing effect material is controlled to be displayed on the first image material following the display position of the first subject object according to the first mapping information; wherein, the first subject object belongs to the subject object of the first subject type in the first image material.

3. The image processing method according to claim 1, wherein: After determining the first editing effect material, the method further includes: Display subject follow controls; In response to the first image material including the subject object of the first subject type, displaying the first editing effect material on the first image material according to the first mapping information includes: In response to a follow function start-up operation triggered by the subject follow control, it is determined whether the first image material includes a subject object of the first subject type, and after determining that the first image material includes a subject object of the first subject type, the first editing effect material is displayed on the first image material according to the first mapping information.

4. The image processing method according to claim 3, wherein: After responding to a follow function activation operation triggered by the main body follow control, the method further includes: Determining a second editing effect material; wherein the second editing effect material is configured with second mapping information, and the second mapping information is used to represent a relative display position relationship between the second editing effect material and a subject object of a second subject type; In response to the first image material including a subject object of the second subject type, the second editing effect material is displayed on the first image material according to the second mapping information.

5. The image processing method according to claim 1, wherein: The determining of the first editing effect material includes: In response to an application triggering operation on a target image editing template, the editing effect material carried in the target image editing template is determined as a first editing effect material.

6. The image processing method according to claim 2, wherein: The method further comprises: In response to the first image material including a plurality of subject objects of the first subject type, displaying a subject object switching control; In response to the triggering operation of the subject object switching control, the first editing effect material is controlled on the first image material to switch from following the display position of the first subject object to following the display position of the second subject object according to the first mapping information; wherein, the second subject object belongs to the subject object of the first subject type in the first image material.

7. The image processing method according to claim 6, characterized in that: In response to the triggering operation of the subject object switching control, controlling the first editing effect material to switch from being displayed following the display position of the first subject object to being displayed following the display position of the second subject object on the first image material according to the first mapping information, includes: In response to a triggering operation on the subject object switching control, displaying icons corresponding to the plurality of subject objects of the first subject type respectively; In response to a triggering operation on the icon of the second main object, the first editing effect material is controlled according to the first mapping information to switch from following the display position of the first main object to following the display position of the second main object on the first image material.

8. The image processing method according to claim 2, wherein: After displaying the first editing effect material on the first image material according to the first mapping information, the method further includes: A display position adjustment operation for the first editing effect material is received, and a relative display position relationship between the first editing effect material and the first main object after the display position adjustment is recorded as third mapping information.

9. The image processing method according to claim 8, characterized in that: After recording the relative display position relationship between the first editing effect material and the first main object after the display position adjustment as third mapping information, the method further includes: In response to a triggering operation of switching from the first image material to a second image material, determining whether the second image material includes a subject object of the first subject type; In response to the second image material including a subject object of the first subject type, the first editing effect material is controlled to be displayed on the second image material following the display position of the third subject object according to the third mapping information; wherein the third subject object belongs to the subject object of the first subject type.

10. The image processing method according to claim 1, wherein: The first image material is a dynamic image, and the dynamic image is composed of multiple consecutive frames of images; and / or, The first editing effect material belongs to at least one material type of filter, sticker, text, graffiti, mosaic, imported picture and base map.

11. The image processing method according to claim 1, wherein: After displaying the first editing effect material on the first image material according to the first mapping information, the method further includes: In response to a template publishing operation, the first image material displaying the first editing effect material is obtained, and an image editing template is generated and published based on the first image material; wherein the image editing template carries the first editing effect material configured with the first mapping information.

12. An image processing device, characterized in that: The device comprises: A receiving module, configured to receive a first image material input by a user; A first determining module is configured to determine a first editing effect material; wherein the first editing effect material is configured with first mapping information, and the first mapping information is used to represent a relative display position relationship between the first editing effect material and a subject object of a first subject type; The first display module is configured to display the first editing effect material on the first image material according to the first mapping information in response to the first image material including the subject object of the first subject type.

13. An electronic device, characterized in that: The electronic device comprises: processor; a memory for storing instructions executable by the processor; The processor is configured to read the executable instructions from the memory and execute the instructions to implement the method according to any one of claims 1 to 11.

14. A computer-readable storage medium, characterized in that The storage medium stores a computer program, and the computer program is used to execute the method according to any one of claims 1 to 11.

15. A computer program product, characterized in that The computer program product comprises a computer program / instruction, and when the computer program / instruction is executed by a processor, the method according to any one of claims 1 to 11 is implemented.

Images