Image processing method, device, electronic device and storage medium

Abstract

An embodiment of the present invention provides an image processing method, device, electronic device, and storage medium. The method includes: displaying object recommendation information for a target object when a preset object recommendation condition is met, wherein the object recommendation information includes information about candidate objects that are predicted to be the same object as the target object; upon obtaining an object selection instruction issued by a user based on the object recommendation information, merging the image of the candidate object indicated by the object selection instruction with the target image of the target object. In this way, the user does not need to find pictures of the same person in many albums and manually merge them. The user can merge the picture of the candidate object with the target image of the target object based on the object recommendation information, which can greatly improve the user experience and improve the efficiency of image processing.

Description

Technical Field

[0001] The present invention relates to the field of image processing technology, and in particular to an image processing method, device, electronic device and storage medium. Background Art

[0002] With the rapid development of intelligent technology, a large number of pictures are stored in the electronic devices currently used by people. For example, users store a large number of pictures in NAS (Network Attached Storage), mobile phones, computers and other devices.

[0003] When you need to view pictures of a certain person or certain people, it takes a lot of time to view a large number of pictures one by one to find the required pictures. Therefore, current smart devices provide the function of classifying pictures. Users can mark people and / or their relationships and generate corresponding photo albums of people.

[0004] However, in the above-mentioned method of classifying pictures, users are required to find pictures of the same person in numerous albums and manually merge them, which results in a very poor user experience. Summary of the Invention

[0005] The purpose of the embodiments of the present invention is to provide a method, device, electronic device, and storage medium for image processing to solve the problem of users having to manually find and merge images of the same person in numerous albums. The specific technical solution is as follows:

[0006] In a first aspect, an embodiment of the present invention provides a method for processing an image, the method comprising:

[0007] When a preset object recommendation condition is met, object recommendation information for the target object is displayed, wherein the object recommendation information includes information of candidate objects predicted to be the same object as the target object;

[0008] When an object selection instruction issued by the user based on the object recommendation information is obtained, the picture of the candidate object indicated by the object selection instruction is merged with the target picture of the target object.

[0009] In a second aspect, an embodiment of the present invention provides an image processing device, the device comprising:

[0010] A first recommendation information display module is configured to display object recommendation information for a target object when a preset object recommendation condition is met, wherein the object recommendation information includes information of candidate objects predicted to be the same object as the target object;

[0011] The first image merging module is configured to, upon receiving an object selection instruction issued by a user based on the object recommendation information, merge the image of the candidate object indicated by the object selection instruction with the target image of the target object.

[0012] In a third aspect, an embodiment of the present invention provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;

[0013] Memory for storing computer programs;

[0014] The processor is configured to implement the method steps described in the first aspect when executing the program stored in the memory.

[0015] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method steps described in the first aspect are implemented.

[0016] Beneficial effects of the embodiments of the present invention:

[0017] In the solution provided by the embodiment of the present invention, the electronic device can display object recommendation information for the target object when the preset object recommendation conditions are met, wherein the object recommendation information includes information of the predicted alternative objects that are the same object as the target object, and then when the object selection instruction issued by the user based on the object recommendation information is obtained, the picture of the alternative object indicated by the object selection instruction can be merged with the target picture of the target object. In this way, the user does not need to find pictures of the same person in many albums and merge them manually. The user can merge the picture of the alternative object with the target picture of the target object based on the object recommendation information, which can greatly improve the user experience and improve the efficiency of image processing. Of course, it is not necessary to achieve all the advantages described above at the same time when implementing any product or method of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other embodiments can also be obtained based on these drawings.

[0019] Figure 1 A flowchart of an image processing method provided by an embodiment of the present invention;

[0020] Figure 2 Based on Figure 1A schematic diagram of a floating-layer display interface for picture details in the illustrated embodiment;

[0021] Figure 3 Based on Figure 1 A schematic diagram of the photo album character portrait interface of the illustrated embodiment;

[0022] Figure 4 Based on Figure 1 A schematic diagram of the home page interface of the smart photo album program of the illustrated embodiment;

[0023] Figure 5 for Figure 1 A flow chart of step S101 in the illustrated embodiment;

[0024] Figure 6(a) is based on Figure 5 A schematic diagram of an object recommendation information display interface of the illustrated embodiment;

[0025] Figure 6(b) is based on Figure 5 A schematic diagram of a confirmation pop-up window in the illustrated embodiment;

[0026] FIG6( c ) is a schematic diagram of a display method of the avatar 2 in the interface shown in FIG6( b );

[0027] Figure 7(a) is based on Figure 5 Another schematic diagram of the object recommendation information display interface of the illustrated embodiment;

[0028] Figure 7(b) is based on Figure 5 A schematic diagram of a similar person list interface of the illustrated embodiment;

[0029] FIG7( c ) is a schematic diagram of a pop-up display interface based on the interface shown in FIG7( b );

[0030] Figure 8 Based on Figure 1 A flow chart of a similar person search method according to the illustrated embodiment;

[0031] Figure 9 Based on Figure 1 A schematic diagram of a relationship recommendation information display interface of the illustrated embodiment;

[0032] Figure 10 Based on Figure 9 A specific flow chart of the object relationship setting method of the illustrated embodiment;

[0033] Figure 11 A schematic diagram of a target image provided by an embodiment of the present invention;

[0034] Figure 12 Based on Figure 10Another schematic diagram of the relationship recommendation information display interface of the illustrated embodiment;

[0035] FIG13( a ) is another schematic diagram of a target image provided by an embodiment of the present invention;

[0036] FIG13( b ) is another schematic diagram of a target image provided by an embodiment of the present invention;

[0037] Figure 14 A schematic structural diagram of an image processing device provided by an embodiment of the present invention;

[0038] Figure 15 A schematic structural diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0039] The following will be combined with the accompanying drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field based on this application are within the scope of protection of the present invention.

[0040] To improve user experience by eliminating the need for users to manually merge pictures of the same person from multiple albums when classifying and organizing pictures, embodiments of the present invention provide a picture processing method, apparatus, electronic device, computer-readable storage medium, and computer program product. The following first introduces a picture processing method provided by an embodiment of the present invention.

[0041] An image processing method provided by an embodiment of the present invention can be applied to any electronic device that needs to classify and organize images, for example, a mobile phone, a computer, a tablet computer, etc., which is not specifically limited here. For the sake of clarity, it is referred to as an electronic device in the following.

[0042] like Figure 1 As shown, a picture processing method, the method comprising:

[0043] S101, displaying object recommendation information for a target object when a preset object recommendation condition is met;

[0044] The object recommendation information includes information about candidate objects that are predicted to be the same object as the target object.

[0045] S102: When an object selection instruction issued by the user based on the object recommendation information is obtained, the image of the candidate object indicated by the object selection instruction is merged with the target image of the target object.

[0046] It can be seen that in the solution provided by the embodiment of the present invention, the electronic device can display object recommendation information for the target object when the preset object recommendation conditions are met, wherein the object recommendation information includes information of the predicted alternative objects that are the same object as the target object, and then when the object selection instruction issued by the user based on the object recommendation information is obtained, the picture of the alternative object indicated by the object selection instruction can be merged with the target picture of the target object. In this way, the user does not need to find pictures of the same person in many albums and manually merge them. The user can merge the picture of the alternative object with the target picture of the target object based on the object recommendation information, which can greatly improve the user experience and improve the efficiency of image processing.

[0047] The user's smart device may store a large number of images in its photo album. To facilitate the user's classification and organization of the photo album, in step S101, if the preset object recommendation conditions are met, the electronic device may display object recommendation information for a target object. The target object is an object included in the image to be processed. The target object can be a person, or an animal, a building, a landscape, etc., which is reasonable.

[0048] The smart device can be a home sharing device that can store a large number of pictures, which can be imported from cameras, mobile phones, downloaded from the Internet, etc. Picture categories can be established for these pictures, for example, including albums, clips, etc., which are not specifically limited here.

[0049] As an implementation method, users can use NAS to store pictures. NAS can be connected to the network and has data storage capabilities, so it is also called "network storage." It is data-centric, completely separating storage devices from servers and centrally managing data, thereby freeing up bandwidth, improving performance, and reducing total cost of ownership. It is equivalent to a hard drive with huge capacity, which users do not need to carry with them. They can access various data in the NAS through mobile phones, computers and other electronic devices. Especially in a local area network, when transferring some large files, the transmission speed and efficiency will be higher than cloud storage space. For example, when a user accesses various data in the NAS through an electronic device, if the preset object recommendation conditions are met, the electronic device can display a corresponding interface, and display object recommendation information for the target object in the interface.

[0050] The above-mentioned preset object recommendation conditions represent that the current situation can recommend to the user pictures that can be merged with the target picture of the target object. For example, the target object is person A. When a newly stored picture that may be the same person as person A is detected, the electronic device can determine that the preset object recommendation conditions are met, and then, can display object recommendation information for the target object.

[0051] Among them, the object recommendation information may include information of alternative objects predicted to be the same object as the target object, such as thumbnail icons (or avatars), names, etc. used to represent the alternative objects. These object recommendation information supports the user's touch operation, and can trigger an operation instruction after the electronic device responds to the user's touch operation, or jump from the current display interface to a new interface, or superimpose a new interface on the current display interface. The number of alternative objects can be one or more, and is not specifically limited here. For example, if the target object is person A, and the preset object recommendation conditions are met, the electronic device can display object recommendation information for person A. The object recommendation information may include the avatar and name of the alternative person a predicted to be the same person as person A, prompt information for prompting the user to determine whether person A and the alternative person a are actually the same person, a merge button for triggering the merge operation of the picture of person A with the picture of the alternative person a, etc.

[0052] The user can determine whether a picture merging operation is required through the object recommendation information. When a picture merging operation is required, the user can issue an object selection instruction based on the object recommendation information. Then, in the above step S102, the electronic device can obtain the object selection instruction issued by the user based on the object recommendation information, and merge the picture of the alternative object indicated by the object selection instruction with the target picture of the target object.

[0053] If there are multiple alternative objects, the user can select one or more of them to issue an object selection instruction. For example, the user can click on the avatar of the alternative person in the object recommendation information, the above-mentioned merge button, etc. to issue an object selection instruction. The avatar of the alternative object displayed in the interface represents one or more pictures of the alternative object. The picture of the alternative object indicated by the object selection instruction can be a picture set of the alternative object displayed in response to the user's touch operation on the avatar of the alternative object, and then a picture determined according to the user's picture selection operation on the picture in the picture set; or it can be a picture set represented by the avatar of the alternative object as the picture of the alternative object indicated by the object selection instruction after responding to the user's touch operation on the avatar of the alternative object.

[0054] When the electronic device obtains an object selection instruction, it means that the user needs to merge the picture of the alternative object indicated by the object selection instruction with the target picture of the target object. Then the electronic device can merge the picture of the alternative object indicated by the object selection instruction with the target picture of the target object, thereby realizing the classification and organization of a large number of pictures.

[0055] For example, the target object is person A, and the NAS stores 100 target images of person A and 50 images of candidate person A. When the electronic device receives an object selection instruction for candidate person A, it can merge the 50 images of candidate person A with the 100 target images of person A, i.e., merge the 50 images of candidate person A and the 100 target images of person A into the same album corresponding to person A.

[0056] As an implementation method, in the solution provided by an embodiment of the present invention, when preset object recommendation conditions are met, the electronic device may display a recommendation information interface including object recommendation information for the target object. This recommendation information interface may include an avatar of the target object, avatars of candidate objects, prompt information prompting the user to determine whether the target object and the candidate objects are truly the same object, a merge button, and may also include a list of images of the target object. The user can view the avatar of the target object, the avatars of the candidate objects, and the prompt information to determine whether the target object and the candidate objects are truly the same object. If so, the user can click the merge button to issue an object selection instruction.

[0057] At this time, a picture merging interface may be displayed. This picture merging interface may be obtained by superimposing a merge confirmation pop-up window on the recommendation information interface. The merge confirmation pop-up window may be displayed at the top, middle, or bottom of the recommendation information interface. The user may click an "OK" button displayed in the merge confirmation pop-up window to trigger the picture merging operation, and then the electronic device may merge the picture of the candidate object with the target picture of the target object.

[0058] Of course, the user can also click the "Cancel" button displayed in the merge confirmation pop-up window to cancel the image merging operation. The merge confirmation pop-up window can also display the avatar of the target object and the avatar of the alternative object, as well as prompt information to prompt the user to determine whether the target object and the alternative object are actually the same object, so as to facilitate the user to determine whether to merge the image of the alternative object with the target image of the target object.

[0059] It can be seen that in the solution provided by the embodiment of the present invention, users do not need to find pictures of the same person in many albums and manually merge them. Users can merge pictures of alternative objects with target pictures of target objects based on object recommendation information, which can greatly improve user experience and improve image processing efficiency.

[0060] As an implementation of an embodiment of the present invention, before the step of displaying the object recommendation information for the target object, the method may further include:

[0061] Capture the triggering operation issued by the user to the avatar of the target object displayed in the interface to determine whether the preset object recommendation conditions are met.

[0062] To facilitate users in classifying and organizing pictures, electronic devices can display the avatar of the target object in the interface to facilitate users to trigger operations based on the avatar of the target object. For example, users can trigger operations on the avatar of the target object by clicking, long pressing, double-clicking, etc.

[0063] When the electronic device captures the trigger operation issued by the user for the avatar of the target object displayed in the interface, it means that the user wants to classify and organize the pictures. The electronic device can determine whether the preset object recommendation conditions are met, and then execute subsequent steps such as displaying object recommendation information for the target object.

[0064] As an implementation manner, the above step of capturing the trigger operation issued by the user to the avatar of the target object displayed in the interface may include at least the following three implementation manners:

[0065] In a first embodiment, when displaying a target image of a target object, a detail viewing instruction issued by a user for the target image is obtained; a picture detail floating layer is displayed, and a trigger operation issued by the user for the avatar of the target object is captured.

[0066] Users can view various pictures stored locally or in a storage device on an electronic device. Pictures are generally displayed in large-image mode. When the user wants to view the details of a target picture, he or she can issue a detail view instruction. That is, when displaying a target picture of a target object, the electronic device can obtain the detail view instruction issued by the user for the target picture. As an implementation method, the user can issue a detail view instruction by swiping up the interface, swiping down the interface, clicking a preset detail view button in the interface, etc.

[0067] After receiving the detail viewing instruction issued by the user, the electronic device can display a picture detail floating layer, which can display the avatars of each object included in the target picture. Of course, it can also include the name, size, storage path and other information of the target picture. This is all reasonable and is not specifically limited here.

[0068] In one embodiment, object recognition can be performed on the target image to determine the objects and corresponding positions therein, and then the image areas of the objects can be cut out from the corresponding positions in the target image as avatars of the objects and displayed in the image details floating layer.

[0069] For each object included in the stored image, some may have an object relationship established by the user, while others may not. An object relationship can be the relationship between the object and the user. For example, if the object is a person, the object relationship can include "myself," "parents," "sister," "brother," "child," "friend," "colleague," "close friend," "client," etc. If the object is an animal, the object relationship can include "my dog," "my cat," etc. When setting an object relationship, the user can also specify the object's name, etc., which is not specifically limited here.

[0070] The avatars of each object included in the image details overlay can be displayed with an object relationship tag to distinguish whether the object has an object relationship set up. By viewing the object relationship tag, the user can determine which objects have object relationships set up and which objects have not. In an optional embodiment, different tags can be displayed on the avatar of the target object for different object relationships.

[0071] For example, Figure 2 In the interface shown, a target image of a target object is displayed. The user can swipe up on the interface to issue a detailed view instruction. The electronic device can display an image details floating layer 201 at the bottom of the interface. Above the image details floating layer 201, the avatars of the various objects included in the target image are displayed. Among them, a question mark-shaped mark 202 can be displayed in the upper right corner of the avatar of an object without an object relationship, while the avatars of objects with an object relationship can be unmarked. The image details floating layer 201 can also include information such as the name, size, file path, and modification time of the target image.

[0072] The user can trigger an action on the target object's profile picture. The electronic device can capture the user's trigger action on the target object's profile picture to determine whether the preset target recommendation conditions are met. In one embodiment, the user can click the target object's profile picture to trigger the action. The target object can be an object with or without an established object relationship, and this is not specifically limited here.

[0073] like Figure 2 As shown, as an example, a schematic diagram of an image detail overlay is shown. For example, a user can click the fifth avatar in the image detail overlay to trigger an operation on a target object. The object corresponding to the fifth avatar is the target object, which is an object without an object relationship. For another example, a user can click the third avatar in the image detail overlay to trigger an operation on a target object. The object corresponding to the third avatar is the target object, which is an object with an object relationship. This is all reasonable.

[0074] In a second embodiment, when an avatar interface of an object included in a stored image is displayed, a trigger operation issued by a user for the avatar of the target object is obtained.

[0075] To facilitate users in knowing the various objects included in the stored pictures, the electronic device may provide an avatar interface for displaying the objects included in the stored pictures, for example, an album portrait interface, a portrait list interface, etc. The user may view this interface in a preset manner. For example, if the electronic device has a smart album program installed that allows users to view and manage pictures stored in the NAS, a "Album Portrait" button may be set on the homepage of the program. The user may click the "Album Portrait" button to enter an interface displaying the portraits corresponding to the objects included in the stored pictures.

[0076] In the case of displaying an avatar interface corresponding to an object included in a stored image, a user can issue a trigger operation on the avatar of the target object, and then the electronic device can obtain the trigger operation issued by the user on the avatar of the target object, thereby determining whether the preset object recommendation conditions are met. The avatar corresponding to the object displayed in the interface can also be displayed with an object relationship mark to distinguish whether the object has been set up with an object relationship. By viewing the object relationship mark, the user can determine which object or objects have been set up with an object relationship, and which objects or objects have not been set up with an object relationship. In an optional embodiment, different marks can be used to display on the avatar of the target object for different object relationships.

[0077] For example, Figure 3 The illustrated interface displays the avatars of objects included in stored images. This display interface can be called an album display interface. Avatars 301 of the objects included in the stored images are displayed at the top of the interface. A circular mark in the upper right corner of the object's avatar indicates that the object has an established object relationship. No mark in the upper right corner of the object's avatar indicates that the object has not established an object relationship. Below each object's avatar can display functional areas such as the shooting location of the stored image, my album, device, screenshots, etc., which are not specifically limited here.

[0078] Users can click Figure 3 The fourth avatar in the interface is used to trigger an operation on a target object. The object corresponding to the fourth avatar is the target object, which is an object without an object relationship. The user can also click the first avatar in the interface to trigger an operation on a target object. The object corresponding to the first avatar is the target object, which is an object with an object relationship. This is both reasonable.

[0079] In a third embodiment, when a similar picture including an object similar to the target object is detected, a trigger button including an avatar of the target object is displayed; and a trigger operation issued by the user for the trigger button is obtained.

[0080] The electronic device can make similar recommendations to the user when it detects similar pictures including an object similar to the target object. Specifically, the electronic device can display a trigger button including the avatar of the target object, and the user can issue a trigger operation based on the trigger button. The electronic device can then obtain the trigger operation issued by the user for the trigger button, thereby determining that the preset object recommendation conditions are met.

[0081] In one embodiment, in order to make it easy for users to notice the similar recommendations and facilitate user operations, a trigger button can be set on the homepage of the smart album program for viewing and managing pictures in the NAS. The trigger button can include an avatar of the target object to facilitate user viewing.

[0082] In the first case, the target object is an object with which an object relationship has been established. In this case, the objects included in the similar images may be objects without an object relationship. In other words, for a target object with which an object relationship has been established, the electronic device can detect whether there are similar images of objects that do not currently have an object relationship established with the target object. If so, a trigger button including the target object's portrait can be displayed.

[0083] For example, Figure 4 In the homepage of the smart album application shown, for a target object with which an object relationship has been established, if the electronic device detects that an image of an object not currently associated with the target object exists that is similar to the target object, a trigger button 402 with an image of the target object 401 may be included on the upper left side of the interface. The user can click on trigger button 402 to initiate a trigger operation, and the electronic device can then receive the trigger operation and determine whether the preset object recommendation conditions are met. Figure 4 The home page interface of the smart photo album program shown can also display functional areas such as the novice guide and the recent backup, which are not specifically limited or explained here.

[0084] In the second case, the target object is an object for which no object relationship has been established. In this case, the similar images include objects for which an object relationship has been established. In other words, for a target object for which no object relationship has been established, the electronic device can detect whether there are any similar images of objects for which an object relationship has been established that are similar to the target object. If so, a trigger button including the target object's portrait can be displayed.

[0085] It can be seen that in this embodiment, the electronic device can adopt at least any one of the above three methods to capture the trigger operation issued by the user for the avatar of the target object displayed in the interface, so as to determine that after the preset object recommendation conditions are met, the object recommendation information for the target object is displayed. A variety of triggering methods can be provided to trigger the display of object recommendation information, which facilitates the user to perform subsequent image merging processing based on the object recommendation information, thereby further improving the user experience.

[0086] As an implementation method of the embodiment of the present invention, Figure 5 As shown, the above step of displaying the object recommendation information for the target object may include:

[0087] S501, determining a preset number of candidate objects from the objects to be matched according to the similarity between the target object and the objects to be matched included in the stored image;

[0088] Since there may be a large number of stored images, the number of objects included in the stored images may also be large, some of which may be similar to the target object, while some may be dissimilar to the target object. Therefore, to improve the efficiency of image processing, the electronic device may determine a preset number of candidate objects from the objects to be matched based on the similarity between the target object and the objects to be matched included in the stored images. The objects to be matched are the objects included in the stored images.

[0089] In one case, the target object is an object with which an object relationship has been established, and the object to be matched may be an object without an object relationship. Since it is not necessary to set the object relationship again for an object with which an object relationship has been established, when the target object is an object with which an object relationship has been established, the electronic device may determine a preset number of candidate objects from stored images including objects with which an object relationship has not been established, based on the similarity between the target object and the object to be matched.

[0090] The candidate objects are objects to be matched that are predicted to be the same as the target object based on the corresponding similarity. For example, if the target object is a person, the candidate objects are people to be matched that are predicted to be the same as the person based on the corresponding similarity. The preset number can be set as needed, for example, 1, 3, 6, etc., and is not specifically limited here.

[0091] For example, the target object is character B with a set object relationship of "sister", and there are 80 stored pictures corresponding to the objects to be matched without a set object relationship. Then, the electronic device can determine a preset number of candidate objects from these objects to be matched based on the similarity between the object to be matched and character B in the 80 pictures. For example, 5 characters can be determined as candidate objects.

[0092] In another case, the target object is an object for which no object relationship has been established. In this case, the object to be matched may be an object for which an object relationship has been established. Since, for a target object for which no object relationship has been established, even if a similar object is found from other objects for which no object relationship has been established, the object relationship of the target object cannot be determined, for the case where the target object is an object for which no object relationship has been established, the electronic device can determine a preset number of candidate objects from stored images including objects for which an object relationship has been established, based on the similarity between the target object and the object to be matched.

[0093] For example, the target object is an unset person C, and there are 10 objects to be matched with set object relationships. Then, the electronic device can determine a preset number of candidate objects from these objects to be matched based on the similarity between the 10 objects to be matched and the person C. For example, one person can be determined as a candidate object.

[0094] S502: Display the candidate object information as object recommendation information.

[0095] After determining a preset number of candidate objects, the electronic device can display the candidate object information as object recommendation information. The candidate object information may include an avatar, name, prompt information, and a merge button, etc., which is not specifically limited here.

[0096] For example, the user can click Figure 2 The avatar in the picture details floating interface jumps to the object recommendation information display interface shown in Figure 6(a), or you can click Figure 3 The avatar in the album display interface shown in Figure 6(a) jumps to the object recommendation information display interface shown in Figure 6(a). You can also click Figure 4 The avatar in the homepage interface of the smart album program shown jumps to the object recommendation information display interface shown in Figure 6(a). In the object recommendation information display interface shown in Figure 6(a), the target object is person D with no object relationship set. The avatar 601 of person D can be displayed at the top of the interface, and the avatar 602 of the candidate object and the prompt message "Is this XXX?" can be displayed above it, where the candidate object is a person with an object relationship set that is predicted to be the same person as person D. "XXX" can be the name of the candidate object, and the prompt message is used to prompt the user to confirm whether the candidate person "XXX" is actually the same person as the target person. A "Merge Person" button can also be displayed on the right side of the prompt message.

[0097] The user can issue an object selection instruction by clicking the "Merge People" button or clicking the avatar of the candidate. After the electronic device receives the object selection instruction, it can display a confirmation pop-up window as shown in Figure 6(b) on the interface. The pop-up window can display the avatars of the target object and the candidate, namely avatar 1 and avatar 2, and can also display a prompt message "Are you sure you want to merge them into the same person?" as well as a "Cancel" button and an "OK" button. The user can click the "OK" button to confirm the image merging operation. At this time, the electronic device can merge the image of the candidate with the target image of the target object. If the user issues an object selection instruction indicating multiple candidate objects, the display of avatar 2 can be shown as shown in Figure 6(c), where the avatar data is consistent with the number of candidate objects indicated by the object selection instruction, for example, it can be 2, 3...6, etc., without specific limitation here. In other words, if there are multiple avatars of candidate objects, the avatars of multiple candidate objects can be displayed in a stacked manner.

[0098] For example, in the object recommendation information display interface shown in Figure 7(a), the target object is person E, with whom an object relationship has been established. Person E's avatar 701 can be displayed at the top of the interface, and above that, a candidate's avatar 702 can be displayed, along with the prompt "Is this XXX?" The candidate is a person who is predicted to be the same person as person D, but for whom an object relationship has not been established. "XXX" can be the name of the target object, and the prompt prompts the user to confirm whether the target person "XXX" and the candidate are actually the same person. A "Merge" button can also be displayed to the right of the prompt.

[0099] The user can issue an object selection instruction by clicking the "One-click Merge" button or clicking the avatar of the candidate object. After the electronic device obtains the object selection instruction, it can display an interface as shown in Figure 7(b). The list of candidate objects selected by the user can be displayed at the bottom of the interface. The list can display the avatars of the candidate objects selected by the user, the number of corresponding pictures, etc., and can also display a "One-click Merge" button. The user can click the "One-click Merge" button to confirm the picture merging operation. At this time, the electronic device can merge the picture of the candidate object with the target picture of the target object.

[0100] As can be seen, in this embodiment, the electronic device can determine a preset number of candidate objects from the to-be-matched objects based on the similarity between the target object and the to-be-matched objects included in the stored images, and then display information about the candidate objects as object recommendations. In this way, the electronic device can accurately determine the candidate objects that may be the same as the target object, making it easier for the user to select the candidate objects for the image merging operation, thereby improving the accuracy of the image merging and user experience.

[0101] As an implementation manner of an embodiment of the present invention, the step of determining a preset number of candidate objects from the objects to be matched based on the similarity corresponding to each object to be matched may include:

[0102] A preset number of objects with the highest corresponding similarities are determined from the objects to be matched as candidate objects.

[0103] Since the higher the highest corresponding similarity, the higher the probability that the candidate object is the same object as the target object, the electronic device can determine a preset number of objects with the highest corresponding similarity from the above-mentioned objects to be matched as candidate objects. For example, if the target object is an object without an object relationship, the electronic device can determine the corresponding object with the highest similarity from the above-mentioned objects to be matched as a candidate object. If the target object is an object with an object relationship set, the electronic device can determine the corresponding six objects with the highest similarity from the above-mentioned objects to be matched as candidate objects. This is all reasonable and is not specifically limited here.

[0104] It can be seen that in this embodiment, the electronic device can determine a preset number of objects with the highest corresponding similarity from the objects to be matched as candidate objects. In this way, the candidate objects that may be the same object as the target object can be determined more accurately, further improving the accuracy of subsequent image merging processing and user experience.

[0105] As an implementation method of an embodiment of the present invention, in some cases, the candidate objects included in the object recommendation information may not be the same as the target object. To facilitate the user in searching for objects similar to the target object, the electronic device may provide a similar object search portal. Specifically, the object recommendation information may further include a similar object search portal, that is, the object recommendation information display interface may further display a similar object search portal. The user may issue a similar object search instruction based on the similar object search portal.

[0106] In this case, if Figure 8 As shown, the above method may further include:

[0107] S801, when a similar object search instruction issued by a user based on the similar object search portal is obtained, determining whether there is an object similar to the target object among the objects to be matched included in the stored image, if so, executing step 802; if not, displaying a prompt message that no similar object is found;

[0108] When the electronic device receives a similar object search instruction issued by a user based on a similar object search portal, it can determine whether there is an object similar to the target object among the objects to be matched included in the stored image. In one embodiment, the electronic device can calculate the similarity between the objects to be matched included in the stored image and the target object, and then determine the objects to be matched whose corresponding similarity exceeds a preset threshold as objects similar to the target object.

[0109] In the case where the target object is an object with which an object relationship has been established, the aforementioned to-be-matched object may be an object without such an object relationship. In other words, when the target object is an object with which an object relationship has been established, upon receiving a similar object search instruction issued by the user based on a similar object search entry, the electronic device may determine whether there is an object similar to the target object among the to-be-matched objects in the stored image that do not have such an object relationship.

[0110] In the case where the target object is an object without an object relationship, the aforementioned to-be-matched object may be an object with an object relationship already established. That is, when the target object is an object without an object relationship already established, upon receiving a similar object search instruction issued by the user based on a similar object search entry, the electronic device may determine whether there is an object similar to the target object among the to-be-matched objects with an established object relationship in the stored image.

[0111] For example, in the object recommendation information display interface shown in FIG7(a), the target object is a person E with whom an object relationship has been established. A similar object search entry 703 may be displayed in the upper right corner of the interface. The user clicks on the similar object search entry 703 to issue a similar object search instruction. The electronic device can then determine whether there is an object similar to the target object among the objects to be matched with an established object relationship in the stored image.

[0112] As an implementation method, in order to avoid the impact of user misoperation, after the user clicks on the similar object search entry, as shown in Figure 7(c), a pop-up window can be superimposed and displayed below the object recommendation information display interface shown in Figure 7(a). The pop-up window displays a "Find Similar People" button and a "Cancel" button. If the user clicks the "Cancel" button, it means that the user's click on the similar object search entry is an error, and the electronic device does not search for objects similar to the target object. If the user clicks the "Find Similar People" button, it means that the user wants to find objects similar to the target object. In this case, the electronic device can determine whether there is an object similar to the target object among the objects to be matched in the stored image for which an object relationship has been set.

[0113] If there is an object similar to the target object among the objects to be matched in the stored picture, step 802 can be continued; if there is no object similar to the target object among the objects to be matched in the stored picture, the electronic device can display a prompt message that no similar object is found to inform the user that there is no object similar to the target object in the current stored picture.

[0114] S802, displaying a similar object list interface;

[0115] If there is an object similar to the target object among the objects to be matched in the stored pictures, a similar object list interface may be displayed, wherein the similar person list interface may include a picture merging entrance.

[0116] In one embodiment, the similar object list interface can be an interface as shown in Figure 7(b), and a list of avatars of objects similar to the target object can be displayed at the bottom of the interface. The avatar list can display the avatars of objects similar to the target object, the number of corresponding pictures, etc., and can also display a "one-click merge" button, that is, a picture merging entrance. In an optional embodiment, when displaying the similar object list interface, the object recommendation information display interface can be blurred or displayed with a blurred background. Of course, the similar object list interface can also be displayed in other superimposed forms, which is not specifically limited in the embodiments of the present application.

[0117] S803: When a picture merging instruction issued by the user based on the picture merging entrance is obtained, the picture of the object similar to the target object is merged with the target picture of the target object.

[0118] The user may issue a picture merging instruction based on the picture merging entry. When the electronic device obtains the picture merging instruction, it may merge the picture of an object similar to the target object with the target picture of the target object.

[0119] For example, with respect to the similar object list interface shown in FIG7(b), the user can click on the image merging entry, namely the “one-click merge” button, to issue an image merging instruction. At this time, the electronic device can merge the image of an object similar to the target object with the target image of the target object.

[0120] It can be seen that in this embodiment, the above-mentioned object recommendation information can also include a similar object search entry. In this case, when the electronic device obtains a similar object search instruction issued by the user based on the similar object search entry, it can determine whether there is an object similar to the target object among the objects to be matched included in the stored pictures. If so, the similar object list interface is displayed. Then, when the user obtains a picture merging instruction issued based on the picture merging entry in the similar object list interface, the picture of the object similar to the target object can be merged with the target picture of the target object. In this way, the user can actively issue a similar object search instruction, and the electronic device can search for objects similar to the target object among the objects to be matched included in the stored pictures, and then merge the pictures of the objects similar to the target object with the target picture of the target object based on the instruction issued by the user, which can further improve the user experience and the accuracy of picture merging.

[0121] As an implementation manner of the embodiment of the present invention, the above-mentioned object recommendation information may further include relationship recommendation information for the target object.

[0122] To facilitate users in setting object relationships between objects in an image, the electronic device may display relationship recommendation information for the target object in the object recommendation information. The relationship recommendation information may include predicted object relationships corresponding to the target object. Of course, the relationship recommendation information may also include prompt information, trigger buttons, etc., which are not specifically limited here.

[0123] For example, the target object is a person F with no object relationship set. By detecting the target image including the person F, it is determined that the person F and the person M may be in a mother-child relationship. The person M is a person with a set person relationship. Assuming that the object relationship of the person M is "myself", the electronic device can determine that for the person F, when displaying its object recommendation information, it can also display the relationship recommendation information for the person F, for example, Figure 9 As shown, the relationship recommendation information may include prompt information 901: "Is this your child?", and may also include an avatar 902 of person F, etc.

[0124] Accordingly, the above method may further include:

[0125] When a relationship setting instruction issued by the user based on the relationship recommendation information is obtained, the object relationship corresponding to the target object is set as the target relationship.

[0126] After viewing the relationship recommendation information, the user can issue a relationship setting instruction based on the relationship recommendation information. For example, the relationship setting instruction can be issued by clicking on an object relationship that can be included in the relationship recommendation information, a prompt message used to prompt the user that the target object may correspond to a certain object relationship, a trigger button, etc. For example, as shown in Figure 6(a), the user can issue a relationship setting instruction by clicking on the "Character Relationship" button 603. The electronic device can display the recommended object relationship at the preset object relationship display position, such as at the position corresponding to the "Character Relationship" button 603. That is, after the character relationship is set, the information displayed on the "Character Relationship" button 603 changes to display a specific object relationship.

[0127] When the electronic device receives a relationship setting instruction issued by the user based on the relationship recommendation information, it can set the object relationship corresponding to the target object as the target relationship. For example, continuing with the above example, the user can click prompt information 901 to issue a relationship setting instruction for person F. In this case, the electronic device can set the object relationship of person F to the target relationship, i.e., "child."

[0128] As can be seen, in this embodiment, the object recommendation information may also include relationship recommendation information for the target object. Furthermore, upon receiving a relationship setting instruction from the user based on the relationship recommendation information, the electronic device may set the object relationship corresponding to the target object as the target relationship. This allows for recommended object relationships to be made available to the user, making it easier for the user to set object relationships for objects that do not already have them set, without requiring the user to manually view images one by one to set object relationships. This significantly improves the user experience and the efficiency of object relationship setting.

[0129] As an implementation method of the embodiment of the present invention, Figure 10 As shown, when the relationship setting instruction issued by the user based on the relationship recommendation information is obtained, the step of setting the object relationship corresponding to the target object as the target relationship may include:

[0130] S1001, when an object relationship display instruction issued by a user based on a preset object relationship setting entry included in the relationship recommendation information is obtained, an object relationship setting interface is displayed;

[0131] S1002: When a relationship setting instruction issued by the user based on the object relationship setting interface is obtained, the object relationship corresponding to the target object is set as a target relationship.

[0132] As an embodiment, the method for determining the object relationship corresponding to the predicted target object included in the above-mentioned relationship recommendation information can be to predict the object relationship corresponding to the target object based on the target image of the target object, and then when the object relationship corresponding to the target object is predicted, the object relationship can be used as the predicted object relationship corresponding to the target object, so that when displaying the object recommendation information, the relationship recommendation information for the target object is displayed.

[0133] In one embodiment, for different objects appearing in a target image of a target object, the target image may be identified to determine the distance, posture, and auxiliary information between the objects to predict the object relationship between the objects, wherein the auxiliary information may include age, gender, etc. For example, Figure 11 In the target picture shown, for target object 1101 and object 1102, since the posture of object 1102 is hugging target object 1101, and the relationship between the age of object 1102 and the age of target object 1101 conforms to the age relationship of mother and child, it can be predicted that the relationship between object 1102 and target object 1101 is mother and child.

[0134] The relationship recommendation information may include a preset object relationship setting entry. Upon receiving an object relationship display instruction from a user based on the preset object relationship setting entry included in the relationship recommendation information, the electronic device may display an object relationship setting interface. To facilitate user setting of object relationships for target objects, an object relationship setting entry, i.e., a preset object relationship setting entry, may be pre-set. Thus, when the user needs to, the object relationship display instruction issued based on the preset object relationship setting entry can be displayed.

[0135] As an implementation method, object relationship setting entries can be pre-set in multiple interfaces of the smart album program for viewing and managing pictures stored in the NAS. This includes pre-setting an object relationship setting entry in the above-mentioned object recommendation information display interface. For example, in the object recommendation information display interface shown in Figure 6(a), a preset object relationship setting entry 603, i.e., a "character relationship" button, can be displayed on the right side of the avatar 601 of character D. The user clicks the "character relationship" button to issue an object relationship display instruction, and the electronic device can then display the object relationship setting interface. The object relationship setting interface can be a setting pop-up interface superimposed on the current display interface, or it can be a new interface switched from the current display interface. This embodiment of the present application does not specifically limit this.

[0136] Furthermore, when a relationship setting instruction issued by the user based on the object relationship setting interface is obtained, the object relationship corresponding to the target object can be set as the target relationship.

[0137] For example, the object relationship setting interface can be as follows Figure 12 The interface shown in the figure can display an area for adding relationships, which can include family, colleagues, friends, and other object relationships. The top of the interface can also display a character name input box and the avatar and name of the character with whom the object relationship has been set. The user can click on the object relationship to issue a relationship setting instruction, and then the electronic device can set the object relationship of the target object to the object relationship. For example, the user clicks Figure 12 In the interface shown, “Dad”, the electronic device can set the object relationship of the target object to “Dad”.

[0138] As can be seen, in this embodiment, when the electronic device receives an object relationship display instruction from the user based on a preset object relationship setting entry included in the relationship recommendation information, it can display the object relationship setting interface. Furthermore, when the electronic device receives a relationship setting instruction from the user based on the object relationship setting interface, it sets the object relationship corresponding to the target object as the target relationship. In this way, the object relationship setting interface can be provided to the user, allowing the user to set object relationships based on the object relationship setting interface, further improving the user experience.

[0139] As an implementation method of an embodiment of the present invention, the above-mentioned candidate object information may include an avatar of the target object, an avatar of the candidate object, and a merge button. To facilitate the user to confirm whether the candidate object and the target object are actually the same object, the candidate object information including the avatar of the target object, the avatar of the candidate object, and the merge button may be displayed in the object recommendation information display interface.

[0140] For example, in the object recommendation information display interface shown in Figure 6(a), the target object is person D. The avatar 601 of person D can be displayed at the top of the interface, and the avatar 602 of the alternative object and the prompt message "Is this XXX?" can be displayed above it. A "Merge characters" button can also be displayed on the right side of the prompt message.

[0141] In this case, when the object selection instruction issued by the user based on the object recommendation information is obtained, the step of merging the image of the candidate object indicated by the object selection instruction with the target image of the target object may include:

[0142] When the user obtains the avatar of the target object and the avatar of the candidate object and the trigger operation issued by the merge button, it is determined that the object selection instruction is obtained; the image of the candidate object indicated by the object selection instruction is merged with the target image of the target object.

[0143] By viewing the avatar of the target object and the avatar of the alternative object, the user can determine whether the alternative object and the target object are the real same object. Then, when it is determined that the alternative object and the target object are the real same object, the user can trigger the operation issued by the merge button, for example, clicking the merge button, long pressing the merge button, double-clicking the merge button, etc., which are all reasonable.

[0144] When a user triggers the merge button, it indicates that the user is confirming whether the candidate object and the target object are truly the same object and needs to merge the image of the candidate object with the target object's target image. The electronic device can then determine that an object selection instruction has been obtained. Furthermore, the image of the candidate object indicated by the object selection instruction can be merged with the target object's target image, thereby merging the images corresponding to the candidate object and the target object, which are truly the same object.

[0145] It can be seen that in this embodiment, the information of the above-mentioned alternative objects may include the avatar of the target object, the avatar of the alternative object, and the merge button. When the user obtains the avatar of the target object and the avatar of the alternative object, and the trigger operation issued for the merge button, the electronic device can determine that the object selection instruction is obtained, and then merge the picture of the alternative object indicated by the object selection instruction with the target picture of the target object. In this way, it is convenient for the user to accurately determine whether the alternative object and the target object are the same object by viewing the avatar of the target object and the avatar of the alternative object, and then when the user determines that the two are the same object, the picture of the alternative object indicated by the object selection instruction is merged with the target picture of the target object, thereby further improving the user experience.

[0146] As an implementation of an embodiment of the present invention, in the above embodiment, the method for determining whether the target object and other objects are similar may include at least one of the following, wherein the other objects include the above-mentioned objects to be matched, alternative objects, and other objects that need to be determined whether they are similar to the target object.

[0147] In the first method, the electronic device can extract image features corresponding to the target object in the target image, as well as image features corresponding to other objects in the image, calculate the similarity between the image features, and then determine that the two are similar when the similarity is higher than a preset similarity. The preset similarity can be 80%, 85%, 90%, etc., which is not specifically limited here.

[0148] In the second method, the electronic device can use relevant information (such as shooting time, shooting location, shooting scene or shooting background) between the target image and the images of other objects to determine whether the two are similar. For example, for the target image shown in Figure 13(a) and the images of other objects shown in Figure 13(b), due to factors such as the inclination or clarity of the characters' faces, it is impossible to determine whether Person 1 in the image shown in Figure 13(b) and Person 2 in the target image shown in Figure 13(a) are the same person based on the similarity between the image features.

[0149] However, since the picture shown in Figure 13(b) and the target picture have similar image backgrounds, and the quality of the picture shown in Figure 13(b) is relatively low due to the inclination or clarity of the character's face, then, at this time, it can be inferred that the picture shown in Figure 13(b) and the target picture are pictures of the same person in the same scene, and it can be predicted that the person 1 in the picture shown in Figure 13(b) and the person 2 in the target picture shown in Figure 13(a) are the same person.

[0150] A third method involves electronic devices determining similarity based on the age of the people in the image. Specifically, the changes between childhood and adolescence are significant, far greater than those seen in adults over a given period of time. For example, the change between a child aged one and three is far greater than the change seen in an adult over a three-year period. The same pattern holds true for older adults.

[0151] For this reason, images of children and the elderly can be affected by age variations, affecting the accuracy of strategies that determine similarity based on the similarity between image features. For example, for images of children, it is likely that images of children aged one month or older will not be recognized based on images of the child at one year old. Therefore, in this case, electronic devices can identify images of people of similar ages and then determine the relationship between their ages. This allows them to infer similar people even when the similarity is not high, and can display relationship recommendation information to the user. After obtaining user confirmation, indicating that the inference of similar people is accurate, the recognition center can be tilted toward older images in the subsequent similar person recognition process to improve the accuracy of similar person prediction.

[0152] It can be seen that in this embodiment, the electronic device can determine whether the target object is similar to other objects based on any of the above methods, and can select a suitable method according to different application scenarios, thereby improving the prediction accuracy of people similar to the target object.

[0153] In the solution provided by this embodiment, the electronic device can improve the scope of person recognition based on the relationships between images; by discovering connections between characters, it can infer the object relationships between characters; through these means, it can recommend alternative objects and / or object relationships to the user and provide convenient operations such as merging images and marking object relationships. This helps users more quickly organize images that actually represent the same person and mark the object relationships of the person, avoiding the need for users to select from multiple identified images and repeatedly fill in object relationships, providing users with positive feedback and higher operational efficiency.

[0154] Corresponding to the above-mentioned image processing method, an embodiment of the present invention further provides an image processing device. The following is an introduction to an image processing device provided by an embodiment of the present invention.

[0155] like Figure 14 As shown, a picture processing device, the device comprising:

[0156] The recommendation information display module 1410 is used to display object recommendation information for the target object when the preset object recommendation conditions are met;

[0157] The object recommendation information includes information about candidate objects that are predicted to be the same object as the target object.

[0158] The first picture merging module 1420 is configured to, upon receiving an object selection instruction issued by a user based on the object recommendation information, merge the picture of the candidate object indicated by the object selection instruction with the target picture of the target object.

[0159] It can be seen that in the solution provided by the embodiment of the present invention, the electronic device can display object recommendation information for the target object when the preset object recommendation conditions are met, wherein the object recommendation information includes information of the predicted alternative objects that are the same object as the target object, and then when the object selection instruction issued by the user based on the object recommendation information is obtained, the picture of the alternative object indicated by the object selection instruction can be merged with the target picture of the target object. In this way, the user does not need to find pictures of the same person in many albums and manually merge them. The user can merge the picture of the alternative object with the target picture of the target object based on the object recommendation information, which can greatly improve the user experience and improve the efficiency of image processing.

[0160] As an implementation manner of the embodiment of the present invention, the above-mentioned device may further include:

[0161] The recommendation condition determination module is used to capture the trigger operation issued by the user on the avatar of the target object displayed in the interface before displaying the object recommendation information for the target object, and determine whether the preset object recommendation condition is met.

[0162] As an implementation of an embodiment of the present invention, the recommendation condition determination module may include:

[0163] A recommendation condition determination unit is configured to, when displaying a target image of a target object, obtain a detail viewing instruction issued by a user for the target image; display a picture detail pop-up layer, and capture a trigger operation issued by the user for the avatar of the target object;

[0164] The picture details floating layer displays the avatars of the various objects included in the target picture.

[0165] Or, for obtaining a trigger operation issued by a user for the avatar of the target object when displaying the avatar interface of the object included in the stored image;

[0166] Or, it is used to display a trigger button including an avatar of the target object when a similar picture including an object similar to the target object is detected; and obtain a trigger operation issued by the user for the trigger button.

[0167] Among them, when the target object is an object with a set object relationship, the objects included in the similar pictures are objects without a set object relationship; when the target object is an object without a set object relationship, the objects included in the similar pictures are objects with a set object relationship.

[0168] As an implementation of an embodiment of the present invention, the recommendation information display module 1410 may include:

[0169] a candidate object determining unit, configured to determine a preset number of candidate objects from the objects to be matched according to the similarity between the target object and the objects to be matched included in the stored image;

[0170] When the target object is an object with an object relationship set, the object to be matched is an object without an object relationship set; when the target object is an object without an object relationship set, the object to be matched is an object with an object relationship set.

[0171] The recommendation information display unit is used to display the information of the candidate objects as object recommendation information.

[0172] As an implementation manner of an embodiment of the present invention, the candidate object determination unit may include:

[0173] The candidate object determination subunit is used to determine a preset number of objects with the highest corresponding similarities from the objects to be matched as candidate objects.

[0174] As an implementation method of an embodiment of the present invention, the object recommendation information may further include a similar object search entry; and the apparatus may further include:

[0175] a similar object search module configured to, upon receiving a similar object search instruction issued by a user based on the similar object search entry, determine whether there is an object similar to the target object among the objects to be matched included in the stored images;

[0176] When the target object is an object with an object relationship set, the object to be matched is an object without an object relationship set; when the target object is an object without an object relationship set, the object to be matched is an object with an object relationship set.

[0177] A similar object display module is used to display a similar object list interface if there are objects similar to the target object;

[0178] Among them, the similar person list interface includes a picture merging entrance.

[0179] The second image merging module is configured to merge images of objects similar to the target object with the target image of the target object when receiving an image merging instruction issued by the user based on the image merging entry.

[0180] As an implementation manner of an embodiment of the present invention, the above-mentioned object recommendation information may further include relationship recommendation information for the target object, wherein the relationship recommendation information includes the predicted object relationship corresponding to the target object;

[0181] The above device may further include:

[0182] The object relationship setting module is configured to set the object relationship corresponding to the target object as the target relationship when a relationship setting instruction issued by the user based on the relationship recommendation information is obtained.

[0183] As an implementation method of an embodiment of the present invention, the object relationship setting module includes:

[0184] A setting interface display unit, configured to display an object relationship setting interface upon receiving an object relationship display instruction issued by a user based on a preset object relationship setting entry included in the relationship recommendation information;

[0185] The object relationship setting unit is configured to set the object relationship corresponding to the target object as a target relationship when a relationship setting instruction issued by the user based on the object relationship setting interface is acquired.

[0186] As an implementation manner of an embodiment of the present invention, the information of the candidate objects may include an avatar of the target object, an avatar of the candidate objects, and a merge button;

[0187] The first image merging module 1420 may include:

[0188] a trigger operation acquiring unit, configured to acquire, upon acquiring a trigger operation issued by a user based on the avatar of the target object and the avatar of the candidate object for the merge button, determine that an object selection instruction is acquired;

[0189] The picture merging unit is configured to merge the picture of the candidate object indicated by the object selection instruction with the target picture of the target object.

[0190] The embodiment of the present invention further provides an electronic device, such as Figure 15 As shown, it includes a processor 1501, a communication interface 1502, a memory 1503 and a communication bus 1504, wherein the processor 1501, the communication interface 1502, and the memory 1503 communicate with each other through the communication bus 1504.

[0191] Memory 1503, used for storing computer programs;

[0192] The processor 1501 is configured to implement the steps of the image processing method described in any of the above embodiments when executing the program stored in the memory 1503 .

[0193] It can be seen that in the solution provided by the embodiment of the present invention, the electronic device can display object recommendation information for the target object when the preset object recommendation conditions are met, wherein the object recommendation information includes information of the predicted alternative objects that are the same object as the target object, and then when the object selection instruction issued by the user based on the object recommendation information is obtained, the picture of the alternative object indicated by the object selection instruction can be merged with the target picture of the target object. In this way, the user does not need to find pictures of the same person in many albums and manually merge them. The user can merge the picture of the alternative object with the target picture of the target object based on the object recommendation information, which can greatly improve the user experience and improve the efficiency of image processing.

[0194] The communication bus mentioned in the electronic device mentioned above may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. This communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is used in the figure, but this does not mean that there is only one bus or only one type of bus.

[0195] The communication interface is used for communication between the above electronic device and other devices.

[0196] The memory may include random access memory (RAM) or non-volatile memory (NVM), such as at least one disk storage. Alternatively, the memory may be at least one storage device located away from the processor.

[0197] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, and discrete hardware components.

[0198] In another embodiment of the present invention, a computer-readable storage medium is provided, which stores a computer program. When the computer program is executed by a processor, the steps of the image processing method described in any of the above embodiments are implemented.

[0199] In another embodiment of the present invention, a computer program product including instructions is provided. When the computer program product is run on a computer, the computer executes the image processing method described in any one of the above embodiments.

[0200] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).

[0201] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply the existence of any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0202] Each embodiment in this specification is described in a related manner. Similar portions between embodiments can be referenced to each other. Each embodiment focuses on the differences between other embodiments. In particular, the device, electronic device, computer-readable storage medium, and computer program product embodiments are generally similar to the method embodiments, so their descriptions are relatively simple. For related portions, reference can be made to the descriptions of the method embodiments.

[0203] The above description is only a preferred embodiment of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention are included in the scope of protection of the present invention.

Claims

1. A method for image processing, characterized in that: The method comprises: When a preset object recommendation condition is met, object recommendation information for the target object is displayed, wherein the object recommendation information includes profile pictures of candidate objects predicted to be the same object as the target object; a profile picture of a candidate object represents a picture set including multiple pictures of the candidate object; When an object selection instruction issued by the user based on the object recommendation information is obtained, the picture of the candidate object indicated by the object selection instruction is merged with the target picture of the target object; wherein the picture of the candidate object indicated by the object selection instruction is a picture set represented by the avatar of the candidate object; Before the step of displaying the object recommendation information for the target object, the method further includes: Capturing the user's triggering action on the target object's avatar displayed in the interface to determine whether the preset object recommendation conditions are met; The step of capturing a trigger operation issued by a user to an avatar of a target object displayed in the interface includes: In the case of displaying an avatar interface of an object included in a stored image, obtaining a trigger operation issued by a user for the avatar of the target object; or When a similar picture including an object similar to the target object is detected, a trigger button including an avatar of the target object is displayed; and a trigger operation issued by a user on the trigger button is obtained, wherein, when the target object is an object with which an object relationship is set, the object included in the similar picture is an object without which an object relationship is set; and when the target object is an object without which an object relationship is set, the object included in the similar picture is an object with which an object relationship is set; The object recommendation information further includes relationship recommendation information for the target object, wherein the relationship recommendation information includes the predicted object relationship corresponding to the target object; The method further comprises: When a relationship setting instruction issued by the user based on the relationship recommendation information is obtained, the object relationship corresponding to the target object is set as the target relationship; Determine whether an object is similar to the target object based on the following: When it is determined that it is impossible to determine whether the object is similar to the target object based on the similarity between image features based on the inclination or clarity of the person's face, if the picture including the object has a similar image background to the target picture, it is determined that the object is similar to the target object.

2. The method according to claim 1, characterized in that The step of displaying object recommendation information for the target object includes: Determine a preset number of candidate objects from the objects to be matched based on the similarity between the target object and the objects to be matched included in the stored image, wherein when the target object is an object with which an object relationship has been set, the objects to be matched are objects without which an object relationship has not been set; when the target object is an object without which an object relationship has not been set, the objects to be matched are objects with which an object relationship has been set; The information of the candidate objects is displayed as object recommendation information.

3. The method according to claim 2, characterized in that The step of determining a preset number of candidate objects from the objects to be matched according to the similarity corresponding to each object to be matched includes: A preset number of objects with the highest corresponding similarities are determined from the objects to be matched as candidate objects.

4. The method according to claim 1, wherein The object recommendation information also includes a similar object search entry; the method further includes: When a similar object search instruction issued by a user based on the similar object search entry is obtained, determining whether there is an object similar to the target object among the objects to be matched included in the stored image, wherein when the target object is an object with an object relationship set, the object to be matched is an object without an object relationship set; when the target object is an object with no object relationship set, the object to be matched is an object with an object relationship set; If so, display a similar object list interface, wherein the similar object list interface includes a picture merging entrance; When the picture merging instruction issued by the user based on the picture merging entrance is obtained, the picture of the object similar to the target object is merged with the target picture of the target object.

5. The method according to claim 1, wherein The step of setting the object relationship corresponding to the target object as the target relationship when the relationship setting instruction issued by the user based on the relationship recommendation information is obtained includes: When an object relationship display instruction issued by a user based on a preset object relationship setting entry included in the relationship recommendation information is obtained, an object relationship setting interface is displayed; When a relationship setting instruction issued by the user based on the object relationship setting interface is obtained, the object relationship corresponding to the target object is set as the target relationship.

6. The method according to any one of claims 1 to 4, characterized in that The candidate object information includes the target object's avatar, the candidate object's avatar, and a merge button; The step of merging the image of the candidate object indicated by the object selection instruction with the target image of the target object when the object selection instruction issued by the user based on the object recommendation information is obtained includes: When a trigger operation issued by the user based on the avatar of the target object and the avatar of the candidate object for the merge button is obtained, determining that an object selection instruction is obtained; The picture of the candidate object indicated by the object selection instruction is merged with the target picture of the target object.

7. A picture processing device, characterized in that: The device comprises: A recommendation information display module is configured to display object recommendation information for a target object when preset object recommendation conditions are met, wherein the object recommendation information includes profile pictures of candidate objects predicted to be the same object as the target object; a profile picture of a candidate object represents a picture set including multiple pictures of the candidate object; a first image merging module configured to, upon receiving an object selection instruction issued by a user based on the object recommendation information, merge the image of the candidate object indicated by the object selection instruction with the target image of the target object; wherein the image of the candidate object indicated by the object selection instruction is a set of images represented by the avatar of the candidate object; The device further comprises: a recommendation condition determination module, configured to capture a trigger operation issued by a user on an avatar of a target object displayed in the interface before displaying the object recommendation information for the target object, and determine whether a preset object recommendation condition is satisfied; The recommendation condition determination module includes: a recommendation condition determination unit, configured to obtain a trigger operation issued by a user for the target object's avatar when displaying the avatar interface of the object included in the stored image; or for displaying a trigger button including an avatar of the target object when a similar picture including an object similar to the target object is detected; obtaining a trigger operation issued by a user on the trigger button, wherein, when the target object is an object with which an object relationship is set, the objects included in the similar picture are objects without which an object relationship is set; and when the target object is an object without which an object relationship is set, the objects included in the similar picture are objects with which an object relationship is set; The object recommendation information further includes relationship recommendation information for the target object, wherein the relationship recommendation information includes the predicted object relationship corresponding to the target object; The device further comprises: an object relationship setting module, configured to set the object relationship corresponding to the target object as a target relationship upon obtaining a relationship setting instruction issued by the user based on the relationship recommendation information; Determine whether an object is similar to the target object based on the following: When it is determined that it is impossible to determine whether the object is similar to the target object based on the similarity between image features based on the inclination or clarity of the person's face, if the picture including the object has a similar image background to the target picture, it is determined that the object is similar to the target object.

8. The device according to claim 7, characterized in that The recommendation information display module includes: a candidate object determination unit, configured to determine a preset number of candidate objects from the objects to be matched based on the similarity between the target object and the objects to be matched included in the stored image, wherein when the target object is an object with which an object relationship has been set, the objects to be matched are objects without which an object relationship has not been set; and when the target object is an object with which an object relationship has not been set, the objects to be matched are objects with which an object relationship has been set; The recommendation information display unit is used to display the information of the candidate objects as object recommendation information.

9. The device according to claim 8, characterized in that The candidate object determination unit includes: The candidate object determination subunit is used to determine a preset number of objects with the highest corresponding similarities from the objects to be matched as candidate objects.

10. The device according to claim 7, characterized in that The object recommendation information also includes a similar object search entry; the device also includes: a similar object search module, configured to, upon receiving a similar object search instruction issued by a user based on the similar object search portal, determine whether there is an object similar to the target object among the objects to be matched included in the stored image, wherein when the target object is an object with an object relationship set, the object to be matched is an object without an object relationship set; and when the target object is an object with no object relationship set, the object to be matched is an object with an object relationship set; A similar object display module, configured to display a similar object list interface if there are objects similar to the target object, wherein the similar object list interface includes an image merging entrance; The second image merging module is configured to merge images of objects similar to the target object with the target image of the target object when receiving an image merging instruction issued by the user based on the image merging entry.

11. The device according to claim 10, characterized in that The object relationship setting module includes: A setting interface display unit, configured to display an object relationship setting interface upon receiving an object relationship display instruction issued by a user based on a preset object relationship setting entry included in the relationship recommendation information; The object relationship setting unit is configured to set the object relationship corresponding to the target object as a target relationship when a relationship setting instruction issued by the user based on the object relationship setting interface is acquired.

12. The device according to any one of claims 7 to 10, characterized in that: The candidate object information includes the target object's avatar, the candidate object's avatar, and a merge button; The first picture merging module includes: a trigger operation acquiring unit, configured to acquire, upon acquiring a trigger operation issued by a user based on the avatar of the target object and the avatar of the candidate object for the merge button, determine that an object selection instruction is acquired; The picture merging unit is configured to merge the picture of the candidate object indicated by the object selection instruction with the target picture of the target object.

13. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; Memory for storing computer programs; A processor, configured to implement the method steps described in any one of claims 1 to 6 when executing a program stored in a memory.

14. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method steps of any one of claims 1 to 6 are implemented.

Images