Image editing method and image editing device

By acquiring and sharing the information of the image set in group shooting, all subjects are allowed to select the most satisfactory image in the image set and replace the target face area in the image to be edited, the problem of expression satisfaction in group shooting is solved, and efficient image editing and personal satisfaction are achieved.

CN113538542BActive Publication Date: 2025-06-24VIVO MOBILE COMM HANGZHOU CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110823829.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-07-21
Publication Date
2025-06-24
Estimated Expiration
2041-07-21

AI Technical Summary

Technical Problem

When taking group photos, it is not possible to ensure that the faces and expressions of all the photographed persons are satisfactory to each photographed person, and subsequent individual photo editing cannot fully meet the personal wishes of the photographed person.

Method used

By obtaining information about the image to be edited and the image set associated therewith, it is sent to the second electronic device, allowing all subjects to select the most satisfactory image in the image set and replace the target face area related to themselves in the image to be edited.

Benefits of technology

It realizes that every person being photographed can have their own satisfactory facial expressions, and reduces the workload of photo editing and improves the efficiency and satisfaction of image editing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113538542B_ABST
    Figure CN113538542B_ABST
Patent Text Reader

Abstract

An embodiment of the present application provides an image editing method and an image editing device, belonging to the technical field of image processing. Among them, the image editing method includes: obtaining an image to be edited and an image set associated with the image to be edited; obtaining first information of the image to be edited and the image set associated with the image to be edited; and sending the first information to a second electronic device for the second electronic device to edit a target face area of the image to be edited according to the image set.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of image editing technology. Specifically, it relates to an image editing method and an image editing device. Background Art

[0002] In related technologies, group photo taking mainly includes the following three steps: 1. All the members to be photographed pose, and the photographer takes multiple group photos; 2. The photographer selects a better one from the multiple photos and synchronizes it to all the members to be photographed as the group photo. However, when there are many people to be photographed, it is impossible to ensure that the facial expressions of all the people to be photographed reach a state that satisfies each person to be photographed, such as closed eyes, open mouths, etc. In addition, even if individual retouching is performed on each person to be photographed later, it is impossible to ensure full compliance with the personal wishes of the person to be photographed. Summary of the Invention

[0003] Embodiments of this application provide an image editing method and an image editing device, which can enable the person to be photographed to perform editing processing on the face area of the image to be edited through the best frame image in multiple images or a video segment, so that each person to be photographed on the target image has a satisfactory facial expression.

[0004] In a first aspect, embodiments of this application provide an image editing method for a first electronic device, including:

[0005] Obtain an image to be edited and an image set associated with the image to be edited;

[0006] Obtain first information of the image to be edited and the image set associated with the image to be edited;

[0007] Send the first information to a second electronic device for the second electronic device to edit the target face area of the image to be edited according to the image set.

[0008] In a second aspect, embodiments of this application provide an image editing method for a second electronic device, including:

[0009] Obtain the first information;

[0010] According to the first information, display the image to be edited and the image set associated with the image to be edited, where the image to be edited includes a target face area;

[0011] Receive a fourth input to the image set;

[0012] In response to the fourth input, edit the target face area according to the image set to generate a target image.

[0013] In a third aspect, embodiments of this application provide an image editing device for a first electronic device, including:

[0014] An acquisition module, configured to acquire an image to be edited and an image set associated with the image to be edited; and

[0015] Acquire first information of the image to be edited and the image set associated with the image to be edited;

[0016] A communication module, configured to send the first information to a second electronic device for the second electronic device to edit a target face region of the image to be edited according to the image set.

[0017] In a fourth aspect, an image editing apparatus for a second electronic device provided by an embodiment of the present application includes:

[0018] An acquisition module, configured to acquire the first information;

[0019] A display module, configured to display the image to be edited and the image set associated with the image to be edited according to the first information, where the image to be edited includes a target face region;

[0020] A receiving module, configured to receive a fourth input to the image set;

[0021] An editing module, configured to edit the target face region according to the image set in response to the fourth input.

[0022] In a fifth aspect, an electronic device provided by an embodiment of the present application includes a processor, a memory, and a program or instruction stored on the memory and running on the processor. When the program or instruction is executed by the processor, the steps of the image editing method provided in the first aspect and / or the second aspect are implemented.

[0023] In a sixth aspect, a read storage medium provided by an embodiment of the present application stores a program or instruction. When the program or instruction is executed by a processor, the steps of the image editing method provided in the first aspect and / or the second aspect are implemented.

[0024] In a seventh aspect, a chip provided by an embodiment of the present application includes a processor and a communication interface. The communication interface is coupled to the processor, and the processor is configured to run a program or instruction to implement the steps of the image editing method provided in the first aspect and / or the second aspect.

[0025] In an embodiment of the present application, the image editing method includes: obtaining an image to be edited and an image set associated with the image to be edited; obtaining first information of the image to be edited and the image set associated with the image to be edited; sending the first information to a second electronic device for the second electronic device to edit a target face area of the image to be edited according to the image set. Thus, the image to be edited and the image set obtained during continuous shooting are sent to the second electronic devices of all the photographed persons who need to process the image to be edited in the form of the first information, so that all the photographed persons can select a more satisfactory image from the image set and use the image to replace the target face area related to themselves in the image to be edited, thereby enabling the edited target image to meet the requirements of all the photographed persons for face shooting and reducing the workload of image retouching at the same time. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 FIG. 1 shows one of the flowcharts of an image editing method according to an embodiment of the first aspect of the present application;

[0027] Figure 2 FIG. 2 shows another flowchart of an image editing method according to an embodiment of the first aspect of the present application;

[0028] Figure 3 FIG. 3 shows yet another flowchart of an image editing method according to an embodiment of the first aspect of the present application;

[0029] Figure 4 FIG. 4 shows still another flowchart of an image editing method according to an embodiment of the first aspect of the present application;

[0030] Figure 5 FIG. 5 shows yet another flowchart of an image editing method according to an embodiment of the first aspect of the present application;

[0031] Figure 6 FIG. 6 shows one of the flowcharts of an image editing method according to an embodiment of the second aspect of the present application;

[0032] Figure 7 FIG. 7 shows another flowchart of an image editing method according to an embodiment of the second aspect of the present application;

[0033] Figure 8 FIG. 8 shows yet another flowchart of an image editing method according to an embodiment of the second aspect of the present application;

[0034] Figure 9 FIG. 9 shows still another flowchart of an image editing method according to an embodiment of the second aspect of the present application;

[0035] Figure 10 FIG. 10 shows yet another flowchart of an image editing method according to an embodiment of the second aspect of the present application;

[0036] Figure 11 Shows the sixth flowchart of the image editing method according to an embodiment of the second aspect of the present application;

[0037] Figure 12 Shows one of the schematic diagrams of the electronic device display according to an embodiment of the present application;

[0038] Figure 13 Shows the second schematic diagram of the electronic device display according to an embodiment of the present application;

[0039] Figure 14 Shows the third schematic diagram of the electronic device display according to an embodiment of the present application;

[0040] Figure 15 Shows the fourth schematic diagram of the electronic device display according to an embodiment of the present application;

[0041] Figure 16 Shows the fifth schematic diagram of the electronic device display according to an embodiment of the present application;

[0042] Figure 17 Shows the structural block diagram of the image editing device according to an embodiment of the third aspect of the present application;

[0043] Figure 18 Shows the structural block diagram of the image editing device according to an embodiment of the fourth aspect of the present application;

[0044] Figure 19 Shows the structural block diagram of the electronic device according to an embodiment of the present application;

[0045] Figure 20 Shows the hardware structural block diagram of the electronic device according to an embodiment of the present application. Detailed implementation manners

[0046] Next, the technical solutions in the embodiments of the present application will be clearly described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope protected by the present application.

[0047] The terms "first", "second", etc. in the description and claims of this application are used to distinguish similar objects, rather than to describe a specific order or sequence. It should be understood that such data used can be interchanged under appropriate circumstances, so that the embodiments of this application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of the same category, and the number of objects is not limited. For example, the first object can be one or multiple. In addition, "and / or" in the description and claims means at least one of the connected objects, and the character " / ", generally represents an "or" relationship between the associated objects before and after.

[0048] The following refers to Figures 1 to 20 Describe an image editing method and an image editing device according to some embodiments of this application.

[0049] In an embodiment of this application, Figure 1 One of the flowcharts of the image editing method according to the first aspect embodiment of this application is shown, including:

[0050] Step 102, obtain an image to be edited and an image set associated with the image to be edited;

[0051] Step 104, obtain first information of the image to be edited and the image set associated with the image to be edited;

[0052] Wherein, the first information is an entry for an editing interface including the image to be edited and the image set. The first information can be an information transmission carrier such as a link or a QR code, and the first information can be obtained by uploading the image to be edited and the image set to the server. For example, when the photographer clicks to finish shooting, the image to be edited and the image set associated with the image to be edited are obtained, and the image to be edited and the image set are uploaded to the server, and the server automatically generates a link. The photographer can send the link address to all the photographed persons, and the photographed persons can enter the collaborative editing interface through the link address. The target face area of the image to be edited in the editing interface can be modified by the photographed persons.

[0053] Step 106, send the first information to a second electronic device.

[0054] Wherein, the second electronic device is an electronic device of a user related to the image to be edited. For example, it is an electronic device of the photographed person in the image to be edited or someone authorized by the photographed person.

[0055] In this embodiment, the first electronic device can send the to-be-edited image and the image set obtained during continuous shooting to the second electronic devices of all the photographed persons who need to process the to-be-edited image in the form of the first information, so that all the photographed persons can select a relatively satisfactory image from the image set and use this image to replace the target face area related to themselves in the to-be-edited image. Furthermore, face recognition and collaborative editing are applied to image processing, giving each photographed person the autonomy to choose their personal expression, enabling the edited target image to meet the needs of all photographed persons for face shooting, and at the same time reducing the workload of users for image retouching.

[0056] Among them, this image editing method is applicable to the first electronic device, that is, the electronic device of the photographer. The first electronic device includes but is not limited to mobile terminals, tablet computers, computers, laptop computers, wearable devices, intelligent cameras, etc.

[0057] It can be understood that when the photographed persons include the photographer, the first electronic device is the second electronic device, and in this case, the step of sending the first information is not required.

[0058] In an embodiment of the present application, as Figure 2 shown, step 102, obtaining the to-be-edited image and the image set associated with the to-be-edited image, includes:

[0059] Step 202, receiving a first input to the first electronic device;

[0060] Among them, the first input includes but is not limited to click input, key input, fingerprint input, swipe input, press input. The key input includes but is not limited to single-click input, double-click input, long-press input, combined key input, etc. of the power key, volume key, and main menu key of the electronic device. Of course, the first input can also be other operations of the user on the first electronic device. The embodiments of the present application do not specifically limit the operation method, and it is any implemented method.

[0061] Step 204, in response to the first input, photographing the photographed object to generate an image file;

[0062] Among them, the image file includes an image or a video, and both the image and the video include multiple face areas in the preview screen during image shooting.

[0063] It should be noted that, in order to ensure that the image set has sufficient images to support user selection and that each image in the image set has high quality. When photographing the subject, if it is in the image shooting mode, multiple pictures need to be taken continuously and quickly. For example, the shooting time span is set to 2s. If it is in the video shooting mode, try to keep a stable video recording as much as possible and avoid too short shooting duration. Moreover, during this process, the subject's body should be kept as still as possible to ensure that the person and the background after the adjustment of the final target face area are not misaligned, and the expression should present the most satisfactory side of the individual as much as possible.

[0064] Step 206, determine the image to be edited and the image set associated with the image to be edited according to the image file.

[0065] In this embodiment, the first input is used to control the first electronic device to photograph the subject and generate an image file. The image to be edited, which serves as the basis for editing, is selected from the image file. That is, all subjects who receive the first information are edited in the same image to be edited, thus avoiding the problem of ineffective modification caused by multiple people modifying different images. At the same time, the other images in the image file except the image to be edited are used as the image set, so that the people who receive the first information can use the image set as a reference sample for editing the image, in order to select the most satisfactory face area of the subject, and then modify the target face area in the image to be edited, so that the edited target image can meet the requirements of all subjects for face shooting.

[0066] In an embodiment of the present application, as Figure 3 shown, step 206, determine the image to be edited and the image set associated with the image to be edited according to the image file, including:

[0067] Step 302, process the image file to determine multiple images;

[0068] In this embodiment, if the image file is multiple images, preprocessing such as denoising and brightening is uniformly performed on the multiple images to obtain the processed multiple images. If the image file is a video, first parse the video, use each frame in the video as an image, and then uniformly perform preprocessing on the multiple images to obtain the processed multiple images, so as to ensure the image quality.

[0069] Step 304, send the multiple images to the third electronic device;

[0070] Step 306, in the case of receiving the second information fed back by the third electronic device, use the image corresponding to the second information as the image to be edited, and use the images in the multiple images except the image to be edited as the image set associated with the image to be edited.

[0071] In this embodiment, multiple images are sent to a third electronic device so that the user corresponding to the third electronic device can select an image to be edited as the basis for collaborative editing from the multiple images captured by the first electronic device. After the third electronic device selects the image to be edited, the second information transmitted to the first electronic device is used to indicate that the third electronic device has selected the image to be edited. When the first electronic device receives the second information, the image corresponding to the second information is used as the image to be edited, and the images other than the image to be edited in the multiple images are used as the image set associated with the image to be edited. This facilitates all users (the photographed persons) of the second electronic devices to select a more satisfactory image from the image set and use the image to replace the target face area related to themselves in the image to be edited, so that each photographed person in the edited target image has a satisfactory expression.

[0072] Among them, the third electronic device serves as the management end of image editing and has the highest authority for image editing management. Regardless of whether all photographed persons perform image editing, the third electronic device can export the target image at any time. The third electronic device can be the first electronic device, or the second electronic device, or a server or a third-party electronic device, which can be set as required. For example, when class students take graduation photos, the first electronic device is the intelligent camera of the photographer, the second electronic devices are the computers or mobile phones of the students, and the third electronic device is the computer of the head teacher.

[0073] It can be understood that when the third electronic device is the first electronic device, that is, when the electronic device of the photographer is used as the management end, in this case, the step of sending multiple images to the third electronic device can be omitted, and the photographer can directly determine the image to be edited from the multiple images through the selection operation on the second electronic device.

[0074] In an embodiment of the present application, as Figure 4 shown, before step 206 of determining the image to be edited and the image set according to the video file, it further includes:

[0075] Step 402, during the shooting process of the video file, display the shooting interface;

[0076] Among them, the shooting interface is used to display the preview screen, and the preview screen is the screen that appears on the screen of the second electronic device when the camera function is turned on for shooting. For example, when the front camera of the mobile phone is turned on, the screen that appears on the mobile phone screen is the preview screen.

[0077] Specifically, for example, as Figure 12As shown, during the shooting process, a shooting interface is displayed on the device. The shooting interface includes a preview screen 110 and a shooting button 120. The camera can be triggered to start shooting through the shooting button 120. At the same time, the shooting progress is displayed at the lower left corner of the shooting interface 100 and on the shooting button 120, enabling the shooter to know the shooting progress for subsequent shooting operations.

[0078] Step 404, receive a second input to the shooting interface;

[0079] Step 406, in response to the second input, obtain the number of face regions in the preview screen;

[0080] Step 408, perform face recognition on the preview screen according to the number of face regions to determine multiple face regions in the preview screen.

[0081] In this embodiment, by combining the number of face regions input by the user (shooter) of the first electronic device and face recognition technology, multiple face regions in the preview screen are framed. On the one hand, after shooting is completed, it is convenient to make the generated image file have editable face regions. On the other hand, while meeting the shooter's personalized needs for face regions, it avoids the recognition errors caused by single use of face recognition and effectively reduces the error rate of face region recognition.

[0082] It can be understood that face recognition is a series of related technologies for automatically detecting and tracking human faces in an image or video stream containing human faces collected by a camera, and then performing face-related operations on the detected human faces. It is usually also called portrait recognition or facial recognition. The specific method of face recognition in the embodiments of this application is not limited.

[0083] Among them, a face region can be the smallest image frame that can contain a human face, or a preset-size image frame centered on the human face. The shape of the image frame is not limited to quadrilaterals, circles, etc.

[0084] Specifically, for example, Figure 13 As shown, the user holds a photography device (the first electronic device) to enter the shooting interface of a group photo. The face recognition technology is used to frame and generate face regions 112 corresponding to the number of faces of the subjects. During the recognition process, the corresponding face regions 112 will be displayed in the preview screen 110. At the same time, the shooter can input the number of faces of the subjects (the number of faces is set to N) at the upper right of the shooting interface to assist the face recognition system in generating N square face regions 112 corresponding to the number of faces of the subjects.

[0085] In an embodiment of the present application, as Figure 5 shown, step 408, perform face recognition on the preview screen according to the number of face regions to determine multiple face regions in the preview screen, including:

[0086] Step 502: Receive a third input to the preview screen;

[0087] Step 504: In response to the third input, edit multiple face regions in the preview screen.

[0088] Among them, the editing methods include at least one of the following: adding, deleting, enlarging, and shrinking.

[0089] In this embodiment, on the shooting interface, the user (shooter) of the first electronic device can independently check the correctness of the generated face regions and can manually edit multiple face regions to ensure the correctness of the generated editable face regions.

[0090] It should be noted that a response function for triggering face region editing by the third input is predefined for the first electronic device, and the response function indicates at least one editing rule. When receiving the third input from the user to the face region in the preview screen, the third input is matched with the editing rule. When the third input meets the rule, in response to the third input, the multiple face regions in the preview screen are edited using the editing method corresponding to the rule. For example, the rule is defined as: double-clicking on a face region deletes the face region, double-clicking on a face on the shooting interface adds a face region, and dragging the border of a face region enlarges or shrinks the face region. The embodiments of the present application do not make specific limitations.

[0091] Specifically, for example, Figure 14 As shown, the shooter double-clicks on the face region 112 in the preview screen 110 with a finger to delete the incorrect face region 112, and a new face region is generated by the region circled by a single finger, so as to ensure the correctness of the number of the generated editable face regions 112 and the editable face regions 112.

[0092] In an embodiment of the present application, Figure 6 shows the sixth flowchart of the image editing method according to the first aspect embodiment of the present application, including:

[0093] Step 602: Export a target image after editing the image to be edited according to the first information.

[0094] In this embodiment, the first information is the entry of the editing interface for collaborative image editing. The users of at least one second electronic device can perform collaborative editing processing on the image to be edited through the first information on the editing interface. At the same time, the first electronic device can also download and export the target image obtained after being edited by the second electronic device through the first information, so as to facilitate the shooter to retain the final finished film.

[0095] Specifically, for example, the first information is a link. The link is displayed on the screen of the first electronic device. The photographer clicks on the link, and the first electronic device jumps to an editing interface. The target image obtained after editing by the second electronic device is displayed in the editing interface. Clicking the download button in the editing interface can export the target image. Among them, the editing interface is a web interface, and anyone can enter the editing interface through the link.

[0096] In an embodiment of the present application, Figure 7 One of the flowcharts of the image editing method according to the second aspect embodiment of the present application is shown, including:

[0097] Step 702, obtain the first information;

[0098] Step 704, according to the first information, display the image to be edited and the image set associated with the image to be edited;

[0099] Among them, the image to be edited includes the target face area;

[0100] In this embodiment, obtain the first information transmitted by the first electronic device, and use the first information to determine the image to be edited obtained after shooting and the image set associated with the image to be edited. Display the image to be edited and the image set on the screen of the second electronic device, so that the user to whom the second electronic device belongs can select the best face area of the person being photographed by viewing the image to be edited and the image set.

[0101] Step 706, receive the fourth input to the image set;

[0102] Among them, the image set includes at least one image.

[0103] Step 708, in response to the fourth input, edit the target face area according to the image set to generate a target image.

[0104] In this embodiment, the user can select the image with the best face area in the image set through the fourth input to the second electronic device. And edit the corresponding target face area in the image to be edited according to this image, and save the edited image to obtain the target image. Thus, applying face recognition and collaborative editing to image processing gives each person being photographed the autonomy to choose their personal expression, enabling the edited target image to meet the needs of all people being photographed for face shooting, and at the same time reducing the workload of users for image retouching.

[0105] In an embodiment of the present application, as Figure 8 shown, step 708, editing the target face area according to the image set, includes:

[0106] Step 802, determine the position information of the target face area in the image to be edited;

[0107] Among them, the position information is used to locate the position of the target face area in the image to be edited. For example, the position information includes the coordinates of the target face area, or the displacement between the center point of the target face area and the center point of the image to be edited, etc.

[0108] Step 804: Determine the face area of the image corresponding to the fourth input in at least one image according to the position information;

[0109] Step 806: Replace the target face area with the face area of the image corresponding to the fourth input.

[0110] In this embodiment, the position information of the target face area that the user (the person being photographed) of the second electronic device needs to edit in the image to be edited is determined. After the user selects an image from the image set through the fourth input, a face area with the same position information as the target face area is searched for on this image, and the face area of the image corresponding to the fourth input is used to replace the target face area of the image to be edited, so as to complete the editing process of the image to be edited.

[0111] Furthermore, after the replacement, the user can also perform image retouching on the replaced target face area, so as to reduce the possibility of problems such as misalignment and uneven brightness in the target image and ensure the quality of the final image of the target image.

[0112] In an embodiment of the present application, as Figure 9 shown, when the image set includes multiple images, step 704: Display the image set associated with the image to be edited, including:

[0113] Step 902: Display a browsing interface;

[0114] Among them, the browsing interface is used to display thumbnails of multiple images and browsing controls for the image set, and the browsing controls are used to switch between multiple images.

[0115] Step 904: Receive a fifth input to the browsing control;

[0116] Step 906: In response to the fifth input, determine the image identification information corresponding to the fifth input;

[0117] Among them, the image identification information includes the number of the image, the position of the image in the browsing interface, etc.

[0118] Step 908: Cancel the display of the thumbnails of multiple images on the browsing interface, and display the image corresponding to the image identification information on the browsing interface.

[0119] In this embodiment, if there are multiple images in the image set, the user can view any one of the images through the browsing interface. Specifically, by operating the browsing control, the user inputs the required image identification information, and searches for the image that the user needs to view among the multiple images according to the image identification information. After determining the image that the user needs to view, it is necessary to display the thumbnails of the multiple images on the browsing interface, and display the image corresponding to the image identification information, so as to replace all the thumbnails with the image corresponding to the image identification information, thereby magnifying and displaying the image that the user needs to view indicated by the image identification information, so as to facilitate the user to view the details in the image and is conducive to selecting a satisfactory face area.

[0120] Specifically, for example, as Figure 15 shown, when the person being photographed clicks to view the target face area that he / she has the permission to edit, he / she can expand the browsing interface 200 of the image set as an alternative near the target face area or on the screen of the second electronic device. During the browsing process, the user can select the image to be browsed through the browsing assist key (browsing control 210) in the lower right corner of the browsing interface 200. By inputting the number of frames that can be browsed and clicking OK, a certain frame of the image can be quickly displayed on the browsing interface 200, and the image includes a face area. Moreover, the functions of playing and viewing subsequent frames and returning to view previous frames can be realized by fast forward and fast backward. Finally, select a frame of the image that the person being photographed is most satisfied with, and click OK to modify the image to be edited with the frame of the image that the person being photographed is most satisfied with.

[0121] In an embodiment of the present application, as Figure 10 shown, step 704, according to the first information, display the image to be edited and the image set associated with the image to be edited, including:

[0122] Step 1002, receive a sixth input to the first information;

[0123] Wherein, the first information includes a link, a QR code, etc.

[0124] Step 1004, in response to the sixth input, load and display the editing interface corresponding to the first information.

[0125] Wherein, the editing interface is used to display the image to be edited and the image set associated with the image to be edited.

[0126] In this embodiment, the second electronic device can, through the sixth input of the first information, load the editing interface corresponding to the first information from the server or other locations by using the first information, and display the editing interface. The user to whom the second electronic device belongs can view the image to be edited and the image set on the editing interface, and edit the image to be edited. In addition, all second electronic devices can jump to the editing interface through the first information, so that all second electronic devices can edit the image to be edited on the same interface, simplifying the steps of image mutual transmission, realizing online collaborative editing of images, and improving the image editing efficiency.

[0127] It should be noted that in the editing interface, after the user confirms that the editing of the target face area of the image to be edited is completed, the image to be edited displayed on the editing interface is updated to the image after editing the target face area, so that the next user who performs editing can edit based on the image to be edited after the previous user's editing.

[0128] In an embodiment of the present application, as Figure 11 shown, step 708, editing the target face area according to the image set, includes:

[0129] Step 1102, receiving the seventh input for the face area of the image to be edited;

[0130] Step 1104, in response to the seventh input, obtaining authentication information;

[0131] Among them, the authentication information includes at least one of name, gender, age, position, number. Of course, the authentication information can also include other information that can distinguish identities, which is not limited in this embodiment.

[0132] Step 1106, sending an editing request for the image to be edited to the third electronic device;

[0133] Among them, the editing request includes authentication information and the face area of the image to be edited.

[0134] Step 1108, in the case of receiving the approval instruction of the editing request fed back by the third electronic device, determining the target face area from the face area of the image to be edited according to the approval instruction;

[0135] Step 1110, highlighting the target face area.

[0136] In this embodiment, in order to prevent unauthorized personnel from randomly modifying the image to be edited, the editing permission of the user to whom the second electronic device belongs needs to be applied for before editing the image. Specifically, the authentication information is obtained through the seventh input of the face area of the image to be edited, and the image to be edited carrying the authentication information and the editing request for the face area corresponding to the seventh input are sent to the third electronic device to apply for the editing permission for the target face area to the third electronic device. The third electronic device sets the editing permission of the user through the authentication information and feeds back to the second electronic device. When the second electronic device receives the approval instruction of the editing request, it indicates that the user to whom the second electronic device belongs has the permission to edit the image of the face area corresponding to the seventh input, and then the face area corresponding to the seventh input is used as the target face area with the editing permission. This enables the user to only edit the target face area and not edit the face areas outside their own permissions, ensuring the privacy of face collaborative editing. At the same time, the target face area is highlighted to facilitate the user to intuitively understand the target face area that can be edited in the image to be edited.

[0137] Among them, the way to highlight the target face area can be to bold the border of the target face area or to indicate the target face area with an arrow.

[0138] Specifically, for example, Figure 16 As shown, after the person being photographed clicks on the system editing link sent by the photographer, they enter the editing interface 300. First, they apply for the viewing permission, click the permission application button, and apply for the face area they want to edit. Necessary authentication information is filled in the editing interface 300 for the administrator to verify. For example, when double-clicking on a face area on the computer, a pop-up window will automatically appear for filling in the authentication information and the "OK" and "Cancel" buttons. Clicking the "OK" button sends the authentication information to the administrator, and the administrator reviews each permission application in the background. When the permission application is approved, the face area is used as the target face area 114 that can be edited. Another example is that on a mobile phone, the face area can be selected by double-clicking with a finger, and a pop-up window will appear with prompts for filling in the corresponding information and the "OK" and "Cancel" buttons.

[0139] It can be understood that a user can apply for the editing permission of multiple face areas, and the administrator (the user to whom the third electronic device belongs) determines the target face areas that the user can edit.

[0140] It should be noted that when the user to whom the second electronic device belongs selects an image that they are satisfied with, the user can click "Edit Confirm" to complete the editing process. At this time, the face area of their own part cannot be modified anymore. If modification is needed, permission needs to be applied for from the administrator again.

[0141] In one embodiment of the present application, further, after editing the target face area according to the image set, it further includes: exporting the target image. That is, the user of the second electronic device can download the edited target image of all users from the editing interface.

[0142] In one embodiment of the present application, as Figure 17 shown, the image editing device 1200 includes: an acquisition module 1202, the acquisition module 1202 is configured to acquire the image to be edited and the image set associated with the image to be edited; and acquire the first information of the image to be edited and the image set associated with the image to be edited; a communication module 1204, the communication module 1204 is configured to send the first information to the second electronic device for the second electronic device to edit the target face area of the image to be edited according to the image set.

[0143] In this embodiment, the first electronic device can send the image to be edited and the image set obtained during continuous shooting in the form of the first information to the second electronic devices of all the photographed persons who need to process the image to be edited, so that all the photographed persons can select a more satisfactory image from the image set and use the image to replace the target face area related to themselves in the image to be edited. Furthermore, face recognition and collaborative editing are applied to image processing, giving each photographed person the autonomy to choose their personal expression, enabling the edited target image to meet the needs of all photographed persons for face shooting, and at the same time reducing the workload of image retouching.

[0144] Optionally, the image editing device 1200 further includes: a receiving module (not shown in the figure), the receiving module is configured to receive a first input to the first electronic device; a shooting module (not shown in the figure), the shooting module is configured to respond to the first input and shoot the shooting object to generate an image file, and the image file includes multiple face areas in the preview screen during image shooting; a determination module (not shown in the figure), the determination module is configured to determine the image to be edited and the image set associated with the image to be edited according to the image file.

[0145] Optionally, the image editing device 1200 further includes: a processing module (not shown in the figure), the processing module is further configured to process the image file to determine multiple images; the communication module 1204 is further configured to send the multiple images to a third electronic device; the determination module is further configured to, in the case of receiving the second information fed back by the third electronic device, use the image corresponding to the second information as the image to be edited, and use the images other than the image to be edited among the multiple images as the image set associated with the image to be edited.

[0146] Optionally, the image editing device 1200 further includes: a display module (not shown in the figure), the display module is configured to display a shooting interface during the shooting process of the image file, and the shooting interface is used to display a preview screen; the receiving module is further configured to receive a second input to the shooting interface; the obtaining module 1202 is further configured to, in response to the second input, obtain the number of face regions in the preview screen; the determining module is further configured to perform face recognition on the preview screen according to the number of face regions, and determine multiple face regions in the preview screen.

[0147] Optionally, the receiving module is further configured to receive a third input to the preview screen; the image editing device 1200 further includes: an editing module (not shown in the figure), the editing module is configured to, in response to the third input, edit multiple face regions in the preview screen.

[0148] Optionally, the image editing device 1200 further includes: an exporting module (not shown in the figure), the exporting module is configured to export a target image after editing the image to be edited according to the first information.

[0149] In this embodiment, when each module of the image editing device 1200 executes its respective function, it implements the steps of the image editing method in any one of the embodiments of the first aspect. Therefore, the image editing device 1200 also includes all the beneficial effects of the image editing method in any one of the embodiments of the first aspect, which will not be elaborated here.

[0150] In an embodiment of the present application, as Figure 18 shown, the image editing device 1300 includes: an obtaining module 1302, the obtaining module 1302 is configured to obtain first information; a display module 1304, the display module 1304 is configured to display an image to be edited and an image set associated with the image to be edited according to the first information, and the image to be edited includes a target face region; a receiving module 1306, the receiving module 1306 is configured to receive a fourth input to the image set; an editing module 1308, the editing module 1308 is configured to, in response to the fourth input, edit the target face region according to the image set to generate a target image.

[0151] In this embodiment, the first information transmitted by the first electronic device is obtained, and the image to be edited obtained after shooting and the image set associated with the image to be edited are determined by using the first information. The image to be edited and the image set are displayed on the screen of the second electronic device, so that the user to whom the second electronic device belongs can select the best face region of the person being photographed by viewing the image to be edited and the image set, and edit the corresponding target face region in the image to be edited. Saving the edited image can obtain the target image. Thereby, face recognition and collaborative editing are applied to image processing, giving each person being photographed the autonomy to select their personal expression, enabling the edited target image to meet the needs of all people being photographed for face shooting, and at the same time reducing the workload of image retouching.

[0152] Optionally, the image editing device 1300 further includes: a first determination module (not shown in the figure), where the first determination module is configured to determine the position information of the target face area in the image to be edited; and according to the position information, determine the face area of the image corresponding to the fourth input in at least one image; the editing module 1308 is further configured to replace the target face area with the face area of the image corresponding to the fourth input.

[0153] Optionally, the display module 1304 is further configured to display a browsing interface, where the browsing interface is used to display thumbnails of multiple images and browsing controls for the image set; the receiving module 1306 is further configured to receive a fifth input to the browsing controls; a second determination module (not shown in the figure), where the second determination module is configured to determine the image identification information corresponding to the fifth input in response to the fifth input; the display module 1304 is further configured to cancel the display of the thumbnails of multiple images on the browsing interface and display the image corresponding to the image identification information on the browsing interface.

[0154] Optionally, the receiving module 1306 is further configured to receive a sixth input to the first information; the display module 1304 is further configured to load and display an editing interface corresponding to the first information in response to the sixth input, where the editing interface is used to display the image to be edited and the image set associated with the image to be edited.

[0155] Optionally, the receiving module 1306 is further configured to receive a seventh input to the face area of the image to be edited; the obtaining module 1302 is further configured to obtain authentication information in response to the seventh input; the image editing device 1300 further includes: a communication module (not shown in the figure), where the communication module is configured to send an editing request for the image to be edited to a third electronic device, and the editing request includes authentication information and the face area of the image to be edited; a third determination module (not shown in the figure), where the third determination module is configured to, in the case of receiving an approval instruction for the editing request fed back by the third electronic device, determine a target face area from the face area of the image to be edited according to the approval instruction; the display module 1304 is further configured to highlight the target face area.

[0156] Optionally, the image editing device 1300 further includes: an export module (not shown in the figure), where the export module is configured to export the target image.

[0157] In this embodiment, when each module of the image editing device 1300 executes its respective function, it implements the steps of the image editing method in any of the embodiments of the second aspect. Therefore, the image editing device 1300 also includes all the beneficial effects of the image editing method in any of the embodiments of the second aspect, which will not be elaborated here.

[0158] The image editing device in the embodiments of the present application can be a device, or a component, an integrated circuit, or a chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a palmtop computer, a vehicle-mounted electronic device, a smart camera device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The non-mobile electronic device can be a server, a Network Attached Storage (NAS), a personal computer (PC), a television (TV), or a self-service machine, etc. The embodiments of the present application do not make specific limitations.

[0159] The application program management device in the embodiments of the present application is a device with an operating system. The operating system can be an Android operating system, an iOS operating system, or other possible operating systems. The embodiments of the present application do not make specific limitations.

[0160] In an embodiment of the present application, as Figure 19 shown, an electronic device 1400 is provided, including: a processor 1404, a memory 1402, and a program or instruction stored in the memory 1402 and running on the processor 1404. When the program or instruction is executed by the processor 1404, the steps of the image editing method provided in any of the above embodiments are implemented. Therefore, the electronic device 1400 includes all the beneficial effects of the image editing method provided in any of the above embodiments, which will not be elaborated here.

[0161] It should be noted that the electronic device in the embodiments of the present application includes the above-mentioned mobile electronic device and non-mobile electronic device.

[0162] Figure 20 The following is a schematic hardware structure diagram of an electronic device 1500 for implementing the embodiments of the present application. The electronic device 1500 includes, but is not limited to: a radio frequency unit 1501, a network module 1502, an audio output unit 1503, an input unit 1504, a sensor 1505, a display unit 1506, a user input unit 1507, an interface unit 1508, a memory 1509, and a processor 1510, etc.

[0163] Those skilled in the art can understand that the electronic device 1500 may further include a power source (such as a battery) for supplying power to each component. The power source can be logically connected to the processor 1510 through a power management system, so as to manage functions such as charging, discharging, and power consumption management through the power management system. Figure 20 The structure of the electronic device shown in Figure 20 does not limit the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine some components, or have different component arrangements, which will not be elaborated here.

[0164] Among them, the processor 1510 is used to obtain the image to be edited and the image set associated with the image to be edited; and obtain the first information of the image to be edited and the image set associated with the image to be edited; the radio frequency unit 1501 is used to send the first information to the second electronic device for the second electronic device to edit the target face area of the image to be edited according to the image set.

[0165] Further, the user input unit 1507 is used to receive a first input to the first electronic device; the processor 1510 is further used to respond to the first input, capture the object to be photographed, generate an image file, and the image file includes multiple face areas in the preview screen when the image is captured; according to the image file, determine the image to be edited and the image set associated with the image to be edited.

[0166] Further, the processor 1510 is further used to process the image file to determine multiple images; the radio frequency unit 1501 is further used to send the multiple images to the third electronic device; the processor 1510 is further used to, in the case of receiving the second information fed back by the third electronic device, use the image corresponding to the second information as the image to be edited, and use the images other than the image to be edited in the multiple images as the image set associated with the image to be edited.

[0167] Further, the display unit 1506 is used to display a shooting interface during the shooting process of the image file, and the shooting interface is used to display the preview screen; the user input unit 1507 is further used to receive a second input to the shooting interface; the processor 1510 is further used to respond to the second input, obtain the number of face areas in the preview screen; perform face recognition on the preview screen according to the number of face areas to determine multiple face areas in the preview screen.

[0168] Further, the user input unit 1507 is further used to receive a third input to the multiple face areas in the preview screen; the processor 1510 is further used to respond to the third input and edit the multiple face areas in the preview screen.

[0169] Further, the processor 1510 is further used to export the target image after editing the image to be edited according to the first information.

[0170] Further, the processor 1510 is further configured to obtain first information; the display unit 1506 is further configured to display a to-be-edited image and an image set associated with the to-be-edited image according to the first information, where the to-be-edited image includes a target face region; the user input unit 1507 is further configured to receive a fourth input to the image set; and the processor 1510 is further configured to, in response to the fourth input, edit the target face region according to the image set to generate a target image.

[0171] Further, the processor 1510 is further configured to determine position information of the target face region in the to-be-edited image; determine a face region of an image corresponding to the fourth input in at least one image according to the position information; and replace the target face region with the face region of the image corresponding to the fourth input.

[0172] Further, the display unit 1506 is further configured to display a browsing interface, where the browsing interface is configured to display thumbnails of a plurality of images and browsing controls for the image set; the user input unit 1507 is further configured to receive a fifth input to the browsing controls; the processor 1510 is further configured to, in response to the fifth input, determine image identification information corresponding to the fifth input; and the display unit 1506 is further configured to cancel displaying the thumbnails of the plurality of images on the browsing interface and display the image corresponding to the image identification information on the browsing interface.

[0173] Further, the user input unit 1507 is further configured to receive a sixth input to the first information; and the display unit 1506 is further configured to, in response to the sixth input, load and display an editing interface corresponding to the first information, where the editing interface is configured to display the to-be-edited image and the image set associated with the to-be-edited image.

[0174] Further, the user input unit 1507 is further configured to receive a seventh input to the face region of the to-be-edited image; the processor 1510 is further configured to, in response to the seventh input, obtain authentication information; the radio frequency unit 1501 is further configured to send an editing request for the to-be-edited image to a third electronic device, where the editing request includes the authentication information and the face region of the to-be-edited image; the processor 1510 is further configured to, in the case of receiving an approval instruction for the editing request fed back by the third electronic device, determine a target face region from the face region of the to-be-edited image according to the approval instruction; and the display unit 1506 is further configured to highlight the target face region.

[0175] Further, the processor 1510 is further configured to export the target image.

[0176] It should be understood that in the embodiments of the present application, the input unit 1504 may include a Graphics Processing Unit (GPU) 1541 and a microphone 1542. The GPU 1541 processes the image data of static pictures or videos obtained by an image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1506 may include a display panel 1561, and the display panel 1561 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1507 includes a touch panel 1571 and other input devices 1572. The touch panel 1571 is also called a touch screen. The touch panel 1571 may include two parts: a touch detection device and a touch controller. The other input devices 1572 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, power on / off keys, etc.), a trackball, a mouse, and a joystick, which will not be elaborated here. The memory 1509 may be used to store software programs and various data, including but not limited to application programs and operating systems. The processor 1510 may integrate an application processor and a modem processor. Among them, the application processor mainly processes the operating system, user interface, application programs, etc., and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor may not be integrated into the processor 1510.

[0177] In an embodiment of the present application, a read storage medium is provided, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the image editing method provided in any of the above embodiments are implemented.

[0178] In this embodiment, the read storage medium can implement each process of the image editing method provided in the embodiments of the present application and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0179] Among them, the processor is the processor in the communication device in the above embodiment. The read storage medium includes a computer-readable storage medium, such as a computer Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disc, etc.

[0180] The embodiments of the present application also provide a chip. The chip includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run a program or instruction to implement each process of the above image editing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0181] It should be understood that the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, a system chip, a chip system, or a system-on-chip, etc.

[0182] It should be noted that in this text, the term "including", "comprising" or any other variant thereof is intended to cover non-exclusive inclusion, such that a process, method, article or device including a series of elements not only includes those elements but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "including one..." does not exclude the existence of additional identical elements in the process, method, article or device including such element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the reverse order according to the functions involved. For example, the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0183] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-described example methods can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation. Based on this understanding, the technical solution of the present application, in essence or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to enable a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in various embodiments of the present application.

[0184] The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Those of ordinary skill in the art, under the inspiration of the present application and without departing from the purpose of the present application and the scope protected by the claims, can still make many forms, all of which fall within the protection scope of the present application.

Claims

1. An image editing method, characterized in that, including: obtaining an image to be edited and an image set associated with the image to be edited; obtaining first information of the image to be edited and the image set associated with the image to be edited; sending the first information to a second electronic device for the second electronic device to edit a target face area of the image to be edited according to the image set, so that users of all the second electronic devices can select a satisfactory image from the image set associated with the image to be edited and replace the target face area related to the second electronic device in the image to be edited.

2. The image editing method according to claim 1, wherein The obtaining of the image to be edited and the image set associated with the image to be edited includes: receiving a first input to a first electronic device; in response to the first input, photographing a subject to generate an image file, the image file including multiple face areas in a preview screen at the time of image capture; determining the image to be edited and the image set associated with the image to be edited according to the image file.

3. The image editing method according to claim 2, characterized in that The determining of the image to be edited and the image set associated with the image to be edited according to the image file includes: processing the image file to determine multiple images; sending the multiple images to a third electronic device; in the case of receiving second information fed back by the third electronic device, taking the image corresponding to the second information as the image to be edited, and taking the images other than the image to be edited among the multiple images as the image set associated with the image to be edited.

4. The image editing method according to claim 2, wherein Before obtaining the image to be edited and the image set associated with the image to be edited, it further includes: during the shooting process of the image file, displaying a shooting interface for displaying the preview screen; receiving a second input to the shooting interface; in response to the second input, obtaining the number of face areas in the preview screen; performing face recognition on the preview screen according to the number of face areas to determine multiple face areas in the preview screen.

5. The image editing method according to claim 4, wherein After performing face recognition on the preview screen according to the number of face areas to determine multiple face areas in the preview screen, it further includes: receiving a third input to the preview screen; in response to the third input, editing the multiple face areas in the preview screen.

6. An image editing method, characterized in that, including: obtaining first information; displaying the image to be edited and the image set associated with the image to be edited on the screen of the second electronic device according to the first information, the image to be edited including a target face area; receiving a fourth input to the image set; in response to the fourth input, selecting an image satisfactory to the user of the second electronic device from the image set and editing the target face area according to the image set to generate a target image.

7. The image editing method according to claim 6, wherein The image set includes at least one image; the editing of the target face area according to the image set includes: determining position information of the target face area in the image to be edited; determining a face area of the image corresponding to the fourth input in the at least one image according to the position information; replacing the target face area with the face area of the image corresponding to the fourth input.

8. The image editing method according to claim 6, characterized in that In the case where the image set includes a plurality of images, displaying the image set associated with the image to be edited includes: Displaying a browsing interface for displaying thumbnails of a plurality of images and browsing controls for the image set; Receiving a fifth input to the browsing controls; In response to the fifth input, determining image identification information corresponding to the fifth input; Canceling the display of the thumbnails of the plurality of images on the browsing interface and displaying the image corresponding to the image identification information on the browsing interface.

9. The image editing method according to claim 6, wherein The displaying the image to be edited and the image set associated with the image to be edited according to the first information includes: Receiving a sixth input to the first information; In response to the sixth input, loading and displaying an editing interface corresponding to the first information, the editing interface being for displaying the image to be edited and the image set associated with the image to be edited.

10. An image editing device, characterized in that, Includes: An acquisition module for acquiring an image to be edited and an image set associated with the image to be edited; And Acquiring first information about the image to be edited and the image set associated with the image to be edited; A communication module for sending the first information to a second electronic device for the second electronic device to edit a target face area of the image to be edited according to the image set, so that users of all the second electronic devices can select a satisfactory image from the image set associated with the image to be edited and replace the target face area related to the second electronic device in the image to be edited.

11. An image editing device, characterized in that, Includes: An acquisition module for acquiring first information; A display module for displaying, according to the first information, an image to be edited and an image set associated with the image to be edited on the screen of the second electronic device, the image to be edited including a target face area; A receiving module for receiving a fourth input to the image set; An editing module for, in response to the fourth input, selecting an image satisfactory to the user of the second electronic device from the image set and editing the target face area according to the image set.

Citation Information

Patent Citations

  • Method and device for shooting multiple people

    CN105303161A

  • Image replacing method and device

    CN106792147A