Image processing method and device, server, electronic equipment and readable storage medium

By generating a set of images with high similarity and identifying non-interfering objects to process the images, the problem of obstruction during the shooting process is solved, and efficient and convenient target scene shooting is achieved.

CN113989706BActive Publication Date: 2026-03-03VIVO MOBILE COMM CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111250774.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-10-26
Publication Date
2026-03-03
Estimated Expiration
2042-03-03

AI Technical Summary

Technical Problem

Users are often obstructed by objects when shooting target scenes, resulting in poor shooting results. Existing technologies require finding specific angles or times to shoot, which is difficult and inconvenient.

Method used

By receiving images sent by multiple electronic devices, a set of highly similar images is generated, non-interference objects are identified, and these objects are used to process the images to remove interference, generating a target image with less interference occlusion.

Benefits of technology

There is no need to frequently adjust the shooting angle or time. Multiple images are used to compensate for each other, which improves shooting efficiency and convenience and reduces shooting difficulty.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113989706B_ABST
    Figure CN113989706B_ABST
Patent Text Reader

Abstract

The application discloses an image processing method and device, a server, electronic equipment and a readable storage medium, wherein the image processing method comprises the following steps: receiving M first images sent by N electronic devices, and generating a first image set, wherein the image similarity in the first image set is greater than or equal to a first threshold value; in the case that the occurrence frequency of a first object in the first image set is greater than a preset threshold value, the first object is determined as a non-interference object; and according to the non-interference object, the images in the first image set are processed to obtain a target image of a target scene.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application belongs to the field of image processing technology, specifically relating to an image processing method, an image processing device, a server, an electronic device, and a readable storage medium. Background Technology

[0002] When users want to shoot a target scene, they are often blocked by distractions, which affects the shooting results.

[0003] In order to capture images free of distractions, users need to find a specific angle or take the picture at a specific time.

[0004] The above methods have strict requirements on shooting time and space, and it is difficult to obtain images without interference, which brings great inconvenience to the user's shooting process. Summary of the Invention

[0005] The purpose of this application is to provide an image processing method, an image processing device, a server, an electronic device, and a readable storage medium that can improve the convenience for users when shooting target scenes.

[0006] In a first aspect, embodiments of this application provide an image processing method applied to a server, the method comprising:

[0007] Receive M first images sent by N electronic devices, generate a first image set, wherein the image similarity in the first image set is greater than or equal to a first threshold;

[0008] If the number of times a first object appears in the first image set is greater than a preset threshold, the first object is determined to be a non-interference object;

[0009] Based on the non-interference objects, the images in the first image set are processed to obtain the target image of the target scene.

[0010] Secondly, embodiments of this application provide an image processing method applied to an electronic device, the method comprising:

[0011] When the electronic devices are in a shooting group, the first image is sent to the server;

[0012] Receive the target image sent by the server, wherein the target image is the image after processing the first image based on the non-interference object.

[0013] Thirdly, embodiments of this application provide an image processing apparatus applied to a server, comprising:

[0014] The generation module is used to receive M first images sent by N electronic devices and generate a first image set, wherein the image similarity in the first image set is greater than or equal to a first threshold.

[0015] The determination module is used to determine the first object as a non-interference object when the number of times the first object appears in the first image set is greater than a preset threshold.

[0016] The processing module is used to process the images in the first image set according to the non-interference objects to obtain the target image of the target scene.

[0017] Fourthly, embodiments of this application provide an image processing apparatus applied to an electronic device, comprising:

[0018] The sending module is used to send the first image to the server when the electronic devices are in a shooting group;

[0019] The receiving module is used to receive the target image sent by the server, wherein the target image is the image after processing the first image based on the non-interference object.

[0020] Fifthly, embodiments of this application provide a server, including a first processor, a first memory, and a program or instructions stored in the first memory and executable on the first processor, wherein the program or instructions, when executed by the first processor, implement the steps of the method as described in the first aspect.

[0021] In a sixth aspect, embodiments of this application provide an electronic device, including a processor, a memory, and a program or instructions stored in the memory and executable on the processor, wherein the program or instructions, when executed by the processor, implement the steps of the method as described in the second aspect.

[0022] In a seventh aspect, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the methods as described in the first and second aspects.

[0023] Eighthly, embodiments of this application provide a chip including a processor and a communication interface coupled to the processor, the processor being used to run programs or instructions to implement the steps of the methods as described in the first and second aspects.

[0024] In this embodiment, after generating the first image set, the occlusion portions of different images within the first image set are different. Each image includes at least one first object. When a first object appears more than a preset threshold in the first image set, it indicates that the first object has appeared in multiple images, meaning that the sub-image is a non-interference object. Based on this method, one or more non-interference objects can be identified. Therefore, the images in the image set can be processed based on these non-interference objects to obtain a target image. The target image can be an image of a target scene without occlusion. During the process of obtaining the target image, the user does not need to frequently move around to find a specific shooting angle. Images taken by other users can provide a reference for the target image generation process, reducing the difficulty of the shooting process. Moreover, through mutual compensation of multiple images, the user does not need to shoot at a specific time, effectively improving shooting efficiency and convenience when shooting the target scene. Attached Figure Description

[0025] Figure 1 A schematic flowchart of an image processing method according to an embodiment of this application is shown;

[0026] Figure 2 One of the schematic diagrams of a first image according to an embodiment of this application is shown;

[0027] Figure 3 A second schematic diagram of a first image according to an embodiment of this application is shown;

[0028] Figure 4 A third schematic diagram showing a first image according to an embodiment of this application;

[0029] Figure 5 A fourth schematic diagram showing a first image according to an embodiment of this application;

[0030] Figure 6 A second schematic flowchart of an image processing method according to an embodiment of this application is shown;

[0031] Figure 7 A schematic diagram of a camera group according to an embodiment of this application is shown;

[0032] Figure 8 A structural block diagram of an image processing apparatus according to an embodiment of this application is shown;

[0033] Figure 9 A second structural block diagram of an image processing apparatus according to an embodiment of this application is shown;

[0034] Figure 10 A structural block diagram of a server according to an embodiment of this application is shown;

[0035] Figure 11 A structural block diagram of an electronic device according to an embodiment of this application is shown;

[0036] Figure 12 A schematic diagram of the hardware structure of the electronic device used to implement the embodiments of this application. Detailed Implementation

[0037] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0038] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0039] The embodiments of this application will be described in detail below with reference to the accompanying drawings and specific examples and application scenarios.

[0040] In some embodiments of this application, such as Figure 1 As shown, an image processing method is proposed and applied to a server. The image processing method includes:

[0041] Step 102: Receive M first images sent by N electronic devices and generate a first image set, wherein the image similarity in the first image set is greater than or equal to a first threshold.

[0042] Step 104: If the number of times the first object appears in the first image set is greater than a preset threshold, the first object is determined as a non-interference object.

[0043] Step 106: Process the images in the first image set according to the non-interference objects to obtain the target image of the target scene.

[0044] The server can receive M first images sent by N electronic devices, meaning it can receive images taken by multiple users. After acquiring the M first images, it needs to determine their similarity. If all M first images were taken of the target scene, then their similarity is relatively high. Images with a similarity greater than or equal to a first threshold are selected from the M first images, and these images are used to generate a first image set. For example, any two images in the first image set have a similarity greater than 80%. All M first images can be added to the first image set, or only some of the M first images can be added. It is understood that images with high similarity within the same scene are more likely to have similar shooting angles and times, thus providing mutual reference value.

[0045] Understandably, since the ultimate goal is to obtain a target image with fewer interfering elements, the image with the fewest interfering elements or the smallest area occupied by interfering elements in the first image set can be selected as the base image. This base image is then processed to obtain the target image. This approach minimizes processing and improves image processing efficiency.

[0046] After generating the first image set, the occlusion portions of different images within the set vary. Each image includes at least one first object. When a first object appears more than a preset threshold in the first image set, it indicates that the first object has appeared in multiple images, meaning that the sub-image is a non-interference object. Based on this method, one or more non-interference objects can be identified. Therefore, images in the image set can be processed based on these non-interference objects to obtain the target image. The target image can be an image of the target scene without occlusion. In obtaining the target image, the user does not need to frequently move around to find specific shooting angles. Images taken by other users can provide reference for determining the target image, reducing the difficulty of the shooting process. Moreover, through mutual compensation of multiple images, the user does not need to shoot at a specific time, effectively improving shooting efficiency and convenience when shooting the target scene.

[0047] In one possible embodiment, after generating the first image set, the method further includes: if the number of times a first object appears in the first image set is less than a preset threshold, determining the first object as an interference object; processing the first image according to the non-interference object to obtain a target image of the target scene, including: replacing the interference object with a non-interference object to obtain a target image of the target scene; wherein the interference object and the non-interference object are in the same position in the images of the first image set.

[0048] In this embodiment, when the number of times the first object appears in the first image set is less than a preset threshold, it indicates that the first object has appeared in one or a few images, which means that the first object is an interference object. Based on this method, one or more interference objects can be identified. After identifying interference objects and non-interference objects, interference objects and non-interference objects located at the same position in the image are identified. Then, the interference objects are replaced with non-interference objects, that is, interference objects in the image are removed.

[0049] For example, if a house in one image is not obscured by distracting objects, while a house in another image is obscured, then the distracting object can be replaced with a related, non-distracting object. This replaces the obscured portion of the image with an unobscured object, thus obtaining a target image where the scene is either unobscured or minimally obscured. By compensating for each other among multiple images in the first image set, the target image is obtained, saving the user the effort of repeatedly moving and changing shooting positions, and improving the convenience of acquiring the target image.

[0050] For example, such as Figure 2 , Figure 3 , Figure 4 and Figure 5 As shown, different locations in the four images are obscured by interfering objects. The interfering and non-interfering objects can be determined by the frequency of their appearance in the same scene across the four images. Based on the interfering and non-interfering objects, the image without interfering objects in that scene can then be obtained. For example, Figure 2 The image in the middle section is obscured, and Figure 3 , Figure 4 and Figure 5 Since the image of the central door is not occluded, the door image can be identified as a non-interference object. The triangular image that occludes the door image is the interference object, thus the image at the door location can be replaced. Figure 2 The image containing the triangular obstruction at the doorway is used to obtain an image of the doorway without the obstruction. Understandably, other obstructions can be removed using a similar method.

[0051] In one possible application, when the first object in the first image of the first image set is a person image, the principle of only reducing and not adding is followed, that is, the person image is identified as an interfering object and needs to be removed.

[0052] In one possible embodiment, after obtaining the target image of the target scene, the process further includes:

[0053] The target image is sent to P electronic devices, where each of the P electronic devices captures an image from the first image set, and P ≤ N.

[0054] Understandably, since the images in the first image set may not originate from all N electronic devices, the target image may be sent to all N electronic devices, or only to some of them. Specifically, the images in the first image set were captured by P electronic devices, which are the devices that provide valid images for obtaining the target image. Electronic devices whose first images are not included in the first image set indicate that their images were not taken for the target scene. Therefore, it is unnecessary to send the processed target image to unrelated electronic devices, preventing users from sending their own photos to unrelated individuals and effectively ensuring the privacy of users within the shooting group.

[0055] Understandably, since all P electronic devices possess images captured in the first image set, the image captured by each electronic device can be used as a basis. This image can be processed to obtain the target image, which is then sent back to the corresponding electronic device. In other words, the target image received by each of the P electronic devices is obtained by processing the first image it sent.

[0056] The application of the first image set can effectively prevent malicious users from using the team photo mode to steal the privacy of other users in the team.

[0057] In one possible embodiment, the N electronic devices are devices in the same shooting group; after sending the target image to the P electronic devices, the method further includes: upon receiving a prompt to disband the shooting group, in response to the first input of Q users, updating the target image, and sending the updated image to the Q users, where Q≤P.

[0058] In this embodiment, during the shooting process of the target scene, once the target image is acquired, it is sent to P electronic devices. After the shooting group is established, new users may continuously join the shooting group, and the first image taken by each new user may also be added to the first image set. Therefore, as the number of new users increases, the number of images in the first image set increases, and the more images in the first image set, the lower the probability of the obtained target image being affected by interference. When a user who established the shooting group wants to leave the shooting group, the number of images in the first image set is at its maximum. At this time, the generated target image is the one with the fewest interferences. Therefore, when leaving the shooting group, the target image is sent to the P electronic devices again. It is understood that this target image is generated based on the images in the current first image set, and the users of the P electronic devices can choose whether to receive the target image again according to their needs. If Q users choose to receive the target image again, the server will send the updated target image to the electronic devices of those Q users.

[0059] It's important to note that the updated image wasn't directly sent to P electronic devices because some users don't require an updated target image. For example, some users might be satisfied with the current target image, even if some obstructions occlude the scene; they might find it aesthetically pleasing and therefore don't need an update. Sending the updated image based on the user's initial input better meets the needs of different users and improves the user experience.

[0060] For example, the first input can be a single-click input or a double-click input. When a user who created the shooting group wants to ungroup the shooting group, a prompt will pop up on the terminals of P users asking whether to update the target image. The user can click or double-click to select "yes" or "no", thereby determining whether to receive the updated target image based on the user's choice.

[0061] In one possible application, the target image can be sent to P users, and even if some of the P users leave the shooting group before receiving the target image, the cloud can still send the processed target image to the individual users.

[0062] In some embodiments of this application, such as Figure 6 As shown, an image processing method is proposed for application in electronic devices. The image processing method includes:

[0063] Step 602: If the electronic device is in a shooting group, send the first image to the server;

[0064] Step 604: Receive the target image sent by the server, wherein the target image is the image after processing the first image based on the non-interference object.

[0065] When it is necessary to photograph a target scene, users can create a shooting group. The first images taken by each user in the shooting group can be sent to the server. The server can receive M first images sent by N electronic devices, that is, the server can receive the first images taken by multiple users and generate a first image set.

[0066] The occlusion portions of different images within the first image set vary. Each image includes at least one first object. When a first object appears more than a preset threshold in the first image set, it indicates that the first object has appeared in multiple images, meaning that the sub-image is a non-interference object. Based on this method, one or more non-interference objects can be identified. Therefore, images in the image set can be processed based on these non-interference objects to obtain a target image. The target image can be an image of the target scene without occlusion. In obtaining the target image, the user does not need to frequently move around to find specific shooting angles. Images taken by other users can provide reference for determining the target image, reducing the difficulty of the shooting process. Moreover, through mutual compensation of multiple images, the user does not need to shoot at a specific time, effectively improving shooting efficiency and convenience when shooting the target scene.

[0067] When there is only one user in the shooting group, it means that there are few users around. At this time, the shooting scene is less likely to be disturbed by interference, so there is no need to process the captured image. In this case, the shooting group can be disbanded.

[0068] The image processing method in this embodiment eliminates the need for users to take multiple photos, find the best shooting angle, or carry additional equipment, greatly improving the effect of reducing image interference and significantly enhancing the user experience.

[0069] The function of sending the first image to the server can be accomplished by the first electronic device that establishes the shooting group. That is, other electronic devices in the shooting group will send their captured first images to the first electronic device, and the first electronic device will send multiple first images to the server. Of course, it can also be accomplished by each electronic device that joins the shooting group individually, that is, each electronic device will send its captured first image to the server separately.

[0070] In one possible embodiment, before sending the first image to the server when the electronic device is in a shooting group, the method further includes: determining the duration of the shooting group and obtaining the signal connection strength between the electronic device and the server; and extending the duration if the signal connection strength is less than a preset strength.

[0071] In this embodiment, when creating a shooting group, the creator can choose the duration of the shooting group or the time point for disbanding the shooting group. The duration of the shooting group can be determined by the duration of the duration of the duration after the shooting group is created. When the duration of the shooting group is reached, the shooting group is automatically disbanded, which avoids the problem of other users continuously joining the shooting group because the user forgets to disband the shooting group, which helps to improve the user experience.

[0072] Before sending the first image to the server, it is necessary to obtain the signal connection strength between the electronic device and the server. If the signal connection strength between the electronic device and the server is poor, or if there is no signal connection between the electronic device and the server, the first image cannot be uploaded to the server for processing. In order to ensure that the user can obtain the target image, the duration of the shooting group can be automatically extended. When the user moves to a location with better signal, the first image can be uploaded to the server for processing, ensuring that the user can receive the target image before the shooting group disbands, which is beneficial to improving the user experience.

[0073] In other embodiments, if the signal connection strength is less than a preset strength, the duration is extended in response to a third input from any of the P users.

[0074] Extending the duration of a shooting group can be done automatically by the electronic device or it can be done by the user. For example, when the signal strength is less than the preset strength, a prompt box will pop up on the screen of the electronic device. The third input can be a single click, and the user can click "yes" or "no" to determine whether to extend the duration based on the user's input, which helps to meet the user's needs.

[0075] Although this embodiment requires cloud-based image processing, it is also applicable to scenarios where there is no network signal or a poor network signal at the shooting location.

[0076] In one possible embodiment, before sending the first image to the server, the method further includes: receiving a second input from a user; determining a first adjustment region of the first image in response to the second input; and receiving a target image sent by the server, wherein the target image is an image after adjusting the first adjustment region of the first image.

[0077] In this embodiment, before sending the first image to the server, the user can specify the adjustment area of ​​the first image. During the generation of the target image, only the user-specified adjustment area is adjusted, and the area outside the adjustment area does not need to be adjusted even if there are interfering objects.

[0078] For example, the images in the first image set were taken by five users. One user specified an adjustment area, while the other four users did not. The other four users adjusted the images as a whole, removing any obscuring elements that could be removed. The user who specified an adjustment area only processed the image within that area, removing any obscuring elements found within that area. By adjusting the specified adjustment area in response to a second user input, the system avoids removing the desired elements from the generated target image, thus better meeting the needs of different users.

[0079] If R users specify adjustment areas, the target image adjusted for the specified areas is sent to R users; otherwise, the target image without specified adjustment areas is sent to PR users.

[0080] In one possible application, the second input can be a swipe input, where the user's finger can slide on the terminal's display screen, and the specified adjustment area is determined based on the user's swipe trajectory.

[0081] In one possible embodiment, before sending the first image to the server, the method further includes: identifying a first electronic device that establishes a shooting group; obtaining location information of the first electronic device when establishing the shooting group; determining the visible range of the shooting group based on the location information; and determining the range within which the shooting group can be joined based on the visible range.

[0082] In this embodiment, when establishing a shooting group, the first electronic device needs to determine the visible range and the range within which users can join. Users within the visible and joinable ranges can then join the shooting group. Specifically, since the user establishing the shooting group wants to acquire images of the target scene, if other users are far away from the group creator, they will find it difficult to capture the target scene, and the images captured by other users are likely to be irrelevant to the target scene. Therefore, to reduce the difficulty of generating the target image, restrictions are placed on the users who can join the shooting group; only users within a certain range of the group creator can join.

[0083] When the first electronic device establishes a shooting group, it needs to obtain the location information of the first electronic device. Based on the location information, the visible range of the shooting group can be determined. Users within the visible range can search for the shooting group. The range that can be joined is determined based on the visible range. For example, the first electronic device can use near field communication technology, such as enabling the Bluetooth function of the first electronic device. Users who can search for the Bluetooth signal of the creator can join the shooting group.

[0084] Other users can also join the shooting group if they are within the visible range and can search for the Bluetooth signal of any user in the shooting group.

[0085] If other users are within the visible range but cannot find the Bluetooth signal of any user in the shooting group, it means that the user is too far away from the others. In this case, the image taken by that user will differ significantly from the images taken by other users in the shooting group. If the user wants to join the shooting group, they need to move to a location where they are within the visible range and can find the Bluetooth signal of any user in the shooting group. This method determines the joinable range. Users within the visible range are closer to the target scene, while users within the joinable range are closer to other users in the shooting group. By setting the visible range and the joinable range, the usability of images captured in the shooting group can be effectively improved, the number of irrelevant images can be reduced, and the speed of generating the target image can be increased.

[0086] The location information used to determine the position of the first electronic device when it established the shooting group was not acquired in real time. In other words, the visible range was already determined when the first electronic device established the shooting group. Even if the first electronic device moved its position after establishing the shooting group, the visible range would not change. This is to ensure that users in the shooting group only joined to capture the target scene. If a user's position changed and the visible range also changed, users capturing other scenes might join the current shooting group, effectively preventing most users in the shooting group from capturing irrelevant images.

[0087] In one possible application, users can choose a team photo mode, and then select and join a shooting group based on the Bluetooth scan results (or create a new shooting group and join it). When a shooting group is scanned, the user can see the name of the shooting group, the number of people in the shooting group, and the disbanding time of the shooting group. Users can actively join or leave the shooting group. After the photo is taken, it will be automatically uploaded to the corresponding group in the cloud. Within the same image set, mutual compensation between images is performed according to specified rules to ultimately reduce image interference.

[0088] For example, such as Figure 7As shown, User A is the creator of the shooting group. Determining User A's location information establishes the center of the shooting group's visible range, and then the visible range of the shooting group is determined by a preset radius. User B is within the visible range and can detect User A's Bluetooth signal, allowing User B to join the shooting group. User C is also within the visible range and can detect both User A and User B's Bluetooth signals, allowing User C to join the shooting group based on these signals. Similarly, User D joins the shooting group based on User C's Bluetooth signal. Although User E can detect User D's Bluetooth signal, User D is not within the visible range of the shooting group, so User D cannot find the shooting group and therefore cannot join. Although User G can detect the shooting group, User G is too far away from other users and cannot detect the Bluetooth signals of other users within the shooting group, thus preventing User G from joining. Even if users A, B, C, and D leave the visible range, they can still receive the target image because they have already joined the shooting group.

[0089] In one possible embodiment, before sending the first image to the server, the method further includes saving the first image locally.

[0090] During the generation of the target image for the target scene, interference in the first image is removed. The resulting target image may differ significantly from the initially captured first image. To meet user needs, the unprocessed first image can be saved locally. Therefore, even if the first image has been processed, the user can obtain both the unprocessed and processed images. The user can keep both images simultaneously or choose to save only one image according to their needs. For example, although the target image has removed interference, its aesthetic appeal may be lower than that of the unprocessed first image. Therefore, saving the first image locally provides users with choice and improves the user experience.

[0091] Saving the first image locally means saving the first image taken by each user to their respective electronic device.

[0092] like Figure 8 As shown, in some embodiments of this application, an image processing apparatus 800 is proposed for a server. The image processing apparatus 800 includes:

[0093] The generation module 810 is used to receive M first images sent by N electronic devices and generate a first image set, wherein the image similarity in the first image set is greater than or equal to a first threshold.

[0094] The determination module 820 is used to determine the first object as a non-interference object when the number of times the first object appears in the first image set is greater than a preset threshold.

[0095] The processing module 830 is used to process the images in the first image set according to the non-interference objects to obtain the target image of the target scene.

[0096] After generating the first image set, the occlusion portions of different images within the set vary. Each image includes at least one first object. When a first object appears more than a preset threshold in the first image set, it indicates that the first object has appeared in multiple images, meaning that the sub-image is a non-interference object. Based on this method, one or more non-interference objects can be identified, allowing for the determination of target images where the target scene is not occluded or where the occlusion is minimal. During the target image determination process, users do not need to frequently move around to find specific shooting angles. Images taken by other users can provide reference for the target image determination process, reducing the difficulty of the shooting process. Moreover, through mutual compensation of multiple images, users do not need to shoot at specific times, effectively improving shooting efficiency and convenience when shooting target scenes.

[0097] In one possible embodiment, the determining module 820 is further configured to: determine the first object as an interference object when the number of times the first object appears in the first image set is less than a preset threshold;

[0098] The processing module 830 is specifically used to: replace the interfering object with the non-interfering object to obtain the target image of the target scene; wherein the interfering object and the non-interfering object are in the same position in the image of the first image set.

[0099] In one possible embodiment, the image processing apparatus 800 further includes:

[0100] The first sending module is used to send the target image to P electronic devices, wherein the P electronic devices capture images from the first image set, and P≤N.

[0101] In one possible embodiment, the N electronic devices are devices in the same shooting group;

[0102] The first sending module is also used to: upon receiving a notification that the shooting group has disbanded, in response to the first input of Q users, update the target image and send the updated image to Q users, where Q≤P.

[0103] like Figure 9 As shown, in some embodiments of this application, an image processing apparatus 900 is proposed for an electronic device. The image processing apparatus 900 includes:

[0104] The second sending module 910 is used to send the first image to the server when the electronic devices are in a shooting group;

[0105] The receiving module 920 is used to receive the target image sent by the server, wherein the target image is the image after processing the first image based on the non-interference object.

[0106] By identifying one or more non-interference objects, a target image of the target scene can be determined based on these objects, ensuring that the scene is not obscured by any interference objects or that the obscuration is minimal. During the target image determination process, the user does not need to frequently move around to find specific shooting angles; images taken by other users can provide references, reducing the difficulty of the shooting process. Furthermore, through mutual compensation of multiple images, the user does not need to take a picture at a specific time, effectively improving shooting efficiency and convenience when capturing the target scene.

[0107] In one possible embodiment, the image processing apparatus 900 further includes:

[0108] The acquisition module is used to determine the duration of the shooting group and to acquire the signal connection strength between the electronic device and the server;

[0109] The extension module is used to extend the duration when the signal connection strength is less than a preset strength.

[0110] In one possible embodiment, the receiving module is further configured to receive a second input from the user, and in response to the second input, determine a first adjustment region of the first image;

[0111] The receiving module 920 is specifically used to receive a target image sent by the server, wherein the target image is an image after the first adjustment of the first image.

[0112] In one possible embodiment, the acquisition module is further configured to: determine the first electronic device that establishes the shooting group; acquire the location information of the first electronic device when establishing the shooting group; determine the visible range of the shooting group based on the location information; and determine the range within which the shooting group can be joined based on the visible range.

[0113] In one possible embodiment, the image processing apparatus 900 further includes:

[0114] The storage module is used to save the first image locally.

[0115] The image processing device in this application embodiment can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. For example, mobile electronic devices can be mobile phones, tablets, laptops, PDAs, in-vehicle electronic devices, wearable devices, ultra-mobile personal computers (UMPCs), netbooks, or personal digital assistants (PDAs), etc., while non-mobile electronic devices can be servers, network-attached storage (NAS), personal computers (PCs), televisions (TVs), ATMs, or self-service machines, etc. This application embodiment does not impose specific limitations.

[0116] The image processing device in this application embodiment can be a device with an operating system. The operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system.

[0117] The image processing apparatus provided in this application embodiment can implement the various processes implemented in the above method embodiments, and will not be described again here to avoid repetition.

[0118] Optionally, embodiments of this application also provide a server 1000. Figure 10 A structural block diagram of a server according to an embodiment of this application is shown, such as... Figure 10 As shown, it includes a first processor 1010, a first memory 1020, and a program or instruction stored in the first memory 1020 that can run on the first processor 1010. When the program or instruction is executed by the first processor 1010, it implements the various processes of the above method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0119] Optionally, embodiments of this application also provide an electronic device 1100. Figure 11 A structural block diagram of an electronic device according to an embodiment of this application is shown, such as... Figure 11 As shown, it includes a second processor 1110, a second memory 1120, and a program or instruction stored in the second memory 1120 that can run on the second processor 1110. When the program or instruction is executed by the second processor 1110, it implements the various processes of the above method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0120] It should be noted that the electronic devices in the embodiments of this application include the aforementioned mobile electronic devices and non-mobile electronic devices.

[0121] Figure 12 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.

[0122] The electronic device 1200 includes, but is not limited to, components such as: radio frequency unit 1201, network module 1202, audio output unit 1203, input unit 1204, sensor 1205, display unit 1206, user input unit 1207, interface unit 1208, memory 12012, and processor 1210.

[0123] Those skilled in the art will understand that the electronic device 1200 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 1210 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 12 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0124] The processor 1210 is used to send a first image to a server when the electronic device is in a shooting group; and to receive a target image sent by the server, wherein the target image is an image after processing the first image based on non-interference objects.

[0125] Optionally, the processor 1210 is used to: determine the duration of the shooting group and obtain the signal connection strength between the electronic device and the server; and extend the duration if the signal connection strength is less than a preset strength.

[0126] Optionally, the processor 1210 is configured to receive a second input from a user; in response to the second input, determine a first adjustment region of the first image; and receive a target image sent by a server, including: receiving the target image sent by the server, the target image being an image after adjusting the first adjustment region of the first image.

[0127] By identifying one or more non-interference objects, a target image of the target scene can be determined based on these objects, ensuring that the scene is not obscured by any interference objects or that the obscuration is minimal. During the target image determination process, the user does not need to frequently move around to find specific shooting angles; images taken by other users can provide references, reducing the difficulty of the shooting process. Furthermore, through mutual compensation of multiple images, the user does not need to take a picture at a specific time, effectively improving shooting efficiency and convenience when capturing the target scene.

[0128] It should be understood that, in the embodiments of this application, the input unit 1204 may include a graphics processing unit (GPU) 12041 and a microphone 12042. The graphics processing unit 12041 processes image data of still pictures or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode.

[0129] The display unit 1206 may include a display panel 12061, which may be configured using a liquid crystal display, an organic light-emitting diode, or other similar means. The user input unit 1207 includes a touch panel 12071 and other input devices 12072. The touch panel 12071 is also called a touchscreen. The touch panel 12071 may include a touch detection device and a touch controller. Other input devices 12072 may include, but are not limited to, a physical keyboard, function keys (such as volume control buttons, power buttons, etc.), a trackball, a mouse, and a joystick, which will not be elaborated further here. The memory 12012 can be used to store software programs and various data, including but not limited to application programs and the operating system. The processor 1210 may integrate an application processor and a modem processor. The application processor mainly handles the operating system, user interface, and application programs, while the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 1210.

[0130] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0131] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0132] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above method embodiments and achieve the same technical effect. To avoid repetition, it will not be described again here.

[0133] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0134] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0135] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0136] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. An image processing method applied to a server, characterized in that, The method comprises: receiving M first images sent by N electronic devices to generate a first image set, wherein the image similarity in the first image set is greater than or equal to a first threshold, N is greater than or equal to 2, and M is greater than or equal to 2; in a case where the number of occurrences of a first object in the first image set is greater than a preset threshold, determining the first object as a non-interference object; processing the images in the first image set according to the non-interference object to obtain a target image of a target scene; sending the target image to P electronic devices, wherein the P electronic devices capture the images in the first image set, and P is less than or equal to N; the target image received by each of the P electronic devices is obtained based on the first image sent by each of the electronic devices; the N electronic devices are devices in a same shooting group; after the target image is sent to the P electronic devices, the method further comprises: in a case where a shooting group disbanding prompt is received, updating the target image in response to first input of Q users, and sending the updated image to the Q users, wherein Q is less than or equal to P.

2. The image processing method of claim 1, wherein after the first image set is generated, the method further comprises: in a case where the number of occurrences of a first object in the first image set is less than a preset threshold, determining the first object as an interference object; the processing of the first image according to the non-interference object to obtain the target image of the target scene comprises: replacing the interference object with the non-interference object to obtain the target image of the target scene; wherein the interference object and the non-interference object have the same position in the images in the first image set.

3. An image processing method applied to an electronic device, comprising: The method comprises: in a case where the electronic device is in a shooting group, sending a first image to a server; receiving a target image sent by the server, wherein the target image is an image obtained by processing the first image according to a non-interference object, the non-interference object is a first object with a number of occurrences in a first image set greater than a preset threshold, the first image set is generated according to M first images sent by N electronic devices, the image similarity in the first image set is greater than or equal to a first threshold, and P electronic devices capture the images in the first image set, wherein P is less than or equal to N, N is greater than or equal to 2, and M is greater than or equal to 2; wherein the target image received by each of the electronic devices is obtained based on the first image sent by each of the electronic devices; when a user who establishes the shooting group disbands the shooting group, a prompt of whether to update the target image pops up on the terminal of P users.

4. The image processing method of claim 3, wherein, before the electronic device sends the first image to the server in a case where the electronic device is in a shooting group, the method further comprises: determining the duration of the shooting group and obtaining the signal connection strength between the electronic device and the server; in a case where the signal connection strength is less than a preset strength, extending the duration.

5. The image processing method of claim 3 or 4, characterized in that, The sending first image to the server further comprises: receiving a second input of a user; in response to the second input, determining a first adjustment region of the first image; The receiving target image sent by the server comprises: receiving the target image sent by the server, the target image being the image after the first adjustment region of the first image.

6. An image processing apparatus applied to a server, comprising: Comprise: a generating module, configured to receive M first images sent by N electronic devices, and generate a first image set, wherein the image similarity in the first image set is greater than or equal to a first threshold, N is greater than or equal to 2, and M is greater than or equal to 2; a determining module, configured to determine a first object as a non-interference object if the number of occurrences of the first object in the first image set is greater than a preset threshold; a processing module, configured to process the images in the first image set according to the non-interference object to obtain a target image of a target scene; a first sending module, configured to send the target image to P electronic devices, wherein the P electronic devices capture the images in the first image set, and P≤N; The target image received by each of the P electronic devices is obtained by processing the first image sent by each of the electronic devices; The N electronic devices are devices in a same shooting group; The first sending module is further configured to, in response to a first input of Q users, update the target image and send the updated image to the Q users if a shooting group dissolving prompt is received, wherein Q≤P.

7. An image processing apparatus applied to an electronic device, comprising: Comprise: a sending module, configured to send a first image to a server if the electronic device is in a shooting group; a receiving module, configured to receive a target image sent by the server, wherein the target image is an image obtained by processing the first image according to a non-interference object, the non-interference object is a first object with a number of occurrences greater than a preset threshold in a first image set, the first image set is generated according to M first images sent by N electronic devices, the image similarity in the first image set is greater than or equal to a first threshold, and P electronic devices capture the images in the first image set, wherein P≤N, N is greater than or equal to 2, and M is greater than or equal to 2; wherein the target image received by each of the electronic devices is obtained by processing the first image sent by each of the electronic devices; When a user who establishes the shooting group releases the shooting group, a prompt of whether to update the target image pops up on the terminal of P users.

8. A server, characterized by Comprise a first processor, a first memory, and a program or instruction stored on the first memory and executable on the first processor, and the program or instruction is executed by the first processor to realize the steps of the method of claim 1 or 2.

9. An electronic device, comprising: Comprise a second processor, a second memory, and a program or instruction stored on the second memory and executable on the second processor, and the program or instruction is executed by the second processor to realize the steps of the method of any one of claims 3 to 5.

10. A readable storage medium, characterized by, The readable storage medium stores programs or instructions, which are executed by the processor to implement the steps of the method according to any one of claims 1 to 5.

Citation Information

Patent Citations

  • Image processing method and camera

    CN101938604A

  • Shooting method and device, electronic equipment and readable storage medium

    CN112399079A