Image processing method and apparatus

Abstract

This application discloses an image processing method and apparatus. The method includes: obtaining a first operation; the first operation being used to open a first image; in response to the first operation, if the first image satisfies a first condition, obtaining a second image; the first condition indicating that the image cannot be opened; outputting the second image; the second image satisfying a second condition, the second condition indicating that the image can be opened, and the second image having the same target feature as the first image, wherein the target feature satisfies the display requirement triggered by the user in the first operation.

Description

Technical Field

[0001] This application relates to the field of image processing technology, and in particular to an image processing method and apparatus. Background Technology

[0002] In social applications, if an image sent by a friend is not loaded into memory in a timely manner, or if the original image is cached in memory for a certain period of time, the image will expire and become unopenable. Summary of the Invention

[0003] In view of the above, this application provides an image processing method and apparatus, as follows:

[0004] An image processing method, comprising:

[0005] A first operation is obtained; the first operation is used to open the first image;

[0006] In response to the first operation, if the first image satisfies the first condition, a second image is obtained; the first condition indicates that the image cannot be opened.

[0007] Output the second image; the second image satisfies the second condition, the second condition indicates that it can be opened, and the second image has the same target features as the first image, the target features satisfying the display requirements of the user triggering the first operation.

[0008] The above method, preferably, involves obtaining the second image by:

[0009] Obtain the display image corresponding to the first image; the display image is the image after the first image is compressed according to the target compression ratio, and the display image is displayed on the operation interface before the first image is opened, and the first image is opened by triggering the display image;

[0010] A second image is obtained based on the displayed image.

[0011] The above method, preferably, involves obtaining a second image based on the displayed image, including:

[0012] The displayed image is filled with content using an image generation model to generate a second image.

[0013] The above method, preferably, involves obtaining a second image based on the displayed image, including:

[0014] Obtain at least one associated image that is related to the displayed image; the association is related to the target feature;

[0015] Select the second image from the associated images.

[0016] Preferably, in the above method, obtaining at least one associated image that is related to the displayed image includes:

[0017] Images that have the same or similar target features as the displayed image are identified as the associated images;

[0018] The target features include a first feature, a second feature, and / or a third feature; the first feature reflects the text content contained in the image, the second feature reflects the color distribution in the image, and the third feature reflects the target category contained in the image.

[0019] In the above method, preferably, selecting a second image from the associated images includes:

[0020] Obtain at least one image parameter of the associated image;

[0021] Among the associated images, the associated image whose image parameters satisfy the preferred conditions is selected as the second image;

[0022] The preferred conditions are related to image quality.

[0023] In the above method, preferably, images with the aforementioned association are assigned the same image identifier, which is used to determine whether the images have the aforementioned association.

[0024] The method further includes:

[0025] When an image is received, the target image set is filtered to see if there are any candidate images that satisfy the association relationship with the received image;

[0026] If there is a candidate image in the target image set that satisfies the association relationship with the received image, set an image identifier for the received image that is the same as the image identifier of the candidate image;

[0027] If the target image set does not contain a candidate image that satisfies the association relationship with the received image, a new image identifier is set for the received image;

[0028] Add the received image and the set image identifier to the target image set.

[0029] In the above method, preferably, the first image satisfies a first condition, including:

[0030] The first image was not found in the current cache area.

[0031] Preferably, the above method further includes:

[0032] If the second image is not obtained, a prompt message is output, indicating that the first image cannot be opened.

[0033] An image processing apparatus, comprising:

[0034] An operation acquisition unit is used to acquire a first operation; the first operation is used to open a first image.

[0035] An image acquisition unit is configured to, in response to the first operation, acquire a second image if the first image satisfies a first condition; the first condition indicates that the image cannot be opened.

[0036] An image output unit is used to output the second image; the second image satisfies a second condition, the second condition indicating that it can be opened, and the second image has the same target features as the first image, the target features satisfying the display requirements of the user triggering the first operation.

[0037] As can be seen from the above technical solutions, in the image processing method and apparatus disclosed in this application, after obtaining the first operation for opening the first image, if the first image cannot be opened, then a second image with the same target image as the first image and which can be opened is obtained. After the second image is output, the target features of the second image satisfy the display requirements of the user triggering the first operation. Attached Figure Description

[0038] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0039] Figure 1 A flowchart illustrating an image processing method provided in an embodiment of this application;

[0040] Figure 2 This is an example diagram of opening an image in a social application according to an embodiment of this application;

[0041] Figure 3 This is a partial flowchart of an image processing method provided in an embodiment of this application;

[0042] Figure 4 This is a schematic diagram of the structure of an image processing apparatus provided in an embodiment of this application;

[0043] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0044] Figure 6This is a flowchart illustrating the processing of images received in social applications, applicable to this application.

[0045] Figure 7 This is a flowchart illustrating the processing flow when opening images in social applications, which is applicable to this application. Detailed Implementation

[0046] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0047] refer to Figure 1 The diagram shown is a flowchart illustrating the implementation of an image processing method according to an embodiment of this application. This method can be applied to electronic devices capable of image processing, such as mobile phones, tablets, computers, or servers. The technical solution in this embodiment is mainly used to improve the reliability of image output.

[0048] Specifically, the method in this embodiment may include the following steps:

[0049] Step 101: Obtain the first operation.

[0050] The first operation is used to open the first image.

[0051] For example, taking a mobile phone as an example, such as Figure 2 As shown, in a mobile social application, a friend sent a screenshot of a transaction history to the user three months ago. A thumbnail of the screenshot is displayed on the application's interface. The user clicks on this thumbnail to trigger the first action. This first action is used to open the original image corresponding to the thumbnail (this original image may include a low-resolution large image or a high-resolution large image that has been further loaded or super-resolutiond). However, due to the passage of time, the original image loaded into the cache three months ago may have been cleared.

[0052] Step 102: In response to the first operation, determine whether the first image meets the first condition. If the first image meets the first condition, execute step 103. If the first image does not meet the first condition, then execute step 104.

[0053] The first condition indicates that the image cannot be opened. That is, the first image cannot be opened. For example, such as... Figure 2 As shown, the original image loaded as a thumbnail in the interactive interface was cleared due to the passage of time, causing the original image to be unable to be opened.

[0054] Specifically, the first image satisfies the first condition: the first image was not found in the current cache area. That is, the first image in the current cache area was cleared because it was too old.

[0055] Step 103: Obtain the second image and output the second image.

[0056] Step 104: Output the first image.

[0057] The second image satisfies the second condition. The second condition indicates that the image can be opened. Furthermore, the second image has the same target features as the first image, and these target features satisfy the display requirements for the user to trigger the first operation.

[0058] For example, such as Figure 2 As shown, when the original image corresponding to the screenshot thumbnail of the account details cannot be opened, this embodiment finds other images that have the target features of the original image and can be opened, namely, a second image. That is, it checks whether there is an original image containing the account details. If the phone has recently loaded the original image corresponding to a screenshot with the same account details sent by a social friend or other friend, then the found original image is output as the second image, so that the user can also know the target features, namely the account details.

[0059] Furthermore, if the second image is not obtained in step 103, a prompt message can be output indicating that the first image cannot be opened. For example, such as... Figure 2 As shown, if a second image is obtained, the second image is output; otherwise, the message "Cannot open" is output.

[0060] As can be seen from the above technical solutions, in the image processing method provided by this application embodiment, after obtaining a first operation for opening a first image, if the first image cannot be opened, then a second image with the same target image as the first image and which can be opened is obtained. After outputting the second image, the target features of the second image satisfy the user's display requirements triggered by the first operation. Therefore, in this application, when an image needs to be opened but cannot be opened, other images with the same target features as the image to be opened can be searched, thus outputting an image that meets the user's display requirements, thereby improving the reliability of image output.

[0061] Moreover, this application eliminates the need for users to manually search for images that can be opened; it can find and output images with the same target features, thereby improving the efficiency of image output.

[0062] In one implementation, obtaining the second image in step 103 can be achieved in the following way: Figure 3 As shown:

[0063] Step 301: Obtain the display image corresponding to the first image.

[0064] The displayed image is the first image compressed according to the target compression rate. The displayed image is shown on the operation interface before the first image is opened. The first image is opened by triggering the display image.

[0065] For example, such as Figure 2 As shown, the displayed image is a thumbnail of the account details. The thumbnail is displayed on the interactive interface (i.e., the operation interface). Users can click on the thumbnail to trigger the opening of the original image of the account details.

[0066] Step 302: Obtain the second image based on the displayed image.

[0067] For example, such as Figure 2 As shown, the second image is obtained by following the image content, image features, or pixel values ​​at each pixel point in the thumbnail.

[0068] In one implementation, step 302 can utilize an image generation model to fill the displayed image with content to generate a second image.

[0069] The image generation model can be a machine learning model. For example, in this embodiment, the image generation model can be used to perform pixel interpolation on the displayed image to generate a second image. Alternatively, in this embodiment, the image generation model can be used to construct an image according to the target features represented by the displayed image to obtain a second image.

[0070] In another implementation, in step 302, at least one associated image that is related to the displayed image can be obtained first. The association relationship is related to the target feature. That is, the associated image that has an association condition related to the target feature is obtained. Then, the second image is selected from these associated images.

[0071] Specifically, in step 302, when obtaining associated images, images with the same or similar target features as the displayed image can be identified as associated images.

[0072] The target features include any one or more of the first feature, second feature, and third feature. The first feature reflects the text content contained in the image, the second feature reflects the color distribution in the image, and the third feature reflects the target category contained in the image. For example, in this embodiment, the pixel values ​​of each pixel in the displayed image can be analyzed, and then the image features corresponding to the displayed image, such as the first feature, second feature, and third feature, can be identified based on the pixel values ​​of each pixel. Then, images with the same or similar features are searched for, i.e., associated images.

[0073] For example, in this embodiment, by parsing the pixel value of each pixel in the displayed image, the text content such as account details, color distribution, and the target type contained therein such as cat, dog, or person are identified. Based on these features, images with the same or similar features are searched. Among the associated images found, the displayed image satisfies at least one of the following association conditions:

[0074] The associated image and the displayed image have the same or similar text content;

[0075] The associated image and the displayed image have the same or similar color distribution;

[0076] The associated image and the displayed image have the same or similar target type, such as a person or a cat.

[0077] In another specific implementation, when selecting the second image from the associated images in step 302, at least one image parameter of the associated image can be obtained first, and then the associated image whose image parameter satisfies the preferred condition can be selected as the second image.

[0078] Among these, the preferred conditions are related to image quality. For example, preferred conditions include: the highest image sharpness or the highest image resolution.

[0079] In other words, in this embodiment, the clarity or resolution of each associated image is first analyzed, and then the associated image with the highest clarity or resolution is selected as the second image. For example, the second image is the original image of the thumbnail that has been cached, or the second image is the image with the same account details as the thumbnail and the highest clarity.

[0080] In another implementation, images with a relationship are assigned the same image identifier, which is used to determine whether the images are related. For example, if two images have the same image identifier, then the two images are related.

[0081] Therefore, in step 302, when obtaining associated images that are related to the displayed image, this can be achieved by using the image identifier of the displayed image. For example, by using the image identifier of the displayed image, images with the same image identifier can be filtered from the stored target image set, thus identifying images with the same image identifier as the displayed image as associated images.

[0082] The target image set stores multiple images, each with its own image identifier, such as an image sequence number. The target image set is a collection of images cached by the electronic device.

[0083] Based on this, in this embodiment, when an image is received, the target image set can be filtered to see if there are any candidate images that satisfy the association conditions of the received images. If there are candidate images in the target image set that satisfy the association conditions of the received images, such as having the same image identifier, then the received image is set with the same image identifier as the candidate image (i.e., the image that satisfies the association conditions with the received image). If there are no candidate images in the target image set that satisfy the association relationship of the received images, then a new image identifier is set for the received image. Then, the received image and the set image identifier are added to the target image set.

[0084] In this way, if the received image cannot be opened later, images with the same image identifier can be filtered in the target image set according to its image identifier, these images can be used as associated images, and then the second image can be obtained from the associated images.

[0085] For example, when a thumbnail is received on a social application, it is first compared with images in the target image set. If there are images in the target image set that have the same or similar target features as the thumbnail, then it is determined that the image and the thumbnail meet the association condition. At this time, the image identifier of the image can be set to the thumbnail. If there are no images in the target image set that have the same or similar target features as the thumbnail, then a new image identifier is generated for the thumbnail.

[0086] refer to Figure 4 This is a schematic diagram of an image processing device provided in an embodiment of this application. The device can be configured in an electronic device capable of image processing, such as a mobile phone, tablet computer, computer, or server. The technical solution in this embodiment is mainly used to improve the reliability of image output.

[0087] Specifically, the device in this embodiment may include the following units:

[0088] Operation acquisition unit 401 is used to acquire a first operation; the first operation is used to open a first image;

[0089] Image acquisition unit 402 is configured to, in response to the first operation, acquire a second image if the first image satisfies a first condition; the first condition indicates that the image cannot be opened.

[0090] Image output unit 403 is used to output the second image; the second image satisfies a second condition, the second condition indicates that it can be opened, and the second image has the same target feature as the first image, the target feature satisfies the display requirements of the user triggering the first operation.

[0091] As can be seen from the above technical solutions, in the image processing apparatus provided in this application embodiment, after obtaining a first operation for opening a first image, if the first image cannot be opened, then a second image with the same target image as the first image and capable of being opened is obtained. After outputting the second image, the target features of the second image satisfy the user's display requirements triggered by the first operation. Therefore, in this application, when an image needs to be opened but cannot be opened, other images with the same target features as the image to be opened can be searched, thus outputting an image that meets the user's display requirements, thereby improving the reliability of image output.

[0092] Moreover, this application eliminates the need for users to manually search for images that can be opened; it can find and output images with the same target features, thereby improving the efficiency of image output.

[0093] In one implementation, the image acquisition unit 402 is specifically used to: acquire a display image corresponding to the first image; the display image is an image after the first image has been compressed according to a target compression ratio, the display image is displayed on the operation interface before the first image is opened, the first image is opened by triggering the display image; and acquire a second image based on the display image.

[0094] In one implementation, when the image acquisition unit 402 obtains a second image based on the displayed image, it is specifically used to: fill the content of the displayed image using an image generation model to generate a second image.

[0095] In one implementation, when the image acquisition unit 402 acquires a second image based on the displayed image, it is specifically configured to: acquire at least one associated image that is related to the displayed image; the association is related to the target feature; and select the second image from the associated images.

[0096] In one implementation, when the image acquisition unit 402 acquires at least one associated image that is related to the displayed image, it is specifically configured to: determine the image that has the same or similar target features as the displayed image as the associated image; wherein, the target features include a first feature, a second feature and / or a third feature; the first feature reflects the text content contained in the image, the second feature reflects the color distribution in the image, and the third feature reflects the target category contained in the image.

[0097] In one implementation, when the image acquisition unit 402 selects a second image from the associated images, it is specifically configured to: acquire at least one image parameter of the associated images; and select an associated image whose image parameter satisfies a preferred condition as the second image; wherein the preferred condition is related to image quality.

[0098] In one implementation, images with the aforementioned association are assigned the same image identifier, which is used to determine whether the images have the aforementioned association. The image acquisition unit 402 is further configured to: when an image is received, filter the target image set to see if there are any candidate images that satisfy the association relationship with the received image; if there are candidate images in the target image set that satisfy the association relationship with the received image, assign the received image the same image identifier as the candidate image; if there are no candidate images in the target image set that satisfy the association relationship with the received image, assign a new image identifier to the received image; and add the received image and the assigned image identifier to the target image set.

[0099] In one implementation, the first image satisfies a first condition, including: the first image is not found in the current cache region.

[0100] In one implementation, the image output unit 403 is further configured to: if the image acquisition unit 402 fails to acquire the second image, output a prompt message indicating that the first image cannot be opened.

[0101] It should be noted that the specific implementation of each unit in this embodiment can be referred to the corresponding content above, and will not be described in detail here.

[0102] refer to Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. The electronic device may include the following structure:

[0103] Memory 501 is used to store computer programs and data generated during the execution of computer programs;

[0104] Processor 502 is used to execute computer programs to achieve:

[0105] A first operation is obtained; the first operation is used to open the first image;

[0106] In response to the first operation, if the first image satisfies the first condition, a second image is obtained; the first condition indicates that the image cannot be opened.

[0107] Output the second image; the second image satisfies the second condition, the second condition indicates that it can be opened, and the second image has the same target features as the first image, the target features satisfying the display requirements of the user triggering the first operation.

[0108] As can be seen from the above technical solutions, in the electronic device provided by this application embodiment, after obtaining a first operation for opening a first image, if the first image cannot be opened, then a second image with the same target image as the first image and which can be opened is obtained. After outputting the second image, the target features of the second image satisfy the user's display requirement for triggering the first operation. Therefore, in this application, when an image needs to be opened but cannot be opened, other images with the same target features as the image to be opened can be searched, thus outputting an image that meets the user's display requirements, thereby improving the reliability of image output.

[0109] Moreover, this application eliminates the need for users to manually search for images that can be opened; it can find and output images with the same target features, thereby improving the efficiency of image output.

[0110] Taking social media software on a mobile phone as an example, the technical solution of this application is illustrated below:

[0111] In social media apps, if a received image isn't opened and the original image isn't loaded, it will expire and become unopenable after a certain period. However, the same image might be received multiple times, and some of those images might have been loaded. This application can then identify the actually loaded image from the chat history.

[0112] To address the above problems, this application proposes the following solutions:

[0113] First, after the user receives the image, the image thumbnail is compared with the thumbnails of other previously received images; the RGB values ​​of each pixel unit in the two thumbnails are compared; if the comparison results are consistent, the two images are assigned the same serial number and associated as an image set.

[0114] When a user finds an image but cannot open it, the system will provide the user with the original image that was saved in the associated image set, allowing the user to directly switch to the original image.

[0115] For example, such as Figure 6As shown, when a user receives an image, the thumbnails of the newly received image and the historically cached old images can be compared. For example, the RGB values ​​of the thumbnail units of the old images and the new images can be compared. If the comparison results are inconsistent, a new sequence number (i.e., the image identifier mentioned above) is generated for the new image and stored in the image. This sequence number is different from the sequence numbers of other images. If the comparison results are consistent, the sequence number of the old images is assigned to the new images for storage. In this way, images with the same sequence number are associated as an image set.

[0116] Based on this, such as Figure 7 As shown, when a user needs to view an image but the image cannot be opened, the system first checks if there is a related image, i.e., if there is an image with the same serial number. If no related image set exists, the system prompts that the image has expired and cannot be viewed. If a related image exists, i.e., the related image mentioned above, the system searches the related image set for the original image corresponding to the thumbnail. If the original image does not exist, the system filters the image with the highest clarity and contains the text content of the thumbnail from the related image set for output, or if the original image does not exist, the system prompts that the image has expired and cannot be viewed. If the original image exists, the system directly loads the original image for the user to view.

[0117] It is evident that the technical solution of this application has the following advantages:

[0118] First, this application automatically processes and stores images in the background after receiving them, reducing the user's comparison waiting time and improving reliability and efficiency;

[0119] Furthermore, in this application, users do not need to search for photos themselves, making it faster and more convenient to obtain images, thus providing reliability and efficiency.

[0120] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to the method section.

[0121] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0122] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein can be implemented directly by hardware, a software module executed by a processor, or a combination of both. The software module can be located in random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

[0123] The above description of the disclosed embodiments enables those skilled in the art to make or use this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An image processing method, comprising: Get the first action; The first operation is used to open the first image; In response to the first operation, if the first image satisfies the first condition, the second image is obtained; The first conditional representation cannot be turned on; Output the second image; the second image satisfies the second condition, the second condition indicates that it can be opened, and the second image has the same target feature as the first image, the target feature satisfies the display requirements of the user triggering the first operation; Obtaining the second image includes: Obtain the display image corresponding to the first image; the display image is the image after the first image is compressed according to the target compression ratio, and the display image is displayed on the operation interface before the first image is opened, and the first image is opened by triggering the display image; A second image is obtained based on the displayed image.

2. The method according to claim 1, wherein obtaining a second image based on the displayed image comprises: The displayed image is filled with content using an image generation model to generate a second image.

3. The method according to claim 1, wherein obtaining a second image based on the displayed image comprises: Obtain at least one associated image that is related to the displayed image; The association relationship is related to the target feature; Select the second image from the associated images.

4. The method according to claim 3, wherein obtaining at least one associated image that is related to the displayed image comprises: Images that have the same or similar target features as the displayed image are identified as the associated images; The target features include a first feature, a second feature, and / or a third feature; the first feature reflects the text content contained in the image, the second feature reflects the color distribution in the image, and the third feature reflects the target category contained in the image.

5. The method according to claim 3, wherein selecting a second image from the associated images comprises: Obtain at least one image parameter of the associated image; Among the associated images, the associated image whose image parameters satisfy the preferred conditions is selected as the second image; The preferred conditions are related to image quality.

6. The method according to claim 3, wherein images having the association relationship are provided with the same image identifier, the image identifier being used to determine whether the images have the association relationship; The method further includes: When an image is received, the target image set is filtered to see if there are any candidate images that satisfy the association relationship with the received image; If there is a candidate image in the target image set that satisfies the association relationship with the received image, set an image identifier for the received image that is the same as the image identifier of the candidate image; If the target image set does not contain a candidate image that satisfies the association relationship with the received image, a new image identifier is set for the received image; Add the received image and the set image identifier to the target image set.

7. The method according to claim 1, wherein the first image satisfies a first condition, including: The first image was not found in the current cache area.

8. The method according to claim 1, further comprising: If the second image is not obtained, a prompt message is output, indicating that the first image cannot be opened.

9. An image processing apparatus, comprising: An operation acquisition unit is used to acquire the first operation; The first operation is used to open the first image; An image acquisition unit is configured to, in response to the first operation, obtain a display image corresponding to the first image if the first image satisfies a first condition; the display image is an image after the first image has been compressed according to a target compression ratio, and the display image is displayed on the operation interface before the first image is opened, and the first image is opened by triggering the display image. Based on the displayed image, obtain the second image; The first conditional representation cannot be turned on; An image output unit is used to output the second image; the second image satisfies a second condition, the second condition indicating that it can be opened, and the second image has the same target features as the first image, the target features satisfying the display requirements of the user triggering the first operation.

Images