Image processing methods and apparatus

Abstract

This application discloses an image processing method and apparatus, belonging to the field of Internet technology. The method includes: acquiring an image to be processed; determining the location information of the image to be processed, the location information including at least one of the acquisition time of the image to be processed and the user identifier of a user logged into a first application, wherein the first application is an application running in the foreground at the acquisition time; acquiring a processed image based on the location information and the image to be processed, wherein the reference position of the processed image displays identification information, the identification information being obtained based on the location information. The image obtained by this image processing method displays identification information based on the location information, enabling image location without offline communication between operators and users, saving time required for locating application anomalies, thereby improving the efficiency of anomaly location and repair.

Description

Technical Field

[0001] This application relates to the field of Internet technology, and in particular to an image processing method and apparatus. Background Technology

[0002] With the continuous development of internet technology, the variety of applications is increasing, and some applications may encounter abnormal problems during operation. In order to fix these problems, users obtain images of the application encountering abnormalities and post them on relevant platforms to seek help.

[0003] After viewing the image, the application's operations staff obtained the user's identifier and the time the anomaly occurred through offline communication. Based on the user identifier and the time of occurrence, they located the anomaly and then attempted to fix it. However, due to the low efficiency of offline communication, locating the anomaly took a long time, resulting in low anomaly location efficiency and consequently low anomaly fix efficiency.

[0004] Therefore, there is an urgent need for an image processing method that can process images to enable operators to obtain user identification and the time of occurrence of abnormal issues without offline communication with users, thereby saving the time required to locate abnormal issues and improving the efficiency of abnormal issue location and repair. Summary of the Invention

[0005] This application provides an image processing method and apparatus, which can be used to solve problems in related technologies. The technical solution is as follows:

[0006] In a first aspect, embodiments of this application provide an image processing method, the method comprising:

[0007] In response to an image acquisition command on the display interface of the first application, acquire the image to be processed;

[0008] Based on the location information of the image to be processed and the image to be processed, a processed image is obtained. The reference position of the processed image is displayed with identification information, which is obtained based on the location information. The location information includes at least one of the acquisition time of the image to be processed and the user identifier of the user logged in in the first application.

[0009] Secondly, embodiments of this application provide an image processing method, the method comprising:

[0010] Obtain the image to be processed;

[0011] Determine the location information of the image to be processed, the location information including at least one of the acquisition time of the image to be processed and the user identifier of the user logged in in the first application, wherein the first application is an application that is running in the foreground at the acquisition time.

[0012] Based on the positioning information and the image to be processed, a processed image is obtained. The reference position of the processed image is marked with identification information, which is obtained based on the positioning information.

[0013] Thirdly, embodiments of this application provide an image processing apparatus, the apparatus comprising:

[0014] The first acquisition module is used to acquire the image to be processed in response to an image acquisition instruction on the display interface of the first application.

[0015] The second acquisition module is used to acquire a processed image based on the location information of the image to be processed and the image to be processed. The reference position of the processed image is displayed with identification information, which is obtained based on the location information. The location information includes at least one of the acquisition time of the image to be processed and the user identifier of the user logged in in the first application.

[0016] In one possible implementation, the device further includes:

[0017] The sending module is used to send a new image generation notification to the first application. The new image generation notification is used by the first application to obtain the image to be processed after obtaining the image to be processed, based on the location information of the image to be processed and the image to be processed.

[0018] A receiving module is used to receive the processed image sent by the first application.

[0019] In one possible implementation, the device further includes:

[0020] The display module is used to display the processed image.

[0021] In one possible implementation, the identification information is an encryption result obtained based on the location information and the encryption algorithm corresponding to the first application.

[0022] Fourthly, embodiments of this application provide an image processing apparatus, the apparatus comprising:

[0023] The first acquisition module is used to acquire the image to be processed;

[0024] The determining module is used to determine the location information of the image to be processed. The location information includes at least one of the acquisition time of the image to be processed and the user identifier of the user logged in in the first application. The first application is an application that is running in the foreground at the acquisition time.

[0025] The second acquisition module is used to acquire a processed image based on the positioning information and the image to be processed. The reference position of the processed image is displayed with identification information, which is obtained based on the positioning information.

[0026] In one possible implementation, the second acquisition module is used to acquire an encryption result based on the location information and use the encryption result as the identification information;

[0027] Alternatively, the location information can be directly used as the identification information.

[0028] In one possible implementation, the second acquisition module is used to acquire the encryption result based on the location information and the encryption algorithm corresponding to the first application.

[0029] In one possible implementation, the second acquisition module is used to acquire the encryption result based on the location information and the public key included in the encryption algorithm corresponding to the first application.

[0030] In one possible implementation, the first acquisition module is configured to receive an image acquisition instruction for the display interface of the first application when displaying the display interface of the first application, capture a first candidate image based on the image acquisition instruction, and use the first candidate image as the image to be processed.

[0031] In one possible implementation, the device further includes:

[0032] The receiving module is used to receive a new image generation notification, and obtain a second candidate image generated by the electronic device based on the new image generation notification. The first application is in the foreground running state when the second candidate image is generated.

[0033] The first acquisition module is used to use the second candidate image as the image to be processed when the image information of the second candidate image meets the image processing requirements.

[0034] In one possible implementation, the image information of the second candidate image includes the image size of the second candidate image. When the image size of the second candidate image is consistent with the screen size of the electronic device, the second candidate image meets the image processing requirements.

[0035] In one possible implementation, the image information of the second candidate image includes the acquisition path of the second candidate image. When the acquisition path of the second candidate image includes a keyword, the second candidate image meets the image processing requirements. The keyword is used to indicate that the second candidate image is a screenshot.

[0036] In one possible implementation, the image information of the second candidate image includes the image size and acquisition path of the second candidate image. When the image size of the first candidate image is consistent with the screen size of the electronic device, and the acquisition path of the first candidate image includes keywords, the first candidate image meets the image processing requirements.

[0037] In one possible implementation, the first acquisition module is further configured to acquire the storage location of the image to be processed;

[0038] The device further includes:

[0039] A storage module is used to store the processed image in the storage location of the image to be processed.

[0040] Fifthly, embodiments of this application provide an electronic device, which includes a processor and a memory. The memory stores at least one piece of program code, which is loaded and executed by the processor to enable the electronic device to implement the image processing method described in the first aspect.

[0041] In a sixth aspect, embodiments of this application provide an electronic device in which an application program is installed and runs, the application program being used to implement the image processing method described in the second aspect above.

[0042] In a seventh aspect, a computer-readable storage medium is also provided, wherein at least one piece of program code is stored therein, the at least one piece of program code being loaded and executed by a processor to enable a computer to implement any of the image processing methods described above.

[0043] Eighthly, a computer program or computer program product is also provided, wherein the computer program or computer program product stores at least one computer instruction, which is loaded and executed by a processor to enable the computer to implement any of the above-described image processing methods.

[0044] The technical solution provided in this application has at least the following beneficial effects:

[0045] The technical solution provided in this application addresses anomalies in image-based location applications. Since the reference location of the processed image displays identification information, and this identification information is derived from the location information of the image to be processed, location information can be obtained based on this identification information. This eliminates the need for offline communication between operators and users; location information can be obtained directly from the processed image, resulting in high efficiency. Based on this location information, application anomalies can be located and repaired, saving time required for locating these anomalies and further improving the efficiency of anomaly location and repair. Attached Figure Description

[0046] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0047] Figure 1 This is a schematic diagram of the implementation environment of an image processing method provided in an embodiment of this application;

[0048] Figure 2 This is a flowchart of an image processing method provided in an embodiment of this application;

[0049] Figure 3 This is a flowchart of an image processing method provided in an embodiment of this application;

[0050] Figure 4 This is a schematic diagram of an image to be processed provided in an embodiment of this application;

[0051] Figure 5 This is a schematic diagram of a processed image provided in an embodiment of this application;

[0052] Figure 6 This is a flowchart of an image processing method provided in an embodiment of this application;

[0053] Figure 7 This is a flowchart of a method for obtaining identification information provided in an embodiment of this application;

[0054] Figure 8 This is a flowchart of an image processing method provided in an embodiment of this application;

[0055] Figure 9 This is a schematic diagram of the structure of an image processing device provided in an embodiment of this application;

[0056] Figure 10This is a schematic diagram of the structure of an image processing device provided in an embodiment of this application;

[0057] Figure 11 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0058] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0059] Figure 1 This is a schematic diagram of the implementation environment of an image processing method provided in an embodiment of this application, such as... Figure 1 As shown, the implementation environment includes: electronic device 101.

[0060] Electronic device 101 may be at least one of a smartphone, game console, desktop computer, tablet computer, e-book reader, MP3 (Moving Picture Experts Group Audio Layer III) player, MP4 (Moving Picture Experts Group Audio Layer IV) player, in-vehicle terminal, and laptop computer. Electronic device 101 is used to execute the image processing method provided in the embodiments of this application. Alternatively, electronic device 101 may have a first application for image processing installed and running, which executes the image processing method provided in the embodiments of this application. The first application can be any type of application, and this embodiment of the application does not limit it. The first application is an application that needs to locate abnormal problems.

[0061] Electronic device 101 can refer to one of a plurality of electronic devices. This embodiment uses electronic device 101 as an example only. Those skilled in the art will know that the number of electronic devices 101 can be more or less. For example, there may be only one electronic device 101, or there may be dozens or hundreds of electronic devices 101, or even more. This application embodiment does not limit the number or type of electronic devices.

[0062] Based on the above implementation environment, this application provides an image processing method to... Figure 2 The flowchart shown in this embodiment of the application illustrates an image processing method. This method can be implemented by... Figure 1 The electronic device 101 in the system performs the operation. For example... Figure 2 As shown, the method includes the following steps:

[0063] In step 201, in response to an image acquisition instruction on the display interface of the first application, an image to be processed is acquired.

[0064] In an exemplary embodiment of this application, a first application is installed and runs on the electronic device. The first application may be a social application, a game application, a science popularization application, or a video application. This embodiment of the application does not limit the type of the first application.

[0065] In one possible implementation, when the first application is running in the foreground, that is, when the screen of the electronic device displays the display interface of the first application, the image to be processed is acquired in response to receiving an image acquisition instruction for the display interface of the first application.

[0066] The electronic device includes a screenshot control. When the screen of the electronic device displays the interface of a first application, and the user triggers the screenshot control, the electronic device receives an image acquisition command for the interface of the first application. The electronic device acquires the image and uses it as an image to be processed. The image to be processed is a screenshot of the interface of the first application.

[0067] In step 202, based on the location information of the image to be processed and the image to be processed, the processed image is obtained. The reference position of the processed image is displayed with identification information. The identification information is obtained based on the location information, which includes at least one of the acquisition time of the image to be processed and the user identifier of the user logged in in the first application.

[0068] The identification information is the encrypted result obtained based on the location information and the encryption algorithm corresponding to the first application.

[0069] In one possible implementation, the process of obtaining the processed image based on the location information of the image to be processed and the image to be processed is as follows: the electronic device sends a new image generation notification to the first application. The new image generation notification is used by the first application to obtain the processed image based on the location information of the image to be processed and the image to be processed after obtaining the image to be processed; and receives the processed image sent by the first application.

[0070] The process by which the first application acquires the processed image based on the location information of the image to be processed is described below. Figure 3 The embodiments shown are described in detail, and will not be repeated here.

[0071] In addition to acquiring the processed image from the first application, the electronic device can also acquire the location information of the image to be processed. Based on the location information of the image to be processed and the image to be processed, the processed image is then acquired. The process by which the electronic device acquires the location information of the image to be processed and, based on that location information, acquires the processed image is consistent with the principle of the first application determining the location information of the image to be processed and, based on that location information, acquiring the processed image. Figure 3 The embodiments shown are for reference only and will not be described in detail here.

[0072] It should be noted that the process of acquiring the processed image based on the location information of the image to be processed and the image to be processed can be executed entirely by the electronic device or by the application. Alternatively, it can be achieved through interaction between the electronic device and the application. For example, the methods by which the electronic device acquires the processed image based on the location information of the image to be processed and the image to be processed also include, but are not limited to, the following two methods:

[0073] In Method 1, after obtaining the location information of the image to be processed, the electronic device obtains the corresponding identification information based on the location information. This identification information is then sent to a first application, which adds the identification information to a reference position on the image to be processed, thus obtaining the processed image. The first application then sends the processed image to the electronic device, enabling the electronic device to acquire the processed image.

[0074] When the electronic device obtains the identification information corresponding to the image to be processed based on the positioning information of the image to be processed, it includes, but is not limited to, encrypting the positioning information of the image to be processed based on the encryption algorithm corresponding to the first application, obtaining an encryption result, and using the encryption result as the identification information corresponding to the image to be processed. Optionally, the electronic device may also encrypt the positioning information of the image to be processed based on an encryption algorithm other than the encryption algorithm corresponding to the first application, obtain an encryption result, and use the encryption result as the identification information corresponding to the image to be processed.

[0075] It should be noted that, regarding the case where the first application acquires the processed image, besides directly sending the processed image to the electronic device, the first application can also store the processed image in a location, from which the electronic device can retrieve the processed image. For example, the first application sends an image processing completion message to the electronic device, which carries the storage location of the processed image. After receiving the image processing completion message, the electronic device parses the message to obtain the storage location of the processed image, and then retrieves the processed image from that storage location.

[0076] Method 2, an electronic device obtains a processed image based on the positioning information of the image to be processed and the image to be processed, including: the electronic device sends the positioning information to a first application, the first application obtains the identification information corresponding to the image to be processed based on the positioning information of the image to be processed and sends it to the electronic device, the electronic device receives the identification information of the image to be processed sent by the first application, adds the identification information corresponding to the image to be processed to the reference position of the image to be processed, and obtains the processed image.

[0077] When the first application obtains the identification information corresponding to the image to be processed based on the location information of the image to be processed, it includes, but is not limited to, encrypting the location information of the image to be processed based on the encryption algorithm corresponding to the first application, obtaining an encryption result, and using the encryption result as the identification information corresponding to the image to be processed. Optionally, the first application may also encrypt the location information of the image to be processed based on an encryption algorithm other than the encryption algorithm corresponding to the first application, obtain an encryption result, and use the encryption result as the identification information corresponding to the image to be processed.

[0078] In one possible implementation, after acquiring the processed image, the electronic device can also store the processed image in its multimedia database. The process of storing the processed image can be found in [reference needed]. Figure 3 The process by which the first application stores the processed image in the illustrated embodiment will not be described in detail here.

[0079] Optionally, after receiving the processed image, the electronic device can also display the processed image, with the reference position of the processed image displaying identification information.

[0080] This method addresses application anomalies based on image location. Since the processed image displays a reference location marker, which is derived from the location information of the image to be processed, location information can be obtained directly from the processed image without requiring offline communication between operations personnel and users. This significantly improves the efficiency of location information retrieval. Based on this location information, application anomalies can be located and repaired, saving time and further improving the efficiency of anomaly location and repair.

[0081] like Figure 3 The flowchart shown in this embodiment of the application illustrates an image processing method. This method can be implemented by... Figure 1 The first application running in electronic device 101 executes. For example... Figure 3 As shown, the method includes the following steps:

[0082] In step 301, the image to be processed is acquired.

[0083] In an exemplary embodiment of this application, an electronic device has a first application that supports image processing installed and running. The first application can be a social application, a game application, a science popularization application, or a video application. This embodiment of the application does not limit the type of the first application. The user logs into the first application, causing the first application to run in the foreground or in the background.

[0084] This application does not limit the way the first application obtains the image to be processed, including but not limited to the following two methods.

[0085] Method 1, obtaining the image to be processed, includes: when displaying the display interface of the first application, receiving an image acquisition instruction for the display interface of the first application, then capturing a first candidate image based on the image acquisition instruction, and using the first candidate image as the image to be processed.

[0086] The first candidate image is a screenshot of the display interface of the first application. For example... Figure 4 The illustration shown is a schematic diagram of an image to be processed according to an embodiment of this application.

[0087] In one possible implementation, a screenshot control is displayed on the screen of the first application. When the user triggers the screenshot control while the screen of the first application is displayed, the first application receives an image acquisition instruction for the screen of the first application. The screenshot control can be triggered by the user clicking it or by the user triggering it via voice; this embodiment does not limit the triggering method.

[0088] Method two involves acquiring the image to be processed, including: receiving a new image generation notification; acquiring a second candidate image generated by the electronic device based on the new image generation notification; and having the first application running in the foreground while the second candidate image is being generated. When the image information of the second candidate image meets the image processing requirements, the second candidate image is used as the image to be processed.

[0089] In one possible implementation, when the electronic device acquires a new image, it sends a new image generation notification to a first application to inform it that a new image has been generated. After receiving the notification, the first application retrieves a reference image from the electronic device's multimedia database; this reference image is the most recently acquired image in the database. The first application then determines whether it was running in the foreground at the time the reference image was acquired. If it was running in the foreground at the time the reference image was generated, it uses the reference image as a second candidate image.

[0090] For example, the new image generation notification sent by the electronic device to the first application carries a new image identifier, and the first application obtains a reference image (that is, the image corresponding to the new image identifier) ​​from the multimedia database of the electronic device based on the new image identifier.

[0091] In one possible implementation, the process of the first application determining whether it is in the foreground running state at the time of the reference image generation is as follows: calling the running state determination method to determine whether the first application is in the foreground running state at the time of the reference image generation.

[0092] In one possible implementation, one or more applications can run in the foreground at a time on an electronic device; that is, the display interface of the electronic device can display the interfaces of one or more applications at a time. This includes, but is not limited to, six methods for determining whether the first application is running in the foreground at the time the reference image is generated. These six methods are: determining whether the first application is running in the foreground at the time the reference image is generated using Running Task; determining whether the first application is running in the foreground at the time the reference image is generated using Running Process; determining whether the first application is running in the foreground at the time the reference image is generated using Activity LifecycleCallbacks; determining whether the first application is running in the foreground at the time the reference image is generated using Usage Stats Manager; determining whether the first application is running in the foreground at the time the reference image is generated using accessibility features built into Android; and determining whether the first application is running in the foreground at the time the reference image is generated using process information stored in the / proc directory of the Linux kernel. Of course, other methods can also be used to determine whether the first application is running in the foreground at the time the reference image is generated; this application embodiment does not limit this.

[0093] Among them, the method of using Usage Stats Manager to determine whether the first application is running in the foreground at the time of reference image generation requires obtaining the first application's permissions, while the other five methods of determining whether the first application is running in the foreground do not require obtaining the first application's permissions.

[0094] In one possible implementation, the process of determining whether the first application was in the foreground running state at the time the reference image was generated, through the Running Task, is as follows: When the first application is in the foreground running state, its process will be at the top of the Running Task stack. Since the difference between the time the reference image is acquired and the time of determining whether the first application was in the foreground running state at the time the reference image was generated is very small and can be ignored, after the reference image is acquired, the task process at the top of the Running Task stack is extracted, and it is determined whether a task exists in the task process at the top of the Running Task stack. If a task exists in the task process at the top of the Running Task stack, the name of the task process at the top of the Running Task stack is determined. If the name of the task process at the top of the Running Task stack matches the name of the first application, then it is determined that the first application was in the foreground running state at the time the reference image was generated.

[0095] It should be noted that the method of determining whether the first application is in the foreground running state at the time of reference image generation through Running Task is only applicable to electronic devices with system versions below Android 5.0 (one system version).

[0096] In one possible implementation, the process of determining whether the first application was in the foreground running state at the time the reference image was generated, using the Running Process, is as follows: After the reference image is acquired, a List of currently running processes is obtained through the Running Process, and it is determined whether a process exists in this List. If a process exists in this List, its name is retrieved. If a process in the List has a name that matches the name of the first application, then it is determined that the first application was in the foreground running state at the time the reference image was generated.

[0097] In one possible implementation, the process of determining whether the first application was in the foreground running state at the time the reference image was generated, using Activity Lifecycle Callbacks, is as follows: Android SDK 14 (Android software development kit 14) added Activity Lifecycle Callbacks to the Application class, obtaining all active lifecycles of each application through these callbacks. The active lifecycle of an application includes its active start time and active end time. Based on the generation time of the reference image and the active lifecycles of each application, it is determined whether the first application was in the foreground running state at the time the reference image was generated. If the generation time of the reference image falls within a certain active lifecycle of the first application, then it is determined that the first application was in the foreground running state at the time the reference image was generated.

[0098] For example, two active lifecycle periods of the first application are obtained through Activity Lifecycle Callbacks: July 18, 2021, 11:38:12 to 11:50:23 and July 18, 2021, 23:05:38 to 23:28:25. The reference image was generated at 23:07:23 on July 18, 2021. Since the reference image was generated during the second active lifecycle period of the first application, it is determined that the first application was in the foreground running state at the time the reference image was generated.

[0099] In one possible implementation, the process of determining whether the first application was running in the foreground at the time the reference image was generated, using the Usage Stats Manager, is as follows: The Usage Stats Manager stores time information about when the first application was running in the foreground. Based on the generation time of the reference image, a first time period is determined, which includes the generation time of the reference image. The time information about when the first application was running in the foreground is obtained through the Usage Stats Manager. If the first time period falls within the time information about when the first application was running in the foreground, then it is determined that the first application was running in the foreground at the time the reference image was generated.

[0100] In one possible implementation, if the first application is not running in the foreground when the reference image is generated, it means that the reference image is not the image of the first application's display interface, that is, the reference image cannot be used as the image to be processed. Therefore, there is no need to obtain the image information of the reference image, and no need to perform subsequent image processing.

[0101] In one possible implementation, if the first application is running in the foreground when the reference image is generated, the reference image is used as the second candidate image, and the image information of the second candidate image is obtained. When the image information of the second candidate image meets the image processing requirements, the second candidate image is used as the image to be processed. The process of obtaining the image information of the second candidate image involves: retrieving the attribute information of the second candidate image from the multimedia database of the electronic device; the attribute information includes the image information of the second candidate image; and then retrieving the image information of the second candidate image from the attribute information.

[0102] In one possible implementation, there are three cases to determine whether the image information of the second candidate image meets the image processing requirements.

[0103] Case 1: The image information of the second candidate image includes the image size of the second candidate image. When the image size of the second candidate image is consistent with the screen size of the electronic device, the second candidate image meets the image processing requirements.

[0104] Optionally, if the image size of the second candidate image is inconsistent with the screen size of the electronic device, the second candidate image does not meet the image processing requirements.

[0105] In this application embodiment, the method of obtaining the screen size of the electronic device is not limited. For example, the screen size of the electronic device can be obtained from the settings function by monitoring the settings function of the electronic device.

[0106] For example, the image size of the second candidate image is 1080*2400, and the screen size of the electronic device is also 1080*2400. Since the image size of the second candidate image is consistent with the screen size of the electronic device, the image information of the second candidate image meets the image processing requirements.

[0107] Scenario 2: The image information of the second candidate image includes the acquisition path of the second candidate image. When the acquisition path of the second candidate image includes keywords, the second candidate image meets the image processing requirements.

[0108] Optionally, if the acquisition path of the second candidate image does not include the keyword, the second candidate image does not meet the image processing requirements.

[0109] The keyword is used to indicate that the first candidate image is a screenshot image. In one embodiment, the keyword can be the system-defined content of the electronic device, which is not limited in this application.

[0110] For example, the keyword is "screenshot", and the acquisition path of the second candidate image is "internal storage / Pictures / screenshots / screenshot_20210718_100052_tencent.mm.jpg". Since the acquisition path of the second candidate image includes the keyword "screenshot", the second candidate image meets the image processing requirements.

[0111] For example, if the keyword is "screenshot", and the acquisition path of the second candidate image is "internal storage / DCIM / Camera / IMG_20210718_100052_mh1630763572153.jpg", then because the acquisition path of the second candidate image does not include the keyword "screenshot", the second candidate image does not meet the image processing requirements.

[0112] Case 3: The image information of the second candidate image includes the image size and acquisition path of the second candidate image. When the image size of the second candidate image is consistent with the screen size of the electronic device, and the acquisition path of the second candidate image includes keywords, the second candidate image meets the image processing requirements.

[0113] The process of determining whether the image size of the second candidate image matches the screen size of the electronic device is the same as in Case 1 above, and will not be repeated here. The process of determining whether the acquisition path of the second candidate image includes keywords is the same as in Case 2 above, and will also not be repeated here.

[0114] Since the acquisition path of the second candidate image includes keywords, it can be determined that the second candidate image is a screenshot. However, if the size is too small, it is not easy to locate, affecting the accuracy of the location information. In addition, even if the image size of the second candidate image is the same as the screen size of the electronic device, it may not be a screenshot. Therefore, by combining the consistency between the image size of the second candidate image and the screen size of the electronic device and the inclusion of keywords in the acquisition path of the second candidate image, the correctness of determining that the second candidate image is a screenshot of the entire screen of the electronic device can be improved, and the accuracy of determining the location information can also be improved.

[0115] Furthermore, this application does not limit whether the image size of the image to be processed is consistent with the screen size of the electronic device, or whether the acquisition path of the image to be processed includes the order of keywords.

[0116] In one possible implementation, when the image information of the second candidate image includes image size and acquisition path, if the image size of the second candidate image is inconsistent with the screen size of the electronic device, and / or the acquisition path of the second candidate image does not include keywords, then the second candidate image is determined to not meet the image processing requirements. That is, the second candidate image cannot be used as the image to be processed, and therefore no further image processing is required.

[0117] In step 302, the positioning information of the image to be processed is determined.

[0118] The location information includes at least one of the following: the acquisition time of the image to be processed and the user identifier of the user logged into the first application. The first application is an application running in the foreground at the acquisition time. Therefore, when the image to be processed is a second candidate image, the acquisition time of the image to be processed is the time when the electronic device generates the second candidate image. When the image to be processed is a first candidate image, the acquisition time of the image to be processed is the time when the first application acquires the first candidate image.

[0119] In one possible implementation, the location information includes the acquisition time of the image to be processed. The process for determining the acquisition time of the image to be processed is as follows: The attribute information of the image to be processed, including its generation time, is obtained by accessing the multimedia database of the electronic device. The acquisition time of the image to be processed is then obtained from the attribute information of the image to be processed.

[0120] For example, the image to be processed was acquired at 23:07:23 on July 18, 2021.

[0121] It should be noted that when a user encounters an error while using the application, an image of the screen showing the error is captured; this image is called the pending image. The time when the pending image is captured indicates the time when the application encountered an error.

[0122] In one possible implementation, since step 301 has already determined that the image to be processed is an image from when the first application is running in the foreground, when the location information includes the user identifier of the user logged into the first application, the currently logged-in user identifier is directly obtained from the user account page of the first application. The user identifier can be the user's account in the first application, the user's nickname in the first application, or any other identifier that can uniquely identify a user; this embodiment does not limit the specific identifier.

[0123] Generally, a user's account in the first application is usually stored as an 8-byte integer, with a value range of [0, 18446744073709551615].

[0124] For example, the user identifier is the user's account in the first application, and the user identifier is 176550068.

[0125] It should be noted that when the location information includes both the acquisition time of the image to be processed and the user identifier of the user logged in to the first application, the user identifier of the user logged in to the first application can be determined first, and then the acquisition time of the image to be processed can be determined. Alternatively, the acquisition time of the image to be processed can be determined first, and then the user identifier of the user logged in to the first application can be determined. This application embodiment does not limit the order of determining the user identifier of the user logged in to the first application and the acquisition time of the image to be processed.

[0126] It should also be noted that the server corresponding to the first application stores usage data for each user, as well as the correspondence between each user's identifier and usage data. Obtaining the user identifier of the user logged into the first application facilitates the subsequent retrieval of the corresponding usage data for that user, and further, based on that user's usage data, the identification of any abnormal issues that may arise when that user is using the first application.

[0127] In step 303, a processed image is obtained based on the positioning information and the image to be processed. The reference position of the processed image is marked with identification information, which is obtained based on the positioning information.

[0128] The reference position can be any position in the image, and this application does not limit it. For example, the reference position can be the upper left corner of the image, or the upper right corner of the image, or the lower left corner of the image, or the lower right corner of the image, or the middle position of the image.

[0129] In one possible implementation, the process of obtaining identification information based on location information involves: obtaining an encryption result based on the location information, and using the encryption result as the identification information. Alternatively, the location information can be directly used as the identification information.

[0130] In one possible implementation, there are three cases in which the location information is directly used as the identification information.

[0131] Scenario 1: When the location information only includes the user identifier of the user logged in in the first application, the user identifier is directly used as the identification information.

[0132] For example, the user ID of the user logged in in the first application is 176550068, and 176550068 is directly used as the identification information.

[0133] Scenario 2: When the location information only includes the acquisition time of the image to be processed, the acquisition time of the image to be processed is directly used as the identification information.

[0134] For example, the acquisition time of the image to be processed is 23:07:23 on July 18, 2021, and 23:07:23 on July 18, 2021 is used as the identification information.

[0135] Scenario 3: When the location information includes the acquisition time of the image to be processed and the user identifier of the user logged in in the first application, the acquisition time of the image to be processed and the user identifier of the user logged in in the first application shall be used as the identification information.

[0136] In one possible implementation, when the location information includes the acquisition time of the image to be processed and the user identifier of the user logged in in the first application, the acquisition time and the user identifier are concatenated to obtain concatenated information, which is then used as identification information.

[0137] It should be noted that when concatenating the acquisition time and the user identifier, the user identifier can be concatenated before or after the acquisition time. This application embodiment does not limit the concatenation order of the acquisition time and the user identifier.

[0138] For example, the splicing order is to splice the user ID before the acquisition time. The user ID is 176550068 and the acquisition time is 23:07:23 on July 18, 2021. Then the spliced ​​information is 1765500682021771823:07:23.

[0139] In one possible implementation, when concatenating the user identifier and the acquisition time to obtain concatenated information, an intermediate symbol is used to separate the user identifier and the acquisition time in order to accurately distinguish them within the concatenated information. The intermediate symbol can be any symbol, and this application embodiment does not limit its use. For example, the intermediate symbol is ".".

[0140] For example, if the user ID is 176550068 and the acquisition time is 23:07:23 on July 18, 2021, then the concatenated information would be 176550068.23:07:23 on July 18, 2021. This accurately distinguishes the user ID and acquisition time contained in the concatenated information.

[0141] In one possible implementation, the process of obtaining the encryption result based on location information is as follows: The encryption result is obtained based on the location information and the encryption algorithm corresponding to the first application. Specifically, when the encryption algorithm corresponding to the first application is an asymmetric encryption algorithm, the encryption result is obtained based on the location information and the public key included in the encryption algorithm corresponding to the first application.

[0142] In one possible implementation, there are five ways to obtain the encryption result based on location information.

[0143] Implementation Method 1: When the image information of the image to be processed only includes the acquisition time of the image, the encryption result is obtained based on the acquisition time.

[0144] In one possible implementation, the acquisition time is encrypted according to the encryption algorithm corresponding to the first application to obtain the encrypted result.

[0145] The encryption algorithm corresponding to the first application can be either a symmetric or asymmetric encryption algorithm, and this application embodiment does not limit this. When the encryption algorithm corresponding to the first application is a symmetric encryption algorithm, it can be any symmetric encryption algorithm, and this application embodiment does not limit this. For example, the symmetric encryption algorithm can be DES (Data Encryption Standard), 3DES (Triple Encryption Standard), or AES (Advanced Encryption Standard). When the encryption algorithm corresponding to the first application is an asymmetric encryption algorithm, it can be any asymmetric encryption algorithm, and this application embodiment does not limit this. For example, the asymmetric encryption algorithm can be RSA (an asymmetric encryption algorithm), ECC (Error Checking and Correction), or DSA (Digital Signature Standard).

[0146] It should be noted that when the encryption algorithm corresponding to the first application is an asymmetric encryption algorithm, when encrypting the acquisition time according to the encryption algorithm corresponding to the first application, the acquisition time needs to be encrypted according to the public key included in the encryption algorithm corresponding to the first application to obtain the encryption result.

[0147] When location information is encrypted using the encryption algorithm corresponding to the first application, the resulting encryption is more secure and less likely to leak user privacy. Furthermore, when the location information is encrypted using the public key included in the encryption algorithm of the first application, only the private key included in the encryption algorithm can decrypt the encryption result. Since only the developer of the first application knows the private key included in the encryption algorithm, even if a third party uses the encrypted image, they cannot decrypt the location information because they cannot obtain the private key included in the encryption algorithm of the first application. Therefore, third-party users cannot obtain the user identifier and the image acquisition time, thus protecting user privacy and increasing security.

[0148] For example, the acquisition time is 23:07:23 on July 18, 2021. The acquisition time is encrypted according to the public key included in the encryption algorithm corresponding to the first application, and the encryption result is 12631.

[0149] Method 2: When the location information of the image to be processed includes the user identifier of the user logged in in the first application, the encrypted result is obtained based on the user identifier.

[0150] In one possible implementation, the user identifier is encrypted according to the encryption algorithm corresponding to the first application to obtain the encryption result.

[0151] It should be noted that when the encryption algorithm corresponding to the first application is an asymmetric encryption algorithm, when encrypting the user identifier according to the encryption algorithm corresponding to the first application, the user identifier needs to be encrypted according to the public key included in the encryption algorithm corresponding to the first application to obtain the encryption result.

[0152] For example, if the user identifier is 176550068, the user identifier is encrypted using the public key included in the encryption algorithm corresponding to the first application, and the encryption result is 12eabea121.

[0153] Implementation Method 3: When the location information only includes the acquisition time of the image to be processed, the acquisition time is processed to obtain the first information, and the encryption result is obtained based on the first information.

[0154] The process of processing the acquisition time to obtain the first information is as follows: based on the acquisition time and the standard time, the first information is determined, and the first information is used to indicate the time difference between the standard time and the acquisition time.

[0155] The first information can be in units of seconds, hours, or minutes; this embodiment of the application does not limit this. For example, the first information is time information in units of seconds, specifically the number of seconds elapsed from the standard time to the acquired time.

[0156] In one possible implementation, the standard time is set by the application developer; for example, the standard time might be January 1, 1970, 00:00:00. Of course, the standard time can be other times as well, and this embodiment does not limit this. Different types of applications may use the same or different standard times, and this embodiment also does not limit this.

[0157] For example, the standard time is 00:00:00 on January 1, 1970, and the acquisition time is 23:07:23 on July 18, 2021. The time difference between the acquisition time and the standard time is determined to be 1626620843, which means that the number of seconds that have elapsed from the standard time to the acquisition time is 1626620843 seconds, and the first information is 1626620843.

[0158] In one possible implementation, the first information can be directly used as the identification information corresponding to the image to be processed.

[0159] For example, the first information is 1626620843, and the identification information corresponding to the image to be processed is 1626620843.

[0160] Of course, the first information can also be encrypted using the encryption algorithm corresponding to the first application to obtain the encrypted result.

[0161] For example, if the first information is 1626620843, and the first information is encrypted according to the encryption algorithm corresponding to the first application, the encryption result is 12631.

[0162] Implementation Method 4: When the location information includes the acquisition time of the image to be processed and the user identifier of the user logged in in the first application, the first information is determined based on the acquisition time, and the encryption result is obtained based on the user identifier and the first information.

[0163] In one possible implementation, the process of obtaining the first information based on the acquisition time is as follows: determine the first information based on the acquisition time and the standard time. The process of determining the first information based on the acquisition time and the standard time is the same as that in implementation method three above, and will not be repeated here.

[0164] In one possible implementation, based on the user identifier and the first information, the encryption result can be obtained in the following two ways.

[0165] Scenario 1: Concatenate the user identifier and the first information to obtain the second information, and encrypt the second information according to the encryption algorithm corresponding to the first application to obtain the encryption result.

[0166] In one possible implementation, when concatenating the user identifier and the first information, the user identifier can be concatenated before the first information or after the first information. This application embodiment does not limit the concatenation order of the user identifier and the first information.

[0167] For example, the concatenation order is to concatenate the user identifier before the first information. If the user identifier is 176550068 and the first information is 1626620843, then the second information is 1765500681626620843.

[0168] In one possible implementation, when concatenating the user identifier and the first information to obtain the second information, in order to accurately distinguish the user identifier and the first information in the second information, an intermediate symbol is used to separate the user identifier and the first information during the concatenation. The intermediate symbol can be any symbol, and this application embodiment does not limit it. For example, the intermediate symbol is ".".

[0169] For example, if the user identifier is 176550068 and the first information is 1626620843, then the second information is 176550068.1626620843. This allows for accurate differentiation between the user identifier and the first information contained in the second information.

[0170] In one possible implementation, after obtaining the second information, the second information is encrypted according to the encryption algorithm corresponding to the first application to obtain the encryption result.

[0171] For example, the second information is 176550068.1626620843. After the second information is encrypted according to the encryption algorithm corresponding to the first application, the encryption result is 12eabea121.12631, which is the identification information corresponding to the image to be processed is 12eabea121.12631.

[0172] Scenario 2: Encrypt the user identifier according to the encryption algorithm corresponding to the first application to obtain the first intermediate information; encrypt the first information according to the encryption algorithm corresponding to the first application to obtain the second intermediate information; concatenate the first intermediate information and the second intermediate information to obtain the encryption result.

[0173] In one possible implementation, the process of encrypting the user identifier according to the encryption algorithm corresponding to the first application to obtain the first intermediate information, and the process of encrypting the first information according to the encryption algorithm corresponding to the first application to obtain the second intermediate information, are consistent with the process of encrypting the second information according to the encryption algorithm of the first application to obtain the encryption result in Case 1 above, and will not be described again here.

[0174] After obtaining the first intermediate information and the second intermediate information, when splicing the first intermediate information and the second intermediate information, the first intermediate information can be spliced ​​before the second intermediate information or after the second intermediate information. The embodiments of this application do not limit the splicing order when splicing the first intermediate information and the second intermediate information.

[0175] In one possible implementation, in order to accurately distinguish the first intermediate information and the second intermediate information in the identification information, an intermediate symbol is used to separate the first intermediate information and the second intermediate information when concatenating them. The intermediate symbol can be any symbol, and this application embodiment does not limit it. For example, the intermediate symbol is ".".

[0176] For example, the user identifier is 176550068, and the first information is 1626620843. The user identifier is encrypted using the encryption algorithm corresponding to the first application, resulting in the first intermediate information 12eabea121. The first information is then encrypted using the same encryption algorithm, resulting in the second intermediate information 12631. When concatenating the first and second intermediate information, a period "." is used to separate them, resulting in the identifier information corresponding to the image to be processed, 12eabea121.12631.

[0177] Implementation Method 5: When the location information includes the user identifier of the user logged in to the first application and the acquisition time of the image to be processed, the encryption result is obtained based on the user identifier and the acquisition time.

[0178] In one possible implementation, there are two scenarios where the encryption result is obtained based on the user identifier and the acquisition time.

[0179] Scenario 1: The user identifier and acquisition time are concatenated to obtain intermediate information. The intermediate information is then encrypted according to the encryption algorithm corresponding to the first application to obtain the encryption result.

[0180] When concatenating the user identifier and the acquisition time, the user identifier can be concatenated before or after the acquisition time. This application embodiment does not limit the concatenation order of the user identifier and the acquisition time.

[0181] In one possible implementation, to accurately distinguish between the user identifier and the acquisition time in the intermediate information, an intermediate symbol is used to separate the user identifier and the acquisition time when concatenating them. The intermediate symbol can be any symbol, and this application embodiment does not limit it. For example, the intermediate symbol is ".".

[0182] The process of encrypting intermediate information according to the encryption algorithm corresponding to the first application is the same as the process of encrypting the acquisition time according to the encryption algorithm corresponding to the first application in the above implementation method, and will not be repeated here.

[0183] For example, the user identifier is 176550068, and the acquisition time is July 18, 2021, 23:07:23. Concatenating the user identifier and the acquisition time yields the intermediate information: 176550068.July 18, 2021, 23:07:23. Encrypting this intermediate information using the encryption algorithm corresponding to the first application yields the encryption result 12eabea121.12631.

[0184] Scenario 2: Encrypt the user identifier according to the encryption algorithm corresponding to the first application to obtain the first intermediate information; encrypt the acquisition time according to the encryption algorithm corresponding to the first application to obtain the third intermediate information; concatenate the first intermediate information and the third intermediate information to obtain the encryption result.

[0185] In one possible implementation, the process of encrypting the user identifier according to the encryption algorithm corresponding to the first application to obtain the first intermediate information is the same as the process in implementation method two above, and will not be repeated here. The process of encrypting the acquisition time according to the encryption algorithm corresponding to the first application to obtain the third intermediate information is similar to the process in implementation method one above, and will not be repeated here.

[0186] When splicing the first intermediate information and the third intermediate information, the first intermediate information can be spliced ​​before the third intermediate information or after the third intermediate information. In this embodiment of the application, the splicing order of the first intermediate information and the third intermediate information is not limited.

[0187] In one possible implementation, to accurately distinguish between the first and third intermediate information in the identification information, an intermediate symbol is used to separate the first and third intermediate information when concatenating them. The intermediate symbol can be any symbol, and this application embodiment does not limit its use. For example, the intermediate symbol is ".".

[0188] For example, the first intermediate information is 12eabea121, and the third intermediate information is 12631. Concatenating the first and third intermediate information yields the encrypted result 12eabea121.12631.

[0189] It should be noted that any of the above methods can be used to obtain the encryption result, and this application embodiment does not limit this.

[0190] It should also be noted that any of the above methods can be used to obtain the identification information corresponding to the image to be processed, and the embodiments of this application do not limit the method of obtaining the identification information.

[0191] In one possible implementation, after obtaining the identification information corresponding to the image to be processed, the identification information is added to a reference position in the image to be processed, resulting in the processed image. The reference position in the processed image displays the identification information.

[0192] Optionally, after obtaining the identification information corresponding to the image to be processed, the first application can send the identification information to the electronic device, which then adds the identification information to a reference position on the image to be processed, thereby obtaining the processed image. Subsequently, the electronic device sends the processed image to the first application, enabling the first application to obtain the processed image.

[0193] Optionally, the electronic device can also obtain the identification information corresponding to the image to be processed, send the identification information corresponding to the image to be processed to the first application, and the first application adds the identification information corresponding to the image to be processed to the reference position of the image to be processed to obtain the processed image.

[0194] The process by which the electronic device acquires the identification information corresponding to the image to be processed is as follows: The electronic device encrypts the location information of the image to be processed based on the encryption algorithm corresponding to the first application, obtains the encryption result, and uses the encryption result as the identification information corresponding to the image to be processed. Alternatively, the electronic device encrypts the location information of the image to be processed based on an encryption algorithm other than the encryption algorithm corresponding to the first application, obtains the encryption result, and uses the encryption result as the identification information corresponding to the image to be processed. Figure 5 The image shown is a schematic diagram of a processed image provided in an embodiment of this application. Figure 5 In the image, the upper right corner displays an identifier, which is 12eabea121.12631.

[0195] In one possible implementation, after acquiring the processed image, the processed image can be sent to an electronic device for display and storage.

[0196] In one possible implementation, after acquiring the processed image, since the first application can monitor the multimedia database of the electronic device, it can also store the processed image. The process of storing the processed image is as follows: obtain the storage location of the image to be processed, and store the processed image in the storage location of the image to be processed.

[0197] The storage location of the image to be processed is determined based on the acquisition path of the image. The image to be processed and the processed image can be stored together in the storage location of the image to be processed, or the processed image can overwrite the image to be processed and be stored in the storage location of the image to be processed.

[0198] In one possible implementation, when storing the image to be processed and the processed image together in the storage location of the image to be processed, it is also necessary to set an image name for the processed image. The image name of the processed image is different from the image name of the image to be processed, and the image name of the processed image may include keywords. When the processed image overwrites the image to be processed in the storage location of the image to be processed, the image name of the processed image is the same as the image name of the image to be processed.

[0199] For example, the acquisition path of the image to be processed is "Internal Storage / Pictures / screenshots / screenshot_20210718_100052_tencent.mm.jpg". Based on this, the storage location of the image to be processed is determined to be a folder named "screenshots". Therefore, the image name of the processed image is set to "Internal Storage / Pictures / screenshots / screenshot_20210718_100052_tencent.mm(1).jpg", and the processed image is stored in the "screenshots" folder.

[0200] Alternatively, overwrite the image to be processed in the "screenshots" folder with the processed image located at "internal storage / Pictures / screenshots / screenshot_20210718_100052_tencent.mm.jpg".

[0201] Optionally, after storing the processed image in a certain location, the first application can also send an image processing completion message to the electronic device to inform it that the image to be processed has been completed. This message includes the storage location of the processed image. Upon receiving the image processing completion message, the electronic device parses it to obtain the storage location of the processed image, allowing it to retrieve the image from that location. Optionally, the electronic device can then display the processed image.

[0202] The above method, when addressing application anomalies based on image location, utilizes an identifier in the processed image. This identifier is derived from the location information of the image to be processed. Therefore, location information can be obtained directly from the processed image without requiring offline communication between operations personnel and users, resulting in high efficiency in obtaining location information. Based on this location information, application anomalies can be located and repaired, saving time previously required for troubleshooting and further improving the efficiency of anomaly location and repair.

[0203] Figure 6 The diagram shown is a flowchart of an image processing method provided in an embodiment of this application. Figure 6 First, a second candidate image is acquired. It is then determined whether the first application was running in the foreground at the time the second candidate image was generated. If the first application was running in the foreground at the time the second candidate image was generated, the image size of the second candidate image is acquired. It is then determined whether the image size of the second candidate image matches the screen size of the electronic device. If the image size matches the screen size, the acquisition path of the second candidate image is acquired. It is then determined whether the acquisition path of the second candidate image includes keywords. If the acquisition path includes keywords, the second candidate image is used as the image to be processed. The generation time of the image to be processed and the user identifier of the logged-in user in the first application are acquired. The first application is the application running in the foreground at the time the image to be processed was acquired. Based on the generation time and the user identifier, the identification information corresponding to the image to be processed is acquired. The identification information is added to a reference position of the image to be processed to obtain the processed image.

[0204] Since the first application is not running in the foreground when the second candidate image is generated, no further image processing is required.

[0205] In response to the generation time of the second candidate image, the first application is running in the foreground, but the image size of the second candidate image is inconsistent with the screen size of the electronic device, and no subsequent image processing is required.

[0206] In response to the first application being in the foreground running state during the generation time of the second candidate image, and the image size of the second candidate image being consistent with the screen size of the electronic device, but the acquisition path of the second candidate image not including keywords, no subsequent image processing is required.

[0207] Figure 7 The diagram shown is a flowchart of a method for obtaining identification information provided in an embodiment of this application. Figure 7 In this process, the user identifier of the logged-in user in the first application is obtained, as well as the generation time of the image to be processed. The user identifier and generation time are concatenated to obtain intermediate information. The intermediate information is then encrypted using the encryption algorithm corresponding to the first application to obtain the encrypted result. The encrypted result is used as the identification information.

[0208] Taking the interaction between an electronic device and a first application as an example, the image processing method provided in the embodiments of this application will be described. Figure 8 The diagram shown is a flowchart of an image processing method provided in an embodiment of this application.

[0209] Step 801: The electronic device generates a new image.

[0210] Step 802: The electronic device sends a new image generation notification to the first application.

[0211] Step 803: The first application receives a notification of new image generation and obtains a reference image.

[0212] The reference image is a newly generated image from the electronic device.

[0213] Step 804: The first application determines whether it is running in the foreground at the time the reference image is generated.

[0214] Step 805: If the first application is running in the foreground during the generation time of the reference image, the first application will use the reference image as the second candidate image.

[0215] Step 806: The first application determines whether the image size of the second candidate image is consistent with the screen size of the electronic device.

[0216] Step 807: If the image size of the second candidate image is consistent with the screen size of the electronic device, the first application determines whether the acquisition path of the image to be processed includes keywords.

[0217] Step 808: If the acquisition path of the second candidate image includes keywords, the first application uses the second candidate image as the image to be processed and obtains the identification information corresponding to the image to be processed.

[0218] For details of steps 801 to 808 above, please refer to [link / reference]. Figure 3 The relevant content shown in step 302 of the illustrated embodiment will not be repeated here.

[0219] Step 809: The first application adds the identification information to the reference position of the image to be processed, and obtains the processed image.

[0220] See step 809 for details. Figure 3 The relevant content shown in step 303 of the illustrated embodiment will not be repeated here.

[0221] If the first application is not running in the foreground when the reference image is generated, or if the first application is running in the foreground when the reference image is generated, but the image size of the second candidate image is inconsistent with the screen size of the electronic device, or if the first application is running in the foreground when the reference image is generated, and the image size of the second candidate image is consistent with the screen size of the electronic device, but the acquisition path of the second candidate image does not include the keyword, then no further image processing will be performed on the second candidate image.

[0222] Figure 9 The diagram shown is a structural schematic of an image processing device provided in an embodiment of this application. Figure 9 As shown, the device includes:

[0223] The first acquisition module 901 is used to acquire an image to be processed in response to an image acquisition instruction on the display interface of the first application.

[0224] The second acquisition module 902 is used to acquire a processed image based on the location information of the image to be processed and the image to be processed. The reference position of the processed image is displayed with identification information, which is obtained based on the location information. The location information includes at least one of the acquisition time of the image to be processed and the user identifier of the user logged in in the first application.

[0225] In one possible implementation, the device further includes:

[0226] The sending module is used to send a new image generation notification to the first application. The new image generation notification is used by the first application to obtain the image to be processed after obtaining the image to be processed, based on the location information of the image to be processed and the image to be processed.

[0227] The receiving module is used to receive the processed image sent by the first application.

[0228] In one possible implementation, the device further includes:

[0229] The display module is used to display the processed image.

[0230] In one possible implementation, the identification information is an encrypted result obtained based on the location information and the encryption algorithm corresponding to the first application.

[0231] When addressing application anomalies based on image location, the aforementioned device utilizes an identifier displayed on the reference location of the processed image. This identifier is derived from the location information of the image to be processed. Therefore, location information can be obtained from the processed image without requiring offline communication between operators and users, resulting in high efficiency in obtaining location information. Based on this location information, application anomalies can be located and repaired, saving time required for troubleshooting and further improving the efficiency of anomaly location and repair.

[0232] Figure 10 The diagram shown is a structural schematic of an image processing device provided in an embodiment of this application. Figure 10 As shown, the device includes:

[0233] The first acquisition module 1001 is used to acquire the image to be processed;

[0234] The determining module 1002 is used to determine the location information of the image to be processed. The location information includes at least one of the acquisition time of the image to be processed and the user identifier of the user logged in in the first application. The first application is an application that is running in the foreground at the acquisition time.

[0235] The second acquisition module 1003 is used to acquire the processed image based on the positioning information and the image to be processed. The reference position of the processed image is displayed with identification information, which is obtained based on the positioning information.

[0236] In one possible implementation, the second acquisition module 1003 is used for

[0237] The encryption result is obtained based on the location information, and the encryption result is used as the identification information;

[0238] Alternatively, location information can be used directly as identification information.

[0239] In one possible implementation, the second acquisition module 1003 is used to acquire the encryption result based on the location information and the encryption algorithm corresponding to the first application.

[0240] In one possible implementation, the second acquisition module 1003 is used to acquire the encryption result based on the location information and the public key included in the encryption algorithm corresponding to the first application.

[0241] In one possible implementation, the first acquisition module 1001 is used to receive an image acquisition instruction for the display interface of the first application when displaying the display interface of the first application, capture a first candidate image based on the image acquisition instruction, and use the first candidate image as the image to be processed.

[0242] In one possible implementation, the device further includes:

[0243] The receiving module is used to receive a new image generation notification, obtain a second candidate image generated by the electronic device based on the new image generation notification, and the first application is in the foreground running state when the second candidate image is generated.

[0244] The first acquisition module 1001 is used to use the second candidate image as the image to be processed when the image information of the second candidate image meets the image processing requirements.

[0245] In one possible implementation, the image information of the second candidate image includes the image size of the second candidate image. When the image size of the second candidate image is consistent with the screen size of the electronic device, the second candidate image meets the image processing requirements.

[0246] In one possible implementation, the image information of the second candidate image includes the acquisition path of the second candidate image. When the acquisition path of the second candidate image includes a keyword, the second candidate image meets the image processing requirements. The keyword is used to indicate that the second candidate image is a screenshot.

[0247] In one possible implementation, the image information of the second candidate image includes the image size and acquisition path of the second candidate image. When the image size of the first candidate image is consistent with the screen size of the electronic device, and the acquisition path of the first candidate image includes keywords, the first candidate image meets the image processing requirements.

[0248] In one possible implementation, the first acquisition module 1001 is further configured to acquire the storage location of the image to be processed;

[0249] The device also includes:

[0250] The storage module is used to store the processed image in the storage location of the image to be processed.

[0251] When addressing application anomalies based on image location, the aforementioned device utilizes an identifier displayed on the reference location of the processed image. This identifier is derived from the location information of the image to be processed. Therefore, location information can be obtained from the processed image without requiring offline communication between operators and users, resulting in high efficiency in obtaining location information. Based on this location information, application anomalies can be located and repaired, saving time required for troubleshooting and further improving the efficiency of anomaly location and repair.

[0252] It should be understood that the above-described apparatus is only illustrated by the division of the functional modules described above when implementing its functions. In practical applications, the functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments belong to the same concept, and their specific implementation process can be found in the method embodiments, which will not be repeated here.

[0253] Figure 11 A structural block diagram of an electronic device 1100 provided in an exemplary embodiment of this application is shown. The electronic device 1100 may be a portable mobile terminal, such as a smartphone, tablet computer, MP3 player (Moving Picture Experts Group Audio Layer III), MP4 player (Moving Picture Experts Group Audio Layer IV), laptop computer, or desktop computer. The electronic device 1100 may also be referred to as a user device, portable terminal, laptop terminal, desktop terminal, or other names.

[0254] Typically, electronic device 1100 includes a processor 1101 and a memory 1102.

[0255] Processor 1101 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Processor 1101 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Processor 1101 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 1101 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the screen. In some embodiments, processor 1101 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0256] The memory 1102 may include one or more computer-readable storage media, which may be non-transitory. The memory 1102 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1102 are used to store at least one instruction, which is executed by the processor 1101 to implement the image processing method provided in the method embodiments of this application.

[0257] In some embodiments, the electronic device 1100 may optionally include a peripheral device interface 1103 and at least one peripheral device. The processor 1101, memory 1102, and peripheral device interface 1103 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 1103 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of the following: a radio frequency circuit 1104, a display screen 1105, a camera assembly 1106, an audio circuit 1107, and a power supply 1109.

[0258] Peripheral device interface 1103 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 1101 and memory 1102. In some embodiments, processor 1101, memory 1102 and peripheral device interface 1103 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 1101, memory 1102 and peripheral device interface 1103 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0259] The radio frequency (RF) circuit 1104 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 1104 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 1104 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 1104 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 1104 can communicate with other terminals via at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: the World Wide Web, metropolitan area networks, intranets, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 1104 may also include circuitry related to NFC (Near Field Communication), which is not limited in this application.

[0260] Display screen 1105 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. When display screen 1105 is a touch display screen, it also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to processor 1101 for processing. In this case, display screen 1105 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one display screen 1105, disposed on the front panel of electronic device 1100; in other embodiments, there may be at least two display screens, disposed on different surfaces of electronic device 1100 or in a folded design; in still other embodiments, display screen 1105 may be a flexible display screen, disposed on a curved or folded surface of electronic device 1100. Furthermore, display screen 1105 may be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. The display screen 1105 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0261] The camera assembly 1106 is used to acquire images or videos. Optionally, the camera assembly 1106 includes a front-facing camera and a rear-facing camera. Typically, the front-facing camera is located on the front panel of the terminal, and the rear-facing camera is located on the back of the terminal. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In some embodiments, the camera assembly 1106 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm-light flash and a cool-light flash, which can be used for light compensation at different color temperatures.

[0262] The audio circuit 1107 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting the sound waves into electrical signals that are input to the processor 1101 for processing, or input to the radio frequency circuit 1104 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, each located at a different part of the electronic device 1100. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert electrical signals from the processor 1101 or the radio frequency circuit 1104 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 1107 may also include a headphone jack.

[0263] Power supply 1109 is used to supply power to various components in electronic device 1100. Power supply 1109 can be alternating current, direct current, a disposable battery, or a rechargeable battery. When power supply 1109 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged via a wired line, and a wireless rechargeable battery is a battery that is charged via a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0264] In some embodiments, the electronic device 1100 further includes one or more sensors 1110. The one or more sensors 1110 include, but are not limited to: an acceleration sensor 1111, a gyroscope sensor 1112, a pressure sensor 1113, an optical sensor 1115, and a proximity sensor 1116.

[0265] Accelerometer 1111 can detect the magnitude of acceleration on the three coordinate axes of a coordinate system established by electronic device 1100. For example, accelerometer 1111 can be used to detect the components of gravitational acceleration on the three coordinate axes. Processor 1101 can control display screen 1105 to display the user interface in either a landscape or portrait view based on the gravitational acceleration signal acquired by accelerometer 1111. Accelerometer 1111 can also be used for games or for acquiring user motion data.

[0266] The gyroscope sensor 1112 can detect the orientation and rotation angle of the electronic device 1100. The gyroscope sensor 1112 can work in conjunction with the accelerometer sensor 1111 to collect the user's 3D movements on the electronic device 1100. Based on the data collected by the gyroscope sensor 1112, the processor 1101 can perform the following functions: motion sensing (e.g., changing the UI based on the user's tilt), image stabilization during shooting, game control, and inertial navigation.

[0267] Pressure sensor 1113 can be disposed on the side bezel of electronic device 1100 and / or on the lower layer of display screen 1105. When pressure sensor 1113 is disposed on the side bezel of electronic device 1100, it can detect the user's grip signal on electronic device 1100, and processor 1101 can perform left / right hand recognition or quick operation based on the grip signal collected by pressure sensor 1113. When pressure sensor 1113 is disposed on the lower layer of display screen 1105, processor 1101 can control operable controls on UI interface based on the user's pressure operation on display screen 1105. Operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

[0268] An optical sensor 1115 is used to collect ambient light intensity. In one embodiment, the processor 1101 can control the display brightness of the display screen 1105 based on the ambient light intensity collected by the optical sensor 1115. Specifically, when the ambient light intensity is high, the display brightness of the display screen 1105 is increased; when the ambient light intensity is low, the display brightness of the display screen 1105 is decreased. In another embodiment, the processor 1101 can also dynamically adjust the shooting parameters of the camera assembly 1106 based on the ambient light intensity collected by the optical sensor 1115.

[0269] The proximity sensor 1116, also known as a distance sensor, is typically located on the front panel of the electronic device 1100. The proximity sensor 1116 is used to detect the distance between the user and the front of the electronic device 1100. In one embodiment, when the proximity sensor 1116 detects that the distance between the user and the front of the electronic device 1100 is gradually decreasing, the processor 1101 controls the display screen 1105 to switch from a screen-on state to a screen-off state; when the proximity sensor 1116 detects that the distance between the user and the front of the electronic device 1100 is gradually increasing, the processor 1101 controls the display screen 1105 to switch from a screen-off state to a screen-on state.

[0270] Those skilled in the art will understand that Figure 11 The structure shown does not constitute a limitation on the electronic device 1100, and may include more or fewer components than shown, or combine certain components, or use different component arrangements.

[0271] In an exemplary embodiment, an electronic device is also provided, which has an application installed and running thereon, the application being used to implement the above. Figure 3 The image processing method provided in the illustrated embodiment.

[0272] In an exemplary embodiment, a computer-readable storage medium is also provided, which stores at least one piece of program code that is loaded and executed by a processor to enable a computer to implement any of the above-described image processing methods.

[0273] Optionally, the aforementioned computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a compact disc read-only memory (CD-ROM), magnetic tape, floppy disk, and optical data storage device, etc.

[0274] In an exemplary embodiment, a computer program or computer program product is also provided, which stores at least one computer instruction that is loaded and executed by a processor to enable the computer to implement any of the above-described image processing methods.

[0275] It should be understood that "multiple" as used in this article refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0276] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0277] The above description is merely an exemplary embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. An image processing method, characterized in that, The method includes: Upon receiving a notification of new image generation, the first application obtains a second candidate image generated by the electronic device based on the notification, and the first application is in the foreground running state at the time the second candidate image is generated. When the image information of the second candidate image meets the image processing requirements, the second candidate image is used as the image to be processed; Determine the location information of the image to be processed, the location information including at least one of the acquisition time of the image to be processed and the user identifier of the user logged in in the first application; Based on the positioning information and the image to be processed, a processed image is obtained. The reference position of the processed image is marked with identification information, which is obtained based on the positioning information.

2. The method according to claim 1, characterized in that, After determining the location information of the image to be processed, the process further includes: The encryption result is obtained based on the location information, and the encryption result is used as the identification information.

3. The method according to claim 2, characterized in that, The step of obtaining the encryption result based on the location information includes: The encryption result is obtained based on the location information and the encryption algorithm corresponding to the first application.

4. The method according to any one of claims 1 to 3, characterized in that, The method further includes: When displaying the display interface of the first application, an image acquisition instruction for the display interface of the first application is received, a first candidate image is captured based on the image acquisition instruction, and the first candidate image is used as the image to be processed.

5. The method according to any one of claims 1 to 3, characterized in that, The image information of the second candidate image includes the image size of the second candidate image. When the image size of the second candidate image is consistent with the screen size of the electronic device, the second candidate image meets the image processing requirements.

6. The method according to any one of claims 1 to 3, characterized in that, The image information of the second candidate image includes the acquisition path of the second candidate image. When the acquisition path of the second candidate image includes a keyword, the second candidate image meets the image processing requirements. The keyword is used to indicate that the second candidate image is a screenshot.

7. The method according to any one of claims 1 to 3, characterized in that, The image information of the second candidate image includes the image size and acquisition path of the second candidate image. When the image size of the second candidate image is consistent with the screen size of the electronic device, and the acquisition path of the second candidate image includes keywords, the second candidate image meets the image processing requirements.

8. The method according to any one of claims 1 to 3, characterized in that, After obtaining the processed image based on the positioning information and the image to be processed, the method further includes: Obtain the storage location of the image to be processed; The processed image is stored in the storage location of the image to be processed.

9. An image processing method, characterized in that, The method includes: In response to an image acquisition instruction on the display interface of the first application, a second candidate image is acquired, wherein the first application is in a foreground running state at the time the second candidate image is acquired; A new image generation notification is sent to the first application. The new image generation notification is used by the first application to take the second candidate image as the image to be processed when the image information of the second candidate image meets the image processing requirements. Based on the location information of the image to be processed and the image to be processed, the first application obtains the processed image. The reference position of the processed image is displayed with identification information, which is obtained based on the location information. The location information includes at least one of the acquisition time of the image to be processed and the user identifier of the user logged in to the first application.

10. The method according to claim 9, characterized in that, After sending the new image generation notification to the first application, the method further includes: Receive the processed image sent by the first application.

11. The method according to claim 10, characterized in that, After receiving the processed image sent by the first application, the method further includes: The image after the processing is displayed.

12. The method according to any one of claims 9-11, characterized in that, The identification information is an encryption result obtained based on the location information and the encryption algorithm corresponding to the first application.

13. An image processing apparatus, characterized in that, The device includes: The first acquisition module is used to receive a new image generation notification, acquire a second candidate image generated by the electronic device based on the new image generation notification, and the first application is in the foreground running state when the second candidate image is generated; when the image information of the second candidate image meets the image processing requirements, the second candidate image is used as the image to be processed. A determining module is used to determine the location information of the image to be processed, the location information including at least one of the acquisition time of the image to be processed and the user identifier of the user logged in in the first application; The second acquisition module is used to acquire a processed image based on the positioning information and the image to be processed. The reference position of the processed image is displayed with identification information, which is obtained based on the positioning information.

14. The apparatus according to claim 13, characterized in that, The second acquisition module is further configured to acquire an encryption result based on the location information and use the encryption result as the identification information.

15. The apparatus according to claim 14, characterized in that, The second acquisition module is used to acquire the encryption result based on the location information and the encryption algorithm corresponding to the first application.

16. The apparatus according to any one of claims 13 to 15, characterized in that, The first acquisition module is further configured to receive an image acquisition instruction for the display interface of the first application when displaying the display interface of the first application, capture a first candidate image based on the image acquisition instruction, and use the first candidate image as the image to be processed.

17. The apparatus according to any one of claims 13 to 15, characterized in that, The image information of the second candidate image includes the image size of the second candidate image. When the image size of the second candidate image is consistent with the screen size of the electronic device, the second candidate image meets the image processing requirements.

18. The apparatus according to any one of claims 13 to 15, characterized in that, The image information of the second candidate image includes the acquisition path of the second candidate image. When the acquisition path of the second candidate image includes a keyword, the second candidate image meets the image processing requirements. The keyword is used to indicate that the second candidate image is a screenshot.

19. The apparatus according to any one of claims 13 to 15, characterized in that, The image information of the second candidate image includes the image size and acquisition path of the second candidate image. When the image size of the second candidate image is consistent with the screen size of the electronic device, and the acquisition path of the second candidate image includes keywords, the second candidate image meets the image processing requirements.

20. The apparatus according to any one of claims 13 to 15, characterized in that, The first acquisition module is further configured to acquire the storage location of the image to be processed; The device further includes: A storage module is used to store the processed image in the storage location of the image to be processed.

21. An image processing apparatus, characterized in that, The device includes: The first acquisition module is used to acquire a second candidate image in response to an image acquisition instruction on the display interface of the first application, wherein the first application is in a foreground running state when the second candidate image is acquired; The sending module is used to send a new image generation notification to the first application. The new image generation notification is used by the first application to take the second candidate image as the image to be processed when the image information of the second candidate image meets the image processing requirements. Based on the location information of the image to be processed and the image to be processed, the first application obtains the processed image. The reference position of the processed image displays identification information, which is obtained based on the location information. The location information includes at least one of the acquisition time of the image to be processed and the user identifier of the user logged in to the first application.

22. The apparatus according to claim 21, characterized in that, The device further includes: A receiving module is used to receive the processed image sent by the first application.

23. The apparatus according to claim 22, characterized in that, The device further includes: The display module is used to display the processed image.

24. The apparatus according to any one of claims 21-23, characterized in that, The identification information is an encryption result obtained based on the location information and the encryption algorithm corresponding to the first application.

25. An electronic device, characterized in that, The electronic device includes a processor and a memory, the memory storing at least one piece of program code, which is loaded and executed by the processor to enable the electronic device to implement the image processing method as described in any one of claims 9 to 12.

26. An electronic device, characterized in that, The electronic device has a first application installed and running, which is used to implement the image processing method as described in any one of claims 1 to 8.

27. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores at least one piece of program code, which is loaded and executed by a processor to enable the computer to implement the image processing method as described in any one of claims 1 to 12.

28. A computer program product, characterized in that, The computer program product stores at least one computer instruction, which is loaded and executed by a processor to enable the computer to implement the image processing method as described in any one of claims 1 to 12.

Images