Method and equipment for processing pictures in picture library
Through the image processing method of electronic devices, batch processing of sensitive information on pictures is achieved using simple operations, solving the problems of cumbersome operations and low privacy protection efficiency in the prior art, improving the efficiency and user experience of privacy protection processing, ensuring sensitivity Information security.
Patent Information
- Application Number
- CN202411412598.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2021-07-23
- Publication Date
- 2024-11-12
AI Technical Summary
In the prior art, when processing sensitive information on pictures, users need to repeatedly apply operations, resulting in long operation time, poor user experience, and difficulty in efficiently hiding sensitive information, increasing the risk of privacy leakage.
Provides an image processing method, which batch and accurately process sensitive information on the picture through electronic devices under simple operation of users, and uses privacy protection methods such as mosaics, graffiti, color coverage, replacement, blur, elimination or blurring to hide it. Sensitive information improves privacy protection processing efficiency and reduces user operations.
It realizes efficient hiding of sensitive information, avoids information leakage, improves privacy protection processing efficiency and user experience, and the processed pictures are beautiful, reduces user operation steps, and enhances privacy and security.
Smart Images

Figure CN118940320A_ABST
Abstract
Description
[0001] This application is a divisional application. The application number of the original application is 202110839752.7, and the original application date is July 23, 2021. The entire contents of the original application are incorporated into this application by reference. Technical Field
[0002] The embodiments of the present application relate to the field of electronic technology, and in particular, to a method and device for processing sensitive information on a gallery image. Background Art
[0003] Currently, more and more users share pictures through social platforms, thereby sharing their moods and feelings with others. Considering privacy security, users often smudge private information when sharing pictures. Figure 1 In (a)-(b), for the privacy information on the picture, the existing technology requires the user to repeatedly smear it, which takes a long time for the user to operate and has a poor user experience. Summary of the invention
[0004] The embodiments of the present application provide a method and device for processing sensitive information on images, which can enable electronic devices to process user sensitive information on images in batches and accurately, so that sensitive information is hidden, sensitive information leakage is avoided, privacy protection processing efficiency is improved, user operations are reduced, and user experience is improved.
[0005] In order to achieve the above purpose, the embodiment of the present application adopts the following technical solution: On the one hand, an embodiment of the present application provides a method for image processing, the method comprising: an electronic device displays a first interface, the first interface includes a first image, and the first image includes M sensitive elements, where M is an integer greater than 1. Then, in response to a first operation of a user on the first interface, the electronic device performs privacy protection processing on the N sensitive elements on the first image of the first interface to obtain a second image. Wherein N is an integer less than or equal to M and greater than 1. Then, the electronic device displays a second interface, and the second interface includes a second image. For example, the privacy protection processing may include mosaic processing, graffiti processing, color overlay processing, replacement processing, blur processing, elimination processing, or blur processing. For example, the first operation of the user on the first interface may be an operation of the user drawing a circle trajectory on the first image displayed on the first interface, a double-click operation of the user on a blank position on the first image displayed on the first interface, and an operation of the user clicking a preset control on the first interface.
[0006] In this solution, the electronic device can respond to simple user operations and perform privacy protection processing on multiple sensitive elements in the picture in batches and accurately, so that the sensitive elements in the picture are hidden, avoiding the leakage of sensitive elements, improving the efficiency of privacy protection processing, reducing user operations, and improving user experience.
[0007] In one possible design, the electronic device responds to a first operation of a user on a first interface, including: the electronic device responds to a first operation of a user on a first sensitive element on a first picture of the first interface, and the N sensitive elements include the first sensitive element. For example, the first operation includes a click operation, a double-click operation, a long press operation, a slide operation, a smear operation, or a circle operation on the first sensitive element.
[0008] In this solution, the electronic device can respond to a user's simple operation on a sensitive element in the image and perform privacy protection processing on multiple sensitive elements in the image in batches and accurately.
[0009] In another possible design, the first sensitive element belongs to a first sensitive element type, and the N sensitive elements on the first picture also belong to the first sensitive element type.
[0010] In this way, electronic devices can perform privacy protection processing on sensitive elements of the same type in images in batches, thereby improving the efficiency of privacy protection processing, reducing user operations, and improving user experience.
[0011] In another possible design, the N sensitive elements on the first picture have the same content as the first sensitive element.
[0012] In this way, the electronic device can perform privacy protection processing on sensitive elements with the same content in the image in batches, thereby improving the efficiency of privacy protection processing, reducing user operations, and improving user experience.
[0013] In another possible design, the first sensitive element corresponds to the first user object, and the N sensitive elements on the first picture also correspond to the first user object.
[0014] In this way, the electronic device can perform privacy protection processing on sensitive elements corresponding to the same user in the image in batches, thereby improving the efficiency of privacy protection processing, reducing user operations, and improving user experience.
[0015] In another possible design, before the electronic device displays the first interface, the method further includes: the electronic device detects a screenshot operation of the user, and the first image is a screenshot obtained by the user.
[0016] That is to say, after obtaining the screenshots, the electronic device can respond to simple operations of the user and perform privacy protection processing on sensitive elements on the screenshots in batches.
[0017] In another possible design, before the electronic device displays the first interface, the method further includes: the electronic device displays a third interface, the third interface includes the first picture, and the electronic device detects a user's sharing operation on the first picture on the third interface.
[0018] That is to say, when sharing pictures, the electronic device can respond to simple operations of the user and perform privacy protection processing on sensitive elements on the pictures in batches.
[0019] In another possible design, before the electronic device displays the first interface, the method further includes: the electronic device displays a fourth interface, the fourth interface includes the first picture. The electronic device detects a user's screen projection operation on the first picture on the fourth interface.
[0020] That is to say, when projecting pictures to other devices, the electronic device can respond to simple operations of the user and perform privacy protection processing on sensitive elements on the pictures in batches.
[0021] In another possible design, before the electronic device displays the first interface, the method also includes: the electronic device detects an operation by a user to add a first picture to be sent on the interface of the application.
[0022] That is to say, when sending pictures, the electronic device can respond to simple operations of the user and perform privacy protection processing on sensitive elements on the pictures in batches.
[0023] In another possible design, the electronic device displays the first interface, including: the electronic device prompts the user whether to perform privacy protection processing on the sensitive elements on the first picture. After the electronic device detects the user's instruction to perform privacy protection processing on the sensitive elements, it displays the first interface.
[0024] For example, when taking screenshots, sharing pictures, sending pictures, or projecting pictures, the electronic device can automatically prompt the user whether to perform privacy protection processing, so that the user can easily know that privacy protection can be performed through this function. After the electronic device detects the user's instruction to perform privacy protection processing on sensitive elements, it can respond to the user's simple operation and perform privacy protection processing on sensitive elements on the picture.
[0025] In another possible design, the electronic device prompts the user whether to perform privacy protection processing only after detecting that the first image includes sensitive elements. If the first image does not include sensitive elements, the electronic device does not prompt the user.
[0026] In another possible design, before the electronic device displays the second interface, the method further includes: the electronic device performs privacy protection processing on the first sensitive element on the first image in response to the first operation to obtain a third image. The electronic device displays a fifth interface, and the fifth interface includes the third image.
[0027] In this way, the batch processing effect of N sensitive elements is a dynamic presentation process, and the processing effects of some sensitive elements can be presented first, and then the processing effects of N sensitive elements can be presented.
[0028] In another possible design, the method further includes: the electronic device cancels the privacy protection processing of the N sensitive elements on the second picture in response to the second operation of the user on the second interface to obtain a fourth picture. The electronic device displays a sixth interface, which includes the fourth picture.
[0029] In this way, the electronic device can undo the last batch processing operation on the sensitive elements in response to the user's second operation.
[0030] In another possible design, the method further includes: the electronic device cancels the privacy protection processing of the second sensitive element on the second picture in response to the user's third operation on the second sensitive element on the second picture, thereby obtaining a fifth picture. The electronic device displays a seventh interface, which includes the fifth picture.
[0031] In this way, the electronic device can revoke the privacy protection processing of a sensitive element in response to the third operation.
[0032] In another possible design, during the process of performing privacy protection processing on N sensitive elements on the first picture, the electronic device can display on the interface the dynamic effects of the N sensitive elements from never being processed, to being half processed, and to being completed, so that the presentation of the privacy protection processing effect is more flexible and vivid.
[0033] In another possible design, after the electronic device enters the editing mode of the first picture, in response to the user's first operation on the first interface, the second picture is obtained by performing privacy protection processing on N of the M sensitive elements on the first picture. The first picture can be obtained from a gallery, an interface of an application, or a screenshot.
[0034] In this solution, the electronic device can perform privacy protection processing on sensitive elements on images in batches in response to simple operations by the user in the editing state.
[0035] In another possible design, the first picture is a screenshot of the group chat interface or a screenshot of the sharing circle interface.
[0036] In this way, the electronic device can respond to simple operations of the user and perform privacy protection processing on sensitive elements on group chat interface screenshots or sharing circle interface screenshots in batches.
[0037] On the other hand, an embodiment of the present application provides a picture processing device, which is included in an electronic device, and the device has the function of realizing the behavior of the electronic device in any of the above aspects and possible designs. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes at least one module or unit corresponding to the above function. For example, a display module or unit, a processing module or unit, a detection module or unit, etc.
[0038] On the other hand, an embodiment of the present application provides an electronic device, which may include a display screen for displaying an interface; one or more processors; a memory; and one or more computer programs; wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions; when the instructions are executed by the processor, the electronic device executes the image processing method in any possible design of the above aspects.
[0039] On the other hand, an embodiment of the present application provides an electronic device, which may include one or more processors; a memory; and one or more computer programs; wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions; when the instructions are executed by the processor, the electronic device executes the image processing method in any possible design of the above aspects.
[0040] On the other hand, an embodiment of the present application provides a computer storage medium, including computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the image processing method in any possible design of the above aspects.
[0041] On the other hand, an embodiment of the present application provides a computer program product, which, when executed on a computer, enables the computer to execute the image processing method in any possible design of the above aspects.
[0042] The beneficial effects of other aspects of the present application can be found in the relevant description of the beneficial effects of the above-mentioned method, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] Figure 1 A schematic diagram of the processing effect of privacy information on a picture provided by the prior art; Figure 2 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application; Figure 3 A set of interface schematic diagrams provided for embodiments of the present application; Figure 4 Another set of interface schematic diagrams provided for embodiments of the present application; Figure 5Another set of interface schematic diagrams provided for embodiments of the present application; Figure 6 Another set of interface schematic diagrams provided for embodiments of the present application; Figure 7 Another set of interface schematic diagrams provided for embodiments of the present application; Figure 8 Another set of interface schematic diagrams provided for embodiments of the present application; Fig. 9 Another set of interface schematic diagrams provided for embodiments of the present application; Fig.10 Another set of interface schematic diagrams provided for embodiments of the present application; Fig.11 Another set of interface schematic diagrams provided for embodiments of the present application; Fig. 12A Another set of interface schematic diagrams provided for embodiments of the present application; Fig. 12B Another set of interface schematic diagrams provided for embodiments of the present application; Fig.13 Another set of interface schematic diagrams provided for embodiments of the present application; Fig.14 Another set of interface schematic diagrams provided for embodiments of the present application; Fig.15 Another set of interface schematic diagrams provided for embodiments of the present application; Fig.16 Another set of interface schematic diagrams provided for embodiments of the present application; Fig.17 Another set of interface schematic diagrams provided for embodiments of the present application; Fig.18 Another set of interface schematic diagrams provided for embodiments of the present application; Fig.19 Another set of interface schematic diagrams provided for embodiments of the present application; Fig. 20A Another set of interface schematic diagrams provided for embodiments of the present application; Fig. 20B Another set of interface schematic diagrams provided for embodiments of the present application; Fig.21 Another set of interface schematic diagrams provided for embodiments of the present application; Fig.22A Another set of interface schematic diagrams provided for embodiments of the present application; Fig. 22B Another set of interface schematic diagrams provided for embodiments of the present application; Fig.23 Another set of interface schematic diagrams provided for embodiments of the present application; Fig.24AAnother set of interface schematic diagrams provided for embodiments of the present application; Fig. 24B Another set of interface schematic diagrams provided for embodiments of the present application; Fig.25A Another set of interface schematic diagrams provided for embodiments of the present application; Fig.25B Another set of interface schematic diagrams provided for embodiments of the present application; Fig.26A A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application; Fig.26B A schematic diagram of a software module of an electronic device provided in an embodiment of the present application; Fig. 27 A flowchart of a method for processing sensitive information provided in an embodiment of the present application; Fig.28 A schematic diagram of the hardware structure of another electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0044] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0045] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.
[0046] In the embodiments of the present application, the words "exemplarily" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.
[0047] In the prior art, for a certain sensitive information on a picture, the user needs to repeatedly smear it to prevent the sensitive information from being leaked. When the picture includes multiple sensitive information, the user needs to repeatedly smear it more times, which makes the operation more complicated and takes longer, and the user experience is poor.
[0048] The embodiment of the present application provides a method for processing sensitive information on a picture, which can be applied to electronic devices, and can enable electronic devices to batch and accurately process sensitive information (also known as sensitive elements) of users on pictures, so that sensitive information is hidden and sensitive information leakage is avoided, thereby protecting the privacy and security of users, improving the efficiency of privacy protection processing, reducing user operations, and enabling users to conveniently perform privacy protection processing on pictures, thereby improving user experience. Moreover, compared with pictures that are repeatedly painted by users in the prior art, pictures processed by the method provided in the embodiment of the present application are more beautiful.
[0049] For example, the electronic device may be a mobile phone, a tablet computer, a wearable device, a smart home device, a vehicle-mounted device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The embodiments of the present application do not impose any restrictions on the device type of the electronic device.
[0050] For example, Figure 2A schematic diagram of the structure of the electronic device 100 is shown. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0051] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0052] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0053] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0054] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0055] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. GNSS may include the global positioning system (GPS), the global navigation satellite system (GLONASS), the Beidou navigation satellite system (BDS), the quasi-zenith satellite system (QZSS) and / or the satellite based augmentation system (SBAS).
[0056] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
[0057] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1. For example, the display screen 194 can be used to display pictures and interfaces, etc.
[0058] The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0059] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0060] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.
[0061] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194. For example, the touch sensor 180K can respond to the user's touch operation to indicate the activation of a privacy protection function or trigger privacy protection processing of certain sensitive information.
[0062] In the embodiment of the present application, the touch sensor 180K can detect a touch operation of the user, which is used to instruct the electronic device 100 to turn on the privacy protection function. The touch sensor 180K can also detect another touch operation of the user, which is used to trigger privacy protection processing of sensitive information. The processor 110 runs the instructions stored in the internal memory 121, so that after the privacy protection function is turned on, the electronic device 100 responds to the user's triggering operation and processes the sensitive information on the picture in batches, accurately and quickly, thereby improving the efficiency of privacy protection processing.
[0063] The following will take a mobile phone as an example of an electronic device to illustrate the method for processing sensitive information on a picture provided in an embodiment of the present application.
[0064] In the method for processing sensitive information on a picture provided in an embodiment of the present application, the mobile phone can turn on the privacy protection function, and then perform privacy protection processing on the sensitive information on the picture. The privacy protection function refers to batch, accurate, and fast processing of sensitive information on the picture, thereby hiding the sensitive information on the picture, avoiding leakage of sensitive information, and protecting the privacy of the user. The processing of sensitive information here may include graffiti, blurring, virtualization, replacement or overwriting, etc. Based on the privacy protection function, the mobile phone can improve the efficiency of privacy protection processing, reduce user operations, and enable users to conveniently process private information in batches, and the processed pictures are more beautiful, which can improve the user experience.
[0065] Among them, the sensitive information is the private information that the user in the picture does not want others to know. For example, the sensitive information may include one or more types of information such as the identity information, financial information, health information or biometric information of the user in the picture. For example, identity information may include name, nickname, avatar, age, private body parts, ID number, mobile phone number, home address, unit name or unit address and other information. Financial information may include financial account number, bank card number, payment code, red envelope amount or transfer amount, etc. Health information may include blood pressure information, heart rate information, body fat information or historical disease information, etc. Biometric information includes fingerprint information or palm print information, etc.
[0066] Among them, the privacy protection processing can hide sensitive information on the image so that the sensitive information cannot be seen by other users, thereby avoiding the leakage of sensitive information and ensuring the privacy security of users. There are many specific ways of privacy protection processing, such as graffiti sensitive information, blurring sensitive information (such as mosaic), covering sensitive information (such as covering sensitive information with other content, or covering sensitive information with a certain color), replacing sensitive information (such as replacing it with other content), eliminating sensitive information or blurring sensitive information, etc. The embodiments of this application do not limit the specific methods of privacy protection processing.
[0067] In some embodiments of the present application, the mobile phone can turn on the privacy protection function in response to the user's trigger operation, thereby performing privacy protection processing on sensitive information in the picture.
[0068] For example, the phone detects that the user clicks Figure 3 After the operation of the thumbnails of the pictures 300 in the gallery shown in (a), as shown in FIG. Figure 3 As shown in (b) of FIG. 1 , a picture display interface is displayed, and the picture display interface includes a privacy protection mode control 301. After the mobile phone detects the user's operation on the privacy protection mode control 301, the privacy protection function is turned on, so that the sensitive information on the picture can be privacy protected.
[0069] For example, the phone detects that the user clicks Figure 3 After the operation of the thumbnails of the pictures 300 in the gallery shown in (a), as shown in FIG. Figure 3 As shown in (c) of FIG. 1 , a picture display interface is displayed, and the picture display interface includes an editing control 302. After the mobile phone detects that the user clicks the editing control 302, as shown in FIG. Figure 3 As shown in (d) in FIG. 1 , an editing interface is displayed. The editing interface includes a privacy protection mode control 303. After the mobile phone detects the user's operation on the privacy protection mode control 303, the privacy protection function is turned on, so that the sensitive information on the picture can be protected from privacy.
[0070] For another example, after the mobile phone displays the picture display interface, if it detects the user's voice command to turn on privacy protection, or detects a specific user gesture operation (such as a swipe up operation or a long press operation, etc.), the privacy protection function is turned on.
[0071] Among them, the picture display interface here can not only be the display interface of the pictures in the above-mentioned gallery, but also the display interface of the pictures opened from a certain application (which can be referred to as application for short) (for example, after clicking on the picture on the shopping application interface, the display interface of the picture is displayed; for example, after clicking on the picture on the chat interface of the social application, the display interface of the picture is displayed), or the display interface of the screenshot obtained when taking a screenshot, etc. Among them, screenshot refers to capturing the image in part or all of the area displayed on the mobile phone screen and saving it as a picture. The embodiments of this application do not limit the source, acquisition method or type of pictures that can be processed for privacy protection.
[0072] For example, see Figure 4 In (a), after the mobile phone takes a screenshot, if the mobile phone detects that the user clicks on the screenshot, Figure 4 Enter the screenshot image display interface as shown in (b) in the figure. Figure 4 As shown in (b) in the figure, after the mobile phone detects the user's specific upward sliding gesture, the privacy protection function is turned on.
[0073] It should be noted that the mobile phone can also enable the privacy protection function in response to other touch operations, voice commands or quick gestures of the user. The embodiment of the present application does not limit the specific operation form of triggering the mobile phone to enable the privacy protection function.
[0074] After the privacy protection function is turned on in the mobile phone, the sensitive information on the picture can be processed for privacy protection through the privacy protection method, so as to hide the sensitive information on the picture, so that the sensitive information on the picture is no longer presented to the user, so as to protect the user's privacy information from being leaked. For example, the privacy protection method may include a mosaic method, a graffiti method, a color covering method, a replacement method, a blurring method, an elimination method or a virtualization method, etc. Correspondingly, the sensitive information after the privacy protection processing is mosaicked, graffitied, covered with color, replaced, blurred, eliminated or virtualized, etc. It can be understood that the privacy protection method can also include many other specific methods, and the embodiments of the present application are not limited to this specific method.
[0075] Among them, the mosaic method refers to mosaicing the location of sensitive information on the picture to avoid leakage of sensitive information. The graffiti method refers to graffiti on the location of sensitive information on the picture to avoid leakage of sensitive information. The color covering method refers to using a certain color to cover the sensitive information on the picture, or using a combination of multiple colors to cover the sensitive information on the picture to avoid leakage of sensitive information. The replacement method refers to replacing the sensitive information on the picture with non-sensitive information to avoid leakage of sensitive information. The blurring method refers to blurring the sensitive information on the picture to avoid leakage of sensitive information. The elimination method refers to eliminating the sensitive information on the picture to avoid leakage of sensitive information. The blurring method refers to blurring the sensitive information on the picture to avoid leakage of sensitive information.
[0076] The privacy protection method used by the mobile phone after the privacy protection function is turned on may be a system default method, a method used when the mobile phone last performed privacy protection processing, or a method preset by the user. For example, the privacy protection method used by the mobile phone after the privacy protection function is turned on is the system default mosaic method. The mobile phone can also change to other methods according to the user's modification operation.
[0077] Alternatively, the privacy protection mode adopted by the mobile phone after the privacy protection function is turned on is the mode set by the user after the privacy protection function is turned on. Figure 5 In (a), after the mobile phone turns on the privacy protection function, the privacy protection mode option 50 is displayed on the interface so that the user can set the privacy protection mode. In another exemplary embodiment, after the mobile phone turns on the privacy protection function, the setting control 500 is displayed on the interface. After the mobile phone detects the user's operation on the setting control 500, Figure 5 (c) in the figure shows a privacy protection setting interface, which includes a privacy protection mode option 501 for the user to set the privacy protection mode.
[0078] In some embodiments of the present application, after the privacy protection function is turned on on the mobile phone, the user can trigger the mobile phone to automatically batch process the relevant sensitive information on the picture based on the privacy protection method and the batch processing strategy (also called batch processing rules) through a simple trigger operation. The trigger operation can be an operation in which the user draws a circle track on the picture displayed on the mobile phone interface, a double-click operation of the user on a blank position on the picture (or a blank position on the interface), an operation in which the user clicks on a preset control on the interface, a voice operation of the user, or a preset gesture operation, etc. The specific form of the trigger operation is not limited in the embodiment of the present application. For example, the batch processing strategy includes a batch processing strategy for avatars, a batch processing strategy for avatars and nicknames, a batch processing strategy for identity information, a batch processing strategy for health information, a batch processing strategy for health information, or a batch processing strategy for all sensitive information, etc. The batch processing strategy can be a preset strategy or a strategy set by the user. For example, when the batch processing strategy is a batch processing strategy for avatars and nicknames, the mobile phone responds to the user's trigger operation and performs privacy protection processing on all avatars and all nicknames on the picture in batches. When the batch processing policy is the identity information batch processing policy, the mobile phone responds to the user's trigger operation and performs privacy protection processing on all identity information on the picture in batches. When the batch processing policy is the all sensitive information batch processing policy, the mobile phone responds to the user's trigger operation and performs privacy protection processing on all sensitive information on the picture in batches. For example, after the mobile phone detects that the user double-clicks a blank position on the picture, it performs privacy protection processing on all identity information on the picture based on the identity information batch processing policy. It should be noted that the batch processing policy can also include other policies not shown, and the examples here cannot be used as a limitation on the batch processing policy. In this way, users can batch process the privacy information on the picture simply, conveniently, quickly and accurately.
[0079] In other embodiments of the present application, after the privacy protection function is turned on on the mobile phone, the user can trigger the mobile phone to automatically batch process the relevant sensitive information on the picture based on the privacy protection method and batch processing strategy through a simple trigger operation on a certain sensitive information on the picture. For example, the batch processing strategy may include: batch processing strategy for the same information, batch processing strategy for the same type, batch processing strategy for the same user object, or batch processing strategy for all sensitive information. It should be noted that the batch processing strategy may also include other strategies not shown, and the embodiments of the present application do not limit the specific strategy methods of the batch processing strategy. In this way, the user can batch process the private information on the picture simply, conveniently, quickly, and accurately.
[0080] In some embodiments, the batch processing policy may be a system default policy, a policy preset by the user through system settings, or a batch processing policy used when the mobile phone last performed privacy protection processing. In addition, the user may also change the batch processing policy.
[0081] In some other embodiments, the batch processing strategy adopted by the mobile phone is a strategy set by the user after the privacy protection function is turned on. Figure 5 In (d), after the mobile phone turns on the privacy protection function, a batch processing strategy option 51 is displayed on the interface so that the user can set or change the batch processing strategy. Figure 5 In (c), the privacy protection setting interface includes a batch processing policy option 502, so that the user can set or change the batch processing policy.
[0082] The following will take the mosaic method as an example of privacy protection, and combine different batch processing strategies to illustrate the method for processing sensitive information on the picture provided by the embodiment of the present application.
[0083] Based on the same information batch processing strategy, after the mobile phone detects the user's trigger operation on sensitive information 1 at a certain position on the picture, it automatically mosaics the positions of all sensitive information 1 on the picture to prevent the sensitive information 1 on the picture from being leaked, so that the privacy protection processing can be performed on sensitive information in batches, accurately and quickly, thereby improving the efficiency of privacy protection processing, allowing users to conveniently process sensitive information in batches, and improving user experience.
[0084] The trigger operation may be a simple touch operation of the user, such as an operation of the user clicking on sensitive information 1, double-clicking on sensitive information 1, long pressing on sensitive information 1, sliding on sensitive information 1, smearing on sensitive information 1, or circling sensitive information 1 (i.e., circling sensitive information 1), etc. Alternatively, the trigger operation may also be a voice command or a specific gesture operation, etc. The specific form of the trigger operation is not limited in the embodiments of the present application.
[0085] For example, the picture to be processed for privacy protection is a screenshot of the sharing circle interface, see Figure 6 In (a), after the mobile phone detects the user's click operation on Zhang San's head portrait 601 at position 1 on the picture, according to the mosaic method and the same information batch processing strategy, such as Figure 6 As shown in (b), the head portrait of Zhang San at position 1 and other positions on the picture are all mosaiced. It can be understood that in the embodiment of the present application, mosaicing the sensitive information on the picture means mosaicing the position where the sensitive information is located on the picture.
[0086] In addition, the phone can prompt the user on the interface that the privacy protection function is currently turned on (such as Figure 6 The prompt information 602 shown in (a) in the figure may also prompt the user of the privacy protection method currently adopted (such as Figure 6 The prompt information 603 shown in (a) in the figure, currently using mosaic mode), can also prompt the user of the batch processing strategy currently used (such as Figure 6 The prompt information 604 shown in (a) in the figure currently adopts the same information batch processing strategy). Figure 6 As shown in (a) in FIG. 1 , a control 61 on the interface can be used to display other privacy protection methods so that the user can change the privacy protection method, and a control 62 can be used to display other batch processing strategies so that the user can change the batch processing strategy.
[0087] Based on the same type of batch processing strategy, after the mobile phone detects the user's trigger operation on sensitive information 1 at a certain location on the picture, it automatically mosaics the locations of all sensitive information of the type to which sensitive information 1 belongs on the picture to prevent the sensitive information of the type to which sensitive information 1 belongs on the picture from being leaked. In this way, privacy protection processing can be performed on a certain type of sensitive information in batches, accurately and quickly, thereby improving the efficiency of privacy protection processing and user experience.
[0088] For example, see Figure 7 In (a), the mobile phone detects the user's smearing operation on Zhang San's head portrait 701. According to the mosaic method and the same type of batch processing strategy, Figure 7 As shown in (b) in the figure, all the user avatars in the picture (such as the avatars of Zhang San, Li Si and Wang Wu) have been mosaiced.
[0089] For further example, see Figure 8 In (a), the mobile phone detects the user's long press operation on Zhang San's nickname 801. According to the mosaic method and the same type of batch processing strategy, Figure 8 As shown in (b), the nicknames of all users in the image (such as the nicknames of Zhang San, Li Si and Wang Wu) are mosaiced.
[0090] It should be noted that in one classification method, the types of sensitive information can include not only avatars or nicknames, but also age, ID number, bank card number, blood pressure information or fingerprint information, etc., which are not listed one by one.
[0091] In another classification method, the types of sensitive information can also be identity information, financial information, health information, or biometric information.
[0092] It is understandable that the types of sensitive information may be classified in other ways, which are not limited.
[0093] For example, see Fig. 9 In (a), the mobile phone detects that the user clicks on Zhang San's avatar 901. The type of sensitive information to which the avatar belongs is identity information. According to the mosaic method and the same type of batch processing strategy, Fig. 9 As shown in (b), all sensitive identity information types in the image (such as Zhang San’s avatar and nickname, Li Si’s avatar and nickname, and Wang Wu’s avatar and nickname) are mosaiced.
[0094] As another example, the mobile phone detects that the user has circled a piece of blood pressure information, and the type of sensitive information to which the blood pressure information belongs is health information. According to the mosaic method and the same type of batch processing strategy, all the health information on the picture is mosaic processed.
[0095] Based on the same-user object batch processing strategy, after the mobile phone detects the user's trigger operation on sensitive information 1 at a certain location on the picture, it automatically mosaics the location where all sensitive information of user 1 belonging to sensitive information 1 on the picture is located, to prevent the sensitive information of user 1 on the picture from being leaked, so that privacy protection processing can be performed on sensitive information in batches, accurately and quickly, thereby improving the efficiency of privacy protection processing and user experience.
[0096] For example, see Fig.10 In (a), the mobile phone detects the user's click operation on Zhang San's head portrait 1001, and according to the mosaic method and the same user object batch processing strategy, Fig.10 As shown in (b), all of Zhang San’s sensitive information in the picture (such as Zhang San’s avatar and nickname) has been mosaiced.
[0097] In other classification methods, the sensitive information type includes user objects, that is, the sensitive information corresponding to the same user object belongs to the same sensitive information type.
[0098] Based on the strategy of batch processing of all sensitive information, after the mobile phone detects the user's trigger operation on sensitive information 1 at a certain position on the picture, it automatically mosaics all the sensitive information locations on the picture to prevent the sensitive information on the picture from being leaked, so that the privacy protection processing of sensitive information can be carried out in batches, accurately and quickly, improving the efficiency of privacy protection processing and user experience. Among them, all sensitive information here includes various sensitive information that can be identified by the mobile phone, or includes multiple types of sensitive information pre-set by the user.
[0099] For example, see Fig.11 In (a), in the screenshot of the group chat interface, the mobile phone detects that the user clicks on the avatar 1101 of Zhang San. The type of sensitive information to which the avatar belongs is identity information. According to the mosaic method and the batch processing strategy of all sensitive information, Fig.11As shown in (b), all sensitive information in the picture (such as Zhang San’s avatar and nickname, Li Si’s avatar and nickname, and Wang Wu’s avatar, nickname and transfer amount) has been mosaiced.
[0100] If the image is a screenshot of a sharing interface, such as a screenshot of a group chat interface or a screenshot of a sharing circle interface, then in some embodiments, since the content shared by the current user or other users in the screenshot is usually intended to be shared with others, the sensitive information processed by the privacy protection process may not include the content shared by the user in the interface screenshot (for example, Fig. 9 In some other embodiments, the sensitive information processed by privacy protection may also include all the content on the picture, that is, the content shared by the user on the interface screenshot. Fig. 12A In (a), in the screenshot of the sharing circle interface, the mobile phone detects that the user clicks on Zhang San's avatar 1201. The type of sensitive information to which the avatar belongs is identity information. According to the mosaic method and the same type of batch processing strategy, Fig. 12A As shown in (b) of the figure, all sensitive information of identity information types in the picture (such as Zhang San's head picture, nickname and heart rate information, Li Si's head picture, nickname and face in the shared content, Wang Wu's head picture, nickname and face in the shared content) are mosaic processed. For another example, the mobile phone detects that the user has clicked on the following Fig. 12B The click operation of Zhang San's head portrait 1202 shown in (a) is performed according to the mosaic method and the batch processing strategy of the same user object, such as Fig. 12B As shown in (b), all of Zhang San’s sensitive information in the picture (such as Zhang San’s avatar, nickname, and heart rate information in the shared content) has been mosaiced.
[0101] In this way, based on the batch processing strategy and the user's simple operation on a certain sensitive information, the mobile phone can be triggered to batch, accurately and quickly process other related sensitive information on the picture according to the sensitive information and the batch processing strategy, without the user having to repeatedly paint each sensitive information separately. This can improve the efficiency of privacy protection processing, reduce user operations and improve user experience.
[0102] In an embodiment of the present application, the privacy protection processing effect of the sensitive information triggered by the user and the privacy protection processing effect of other sensitive information corresponding to the batch processing strategy can be presented synchronously, or can be presented one after another.
[0103] For example, in one classification method, the user's profile picture belongs to a sensitive information type, and the mobile phone detects that the user Fig.13After the click operation of Zhang San's head portrait 1301 at position 1 shown in (a) of FIG. 1 , according to the mosaic method and the same type of batch processing strategy, such as Fig.13 As shown in (b) in the figure, the portrait of Zhang San at position 1 is mosaiced. Then, Fig.13 As shown in (c) in the figure, other user avatars are mosaiced simultaneously. In other words, the sensitive information targeted by the user is mosaiced first, and then other corresponding sensitive information is mosaiced.
[0104] Or, the phone detects that the user is targeting Fig.14 After the click operation of Zhang San's head portrait 1401 at position 1 shown in (a) of FIG. 1 , according to the mosaic method and the same type of batch processing strategy, such as Fig.14 As shown in (b) in the figure, the portrait of Zhang San at position 1 is mosaiced. Then, Fig.14 As shown in (c) in the figure, Li Si’s user profile picture is mosaiced. Fig.14 As shown in (d) in the figure, Wang Wu’s user profile picture has been mosaiced. In other words, the sensitive information on the picture has been mosaiced sequentially and dynamically.
[0105] Or, the phone detects that the user is targeting Fig.15 After the click operation of Zhang San's head portrait 1501 at position 1 shown in (a) in FIG. 1 , according to the mosaic method and the same type of batch processing strategy, such as Fig.15 As shown in (b), the user portraits at position 1 and other positions are all mosaiced. In other words, the user portraits on the picture are mosaiced at once and synchronously.
[0106] In another exemplary embodiment, the mobile phone detects that the user is targeting Fig.16 After the smearing operation of Zhang San's head portrait 1601 at position 1 shown in (a), according to the mosaic method and the same type of batch processing strategy, such as Fig.16 As shown in (b) in FIG, the user portraits at position 1 and other positions are mosaic processed synchronously. Figure 7 As shown in (a)-(b) in the figure, the avatar at position 1 is first mosaicked, and then the avatars of users at other positions are mosaicked.
[0107] In some embodiments of the present application, when the privacy protection processing of sensitive information does not meet the user's needs due to user's misoperation or other reasons, or when the user specifically wants to present certain sensitive information that has been processed for privacy protection, the mobile phone can also revoke the privacy protection processing of the sensitive information in response to the user's revocation operation.
[0108] For example, in one possible design, after the mobile phone turns on the privacy protection function, an undo control is displayed on the interface, and the undo operation can be an operation performed by the user on the undo control. In response to the user's operation on the undo control, the privacy protection processing of sensitive information is revoked. In some technical solutions, the mobile phone responds to the user's operation on the undo control and revokes the most recent batch privacy protection processing of multiple sensitive information. For example, the most recent batch privacy protection processing of multiple sensitive information can be multiple sensitive information of the same information, multiple sensitive information of the same type, multiple sensitive information of the same user object, or all sensitive information, etc. For example, see Fig.17 In (a), the mobile phone detects the user's click operation on Zhang San's head portrait. According to the mosaic method and the same type of batch processing strategy, Fig.17 As shown in (b) in the figure, all the avatars of users in the picture (such as Zhang San, Li Si and Wang Wu) are mosaiced. Then, the mobile phone detects the user's click operation on Zhang San's nickname, and according to the mosaic method and the same type of batch processing strategy, Fig.17 As shown in (c) in FIG. 1 , all nicknames of users on the picture (such as the nicknames of Zhang San, Li Si and Wang Wu) are mosaiced. If the mobile phone detects that the user clicks the cancel control 1701, the mosaic processing of all nicknames of users on the picture is canceled, and the display Fig.17 The processing result is shown in (b) in FIG. Fig.17 As shown in (c) in the figure, the interface of the mobile phone also includes a completion control 1702. After the mobile phone detects the user's operation on the control 1702, it completes the privacy protection processing of the image. In other technical solutions, the mobile phone responds to the user's operation on the cancellation control and cancels the last sensitive information that has been subjected to privacy protection processing.
[0109] In another possible design, if the mobile phone detects that the user clicks on sensitive information that has been processed for privacy protection (i.e., cancels the operation, which can also be a long press or double click, etc.), the privacy protection processing of the sensitive information will be canceled. Fig.18 In (a), if the mobile phone detects that the user clicks on sensitive information 1801, Fig.18 As shown in (b) in the figure, the privacy protection processing of sensitive information 1801 is revoked.
[0110] In another possible design, for a picture that has been processed for privacy protection, if the phone detects that the user has double-clicked an area after selecting it, the privacy protection processing for sensitive information in the area will be canceled. Fig.19In (a), if the mobile phone detects that the user selects area 1901 and then double-clicks in the area, then Fig.19 As shown in (b) in FIG. 1 , the privacy protection processing of the sensitive information in the area 1901 is revoked.
[0111] In another possible design, the undo operation may be the same as or different from the trigger operation 1 described above. For example, the trigger operation is a smear operation from left to right, and the undo operation is a smear operation from right to left; for another example, the trigger operation is a click operation, and the undo operation is also a click operation. If the mobile phone detects that the user has smeared from right to left on sensitive information that has been processed for privacy protection, the privacy protection processing of the sensitive information will be canceled.
[0112] It is understandable that the undo operation may also be a voice command operation, a specific gesture operation or other touch operation, etc., which is not limited in the embodiment of the present application.
[0113] In this way, the mobile phone can respond to the user's operation to promptly, flexibly and accurately cancel the privacy protection processing for certain sensitive information, thereby accurately shielding truly sensitive information and accurately presenting the information that the user wants to display.
[0114] The above is explained using the mosaic mode as an example. When the privacy protection mode is other modes, other related sensitive information on the image can still be processed in batches, accurately and quickly based on the user's simple operation on a certain sensitive information and batch processing strategy, thereby improving the efficiency of privacy protection processing and reducing user operations.
[0115] For example, see Fig. 20A In (a)-(b) above, if the privacy protection method is graffiti and the batch processing strategy is the same type of batch processing, after the mobile phone detects that the user clicks on an avatar on the picture, it automatically graffiti all the avatars on the picture in batches, accurately and quickly, without the user having to smudge each avatar multiple times or adjust the size of the smudge pen. This can improve the efficiency of privacy protection processing, reduce user operations, and improve user experience.
[0116] For example, see Fig. 20BIn (a)-(b), if the privacy protection method is replacement, and the batch processing strategy is batch processing of the same type, after the mobile phone detects that the user clicks on a certain avatar (such as Zhang San's avatar) on the picture, it automatically replaces the avatars of all users on the picture with other pictures (such as a picture of a flower, a picture of the sky, a picture of white clouds, a picture of the sea, or a picture of a kitten, etc.) in batches, accurately, and quickly, without the user having to operate for each avatar separately, thereby improving the efficiency of privacy protection processing, reducing user operations, and improving user experience. Among them, different avatars can be replaced with different pictures, or they can be replaced with the same picture, without limitation.
[0117] For another example, if the privacy protection method is color overlay, and the batch processing strategy is batch processing of the same type, after the mobile phone detects that the user clicks on a certain avatar on the picture, it automatically uses a certain color or a combination of certain colors to cover all the avatars of users on the picture in batches, accurately, and quickly, without the user having to operate for each avatar separately, thereby improving the efficiency of privacy protection processing, reducing user operations, and improving user experience. For example, the mobile phone can use white to cover sensitive information, or use the same color as the background near the sensitive information to cover sensitive information.
[0118] Similar to the case where the privacy protection mode is the mosaic mode, when the privacy protection mode is other modes, the mobile phone can also cancel the privacy protection processing in response to the user's cancellation operation, which will not be elaborated herein.
[0119] In some embodiments of the present application, the traces of privacy protection processing of sensitive information on the picture are less obvious, and the processed picture is more beautiful. For example, the location of privacy protection processing such as mosaic, graffiti, color overlay, replacement, blur, elimination or virtualization will not exceed the area where the sensitive information is located, and the edges of the processed area are neat, the elements on the picture are more harmonious, and the processed picture is more beautiful. For example, when it is a graffiti method, the thickness of the graffiti pen can be adapted to the size of the sensitive information, and the graffiti traces will not exceed the location of the sensitive information. In this way, the picture after graffiti processing of sensitive information has less obvious processing traces, the picture elements are more harmonious, and the processed picture is more beautiful. In the prior art, the user's smearing operation may cause the smearing to exceed the area where the sensitive information is located, the edges of the smearing area are uneven, and the smeared picture is less beautiful.
[0120] In some other embodiments of the present application, the mobile phone can also process the location of sensitive information through a combination of one or more of color matching, color gradient, graphic combination, transparency or blur, etc., to achieve the effect of concealing sensitive information and reduce the feeling that the picture has been obviously tampered with. In this way, the sensitive information after privacy protection processing is better integrated with other content on the picture, the different elements on the picture are more harmonious, and the processed picture is more beautiful. Therefore, when the picture processed with privacy protection is shared, it is not easy to give others a sense of distrust that the privacy protection processing has been specially carried out, and others have a better experience. Among them, based on the same privacy protection method, the specific processing methods of different sensitive information processed in the same batch can be the same or different.
[0121] For example, when the privacy protection method is a mosaic method, the size, number or layout of the grids included in the mosaic can be adapted to the background of the location of the sensitive information on the picture. For example, if the background of the sensitive information is white clouds above and blue sky below, the location of the sensitive information can also include upper and lower areas when mosaic is made, and the color of the mosaic grid in the lower area is similar to the color of the blue sky, and the color of the mosaic grid in the upper area is similar to the color of the white clouds. For another example, the transparency of the mosaic can be larger, the color can be lighter, and the blurriness can be larger, so that the traces of image coding are less obvious, reducing the visual sense that the image has been obviously tampered with. Moreover, the transparency, color change, graphic change, and blurriness of the mosaic can also match the background around the sensitive information, so that the coded sensitive information is better integrated with the background, reducing the sense of disobedience.
[0122] For another example, when the privacy protection method is color overlay, the color used to cover the sensitive information can be the same as or similar to the color of the location near the sensitive information on the picture, so that the processed sensitive information can be better integrated with the background, the processing traces are less obvious, the image elements are more harmonious, and the processed image is more beautiful. For example, when the location near the sensitive information on the picture is the blue sea, the sensitive information can be covered with the same or similar color as the blue sea, giving the user the feeling that the location of the processed sensitive information is also part of the sea, and the location of the sensitive information has not been processed for privacy protection, and the processed image is more beautiful. For another example, see Fig.21 In (a)-(b), if the privacy protection method is the color overlay method and the batch processing strategy is the same type of batch processing, after the mobile phone detects that the user clicks on a nickname 2101 on the picture, it automatically uses the same color as the background near the sensitive information to cover all the nicknames on the picture, so that the processed sensitive information is integrated with the background, and the user cannot see the processing traces or the processing traces are less obvious.
[0123] For another example, when the privacy protection method is color covering, the color used to cover the edge area of sensitive information can be the same as or similar to the color of the edge of the sensitive information; the color used to cover the edge area of sensitive information and the color used to cover the center area of sensitive information can be gradient, so that the processed sensitive information is better integrated with the background, the processing traces are less obvious, the picture elements are more harmonious, and the processed picture is more beautiful.
[0124] For another example, when the privacy protection method is replacement, the location of sensitive information can be replaced with the background content of the area near the sensitive information, so that the processed sensitive information is better integrated with the background, the processing traces are less obvious, the image elements are more harmonious, and the processed image is more beautiful. When sensitive information is replaced with non-sensitive information, other users cannot see the processing traces, and the processed image is beautiful and does not look tampered with. For example, the sensitive information in the sharing circle is the user's avatar, and the user's avatar can be replaced with a non-sensitive picture so that other users cannot see the processing traces; and the avatars of different users can be replaced with different non-sensitive pictures, giving users the feeling that the replaced non-sensitive pictures are real avatars.
[0125] In some other embodiments, the privacy protection mode corresponds to the user's triggering operation for sensitive information. Different triggering operations will result in different privacy protection modes adopted by the mobile phone. For example, if the triggering operation is a click operation, the privacy protection mode is a mosaic mode; if the triggering operation is a slide operation, the privacy protection mode is a smear mode.
[0126] In some other embodiments, the batch processing strategy corresponds to the user's trigger operation for sensitive information. Different trigger operations will result in different batch processing strategies adopted by the mobile phone. For example, if the trigger operation is a click operation, the batch processing method is the same information batch processing; if the trigger operation is to circle sensitive information, the batch processing strategy is the same type of batch processing.
[0127] In the embodiments of the present application, users can set the mobile phone to adopt different batch processing strategies in the privacy protection mode, thereby meeting the security requirements of different users. Users can also set the mobile phone to adopt different privacy protection methods in the privacy protection mode, thereby meeting the personalized processing requirements of different users for privacy protection. The method for processing sensitive information on pictures provided in the embodiments of the present application is applicable to more scenarios and has a more flexible design.
[0128] In some other embodiments, after the privacy protection function is turned on, the mobile phone can select an area to be processed on the image in response to the user's operation, thereby performing privacy protection processing on sensitive information in the area to be processed in the manner described in the above embodiments, or canceling the privacy protection processing.
[0129] In some other embodiments, after the privacy protection function is turned on, the mobile phone can select a non-processed area on the image in response to the user's operation, thereby performing privacy protection processing on sensitive information in other areas outside the non-processed area in the manner described in the above embodiments, or canceling the privacy protection processing.
[0130] In other embodiments, based on the picture display interface, after the mobile phone responds to the user's trigger operation to turn on the privacy protection function, the sensitive information on the picture can be automatically batch processed according to the privacy protection method and batch processing strategy without the user having to trigger it through the above-mentioned trigger operation for sensitive information, thereby improving the efficiency of privacy protection processing.
[0131] The above embodiments are based on the picture display interface, and the user triggers the mobile phone to turn on the privacy protection function, thereby performing privacy protection processing as an example for explanation. In some other embodiments of the present application, the mobile phone can automatically turn on the privacy protection function in the target scene without the need for the user to trigger it. Alternatively, the mobile phone can automatically prompt the user whether to enter the privacy protection function in the target scene, and turn on the privacy protection function in response to the user's instructions. Alternatively, the mobile phone can automatically detect whether there is sensitive information in the target scene, and automatically turn on the privacy protection function if there is. Alternatively, the mobile phone can automatically detect whether there is sensitive information in the target scene, and if there is sensitive information, it automatically prompts the user whether to enter the privacy protection function, and turns on the privacy protection function in response to the user's instructions.
[0132] After the mobile phone turns on the privacy protection function, the method described in the above embodiment can be used to perform privacy protection processing on the picture, so that sensitive information can be processed in batches, accurately and quickly for privacy protection, thereby improving the efficiency of privacy protection processing and user experience. For example, the mobile phone can respond to the user's trigger operation on sensitive information 1 and process the sensitive information through the privacy protection method and batch processing strategy; or, without the user triggering through the above trigger operation on sensitive information, the mobile phone automatically processes the sensitive information on the picture in batches according to the privacy protection method and batch processing strategy. In this way, the mobile phone can process the sensitive information on the picture in batches and accurately, thereby improving the efficiency of privacy protection processing and reducing user operations. Users can simply, conveniently and quickly process the private information on the picture in batches, and the user experience is high.
[0133] The target scene is a scene where other people may see the image content, which may easily lead to sensitive information leakage. The target scene may be a system default scene or a user-preset scene.
[0134] For example, the target scenario includes a picture sharing scenario, such as a user clicking a sharing control to share a picture with other devices (such as other devices via Bluetooth or Wi-Fi), other applications (such as social applications), or other contacts (such as other contacts via text messages). Since other people can easily see the content of the picture after the user shares it, and sensitive information on the picture can be easily leaked, the mobile phone can enable the privacy protection function when sharing pictures to protect the privacy of the picture. For example, see Fig.22A , after the mobile phone detects that the user clicks the share control 2201 for the picture, it prompts the user whether to perform privacy protection. Or, after the mobile phone detects that the user clicks the share control for the picture and detects that the picture includes sensitive information, it prompts the user whether to perform privacy protection. After the mobile phone detects that the user clicks the "Yes" control 2202, it turns on the privacy protection function. Then, the mobile phone can respond to the user's trigger operation for sensitive information and perform batch processing on the sensitive information on the picture; it can also automatically perform batch processing on the sensitive information on the picture without the user's trigger operation, which will not be described in detail. For example, see Fig.22A In (c), the mobile phone detects that the user clicks on the portrait of Zhang San in the picture. Fig.22A As shown in (d) in FIG, based on a batch processing strategy (e.g., a batch processing strategy of the same type), all avatars are processed for privacy protection in batches. Then, as Fig.22A As shown in (d) in FIG. 2 , after the mobile phone detects that the user clicks to complete the operation of the control 2200, the privacy protection process is completed. Fig.22A In (e), after the mobile phone detects the user's selection of the sharing object 2203, the privacy-protected image is shared.
[0135] For further example, see Fig. 22B , after the mobile phone detects that the user clicks the sharing control 2201 for the picture and selects the operation of the sharing object 2203, the user is prompted whether to perform privacy protection. After the mobile phone responds to the user's instruction to enter the privacy protection function, the method provided in the above embodiment is used to perform privacy protection processing on the picture, so as to share the processed picture with the sharing object 2203.
[0136] For another example, the target scenario includes a screenshot scenario. After taking a screenshot, the user may want to share the screenshot with others, which may easily lead to the leakage of sensitive information on the picture. Therefore, the mobile phone can turn on the privacy protection function when taking a screenshot, so as to use the method provided in the above embodiment to perform privacy protection processing on the picture. For example, see Fig.23In (a)-(b), after the mobile phone detects the user's screenshot operation, it prompts the user whether to perform privacy protection. Alternatively, after the mobile phone detects the user's screenshot operation and detects that the screenshot includes sensitive information, it prompts the user whether to perform privacy protection. The mobile phone responds to the user's instruction to turn on / off the privacy protection function. For example, after the mobile phone turns on the privacy protection function, Fig.23 As shown in (c) in the figure, if the mobile phone detects that the user clicks on the portrait of Zhang San in the picture, Fig.23 As shown in (d) in , based on the batch processing strategy, all avatars are processed for privacy protection in batches. Fig.23 As shown in (d) in FIG. 2 , after the mobile phone detects that the user clicks to complete the operation of the control 2300, the privacy protection process is completed. Fig.23 In (e), if the mobile phone detects that the user clicks the share control, the privacy-protected image is shared. In another exemplary embodiment, the mobile phone detects that the user takes a screenshot, and then detects that the user clicks the share control 2301, and prompts the user whether to perform privacy protection.
[0137] For another example, the target scenario includes adding a picture in a specific application. For example, the specific application is a social application. When adding a picture in a single chat interface, a group chat interface, or a sharing circle in the social application, the mobile phone can turn on the privacy protection function and use the method provided in the above embodiment to perform privacy protection processing on the picture to prevent sensitive information from being leaked. For example, see Fig.24A In (a)-(d), when the mobile phone detects that the user adds a picture in the group chat interface, it prompts the user whether to perform privacy protection. Or, when the mobile phone detects that the user adds a picture in the group chat interface and detects that the picture contains sensitive information, it prompts the user whether to perform privacy protection. After the mobile phone turns on the privacy protection function, Fig. 24B As shown in (a) in the figure, if the mobile phone detects that the user clicks on the portrait of Zhang San in the picture, Fig. 24B As shown in (b) in the figure, based on the batch processing strategy, all avatars are processed for privacy protection in batches. Fig. 24B As shown in (b) of FIG. 2 , after the mobile phone detects that the user clicks to complete the operation of the control 2400, the privacy protection process is completed. Fig. 24B In (c), the mobile phone adds the privacy-protected picture to the group chat interface.
[0138] For another example, the target scenario includes a screen projection scenario. When a picture is projected on other devices, other people can see the picture through other devices, which may easily lead to the leakage of sensitive information on the picture. Therefore, the mobile phone can turn on the privacy protection function when projecting the screen, so as to use the method provided in the above embodiment to perform privacy protection processing on the picture. For example, see Fig.25AIn (a)-(b), when the mobile phone detects that the user clicks the screen projection control 2501 for the picture, it prompts the user whether to perform privacy protection. Alternatively, when the mobile phone detects that the user clicks the screen projection control for the picture and detects that the picture contains sensitive information, it prompts the user whether to perform privacy protection. For example, after the mobile phone turns on the privacy protection function, Fig.25B As shown in (a) in the figure, if the mobile phone detects that the user clicks on the portrait of Zhang San in the picture, Fig.25B As shown in (b) in , based on the batch processing strategy, all avatars are processed for privacy protection in batches. Fig.25B As shown in (c) of FIG. 1 , after the mobile phone detects that the user clicks to complete the operation of the control 2500, the privacy protection process is completed. Fig.25B In (d), if the mobile phone detects that the user selects a projection device (such as a large screen), the privacy-protected image is projected to the corresponding device for display.
[0139] In addition, in some other embodiments of the present application, based on the picture display interface, the mobile phone can automatically turn on the privacy protection function without user triggering; or, the mobile phone can automatically prompt the user whether to enter the privacy protection function, and turn on the privacy protection function according to the user's instructions. Alternatively, based on the picture display interface, the mobile phone can automatically detect whether there is sensitive information, and automatically turn on the privacy protection function if there is sensitive information, or automatically prompt the user whether to enter the privacy protection function if there is sensitive information. After the mobile phone turns on the privacy protection function, the method described in the above embodiment can be used to perform privacy protection processing on the picture, so that sensitive information can be processed in batches, accurately and quickly for privacy protection, improving the efficiency of privacy protection processing and user experience.
[0140] In an embodiment of the present application, a mobile phone can save pictures after privacy protection processing so that pictures can be shared safely; it can also save pictures before privacy protection processing so that it can be viewed by itself. For example, in the target scenario, the mobile phone can save pictures before and after privacy protection processing. In the gallery, pictures after privacy protection processing saved by the mobile phone can be displayed separately from pictures without privacy protection processing, so that users can intuitively know pictures that are not easy to leak private information, so as to share or cast the screen safely and conveniently. For example, pictures after privacy protection processing are displayed with a specific mark "S" to indicate that the picture is safe and not easy to leak.
[0141] It should be noted that the above description is based on the example of a mobile phone as the electronic device. When the electronic device is a tablet computer or other device such as a smart watch, the method provided in the above embodiment can still be used to process sensitive information on the image, and no further description is given.
[0142] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100.
[0143] Fig.26A 1 is a software structure diagram of the electronic device 100 of the embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer. The application layer can include a series of application packages.
[0144] like Fig.26A As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.
[0145] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.
[0146] like Fig.26A As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.
[0147] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.
[0148] Content providers are used to store and retrieve data and make it accessible to applications. The data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0149] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.
[0150] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).
[0151] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0152] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.
[0153] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.
[0154] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.
[0155] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0156] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0157] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.
[0158] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.284, MP3, AAC, AMR, JPG, PNG, etc.
[0159] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0160] A 2D graphics engine is a drawing engine for 2D drawings.
[0161] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
[0162] In the examples of this application, see Fig.26B , Fig.26A The application framework layer shown may include a display module, a layout analysis module, a matching module, and a privacy protection processing module. Among them, the display module is used to display pictures and related controls. The display module can also display information on the interface to prompt the user whether to perform privacy protection (for example, prompt whether to perform privacy protection in the target scene). The electronic device can turn on the privacy protection function according to the user's instructions. The layout analysis module is used to analyze and identify the layout of the picture after turning on the privacy protection function, such as identifying the user avatar area and content, nickname area and content, and sharing area and content on the sharing circle screenshot, so as to identify the location of sensitive information on the picture. The matching module is used to determine the location of the sensitive information to be batch processed on the picture according to the user's trigger operation and batch processing strategy. The privacy protection processing module is used to perform privacy protection processing on the sensitive information to be batch processed on the picture according to the privacy protection method. For example, when the privacy protection method is a mosaic method, the privacy protection processing module is used to intercept part of the sensitive information to be batch processed, and blur the corresponding part of the original image, so as to mosaic the sensitive information to be batch processed.
[0163] In some embodiments, the layout analysis module, matching module, and privacy protection processing module can use artificial intelligence (AI) algorithms to identify, match, and process sensitive information. The layout analysis algorithm can include multiple components, each of which can identify a type of sensitive information, and the components can be used to automatically batch process multiple sensitive information of the same type.
[0164] Based on these software modules, electronic devices can identify sensitive information of the same type through components. In response to user trigger operations, they can implement batch processing of multiple sensitive information of the same type based on batch processing strategies. Through AI algorithms, they can identify the location of sensitive information to be processed and automatically perform privacy protection processing such as coding.
[0165] In this way, electronic devices can process sensitive information on images in batches, accurately and quickly, without the need for users to repeatedly cover each sensitive information separately. This can improve the efficiency of privacy protection processing, reduce user operations and improve user experience.
[0166] In addition, in combination with the above embodiments and the corresponding drawings, another embodiment of the present application provides a method for processing an image. Figure 2 The electronic device of the structure shown is implemented. Fig. 27, the method comprising: 2701. An electronic device displays a first interface, where the first interface includes a first picture, and the first picture includes M sensitive elements, where M is an integer greater than 1.
[0167] For example, the first interface may be Figure 6 The interface shown in (a) is as follows: Fig.11 The interface shown in (a) is as follows: Fig.22A The interface shown in (a) is as follows: Fig.23 The interface shown in (c) is as follows: Fig. 24B The interface shown in (a) in the figure, or Fig.25B The interface shown in (a) in the figure, etc. The first interface can be used to display a first picture, and the first picture includes multiple sensitive elements (also called sensitive information).
[0168] 2702. In response to a first operation of a user on a first interface, the electronic device performs privacy protection processing on N sensitive elements on a first image of the first interface to obtain a second image, where N is an integer less than or equal to M and greater than 1.
[0169] For example, the first operation is an operation of the user drawing a circle track on the picture, an operation of the user double-clicking a blank position on the picture, an operation of the user clicking a preset control, a user's voice operation, or a preset gesture operation, etc.
[0170] For another example, the first operation is an operation of the user on the first sensitive element among the M sensitive elements on the first picture of the first interface, and the N sensitive elements include the first sensitive element. For example, the first operation is an operation of the user clicking the first sensitive element, double-clicking the first sensitive element, long pressing the first sensitive element, sliding on the first sensitive element, painting on the first sensitive element, or circling the first sensitive element.
[0171] The first picture is a picture that has not been processed for privacy protection, and the second picture is a picture that has been processed for privacy protection. For the description of the privacy protection processing, please refer to the relevant description in the above embodiment.
[0172] For example, the privacy protection processing includes mosaic processing, graffiti processing, color overlay processing, replacement processing, blur processing, elimination processing or blur processing, etc.
[0173] In a possible implementation, the first sensitive element belongs to the first sensitive element type, and the N sensitive elements on the first image also belong to the first sensitive element type. That is, the electronic device can adopt the above-mentioned same-type batch processing strategy to batch-process all sensitive elements of the same type as the first sensitive element on the first image for privacy protection.
[0174] In another possible implementation, the N sensitive elements on the first image have the same content as the first sensitive element. That is, the electronic device can use the above-mentioned same information batch processing strategy to batch perform privacy protection processing on all sensitive elements on the first image that have the same content as the first sensitive element.
[0175] In another possible implementation, the first sensitive element corresponds to the first user object, and the N sensitive elements on the first image also correspond to the first user object. That is, the electronic device can adopt the above-mentioned same user object batch processing strategy to batch perform privacy protection processing on all sensitive elements on the first image that correspond to the same user object as the first sensitive element.
[0176] In another possible implementation, N is equal to M, that is, the electronic device can adopt the above-mentioned strategy of batch processing of all sensitive information to perform privacy protection processing on all sensitive elements on the first picture in batches.
[0177] 2703. The electronic device displays a second interface, where the second interface includes a second picture.
[0178] For example, when the first interface is Figure 6 When the interface shown in (a) is shown in FIG. 1 , the second interface can be Figure 6 The interface shown in (b) in the figure. When the first interface is Fig.11 When the interface shown in (a) is shown in FIG. 1 , the second interface can be Fig.11 The interface shown in (b) in the figure. When the first interface is Fig.13 When the interface shown in (a) is shown in FIG. 1 , the second interface can be Fig.13 The interface shown in (c) in the figure. When the first interface is Fig.14 When the interface shown in (a) is shown in FIG. 1 , the second interface can be Fig.14 The interface shown in (d).
[0179] In the scheme described in the above steps 2701-2703, the electronic device can respond to simple user operations and perform privacy protection processing on multiple sensitive elements on the picture in batches and accurately, so that the sensitive elements on the picture are hidden, avoiding the leakage of sensitive elements, improving the efficiency of privacy protection processing, reducing user operations, and improving user experience.
[0180] In some technical solutions, before the electronic device displays the first interface, the method further includes: the electronic device detects a screenshot operation of the user, and the first image is a screenshot obtained by the user. Fig.23 A screenshot obtained by the screenshot operation of the interface shown in (a).
[0181] In some other technical solutions, before the electronic device displays the first interface, the method further includes: the electronic device displays a third interface, and the third interface includes the first picture. The electronic device detects a user's sharing operation on the first picture on the third interface. That is, when the user shares the first picture, the electronic device can use the method provided in the embodiment of the present application to perform privacy protection processing on sensitive elements on the first picture in batches. Exemplarily, the third interface can be Fig.22A The interface shown in (a) or Fig. 22B The interface shown in (b) etc.
[0182] In some other technical solutions, before the electronic device displays the first interface, the method further includes: the electronic device displays a fourth interface, and the fourth interface includes the first picture. The electronic device detects the user's screen projection operation on the first picture on the fourth interface. That is, when the user projects the first picture to other devices, the electronic device can use the method provided in the embodiment of the present application to perform privacy protection processing on sensitive elements on the first picture in batches. Exemplarily, the fourth interface can be Fig.25A The interface shown in (a) above, etc.
[0183] In some other technical solutions, before the electronic device displays the first interface, the method further includes: the electronic device detects the user's operation of adding a first picture to be sent on the interface of the application. For example, the user's operation of adding a first picture to be sent on the interface of the application can be referred to Fig.24A (a)-(d) in the figure.
[0184] In some other technical solutions, the electronic device displays a first interface, including: the electronic device prompts the user whether to perform privacy protection processing on sensitive elements on the first picture, so that the user can know that privacy protection can be performed through this function. After the electronic device detects the user's instruction to perform privacy protection processing on the sensitive elements, the first interface is displayed. For example, see Fig.22A The interface shown in (b) is as follows: Fig. 22B The interface shown in (b) or Fig.25A In the interface shown in (b) of FIG. 1 , the electronic device may display a prompt message to prompt the user whether to perform privacy protection processing. In some possible implementations, the electronic device prompts the user whether to perform privacy protection processing only after detecting that there are sensitive elements in the first image.
[0185] In some other technical solutions, before the electronic device displays the second interface, the method further includes: the electronic device performs privacy protection processing on the first sensitive element on the first image in response to the first operation to obtain a third image. The electronic device displays a fifth interface, and the fifth interface includes the third image. Exemplarily, the first interface can be Fig.13The fifth interface can be Fig.13 The interface shown in (b) in the figure, the second interface can be Fig.13 In response to the first operation, the electronic device first displays Fig.13 The interface shown in (b) is then displayed Fig.13 The first interface can be shown in (c) of FIG. Fig.14 The fifth interface can be Fig.14 The interface shown in (b) in the figure, the second interface can be Fig.14 In response to the first operation, the electronic device first displays Fig.14 The interface shown in (b) can also display Fig.14 The interface shown in (c) is then displayed Fig.14 That is to say, the batch processing effect of N sensitive elements is a dynamic presentation process, and the processing effect of some sensitive elements can be presented first, and then the processing effect of N sensitive elements can be presented.
[0186] In some other technical solutions, the method further includes: the electronic device cancels the privacy protection processing of N sensitive elements on the second picture in response to the second operation of the user on the second interface to obtain a fourth picture. The electronic device displays a sixth interface, and the sixth interface includes the fourth picture. Exemplarily, the second interface can be Fig.17 In the interface shown in (c), the second operation can be that the user clicks Fig.17 The sixth interface may be Fig.17 The fourth picture is the interface after canceling the privacy protection process for all user nicknames shown in (b) in FIG. Fig.17 That is, the electronic device can cancel the last batch processing operation on the sensitive elements in response to the second operation of the user.
[0187] In some other technical solutions, the method further includes: the electronic device cancels the privacy protection processing of the second sensitive element on the second picture in response to the user's third operation on the second sensitive element on the second picture, so as to obtain a fifth picture. The electronic device displays a seventh interface, and the seventh interface includes the fifth picture. Exemplarily, the second interface can be Fig.18 In the interface shown in (a), the third operation can be that the user clicks Fig.18 For the operation of the sensitive element 1801 shown in (a), the seventh interface may be Fig.18 The fifth picture may be the interface after canceling the privacy protection processing of the sensitive element 1801 as shown in (b) of FIG. Fig.18That is, the electronic device can cancel the privacy protection processing of a certain sensitive element in response to the third operation.
[0188] The above embodiments mainly describe the scheme of performing privacy protection processing on sensitive information on pictures by electronic devices. In some other embodiments of the present application, similar to the privacy protection processing on pictures, the electronic device can use the method described in the above embodiments to perform privacy protection processing on sensitive information on any interface. For example, the arbitrary interface can be an application interface, a text display interface, or other interfaces, etc., without limitation. For example, when the user wants to show the current interface of the electronic device to others but does not want to expose sensitive information on the interface, the interface after privacy protection processing can be shown to others.
[0189] It is understandable that in order to implement the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of the present application.
[0190] In this embodiment, the electronic device can be divided into functional modules according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.
[0191] In the case of dividing each functional module according to each function, in a possible composition of the electronic device involved in the above embodiment, the electronic device may include: a display unit, a detection unit, and a processing unit, etc. It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and will not be repeated here.
[0192] The present application also provides an electronic device, such as Fig.28As shown, it includes: a display screen (or screen) 2801, one or more processors 2802, a memory 2803, and one or more computer programs 2804, and the above-mentioned devices can be connected through one or more communication buses 2805. The one or more computer programs 2804 are stored in the above-mentioned memory 2803 and are configured to be executed by the one or more processors 2802. The one or more computer programs 2804 include instructions, and the above-mentioned instructions can be used to execute the various steps in the above-mentioned embodiments. Among them, all relevant contents of each step involved in the above-mentioned method embodiment can be referred to the functional description of the corresponding physical device, and will not be repeated here.
[0193] Exemplarily, the processor 2802 may be Figure 2 The processor 110 shown in FIG. 1 , the memory 2803 may specifically be Figure 2 The internal memory 121 shown, the display screen 2801 can be specifically Figure 2 Display screen 194 is shown.
[0194] The embodiment of the present application also provides an electronic device, including one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program codes, and the computer program codes include computer instructions. When the one or more processors execute the computer instructions, the electronic device executes the above-mentioned related method steps to implement the sensitive information processing method in the above-mentioned embodiment.
[0195] An embodiment of the present application also provides a computer-readable storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the sensitive information processing method in the above-mentioned embodiment.
[0196] An embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer executes the above-mentioned related steps to implement the sensitive information processing method performed by the electronic device in the above-mentioned embodiment.
[0197] In addition, an embodiment of the present application also provides a device, which may specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor may execute the computer-executable instructions stored in the memory, so that the device executes the sensitive information processing method executed by the electronic device in the above-mentioned method embodiments.
[0198] Among them, the electronic device, computer-readable storage medium, computer program product or device provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.
[0199] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0200] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0201] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0202] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0203] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.
[0204] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A method for processing a picture library, characterized in that: include: The electronic device displays a first interface of the gallery, the first interface including a thumbnail of at least one picture, the at least one picture including the first picture; After receiving a first operation on the thumbnail of the first picture, displaying a display interface including the first picture; wherein the display interface of the first picture includes a first control; In response to a second operation applied to the first control, privacy protection processing is performed on a first element and a second element of the first image to obtain a second image; wherein the first element and the second element are sensitive elements; In response to a third operation applied to the first element, the privacy protection processing of the first element on the second image is revoked to obtain a third image; the third image includes the first element but does not include the second element.
2. The method according to claim 1, characterized in that The first picture includes a third element; the second picture does not include the first element, the second element and the third element; wherein the first element and the second element are sensitive elements of the first type or sensitive elements of the first user, and the third element is a sensitive element of the second type or a sensitive element of the second user; In response to a second operation on the first control, performing privacy protection processing on the first element and the second element of the first picture to obtain a second picture; specifically comprising: In response to a second operation applied to the first control, privacy protection processing is performed on the first element, the second element, and the third element of the first image to obtain a second image.
3. The method according to claim 2, characterized in that The method further comprises: In response to a fourth operation used for the electronic device, the privacy protection processing of the second element and the third element on the second picture is canceled to obtain a fourth picture; the fourth picture includes the first element, the second element, and the third element.
4. The method according to claim 3, characterized in that The third picture includes a third element, and the method further includes: In response to a fifth operation acting on the third element, performing privacy protection processing on the third element of the third picture to obtain a fifth picture; In response to the sixth operation acting on the third element, the privacy protection processing of the third element on the third picture is canceled to obtain a sixth picture.
5. The method according to claim 1, characterized in that The method further comprises: The first picture includes a third element, and the third picture includes the third element, wherein the third element is a sensitive element of the second type or a sensitive element of a second user.
6. The method according to claim 1, characterized in that The third picture includes the first element and the second element; In response to the third operation on the first element, canceling the privacy protection processing of the first element on the second image to obtain the third image specifically includes: In response to the third operation applied to the first element, the privacy protection processing of the first element and the second element on the second image is canceled to obtain a third image.
7. The method according to claim 1, characterized in that The first element and the second element are sensitive elements of the first type or sensitive elements of the first user.
8. The method according to claim 1, characterized in that The method also includes: the first element and the second element are different elements.
9. The method according to claim 1, characterized in that: The privacy protection processing includes mosaic processing, graffiti processing, color covering processing, replacement processing, blurring processing, elimination processing or blurring processing.
10. The method according to claim 1, characterized in that The at least one picture includes a seventh picture; After receiving the seventh operation acting on the thumbnail of the seventh picture, displaying a display interface including the seventh picture; wherein the display interface of the seventh picture includes a second control; In response to an eighth operation applied to the second control, privacy protection processing is performed on the fourth element and the fifth element of the seventh picture to obtain an eighth picture; wherein the fourth element and the fifth element are sensitive elements; In response to the ninth operation on the fourth element, cancel the privacy protection processing of the fourth element on the seventh picture to obtain a tenth picture; the tenth picture includes the fourth element but does not include the fifth element; The seventh picture and the first picture are from different types of interfaces in the application.
11. An electronic device, characterized in that: include: Screen, used to display the interface; one or more processors; Memory; And one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, and when the instructions are executed by the electronic device, the electronic device executes the image processing method as described in any one of claims 1-10.
12. A computer-readable storage medium, characterized in that: The method comprises computer instructions, which, when executed on a computer, enable the computer to execute the image processing method according to any one of claims 1 to 10.
13. A computer program product, characterized in that When the computer program product runs on a computer, the computer is enabled to execute the image processing method according to any one of claims 1 to 10.
Citation Information
Patent Citations
Privacy-information protection method and device, terminal and storage medium
CN107145800A
Privacy information display method and terminal equipment
CN110502936A
Picture processing method and device and electronic equipment
CN112163200A
Methods and devices for hiding privacy information
US20150332439A1
Screenshot processing method and device
US20210110579A1
