Privacy protection method and electronic device

By automatically identifying and processing privacy information in the image by electronic devices, the problem of user manual obstruction of privacy information is solved, and the efficiency of privacy protection is improved.

CN117633856BActive Publication Date: 2025-08-29HONOR DEVICE CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210993589.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-08-18
Publication Date
2025-08-29
Estimated Expiration
2042-08-18

AI Technical Summary

Technical Problem

In the prior art, users need to manually select to block privacy information when sharing images, which is cumbersome and inefficient, and cannot effectively protect privacy information.

Method used

Electronic devices automatically identify important users in the image and process privacy information, including fingerprints, iris, etc., to reduce user operations and improve privacy protection efficiency.

Benefits of technology

By automatically identifying and processing privacy information, users' operation steps are reduced and the efficiency of privacy information protection is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117633856B_ABST
    Figure CN117633856B_ABST
Patent Text Reader

Abstract

The present application discloses a privacy protection method and electronic device, which relate to the field of electronic technology and can simplify operations when users share images and improve the efficiency of protecting private information. The specific scheme is as follows: the electronic device receives a first operation from a user to share a first media resource, where the first media resource includes at least one first user; in response to the first operation, the electronic device identifies the at least one first user; when the electronic device identifies the first user, the electronic device identifies the first user's private information; when the electronic device identifies the first user's private information, the electronic device performs de-privacy processing on the private information; and the electronic device shares the de-privacy processed first media resource.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of electronic technology, and in particular to a privacy protection method and electronic device. Background Art

[0002] Currently, users can share images on electronic devices (such as mobile phones) with other users or on social networks. The images shared by users may contain some of the user's private information, such as fingerprints, irises, private parts, etc.

[0003] When sharing an image, if a user does not want others to know certain private information in the image, the user can use mosaics or cartoon avatars to cover up the private information in the image. However, this privacy protection method is relatively cumbersome and inefficient. Summary of the Invention

[0004] The embodiments of the present application provide a privacy protection method and electronic device, which can simplify the operation of users when sharing images and improve the efficiency of protecting privacy information.

[0005] To achieve the above objectives, the present invention adopts the following technical solutions:

[0006] In a first aspect, embodiments of the present application provide a privacy protection method, applied to an electronic device. The privacy protection method may include: the electronic device receiving a first operation by a user to share a first media resource, where the first media resource includes at least one first user; in response to the first operation, the electronic device identifying the at least one first user; upon identifying the first user, the electronic device identifying the first user's private information; upon identifying the first user's private information, the electronic device performing de-privacy processing on the private information; and the electronic device sharing the de-privacy processed first media resource.

[0007] Based on the method described in the first aspect, when a user needs to share a first media resource, the electronic device can identify the user's privacy information included in the first media resource. When the first media resource includes the user's privacy information, the electronic device can automatically perform de-privacy processing on the privacy information involved in the first media resource, thereby avoiding the user from selecting the location in the first media resource that requires de-privacy processing, reducing the user's operations, and improving the efficiency of protecting privacy information.

[0008] In combination with the first aspect, in another possible implementation, the above-mentioned de-privacy processing of the private information by the electronic device when the electronic device recognizes the private information of the first user may include: when the electronic device recognizes the private information of the first user and the user information stored in the electronic device includes the user information of the first user, the electronic device de-privacy processing of the private information of the first user.

[0009] Based on this possible implementation method, when a user needs to share a first media resource, the electronic device can perform de-privacy processing on the private information of certain important users in the first media resource (i.e., users corresponding to the user information stored in the electronic device), thereby avoiding the user from selecting the location in the first media resource that requires de-privacy processing, reducing the user's operations, and improving the efficiency of protecting private information.

[0010] In combination with the first aspect, in another possible implementation, the above-mentioned de-privacy processing of the privacy information by the electronic device when the electronic device recognizes the privacy information of the first user may also include: when the electronic device recognizes the privacy information of the first user and the user information stored in the electronic device does not include the user information of all the first users in the first media resource, the electronic device displays a first prompt window, and the first prompt window is used for the user to confirm whether to de-privacy process the privacy information of all the first users included in the first media resource; the electronic device receives a second operation of the user confirming to de-privacy process the privacy information of all the first users included in the first media resource; in response to the second operation, the electronic device de-privacy processes the privacy information of all the first users included in the first media resource.

[0011] Based on this possible implementation, when the user information in the first media resource is not the user information stored in the electronic device, the electronic device can display a prompt window for the user to confirm whether to perform de-privacy processing on all the first user's private information included in the first media resource, so that the user can choose to perform de-privacy processing on all the first user's private information included in the first media resource, thereby avoiding the user from selecting the location in the first media resource that requires de-privacy processing and reducing the user's operation.

[0012] In combination with the first aspect, in another possible implementation, the above-mentioned de-privacy processing of the privacy information by the electronic device when the electronic device recognizes the privacy information of the first user may also include: when the electronic device recognizes the privacy information of the first user and the user information stored in the electronic device does not include the user information of all the first users in the first media resource, the electronic device displays a first prompt window, and the first prompt window is used for the user to confirm whether to de-privacy process the privacy information of all the first users included in the first media resource; the electronic device receives a third operation in which the user confirms not to de-privacy process the privacy information of all the first users included in the first media resource; in response to the third operation, the electronic device displays the identifiers of all the first users in the first media resource; the electronic device receives a fourth operation in which the user selects the identifiers of some of the first users in the first media resource; in response to the fourth operation, the electronic device de-privacy processes the privacy information of some of the first users in the first media resource.

[0013] Based on this possible implementation, the user can select all the identifiers of the first users included in the first media resource, that is, the user can select the users that need to be de-privacy processed, and the electronic device can de-privacy process the private information of the users selected by the user, thereby avoiding the user from selecting the location in the first media resource that needs to be de-privacy processed, thereby reducing the user's operations.

[0014] In combination with the first aspect, in another possible implementation, before the electronic device de-privacy processes the private information, the above-mentioned privacy protection method may further include: the electronic device determines the processing status of the first media resource, the processing status of the first media resource includes de-privacy processing or not de-privacy processing; when the electronic device determines that the processing status of the first media resource is de-privacy processing, the electronic device displays a second prompt window, the second prompt window is used for the user to confirm whether to use the second media resource, the second media resource is the media resource after the first media resource has been de-privacy processed; the electronic device receives a fifth operation of the user confirming to use the second media resource; the above-mentioned electronic device de-privacy processing of the private information may include: in response to the fifth operation, the electronic device displays the second media resource.

[0015] Based on this possible implementation, when the first media resource has been de-encrypted, the user can choose to use the de-encrypted media resource for sharing, thereby avoiding the user from selecting the location in the first media resource that requires de-encryption, thereby reducing the user's operations.

[0016] In combination with the first aspect, in another possible implementation method, the above-mentioned privacy protection method may also include: the electronic device obtains a third media resource; the third media resource includes media resources stored in the electronic device, media resources stored in the server, media resources input by the user, and information input by the user; the electronic device obtains the user information stored in the electronic device based on the third media resource.

[0017] Based on this possible implementation method, the electronic device can obtain user information stored in the electronic device based on the media resources stored in the electronic device, the media resources stored on the server, the media resources input by the user, and the information input by the user, so that when sharing the first media resource, it can determine whether the user information stored in the electronic device includes the user information included in the first media resource.

[0018] In combination with the first aspect, in another possible implementation, the user information may include one or more of the following information: fingerprint information, facial information.

[0019] Based on this possible implementation method, the electronic device can conveniently and quickly determine whether the first user information in the first media resource is the user information stored in the electronic device based on the user's facial information included in the first media resource and the user's facial information stored in the electronic device.

[0020] In combination with the first aspect, in another possible implementation method, the above-mentioned privacy protection method may also include: the electronic device stores a fourth media resource, user information processed for privacy in the fourth media resource, and a correspondence between the fourth media resource and the user information processed for privacy in the fourth media resource, wherein the fourth media resource is the first media resource after privacy processing.

[0021] Based on this possible implementation, the electronic device may store a media resource obtained by de-privacy processing of the first media resource, so that when the user shares the first media resource again, the electronic device may use the media resource obtained by de-privacy processing to replace the first media resource.

[0022] In combination with the first aspect, in another possible implementation, the private information includes one or more of the following information: iris information, fingerprint information, and private part information.

[0023] Based on this possible implementation, the electronic device can perform privacy protection on the user's iris information, fingerprint information, and private part information involved in the first media resource, thereby protecting the user's privacy information when the user shares the first media resource.

[0024] In a second aspect, embodiments of the present application provide a privacy protection device that can be applied to an electronic device and used to implement the method described in the first aspect. The functions of the privacy protection device can be implemented through hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions, such as a receiving module, a processing module, and a sharing module.

[0025] The receiving module may be configured to receive a first operation of a user sharing a first media resource, where the first media resource includes at least one first user.

[0026] The identification module can be configured to identify at least one first user in response to a first operation.

[0027] The identification module can also be used to identify the privacy information of the first user when the electronic device identifies the first user.

[0028] The processing module can be used to de-privacy the private information when the electronic device recognizes the private information of the first user.

[0029] The sharing module can be used to share the first media resource after privacy protection.

[0030] In combination with the second aspect, in one possible implementation, the processing module can also be used to de-privacy process the first user's private information when the electronic device recognizes the first user's private information and the user information stored in the electronic device includes the user information of the first user.

[0031] In combination with the second aspect, in a possible implementation, the privacy protection device may further include a display module.

[0032] The display module can be used to display a first prompt window when the electronic device recognizes the privacy information of the first user and the user information stored in the electronic device does not include all the user information of the first user in the first media resource. The first prompt window is used for the user to confirm whether to de-privacy process all the privacy information of the first user included in the first media resource.

[0033] The receiving module may also be configured to receive a second operation in which the user confirms that all private information of the first user included in the first media resource will be de-privacy processed.

[0034] The processing module may also be configured to, in response to a second operation, perform privacy removal processing on all private information of the first user included in the first media resource.

[0035] In conjunction with the second aspect, in a possible implementation, the receiving module may be further configured to receive a third operation in which the user confirms not to perform de-privacy processing on all the first user's private information included in the first media resource.

[0036] The display module may also be configured to display the identifiers of all first users in the first media resource in response to a third operation.

[0037] The receiving module may also be configured to receive a fourth operation of the user selecting some of the first user's identifiers in the first media resource.

[0038] The processing module may also be configured to, in response to a fourth operation, perform privacy removal processing on part of the first user's private information in the first media resource.

[0039] In combination with the second aspect, in a possible implementation, the privacy protection device may further include a determination module.

[0040] The determination module may be configured to determine a processing status of the first media resource. The processing status of the first media resource may include: having been processed for privacy protection or not having been processed for privacy protection.

[0041] The display module can also be used to display a second prompt window when the electronic device determines that the processing status of the first media resource is de-privacy processed. The second prompt window is used for the user to confirm whether to use the second media resource. The second media resource is the media resource after the first media resource has been de-privacy processed.

[0042] The receiving module may also be configured to receive a fifth operation from the user confirming the use of the second media resource.

[0043] The display module can be configured to cause the electronic device to display a second media resource in response to a fifth operation.

[0044] In combination with the second aspect, in a possible implementation, the privacy protection device may further include an acquisition module.

[0045] The acquisition module can also be used to acquire third media resources; the third media resources include media resources stored in the electronic device, media resources stored in the server, media resources input by the user, and information input by the user.

[0046] The determination module may also be configured to obtain user information stored in the electronic device based on a third media resource.

[0047] In combination with the second aspect, in a possible implementation, the user information includes one or more of the following information: fingerprint information, facial information.

[0048] In combination with the second aspect, in a possible implementation, the privacy protection device may further include a storage module.

[0049] The storage module can be used to store a fourth media resource, user information de-privacy processed in the fourth media resource, and a correspondence between the fourth media resource and the user information de-privacy processed in the fourth media resource, wherein the fourth media resource is the first media resource after the de-privacy processing.

[0050] In conjunction with the second aspect, in a possible implementation, the private information includes one or more of the following information: iris information, fingerprint information, and private part information.

[0051] In a third aspect, a privacy protection device is provided, which has the function of implementing the method described in the first aspect. This function can be implemented in hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0052] In a fourth aspect, a privacy protection device is provided, comprising: a processor and a memory; the memory is used to store computer execution instructions, and when the privacy protection device is running, the processor executes the computer execution instructions stored in the memory, so that the privacy protection device performs the privacy protection method as described in any one of the first aspects above.

[0053] In a fifth aspect, a privacy protection device is provided, comprising: a processor; the processor is used to couple with a memory, and after reading instructions in the memory, execute the privacy protection method as described in any one of the first aspects above according to the instructions.

[0054] In a sixth aspect, a computer-readable storage medium is provided, which stores instructions. When the computer-readable storage medium is run on a computer, the computer can execute the privacy protection method described in any one of the first aspects above.

[0055] In a seventh aspect, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute the privacy protection method described in any one of the first aspects above.

[0056] In an eighth aspect, a device (e.g., a chip system) is provided, comprising a processor configured to support the device in implementing the functions described in the first aspect. In one possible design, the device further comprises a memory configured to store program instructions and data necessary for the device. When the device is a chip system, it may be composed of a chip or may include a chip and other discrete components.

[0057] Among them, the technical effects brought about by any design method in the fourth to eighth aspects can refer to the technical effects brought about by different design methods in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] Figure 1 Schematic diagram of the display interface of the electronic device provided in the embodiment of the present application Figure 1 ;

[0059] Figure 2 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0060] Figure 3 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application;

[0061] Figure 4 A privacy protection method process diagram provided in this application embodiment Figure 1 ;

[0062] Figure 5 A privacy protection method provided in this application embodiment Figure 2 ;

[0063] Figure 6 Schematic diagram of the display interface of the electronic device provided in the embodiment of the present application Figure 2 ;

[0064] Figure 7 A schematic diagram of a process for obtaining user information of important users provided in an embodiment of the present application;

[0065] Figure 8 Schematic diagram of the display interface of the electronic device provided in the embodiment of the present application Figure 3 ;

[0066] Figure 9 Schematic diagram of the display interface of the electronic device provided in the embodiment of the present application Figure 4 ;

[0067] Figure 10 A privacy protection method provided in this application embodiment Figure 3 ;

[0068] Figure 11 A privacy protection method process diagram provided in this application embodiment Figure 4 ;

[0069] Figure 12 A privacy protection method provided in this application embodiment Figure 5 ;

[0070] Figure 13A schematic diagram of the structure of a privacy protection device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0071] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0072] The terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of the technical features being referred to. Thus, a feature specified as "first" or "second" may explicitly or implicitly include one or more of such features. Throughout this application, unless otherwise specified, "plurality" means two or more.

[0073] With the development of social networks, users can share images taken by mobile phones and other electronic devices on social networks, and users can also share the images they take with other users.

[0074] However, images shared by users may contain their private information (such as fingerprints, irises, and private parts). Therefore, when sharing images, if users directly share the captured images on social networks or with other users, their private information may be exposed. For example, other users may use the user's face and other private information for other purposes, posing risks to the user's information security.

[0075] When sharing images containing private information, users can typically use mosaics or cartoon avatars to cover the private information involved in the image. This means users can use mosaics or cartoon avatars to obscure certain private information contained in the image, thereby achieving a de-privacy effect and protecting private information from exposure.

[0076] However, when users use mosaics or cartoon avatars to block private information in an image, they need to manually select the location of the mosaics or cartoon avatars to block. This makes the user's operation more troublesome and the efficiency of protecting private information is low.

[0077] In response to the above-mentioned problems, an embodiment of the present application provides a privacy protection method, which is applied to electronic devices. The method can identify important users in an image, thereby automatically protecting the privacy information (fingerprints, irises, private parts, etc.) related to the important users in the image, reducing user operations and improving the efficiency of protecting privacy information.

[0078] For example, combined with Figure 1 As shown in (a), when user 1 shares an image (such as a family portrait) with other users (such as the owner of mobile phone 1), the electronic device can identify whether there is user information corresponding to important users (such as facial information corresponding to important users) in the image. For example, the important users may be user 1, user 2, user 3 and user 4, and the user information corresponding to the important users may be the facial information of user 1, the facial information of user 2, the facial information of user 3 and the facial information of user 4.

[0079] When the electronic device recognizes that the image contains user information corresponding to an important user (i.e., recognizes that the image contains an important user), the electronic device can identify whether the image contains private information corresponding to the important user (such as fingerprints, irises, etc.). In other words, when the electronic device recognizes that the image to be shared contains the facial information of user 1, user 2, user 3, and user 4, the electronic device can identify whether the image to be shared contains private information such as fingerprints or irises corresponding to user 1, user 2, user 3, and user 4.

[0080] When the electronic device recognizes that the private information such as fingerprints or irises corresponding to user 1, user 2, user 3, and user 4 exists in the image to be shared, the electronic device can process the private information such as fingerprints or irises corresponding to user 1, user 2, user 3, and user 4 in the image to be shared, that is, perform privacy removal, such as using mosaics or cartoon avatars to block the private information, or blurring the private information. Figure 1 For user 5 in (a), since the electronic device's preset user information does not contain the corresponding facial information of user 5 (i.e., user 5 is not an important user), the electronic device may not process the corresponding privacy information of user 5. In other words, when the electronic device recognizes that an important user exists in the image to be shared, it can automatically protect the important user's privacy information (fingerprint, iris, private parts, etc.) in the image, reducing user operations and improving the efficiency of privacy information protection.

[0081] For example, combined Figure 1 As shown in (b), when user 6 (such as the owner of the electronic device) shares an image (such as an image of the owner of the electronic device and friends hanging out) with other users (such as the owner of mobile phone 1), the electronic device can identify whether there is user information corresponding to an important user (such as facial information corresponding to the important user) in the image. For example, the important user may be user 6, and the user information corresponding to the important user may be the facial information of user 6.

[0082] When the electronic device recognizes that the image contains user information corresponding to an important user (i.e., recognizes that the image contains an important user), the electronic device can identify whether the image contains private information corresponding to the important user (such as a fingerprint, iris, etc.). In other words, when the electronic device recognizes that the image to be shared contains the facial information of user 6, the electronic device can identify whether the image to be shared contains private information such as a fingerprint or iris corresponding to user 6.

[0083] When the electronic device recognizes that the image to be shared contains the private information such as the fingerprint or iris of the user 6, the electronic device can process the private information such as the fingerprint or iris of the user 6 in the image to be shared, that is, perform privacy removal. Figure 1 For users 7, 8, and 9 in (b), since the facial information corresponding to these users 7, 8, and 9 does not exist in the preset user information of the electronic device (i.e., users 7, 8, and 9 are not important users), the electronic device may not process the privacy information corresponding to users 7, 8, and 9.

[0084] For example, combined with Figure 1 As shown in (c), when user 10 (such as the owner of the electronic device) shares an image (such as an image taken by the owner of the electronic device and user 11 when they go out to play) to other users (such as the owner of the mobile phone 1), the electronic device can identify whether there is user information corresponding to an important user (such as facial information corresponding to the important user) in the image. For example, the important user may be user 10, and the user information corresponding to the important user may be the facial information of user 10.

[0085] When the electronic device recognizes that the image to be shared contains the facial information of the user 10 , the electronic device may identify whether the image to be shared contains private information such as a fingerprint or iris corresponding to the user 10 .

[0086] When the electronic device recognizes that the image to be shared contains the private information such as the fingerprint or iris of the user 10, the electronic device can process the private information such as the fingerprint or iris of the user 10 in the image to be shared, that is, perform privacy removal. Figure 1 For user 11 in (c), since the facial information corresponding to user 11 does not exist in the preset user information of the electronic device (ie, user 11 is not an important user), the electronic device may not process the privacy information corresponding to user 11.

[0087] In some examples, the electronic device may also process the image corresponding to the non-important user, ie, user 11, such as cropping or coding the image corresponding to user 11, so as to eliminate user 11.

[0088] The privacy protection method provided in the embodiments of the present application is described below.

[0089] In some examples, the electronic device may be a mobile phone, a tablet computer, a handheld computer, a personal computer (PC), a cellular phone, a personal digital assistant (PDA), a wearable device, or other electronic device. The embodiments of the present application do not limit the specific form of the electronic device.

[0090] For example, taking the electronic device as a mobile phone, Figure 2 A schematic structural diagram of an electronic device provided in an embodiment of the present application is shown.

[0091] like Figure 2 As shown, the electronic device may include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, a button 290, a motor 291, an indicator 292, a camera 293, a display screen 294, and a subscriber identification module (SIM) card interface 295, etc. Among them, the sensor module 280 can include a pressure sensor 280A, a gyroscope sensor 280B, an air pressure sensor 280C, a magnetic sensor 280D, an acceleration sensor 280E, a distance sensor 280F, a proximity light sensor 280G, a fingerprint sensor 280H, a temperature sensor 280J, a touch sensor 280K, an ambient light sensor 280L, a bone conduction sensor 280M, etc.

[0092] It should be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device. In other embodiments, the electronic device may include more or fewer components than shown, or may combine or separate certain components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0093] The processor 210 may include one or more processing units. For example, the processor 210 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0094] The controller can be the nerve center and command center of the electronic device. The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0095] Processor 210 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 210 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 210. If processor 210 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 210 latency, and thus improves system efficiency.

[0096] In some embodiments, the processor 210 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0097] The electronic device implements display functionality through a GPU, display screen 294, and an application processor. A GPU is a microprocessor for image processing that connects display screen 294 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 210 may include one or more GPUs that execute program instructions to generate or modify display information.

[0098] Display screen 294 is used to display images, videos, and the like. Display screen 294 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, the electronic device can include one or N display screens 294, where N is a positive integer greater than one.

[0099] In the embodiment of the present application, the display screen 294 may be used to display an interface of the electronic device.

[0100] The electronic device can implement the shooting function through the ISP, camera 293, video codec, GPU, display 294 and application processor, etc. In some embodiments, the electronic device can include 1 or N cameras 293, where N is a positive integer greater than 1.

[0101] Of course, it is understandable that the above Figure 2 The figure is only an example of the electronic device being a mobile phone. If the electronic device is a tablet computer, handheld computer, PC, PDA, wearable device (such as smart watch, smart bracelet) or other device forms, the structure of the electronic device may include more than Figure 2 The structure shown in the figure is less than Figure 2 More structures are shown in the figure, which are not limited here.

[0102] It is understandable that, generally speaking, the realization of electronic device functions requires not only hardware support but also software cooperation.

[0103] The software system of the electronic device can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. Taking the system as an example, the software structure of the electronic device is illustrated.

[0104] Figure 3 This is a software structure block diagram of the electronic device provided in the embodiment of the present application.

[0105] The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, The system is divided into four layers, from top to bottom: application layer, application framework layer, Runtime( runtime) and system libraries, as well as the kernel layer.

[0106] The application layer can include a series of application packages. Figure 3 As shown, the application package may include applications such as camera, gallery, calendar, phone, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0107] The application framework layer provides an application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0108] like Figure 3 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0109] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0110] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0111] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0112] The phone manager is used to provide communication functions for electronic devices, such as call status management (including answering, hanging up, etc.).

[0113] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0114] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager can be used to notify users of download completions, message reminders, and so on.

[0115] The notification manager can also be a notification that appears in the system's top status bar in the form of an icon or scrolling text bar, such as a notification from an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message may be displayed in the status bar, a notification sound may be emitted, an electronic device may vibrate, an indicator light may flash, etc.

[0116] In some examples, in order to implement the privacy protection method provided in the embodiments of the present application, such as Figure 3 As shown, the application framework layer may further include a control module, a storage module, a detection module, an identification module, a processing module, and a marking module.

[0117] The control module can be used to receive a user's operation of sharing an image and obtain the identity (ID) of the image. The control module can also be used to send the ID of the image to the storage module.

[0118] The control module can also be used to receive the query result sent by the storage module. If the query result indicates that the processing status of the image is not privacy processed, the control module can send a detection request to the detection module.

[0119] The control module can also be used to receive the detection result sent by the detection module. When the detection result indicates that the user information of the user exists in the image, the control module can send a recognition request to the recognition module.

[0120] The control module may also be configured to receive a recognition result sent by the recognition module. This recognition result may indicate that the user information sent by the recognition module is the user information of an important user. The control module may also receive a user privacy protection operation, i.e., receive a user privacy protection operation for the image. Upon receiving the user privacy protection operation, the control module may also be configured to send a processing request to the processing module.

[0121] The storage module can be used to store the correspondence between an image ID and the image's processing status. The image processing status can include privacy-processed or non-privacy-processed. The storage module can also be used to receive an image ID from the control module and determine the corresponding processing status for the image. If the image's processing status is non-privacy-processed, the storage module can send a query result to the control module, indicating that the image's processing status is non-privacy-processed.

[0122] The storage module can also be used to store user information of important users (such as facial information of important users). The storage module can also be used to receive user information sent by the recognition module and identify whether the user information sent by the recognition module is user information of an important user. If the user information sent by the recognition module is user information of an important user, the storage module can send a recognition result to the recognition module. The recognition result can indicate that the user information sent by the recognition module is user information of an important user.

[0123] The storage module can also be used to store historical processing information, which can include processing information corresponding to images in the privacy-processed state, such as blurring private information in privacy-processed images or covering private information in privacy-processed images with mosaics or cartoon avatars. The storage module can also be used to receive processing information query requests sent by the processing module and send historical processing information to the processing module.

[0124] The storage module can also be used to receive and store user information in the image after privacy removal sent by the marking module. The storage module can also be used to receive and store the image after privacy removal sent by the processing module.

[0125] The detection module can be used to receive the detection request sent by the control module and detect whether the user information of the user (such as the user's fingerprint information, the user's facial information, etc.) is present in the image. If the user information of the user is present in the image, the detection module can send a detection result to the control module. The detection result can indicate that the user information of the user is present in the image.

[0126] The recognition module can be used to receive the recognition request sent by the control module and identify whether there is user information (such as user's facial information) in the image. If there is user information in the image, the recognition module can send the recognized user information to the storage module.

[0127] The identification module can also be used to receive the identification result sent by the storage module. The identification result can indicate that the user information sent by the identification module is the user information of an important user. The identification module can also send the identification result to the control module.

[0128] The processing module can be used to receive processing requests sent by the control module and send a query processing information request to the storage module. The processing module can also be used to receive historical processing information sent by the storage module and perform privacy protection on the image to be shared based on the historical processing information.

[0129] The processing module can also be used to receive processing requests sent by the control module and send a request to the storage module to query processing information. The processing module can also be used to receive historical processing information sent by the storage module and, based on the historical processing information, perform privacy protection on the image to be shared. The processing module can also be used to send the privacy-protected image to the storage module.

[0130] When the de-privacy processing of the image to be shared is completed, the processing module can also be used to send a marking request to the marking module. The marking request can be used to request marking of the user information in the de-privacy processed image, that is, marking the user who has undergone the de-privacy processing in the image.

[0131] The marking module can be used to receive the marking request sent by the processing module and mark the user information in the image after privacy removal. The marking module can also be used to send the user information in the image after privacy removal to the storage module.

[0132] Runtime The runtime includes the core library and the virtual machine. Runtime runtime is responsible for System scheduling and management.

[0133] The core library consists of two parts: one is the function that the Java language needs to call, and the other is The core library.

[0134] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0135] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0136] The surface manager is used to manage the display subsystem and provide the fusion of two-dimensional and three-dimensional layers for multiple applications.

[0137] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support multiple audio and video encoding formats.

[0138] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0139] A 2D graphics engine is a drawing engine for 2D drawings.

[0140] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0141] The methods in the following embodiments can all be implemented in an electronic device having the above hardware structure or software structure.

[0142] The following combination Figure 4 The privacy protection method provided in the embodiments of the present application is described in detail. Figure 4 This is a flowchart of a privacy protection method provided in an embodiment of the present application. Figure 4 As shown, the privacy protection method may include the following S401-S416.

[0143] S401: The electronic device receives a user's sharing operation on a first image.

[0144] When a user needs to share the first image, such as sharing it with another electronic device or sharing it with another application, the user can perform a sharing operation on the first image. That is, the electronic device can receive the user's operation to share the first image (which may be referred to as the first operation in the embodiment of the present application). The first image (which may be referred to as the first media resource in the embodiment of the present application) can be any image stored in the electronic device.

[0145] It should be noted that the user's sharing operation of the first image can be an operation of the user sharing the first image through the gallery application of the electronic device, or an operation of the user selecting the first image when other applications (such as social applications) access the gallery application of the electronic device.

[0146] For example, combined with Figure 5 As shown, the electronic device receives the user's operation of sharing the first image, and the electronic device, such as the control module included in the electronic device, receives the user's operation of sharing the image (ie, the first image).

[0147] S402: In response to the sharing operation, the electronic device determines whether the first image has been de-privacy processed.

[0148] When the electronic device receives the user's operation of sharing the first image, in response, the electronic device may determine whether the first image has been de-privacy processed.

[0149] In some examples, the electronic device may store a correspondence between an image ID and the image's processing status, where the image processing status may include privacy-decorated or non-privacy-decorated. Determining whether a first image has been de-privacy-decorated may include: obtaining the ID of the first image. The electronic device may then determine the processing status corresponding to the first image based on the correspondence between the image ID and the image processing status.

[0150] If the processing state corresponding to the first image is privacy processed, the electronic device may determine that the first image has been privacy-removed. If the processing state corresponding to the first image is not privacy processed, the electronic device may determine that the first image has not been privacy-removed.

[0151] The first image has been de-privacy processed, meaning that the electronic device has performed past privacy processing on the first image. In other words, the electronic device may store an image corresponding to the first image after the privacy processing. The first image has not been de-privacy processed, meaning that the electronic device has not performed past privacy processing on the first image. In other words, the first image to be shared by the electronic device may be the original image corresponding to the first image.

[0152] For example, continue to combine Figure 5 As shown, the electronic device determines whether the first image has been de-privacy processed, which may include: after the electronic device, such as the control module included in the electronic device, receives the operation of the user to share the image (i.e., the first image), the control module of the electronic device can obtain the ID of the image. The control module of the electronic device sends the ID of the image to the storage module of the electronic device. The storage module of the electronic device stores the correspondence between the ID of the image and the processing status of the image. The storage module of the electronic device determines the processing status of the image based on the ID of the image and the correspondence between the ID of the image and the processing status of the image.

[0153] When the processing status of the image is that the privacy has been removed, the storage module of the electronic device may determine that the image has been removed and send a query result to the control module of the electronic device. The query result may be used to indicate that the image (i.e., the first image) has been removed.

[0154] When the image processing status is not privacy-removed, the storage module of the electronic device may determine that the image has not been privacy-removed and send a query result to the control module of the electronic device. The query result may be used to indicate that the image (ie, the first image) has not been privacy-removed.

[0155] If the electronic device determines that the first image has been subjected to privacy protection processing, the electronic device may execute S403. If the electronic device determines that the first image has not been subjected to privacy protection processing, the electronic device may execute S404.

[0156] It should be noted that when the electronic device determines whether the first image has been de-privacy processed, it can be for the electronic device to determine whether all users in the first image have been de-privacy processed, or it can be for the electronic device to determine whether some users in the first image have been de-privacy processed. This is not limited in the embodiments of the present application.

[0157] S403: The electronic device displays a prompt window for the user to confirm whether to use the first image that has been de-privacy processed.

[0158] When the electronic device determines that the first image has been de-privacy processed, the electronic device may display a prompt window (which may be referred to as a second prompt window in the embodiment of the present application), which may be used by the user to confirm whether to use the first image that has been de-privacy processed.

[0159] In some examples, electronic devices can store de-identified images so that the next time a user shares an image that has not been de-identified, the electronic device can display a prompt window to prompt the user to use the de-identified image for sharing. For example, if the electronic device stores a first image that has been de-identified, when the user shares the first image that has not been de-identified, the electronic device can display a prompt window to indicate that the first image has been de-identified and ask whether to use the de-identified first image for sharing, thereby protecting the user's privacy information.

[0160] In some examples, if the electronic device determines that the first image has been de-identified, the electronic device may display a prompt window that includes the words "Do you want to use the de-identified image?" The first prompt window may also include two options, namely "Yes" and "No."

[0161] When the electronic device receives a triggering operation (referred to as the sixth operation in the embodiment of the present application) of the "No" option in the prompt window from the user, such as a click operation, the electronic device may determine that the user does not use the de-privacy processed image, that is, does not use the de-privacy processed first image for sharing. The electronic device may share the first image, such as sharing it with other electronic devices or other applications (such as social applications).

[0162] When the electronic device receives a triggering operation (referred to as the fifth operation in this embodiment of the present application) of the user selecting the "Yes" option in the prompt window, such as a click operation, the electronic device may determine that the user is using the de-privacy processed image, i.e., using the de-privacy processed first image for sharing. The electronic device may then display the de-privacy processed first image and share the de-privacy processed first image, such as with other electronic devices or other applications (such as social applications).

[0163] For example, taking the first image as a family photo of a user, when the electronic device receives the user's sharing operation on the first image, Figure 6 As shown in (a) of FIG, the electronic device can display a sharing interface of the first image, that is, the electronic device can share the first image to other electronic devices (such as mobile phone 1) or to other applications (such as email applications). At the same time, the electronic device can determine whether the first image has been de-privacy processed. In the case where the electronic device determines that the first image has been de-privacy processed, Figure 6 As shown in (b) of FIG. 6 , the electronic device may display a prompt window 601. The prompt window 601 may be used to prompt the user whether to use the image that has been processed for privacy protection, that is, the first image that has been processed for privacy protection.

[0164] This prompt window 601 may include the words "Do you want to use the de-privacy processed image?" and options "Yes" and "No." When the electronic device receives a user trigger operation, such as a click operation, on the "No" option in prompt window 601, the electronic device may determine that the user does not want to use the de-privacy processed image for sharing. Thereafter, as shown in (c) in FIG6 , the electronic device may continue to display the sharing interface of the first image, thereby allowing the electronic device to share the first image.

[0165] When the electronic device receives a trigger operation, such as a click operation, from the user in response to the "Yes" option in the prompt window, the electronic device can determine that the user is using the de-privacy processed image for sharing. Afterwards, as shown in (d) in 6, the electronic device can display the first image that has been de-privacy processed, such as the first image that has been de-privacy processed using a cartoon avatar 602 to block the user's private information (such as the user's face) in the first image. The electronic device can display the sharing interface corresponding to the first image that has been de-privacy processed, so that the electronic device can share the first image that has been de-privacy processed.

[0166] S404: The electronic device determines whether user information of an important user exists in the first image.

[0167] When the electronic device determines that the first image has not been subjected to privacy removal processing, the electronic device may determine whether user information of an important user (which may be referred to as user information stored by the electronic device in this embodiment of the present application) exists in the first image.

[0168] Important users can be users pre-stored in the electronic device, that is, important users can be users pre-stored in the electronic device and whose privacy needs to be protected. For example, the important user can be the owner of the electronic device, or the important user can be a user set by the owner of the electronic device, such as a family member of the owner.

[0169] In some examples, the electronic device may pre-store user information of important users, and the user information may be user facial information, user fingerprint information, etc. The specific type of user information is not limited in the embodiments of the present application.

[0170] The electronic device determines whether the user information of the important user exists in the first image, which may include: the electronic device identifies the user information included in the first image. Afterwards, the electronic device matches the user information included in the first image with the user information of the important user pre-stored by the electronic device. In the case of a successful match (i.e., the user information included in the first image is the same as the user information of the important user pre-stored by the electronic device), the electronic device can determine that the user information of the important user exists in the first image. In the case of an unsuccessful match (i.e., the user information included in the first image is different from the user information of the important user pre-stored by the electronic device), the electronic device can determine that the user information of the important user does not exist in the first image.

[0171] In some examples, the user information of the important user may include the facial information and fingerprint information of the important user. In the case where the user information of the important user includes the facial information and fingerprint information of the important user, the electronic device determines whether the user information of the important user exists in the first image, which may include: the electronic device first identifies whether the facial information of the important user exists in the first image, that is, the electronic device first identifies the facial information of the user in the first image, and after identifying the facial information of the user, the electronic device may match the identified facial information of the user with the user information of the important user pre-stored in the electronic device (that is, the facial information of the important user). In the case of a successful match, the electronic device may determine that the user information of the important user exists in the first image, that is, the user information in the first image that successfully matches the user information of the important user pre-stored in the electronic device is the user information of the important user in the first image.

[0172] In the event of an unsuccessful match, that is, the electronic device determines that the facial information of the important user pre-stored in the electronic device does not exist in the first image, the electronic device may continue to identify whether the fingerprint information of the important user exists in the first image, that is, the electronic device continues to identify the fingerprint information of the user in the first image. After identifying the fingerprint information of the user, the electronic device may match the identified fingerprint information of the user with the user information of the important user pre-stored in the electronic device (that is, the fingerprint information of the important user). In the event of a successful match, the electronic device may determine that the user information of the important user exists in the first image, that is, the user information in the first image that successfully matches the user information of the important user pre-stored in the electronic device is the user information of the important user in the first image.

[0173] In some examples, the electronic device pre-stores user information of important users, and the electronic device can perform feature learning on images stored locally on the electronic device (which may be referred to as third media resources in the embodiment of the present application) and images stored in the cloud corresponding to the electronic device (which may also be referred to as third media resources in the embodiment of the present application), so as to obtain and store the user information of important users. For feature learning, it can be done through self-learning of the electronic device or supervised neural network learning through user labeling. When several faces in a picture owned by the user are identified, the user can be prompted to label the faces, that is, the user determines the face of the important user among multiple faces, so that the electronic device can obtain the user information corresponding to the important user. The electronic device pre-stores the user information of important users, and it can also be the facial information entered by the owner of the electronic device for unlocking the electronic device, that is, the electronic device pre-stores the user information of important users or it can be information input by the user.

[0174] For example, combined with Figure 7 As shown, the electronic device may include a feature learning module, a gallery (i.e., a local gallery of the electronic device), cloud images corresponding to the electronic device, and a storage module. When the number of images included in the local gallery of the electronic device is greater than 500, the number of cloud images corresponding to the electronic device is greater than 500, or the user uses the electronic device to enter facial information, the feature learning module may be triggered to perform feature learning on the image or feature extraction on the entered facial information.

[0175] The feature learning module can extract features from the user information of important users that has been stored in the storage module, thereby performing feature learning on the image or performing cluster learning on the features extracted from the recorded facial information, thereby obtaining the user information of important users. When the feature learning module obtains the user information of multiple users (i.e., multiple user learning results), the electronic device can prompt the user with the learning results and request the user to mark the user information of multiple users. That is, the user can confirm the marking of important users, that is, the user can mark which users are important users, so that the feature learning module can obtain the user information of important users. After the feature learning module obtains the user information of important users, the feature learning module can send the user information of important users to the storage module, so that the storage module can store the user information of important users obtained by the feature learning module, that is, the storage module can improve the user information of important users that has been stored, thereby storing the user information of important users.

[0176] For example, continue to combine Figure 5 As shown, the electronic device may determine whether user information of an important user is present in a first image. This may include: after the electronic device, such as a control module included in the electronic device, receives a detection result sent by a detection module, the control module of the electronic device may send a recognition request to an identification module of the electronic device. After the identification module of the electronic device receives the recognition request, the identification module may recognize the first image, thereby identifying the user information included in the first image, such as the facial information of the user included in the first image.

[0177] The identification module of the electronic device can send the user information included in the identified first image to the storage module of the electronic device. The storage module of the electronic device can match the user information sent by the identification module with the stored user information of the important user. In the case of a successful match (i.e., the user information included in the first image is the same as the user information of the important user pre-stored in the electronic device), the storage module of the electronic device can determine that the user information of the important user exists in the first image. In the case of an unsuccessful match (i.e., the user information included in the first image is not the same as the user information of the important user pre-stored in the electronic device), the storage module of the electronic device can determine that the user information of the important user does not exist in the first image.

[0178] If the electronic device determines that the user information of the important user does not exist in the first image, the electronic device may execute S405 to S411. If the electronic device determines that the user's private information exists in the first image, the electronic device may execute S412 to S416.

[0179] S405: The electronic device displays a prompt window for the user to confirm whether to perform privacy removal processing on the private information of all users in the first image.

[0180] The first image may include multiple users. When the electronic device determines that user information of important users does not exist in the first image, the electronic device may display a prompt window (which may be referred to as a first prompt window in this embodiment of the present application). The prompt window may be used for the user to confirm whether to de-privacy process the private information of all users in the first image.

[0181] In some examples, if the electronic device determines that the first image does not contain user information of an important user, the electronic device may display a prompt window that may include the words "Do you want to de-privacy the private information of all users in the first image?" The first prompt window may also include two options, namely "Yes" and "No."

[0182] When the electronic device receives a trigger operation (which may be referred to as the third operation in this embodiment of the present application) from the user for the "No" option in the prompt window, such as a click operation, the electronic device may determine that the user confirms that the privacy information of part of the user in the first image will be de-privacy processed.

[0183] When the electronic device receives a trigger operation (which may be referred to as a second operation in this embodiment of the present application) from the user for the "Yes" option in the prompt window, such as a click operation, the electronic device may determine that the user confirms that the privacy information of part of the user in the first image will be de-privacy processed.

[0184] S406: The electronic device receives an operation from the user to perform privacy protection processing on the private information of all users in the first image.

[0185] After the electronic device displays a prompt window for the user to confirm whether to perform de-privacy processing on the private information of all users in the first image, the electronic device can receive an operation from the user to perform de-privacy processing on the private information of all users in the first image, such as a triggering operation on a "Yes" option included in the prompt window, such as a click operation.

[0186] S407: In response to the operation, the electronic device performs privacy protection on the private information of all users in the first image.

[0187] When the electronic device receives an operation from the user to perform privacy protection processing on the private information of all users in the first image, such as a triggering operation on the "Yes" option included in the prompt window, such as a click operation, in response to the operation, the electronic device can perform privacy protection processing on the private information of all users in the first image.

[0188] Privacy protection can include masking the user's private information, such as using mosaics or cartoon avatars. Privacy protection can also include blurring the user's private information. For example, when the user's private information is information such as the user's iris or fingerprint, the user's private information can be blurred using a blurring algorithm (such as Kawase blurring, double blurring, etc.). In addition, privacy protection can also be performed by applying beauty-style processing to the iris, replacing the user's original iris with a fixed iris pattern or color.

[0189] For example, the first image is a family photo of the user, the user's private information is the user's facial information, and the privacy protection process is to use a cartoon avatar to cover the private information. When the electronic device receives the user's sharing operation on the first image, Figure 8 As shown in (a) of FIG, the electronic device may display a sharing interface for the first image, that is, the electronic device may share the first image with other electronic devices (such as mobile phone 1) or with other applications (such as email applications). At the same time, the electronic device may determine whether the first image has been de-identified. If the electronic device determines that the first image has not been de-identified, the electronic device may determine whether user information of an important user is present in the first image.

[0190] When the electronic device determines that the user information of the important user does not exist in the first image, such as Figure 8 As shown in (b) of FIG. , the electronic device may display a prompt window 801. Prompt window 801 may be used for the user to confirm whether to perform privacy protection processing on the private information of all users in the first image. Prompt window 801 may include the words "Do you want to perform privacy protection processing on the private information of all users in the first image?" and options of "Yes" and "No."

[0191] When the electronic device receives a trigger operation of the user for the "Yes" option in the prompt window 801, such as a click operation, the electronic device can determine that the user confirms that the privacy information of all users in the first image (such as the user's facial information) will be de-privatized. Afterwards, the electronic device can continue to de-privatize the privacy information of all users in the first image, that is, use a cartoon avatar to block the privacy information of all users in the first image (that is, the facial information of all users). Afterwards, as shown in (c) in 8, the electronic device can display the first image after the privacy removal process, that is, use a cartoon avatar 802 to block the privacy information of all users in the first image (that is, the facial information of all users), and display the sharing interface corresponding to the first image after the privacy removal process, so that the electronic device can share the first image.

[0192] For example, continue to combine Figure 5As shown, the electronic device performs de-privacy processing on the private information of all users in the first image, which may include: when the electronic device, such as the control module of the electronic device, receives the user's de-privacy operation, that is, when the control module receives the user's operation to perform de-privacy processing on the private information of all users in the first image, the control module of the electronic device may send a processing request to the processing module of the electronic device. After the processing module of the electronic device receives the processing request, the processing module of the electronic device may send a query processing information request to the storage module of the electronic device. The storage module of the electronic device may send historical processing information (that is, the de-privacy processing method corresponding to the image that has been de-privacy processed) to the processing module. The processing module of the electronic device may perform de-privacy processing on the private information of all users in the first image based on the historical processing information.

[0193] S408: The electronic device stores the first image after the privacy removal processing, the user information after the privacy removal processing in the first image, and the correspondence between the first image and the user information after the privacy removal processing in the first image.

[0194] After the electronic device performs de-privacy processing on the private information of all users in the first image, the electronic device can store the first image after the de-privacy processing, the user information after the de-privacy processing in the first image, and the correspondence between the first image and the user information after the de-privacy processing in the first image, so that when the electronic device shares the first image again, the first image after the de-privacy processing can be shared, thereby achieving the effect of protecting user privacy.

[0195] In some examples, the electronic device may also store user information in the first image after de-privacy processing (i.e., the electronic device may store user information of the user who performed de-privacy processing on the first image), as well as a processing method for de-privacy processing on the private information in the first image.

[0196] For example, continue to combine Figure 5 As shown, the electronic device stores the first image after the privacy de-processing, which may include: after the electronic device, such as the processing module of the electronic device, performs privacy de-processing on the private information of all users in the first image, the processing module of the electronic device may send a marking request to the marking module of the electronic device. After the marking module of the electronic device receives the marking request, the marking module of the electronic device may mark the users who have undergone privacy de-processing in the first image, that is, mark the user information of all users who have undergone privacy de-processing in the first image. Afterwards, the marking module of the electronic device may send the user information in the image after the privacy de-processing, that is, the marking information corresponding to the user information of all users who have undergone privacy de-processing in the first image, to the storage module, so that the storage module of the electronic device can store the user information in the first image after the privacy de-processing.

[0197] When the processing module of the electronic device sends the marking request to the marking module of the electronic device, the processing module of the electronic device can send the image after privacy decryption (i.e., the first image after privacy decryption) to the storage module of the electronic device, so that the storage module of the electronic device can store the first image after privacy decryption. The processing module of the electronic device can also send the processing method for performing privacy decryption on the first image to the storage module of the electronic device, so that the storage module of the electronic device can store the processing method for performing privacy decryption on the first image.

[0198] S409: The electronic device receives an operation by the user to perform privacy protection processing on the private information of part of the user in the first image.

[0199] After the electronic device displays a prompt window for the user to confirm whether to de-privacy the private information of all users in the first image, the electronic device can receive an operation from the user to de-privacy the private information of some users in the first image, such as a triggering operation of a "No" option included in the prompt window, such as a click operation.

[0200] S410: In response to the operation, the electronic device performs privacy protection processing on the private information of part of the user in the first image.

[0201] When the electronic device receives an operation from the user to perform privacy protection processing on the private information of some users in the first image, such as a triggering operation on the "No" option included in the prompt window, such as a click operation, in response to the operation, the electronic device can perform privacy protection processing on the private information of some users in the first image.

[0202] In some examples, before the electronic device performs de-privacy processing on the private information of some users in the first image, the electronic device can display the users who can be de-privacy processed, that is, the electronic device can display the user's identification, so that the user can select the users who can be de-privacy processed, that is, the user can select the identification of the users who can be de-privacy processed.

[0203] When the electronic device displays users who can be de-privacy processed, the electronic device may also display a prompt window, which may prompt the user to select the user who needs to be de-privacy processed. For example, the prompt window may include the words "Please select the user who needs to be de-privacy processed."

[0204] For example, let's take the first image as a family photo of the user, the user's private information as the user's face, and the privacy protection process as masking the private information using a cartoon avatar. When the electronic device receives the user's sharing operation on the first image, Figure 8As shown in (a) of FIG, the electronic device may display a sharing interface for the first image, that is, the electronic device may share the first image with other electronic devices (such as mobile phone 1) or with other applications (such as email applications). At the same time, the electronic device may determine whether the first image has been de-identified. If the electronic device determines that the first image has not been de-identified, the electronic device may determine whether user information of an important user is present in the first image.

[0205] When the electronic device determines that the user information of the important user does not exist in the first image, such as Figure 8 As shown in (b) of FIG. 8 , the electronic device may display a prompt window 801. The prompt window 801 may include the words “Do you want to perform privacy protection processing on the private information of all users in the first image?” and options of “Yes” and “No”.

[0206] When the electronic device receives a trigger operation of the user for the "No" option in the prompt window 801, such as a click operation, the electronic device can determine that the user confirms that the private information of some users in the first image (such as the facial information of some users) will be de-privacy processed. Afterwards, as shown in (d) in 8, the electronic device can display the users included in the first image, that is, the electronic device can display the identifiers of the users included in the first image, such as user 1, user 2, user 3 and user 4, so that the user can select some users for de-privacy processing. While the electronic device displays the users included in the first image, as shown in (d) in 8, the electronic device can also display a prompt window 803, which can include the words "Please select the users who need to be de-privacy processed."

[0207] When the user selects User 3 and User 4, that is, the electronic device receives the user's selection of User 3 and User 4 (this embodiment of the present application may be referred to as the fourth operation), that is, the user confirms that the privacy information of some users in the first image (i.e., the facial information of User 3 and User 4) will be de-privatized. The electronic device may de-privatize the privacy information of some users in the first image, that is, use cartoon avatars to block the privacy information of some users in the first image (i.e., the facial information of User 3 and User 4). Afterwards, as shown in (e) in 8, the electronic device may display the first image after the de-privatization process, that is, use cartoon avatars 802 to block the privacy information of some users in the first image (i.e., the facial information of User 3 and User 4), and display the sharing interface corresponding to the first image after the de-privatization process, so that the electronic device can share the first image.

[0208] It should be noted that, when the electronic device performs privacy protection processing on the private information of some users in the first image, the electronic device may also remove some users (ie, users selected by the user) in the first image.

[0209] S411: The electronic device stores the first image after the privacy removal processing, the user information after the privacy removal processing in the first image, and the correspondence between the first image and the user information after the privacy removal processing in the first image.

[0210] After the electronic device performs de-privacy processing on the private information of part of the user in the first image, the electronic device can store the first image after the de-privacy processing, the user information after the de-privacy processing in the first image, and the correspondence between the first image and the user information after the de-privacy processing in the first image, so that when the electronic device shares the first image again, the first image after the de-privacy processing can be shared, thereby achieving the effect of protecting user privacy.

[0211] In some examples, the electronic device may also store user information in the first image after de-privacy processing (i.e., the electronic device may store user information of the user who performed de-privacy processing on the first image), as well as a processing method for de-privacy processing on the private information in the first image.

[0212] S412: The electronic device determines whether the first image contains private information of an important user.

[0213] If the electronic device determines that the first image contains user information of an important user, the electronic device may determine whether the first image contains the private information of the important user. The first image may include at least one user (referred to as the first user in this embodiment of the application). That is, the electronic device may determine whether the first image contains the private information of all first users.

[0214] A user's private information may include information such as fingerprint information, iris information, and private body part information. In some examples, a user's private information may also include one or more of the following: name, school name, company name, bank account number, company account number, and ID number. The specific types of user private information are not limited in the embodiments of this application.

[0215] In some examples, the electronic device determining whether the first image contains the privacy information of an important user may include: the electronic device identifying the first image using a privacy learning artificial intelligence (AI) algorithm and a face recognition AI algorithm. If the electronic device identifies the user's privacy information using the privacy learning artificial intelligence (AI) algorithm and the face recognition AI algorithm, the electronic device may determine that the first image contains the privacy information of the important user. If the electronic device does not identify the privacy information of the important user using the privacy learning artificial intelligence (AI) algorithm and the face recognition AI algorithm, the electronic device may determine that the first image does not contain the privacy information of the important user.

[0216] For example, continue to combine Figure 5 As shown, the electronic device determines whether the privacy information of an important user exists in the first image, which may include: after the electronic device, such as the control module included in the electronic device, receives the query result sent by the storage module, the control module of the electronic device may send a detection request to the detection module of the electronic device. After the detection module of the electronic device receives the detection request, the detection module may detect the first image and send the detection result to the identification module of the electronic device. The identification module of the electronic device determines whether the user information of the important user, such as the user's facial information and fingerprint information, exists in the first image based on the detection result sent by the detection module through the storage module of the electronic device.

[0217] In the case that the user information of the important user exists in the first image, the recognition module of the electronic device may send a recognition result to the control module of the electronic device, where the recognition result may be used to indicate that the user information of the important user exists in the first image.

[0218] When important user information of the user does not exist in the first image, the detection module of the electronic device may send a recognition result to the control module of the electronic device, where the recognition result may be used to indicate that user information of the important user does not exist in the first image.

[0219] If the electronic device determines that the user information of the important user does not exist in the first image, the electronic device may execute S413. If the electronic device determines that the user information of the important user exists in an image, the electronic device may execute S414.

[0220] S413: The electronic device shares the first image.

[0221] When the electronic device determines that the user's private information does not exist in the first image, the electronic device may share the first image.

[0222] It should be noted that the embodiment of the present application does not limit the order in which the above steps S404 and S412 are executed. Figure 4An exemplary description is given by taking step S404 being performed before step S412 as an example. In other embodiments, the above-mentioned step S404 may also be performed after step S412. When step S404 is performed after step S412, the electronic device first determines whether the user's privacy information exists in the first image. When the electronic device determines that the user's privacy information does not exist in the first image, step S413 is continued to be performed. When the electronic device determines that the user's privacy information exists in the first image, it further determines whether the first image contains user information of an important user. When the electronic device determines that the first image contains user information of an important user, steps S414-S416 are continued to be performed. When the electronic device determines that the first image does not contain user information of an important user, steps S405-S411 are continued to be performed.

[0223] S414: The electronic device receives the privacy information of the important user and performs a privacy removal operation on the private information.

[0224] When the electronic device determines that the user information of the important user exists in the first image, the electronic device may receive a request from the user to perform a de-privacy operation on the private information of the important user, thereby performing de-privacy processing on the private information of the important user in the first image.

[0225] In some examples, before the electronic device receives a request from the user to perform a de-privacy operation on the privacy information of an important user, that is, when the electronic device determines that the user information of the important user exists in the first image, the electronic device can display a prompt window, which can be used by the user to confirm whether to de-privacy the privacy information of the important user in the first image.

[0226] In some examples, if the electronic device determines that the first image contains user information of an important user, the electronic device may display a prompt window that may include the words "Do you want to de-privacy the private information of the important user in the first image?" The first prompt window may also include two options, namely "Yes" and "No."

[0227] When the electronic device receives a trigger operation from the user for the "No" option in the prompt window, such as a click operation, the electronic device can determine that the user confirms not to de-privacy process the private information of important users in the first image, so that the electronic device can share the first image.

[0228] When the electronic device receives a trigger operation of the user for the "Yes" option in the prompt window, such as a click operation, the electronic device can determine that the user confirms to de-privacy the private information of the important user in the first image, that is, the electronic device receives the user's de-privacy operation for the private information of the important user.

[0229] S415: In response to the privacy protection operation, the electronic device performs privacy protection on the privacy information of the important user in the first image.

[0230] When the electronic device receives a request from the user to perform a privacy de-privacy operation on the private information of an important user, the electronic device may perform a privacy de-privacy process on the private information of the important user in the first image in response to the privacy de-privacy operation.

[0231] For example, let's take the first image as a family photo of the user, the user's private information as the user's face, and the privacy protection process as masking the private information using a cartoon avatar. When the electronic device receives the user's sharing operation on the first image, Figure 9 As shown in (a) of FIG, the electronic device may display a sharing interface for the first image, that is, the electronic device may share the first image with other electronic devices (such as mobile phone 1) or with other applications (such as email applications). At the same time, the electronic device may determine whether the first image has been de-identified. If the electronic device determines that the first image has not been de-identified, the electronic device may determine whether user information of an important user is present in the first image.

[0232] When the electronic device determines that the user information of important users (ie, user 1, user 2, user 3, and user 4) exists in the first image, as shown in FIG. Figure 9 As shown in (b) of FIG. , the electronic device may display a prompt window 901. The prompt window 901 may include the words "Do you want to perform privacy protection processing on the private information of the important user in the first image?" and options of "Yes" and "No".

[0233] When the electronic device receives a user's triggering operation on the "No" option in the prompt window 901, such as a click operation, Figure 9 As shown in (d), the electronic device can continue to display the sharing interface corresponding to the first image, so that the electronic device can share the first image.

[0234] When the electronic device receives a trigger operation of the user for the "Yes" option in the prompt window 901, such as a click operation, the electronic device can determine that the user confirms to perform de-privacy processing on the private information of the important users in the first image (such as the facial information of the important users). Afterwards, as shown in (c) in 9, the electronic device can display the first image after the de-privacy processing, that is, the electronic device can use a cartoon avatar to block the private information of the important users in the first image (that is, the facial information of user 1, user 2, user 3, and user 4). Afterwards, the electronic device can display the sharing interface corresponding to the first image after the de-privacy processing, so that the electronic device can share the first image after the de-privacy processing.

[0235] It should be noted that after the electronic device de-identifies the private information of the important user in the first image, the electronic device may also display a prompt window for the user to confirm whether to de-identify the private information of other users. When the electronic device receives the user's confirmation to de-identify the private information of other users, the electronic device may display the user's identifier, allowing the user to select the users to be de-identified, that is, to select the identifiers of the users to be de-identified.

[0236] When the electronic device receives an operation in which the user selects the user's identifier, the electronic device may continue to perform de-identification processing on the private information corresponding to the user's identifier, so that the electronic device can share the first image after the de-identification processing (i.e., the first image after the de-identification processing of the important user and the selected user). When the electronic device receives an operation in which the user confirms that the private information of other users will not be de-identified, the electronic device may display the user's identifier (i.e., the first image after the de-identification processing of the important user).

[0237] S416: The electronic device stores the first image after the privacy removal processing, the user information after the privacy removal processing in the first image, and the correspondence between the first image and the user information after the privacy removal processing in the first image.

[0238] After the electronic device performs de-privacy processing on the privacy information of the important user in the first image, the electronic device can store the first image after the de-privacy processing, the user information after the de-privacy processing in the first image, and the correspondence between the first image and the user information after the de-privacy processing in the first image, so that when the electronic device shares the first image again, the first image after the de-privacy processing can be shared, thereby achieving the effect of protecting user privacy.

[0239] In some examples, the electronic device may also store user information in the first image after de-privacy processing (i.e., the electronic device may store user information of important users for whom de-privacy processing is performed on the first image), as well as a method for de-privacy processing of the private information in the first image.

[0240] Using the solution of this application, when an electronic device receives a user's request to share a first image, the electronic device can first determine whether the first image has been de-identified. If the first image has been de-identified, the electronic device can share the de-identified first image, thereby preventing the disclosure of the user's private information in the first image.

[0241] If the first image has not been de-privacy processed, the electronic device may determine whether the user's private information exists in the first image. If the user's private information does not exist in the first image, the electronic device may share the first image, thereby preventing the leakage of the user's private information in the first image.

[0242] If the electronic device determines that the first image contains the user's private information, the electronic device may determine whether the first image contains the user information of an important user. If the electronic device determines that the first image does not contain the user information of an important user, the electronic device may perform a privacy protection process on the private information of all users in the first image, or perform a privacy protection process on the private information of some users in the first image, thereby preventing the leakage of the user private information of all or some users in the first image.

[0243] When the electronic device determines that user information of an important user is present in the first image, the electronic device can perform de-privacy processing on the private information of the important user in the first image, thereby preventing leakage of the private information of the important user in the first image. The privacy protection method provided in the embodiment of the present application can identify the important user in the image and automatically protect the private information (fingerprint, iris, private parts, etc.) related to the important user in the image, thereby reducing user operations and improving the efficiency of protecting private information.

[0244] For ease of understanding, the privacy protection method provided in the embodiments of the present application is described below by way of example.

[0245] For example, the first image may include multiple users, and the user's private information includes the user's facial information and fingerprint information, such as Figure 10 As shown, the privacy protection method provided in the embodiment of the present application may include the following process:

[0246] The electronic device receives a sharing operation from the user, that is, the electronic device may receive an operation from the user to share the first image.

[0247] When the electronic device receives an operation from a user to share a first image, in response, the electronic device may determine whether the image (i.e., the first image) has been de-identified, such as whether all users in the image have been de-identified. If the electronic device determines that the image (i.e., the first image) has been de-identified, such as if the electronic device determines that all users in the image have been de-identified, the electronic device may not process the first image and may prompt the user that all users in the image have been de-identified, so that the user can choose to share the de-identified image.

[0248] If the electronic device determines that the image (i.e., the first image) has not been processed for privacy removal, such as if the electronic device determines that all users in the image have not been processed for privacy removal, the electronic device may determine whether there are any users in the image who have not been processed for privacy removal, such as if the electronic device determines whether there are any faces of users who have not been processed for privacy removal in the image. If the electronic device determines that there are no faces of users who have not been processed for privacy removal in the image, the electronic device may determine whether there are any fingerprints of users who have not been processed in the image.

[0249] When the electronic device determines that the face of a user whose privacy has not been removed exists in the image, the electronic device may determine whether the stored facial information can be obtained, that is, the electronic device may determine whether the user information of the important user can be obtained.

[0250] When the electronic device determines that the stored facial information can be acquired, the electronic device may identify the facial information in the image (ie, the first image) and determine whether the facial information in the image is facial information of an important user.

[0251] If the electronic device determines that the facial information in the image is not that of an important user, the electronic device may determine whether to perform privacy protection for all users. If the electronic device determines that privacy protection is to be performed for all users, the electronic device may determine the faces and fingerprints of the users in the image. If the electronic device determines that privacy protection is not to be performed for all users, the electronic device may identify the facial information recognized in the image for the user to select, that is, the user may select which users in the image to be protected. After the user selects the user to be protected, the electronic device may prompt the user to confirm. If the electronic device determines that the user does not confirm, the electronic device may re-identify the recognized facial information for the user to select. If the electronic device determines that the user confirms, the electronic device may prompt the user to add the user, that is, whether to add the user to the privacy protection. If the electronic device determines that the user will not be added, the electronic device may determine the faces and fingerprints of the users in the image. If the electronic device determines that the user will be added, the electronic device may perform privacy protection for the added user. The electronic device may then determine the faces and fingerprints of the users in the image.

[0252] In the case where the electronic device determines that the facial information in the image is the facial information of an important user, the electronic device can determine whether the image (i.e., the first image) is shared for the first time. In the case where the electronic device determines that the image is shared for the first time, the electronic device can mark the important user and display the important user, so that the user can determine whether to perform de-privacy processing on the privacy information of the important user in the image. In the case where the electronic device determines that the image is not shared for the first time, the electronic device can obtain the existing de-privacy processing information of the image (i.e., the user who has been de-privacy processed and the de-privacy processing method), and then mark the existing de-privacy processing information of the image (i.e., the important user) and display the important user, so that the user can determine whether to perform de-privacy processing on the privacy information of the important user in the image.

[0253] When the electronic device marks and displays important users, the electronic device can determine whether the image is shared. When the electronic device determines that the user does not share the marked image, the electronic device may not process it and share the original image (i.e., the first image). When the electronic device determines that the user shares the marked image, the electronic device can determine whether it has received the user's permanent validation (i.e., the privacy information of the important user in the image is permanently de-privacy processed) operation. When the electronic device determines that it has not received the user's permanent validation operation, the electronic device can determine the user's face and fingerprint in the image.

[0254] When the electronic device determines that the permanent validation operation of the user has been received, the electronic device may save the setting item. After the electronic device saves the setting item, the electronic device may determine the face and fingerprint of the user in the image.

[0255] After the electronic device determines the user's face and fingerprint in the image, it can circle the pixel circles corresponding to the user's face and fingerprint in the image. After the electronic device circle the pixel circles corresponding to the user's face and fingerprint in the image, it can perform privacy protection on the image. After the image is privacy-protected, the electronic device can mark (i.e., store) the user in the image whose privacy protection has been protected.

[0256] After the electronic device marks the user whose privacy has been de-identified in the image, it can determine whether there is an unprocessed user's fingerprint in the image. If the electronic device determines that there is no unprocessed user's fingerprint in the image, the electronic device may not process the image or provide a prompt. If the electronic device determines that there is an unprocessed user's fingerprint in the image, the electronic device can determine whether to perform privacy de-identification on the fingerprint in the image.

[0257] If the electronic device determines not to perform privacy protection processing on the fingerprint in the image, the electronic device may not perform the processing and may not provide a prompt. If the electronic device determines to perform privacy protection processing on the fingerprint in the image, the electronic device may determine the fingerprint included in the image. After the electronic device determines the fingerprint included in the image, the electronic device may perform a privacy protection operation on the fingerprint included in the image, such as blurring the fingerprint. After the electronic device performs the privacy protection operation on the fingerprint included in the image, the electronic device may display the processed image. After the electronic device displays the processed image, the electronic device may mark and store the fingerprint included in the processed image.

[0258] It should be noted that the privacy protection method provided in the embodiment of the present application can also be applied to the scenario of sharing images to other applications, such as social applications. Figure 11 As shown, the process of sharing an image to other applications may include the following process.

[0259] The application can access the electronic device's image gallery, allowing the user to select an image to share. After the user selects an image to share, the electronic device can determine the processing status of the accessed image. If the processing status of the accessed image is processed, the electronic device can prompt the user that the accessed image has been de-identified, so that the electronic device can display the de-identified image and share it.

[0260] In the case where the processing status of the accessed image is unprocessed, the electronic device can determine whether there is an image that has been processed for privacy protection. In the case where the electronic device determines that there is an image that has been processed for privacy protection, the electronic device can recommend replacing it with an image that has been processed for privacy protection. In the case where the electronic device determines that there is an image that has been processed for privacy protection, the electronic device can prompt the user to perform privacy protection. The electronic device marks the users in the image so that the user can choose to perform privacy protection on certain users in the image or kick out a certain user. In the case where the user chooses to exclude a certain user, the electronic device can locate the excluded user and crop or blur the excluded user. Afterwards, the electronic device can display the processed image.

[0261] For ease of understanding, the following Figure 12 The privacy protection method provided in the embodiment of this application is described. Figure 12 As shown, the privacy protection method may include the following S1201-S1218.

[0262] S1201: The electronic device receives a first operation of a user to share a first media resource.

[0263] The first media resource may be an image stored in an electronic device, or a video stored in an electronic device. The specific type of the first media resource is not limited in the embodiment of the present application. The embodiment of the present application takes the first media resource as an image as an example for illustration.

[0264] In the embodiment of the present application, the specific implementation of the electronic device receiving the first operation of the user sharing the first media resource can refer to the implementation in the above S401, which will not be described in detail in this embodiment of the present application.

[0265] S1202: In response to the first operation, the electronic device determines a processing status of a first media resource.

[0266] After the electronic device receives a first operation from a user to share a first media resource, the electronic device may determine a processing status of the first media resource. The processing status of the first media resource may include being processed for privacy protection or not being processed for privacy protection.

[0267] When the processing status of the first media resource is de-privacy processed, the first media resource has been de-privacy processed. When the processing status of the first media resource is not de-privacy processed, the first media resource has not been de-privacy processed.

[0268] In the embodiment of the present application, the specific implementation of the electronic device determining the processing status of the first media resource can refer to the implementation in the above S402, which will not be described in detail in this embodiment of the present application.

[0269] S1203: When the electronic device determines that the processing status of the first media resource has been de-privacy processed, the electronic device displays a second prompt window.

[0270] When the electronic device determines that the processing status of the first media resource has been de-privacy processed, the electronic device may display a second prompt window. The second prompt window may be used for the user to confirm whether to use the second media resource, that is, prompt the user to confirm whether to use the second media resource for sharing.

[0271] The second media resource may be a media resource obtained by de-privacy processing of the first media resource. That is, the user may use the de-privacy processed media resource to replace the first media resource, thereby being able to share the de-privacy processed media resource.

[0272] In the embodiment of the present application, the specific implementation of the electronic device displaying the second prompt window can refer to the implementation in the above S403, which will not be described in detail in this embodiment of the present application.

[0273] S1204: The electronic device receives a fifth operation of the user confirming the use of the second media resource.

[0274] S1205. In response to the fifth operation, the electronic device displays a second media resource.

[0275] When the electronic device receives the fifth operation of the user confirming to use the second media resource, the electronic device may display the second media resource in response and then share the second media resource.

[0276] S1206: The electronic device receives a sixth operation of the user confirming not to use the second media resource.

[0277] S1207: In response to the sixth operation, the electronic device shares the first media resource.

[0278] When the electronic device receives the fifth operation of the user confirming not to use the second media resource, that is, the electronic device determines that the user does not share the second media resource but wants to share the first media resource, in response, the electronic device can share the first media resource.

[0279] S1208: When the electronic device determines that the processing status of the first media resource is not privacy-removing processing, the electronic device determines whether the first media resource includes at least one first user.

[0280] When the electronic device determines that the processing status of the first media resource is not privacy-removed, the electronic device may determine whether the first media resource includes the user's private information. The user information may be the user's facial information, fingerprint information, or other user information. The specific type of user information is not limited in the embodiments of this application. The embodiments of this application use the user's facial information as an example for illustration.

[0281] The first media resource may include multiple first users, that is, the first media resource may include user information of multiple first users. The user information may be user facial information, fingerprint information, and other information.

[0282] The electronic device determines whether the first media resource includes at least one first user, that is, the electronic device determines whether the first media resource includes user information of at least one first user.

[0283] S1209: When the electronic device determines that the first media resource does not include at least one first user, the electronic device may share the first media resource.

[0284] S1210: When the electronic device determines that the first media resource includes at least one first user, the electronic device determines whether the stored user information includes user information of the first user in the first media resource.

[0285] When the electronic device determines that the first media resource includes at least one first user, the electronic device may determine whether the stored user information includes user information of all first users in the first media resource.

[0286] When the electronic device determines that the first media resource includes private information of at least one first user, the electronic device displays a first prompt window. The electronic device may identify user information of the user included in the first media resource. The first media resource may include at least one first user, and the user information of the user included in the first media resource is the user information of the at least one first user.

[0287] After the electronic device identifies the user information of at least one first user included in the first media resource (i.e., the user information of all users included in the first media resource), the electronic device can compare the user information of the at least one first user with the user information stored in the electronic device to determine whether the user information of the at least one first user is the same as the user information stored in the electronic device.

[0288] The user information stored in the electronic device may be user information pre-stored in the electronic device, that is, the user information stored in the electronic device may be user information of important users pre-stored in the electronic device.

[0289] The user information stored in the electronic device may include user information of multiple users. The user information stored in the electronic device may be facial information of the user.

[0290] In some examples, the electronic device obtaining stored user information may include: the electronic device obtaining a third media resource (the third media resource may be an image), the third media resource may include media resources stored by the electronic device, media resources stored by a server (i.e., media resources stored in the cloud corresponding to the electronic device), and media resources input by the user (e.g., facial information input by the user). The electronic device may use a machine learning algorithm based on the third media resource to obtain the user information stored by the electronic device.

[0291] In the embodiment of the present application, the specific implementation of the electronic device determining whether the user information of at least one first user is the same as the user information stored in the electronic device can refer to the implementation in S404-S406 above, which will not be repeated here.

[0292] S1211: When the user information stored in the electronic device includes the user information of the first user, the electronic device performs a privacy protection process on the private information of the first user.

[0293] In some examples, the user information stored in the electronic device includes user information of all first users, that is, the user information stored in the electronic device includes user information of all first users in the first media resource.

[0294] It should be noted that, when the electronic device determines that the stored user information includes the user information of the first user, the electronic device can first determine whether the first media resource includes the privacy information of the first user. If the first media resource includes the privacy information of the first user, the electronic device can de-privacy process the privacy information of the first user.

[0295] In some examples, when the first media resource does not include the first user's private information, the electronic device may share the first media resource.

[0296] In the embodiment of the present application, the specific implementation method of the electronic device performing the de-privacy processing on the private information of the first user can refer to the implementation method in the above S413-S416, which will not be described in detail in this embodiment of the present application.

[0297] S1212: When the user information stored in the electronic device does not include user information of all first users in the first media resource, the electronic device displays a first prompt window.

[0298] If the user information stored in the electronic device does not include the user information of all first users in the first media resource, that is, if the first media resource includes no important users stored in the electronic device, the electronic device may display a first prompt window. This first prompt window may allow the user to confirm whether to perform de-privacy processing on the private information of all first users included in the first media resource.

[0299] When the electronic device determines that the user confirms to perform de-privacy processing on all the first user's private information included in the first media resource, the electronic device may perform de-privacy processing on all the first user's private information included in the first media resource, that is, the electronic device performs de-privacy processing on the first user's private information.

[0300] When the electronic device determines that the user confirms not to perform de-privacy processing on all the first user's private information included in the first media resource, the electronic device can display the identifiers of all the first users in the first media resource, so that the user can select the identifiers of the users who need to perform de-privacy processing.

[0301] In the embodiment of the present application, the specific implementation of the electronic device displaying the first prompt window can refer to the implementation in the above S407, which will not be described in detail in this embodiment of the present application.

[0302] It should be noted that if the electronic device determines that the stored user information does not include all of the first user's user information in the first media resource, the electronic device may first determine whether the first user's private information is included in the first media resource. If the first user's private information is included in the first media resource, the electronic device may continue to execute S1213-S1218 below. If the first media resource does not include the first user's private information, the electronic device may share the first media resource.

[0303] S1213: The electronic device receives a second operation in which the user confirms to perform de-privacy processing on all private information of the first user included in the first media resource.

[0304] S1214: In response to the second operation, the electronic device performs privacy protection on all the first user's private information included in the first media resource.

[0305] When the electronic device receives the second operation in which the user confirms that all the first user's private information included in the first media resource will be de-privatized, that is, the electronic device receives the second operation in which the user confirms that all the private information corresponding to the user information included in the first media resource will be de-privatized, in response, the electronic device may de-privatize all the first user's private information included in the first media resource.

[0306] After the electronic device performs a privacy-removing process on all the first user's private information included in the first media resource, the electronic device may share the first media resource after the privacy-removing process.

[0307] Privacy protection processing may include masking the private information, such as using mosaics or cartoon avatars, or blurring the private information. The specific type of privacy protection processing is not limited in the embodiments of the present application.

[0308] In some examples, after the electronic device performs de-privacy processing on all the first user's private information included in the first media resource, the electronic device may store the first media resource after the de-privacy processing. The electronic device may also store the user information de-privacy processed in the first media resource and the de-privacy processing method.

[0309] In the embodiment of the present application, the specific implementation method of the electronic device performing the de-privacy processing on all the private information of the first user included in the first media resource can refer to the implementation methods in S408-409 above, which will not be described in detail in this embodiment of the present application.

[0310] S1215: The electronic device receives a third operation in which the user confirms not to perform privacy removal processing on all the private information of the first user included in the first media resource.

[0311] S1216. In response to the third operation, the electronic device displays the identifiers of all first users in the first media resource.

[0312] When the electronic device receives the third operation in which the user confirms that all the first user's private information included in the first media resource will not be de-privatized, that is, the electronic device receives the user's confirmation that the private information corresponding to part of the user information included in the first media resource will be de-privatized, in response, the electronic device may include the identifiers of all the first users in the first media resource, so that the user can select the identifiers of the users who need to be de-privatized, that is, select the users who need to be de-privatized.

[0313] S1217: The electronic device receives a fourth operation of the user selecting some of the first user's identifiers in the first media resource.

[0314] After the electronic device displays the identifiers of all first users in the first media resource, the electronic device may receive a fourth operation of the user selecting some of the identifiers of the first users in the first media resource.

[0315] S1218: In response to the fourth operation, the electronic device performs a privacy protection process on part of the first user's private information in the first media resource.

[0316] After the electronic device receives a fourth operation in which the user selects identifiers of some of the first user in the first media resource, the electronic device may determine that the user needs to perform de-privacy processing on the private information of some of the first user in the first media resource. In response, the electronic device may perform de-privacy processing on the private information of some of the first user in the first media resource. After the electronic device performs de-privacy processing on the private information of some of the first user in the first media resource, the electronic device may share the de-privacy processed first media resource.

[0317] After the electronic device performs de-privacy processing on a portion of the first user's private information in the first media resource, the electronic device may store a fourth media resource, the de-privacy processed user information in the fourth media resource, and a correspondence between the fourth media resource and the de-privacy processed user information in the fourth media resource. The fourth media resource may be the de-privacy processed first media resource.

[0318] The privacy protection method provided in the embodiment of the present application can enable the electronic device to identify the user information in the media resources when the user needs to share media resources. When the user information in the media resources is the user information stored in the electronic device (i.e., the user information of an important user), the electronic device can automatically perform de-privacy processing on the privacy information (fingerprint information, iris information, private part information, etc.) related to the important user in the media resources. This can avoid the user from selecting the location for de-privacy processing, reduce the user's operations, and improve the efficiency of protecting privacy information.

[0319] Corresponding to the methods in the aforementioned embodiments, embodiments of the present application also provide a privacy protection device. This privacy protection device can be applied to an electronic device to implement the methods in the aforementioned embodiments. The functions of this device can be implemented in hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the aforementioned functions.

[0320] For example, Figure 13 A schematic diagram of the structure of a privacy protection device 1300 is shown. Figure 13 As shown, the privacy protection device 1300 may include: a receiving module 1301, an identification module 1302, a processing module 1303 and a sharing module 1304, etc.

[0321] The receiving module 1301 may be configured to receive a first operation of a user sharing a first media resource.

[0322] The identification module 1302 may be configured to identify at least one first user in response to a first operation.

[0323] The identification module 1302 may also be configured to identify the privacy information of the first user when the electronic device identifies the first user.

[0324] The processing module 1303 may be configured to perform privacy protection processing on the private information when the electronic device recognizes the private information of the first user.

[0325] The sharing module 1304 may be used to share the first media resource after the privacy protection process.

[0326] In a possible implementation, the processing module 1303 may also be configured to perform de-privacy processing on the first user's private information when the electronic device recognizes the first user's private information and the user information stored in the electronic device includes the first user's user information.

[0327] In a possible implementation, the privacy protection device 1300 may further include a display module 1305 .

[0328] Display module 1305 can be used to display a first prompt window when the electronic device recognizes the privacy information of the first user and the user information stored in the electronic device does not include all the user information of the first user in the first media resource. The first prompt window is used for the user to confirm whether to de-privacy process all the privacy information of the first user included in the first media resource.

[0329] The receiving module 1301 may also be configured to receive a second operation in which the user confirms to perform de-privacy processing on all private information of the first user included in the first media resource.

[0330] The processing module 1303 may also be configured to, in response to the second operation, perform privacy removal processing on all the first user's private information included in the first media resource.

[0331] In a possible implementation, the receiving module 1301 may also be configured to receive a third operation in which the user confirms not to perform de-privacy processing on all the private information of the first user included in the first media resource.

[0332] The display module 1305 may also be configured to display the identifiers of all first users in the first media resource in response to the third operation.

[0333] The receiving module 1301 may also be configured to receive a fourth operation of the user selecting some of the first user's identifiers in the first media resource.

[0334] The processing module 1303 may also be configured to, in response to a fourth operation, perform privacy removal processing on part of the first user's private information in the first media resource.

[0335] In a possible implementation, the privacy protection device 1300 may further include a determination module 1306 .

[0336] The determination module 1306 may be configured to determine a processing status of the first media resource. The processing status of the first media resource may include whether the first media resource has been processed for privacy protection or whether the first media resource has not been processed for privacy protection.

[0337] The display module 1305 can also be used to display a second prompt window when the electronic device determines that the processing status of the first media resource is de-privacy processed. The second prompt window is used for the user to confirm whether to use the second media resource. The second media resource is the media resource after the first media resource has been de-privacy processed.

[0338] The receiving module 1301 may also be configured to receive a fifth operation of the user confirming the use of the second media resource.

[0339] The display module 1305 may be configured to cause the electronic device to display a second media resource in response to the fifth operation.

[0340] In a possible implementation, the privacy protection device 1300 may further include an acquisition module 1307 .

[0341] The acquisition module 1307 can also be used to acquire third media resources; the third media resources include media resources stored in the electronic device, media resources stored in the server, media resources input by the user, and information input by the user.

[0342] The determination module 1306 may also be configured to obtain user information stored in the electronic device based on the third media resource.

[0343] In a possible implementation, the user information includes one or more of the following information: fingerprint information and facial information.

[0344] In a possible implementation, the privacy protection device 1300 may further include a storage module 1308 .

[0345] The storage module 1308 may be configured to store a fourth media resource, user information in the fourth media resource that has been subjected to privacy decryption, and a correspondence between the fourth media resource and the user information in the fourth media resource that has been subjected to privacy decryption, wherein the fourth media resource is the first media resource that has been subjected to privacy decryption.

[0346] In a possible implementation, the private information includes one or more of the following information: iris information, fingerprint information, and private part information.

[0347] It should be understood that the division of units or modules (hereinafter referred to as units) in the above devices is merely a division of logical functions. In actual implementation, they may be fully or partially integrated into a single physical entity, or physically separated. Furthermore, the units in the device may be implemented entirely in the form of software called through processing elements; entirely in the form of hardware; or partially in the form of software called through processing elements, and partially in the form of hardware.

[0348] For example, each unit can be a separately established processing element, or it can be integrated into a certain chip of the device for implementation. In addition, it can also be stored in a memory in the form of a program, and called by a certain processing element of the device to execute the function of the unit. In addition, all or part of these units can be integrated together, or they can be implemented independently. The processing element described here can also be called a processor, which can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each of the above units can be implemented by the integrated logic circuit of the hardware in the processor element or in the form of software called by the processing element.

[0349] In one example, the unit in the above device can be one or more integrated circuits configured to implement the above method, such as: one or more application specific integrated circuits (ASICs), or one or more digital signal processors (DSPs), or one or more field programmable gate arrays (FPGAs), or a combination of at least two of these integrated circuit forms.

[0350] For another example, when the units in the device can be implemented in the form of a processing element scheduling program, the processing element can be a general-purpose processor, such as a central processing unit (CPU) or other processor that can call programs. For another example, these units can be integrated together and implemented in the form of a system-on-a-chip (SOC).

[0351] In one implementation, the units implementing the corresponding steps of the above methods in the apparatus described above may be implemented in the form of a processing element scheduling program. For example, the apparatus may include a processing element and a storage element, with the processing element invoking a program stored in the storage element to execute the method described in the above method embodiments. The storage element may be a storage element on the same chip as the processing element, i.e., an on-chip storage element.

[0352] In another implementation, the program for executing the above method may be stored in a memory element on a different chip from the processing element, i.e., an off-chip memory element. In this case, the processing element calls or loads the program from the off-chip memory element onto the on-chip memory element to call and execute the method described in the above method embodiment.

[0353] For example, an embodiment of the present application may also provide a device, such as an electronic device (test electronic device), which may include a processor and a memory for storing instructions executable by the processor. When the processor is configured to execute the above instructions, the electronic device implements the privacy protection method as described in the above embodiment. The memory may be located inside the electronic device or outside the electronic device. The processor may include one or more.

[0354] In another implementation, the unit of the apparatus implementing each step of the above method may be configured as one or more processing elements, which may be provided on the corresponding electronic device. The processing elements may be integrated circuits, such as one or more ASICs, one or more DSPs, one or more FPGAs, or a combination of these integrated circuits. These integrated circuits may be integrated together to form a chip.

[0355] For example, an embodiment of the present application further provides a chip that can be applied to the above-mentioned electronic device (test electronic device). The chip includes one or more interface circuits and one or more processors; the interface circuits and processors are interconnected by lines; the processors receive and execute computer instructions from the memory of the electronic device through the interface circuits to implement the methods described in the above method embodiments.

[0356] An embodiment of the present application also provides a computer program product, including computer instructions executed by the above-mentioned electronic device.

[0357] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0358] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0359] The units described as separate components may or may not be physically separate, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0360] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0361] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, such as a program. The software product is stored in a program product, such as a computer-readable storage medium, and includes a number of instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, etc. Various media that can store program codes.

[0362] For example, embodiments of the present application may further provide a computer-readable storage medium having computer program instructions stored thereon. When the computer program instructions are executed by an electronic device, the electronic device implements the privacy protection method described in the aforementioned method embodiment.

[0363] The above is only a specific embodiment of the present application, but the scope of protection of this application is not limited to this. Any changes or substitutions within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A privacy protection method, characterized in that: Applied to electronic equipment, the method includes: The electronic device receives a first operation of a user sharing a first media resource, where the first media resource includes at least one first user; In response to the first operation, the electronic device identifies the at least one first user; When the electronic device identifies the first user, the electronic device identifies the private information of the first user; When the electronic device recognizes the private information of the first user, the electronic device performs a privacy protection process on the private information; The electronic device shares the first media resource after the privacy protection process; Wherein, when the electronic device recognizes the private information of the first user, the electronic device performs a privacy protection process on the private information, including: When the electronic device recognizes the private information of the first user and the user information stored in the electronic device does not include all the user information of the first user in the first media resource, the electronic device displays a first prompt window for the user to confirm whether to perform de-privacy processing on the private information of the first user included in the first media resource; The electronic device receives an operation by a user to perform privacy protection on part of the first user's private information in the first media resource; In response to the operation, the electronic device performs privacy protection processing on a portion of the first user's private information in the first media resource.

2. The method according to claim 1, characterized in that When the electronic device recognizes the private information of the first user, the electronic device performs a privacy protection process on the private information, including: When the electronic device recognizes the private information of the first user and the user information stored in the electronic device includes the user information of the first user, the electronic device performs a privacy protection process on the private information of the first user.

3. The method according to claim 2, characterized in that When the electronic device recognizes the private information of the first user, the electronic device performs a privacy protection process on the private information, further comprising: When the electronic device recognizes the private information of the first user and the user information stored in the electronic device does not include all the user information of the first user in the first media resource, the electronic device displays a first prompt window for the user to confirm whether to perform de-privacy processing on the private information of the first user included in the first media resource; The electronic device receives a second operation confirming by the user that all private information of the first user included in the first media resource is to be de-privacy processed; In response to the second operation, the electronic device performs privacy protection processing on all the first user's private information included in the first media resource.

4. The method according to claim 2, characterized in that After the electronic device displays the first prompt window, the method further includes: The electronic device receives a third operation from the user confirming that all the first user's private information included in the first media resource will not be de-privacy processed; In response to the third operation, the electronic device displays the identifiers of all first users in the first media resource; The electronic device receives a fourth operation of the user selecting some of the first user's identifiers in the first media resource; In response to the fourth operation, the electronic device performs privacy protection processing on part of the first user's private information in the first media resource.

5. The method according to claim 1, wherein Before the electronic device performs privacy protection processing on the private information, the method further includes: The electronic device determines a processing status of the first media resource, where the processing status of the first media resource includes whether the first media resource has been processed for privacy protection or whether the first media resource has not been processed for privacy protection; When the electronic device determines that the processing status of the first media resource is the deprivacy processed, the electronic device displays a second prompt window, where the second prompt window is for the user to confirm whether to use a second media resource, where the second media resource is the first media resource after the deprivacy processing. The electronic device receives a fifth operation of the user confirming to use the second media resource; The electronic device performs privacy protection processing on the private information, including: in response to the fifth operation, the electronic device displays the second media resource.

6. The method according to claim 2, characterized in that The method further comprises: The electronic device acquires a third media resource; the third media resource includes a media resource stored in the electronic device, a media resource stored in a server, a media resource input by a user, and information input by the user; The electronic device obtains the user information stored in the electronic device according to the third media resource.

7. The method according to any one of claims 1 to 6, characterized in that The user information includes one or more of the following information: fingerprint information, face information.

8. The method according to any one of claims 1 to 6, characterized in that The method further comprises: The electronic device stores a fourth media resource, user information in the fourth media resource that has been subjected to privacy de-processing, and a correspondence between the fourth media resource and the user information in the fourth media resource that has been subjected to privacy de-processing, wherein the fourth media resource is the first media resource after the privacy de-processing.

9. The method according to any one of claims 1 to 6, characterized in that The private information includes one or more of the following information: iris information, fingerprint information, and private part information.

10. An electronic device, characterized in that: The electronic device comprises a processor and a memory for storing instructions executable by the processor; when the processor is configured to execute the instructions, the electronic device implements the method according to any one of claims 1 to 9.

11. A computer-readable storage medium having computer program instructions stored thereon; characterized in that: When the computer program instructions are executed by an electronic device, the electronic device is caused to implement the method according to any one of claims 1 to 9.

Citation Information

Patent Citations

  • Privacy protection implementing method and device

    CN104376011A

  • Privacy protection method and electronic equipment

    CN114040048A