Privacy protection method and device, electronic equipment and storage medium

Abstract

The invention provides a privacy protection method which comprises the following steps: when terminal equipment displays a target interface, performing face image detection; if the face image of a target person is detected, matching the face image of the target person in a relational database to obtain a target intimacy level of the target person, the target person being a non-user person of the terminal device; determining target display content and non-display content corresponding to the target intimacy level based on a corresponding relationship between the intimacy level and the display content; based on the target display content and the non-display content, a final display interface is determined, and the final display interface comprises the target display content; and displaying the final display interface in the terminal equipment. According to the method and the device, non-user personnel can only see the content related to the intimacy level, so that the privacy of the user is protected, the flexibility of privacy setting can be improved, and meanwhile, the user experience is also improved.

Description

Technical Field

[0001] The present invention relates to the field of information protection technology, and in particular to a privacy protection method, device, electronic device and storage medium. Background Art

[0002] With the rapid development of the Internet, Internet chat software has deeply penetrated into people's work and life. Whether it is to keep in touch with relatives and friends far away, or to communicate with colleagues at work, these chat software have become an indispensable communication tool. However, this convenient way of communication also brings the hidden danger of privacy leakage. For example, someone obtains the user's privacy by peeking at the screen or borrowing terminal devices, which makes the user's demand for privacy protection increasingly strong. In this context, many privacy protection schemes have emerged. Among them, many schemes adopt the method of pre-setting hidden content. For example, users can set certain content in albums, folders or APPs to be hidden in advance to prevent unauthorized persons from viewing. This scheme of pre-setting hidden content protects the user's privacy to a certain extent, but whether it is close friends or family, as long as they are not the user himself, the content they see is the preset hidden version and it is the same. It can be seen that the existing scheme of hiding content is less flexible. Summary of the invention

[0003] The embodiment of the present invention provides a privacy protection method, which aims to solve the problem of poor flexibility of existing solutions for hiding content. When a non-user person is detected, the display content for the non-user person can be determined according to the intimacy level between the non-user person and the user, so that the non-user person can only see the content related to the intimacy level, which protects the user's privacy, improves the flexibility of privacy settings, and improves the user experience.

[0004] In a first aspect, an embodiment of the present invention provides a privacy protection method, the method comprising:

[0005] When the terminal device displays the target interface, perform face image detection;

[0006] If a facial image of a target person is detected, the facial image of the target person is matched in a relational database to obtain a target intimacy level of the target person, wherein the target person is a non-user person of the terminal device, and the relational database includes a correspondence between the facial image of the non-user person and the intimacy level;

[0007] Based on the correspondence between the intimacy level and the display content, determining the target display content and non-display content corresponding to the target intimacy level;

[0008] Determining a final display interface based on the target display content and the non-display content, wherein the final display interface includes the target display content;

[0009] The final display interface is displayed in the terminal device.

[0010] Optionally, before the step of matching the face image of the target person in a relational database to obtain the intimacy level of the target person, the method further includes:

[0011] Acquiring historical social data of the user of the terminal device and the non-user person on the social software;

[0012] Determining an intimacy level of the non-user person based on the historical social data;

[0013] And, based on the user avatar information of the social software or the historical social data, obtaining the facial image of the non-user person;

[0014] The facial image of the non-user person is associated with the intimacy level of the non-user person to obtain the relationship database.

[0015] Optionally, the historical social data is historical chat data, and the step of determining the intimacy level of the non-user person based on the historical social data includes:

[0016] Determining the number of chats and / or chat contents between the user and the non-user person based on the historical chat data;

[0017] Based on the number of chats and / or the chat content, determine the intimacy level of the non-user person.

[0018] Optionally, the step of acquiring the facial image of the non-user person based on the user avatar information on the social software or the historical social data includes:

[0019] Obtaining user avatar information of the non-user person on the social software, and determining whether the user avatar information is the avatar information of the non-user person;

[0020] If the user portrait information is the portrait information of the non-user person, then determining the face image of the non-user person based on the user portrait information;

[0021] If the user avatar information is not the avatar information of the non-user person, searching for the avatar information sent by the non-user person in the historical social data;

[0022] Based on the portrait information, a facial image of the non-user person is determined.

[0023] Optionally, the step of determining a final display interface based on the target display content and the non-display content includes:

[0024] Hiding the non-display content in the target interface to obtain a final display interface;

[0025] Alternatively, the target display content and the non-display content are sorted in the target interface in the order of the target display content first and the non-display content later to obtain a final display interface.

[0026] Optionally, the step of displaying the final display interface in the terminal device includes:

[0027] Performing real-time line of sight detection on the target person;

[0028] If it is detected that the sight target of the target person is the terminal device, then after performing a mitigation operation, the final display interface is displayed in the terminal device.

[0029] Optionally, after performing the mitigation operation, the step of displaying the final display interface in the terminal device includes:

[0030] Modifying the state of the target interface to an inoperable state so that the user exits the software to which the target interface belongs;

[0031] When the user re-enters the software to which the target interface belongs, the final display interface is displayed on the terminal device;

[0032] Alternatively, changing the display interface of the terminal device to a non-target interface;

[0033] After the non-target interface ends, the final display interface is displayed on the terminal device.

[0034] In a second aspect, an embodiment of the present invention further provides a privacy protection device, the privacy protection device comprising:

[0035] A detection module is used to detect a face image when the terminal device displays the target interface;

[0036] A matching module, for matching the face image of a target person in a relational database to obtain a target intimacy level of the target person if a face image of the target person is detected, wherein the target person is a non-user person of the terminal device, and the relational database includes a correspondence between the face image of the non-user person and the intimacy level;

[0037] A first processing module, configured to determine target display content and non-display content corresponding to the target intimacy level based on the correspondence between the intimacy level and the display content;

[0038] A second processing module, configured to determine a final display interface based on the target display content and the non-display content, wherein the final display interface includes the target display content;

[0039] A display module is used to display the final display interface in the terminal device.

[0040] In a third aspect, an embodiment of the present invention provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the privacy protection method provided in the embodiment of the present invention when executing the computer program.

[0041] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps in the privacy protection method provided in the embodiment of the invention are implemented.

[0042] In an embodiment of the present invention, when the terminal device displays the target interface, facial image detection is performed; if the facial image of the target person is detected, the facial image of the target person is matched in the relational database to obtain the target intimacy level of the target person, the target person is a non-user person of the terminal device, and the relational database includes the correspondence between the facial image of the non-user person and the intimacy level; based on the correspondence between the intimacy level and the display content, the target display content and non-display content corresponding to the target intimacy level are determined; based on the target display content and the non-display content, the final display interface is determined, and the final display interface includes the target display content; the final display interface is displayed in the terminal device. The present invention can determine the display content for the non-user person according to the intimacy level between the non-user person and the user when a non-user person is detected, so that the non-user person can only see the content related to the intimacy level, which protects the privacy of the user, improves the flexibility of the privacy setting, and improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0044] Figure 1is a flow chart of a privacy protection method provided by an embodiment of the present invention;

[0045] Figure 2 is a structural schematic diagram of a privacy protection device provided by an embodiment of the present invention;

[0046] Figure 3 It is a structural schematic diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0047] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0048] like Figure 1 As shown, Figure 1 : is a method flow chart of a privacy protection method provided by an embodiment of the present invention. The privacy protection method comprises the steps of:

[0049] 101. When the terminal device displays the target interface, facial image detection is performed.

[0050] In an embodiment of the present invention, the terminal device may be a personal terminal device such as a mobile phone, a tablet, or a computer. Various functional software such as chat software, photo album software, and file management software are installed in the terminal device. The target interface may be a software interface specified by a user, and the software interface may view data corresponding to the software. The present invention is described using chat software as an example, and other types of software may also be implemented with reference to the embodiment of the chat software. A camera is provided in the terminal device, and image acquisition is performed through the camera. Specifically, image acquisition may be performed on the area in front of the terminal device.

[0051] Taking chat software as an example, the target interface is the chat software interface, and the chat software interface may include a chat list, a chat record box, and an input box.

[0052] When the interface displayed by the terminal device includes the target interface, the privacy protection mode will be entered. When the interface displayed by the terminal device is not the target interface, the privacy protection mode will not be entered. Specifically, after the terminal device is turned on or the screen is turned on, it is detected whether the target interface is included on the screen of the terminal device. If so, when it is detected that the target interface is included on the screen of the terminal device, the privacy protection model can be entered, and the image of the area in front of the terminal device is captured through the camera of the terminal device to obtain the image data in front of the terminal device, and face detection is performed on the image data. If a facial image is detected, it will be determined whether the facial image is the facial image of the user. If it is the facial image of the user, it will not be processed. If it is not the facial image of the user, the person corresponding to the facial image is determined as the target person, and the facial image is determined as the facial image of the target person.

[0053] In a possible embodiment, if the screen of the terminal device includes a target interface, it can also be determined whether the target interface is the top-level interface, and if the target interface is the top-level interface, the privacy protection mode is entered. If the target interface is not the top-level interface, the exposed area of ​​the target interface is determined, and if the exposed area of ​​the target interface is larger than a preset area, the privacy protection mode is entered.

[0054] 102. If a facial image of a target person is detected, the facial image of the target person is matched in a relational database to obtain a target intimacy level of the target person.

[0055] In an embodiment of the present invention, the target person is a non-user person of the terminal device, and the non-user person corresponds to the user, and the user is the owner of the terminal device (also referred to as the owner). Specifically, when performing facial image detection, if a facial image is detected, a facial image of the user is subjected to facial comparison. If the comparison is successful, the person to whom the facial image belongs is determined to be the user, and no subsequent processing is performed. If the comparison fails, the person to whom the facial image belongs is determined to be a non-user person, and the person to whom the facial image belongs is determined to be the target person, and it can be determined that the facial image of the target person is detected.

[0056] The above-mentioned relational database is pre-set, and includes the correspondence between facial images of non-user persons and intimacy levels. The correspondence between facial images of non-user persons and intimacy levels in the above-mentioned relational database can be updated in real time or periodically.

[0057] Since the above-mentioned relational database includes the correspondence between facial images of non-user persons and intimacy levels, after obtaining the facial image of the target person, the facial image of the target person can be compared with the facial images of non-user persons in the relational database, and the intimacy level corresponding to the successfully matched facial image can be determined as the target intimacy level of the target person.

[0058] In a possible embodiment, if the facial image of the target person fails to match in the relational database, it means that the target person is a stranger to the user, and the corresponding target intimacy level can be directly regarded as the lowest intimacy level.

[0059] 103. Based on the correspondence between the intimacy level and the display content, determine the target display content and non-display content corresponding to the target intimacy level.

[0060] In the embodiment of the present invention, there is a corresponding relationship between the intimacy level and the displayed content. Different intimacy levels correspond to different displayed content, which increases the flexibility of the displayed content. The higher the intimacy level, the more corresponding displayed content, and the lower the intimacy level, the less corresponding displayed content. The displayed content of the highest intimacy level can be the entire content of the terminal device or the corresponding software; the displayed content of the lowest intimacy level can be none, that is, no content is displayed; the displayed content of the intermediate intimacy level can be part of the content of the terminal device or the corresponding software.

[0061] After determining the target intimacy level of the target person, the display content corresponding to the intimacy level may be determined as the target display content, and the content other than the target display content may be determined as the non-display content.

[0062] For example, the target interface is a chat interface, which includes a chat list, a chat history box, and an input box. Display content 1 can be a common group between the user and the target person, and display content 2 can be a common friend between the user and the target person, etc. Taking intimacy level 1 as the highest level, when intimacy level 1, the target display content is all display content, and non-display content is empty; when intimacy level 2, the target display content is display content 1 + display content 2, and other display content is non-display content; when intimacy level 3, the target display content is display content 1, and other display content is non-display content; the display content is reduced in turn according to the decrease of intimacy level. Of course, the above display content can also be displayable content of other software, such as pictures or videos in album software, files in file management software, etc.

[0063] It can be understood that the above-mentioned target display content is the content that the target person can see, and the above-mentioned non-display content is the content that the target person cannot see.

[0064] 104. Determine a final display interface based on target display content and non-display content.

[0065] In an embodiment of the present invention, if the target display content and the non-display content are the contents in the target interface, the target display content can be retained in the target interface and the non-display content can be hidden, thereby obtaining a final display interface including the target display content.

[0066] If the target display content and the non-display content are not the contents in the target interface, the non-display content can be shielded at the bottom layer, and the target display content can be used as the preparation display interface of the corresponding software. The preparation display interface will only be displayed when the corresponding software is opened, and the preparation display interface is the final display interface.

[0067] 105. Display the final display interface on the terminal device.

[0068] In the embodiment of the present invention, the final display interface can directly replace the target interface, so that the terminal device only displays the final display interface. The final display interface can also be displayed after mitigation processing and when the corresponding software is re-entered.

[0069] The above-mentioned mitigation process can avoid the abruptness of directly replacing the target interface, making the display process of the final display interface more reasonable, thereby avoiding the embarrassing situation between the user and the target person and improving the user experience.

[0070] In an embodiment of the present invention, when the terminal device displays the target interface, facial image detection is performed; if the facial image of the target person is detected, the facial image of the target person is matched in the relational database to obtain the target intimacy level of the target person, the target person is a non-user person of the terminal device, and the relational database includes the correspondence between the facial image of the non-user person and the intimacy level; based on the target intimacy level, the target display content and non-display content for the target person are determined, and different intimacy levels correspond to different display contents; based on the correspondence between the intimacy level and the display content, the target display content and non-display content corresponding to the target intimacy level are determined; and the final display interface is displayed in the terminal device. The present invention can determine the display content for the non-user person according to the intimacy level between the non-user person and the user when a non-user person is detected, so that the non-user person can only see the content related to the intimacy level, which protects the privacy of the user, improves the flexibility of the privacy setting, and improves the user experience.

[0071] It should be noted that the privacy protection method provided in the embodiment of the present invention can be applied to devices such as smart phones, tablets, computers, servers, etc. that can perform the privacy protection method.

[0072] It is understandable that in the specific implementation of this application, user data, non-user data, interface data, facial data, social data, software data and other related data are involved. When the embodiments in this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0073] Optionally, before matching the facial image of the target person in a relational database to obtain the intimacy level of the target person, historical social data of the user of the terminal device and non-user persons on the social software can be obtained; based on the historical social data, the intimacy level of the non-user person is determined; and, based on the user avatar information or historical social data of the social software, the facial image of the non-user person is obtained; the facial image of the non-user person is associated with the intimacy level of the non-user person to obtain a relational database.

[0074] In an embodiment of the present invention, the construction of the relational database may be performed based on the intimacy level between users and non-users, and the intimacy level between users and non-users may be determined based on the historical social data of users and non-users on social software.

[0075] The above-mentioned social software can be chat software or social platform software. The above-mentioned chat software can be understood as software that can chat in real time, such as WeChat, QQ, etc. The above-mentioned platform software can be understood as software that can share information, such as Weibo, forums, etc.

[0076] It is understandable that, for the intimacy level, the more historical social data the user and the non-user personnel have on the social software, the higher the intimacy level between the user and the non-user personnel. Therefore, the intimacy level between the user and the non-user personnel can be determined based on the amount of historical social data. In addition, the intimacy level between the user and the non-user personnel can also be determined based on the time distribution of the social data in the historical social data. Specifically, if the social data is distributed in the later time of the historical social data, it means that the relationship between the user and the non-user personnel is relatively close in the recent time period, and the intimacy level between the user and the non-user personnel is set higher; if the social data is distributed in the earlier time of the historical social data, it means that the relationship between the user and the non-user personnel is relatively distant in the recent time period, and the intimacy level between the user and the non-user personnel is set lower.

[0077] For the facial images of non-user personnel, it can be determined from the user avatar information of the social software or the portrait data in the historical social data. In this way, it is not necessary to collect the facial images of non-user personnel.

[0078] After obtaining the intimacy level between the user and the non-user person and the facial image of the non-user person, the intimacy level between the user and the non-user person is determined as the intimacy level of the non-user person, and the facial image of the non-user person is associated with the intimacy level of the non-user person to obtain the correlation relationship between the facial image of the non-user person and the intimacy level of the non-user person. The correlation relationship is recorded in the form of a data table and maintained through a database method to obtain a relational database.

[0079] Optionally, in the step of determining the intimacy level of the non-user person based on the historical social data when the historical social data is historical chat data, the number of chats and / or chat contents between the user and the non-user person can be determined based on the historical chat data; and the intimacy level of the non-user person can be determined based on the number of chats and / or chat contents.

[0080] In an embodiment of the present invention, the more chat times, the higher the intimacy level, and the fewer chat times, the lower the intimacy level; the more chat content, the higher the intimacy level, and the less chat content, the lower the intimacy level. For example, if the number of chats is more than X1 times, the intimacy level is set to level 1; if the number of chats is less than X1 and more than Y1 times, the intimacy level is set to level 2; if the number of chats is less than Y1 times, the intimacy level is set to level 3, where X1 is greater than Y1, and X1 and Y1 are preset times thresholds. The amount of chat content can be determined according to the number of characters in the chat content. The more characters in the chat content, the more chat content, and the fewer characters in the chat content, the less chat content. For example, if the number of characters in the chat content is more than X2 characters, the intimacy level is set to level 1; if the number of characters in the chat content is less than X2 characters and more than Y2 characters, the intimacy level is set to level 2; if the number of characters in the chat content is less than Y2 characters, the intimacy level is set to level 3, where X2 is greater than Y2, and X2 and Y2 are preset times thresholds.

[0081] In a possible embodiment, sentiment analysis may also be performed on the chat content, and the intimacy level may be determined based on the result of the sentiment analysis, wherein positive sentiment corresponds to a high intimacy level, and negative sentiment corresponds to a low intimacy level.

[0082] In a possible embodiment, for a non-user person, the timeliness of the user's reply to the non-user person's message can also be calculated from the historical chat data. The above timeliness can be the average time for replying to the message. If the average time for replying to the non-user person's message is less than the preset reply time threshold, it means that the non-user person is very important to the user, and the user may want to show more content to the non-user person. Therefore, the intimacy level of the non-user person can be set higher, otherwise, the judge level of the non-user person can be set lower.

[0083] In a possible embodiment, the intimacy level between the above-mentioned user and non-user personnel can also be set by the user himself. Non-user personnel related to the user can be extracted through the address book or friend list and displayed to the user. The user can manually set the intimacy level of the non-user personnel.

[0084] By determining the intimacy level between a user and a non-user person through historical chat data, the intimacy level between the user and the non-user person can be determined quickly and accurately.

[0085] Optionally, in the step of obtaining the facial image of the non-user person based on the user avatar information or historical social data on the social software, the user avatar information of the non-user person on the social software can be obtained, and a judgment can be made as to whether the user avatar information is the non-user person's own avatar information; if the user avatar information is the non-user person's own avatar information, the facial image of the non-user person is determined based on the user avatar information; if the user avatar information is not the non-user person's own avatar information, the portrait information sent by the non-user person is searched in the historical social data; and the facial image of the non-user person is determined based on the portrait information.

[0086] In an embodiment of the present invention, the user avatar information of the non-user person on the social software can be pushed to the user for confirmation, and whether the user avatar information is the non-user person's own avatar information is determined based on the user's confirmation result. The user displays the user avatar information of the non-user person through the terminal device to determine whether it is his own avatar information. The above-mentioned user avatar information includes the user avatar. If the user determines that the user avatar of the non-user person is the non-user person's own avatar, the user avatar information can be determined as the non-user person's own avatar information. If the user determines that the user avatar of the non-user person is the non-user person's own avatar, the user avatar information can be determined as not the non-user person's own avatar information.

[0087] If the user avatar information is avatar information of a non-user person, the user avatar in the user avatar information can be determined as a facial image of the non-user person, or face extraction can be performed on the user avatar in the user avatar information to obtain a facial image of the non-user person.

[0088] In a possible embodiment, the user avatar in the user avatar information may be classified as a web image. If the user avatar is classified as a web image, it may be directly determined that the user avatar information is not the user's own avatar information.

[0089] When the user's avatar information is not the avatar information of the non-user person, the avatar information sent by the non-user person can be found in the historical social data. The historical social data may include the avatar information of the user sent by the non-user person, or the avatar information of the user published by the non-user person for viewing by a specific group of people. For example, during a chat with the user, the non-user person sends his or her own photo to the user, or the user publishes his or her own photo on the platform (friend circle, Weibo, forum, etc.).

[0090] After obtaining the portrait information of the non-user person, it can be sent to the user for confirmation to determine whether it is the user's own portrait information. If it is the user's own portrait information, the face image of the non-user person can be extracted from the portrait information. If it is not the user's own portrait, the non-user person will not be matched with the corresponding intimacy level when performing intimacy level matching, and can be directly identified as the lowest intimacy level.

[0091] Optionally, in the step of determining the final display interface based on the target display content and the non-display content, the non-display content may be hidden to obtain the final display interface; or, the target display content and the non-display content may be sorted in such a way that the target display content comes first and the non-display content comes later to obtain the final display interface.

[0092] In an embodiment of the present invention, the above-mentioned hiding process can be to hide the non-display content at the bottom layer of the software. Even if the software interface is operated, the hidden non-display content will not be displayed. In this way, it can be avoided that non-user personnel can find these non-display contents when borrowing the terminal device.

[0093] Considering the limited display range of the terminal device screen and the common tendency of humans to look at the top of the list first, the target display content and non-display content can be sorted, and the target display content can be arranged first, such as at the top of the list, and the non-display content can be arranged later, such as at the bottom of the list. In this way, the target display content can be displayed first, and if you want to see the non-display content, you may need to slide the display interface, thereby avoiding non-contact screen peeking.

[0094] Optionally, in the step of displaying the final display interface in the terminal device, real-time line of sight detection can be performed on the target person; if it is detected that the line of sight target of the target person is the terminal device, the final display interface is displayed in the terminal device after performing a mitigation operation.

[0095] In an embodiment of the present invention, in the privacy protection mode, if the target person's sight target is the terminal device, it means that the target person has the intention to see the target interface, that is, the target person wants to see the user's privacy. At this time, since the target person has already looked at the terminal device, if the target interface is directly replaced with the final display interface, it will appear too deliberate and affect the relationship between the user and the target person. In order to avoid the abruptness of directly replacing the target interface and make the display process of the final display interface more reasonable, a mitigation operation can be performed. After the mitigation operation is completed, the final display interface is displayed in the terminal device so that the target person can see what the user wants the target person to see.

[0096] The above-mentioned sight line detection can be implemented by using a deep learning model. The facial image of the target person is input into the deep learning model, and the sight line direction of the target person is output through the deep learning model. If the sight line direction is a terminal device, it can be determined that the sight line target of the target person is the terminal device. Specifically, sample facial images can be collected to construct a training data set. The sample facial images have labels corresponding to the sight line directions. The deep learning model is trained using the training data set to obtain a trained deep learning model. The facial image of the target person is input into the trained deep learning model, and the corresponding sight line direction is output through the trained deep learning model.

[0097] In a possible embodiment, the eye image of the target person may be captured by a camera of the smart terminal, the eye contour information of the target person may be extracted, and the sight direction of the target person may be determined according to the change of the contour.

[0098] In a possible embodiment, the eye image of the target person is captured by a camera of the smart terminal, and the features such as the iris and pupil are accurately identified and analyzed using an image processing algorithm to determine the line of sight direction.

[0099] In a possible embodiment, infrared rays can be used to illuminate the area outside the screen of the terminal device. If the infrared rays hit the eyeball, the infrared light will be reflected back. A red line can be used to illuminate the eyeball and capture the reflected light. The angle and position of the reflected light are analyzed to determine the line of sight of the target person.

[0100] Optionally, after executing the mitigation operation, in the step of displaying the final display interface in the terminal device, the state of the target interface can be modified to an inoperable state so that the user exits the software to which the target interface belongs; when the user re-enters the software to which the target interface belongs, the final display interface is displayed in the terminal device; or, the display interface of the terminal device is changed to a non-target interface; after the non-target interface ends, the final display interface is displayed in the terminal device.

[0101] In an embodiment of the present invention, the above-mentioned mitigation operation can be performed in two ways, among which, mitigation operation mode 1: if the target person enters the shooting range of the terminal device camera and the target person's eyes are captured looking directly at the terminal screen, if the target interface is displayed on the terminal device screen, in order to avoid embarrassment, the target interface or the software to which the target interface belongs can be controlled to be in a state where it cannot operate normally (no response to any operation). At this time, the user can control the software to which the target interface belongs to exit in front of the target person, and then re-enter the software to which the target interface belongs. When the software to which the target interface belongs is re-entered, the final display content will be displayed on the terminal setting screen.

[0102] Mitigation operation mode 2: If the target person enters the shooting range of the terminal device camera and the target person's eyes are captured looking directly at the terminal screen, if the terminal screen displays the target interface, the screen will be instantly turned off or an animation will be played (i.e., the non-target interface). When the screen is turned off or the animation is played, when the software to which the target interface belongs is re-entered, the final display content will be displayed on the terminal setting screen.

[0103] In this way, it can be avoided that the target person sees the hidden process after seeing the target interface, which can ease the embarrassment between the user and the target person, thereby improving the user experience.

[0104] like Figure 2 As shown, an embodiment of the present invention provides a privacy protection device, which includes:

[0105] The detection module 201 is used to detect a face image when the terminal device displays the target interface;

[0106] A matching module 202 is used for matching the face image of the target person in a relational database to obtain a target intimacy level of the target person if a face image of the target person is detected, wherein the target person is a non-user person of the terminal device, and the relational database includes a correspondence between the face image of the non-user person and the intimacy level;

[0107] The first processing module 203 is used to determine target display content and non-display content for the target person based on the target intimacy level, and different intimacy levels correspond to different display contents;

[0108] A second processing module 204 is used to determine the target display content and non-display content corresponding to the target intimacy level based on the correspondence between the intimacy level and the display content;

[0109] The display module 205 is used to display the final display interface in the terminal device.

[0110] Optionally, the device further comprises:

[0111] A first acquisition module, used to acquire historical social data of the user of the terminal device and the non-user person on the social software;

[0112] A third processing module is used to determine the intimacy level of the non-user person based on the historical social data; and to obtain a face image of the non-user person based on the user avatar information of the social software or the historical social data;

[0113] The fourth processing module is used to associate the facial image of the non-user person with the intimacy level of the non-user person to obtain the relationship database.

[0114] Optionally, the historical social data is historical chat data, and the third processing module is further used to determine the number of chats and / or chat content between the user and the non-user person based on the historical chat data; and determine the intimacy level of the non-user person based on the number of chats and / or the chat content.

[0115] Optionally, the third processing module is also used to obtain user avatar information of the non-user person on the social software, and determine whether the user avatar information is the non-user person's own avatar information; if the user avatar information is the non-user person's own avatar information, then based on the user avatar information, determine the non-user person's facial image; if the user avatar information is not the non-user person's own avatar information, then search for portrait information sent by the non-user person in the historical social data; based on the portrait information, determine the facial image of the non-user person.

[0116] Optionally, the second processing module 204 is further used to hide the non-display content to obtain a final display interface; or, in an order of the target display content first and the non-display content later, the target display content and the non-display content are sorted to obtain a final display interface.

[0117] Optionally, the display module 205 is also used to detect the line of sight of the target person; if it is detected that the line of sight of the target person is the terminal device, after performing a mitigation operation, the final display interface is displayed in the terminal device.

[0118] Optionally, the display module 205 is also used to modify the state of the target interface to an inoperable state so that the user exits the software to which the target interface belongs; when the user re-enters the software to which the target interface belongs, the final display interface is displayed in the terminal device; or, the display interface of the terminal device is changed to a non-target interface; after the non-target interface ends, the final display interface is displayed in the terminal device.

[0119] It should be noted that the privacy protection device provided in the embodiment of the present invention can be applied to devices such as smart phones, tablets, computers, servers, etc. that can perform the privacy protection method.

[0120] The privacy protection device provided in the embodiment of the present invention can implement each process implemented by the privacy protection method in the above method embodiment and can achieve the same beneficial effect. To avoid repetition, it will not be described here.

[0121] See also Figure 3 , Figure 3 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present invention, such as Figure 3 As shown, it includes: a memory 302, a processor 301, and a computer program of a privacy protection method stored in the memory 302 and executable on the processor 301, wherein:

[0122] The processor 301 is used to call the computer program stored in the memory 302 and execute the following steps:

[0123] When the terminal device displays the target interface, perform face image detection;

[0124] If a facial image of a target person is detected, the facial image of the target person is matched in a relational database to obtain a target intimacy level of the target person, wherein the target person is a non-user person of the terminal device, and the relational database includes a correspondence between the facial image of the non-user person and the intimacy level;

[0125] Based on the correspondence between the intimacy level and the display content, determining the target display content and non-display content corresponding to the target intimacy level;

[0126] Determining a final display interface based on the target display content and the non-display content, wherein the final display interface includes the target display content;

[0127] The final display interface is displayed in the terminal device.

[0128] Optionally, before the step of matching the facial image of the target person in a relational database to obtain the intimacy level of the target person, the method executed by the processor 301 further includes:

[0129] Acquiring historical social data of the user of the terminal device and the non-user person on the social software;

[0130] Determining an intimacy level of the non-user person based on the historical social data;

[0131] And, based on the user avatar information of the social software or the historical social data, obtaining the facial image of the non-user person;

[0132] The facial image of the non-user person is associated with the intimacy level of the non-user person to obtain the relationship database.

[0133] Optionally, the historical social data is historical chat data, and the step of determining the intimacy level of the non-user person based on the historical social data performed by the processor 301 includes:

[0134] Determining the number of chats and / or chat contents between the user and the non-user person based on the historical chat data;

[0135] Based on the number of chats and / or the chat content, determine the intimacy level of the non-user person.

[0136] Optionally, the step of acquiring the facial image of the non-user person based on the user avatar information on the social software or the historical social data performed by the processor 301 includes:

[0137] Obtaining user avatar information of the non-user person on the social software, and determining whether the user avatar information is the avatar information of the non-user person;

[0138] If the user portrait information is the portrait information of the non-user person, then determining the face image of the non-user person based on the user portrait information;

[0139] If the user avatar information is not the avatar information of the non-user person, searching for the avatar information sent by the non-user person in the historical social data;

[0140] Based on the portrait information, a facial image of the non-user person is determined.

[0141] Optionally, the step of determining the final display interface based on the target display content and the non-display content, performed by the processor 301, includes:

[0142] Hiding the non-display content to obtain a final display interface;

[0143] Alternatively, the target display content and the non-display content are sorted in such a manner that the target display content comes first and the non-display content comes last, thereby obtaining a final display interface.

[0144] Optionally, the step of displaying the final display interface in the terminal device performed by the processor 301 includes:

[0145] Performing real-time line of sight detection on the target person;

[0146] If it is detected that the sight target of the target person is the terminal device, then after performing a mitigation operation, the final display interface is displayed in the terminal device.

[0147] Optionally, the step of displaying the final display interface in the terminal device after performing the mitigation operation, performed by the processor 301, includes:

[0148] Modifying the state of the target interface to an inoperable state so that the user exits the software to which the target interface belongs;

[0149] When the user re-enters the software to which the target interface belongs, the final display interface is displayed on the terminal device;

[0150] Alternatively, changing the display interface of the terminal device to a non-target interface;

[0151] After the non-target interface ends, the final display interface is displayed on the terminal device.

[0152] It should be noted that the electronic device provided in the embodiment of the present invention can be applied to devices such as smart phones, tablets, computers, servers, etc. that can perform the privacy protection method.

[0153] The electronic device provided by the embodiment of the present invention can implement each process implemented by the privacy protection method in the above method embodiment and can achieve the same beneficial effect. To avoid repetition, it will not be described here.

[0154] An embodiment of the present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the privacy protection method provided by the embodiment of the present invention are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0155] A person skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The computer-readable storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM).

[0156] The above disclosure is only the preferred embodiment of the present invention, which certainly cannot be used to limit the scope of the present invention. Therefore, equivalent changes made according to the claims of the present invention are still within the scope of the present invention.

Claims

1. A privacy protection method, characterized in that: The method comprises the following steps: When the terminal device displays the target interface, perform face image detection; If a facial image of a target person is detected, the facial image of the target person is matched in a relational database to obtain a target intimacy level of the target person, wherein the target person is a non-user person of the terminal device, and the relational database includes a correspondence between the facial image of the non-user person and the intimacy level; Based on the correspondence between the intimacy level and the display content, determining the target display content and non-display content corresponding to the target intimacy level; Determining a final display interface based on the target display content and the non-display content, wherein the final display interface includes the target display content; The final display interface is displayed in the terminal device.

2. The privacy protection method according to claim 1, characterized in that: Before the step of matching the face image of the target person in a relational database to obtain the intimacy level of the target person, the method further includes: Acquiring historical social data of the user of the terminal device and the non-user person on the social software; Determining an intimacy level of the non-user person based on the historical social data; And, based on the user avatar information of the social software or the historical social data, obtaining the facial image of the non-user person; The facial image of the non-user person is associated with the intimacy level of the non-user person to obtain the relationship database.

3. The privacy protection method according to claim 2, characterized in that: The historical social data is historical chat data, and the step of determining the intimacy level of the non-user person based on the historical social data includes: Determining the number of chats and / or chat contents between the user and the non-user person based on the historical chat data; Based on the number of chats and / or the chat content, determine the intimacy level of the non-user person.

4. The privacy protection method according to claim 2, characterized in that: The step of acquiring the facial image of the non-user person based on the user avatar information on the social software or the historical social data comprises: Obtaining user avatar information of the non-user person on the social software, and determining whether the user avatar information is the avatar information of the non-user person; If the user portrait information is the portrait information of the non-user person, then determining the face image of the non-user person based on the user portrait information; If the user avatar information is not the avatar information of the non-user person, searching for the avatar information sent by the non-user person in the historical social data; Based on the portrait information, a facial image of the non-user person is determined.

5. The privacy protection method according to any one of claims 1 to 4, characterized in that: The step of determining a final display interface based on the target display content and the non-display content includes: Hiding the non-display content in the target interface to obtain a final display interface; Alternatively, the target display content and the non-display content are sorted in the target interface in the order of the target display content first and the non-display content later to obtain a final display interface.

6. The privacy protection method according to any one of claims 1 to 4, characterized in that: The step of displaying the final display interface in the terminal device includes: Performing real-time line of sight detection on the target person; If it is detected that the sight target of the target person is the terminal device, then after performing a mitigation operation, the final display interface is displayed in the terminal device.

7. The privacy protection method according to claim 6, characterized in that: After performing the mitigation operation, the step of displaying the final display interface in the terminal device includes: Modifying the state of the target interface to an inoperable state so that the user exits the software to which the target interface belongs; When the user re-enters the software to which the target interface belongs, the final display interface is displayed on the terminal device; Alternatively, changing the display interface of the terminal device to a non-target interface; After the non-target interface ends, the final display interface is displayed on the terminal device.

8. A privacy protection device, characterized in that: The privacy protection device comprises: A detection module is used to detect a face image when the terminal device displays the target interface; A matching module, for matching the face image of a target person in a relational database to obtain a target intimacy level of the target person if a face image of the target person is detected, wherein the target person is a non-user person of the terminal device, and the relational database includes a correspondence between the face image of the non-user person and the intimacy level; A first processing module, configured to determine target display content and non-display content corresponding to the target intimacy level based on the correspondence between the intimacy level and the display content; A second processing module, configured to determine a final display interface based on the target display content and the non-display content, wherein the final display interface includes the target display content; A display module is used to display the final display interface in the terminal device.

9. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps in the privacy protection method according to any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the privacy protection method according to any one of claims 1 to 7 are implemented.

Images