A method and apparatus for protecting terminal information
By periodically obtaining facial features in front of the terminal and displaying privacy applications or information only under preset conditions, the privacy data leakage problem of mobile terminals in the unlocked state of the bright screen is solved, and effective privacy protection and power management are achieved.
Patent Information
- Application Number
- CN201910882900.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-09-18
- Publication Date
- 2025-07-11
- Estimated Expiration
- 2039-09-18
AI Technical Summary
When the mobile terminal is in a light screen and unlocked state, the privacy data faces the risk of being operated or peeped by users other than the owner, resulting in privacy data leakage and property damage.
By periodically obtaining facial features in front of the terminal, identifying facial features and number of characters, only displaying privacy applications or information when preset conditions match. Otherwise, lock protection will be added to avoid detailed facial recognition and reduce the terminal's workload.
Effectively protect privacy data, reduce terminal power consumption, remind users of the risk of peeping, prevent private information leakage, and improve user experience.
Smart Images

Figure CN112528314B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of mobile terminals, and in particular, to a method and device for protecting terminal information. Background Art
[0002] Mobile terminals such as mobile phones have become essential electronic products in people's lives. Due to the personal privacy and mobility attributes of mobile phones, many users like to implant important information into mobile phones.
[0003] When a user is using a mobile terminal, once the mobile terminal is operated by a user other than the owner, or when the owner is viewing important information and is peeked at by other people around, the privacy data of the owner is at risk of leakage, which will seriously affect the security of the privacy data. If important information is peeked at and stolen, property losses will also occur. Summary of the Invention
[0004] In order to overcome the above problems, embodiments of the present application provide a method and device for protecting terminal information.
[0005] To achieve the above object, embodiments of the present application adopt the following technical solutions: In a first aspect, the present application provides a method for protecting terminal information. The method can be executed when the terminal is in a lit screen and unlocked state, and includes: displaying a running interface of a first application; when the running interface of the first application is displayed, obtaining a first image; determining a human face feature according to the first image; when the human face feature matches a preset condition, displaying the running interface of the first application; when the human face feature does not match the preset condition, displaying a second display interface, and the second display interface does not include the running interface of the first application. The present application periodically obtains the face features in the front area of the terminal. If the face features change before the privacy application is opened, that is, there is a change in the person in front of the terminal. When the user wants to open the privacy application, the privacy application is locked and protected at this time, and the user needs to unlock it to enter. This not only reminds the user that someone is peeking at the privacy application in the terminal, but also protects the privacy application.
[0006] In another possible implementation, the obtaining of the first image includes: obtaining an image in the directly front area of the terminal through a camera.
[0007] In another possible implementation, the face facial features include: the facial features of a person and the number of people. Determining the face facial features according to the first image includes: identifying the facial features of the person and the number of people in the image according to the acquired image; wherein, according to the differences in the facial features and the number of people, it is determined whether the face facial features match the preset conditions. This application only needs to obtain the facial feature and the number of people information, and does not need to obtain detailed facial feature information like facial recognition unlocking, which can protect the privacy of other people around. At the same time, it avoids the need for the terminal to use artificial intelligence to identify facial feature information, thereby reducing the workload of the terminal.
[0008] In another possible implementation, the second display interface further includes authentication information. So that after the user determines whether someone is peeping, they can verify again to enter the privacy application.
[0009] In another possible implementation, the authentication information is at least used to indicate face authentication or unlock authentication.
[0010] In a second aspect, the present application provides a terminal information protection device, including: a transceiver, a processor, and a memory; the memory stores one or more programs, and the one or more programs include instructions that, when executed by the device, cause the device to execute the method of any possible implementation example in the first aspect.
[0011] In a third aspect, the present application provides a terminal information protection method, which can be executed when the terminal is in the screen-on and unlocked state, including: receiving a first message; acquiring a first image; determining face facial features according to the first image; when the face facial features match the preset conditions, displaying the content of the first message; when the face facial features do not match the preset conditions, displaying a first prompt message, and the first prompt message is used to prompt that the first message has been received, and the first prompt message does not include the content of the first message. In the present application, when the application exits or is pushed into the background, etc., when a message is received, by periodically acquiring the facial features in the front area of the terminal, if it is detected that the facial features acquired continuously twice have changed, the privacy information displayed on the current interface is locked and protected, which not only reminds the user that someone is peeping at the privacy information in the terminal, but also protects the privacy information or privacy application.
[0012] In another possible implementation, the first message is a message that meets the preset conditions.
[0013] In another possible implementation, acquiring the first image includes: acquiring an image in the directly front area of the terminal through a camera.
[0014] In another possible implementation, the face facial features include: the facial features of a person and the number of people,
[0015] Determine the facial features of a human face based on the first image, including: based on the acquired image, identify the facial features and the number of people in the image; wherein, based on the differences in the facial features and the number of people, determine whether the facial features of the human face match the preset conditions.
[0016] This application only needs to obtain facial feature and number-of-people information, without the need to obtain detailed facial feature information like facial recognition for unlocking, which can protect the privacy of other people around. At the same time, it avoids the need for the terminal to use artificial intelligence to identify facial feature information, thereby reducing the workload of the terminal.
[0017] In another possible implementation, when the facial features of the human face do not match the preset conditions, display a first prompt message, and further include: when the first prompt message is displayed, obtain a second image; when the facial features of the human face in the second image match the preset conditions, display the content of the first message.
[0018] In the subsequent image acquisition of this application, if it is detected that the image matches the preset conditions, the user can view the content of the privacy information without the need for the user to open the application again to read the privacy information later.
[0019] In another possible implementation, when the facial features of the human face do not match the preset conditions, display a first prompt message, and further include: display the content of the first message according to a preset input instruction acting on the prompt message. After the terminal receives the operation instruction of the user on the prompt message display interface, directly display the content of the privacy information to facilitate the user to directly read the content of the privacy information on the current interface.
[0020] In a fourth aspect, this application provides a terminal information protection device, including: a transceiver, a processor, and a memory; the memory stores one or more programs, and the one or more programs include instructions that, when executed by the device, cause the device to execute the method of any possible implementation example in the third aspect.
[0021] Fifth aspect, the present application provides a method for protecting terminal information. The method can be executed when the terminal is in the screen-on and unlocked state, and includes: presenting a gallery preview interface; when presenting the gallery preview interface, obtaining a first image; determining a face feature based on the first image; when the face feature matches a preset condition, presenting a first gallery preview interface, where the first gallery preview interface includes a preset picture; when the face feature does not match the preset condition, presenting a second gallery preview interface, where the second gallery preview interface does not include the preset picture. When the present application opens the photo album or views private pictures, by periodically obtaining the face features in the area in front of the terminal, if it is detected that the face features obtained continuously twice have changed, the private information displayed on the current interface is locked and protected, which not only reminds the user that someone is peeping at the private information in the terminal, but also protects the private information.
[0022] In another possible implementation, the preset picture is a picture that meets the preset condition.
[0023] In another possible implementation, the obtaining of the first image includes: obtaining an image in the area directly in front of the terminal through a camera.
[0024] In another possible implementation, the face feature includes: the face feature of a person and the number of people. Determining the face feature based on the first image includes: identifying the face feature and the number of people in the image according to the obtained image; wherein, according to the differences in the face feature and the number of people, it is determined whether the face feature matches the preset condition. The present application only needs to obtain the face feature and the number of people information, and does not need to obtain detailed face feature information like face recognition unlocking, which can protect the privacy of other people around. At the same time, it avoids the terminal from needing to perform artificial intelligence to identify face feature information, thereby reducing the workload of the terminal.
[0025] In another possible implementation, the second gallery preview interface includes other pictures except the preset picture.
[0026] In another possible implementation, when the face feature matches the preset condition and the first gallery preview interface is presented, it further includes: when presenting the first gallery preview interface, obtaining a second image; when the face feature in the second image does not match the preset condition, presenting the second gallery preview interface. In the subsequent image obtaining of the present application, if it is detected that the image does not match the preset condition, it indicates that someone is peeping in front of the terminal at this time, and the terminal hides the preset picture so that the preset picture is not displayed on the screen, protecting the preset picture.
[0027] Sixth aspect, the present application provides a terminal information protection device, including: a transceiver, a processor, and a memory; the memory stores one or more programs, and the one or more programs include instructions that, when executed by the device, cause the device to execute the method according to any possible implementation example in the fifth aspect.
[0028] Seventh aspect, the present application provides a terminal information protection method, which can be executed when the terminal is in the screen-on and unlocked state, including: presenting a first display interface, and the first display interface includes a payment interface; when presenting the first display interface, obtaining a first image; determining a human face feature according to the first image; when the human face feature matches a preset condition, presenting the payment interface; when the human face feature does not match the preset condition, presenting a second display interface, and the second display interface does not include the payment interface. When the present application is on the payment page, by periodically obtaining the facial features in the area in front of the terminal, if it is detected that the facial features obtained continuously twice change, the privacy information displayed on the current interface is locked and protected, which not only reminds the user that someone is peeping at the privacy information in the terminal, but also protects the privacy information.
[0029] In another possible implementation, the obtaining the first image includes: obtaining an image in the area directly in front of the terminal through a camera.
[0030] In another possible implementation, the human face feature includes: the human face feature of a person and the number of people. Determining the human face feature according to the first image includes: identifying the human face feature and the number of people in the image according to the obtained image; wherein, according to the differences in the human face feature and the number of people, it is determined whether the human face feature matches the preset condition. The present application only needs to obtain the human face feature and the number of people information, and does not need to obtain detailed human face feature information like facial recognition unlocking, which can protect the privacy of other people around. At the same time, it avoids the terminal needing to perform artificial intelligence to identify human face feature information, thereby reducing the workload of the terminal.
[0031] In another possible implementation, the payment interface at least includes a payment QR code or a password input interface.
[0032] In another possible implementation, the second display interface is an interface obtained by blurring the payment interface.
[0033] In another possible implementation, the second display interface includes a second prompt message; wherein, the second prompt message is used to prompt the user that there is a peeper.
[0034] In an eighth aspect, the present application provides a terminal information protection device, including: a transceiver, a processor, and a memory; the memory stores one or more programs, and the one or more programs include instructions that, when executed by the device, cause the device to execute the method according to any possible implementation example in the seventh aspect.
[0035] In a ninth aspect, the present application provides a readable storage medium for storing instructions that, when executed, cause any possible implementation example in the first aspect, or any possible implementation example in the third aspect, or any possible implementation example in the fifth aspect, or any possible implementation example in the seventh aspect to be implemented.
[0036] In a tenth aspect, the present application provides a computer program device containing instructions that, when running on a terminal, cause the terminal to execute any possible implementation example in the first aspect, or any possible implementation example in the third aspect, or any possible implementation example in the fifth aspect, or any possible implementation example in the seventh aspect.
[0037] In a tenth aspect, the present application provides an electronic device, including: a display, a transceiver, a processor, and a memory. When the electronic device unlocks and enters a privacy application, the display is configured to display the running interface of the privacy application; the transceiver is configured to periodically obtain a first image within the area directly in front of the terminal when the electronic device is in an unlocked state; the processor is configured to identify the facial features of a face in the first image, and when the facial features of the face match a preset condition stored in the memory, control the display to display the running interface of the privacy application; when the facial features of the face do not match the preset condition, control the display to display a display interface that does not include the privacy application; when the electronic device unlocks and enters an application and then exits or is pushed into the background, and a privacy message is received, the display is configured to display the content or a prompt message of the privacy message; the transceiver is configured to periodically obtain a second image within the area directly in front of the terminal when the electronic device is in an unlocked state; the processor is configured to identify the facial features of a face in the second image, and when the facial features of the face match the preset condition stored in the memory, control the display to display the content of the privacy message; when the facial features of the face do not match the preset condition, control the display to display a prompt message of the privacy message, where the prompt message is used to prompt that the privacy message has been received, and the prompt message does not include the content of the privacy message; when the electronic device unlocks and enters the photo album or views privacy pictures, the display is configured to present a gallery preview interface; the transceiver is configured to periodically obtain a third image within the area directly in front of the terminal when the electronic device is in an unlocked state; the processor is configured to identify the facial features of a face in the third image, and when the facial features of the face match the preset condition stored in the memory, control the display to present a gallery preview interface including preset pictures; when the facial features of the face do not match the preset condition, control the display to present a gallery preview interface that does not include the preset pictures; when the electronic device unlocks and enters a payment page, the display is configured to present a display interface including a payment interface; the transceiver is configured to periodically obtain a fourth image within the area directly in front of the terminal when the electronic device is in an unlocked state; the processor is configured to identify the facial features of a face in the fourth image, and when the facial features of the face match the preset condition stored in the memory, control the display to present the payment interface; when the facial features of the face do not match the preset condition, control the display to present a display interface that does not include the payment interface. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] The following briefly introduces the drawings required for the description of the embodiments or the prior art.
[0039] Figure 1 It is a flowchart of the first terminal information protection method provided by the embodiment of the present application;
[0040] Figure 2A schematic diagram for protecting a privacy application or privacy information when it is opened again in an embodiment of the present application;
[0041] Figure 3 A flowchart of a second terminal information protection method provided in an embodiment of the present application;
[0042] Figure 4 A schematic diagram for protecting privacy information when it pops up on the current interface after a privacy application exits or is pushed into the background in an embodiment of the present application;
[0043] Figure 5 A flowchart of a third terminal information protection method provided in an embodiment of the present application;
[0044] Figure 6 A schematic diagram for protecting a privacy application when it is displayed on the current interface in an embodiment of the present application;
[0045] Figure 7 A flowchart of a fourth terminal information protection method provided in an embodiment of the present application;
[0046] Figure 8 A schematic diagram for protecting privacy information when it is displayed on the current interface in an embodiment of the present application;
[0047] Figure 9 A schematic diagram of the structure of a first terminal information protection device provided in an embodiment of the present application;
[0048] Figure 10 A schematic diagram of the structure of a second terminal information protection device provided in an embodiment of the present application;
[0049] Figure 11 A schematic diagram of the structure of a third terminal information protection device provided in an embodiment of the present application;
[0050] Figure 12 A schematic diagram of the structure of a fourth terminal information protection device provided in an embodiment of the present application;
[0051] Figure 13 A schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Detailed implementation manners
[0052] Next, the technical solutions in the embodiments of the present application will be described with reference to the accompanying drawings in the embodiments of the present application.
[0053] Figure 1 A flowchart of a first terminal information protection method provided in an embodiment of the present application. As Figure 1 shown, the terminal information protection method provided by the present application can be executed when the terminal is in the screen-on and unlocked state. The specific implementation steps are as follows:
[0054] Step S101, display the running interface of the first application.
[0055] Among them, the first application is a privacy application that the user needs to protect privacy, and it can be daily application programs such as WeChat, Alipay, email, etc. When the end user deems some application programs important, lock them, and only when unlocked can the user read privacy information or operate the privacy application. Among them, the unlocking methods include but are not limited to the currently commonly used fingerprint unlocking, face recognition unlocking, password unlocking, etc.
[0056] After the terminal is powered on through a secure unlocking method, when the user first opens the privacy application, the privacy application may not be locked at this time, and the user can directly open the privacy application. The reason for the privacy application not being locked at this time is based on the secure startup of the terminal. If the terminal is powered on through an illegal unlocking method, the privacy application is locked at this time to prevent the privacy application from being viewed or operated by others. Of course, the user can set that when the terminal is unlocked through a highly secure encryption method such as fingerprint recognition unlocking or face recognition unlocking, the privacy application is not locked when opened.
[0057] It should be noted that the "first opening" here does not necessarily mean the first time the privacy application is opened after the terminal is powered on. When the privacy application needs to be unlocked by the user when it is opened for the second time after power on, the terminal abandons the previously obtained facial features at this time, and takes the facial features obtained when the privacy application is opened for the second time as the first obtained facial features. Therefore, each time the user needs to unlock and enter the privacy application is redefined as the first time to open the privacy application. Similarly, when the terminal is turned off the screen or the screen is locked, after the screen is lit again and the terminal is powered on through a secure unlocking method, the facial features obtained when the privacy application is opened for the first time are taken as the first obtained facial features.
[0058] Step S103, when the running interface of the first application is displayed, obtain the first image.
[0059] Step S105, determine the facial features of the human face according to the first image.
[0060] After the privacy application is opened for the first time, the terminal may still be in the state of the screen being lit and unlocked. When face authentication is required, the terminal activates the front camera to detect a certain area directly in front of the terminal, and then recognizes the facial features in the photo to obtain the facial features of each person in the photo and the number of people. Among them, the facial features here can be to obtain partial facial features, such as partial features of eyes, nose, etc., and do not need to obtain detailed facial feature information like face recognition unlocking, which can protect the privacy of other people around. At the same time, it avoids the terminal needing to use artificial intelligence to recognize facial feature information, thereby reducing the workload of the terminal.
[0061] Among them, the range of the area directly in front of the terminal obtained by the front camera is not limited. Through multiple experiments by technicians, according to the maximum distance and maximum angle of human beings watching the screen, the camera in the embodiment of the present application obtains the best facial features within a range of 1.5 m from the camera and within an area where the FOV angle ranges from 120 degrees to 160 degrees at most. For people not within this area, it can be considered that they cannot clearly see the content on the screen, so there is no need to obtain the facial features of people not within this area.
[0062] When the terminal is in the screen-off state or the screen is locked, the camera can refrain from detecting a certain area directly in front of the terminal. This can reduce the power consumption of the terminal in the screen-off or screen-locked state.
[0063] In a possible embodiment, the facial features obtained by the camera are the features of the human eyes and the features around the eyes. Considering that when the user is using the terminal, there are relatively many people in the surrounding environment, or in specific scenarios such as a crowded subway or meeting room, most people at this time will not peek at the information on the user's terminal. If the facial features of the person are still obtained, when the user views or operates a privacy application, the terminal will always lock it, thus affecting the user experience.
[0064] After the user opens a privacy application, the terminal can continuously detect a certain area directly in front of the terminal periodically at a certain frequency, thereby reducing the power consumption of the terminal. Among them, different frequencies are set according to different situations. For example, when in a daytime environment, the camera takes a photo every 360 ms; when in a nighttime environment, the camera takes a photo every 3 - 4 s, and so on.
[0065] In addition, after the user exits the privacy application or pushes the privacy application into the background, the terminal is still in the screen-on and unlocked state at this time. In a possible embodiment, the camera stops taking photos. After the privacy application exits or is pushed into the background, the privacy application is not displayed on the terminal screen, so there is no need for the camera to continue taking photos. When it is opened again later, the camera is started to take photos, which can reduce the power consumption of the terminal.
[0066] In a possible embodiment, the change of facial features can be monitored periodically by the camera. The purpose of this is to determine whether the facial features within a certain area directly in front of the terminal have changed when the privacy application receives a message after the privacy application exits or is pushed into the background. If there is no change, the privacy application directly pops up the message. If there is a change, the privacy application notifies the user that there is a message received. This avoids the message received from being peeked at after the privacy application exits or is pushed into the background.
[0067] Step S107, when the facial features match the preset conditions, display the running interface of the first application.
[0068] Step S109: When the facial features of the human face do not match the preset conditions, display a second display interface.
[0069] When the user exits the privacy application or pushes the privacy application into the background and then opens the privacy application again, since the camera has been periodically detecting a certain area in front of the terminal, the terminal recognizes the facial features in the photo obtained when the privacy application is opened again.
[0070] In a possible embodiment, the terminal compares the facial features in the photo obtained when the privacy application is opened again with the facial features obtained last time when the privacy application was opened for the first time. Since the privacy application was opened for the first time based on the security of the terminal, the facial features obtained for the first time are the facial features of the terminal owner, or may also include the facial features of a bystander approved by the terminal owner to view the privacy application. Therefore, it is relatively safe to compare the facial features in the photo obtained when the privacy application is opened again with the facial features obtained last time when the privacy application was opened for the first time. The preset condition at this time is the facial features obtained last time when the privacy application was opened for the first time.
[0071] In a possible embodiment, the terminal compares the facial features in the photo obtained when the privacy application is opened again with the facial features in the photo obtained last time. Since the terminal has been periodically detecting a certain area in front of it and then recognizing the facial features, as long as the facial features in any two consecutive photos change, the terminal will lock the privacy application. Therefore, the facial features obtained each time from the first time the facial features were obtained to the photo obtained when the privacy application is opened again have not changed. If there is a change, the terminal will have locked the privacy application before the photo obtained when the privacy application is opened again. Therefore, it is relatively safe to compare the facial features in the photo obtained when the privacy application is opened again with the facial features obtained last time. The preset condition at this time is the facial features in the photo obtained last time before the photo obtained when the privacy application is opened again.
[0072] When the user opens the privacy application again, the terminal will compare the facial features in the photo obtained when the privacy application is opened again with the facial features obtained last time. In a possible embodiment, the terminal identifies the facial features and the number of people in the two photos, and then compares whether the facial features and the number of people in the two photos are the same. In another possible embodiment, the terminal identifies the eye features and the number of eyes of the people in the two photos, and then compares whether the eye features and the number of eyes of the people in the two photos are the same.
[0073] When it is determined that the facial features obtained twice are the same, the user can directly open the privacy application. This indicates that there is no one peeping within a certain area in front of the terminal. When the facial features obtained twice are different, it indicates that someone is peeping at the terminal screen within a certain area in front of the terminal. The terminal will activate the security protection function to lock the privacy application, making it impossible to view or operate the privacy application on the terminal screen.
[0074] Among them, the ways to lock the privacy application include, but are not limited to, hiding the privacy application from the current interface, blurring the privacy application and then displaying it on the current interface, and displaying the identifier of the privacy application on the current interface, etc.
[0075] In this application, by periodically obtaining the facial features within the area in front of the terminal, if the facial features change before the privacy application is opened, that is, there is a change in the people in front of the terminal. When the user wants to open the privacy application, at this time the privacy application is locked and protected, and the user needs to unlock it to enter. This not only reminds the user that someone is peeping at the privacy application in the terminal, but also protects the privacy application.
[0076] To better facilitate the understanding of the above technical solution, the above technical solution will be described through an embodiment below.
[0077] Figure 2 It is a schematic diagram for protecting the privacy application or privacy information when it is opened again provided by the embodiment of this application. As Figure 2 shown, the implementation process of this scenario is as follows (the following takes WeChat as an example of the privacy application for illustration):
[0078] The first step: The user selects the application program as the privacy application.
[0079] In the embodiment of this application, the user believes that the chat information in WeChat is private and does not want to be known by others. Therefore, it is necessary to set WeChat so that it can only be opened when the user uses the terminal by himself. The user adds WeChat to the application lock. After WeChat is locked, it can only be used after unlocking.
[0080] The second step: After the terminal is unlocked, enter the privacy application.
[0081] After the user enters the terminal through fingerprint recognition, facial recognition, password input, etc., in one case, the user can directly open the privacy application. The reason why the privacy application is not locked at this time is based on the secure startup of the terminal.
[0082] In another case, the user needs to unlock the device to access WeChat. Considering that the person unlocking the device may not be the owner of the device, when using WeChat, the owner of the device needs to unlock it to open WeChat. At this time, the method of unlocking WeChat is different from the method of unlocking the device. If the same unlocking method is used for both WeChat and the device, after unlocking the device, the user can directly unlock WeChat.
[0083] After the privacy application is opened for the first time, the device activates the front camera to detect a certain area in front of the device, identify the facial features in the photo, and obtain the face features and the number of people of each person in the photo. Then the device continuously detects a certain area in front of the device periodically at a certain frequency.
[0084] Step 3: Exit the privacy application or push the privacy application to the background.
[0085] When the user exits WeChat when not needed or pushes WeChat to the background when using other applications, the device may still be in the screen-on and unlocked state. In one case, the subsequent camera stops taking pictures. Because after the privacy application is exited or pushed to the background, the device screen does not display the privacy application, so there is no need for the camera to continue taking pictures. When it is opened again later, the camera is activated to take pictures, which can reduce the power consumption of the device.
[0086] In another case, the subsequent camera continues to take pictures. The purpose of this is to determine whether the facial features in a certain area in front of the device have changed when the privacy application receives a message after the privacy application is exited or pushed to the background. If there is no change, the privacy application directly pops up the message. If there is a change, the privacy application notifies the user that there is a message received. This avoids the received message being peeked at after the privacy application is exited or pushed to the background.
[0087] Step 4: The user opens the privacy application again.
[0088] When the user opens WeChat again, the device obtains the facial features in a certain area in front of the device when opening WeChat, and then compares them with the facial features obtained last time. Among them, the facial features obtained last time can refer to the facial features obtained last when the privacy application was opened for the first time, or can refer to the facial features obtained previously when the privacy application was opened again.
[0089] There are three possible situations based on the comparison results of the facial features obtained by taking pictures twice: First, there is still only the device owner in a certain area in front of the device; Second, someone else appears in a certain area in front of the device; Third, in addition to the device owner, there are other people in a certain area in front of the device.
[0090] Step 5: The terminal determines whether to activate the security protection function based on whether the facial features obtained twice have changed.
[0091] When the facial features obtained twice are compared and found to be unchanged (corresponding to the first case in Step 4), the terminal does not activate the security protection function, and the user can directly open WeChat. When the facial features obtained twice are compared and found to have changed (corresponding to the second and third cases in Step 4), the terminal activates the security protection function at this time, locks WeChat, and the user cannot open WeChat at this time. The terminal displays an identifier that requires the user to unlock on the interface where the user clicks to open WeChat.
[0092] Figure 3 It is a flowchart of the second terminal information protection method provided by the embodiment of the present application. As Figure 3 shown, the terminal information protection method provided by the present application can be executed when the terminal is in the screen-on and unlocked state. The specific implementation steps are as follows:
[0093] Step S301: Receive the first message.
[0094] Among them, the first message is the privacy information that the user needs to protect, which can be important information such as files considered important by the terminal user, content displayed in application programs, and favorite pictures. When the terminal user deems some information important, it is locked, and the privacy information can only be read after unlocking. The unlocking methods include, but are not limited to, fingerprint unlocking, facial recognition unlocking, password unlocking, etc. commonly used in daily life.
[0095] In cases such as when the application program exits or is pushed into the background, when the terminal or the application program receives a message, it determines whether the facial features within a certain area directly in front of the terminal have changed. If there is no change, the privacy application directly pops up the content of the message. If there is a change, the terminal or the application program notifies the user that a message has been received. This avoids the received message being peeked at in cases such as when the application program exits or is pushed into the background. Among them, after the user exits the privacy application or pushes the privacy application into the background, the terminal can still be in the screen-on and unlocked state at this time.
[0096] Step S303: Obtain the first image.
[0097] Step S305: Determine the facial features based on the first image.
[0098] In cases such as when the application program exits or is pushed into the background, the terminal still activates the front camera to detect a certain area directly in front of the terminal.
[0099] After receiving a message, face authentication is required. The terminal activates the front camera to detect a certain area directly in front of the terminal, and then identifies the facial features in the photo to obtain the facial features of each person in the photo and the number of people. Here, the facial features can be partial facial features, such as partial features like eyes and nose, without the need to obtain detailed facial feature information as in facial recognition for unlocking, which can protect the privacy of others around. At the same time, it avoids the terminal needing to use artificial intelligence to identify facial feature information, thus reducing the workload of the terminal.
[0100] If the terminal is in the screen-off state or the screen is locked, the camera can refrain from detecting a certain area directly in front of the terminal. This can reduce the power consumption of the terminal in the screen-off or screen-locked state.
[0101] In a possible embodiment, the facial features obtained by the camera are the eye features of the person and the features around the eyes. Considering that when the user is using the terminal, in an environment with a large flow of people or in specific scenarios such as a crowded subway or meeting room, most people at this time will not peek at the information on the user's terminal. If the facial features of the person are still obtained, when the user views or operates a privacy application, the terminal will keep locking it, thus affecting the user experience.
[0102] Step S307, when the facial features match the preset conditions, display the content of the first message.
[0103] Step S309, when the facial features do not match the preset conditions, display the first prompt message.
[0104] When the application exits or is pushed into the background, etc., when receiving a message, since the camera has been periodically detecting a certain area directly in front of the terminal, the terminal identifies the facial features in the photo obtained when receiving the message.
[0105] When receiving a message, the terminal compares the facial features in the photo obtained when receiving the message with the facial features obtained last time. In a possible embodiment, the terminal identifies the facial features of the people and the number of people in the two photos, and then compares whether the facial features and the number of people in the two photos are the same. In another possible embodiment, the terminal identifies the eye features and the number of eyes of the people in the two photos, and then compares whether the eye features and the number of eyes in the two photos are the same.
[0106] When it is determined that the facial features obtained twice are the same, the terminal or application directly pops up the content of the message. This indicates that there is no one peeping within a certain area directly in front of the terminal. When the facial features obtained twice are different, this indicates that someone is peeping at the terminal screen within a certain area directly in front of the terminal, and the terminal will activate the security protection function and display a prompt message on the display screen to remind the user that there is a message received.
[0107] Among them, the ways to lock the privacy information include, but are not limited to, hiding the privacy information from the current interface, displaying the privacy information on the current interface after blurring it, and displaying a reminder message of the privacy information on the current interface, etc.
[0108] In a possible embodiment, when the prompt message of the privacy information is displayed on the terminal interface, the terminal can receive the instruction generated by the user's operation on the screen. After receiving the instruction input by the user, it directly displays the content of the privacy information to facilitate the user to directly read the content of the privacy information on the current interface.
[0109] In this application, when the application exits or is pushed into the background, etc., when receiving a message, by periodically obtaining the facial features in the area in front of the terminal, if it is detected that the facial features obtained continuously twice have changed, the privacy information displayed on the current interface is locked and protected, which not only reminds the user that someone is peeping at the privacy information in the terminal, but also protects the privacy information or privacy application at the same time.
[0110] To better facilitate the understanding of the above technical solution, the above technical solution will be described through an embodiment below.
[0111] Figure 4 It is a schematic diagram for protecting privacy information when it pops up on the current interface after a privacy application exits or is pushed into the background provided by the embodiment of this application. As Figure 4 shown, the implementation process of this scenario is as follows (the following takes the message received by WeChat as an example of privacy information for illustration):
[0112] When the user needs to use the video APP application, push WeChat into the background, and then the camera has been periodically detecting a certain area directly in front of the terminal to obtain the facial features within a certain area directly in front of the terminal when the video APP application is opened.
[0113] If the facial features within a certain area directly in front of the terminal remain unchanged before a message is received on WeChat, the terminal will directly pop up the detailed content of the received message on the current interface; if the facial features within a certain area directly in front of the terminal change (become a situation where there is no one in front of the terminal (not shown in the figure), a situation of a person change, or a situation of a person coming) before a message is received on WeChat, the terminal will directly pop up the title of the received message on the current interface to remind the owner of the device. This avoids the received message being peeked at after the privacy application exits or is pushed to the background.
[0114] Figure 5 This is a flowchart of the third terminal information protection method provided by the embodiments of the present application. As Figure 5 shown, the terminal information protection method provided by the present application can be executed when the terminal is in the screen-on and unlocked state. The specific implementation steps are as follows:
[0115] Step S501, present a gallery preview interface.
[0116] Among them, when the terminal user believes that some pictures in the album are relatively important, the terminal user groups these pictures into a privacy group and locks it. Only when it is unlocked can the privacy group be viewed.
[0117] Step S503, when presenting the gallery preview interface, obtain a first image.
[0118] Step S505, determine the facial features of the face according to the first image.
[0119] After the terminal user opens the album, face authentication is required. The terminal activates the front camera to detect a certain area directly in front of the terminal, and then recognizes the facial features in the photo to obtain the facial features of each person in the photo and the number of people. Among them, the facial features here can be to obtain partial facial features, such as partial features of eyes, nose, etc., without the need to obtain detailed facial feature information like facial recognition for unlocking, which can protect the privacy of other people around. At the same time, it avoids the terminal needing to use artificial intelligence to identify facial feature information, thereby reducing the workload of the terminal.
[0120] If the terminal is in the screen-off or screen-locked state, the camera can not detect a certain area directly in front of the terminal. This can reduce the power consumption of the terminal in the screen-off or screen-locked state.
[0121] In a possible embodiment, the face features obtained by the camera are the features of the human eyes and the features around the eyes. Considering that when the user uses the terminal, there is a large flow of people in the environment where the user is located, or in specific scenarios such as a crowded subway or meeting room, most people at this time will not peek at the information on the user's terminal. If the facial features of the person are still obtained, when the user views or operates a privacy application, the terminal will always lock it, thus affecting the user experience.
[0122] Step S507, when the facial features match the preset conditions, present the first gallery preview interface.
[0123] Step S509, when the facial features do not match the preset conditions, present the second gallery preview interface.
[0124] Since the camera is always periodically detecting a certain area directly in front, and then identifying the facial features, as long as the facial features in any two consecutive photos change, the terminal will lock the privacy information. Therefore, starting from the second time the terminal obtains the facial features, each time it compares with the facial features obtained last time.
[0125] Among them, the terminal can identify the facial features and the number of people in the two photos, and then compare whether the facial features and the number of people in the two photos are the same; it can identify the eye features and the number of eyes of the people in the two photos, and then compare whether the eye features and the number of eyes in the two photos are the same.
[0126] When it is determined that the facial features obtained continuously twice are the same, the user can directly open the privacy group or continuously view the pictures in the privacy group. At this time, it indicates that there is no one peeking in a certain area directly in front of the terminal. When the facial features obtained continuously twice are different, at this time, it indicates that there is someone peeking at the terminal screen in a certain area directly in front of the terminal, and the terminal will activate the security protection function to hide the privacy group, so that the privacy group cannot be viewed on the terminal screen.
[0127] Among them, the ways to lock the privacy information include but are not limited to hiding the privacy information from the current interface, displaying the privacy information on the current interface after blurring it, and displaying a reminder message of the privacy information on the current interface, etc.
[0128] In this application, when opening the album or viewing privacy pictures, by periodically obtaining the facial features in the area in front of the terminal, if it is detected that the facial features obtained continuously twice change, the privacy information displayed on the current interface is locked and protected, which not only reminds the user that someone is peeking at the privacy information in the terminal, but also protects the privacy information.
[0129] For better understanding of the above technical solution, the above technical solution will be described below through an embodiment.
[0130] Figure 6 This is a schematic diagram for protection when displaying a privacy application on the current interface provided by an embodiment of the present application. As Figure 7 shown, the specific implementation process of the method for hiding privacy information in the embodiment of the present application is as follows (hereinafter, the photo album is taken as an example of privacy information for illustration):
[0131] First, the user groups a large number of photos in the photo album. The user groups the pictures that he does not want others to see into one group, and then adds an application lock to this group as a privacy photo album. After the privacy photo album is locked, it can only be viewed when it is unlocked.
[0132] After the user enters the terminal through fingerprint recognition, face recognition, password input, etc., when the user opens the photo album, he can directly see the pictures in the privacy photo album, or he can only see the pictures in the privacy photo album by unlocking. When opening the photo album, the terminal continuously detects a certain area directly in front of the terminal at a certain frequency. When the terminal detects that the facial features in two consecutive photos change (when it becomes a situation without people in front of the terminal (not shown in the figure), a situation of changing people, or a situation of someone coming), the terminal activates the security protection function, locks the privacy photo album, and hides the privacy photo album, so that all pictures of the privacy photo album cannot be viewed on the terminal screen.
[0133] Figure 7 This is a flowchart of the fourth terminal information protection method provided by an embodiment of the present application. As Figure 7 shown, the terminal information protection method provided by the present application can be executed when the terminal is in the screen-on and unlocked state. The specific implementation steps are as follows:
[0134] Step S701, present a first display interface.
[0135] Among them, when the terminal user believes that the payment pages when using WeChat payment, Alipay payment, and Taobao shopping are relatively important, the payment pages such as the payment QR code page, the password input page, and the received SMS verification page are used as privacy information and locked. It can only be viewed when it is unlocked.
[0136] Step S703, when presenting the first display interface, obtain a first image.
[0137] Step S705, determine the facial features of the human face according to the first image.
[0138] After the end user opens the photo album, face authentication is required. The terminal activates the front camera to detect a certain area directly in front of the terminal, and then identifies the facial features in the photo, obtaining the facial features of each person in the photo and the number of people. Here, the facial features can be partial facial features, such as partial features like eyes and nose, without the need to obtain detailed facial feature information as in facial recognition for unlocking, which can protect the privacy of others around. At the same time, it avoids the terminal needing to use artificial intelligence to identify facial feature information, thus reducing the workload of the terminal.
[0139] If the terminal is in the screen-off state or the screen is locked, the camera can refrain from detecting a certain area directly in front of the terminal. This can reduce the power consumption of the terminal in the screen-off or screen-locked state.
[0140] In a possible embodiment, the facial features obtained by the camera are the eye features of the person and the features around the eyes. Considering that when the user is using the terminal, in an environment with a large flow of people or in specific scenarios such as a crowded subway or meeting room, most people at this time will not peek at the information on the user's terminal. If the facial features of the person are still obtained, when the user views or operates privacy applications, the terminal will keep locking them, thus affecting the user experience.
[0141] Step S707, when the facial features match the preset conditions, present the payment interface.
[0142] Step S709, when the facial features do not match the preset conditions, present the second display interface.
[0143] Since the camera is constantly detecting a certain area directly in front of it periodically and then identifying the facial features, as long as the facial features in any two consecutive photos change, the terminal will lock the privacy information. Therefore, starting from the second time the terminal obtains the facial features, each time it compares with the facial features obtained last time.
[0144] Among them, the terminal can identify the facial features and the number of people in the two photos, and then compare whether the facial features and the number of people in the two photos are the same; it can identify the eye features and the number of eyes of the people in the two photos, and then compare whether the eye features and the number of eyes in the two photos are the same.
[0145] When it is determined that the facial features obtained continuously twice are the same, the payment interface will be continuously displayed on this interface. At this time, it indicates that no one is peeking at the terminal in a certain area directly in front of the terminal. When the facial features obtained continuously twice are different, it indicates that someone is peeking at the terminal screen in a certain area directly in front of the terminal. The terminal will activate the security protection function to blur the privacy group, making it impossible to view the payment interface on the terminal screen.
[0146] Among them, the ways to lock privacy information include, but are not limited to, hiding the privacy information from the current interface, displaying the privacy information on the current interface after blurring it, and displaying reminder messages of the privacy information on the current interface, etc.
[0147] When this application is on the payment page, by periodically obtaining the facial features in the area in front of the terminal, if it is detected that the facial features obtained continuously twice have changed, the privacy information displayed on the current interface is locked and protected, which not only reminds the user that someone is peeping at the privacy information in the terminal, but also protects the privacy information.
[0148] To better facilitate the understanding of the above technical solution, the above technical solution will be described below through an embodiment.
[0149] Figure 8 It is a schematic diagram for protecting privacy information displayed on the current interface provided by an embodiment of this application. As Figure 8 shown, the specific implementation process of the way to blur the privacy information in the embodiment of this application is as follows (the Alipay payment QR code is used as an example of privacy information below for illustration):
[0150] First, the user adds an application lock to the payment code in Alipay. After the payment code is locked, it can only be seen when it is unlocked.
[0151] After the user enters the terminal through fingerprint recognition, facial recognition, password input, etc., when the user opens Alipay, they can directly see the payment code picture, or they can only see the payment code picture after unlocking. When opening the payment code, the terminal continuously detects a certain area directly in front of the terminal at a certain frequency. When the terminal detects that the facial features in two consecutive photos have changed (when there is no one in front of the terminal (not shown in the figure), a person change, or someone comes), the terminal activates the security protection function, locks the payment code picture, and blurs the payment code, so that the detailed payment code picture cannot be viewed on the terminal screen.
[0152] It should be noted that in the above four embodiments, the executed steps are all realized when the terminal is in the continuous screen-on / unlocked state. If the electronic device's screen is turned off or the screen is locked, the steps executed in the above four embodiments will be interrupted.
[0153] Figure 9 It is a schematic diagram of the structure of the first terminal information protection device provided by an embodiment of this application. As Figure 9 shown, the terminal information protection device 90 provided by this application (corresponding to the above terminal of this application) includes: a display unit 901, an acquisition unit 902, a determination unit 903, a storage unit 904, and a processing unit 905.
[0154] The display unit 901 is used to display the running interface of the first application.
[0155] Among them, the first application is a privacy application that the user needs to protect privacy, and it can be daily application programs such as WeChat, Alipay, email, etc. When the end user deems some application programs important, lock them, and only when unlocked can the user read privacy information or operate the privacy application. Among them, the unlocking methods include but are not limited to the currently commonly used fingerprint unlocking, face recognition unlocking, password unlocking and other methods.
[0156] After the terminal is powered on through a secure unlocking method, when the user first opens the privacy application, at this time the privacy application may not be locked, and the user can directly open the privacy application. The reason for not locking the privacy application at this time is based on the secure startup of the terminal. If the terminal is powered on through an illegal unlocking method, then the privacy application is locked at this time to prevent the privacy application from being viewed or operated by others. Of course, the user can set that when the terminal is unlocked through a highly secure encryption method such as fingerprint recognition unlocking or face recognition unlocking, the privacy application is not locked when opened.
[0157] The acquisition unit 902 is used to acquire a first image when the running interface of the first application is displayed.
[0158] The determination unit 903 is used to determine the facial features of a human face according to the first image.
[0159] After the privacy application is first opened, the terminal is still in the screen-on and unlocked state, and face authentication is required. The terminal starts the front camera to detect a certain area in front of the terminal, and then recognizes the facial features in the photo to obtain the facial features of each person in the photo and the number of people. Among them, the facial features here can be to obtain partial facial features, such as partial features of eyes, nose, etc., without the need to obtain detailed facial feature information like face recognition unlocking, which can protect the privacy of other people around. At the same time, it avoids the terminal from needing to use artificial intelligence to recognize facial feature information, thereby reducing the workload of the terminal.
[0160] If the terminal is in the screen-off or screen-locked state, the camera can not detect a certain area in front of the terminal. This can reduce the power consumption of the terminal in the screen-off or screen-locked state.
[0161] In a possible embodiment, the facial features acquired by the camera are the eye features of a person and the features around the eyes. Considering that when the user uses the terminal, there are a large number of people in the surrounding environment, or in specific scenarios such as crowded subways, meeting rooms, etc., most people at this time will not peek at the information on the user's terminal. If the facial features of a person are still acquired, when the user views or operates the privacy application, the terminal will always lock it, thus affecting the user experience.
[0162] After the user opens the privacy application, the terminal can continuously detect a certain area directly in front of the terminal at a certain frequency periodically, thereby reducing the power consumption of the terminal. Among them, different frequencies are set according to different situations. For example, when in a daytime environment, the camera takes a photo every 360 ms; when in a nighttime environment, the camera takes a photo every 3 - 4 s, and so on.
[0163] In addition, after the user exits the privacy application or pushes the privacy application into the background, the terminal at this time can still be in the screen - on and unlocked state. In a possible embodiment, the camera stops taking photos. After the privacy application exits or is pushed into the background, the privacy application is not displayed on the terminal screen, so there is no need for the camera to continue taking photos. When it is opened again later, the camera is started to take photos, which can reduce the power consumption of the terminal.
[0164] In a possible embodiment, the camera can be used to periodically monitor changes in facial features. The purpose of doing this is to determine whether the facial features in a certain area directly in front of the terminal have changed when the privacy application receives a message after the privacy application exits or is pushed into the background. If there is no change, the privacy application directly pops up the message. If there is a change, the privacy application notifies the user that there is a message received. This avoids the received message being peeked at after the privacy application exits or is pushed into the background.
[0165] The storage unit 904 is used to store the first image and the facial features corresponding to the first image.
[0166] The processing unit 905 is used to control the display unit 901 to display the running interface of the first application when the facial features match the preset conditions stored in the storage unit 904; when the facial features do not match the preset conditions, control the display unit 901 to display the second display interface, and the second display interface does not include the running interface of the first application.
[0167] When the user exits the privacy application or pushes the privacy application into the background and then opens the privacy application again, since the camera has been continuously detecting a certain area directly in front of the terminal periodically, the terminal recognizes the facial features in the photo obtained when the privacy application is opened again.
[0168] In a possible embodiment, the terminal compares the facial features in the photo obtained when the privacy application is reopened with the facial features obtained last time when the privacy application was first opened. Since the privacy application was first opened based on the security activation of the terminal, the facial features obtained for the first time are those of the terminal owner, or may also include those of a bystander approved by the terminal owner to view the privacy application. Therefore, it is relatively safe to compare the facial features in the photo obtained when the privacy application is reopened with the facial features obtained last time when the privacy application was first opened. The preset condition at this time is the facial features obtained last time when the privacy application was first opened.
[0169] In a possible embodiment, the terminal compares the facial features in the photo obtained when the privacy application is reopened with the facial features in the photo obtained last time. Since the terminal continuously detects a certain area directly in front of it at regular intervals and then identifies the facial features, as long as the facial features in any two consecutive photos change, the terminal will lock the privacy application. Therefore, the facial features obtained each time between the first time the facial features were obtained and the photo obtained when the privacy application is reopened remain unchanged. If there is a change, the terminal will have locked the privacy application before the photo obtained when the privacy application is reopened. Therefore, it is relatively safe to compare the facial features in the photo obtained when the privacy application is reopened with the facial features obtained last time. The preset condition at this time is the facial features in the photo obtained last time before the photo obtained when the privacy application is reopened.
[0170] When the user reopens the privacy application, the terminal compares the facial features in the photo obtained when the privacy application is reopened with the facial features obtained last time. In a possible embodiment, the terminal identifies the facial features and the number of people in the two photos, and then compares whether the facial features and the number of people in the two photos are the same. In another possible embodiment, the terminal identifies the eye features and the number of eyes of the people in the two photos, and then compares whether the eye features and the number of eyes of the people in the two photos are the same.
[0171] When it is determined that the facial features obtained twice are the same, the user can directly open the privacy application. This indicates that there is no one peeping in a certain area directly in front of the terminal. When the facial features obtained twice are different, this indicates that there is someone peeping at the terminal screen in a certain area directly in front of the terminal. The terminal will activate the security protection function to lock the privacy application, making it impossible to view or operate the privacy application on the terminal screen.
[0172] Among them, the methods of locking the privacy application include but are not limited to hiding the privacy application from the current interface, displaying the privacy application on the current interface after blurring it, and displaying the logo of the privacy application on the current interface, etc.
[0173] The terminal information protection device provided by the embodiment of the present application periodically obtains facial features in the area in front of the terminal. If the facial features change before the privacy application is opened, that is, there is a change in the person in front of the terminal, when the user wants to open the privacy application, the privacy application is locked and protected at this time, and the user needs to unlock it to enter. This not only reminds the user that someone is peeping at the privacy application in the terminal, but also protects the privacy application.
[0174] Figure 10 It is a schematic structural diagram of the second terminal information protection device provided by the embodiment of the present application. As Figure 10 shown, the terminal information protection device 100 (corresponding to the above terminal of the present application) provided by the present application includes: a display unit 1001, an acquisition unit 1002, a determination unit 1003, a storage unit 1004, and a processing unit 1005.
[0175] The display unit 1001 is used to display the content of the first message or prompt information.
[0176] The acquisition unit 1002 is used to receive the first information.
[0177] Among them, the first message is privacy information that the user needs to protect, which can be important information such as files considered important by the terminal user, content displayed in application programs, and favorite pictures. When the terminal user deems some information important, it is locked, and the privacy information can only be read when unlocked. Among them, the unlocking methods include but are not limited to fingerprint unlocking, face recognition unlocking, password unlocking, etc. commonly used in daily life.
[0178] In cases such as when the application program exits or is pushed into the background, when the terminal or the application program receives a message, it determines whether the facial features of the person within a certain area directly in front of the terminal have changed. If there is no change, the privacy application directly pops up the content of the message. If there is a change, the terminal or the application program notifies the user that a message has been received. This avoids the message received from being peeped at in cases such as when the application program exits or is pushed into the background. Among them, after the user exits the privacy application or pushes the privacy application into the background, the terminal at this time can still be in the state of being lit and unlocked.
[0179] The acquisition unit 1002 is further used to acquire the first image.
[0180] The determination unit 1003 is used to determine the facial features of the human face according to the first image.
[0181] In cases such as when the application program exits or is pushed into the background, the terminal still activates the front camera to detect a certain area directly in front of the terminal.
[0182] After receiving a message, face authentication is required. The terminal activates the front camera to detect a certain area directly in front of the terminal, and then identifies the facial features in the photo to obtain the facial features of each person in the photo and the number of people. Here, the facial features can be partial facial features, such as partial features like eyes and nose, without the need to obtain detailed facial feature information as in facial recognition for unlocking, which can protect the privacy of others around. At the same time, it avoids the terminal having to use artificial intelligence to identify facial feature information, thereby reducing the workload of the terminal.
[0183] If the terminal is in the screen-off state or the screen is locked, the camera can refrain from detecting a certain area directly in front of the terminal. This can reduce the power consumption of the terminal in the screen-off or screen-locked state.
[0184] In a possible embodiment, the facial features obtained by the camera are the eye features of the person and the features around the eyes. Considering that when the user is using the terminal, there is a relatively large flow of people in the surrounding environment, or in specific scenarios such as crowded subways or meeting rooms, most people in such situations will not peek at the information on the user's terminal. If the facial features of the person are still obtained, when the user views or operates a privacy application, the terminal will keep locking it, thus affecting the user experience.
[0185] The storage unit 1004 is used to store the first image and the corresponding facial features of the first image.
[0186] The processing unit 1005 is used to control the display unit 1001 to display the content of the first message when the facial features match the preset conditions; when the facial features do not match the preset conditions, it controls the display unit 1001 to display a first prompt message, and the first prompt message is used to prompt that the first message has been received, and the first prompt message does not include the content of the first message.
[0187] When the application exits or is pushed into the background, etc., when a message is received, since the camera has been periodically detecting a certain area directly in front of the terminal, the terminal identifies the facial features in the photo obtained when the message is received.
[0188] When a message is received, the terminal compares the facial features in the photo obtained when the message is received with the facial features obtained last time. In a possible embodiment, the terminal identifies the facial features of the people and the number of people in the two photos, and then compares whether the facial features of the people and the number of people in the two photos are the same. In another possible embodiment, the terminal identifies the eye features and the number of eyes of the people in the two photos, and then compares whether the eye features and the number of eyes of the people in the two photos are the same.
[0189] When it is determined that the facial features obtained twice are the same, the content of the message is directly popped up by the terminal or application. This indicates that there is no one peeping within a certain area directly in front of the terminal. When the facial features obtained twice are different, this indicates that someone is peeping at the terminal screen within a certain area directly in front of the terminal, and the terminal will activate the security protection function to display a prompt message on the display screen to remind the user that there is a message received.
[0190] Among them, the ways to lock the privacy information include but are not limited to hiding the privacy information from the current interface, displaying the privacy information on the current interface after blurring it, and displaying a reminder message of the privacy information on the current interface, etc.
[0191] In a possible embodiment, when the prompt information of the privacy information is displayed on the terminal interface, the terminal can receive the instruction generated by the user's operation on the screen. After receiving the instruction input by the user, the content of the privacy information is directly displayed to facilitate the user to directly read the content of the privacy information on the current interface.
[0192] For the terminal information protection device provided by the embodiments of the present application, when the application exits or is pushed into the background, etc., when receiving a message, by periodically obtaining the facial features within the area in front of the terminal, if it is detected that the facial features obtained continuously twice change, the privacy information displayed on the current interface is locked and protected, which not only reminds the user that someone is peeping at the privacy information in the terminal, but also protects the privacy information or privacy application at the same time.
[0193] Figure 11 This is the structural schematic diagram of the third terminal information protection device provided by the embodiments of the present application. As Figure 11 shown, the terminal information protection device 110 provided by the present application (corresponding to the above terminal of the present application) includes: a display unit 1101, an acquisition unit 1102, a determination unit 1103, a storage unit 1104, and a processing unit 1105.
[0194] The display unit 1101 is used to present the gallery preview interface.
[0195] Among them, when the terminal user believes that some pictures in the album are relatively important, the terminal user groups these pictures as a privacy group and locks it, and can only view the privacy group after unlocking.
[0196] The acquisition unit 1102 is used to acquire the first image when presenting the gallery preview interface.
[0197] The determination unit 1103 is used to determine the facial features of the human face according to the first image.
[0198] After the end user opens the photo album, face authentication is required. The terminal activates the front camera to detect a certain area directly in front of the terminal, and then recognizes the facial features in the photo to obtain the facial features of each person in the photo and the number of people. Here, the facial features can be partial facial features, such as partial features of eyes, nose, etc., without the need to obtain detailed facial feature information like facial recognition for unlocking, which can protect the privacy of other people around. At the same time, it avoids the terminal from requiring artificial intelligence to recognize facial feature information, thus reducing the workload of the terminal.
[0199] If the terminal is in the screen-off state or the screen is locked, the camera can refrain from detecting a certain area directly in front of the terminal. This can reduce the power consumption of the terminal in the screen-off or screen-locked state.
[0200] In a possible embodiment, the facial features obtained by the camera are the eye features of the person and the features around the eyes. Considering that when the user is using the terminal, in an environment with a large flow of people or in specific scenarios such as a crowded subway or meeting room, most people at this time will not peek at the information on the user's terminal. If the facial features of the person are still obtained, when the user views or operates privacy applications, the terminal will keep locking them, thus affecting the user experience.
[0201] The storage unit 1104 is used to store the first image and the corresponding facial features of the first image.
[0202] The processing unit 1105 is used to control the display unit 1101 to present a first photo album preview interface including preset pictures when the facial features match the preset conditions; and to control the display unit 1101 to present a second photo album preview interface without preset pictures when the facial features do not match the preset conditions.
[0203] Since the camera is always periodically detecting a certain area directly in front and then recognizing the facial features, as long as the facial features in any two consecutive photos change, the terminal will lock the privacy information. Therefore, starting from the second time the terminal obtains the facial features, each time it compares with the facial features obtained last time.
[0204] Among them, the terminal can recognize the facial features and the number of people in the two photos, and then compare whether the facial features and the number of people in the two photos are the same; it can also recognize the eye features and the number of eyes of the people in the two photos, and then compare whether the eye features and the number of eyes in the two photos are the same.
[0205] When it is determined that the facial features obtained twice in a row are the same, the user directly opens the privacy group or continuously views the pictures in the privacy group, indicating that there is no one peeping in a certain area directly in front of the terminal. When the facial features obtained twice in a row are different, it indicates that someone is peeping at the terminal screen in a certain area directly in front of the terminal, and the terminal will activate the security protection function to hide the privacy group so that the privacy group cannot be viewed on the terminal screen.
[0206] Among them, the methods of locking the privacy information include, but are not limited to, hiding the privacy information from the current interface, displaying the privacy information on the current interface after blurring it, and displaying a reminder message of the privacy information on the current interface, etc.
[0207] The terminal information protection device provided by the embodiments of the present application, when opening the album or viewing privacy pictures, periodically obtains the facial features in the area in front of the terminal. If it is detected that the facial features obtained twice in a row change, the privacy information displayed on the current interface is locked and protected, which not only reminds the user that someone is peeping at the privacy information in the terminal, but also protects the privacy information or privacy application at the same time.
[0208] Figure 12 It is a schematic structural diagram of the fourth terminal information protection device provided by the embodiments of the present application. As Figure 12 shown, the terminal information protection device 120 (corresponding to the above terminal of the present application) provided by the present application includes: a display unit 1201, an acquisition unit 1202, a determination unit 1203, a storage unit 1204, and a processing unit 1205.
[0209] The display unit 1201 is used to present a first display interface, and the first display interface includes a payment interface.
[0210] Among them, when the terminal user believes that the payment pages when using WeChat payment, Alipay payment, and Taobao shopping are relatively important, the payment pages such as the payment QR code page, the input password page, and the received SMS verification page are used as privacy information and locked. Only when unlocked can the page be viewed.
[0211] The acquisition unit 1202 is used to acquire a first image when presenting the first display interface.
[0212] The determination unit 1203 is used to determine the facial features of the human face according to the first image.
[0213] After the end user opens the photo album, face authentication is required. The terminal activates the front camera to detect a certain area directly in front of the terminal, and then recognizes the facial features in the photo to obtain the facial features of each person in the photo and the number of people. Here, the facial features can be partial facial features, such as partial features like eyes and nose, without the need to obtain detailed facial feature information as in facial recognition for unlocking, which can protect the privacy of other people around. At the same time, it avoids the terminal from needing to use artificial intelligence to recognize facial feature information, thereby reducing the workload of the terminal.
[0214] When the terminal is in the screen-off state or the screen is locked, the camera can stop detecting a certain area directly in front of the terminal. This can reduce the power consumption of the terminal in the screen-off or screen-locked state.
[0215] In a possible embodiment, the facial features obtained by the camera are the eye features of the person and the features around the eyes. Considering that when the user is using the terminal, there are a relatively large number of people in the surrounding environment, or in specific scenarios such as a crowded subway or meeting room, most people in such situations will not peek at the information on the user's terminal. If the facial features of the person are still obtained, when the user views or operates privacy applications, the terminal will keep locking them, thus affecting the user experience.
[0216] The storage unit 1204 is used to store the first image and the corresponding facial features of the first image.
[0217] The processing unit 1205 is used to control the display unit 1201 to present the payment interface when the facial features match the preset conditions; when the facial features do not match the preset conditions, it controls the display unit 1201 to present a second display interface, and the second display interface does not include the payment interface.
[0218] Since the camera is always periodically detecting a certain area directly in front of it and then recognizing the facial features, as long as the facial features in any two consecutive photos change, the terminal will lock the privacy information. Therefore, starting from the second time the terminal obtains the facial features, each time it compares with the facial features obtained last time.
[0219] Among them, the terminal can recognize the facial features and the number of people in the two photos, and then compare whether the facial features and the number of people in the two photos are the same; it can also recognize the eye features and the number of eyes of the people in the two photos, and then compare whether the eye features and the number of eyes in the two photos are the same.
[0220] When it is determined that the facial features obtained twice in a row are the same, the payment interface will be continuously displayed on the interface. At this time, it indicates that there is no one peeping in a certain area in front of the terminal. When the facial features obtained twice in a row are different, it indicates that someone is peeping at the terminal screen in a certain area in front of the terminal. The terminal will activate the security protection function to blur the privacy group, making it impossible to view the payment interface on the terminal screen.
[0221] Among them, the methods of locking the privacy information include, but are not limited to, hiding the privacy information from the current interface, displaying the privacy information on the current interface after blurring it, and displaying a reminder message of the privacy information on the current interface.
[0222] The terminal information protection device provided by the embodiments of the present application, when on the payment page, periodically obtains the facial features in the area in front of the terminal. If it is detected that the facial features obtained twice in a row change, the privacy information displayed on the current interface is locked and protected, which not only reminds the user that someone is peeping at the privacy information in the terminal, but also protects the privacy information or privacy application at the same time.
[0223] The present application provides an electronic device. When the electronic device is in the screen-on and unlocked state and there is no screen locking or screen-off action in the middle, it includes: a display, a transceiver, a processor, and a memory.
[0224] In a possible implementation embodiment, when the electronic device unlocks and enters the privacy application, the display is used to display the running interface of the privacy application; the transceiver is used to periodically obtain the first image in the area directly in front of the terminal; the processor is used to identify the facial features of the human face in the first image. When the facial features of the human face match the preset conditions stored in the memory, it controls the display to display the running interface of the privacy application; when the facial features of the human face do not match the preset conditions, it controls the display to display a display interface that does not include the privacy application.
[0225] In a possible implementation embodiment, when the electronic device unlocks and enters the application program and then exits or is pushed into the background, and receives privacy information, the display is used to display the content or prompt information of the privacy information; the transceiver is used to periodically obtain the second image in the area directly in front of the terminal; the processor is used to identify the facial features of the human face in the second image. When the facial features of the human face match the preset conditions stored in the memory, it controls the display to display the content of the privacy information; when the facial features of the human face do not match the preset conditions, it controls the display to display the prompt information of the privacy information. The prompt information is used to prompt that privacy information has been received, and the prompt information does not include the content of the privacy information.
[0226] In a possible implementation example, when the electronic device is unlocked and enters the photo album or views private pictures, the display is used to present a gallery preview interface; the transceiver is used to periodically obtain a third image within the area directly in front of the terminal; the processor is used to recognize the facial features of the face in the third image, and when the facial features of the face match the preset conditions stored in the memory, control the display to present a gallery preview interface including preset pictures; when the facial features of the face do not match the preset conditions, control the display to present a gallery preview interface that does not include preset pictures.
[0227] In a possible implementation example, when the electronic device is unlocked and enters the payment page, the display is used to present a display interface including a payment interface; the transceiver is used to periodically obtain a fourth image within the area directly in front of the terminal; the processor is used to recognize the facial features of the face in the fourth image, and when the facial features of the face match the preset conditions stored in the memory, control the display to present the payment interface; when the facial features of the face do not match the preset conditions, control the display to present a display interface that does not include the payment interface.
[0228] Figure 13 The structural schematic diagram of an electronic device provided by an embodiment of the present invention is as follows. Figure 13 As shown in an electronic device 1300, the electronic device 1300 may be the above-mentioned device 90, device 100, device 110, and device 120, and includes a sensor 1301, a display 1302, a processor 1303, a memory 1304, a communication interface 1305, and a bus 1306. The processor 1303, the memory 1304, and the communication interface 1305 in the electronic device may establish a communication connection through the bus 1306.
[0229] The sensor 1301 is used to obtain a photo within a certain area directly in front of the terminal. The sensor 1301 may include a camera and the like.
[0230] The display 1302 is used to display the processed data, such as videos and virtual operation interfaces.
[0231] The processor 1303 may be a central processing unit (CPU).
[0232] The memory 1304 may include volatile memory, such as random-access memory (RAM); the memory may also include non-volatile memory, such as read-only memory (ROM), flash memory, a hard disk drive (HDD), or a solid state drive (SSD); the memory 1304 may further include a combination of the above types of memories.
[0233] The terminal information protection methods provided by the above embodiments are all executed by the processor 1303. Data such as pictures, recognized face features, and the number of people will be stored in the memory 1304. In addition, the memory 1304 will also be used to store program instructions corresponding to the terminal information protection methods described in the above embodiments executed by the processor 1303, and so on.
[0234] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the embodiments of the present application.
[0235] In addition, various aspects or features of the embodiments of the present application can be implemented as a method, an apparatus, or an article of manufacture using standard programming and / or engineering techniques. The term "article of manufacture" used in the present application covers a computer program accessible from any computer-readable device, carrier, or medium. For example, computer-readable media may include, but are not limited to: magnetic storage devices (such as hard disks, floppy disks, or magnetic tapes, etc.), optical discs (such as compact discs (CDs), digital versatile discs (DVDs), etc.), smart cards, and flash memory devices (such as erasable programmable read-only memories (EPROMs), cards, sticks, or key drives, etc.). Additionally, the various storage media described herein may represent one or more devices and / or other machine-readable media for storing information. The term "machine-readable media" may include, but is not limited to, wireless channels and various other media capable of storing, containing, and / or carrying instructions and / or data.
[0236] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more integrated available media. The available medium can be a magnetic medium (such as a floppy disk, hard disk, magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid state disk (SSD)).
[0237] It should be understood that in various embodiments of the embodiments of the present application, the magnitude of the serial numbers of the above processes does not mean the order of execution. The order of execution of each process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.
[0238] Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments and will not be described in detail here.
[0239] In several embodiments provided in the present application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division, and there can be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces. The indirect couplings or communication connections of the devices or units can be in electrical, mechanical, or other forms.
[0240] The unit described as a separation component may or may not be physically separated. The component shown as a unit may or may not be a physical unit, that is, it may be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0241] If the above functions are implemented in the form of software function units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiments of this application, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or an access network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The foregoing storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical discs that can store program codes.
[0242] The above is only the specific implementation manner of the embodiments of this application, but the protection scope of the embodiments of this application is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the embodiments of this application, and all should be covered by the protection scope of the embodiments of this application.
Claims
1. A method for protecting terminal information, characterized in that, including: displaying a running interface of a first application; wherein, the first application is a privacy application; the running interface is opened by the user unlocking to enter the first application or based on the security startup of the terminal; after the user opens the first application, periodically and continuously detecting a predetermined area directly in front of the terminal, and obtaining facial features within the area in front of the terminal; taking the facial features obtained when the first application is first opened as the first obtained facial features; exiting the first application or pushing the first application into the background; when the first application is opened again, determining whether there are changes in the facial features obtained in the previous and current times; wherein, when the facial features obtained in the previous and current times match, displaying the running interface of the first application; when the facial features obtained in the previous and current times do not match, displaying a second display interface, and the second display interface does not include the running interface of the first application.
2. The method according to claim 1, wherein The facial features include: the face features of a person and the number of people; The determining whether there are changes in the facial features obtained in the previous and current times includes: identifying the face features of the person and the number of people in the facial features obtained in the previous and current times according to the facial features obtained in the previous and current times; wherein, determining whether the facial features match a preset condition according to the differences in the face features and the number of people.
3. A terminal information protection device, characterized in that, including: a transceiver, a processor, and a memory; the memory stores one or more programs, and the one or more programs include instructions, and when the instructions are executed by the device, the device executes the method according to any one of claims 1-2.
4. A terminal information protection method, characterized in that, including: presenting a gallery preview interface; wherein, the gallery is locked; the preview interface is opened by the user unlocking; after the user opens the gallery, periodically and continuously detecting a predetermined area directly in front of the terminal, and obtaining facial features within the area in front of the terminal; taking the facial features obtained when the gallery preview interface is first opened as the first obtained facial features; determining whether there are changes in the facial features obtained in the previous and current times; when the facial features obtained in the previous and current times match, presenting a first gallery preview interface, and the first gallery preview interface includes preset pictures; when the facial features obtained in the previous and current times do not match, presenting a second gallery preview interface, and the second gallery preview interface does not include the preset pictures, and the second gallery preview interface includes other pictures except the preset pictures.
5. The method according to claim 4, characterized in that The preset pictures are pictures that meet preset conditions.
6. The method according to claim 4, characterized in that, The facial features include: the face features of a person and the number of people; Determining whether there are changes in the facial features obtained in the previous and current times includes: identifying the face features of the person and the number of people in the facial features obtained in the previous and current times according to the facial features obtained in the previous and current times; wherein, determining whether the facial features match a preset condition according to the differences in the face features and the number of people.
7. The method according to any one of claims 4 to 6, characterized in that When the facial features obtained in the previous and current times match and presenting the first gallery preview interface, it further includes: when presenting the first gallery preview interface, obtaining a second image; when the facial features in the second image do not match the preset condition, presenting the second gallery preview interface.
8. A terminal information protection device, characterized in that Comprising: a transceiver, a processor, and a memory; The memory stores one or more programs, and the one or more programs include instructions that, when executed by the device, cause the device to execute the method according to any one of claims 4-7.
9. A method for protecting terminal information, characterized in that, Comprising: presenting a first display interface, the first display interface including a payment interface, the payment interface at least including a payment QR code or a password input interface; The first display interface is opened by user unlocking; after the user opens the payment interface, periodically and continuously detecting a predetermined area directly in front of the terminal, and acquiring facial features within the area in front of the terminal; taking the facial features acquired when the first display interface is first opened as the first acquired facial features; determining whether there is a change in the facial features acquired in the previous and subsequent times; when the facial features acquired in the previous and subsequent times match, presenting the payment interface; when the facial features acquired in the previous and subsequent times do not match, presenting a second display interface, the second display interface not including the payment interface.
10. The method according to claim 9, wherein The facial features include: the facial features of a person and the number of persons, Determining whether there is a change in the facial features acquired in the previous and subsequent times includes: Based on the facial features acquired in the previous and subsequent times, identifying the facial features of the person and the number of persons in the facial features acquired in the previous and subsequent times; wherein, according to the differences in the facial features and the number of persons, determining whether the facial features match a preset condition.
11. The method according to claim 9, wherein The second display interface is an interface obtained by blurring the payment interface.
12. The method according to claim 9, wherein The second display interface includes a second prompt message; wherein, the second prompt message is used to prompt the user that there is a peeping person.
13. A terminal information protection device, characterized in that, Comprising: a transceiver, a processor, and a memory; The memory stores one or more programs, and the one or more programs include instructions that, when executed by the device, cause the device to execute the method according to any one of claims 9-12.
14. A readable storage medium for storing instructions, characterized in that, When the instructions are executed, the method according to any one of claims 1-2, or any one of claims 4-7, or any one of claims 9-12 is implemented.
15. A computer program device comprising instructions, characterized in that, When it runs on the terminal, the method according to any one of claims 1-2, or any one of claims 4-7, or any one of claims 9-12 is implemented.
16. An electronic device, characterized in that, Comprising: a display, a transceiver, a processor, and a memory, when the electronic device unlocks and enters a privacy application, the display is used to display the running interface of the privacy application; the transceiver is used to periodically acquire a first image within the area directly in front of the terminal after the user opens the privacy application; the processor is used to identify the facial features of the human face in the first image, and when the facial features acquired in the previous and subsequent times match control the display to display the running interface of the privacy application; when the facial features acquired in the previous and subsequent times do not match, control the display to display a display interface that does not include the privacy application, and display authentication information; take the facial features acquired when the privacy application is first opened as the first acquired facial features; When the electronic device is unlocked to enter the photo album or view private pictures, the display is used to present a gallery preview interface; the transceiver is used to periodically obtain a third image in the area directly in front of the terminal when the electronic device is in an unlocked state; the processor is used to identify the facial features of the face in the third image. When the facial features obtained in two consecutive times match, it controls the display to present a gallery preview interface including preset pictures, where the preset pictures are pictures that meet preset conditions; when the facial features obtained in two consecutive times do not match, it controls the display to present a gallery preview interface that does not include preset pictures and displays other pictures except the preset pictures; and takes the facial features obtained when the gallery preview interface is opened for the first time as the first obtained facial features; When the electronic device is unlocked to enter the payment page, the display is used to present a display interface including a payment interface, and the payment interface at least includes a payment QR code or a password input interface; the transceiver is used to periodically obtain a fourth image in the area directly in front of the terminal when the electronic device is in an unlocked state; the processor is used to identify the facial features of the face in the fourth image. When the facial features obtained in two consecutive times match, it controls the display to present the payment interface; when the facial features obtained in two consecutive times do not match, it controls the display to present a display interface that does not include the payment interface; and takes the facial features obtained when the first display interface is opened for the first time as the first obtained facial features.
Citation Information
Patent Citations
Method and device for detecting environment of terminal
CN106156663A
Message prompting method, mobile terminal, and computer readable storage medium
CN108989534A