Display control method and device of application program, equipment and storage medium

Abstract

The invention provides a display control method and device for an application program, electronic equipment and a computer readable storage medium, and the method comprises the steps: obtaining a facial image of a user, inputting the facial image to a facial information model to obtain a corresponding expression category, and starting a privacy display mode when the expression category belongs to a first expression category, a user can set the target content needing to be hidden, so that the privacy content of the user can be hidden through the expression, when the expression class belongs to the second expression class, the normal display mode is started, the privacy display mode is conveniently switched to the normal display mode, and the user experience is improved. And the influence on normal use of a user is reduced. According to the embodiment of the invention, the display control process is realized through expression recognition, and a user does not need to manually operate hiding and cancel hiding, so that the privacy protection process is simpler and more convenient under the condition that the privacy of the user is protected, and the use experience is improved.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a display control method, device, electronic device and computer-readable storage medium for an application. Background Art

[0002] With the development of application programs, in order to meet the various needs of users, application programs are also constantly refining their functions and meeting the needs. Therefore, the number of application programs is not only huge, but also the types are very rich.

[0003] As applications meet various needs of users, users need to hide or display some applications according to their own preferences, and usually achieve the hiding function by manually setting the hiding function.

[0004] Manually hiding applications requires certain steps, which is very inconvenient to implement. Summary of the invention

[0005] In view of the above problems, the embodiments of the present application provide a display control method, device, electronic device and computer-readable storage medium for an application program to solve the problems in the related art.

[0006] In a first aspect, an embodiment of the present application provides a display control method for an application program, the method comprising:

[0007] Acquire a facial image of a user, input the facial image into a facial information model, and obtain an expression category corresponding to the facial image; the facial information model is used to determine the corresponding expression category according to facial information in the facial image;

[0008] When the expression category belongs to the first expression category, enabling a privacy display mode to hide the target content of the application program in the interface in the privacy display mode;

[0009] When the expression category belongs to the second expression category, the normal display mode is enabled to normally display all contents of the application program in the interface in the normal display mode.

[0010] In a second aspect, an embodiment of the present application provides a display control device for an application program, the device comprising:

[0011] An information detection module is used to obtain a facial image of a user, input the facial image into a facial information model, and obtain an expression category corresponding to the facial image; the facial information model is used to determine a corresponding expression category according to facial information in the facial image;

[0012] A privacy mode module, used to enable a privacy display mode when the expression category belongs to a first expression category, so as to hide the target content of the application program in the interface in the privacy display mode;

[0013] The recovery module is used to enable the normal display mode when the expression category belongs to the second expression category, so as to normally display all the contents of the application program in the interface in the normal display mode.

[0014] In a third aspect, an embodiment of the present application further discloses an electronic terminal, comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the display control method of the application described in the first aspect are implemented.

[0015] In a fourth aspect, an embodiment of the present application further discloses a computer-readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the display control method of the application program described in the first aspect are implemented.

[0016] In the embodiment of the present application, by obtaining the user's facial image, the facial image is input into the facial information model to obtain the corresponding expression category. When the expression category belongs to the first expression category, the privacy display mode is enabled to hide the target content. The user can set the target content to be hidden, so that the user's private content can be hidden through the expression. When the expression category belongs to the second expression category, the normal display mode is enabled, so that the privacy display mode can be switched to the normal display mode more conveniently, reducing the impact on the user's normal use. The display control process of the embodiment of the present application is realized through expression recognition, and there is no need for the user to manually hide and cancel the hiding. While protecting the user's privacy, it also makes the privacy protection process simpler and improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments of the present application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0018] Figure 1 It is a flowchart of the steps of a display control method of an application provided in an embodiment of the present application;

[0019] Figure 2 is a schematic diagram of a display mode provided in an embodiment of the present application;

[0020] Figure 3is a schematic diagram of another display mode provided in an embodiment of the present application;

[0021] Figure 4 is a flowchart of another method for controlling the display of an application program provided in an embodiment of the present application;

[0022] Figure 5 is a schematic diagram of another display mode provided in an embodiment of the present application;

[0023] Figure 6 is a schematic diagram of another display mode provided in an embodiment of the present application;

[0024] Figure 7 is a block diagram of a display control device for an application provided in an embodiment of the present application;

[0025] Figure 8 is a block diagram of an electronic device provided in an embodiment of the present application;

[0026] Fig. 9 It is a block diagram of another electronic device according to another embodiment of the present application. DETAILED DESCRIPTION

[0027] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0028] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally a class, and the number of objects is not limited. For example, the first object can be one or more. In addition, the term "and / or" in the specification and claims is used to describe the association relationship of associated objects, indicating that three kinds of relationships can exist, for example, A and / or B can be represented: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the front and back associated objects are a kind of "or" relationship. In the embodiment of the present application, the term "multiple" refers to two or more, and other quantifiers are similar.

[0029] With the continuous development of applications in mobile phones, more and more applications with different functions are gradually appearing in the users' field of vision. The functions of applications are becoming more and more refined, making it easier to find their users more accurately, making the applications more competitive in specific segments.

[0030] The reason for the continuous differentiation of application functions is the diverse needs of users. Nowadays, applications provide a lot of help in our daily lives. As a tool to make life more convenient, applications have been tied to daily payment, travel, social interaction, entertainment and other activities.

[0031] Each application installed by the user reflects the needs of the user to a certain extent. Therefore, knowing the applications installed by the user can know the needs and preferences of the user to a certain extent. On the one hand, when these private information are snooped, it will bring a certain discomfort to the user. For example, a student needs to fill in the identity information for admission in a crowded carriage. Whether it is seen by people around or not, he needs to disperse some energy to be vigilant. On the other hand, in some specific occasions, users do not want irrelevant and discordant content to appear. For example, in the workplace, it is necessary to connect to the display screen to report on the work content. At this time, if the display screen shows only work-related applications instead of entertainment applications, it will lay a serious atmosphere and be more conducive to the user to play the current role well.

[0032] Considering the privacy needs of users, hiding the content in applications that users care about is an urgent problem to be solved. In some related technologies, users can manually hide or eliminate application icons to clean the application icons on the screen, or use encrypted asterisks to replace the original private information when processing certain private content. These methods not only have inconsistent operation styles, but also have complicated manual operation steps when hiding icons. In addition, encrypting private information is usually a function designed in advance by developers, which is difficult to make individual adjustments according to the individual needs of users. Therefore, a method for controlling application display that is easy to operate and can be adjusted according to the user's individual needs is needed.

[0033] like Figure 1 As shown, the present application embodiment proposes a flow chart of the steps of a display control method of an application program, such as Figure 1 As shown, the method may include:

[0034] Step 101, obtaining a facial image of a user, inputting the facial image into a facial information model, and obtaining an expression category corresponding to the facial image;

[0035] In the embodiment of the present application, the user's facial image is the user's facial image taken by the electronic device being used, and the facial information model is an existing trained human face facial expression recognition model. By inputting the user's facial image, the expression category corresponding to the facial image will be obtained from the facial information model. The method of reading facial information as the input of user commands is more convenient than the input method in which the user uses fingers or input devices such as a mouse and keyboard to interact with a specified position.

[0036] Optionally, when acquiring the facial image of the user, the camera of the electronic device or a dedicated facial recognition module can be used to implement it. After acquiring the facial image, the image is preprocessed and the noise in the facial image is removed by using methods such as Gaussian filtering and median filtering, so as to reduce the influence of noise on the expression category obtained by the facial information model; the brightness of the facial image is adjusted by using methods such as histogram equalization, so as to improve the performance of the facial image in some usage scenarios, such as when the overall brightness is low during night shooting, or when the brightness of the portrait part is low when the user is backlit.

[0037] Specifically, the expression category can be expressions showing emotions in daily life, such as smiling, angry, sad, etc., or unconventional expressions with facial movements, such as frowning, opening the mouth, closing the left eye, closing the right eye, etc.

[0038] Step 102, when the expression category belongs to the first expression category, enable a privacy display mode to hide the target content of the application program in the interface in the privacy display mode.

[0039] In the embodiment of the present application, the user can set the expressions serving as the first expression category according to his / her own usage habits.

[0040] For example, the user can set smile as the first expression category for enabling the privacy display mode. When the user smiles, a facial image with the smile is acquired and input into the facial information model, and the expression category output by the facial information model is judged.

[0041] Optionally, the user can select some expressions that do not appear frequently and are not inconsistent as the first expression category. Expressions that appear frequently will increase the risk of accidental touches and affect the user's normal use process. Therefore, expressions such as frowning, closing only the left eye, closing only the right eye, and turning down the corners of the mouth can be used as the first expression category.

[0042] like Figure 2-3As shown, after the privacy display mode is enabled, the target content of the application in the interface is hidden. The target content can be set by the user, thereby making the hiding method of the application more personalized, hiding the content to be hidden according to the needs and preferences of the user, and at the same time controlling the switch of the privacy display mode by reading facial information, which is more convenient than the input method in which the user uses fingers or input devices such as mouse and keyboard to interact with the specified location.

[0043] For example, the target content is the shortcut icon and application name of an application. The positional relationship between the shortcut icon and the application name is as follows: Figure 2 As shown, Figure 2 The numbers represent different application names. After entering the privacy display mode, the application's shortcut icon and application name are hidden; or the user sets the target content to only the application name, after entering the privacy display mode, only the application name is hidden; when the target content is set to the private data of the application operation interface, the private data will be hidden after entering the privacy display mode.

[0044] Step 103, when the expression category belongs to the second expression category, enable the normal display mode to normally display all the contents of the application program in the interface in the normal display mode.

[0045] In an embodiment of the present application, the user enables the normal display mode by setting the second expression category. In the normal display mode, all contents of the application in the interface will be displayed normally, whether it is the application's shortcut icon and application name or the privacy data of the application operation interface.

[0046] Optionally, since the usage scenarios in the normal display mode occupy the vast majority of the user's usage scenarios, the second expression category can select an expression category with a higher frequency of occurrence, such as smiling, opening the mouth, etc.

[0047] In summary, in the embodiment of the present application, by obtaining the user's facial image, the facial image is input into the facial information model to obtain the corresponding expression category. When the expression category belongs to the first expression category, the privacy display mode is enabled to hide the target content. The user can set the target content to be hidden, so that the user's private content can be hidden through the expression. When the expression category belongs to the second expression category, the normal display mode is enabled, so that the privacy display mode can be switched to the normal display mode more conveniently, reducing the impact on the user's normal use. The display control process of the embodiment of the present application is realized through expression recognition, and there is no need for the user to manually hide and cancel the hiding. While protecting the user's privacy, it also makes the privacy protection process simpler and improves the user experience.

[0048] like Figure 4 As shown, the present application embodiment proposes a flow chart of the steps of a display control method of an application program, such as Figure 4 As shown, the method may include:

[0049] Step 201 , obtaining a facial image of a user, inputting the facial image into a facial information model, and obtaining an expression category corresponding to the facial image.

[0050] This step may specifically refer to the above step 101, which will not be described in detail here.

[0051] Step 202: when the expression category belongs to the first expression category, enable a private display mode to hide the target content of the application program in the interface in the private display mode.

[0052] This step can be specifically referred to the above step 102, which will not be repeated here.

[0053] Optionally, step 202 may specifically include:

[0054] Sub-step 221, when the desktop is displayed on the current interface, obtain an application list including all applications, and search for an application whose working mode is a privacy mode in the application list; the application list records the working mode of the application.

[0055] In an embodiment of the present application, by distinguishing the current display interface, different privacy content hiding schemes can be executed according to different display interfaces. When the current display interface displays the desktop, the application information of the desktop is the shortcut icon and application name of the application. By obtaining an application list of all applications and searching for applications whose working mode is a privacy mode in the application list, wherein the application list records the working mode of the application, the application whose working mode is a privacy mode executes the corresponding hiding operation, and the remaining applications are displayed normally, personalized adjustments are made for the hiding of the user's application, which is closer to the user's real needs.

[0056] For example, when the privacy display mode is enabled, not all applications are adjusted to perform corresponding hiding processing. Instead, the application list of all applications will be searched for the application that has entered the privacy mode. Taking games as an example, when it is found that the game has entered the privacy mode and the other applications are not in the privacy mode, the other applications will be displayed normally, while the game will be hidden accordingly.

[0057] Sub-step 2022, determining target content from the displayed content of the application in the privacy mode, and hiding the target content in the interface.

[0058] In an embodiment of the present application, by setting the target content in the display content and hiding the target content, the hiding scheme can execute the corresponding scheme according to the actual situation to adapt to more application scenarios, which is convenient for users to respond to different situations through the same operation, and increases the versatility of users entering the privacy display mode through the first expression category.

[0059] Optionally, sub-step 2022 may specifically include:

[0060] Sub-step 20221, when the desktop is displayed on the current interface, the shortcut icon and application name of the application in the privacy mode are used as the target content.

[0061] In an embodiment of the present application, when the desktop is displayed on the current interface, the shortcut icons and application names are hidden as target content, so that the user does not need to worry about the leakage of information contained in the application when using the electronic device, thereby ensuring that the user's use of the electronic device is not affected by others.

[0062] For example, when the user is a teacher and needs to connect the electronic device to a projection screen during teaching, if the content that appears on the screen includes other game icons in addition to the courseware, it is easy for students to focus on the game and may also trigger discussions, which will weaken the teaching effect to a certain extent. By setting the first expression category to make the application enter the private display mode, the shortcut icon and application name of the game application in the privacy mode are hidden, and the shortcut icon and application name of the application used for teaching are displayed, thereby maintaining a serious atmosphere in the classroom.

[0063] Optionally, after sub-step 20221, the method further includes:

[0064] Sub-step 202211, after the target content is hidden, the applications of the shortcut icons that are not hidden are arranged in sequence and then displayed.

[0065] In an embodiment of the present application, after the target content, which is the information of the shortcut icon and the application name, is hidden, an empty area will be left on the display interface of the electronic device. Leaving this area will make the display interface irregular and affect the appearance. At the same time, it will also leave traces of the hidden target content, making the hiding process flawed. Therefore, arranging the applications of the shortcut icons that are not hidden in sequence and displaying them can make up for this defect well.

[0066] For example, Figure 3As shown, the applications of some electronic devices are placed by users, and deleting shortcut icons and application names will not cause the rearrangement of desktop shortcut icons. Therefore, empty areas will be left after hiding. Arranging the applications of shortcut icons that are not hidden in sequence and displaying them can make the empty areas disappear, such as Figure 5 As shown, it is difficult to see any trace of the application hiding.

[0067] Sub-step 20222, when the operation interface of the application in the privacy mode is displayed on the current interface, the privacy data identified from the operation interface is used as the target content.

[0068] In an embodiment of the present application, the privacy data may be text information, picture information, audio information, and video information. By detecting the front-end label of the application's operating interface, the text information, picture information, audio information, and video information that may contain privacy information are hidden.

[0069] For example, taking opening a browser as an example, the front-end tag corresponding to the text information is <input value＝"您的密码是********"> , at this time, the front-end tag corresponding to the text information <input> Hide can hide text information, and the front-end label of image information is<image src="https: / / ******"> , the front-end tag of the picture information Hide can hide the image information. Correspondingly, the front-end tag corresponding to the audio information is <source> Etc., the front-end tag corresponding to the video information is <video>wait.

[0070] Optionally, in addition to hiding the privacy data, the privacy data may be protected by forming a cover layer above the privacy data.

[0071] Optionally, after step 202, the method further includes:

[0072] Sub-step 2023, adding a privacy mode control to the task bar of the display interface; the privacy mode control is used to remind that some applications are in privacy mode

[0073] In the embodiment of the present application, a privacy mode control is added to the taskbar of the display interface to indicate that the current display mode is hidden. The working mode of some applications is privacy mode, and the shortcut icons and application names of applications in privacy mode are hidden. When there is no privacy mode control, users are likely to forget which display mode they are currently in, and it is easy to find that the application icon has been hidden after searching for the application many times, which brings inconvenience to the user. Therefore, by adding a privacy mode control to the taskbar of the display interface, users are reminded of the current display state, which reduces the discomfort caused to users by the hidden application.

[0074] Optionally, the icon of the privacy mode control can be set by the user to prevent people other than the user from identifying it, thereby improving the privacy of the privacy mode control.

[0075] Step 203, when the expression category belongs to the second expression category, enable the normal display mode to normally display all the contents of the application program in the interface in the normal display mode.

[0076] This step can be specifically referred to the above step 103, which will not be repeated here.

[0077] Step 204: When the expression category belongs to the third expression category, the display modes of all application programs are adjusted to an anti-peeping display mode.

[0078] like Figure 6 As shown, in addition to adopting functionally opposing hiding or displaying, a display control method between the two can also be adopted. When the user has a need to protect the privacy of the shortcut icon of the application he is using, but does not have high requirements for the effect required to be achieved by such a need, or when hiding the shortcut icon of the application will affect the normal use of the user, a facial image with a third expression category of the user is obtained through an electronic device, and when the expression category is identified as the third expression category, the display mode of the application is adjusted to an anti-peeping display mode. This will not affect the normal use due to the hiding of the shortcut icon of the application, and will also enable the application to have a certain anti-peeping effect, thereby meeting the privacy needs of the user in more scenarios.

[0079] Step 205: After all the applications enter the anti-peeping display mode, the transparency of the shortcut icons of all the applications is adjusted according to a preset value, and the names of the applications are hidden.

[0080] In the embodiment of the present application, by presetting the transparency of the application shortcut icon, adjusting the transparency of the application shortcut icon after entering the anti-peep display mode, and hiding the application name, the user of the electronic device usually occupies the best viewing position of the screen of the electronic device. Therefore, reducing the transparency of the shortcut icon, although it has a partial impact on the user's experience, it does not affect the user's normal use of the application in the electronic device. When the bystander is in a bystander position other than the best position occupied by the user, after adjusting the transparency of the shortcut icon and hiding the application name, the information that the bystander can obtain will be greatly reduced.

[0081] In addition, since the transparency is set according to a preset value, the set transparency value is within the acceptable range for the user, and combined with the user's familiarity with their own electronic devices, the discomfort during use can be reduced, while also achieving a certain anti-peeping effect and meeting the user's privacy needs.

[0082] For example, when the preset transparency value is 60% and the application name is hidden, the user, relying on his / her proficiency in use and being in the best viewing position of the electronic device, looks directly at the screen, which will only have a small impact on the user's normal use. However, a bystander is in the bystander position, looks at the screen sideways, and there is no application name and shortcut icon with 60% transparency, so the information obtained by the bystander is greatly reduced.

[0083] Optionally, the application has a desktop plug-in component, and the method further includes:

[0084] Step 206, when the expression category belongs to the first expression category, adjusting the display mode of the desktop plug-in component of the application to a private display mode, so as to hide the target content of the desktop plug-in component in the interface in the private display mode.

[0085] Among them, the desktop plug-in component of the application is a partial data display plug-in of the application. The desktop plug-in component is used to display data content that cannot be displayed by the application shortcut icon, so that users can obtain data without entering the application.

[0086] For example, a weather application has a desktop plug-in component that displays a line graph of temperature changes throughout the day; a sports application has a desktop plug-in component that displays calories consumed that day; and an accounting application has a desktop plug-in component that records a line graph of daily expenses.

[0087] In an embodiment of the present application, when the user's expression category is identified as the first expression category, the display mode of the application's desktop plug-in component is adjusted to a privacy mode, so that the data content displayed by the desktop plug-in component is protected and consistent with the display mode of the application's shortcut icon and application name, thereby improving the hiding effect.

[0088] Step 207, when the expression category belongs to the second expression category, adjusting the display mode of the desktop plug-in component of the application to a normal display mode, so as to normally display all contents of the desktop plug-in component in the interface in the normal display mode.

[0089] In an embodiment of the present application, when it is recognized that the user's expression category is the second expression category, the display mode of the application's desktop plug-in component is adjusted to normal mode, so that the desktop component releases all negative display effects such as hiding or reducing transparency, so that the user can quickly restore the normal display of the desktop plug-in component through an expression.

[0090] Step 208, when the expression category belongs to the third expression category, the display mode of the desktop plug-in component of the application is adjusted to an anti-peeping display mode, so as to adjust the transparency display of the desktop plug-in component in the interface according to a preset value in the normal display mode, and hide the name of the plug-in component.

[0091] In an embodiment of the present application, when it is recognized that the user's expression category is the third expression category, the display mode of the desktop plug-in component of the application is adjusted to the anti-peeping mode, the transparency of the desktop plug-in component is adjusted according to a preset value, and the name of the desktop plug-in component is hidden, so that the information obtained by the bystander from the bystander perspective is greatly reduced.

[0092] Optionally, the method further includes:

[0093] Step 209, when the facial information of the user's facial image is inconsistent with the preset user facial information, enter the privacy display mode to hide the target content of the application in the interface in the privacy display mode.

[0094] Among them, the preset user facial information is the facial information stored in the electronic device for unlocking. Usually, the facial information of the owner of the electronic device is stored in the electronic device. When the facial information of the user's facial image is inconsistent with the preset user facial information, it is assumed that the user at this time is not the owner of the electronic device. Therefore, it automatically enters the privacy mode to hide the private information, so that the electronic device can protect the privacy content of the electronic device without receiving the owner's instructions.

[0095] Optionally, the method further includes:

[0096] Step 210: When the display mode of the application is other than the normal mode, start an abnormal timer.

[0097] Among them, the abnormal timer is used to record the time when the application enters other modes except the normal mode, so as to prevent the user from forgetting that it is not in the normal mode at this time and staying in other modes except the normal mode for too long, thereby affecting the user experience.

[0098] Step 211, when the timing result of the abnormal timer reaches the preset time threshold, enter the step of enabling the normal display mode to normally display all the contents of the application in the interface in the normal display mode.

[0099] Optionally, the preset time threshold is set to one day, and can also be set according to the user's habits.

[0100] In the embodiment of the present application, since the normal display mode is the normal state when the electronic device is used, it is necessary to have a function of automatically entering the normal display mode. Except for the user actively entering the normal display mode by relying on memory, most other situations are scenarios where the user finds that he has forgotten to enter the normal mode. In this situation, it is easy to cause negative emotions in the user and cause a bad user experience. Therefore, the normal display mode is entered by regularly switching through the abnormal timer to reduce the psychological burden of the user during operation.

[0101] Optionally, the user's facial information is stored, and the method further includes:

[0102] Step 212, when an application is in privacy mode and the screen of the electronic device is naturally turned off, obtain the unlocking method for unlocking the electronic device again.

[0103] Among them, natural screen off refers to the situation where the electronic device automatically locks the screen to save energy after the user has not operated for a period of time. When a program is in privacy mode and has not been operated for a period of time, it can be preliminarily determined that the user's privacy protection needs are not strong at this time. If the user currently does not need to operate the application and has privacy protection needs, the screen will usually be locked actively, and the screen will not be turned off naturally.

[0104] Step 213, when the unlocking method is to unlock through the user's facial information, enter the step of enabling the normal display mode to normally display all the contents of the application in the interface in the normal display mode.

[0105] In this embodiment, when the unlocking method obtained is unlocking through the user's facial information, it indicates that the user is the owner of the electronic device himself, and because the screen is naturally turned off, it is preliminarily determined that the user's privacy needs are not strong at this time, so it automatically enters the normal display mode to reduce the burden of the user switching display modes and improve the user experience.

[0106] In summary, in the embodiment of the present application, by obtaining the user's facial image, the facial image is input into the facial information model to obtain the corresponding expression category. When the expression category belongs to the first expression category, the privacy display mode is enabled to hide the target content. The user can set the target content to be hidden, so that the user's privacy content can be hidden through the expression. When the expression category belongs to the second expression category, the normal display mode is enabled, so that the privacy display mode can be switched to the normal display mode more conveniently, reducing the impact on the user's normal use. When the expression category belongs to the third expression category, the anti-peeping display mode is enabled, so that the amount of information that can be obtained from the bystander's perspective can be reduced without affecting the user's normal use. The display control process of the embodiment of the present application is realized through expression recognition, and there is no need for the user to manually switch the display mode. While protecting the user's privacy, it also makes the privacy protection process simpler and improves the user experience.

[0107] like Figure 7 As shown, the embodiment of the present application proposes a display control device for an application program, such as Figure 2 As shown, the device may include:

[0108] The information detection module 301 is used to obtain a facial image of a user, input the facial image into a facial information model, and obtain an expression category corresponding to the facial image; the facial information model is used to determine the corresponding expression category according to the facial information in the facial image;

[0109] A privacy mode module 302, configured to enable a privacy display mode when the expression category belongs to a first expression category, so as to hide the target content of the application program in the interface in the privacy display mode;

[0110] The recovery module 303 is used to enable the normal display mode when the expression category belongs to the second expression category, so as to normally display all the contents of the application program in the interface in the normal display mode.

[0111] Optionally, the privacy mode module 302 may specifically include:

[0112] The privacy mode submodule is used to obtain an application list including all applications when the desktop is displayed on the current interface, and search for applications whose working mode is the privacy mode in the application list; the application list records the working mode of the application.

[0113] The hiding submodule is used to determine the target content from the displayed content of the application in the privacy mode, and hide the target content in the interface.

[0114] Optionally, the hidden submodules may specifically include:

[0115] The desktop unit is used to use the shortcut icon and application name of the application in the privacy mode as the target content when the desktop is displayed on the current interface.

[0116] The operation interface unit is used to use the privacy data identified from the operation interface as the target content when the operation interface of the application program in the privacy mode is displayed on the current interface.

[0117] Optionally, the desktop unit may specifically include:

[0118] The rearrangement subunit is used to arrange the applications of the shortcut icons that are not hidden in sequence and then display them after the target content is hidden.

[0119] Optionally, the privacy mode module 302 may specifically include:

[0120] The reminder control submodule is used to add a privacy mode control in the taskbar of the display interface; the privacy mode control is used to remind that some applications are in privacy mode.

[0121] Optionally, the device further comprises:

[0122] The anti-peeping mode module is used to adjust the display modes of all application programs to the anti-peeping display mode when the expression category belongs to the third expression category.

[0123] The transparency module is used to adjust the transparency of the shortcut icons of all the applications according to a preset value and hide the names of the applications when all the applications enter the anti-peeping display mode.

[0124] Optionally, the device further comprises:

[0125] A plug-in privacy module, used for adjusting the display mode of the desktop plug-in component of the application to a privacy display mode when the expression category belongs to the first expression category, so as to hide the target content of the desktop plug-in component in the interface in the privacy display mode; the target content includes the icon and name of the desktop plug-in component;

[0126] A plug-in normal module, used for adjusting the display mode of the desktop plug-in component of the application to a normal display mode when the expression category belongs to the second expression category, so as to display all contents of the desktop plug-in component in the interface normally in the normal display mode;

[0127] A plug-in anti-peeping module is used to adjust the display mode of the desktop plug-in component of the application to an anti-peeping display mode when the expression category belongs to the third expression category, so as to adjust the transparency display of the desktop plug-in component in the interface according to a preset value in the normal display mode, and hide the name of the plug-in component.

[0128] Optionally, the device further comprises:

[0129] The identity authentication module is used to enter the privacy display mode when the facial information of the user's facial image is inconsistent with the preset user facial information, so as to hide the target content of the application in the interface in the privacy display mode.

[0130] Optionally, the device further comprises:

[0131] A timing module, used for starting an abnormal timer when the display mode of the application is other than the normal mode;

[0132] The timing recovery module is used to enter the step of enabling the normal display mode when the timing result of the abnormal timer reaches a preset time threshold, so as to normally display all the contents of the application in the interface in the normal display mode.

[0133] Optionally, the device further comprises:

[0134] A wake-up module, used to obtain an unlocking method for unlocking the electronic device again when an application is in a privacy mode and the screen of the electronic device is naturally turned off;

[0135] The unlock recovery module is used to enter the normal display mode when the unlocking method is unlocking through the user's facial information, so as to normally display all the contents of the application in the interface in the normal display mode.

[0136] In summary, in the embodiment of the present application, by obtaining the user's facial image, the facial image is input into the facial information model to obtain the corresponding expression category. When the expression category belongs to the first expression category, the privacy display mode is enabled to hide the target content. The user can set the target content to be hidden, so that the user's private content can be hidden through the expression. When the expression category belongs to the second expression category, the normal display mode is enabled, so that the privacy display mode can be switched to the normal display mode more conveniently, reducing the impact on the user's normal use. The display control process of the embodiment of the present application is realized through expression recognition, and there is no need for the user to manually hide and cancel the hiding. While protecting the user's privacy, it also makes the privacy protection process simpler and improves the user experience.

[0137] See also Figure 8 , the electronic device 400 may include one or more of the following components: a processing component 402 , a memory 404 , a power component 406 , a multimedia component 408 , an audio component 410 , an input / output (I / O) interface 412 , a sensor component 414 , and a communication component 416 .

[0138] The processing component 402 generally controls the overall operation of the electronic device 400, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 402 may include one or more processors 420 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 402 may include one or more modules to facilitate the interaction between the processing component 402 and other components. For example, the processing component 402 may include a multimedia module to facilitate the interaction between the multimedia component 408 and the processing component 402.

[0139] The memory 404 is used to store various types of data to support the operation of the electronic device 400. Examples of such data include instructions for any application or method operating on the electronic device 400, contact data, phone book data, messages, pictures, multimedia, etc. The memory 404 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0140] The power supply component 406 provides power to the various components of the electronic device 400. The power supply component 406 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 400.

[0141] The multimedia component 408 includes an interface that provides an output interface between the electronic device 400 and the user. In some embodiments, the interface may include a liquid crystal display (LCD) and a touch panel (TP). If the interface includes a touch panel, the interface may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 408 includes a front camera and / or a rear camera. When the electronic device 400 is in an operating mode, such as a shooting mode or a multimedia mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0142] The audio component 410 is used to output and / or input audio signals. For example, the audio component 410 includes a microphone (MIC), and when the electronic device 400 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is used to receive an external audio signal. The received audio signal can be further stored in the memory 404 or sent via the communication component 416. In some embodiments, the audio component 410 also includes a speaker for outputting audio signals.

[0143] The input / output I / O interface 412 provides an interface between the processing component 402 and the peripheral interface module, which may be a keyboard, a click wheel, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0144] The sensor assembly 414 includes one or more sensors for providing various aspects of status assessment for the electronic device 400. For example, the sensor assembly 414 can detect the open / closed state of the electronic device 400, the relative positioning of components, such as the display and keypad of the electronic device 400, and the sensor assembly 414 can also detect the position change of the electronic device 400 or a component of the electronic device 400, the presence or absence of user contact with the electronic device 400, the orientation or acceleration / deceleration of the electronic device 400, and the temperature change of the electronic device 400. The sensor assembly 414 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 414 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 414 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0145] The communication component 416 is used to facilitate wired or wireless communication between the electronic device 400 and other devices. The electronic device 400 can access a wireless network based on a communication standard, such as WiFi, a carrier network (such as 2G, 3G, 4G or 5G), or a combination thereof. In an exemplary embodiment, the communication component 416 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 416 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0146] In an exemplary embodiment, the electronic device 400 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to implement a method for displaying a vehicle-road collaborative scenario provided in an embodiment of the present application.

[0147] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 404 including instructions, and the instructions can be executed by a processor 420 of an electronic device 400 to perform the above method. For example, the non-transitory storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0148] Fig. 9 is a block diagram of an electronic device 500 according to another embodiment of the present application. For example, the electronic device 500 may be provided as a server. Fig. 9 , the electronic device 500 includes a processing component 522, which further includes one or more processors, and a memory resource represented by a memory 532 for storing instructions executable by the processing component 522, such as an application. The application stored in the memory 532 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 522 is configured to execute instructions to execute a method for displaying a vehicle-road cooperative scenario provided in an embodiment of the present application.

[0149] The electronic device 500 may also include a power supply component 526 configured to perform power management of the electronic device 500, a wired or wireless network interface 550 configured to connect the electronic device 500 to a network, and an input / output (I / O) interface 558. The electronic device 500 may operate based on an operating system stored in the memory 532, such as Windows Server TM, Mac OS X TM, Unix TM, Linux TM, Free BSD TM or the like.

[0150] In an embodiment of the present application, the memory 632 may be used to store software programs and various data. The memory 632 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 632 may include a volatile memory or a non-volatile memory, or the memory 632 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 632 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0151] The processor may include one or more processing units; optionally, the processor integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to the operating system, user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor.

[0152] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned image super-resolution reconstruction method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0153] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0154] An embodiment of the present application also provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the super-resolution reconstruction method embodiment of the above-mentioned image, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0155] It should be noted that the various information and data obtained in the embodiments of the present application are obtained with the authorization of the information / data holder. All actions of obtaining signals, information or data in the present application are carried out in compliance with the relevant data protection laws and policies of the country of residence and with the authorization given by the corresponding device owner.

[0156] The algorithm and display provided herein are not inherently related to any particular computer, virtual system or other device. Various general purpose systems can also be used together with the teachings based on this. According to the above description, it is obvious that the structure required for constructing such systems. In addition, the application is not directed to any specific programming language either. It should be understood that various programming languages ​​can be utilized to realize the content of the application described herein, and the description of the specific language above is for the purpose of disclosing the best mode of implementation of the application.

[0157] In the description provided herein, a large number of specific details are described. However, it is understood that the embodiments of the present application can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0158] Similarly, it should be understood that in order to streamline the present application and help understand one or more of the various application aspects, in the above description of the exemplary embodiments of the present application, the various features of the present application are sometimes grouped together into a single embodiment, figure, or description thereof. However, the disclosed method should not be interpreted as reflecting the following intention: the claimed application requires more features than the features clearly stated in each claim. More specifically, as reflected in the claims below, the application aspects are less than all the features of the single embodiment disclosed above. Therefore, the claims following the specific embodiment are hereby expressly incorporated into the specific embodiment, wherein each claim itself serves as a separate embodiment of the present application.

[0159] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and in addition they may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this manner may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.

[0160] The various component embodiments of the present application can be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or digital signal processor (DSP) can be used in practice to implement some or all functions of some or all components in the sorting device according to the present application. The present application can also be implemented as a device or apparatus program for executing part or all of the methods described herein. Such a program implementing the present application can be stored on a computer-readable medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0161] It should be noted that the above embodiments illustrate the present application rather than limit the present application, and that those skilled in the art may design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets should not be constructed as a limitation to the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present application may be implemented by means of hardware including a number of different elements and by means of a suitably programmed computer. In a unit claim that lists a number of devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc. does not indicate any order. These words may be interpreted as names.

[0162] The user information (including but not limited to the user's device information, user personal information, etc.) and related data involved in this application are all information authorized by the user or by all parties.

[0163] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0164] The above are only preferred embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application should be included in the protection scope of the present application.

[0165] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.< / video>

Claims

1. A display control method for an application, characterized in that: The method comprises: Acquire a facial image of a user, input the facial image into a facial information model, and obtain an expression category corresponding to the facial image; the facial information model is used to determine the corresponding expression category according to facial information in the facial image; When the expression category belongs to the first expression category, enabling a privacy display mode to hide the target content of the application program in the interface in the privacy display mode; When the expression category belongs to the second expression category, the normal display mode is enabled to normally display all contents of the application program in the interface in the normal display mode.

2. The method according to claim 1, characterized in that When the expression category belongs to the first expression category, enabling the privacy display mode to hide the target content of the application program in the interface in the privacy display mode includes: When the desktop is displayed on the current interface, an application list including all applications is obtained, and an application whose working mode is a privacy mode is searched in the application list; the working mode of the application is recorded in the application list; The target content is determined from the displayed content of the application in the privacy mode, and the target content is hidden in the interface.

3. The method according to claim 2, characterized in that The step of determining target content from the displayed content of the application in the privacy mode includes: When the desktop is displayed on the current interface, the shortcut icon and the application name of the application in the privacy mode are used as the target content; When the operation interface of the application in the privacy mode is displayed on the current interface, the privacy data identified from the operation interface is used as the target content.

4. The method according to claim 3, characterized in that After taking the shortcut icon and the application name of the privacy mode application as the target content, the method further includes: After the target content is hidden, the applications of the shortcut icons that are not hidden are arranged in sequence and then displayed.

5. The method according to claim 1, characterized in that After enabling the privacy display mode to hide the target content of the application in the interface in the privacy display mode, the method further includes: A privacy mode control is added to the taskbar of the display interface; the privacy mode control is used to remind that some applications are in privacy mode.

6. The method according to claim 1, characterized in that The application program has an application program name below the shortcut icon, and the method further includes: When the expression category belongs to the third expression category, adjusting the display modes of all application programs to an anti-peeping display mode; When all the applications enter the anti-peeping display mode, the transparency of the shortcut icons of all the applications is adjusted according to a preset value, and the names of the applications are hidden.

7. The method according to claim 6, characterized in that The application program has a desktop plug-in component, and the method further comprises: When the expression category belongs to the first expression category, adjusting the display mode of the desktop plug-in component of the application to a privacy display mode, so as to hide the target content of the desktop plug-in component in the interface in the privacy display mode; the target content includes the icon and name of the desktop plug-in component; When the expression category belongs to the second expression category, adjusting the display mode of the desktop plug-in component of the application to a normal display mode, so as to normally display all contents of the desktop plug-in component in the interface in the normal display mode; When the expression category belongs to the third expression category, the display mode of the desktop plug-in component of the application is adjusted to an anti-peeping display mode, so that the transparency of the desktop plug-in component in the interface is adjusted according to a preset value in the normal display mode, and the name of the plug-in component is hidden.

8. The method according to claim 1, characterized in that The method further comprises: When the facial information of the user's facial image is inconsistent with the preset user facial information, the step of enabling the privacy display mode is entered to hide the target content of the application in the interface in the privacy display mode.

9. The method according to claim 1, characterized in that: The method further comprises: When the display mode of the application is other than the normal mode, starting an abnormal timer; When the timing result of the abnormal timer reaches the preset time threshold, the step of enabling the normal display mode is entered to normally display all the contents of the application program in the interface in the normal display mode.

10. The method according to claim 1, characterized in that The user's facial information is stored, and the method further includes: When an application is in privacy mode and the screen of the electronic device is naturally turned off, obtaining an unlocking method for unlocking the electronic device again; When the unlocking method is to unlock by the facial information of the user, the step of entering the enabling normal display mode is performed to normally display all contents of the application in the interface in the normal display mode.

11. A display control device for an application, characterized in that: The device comprises: An information detection module is used to obtain a facial image of a user, input the facial image into a facial information model, and obtain an expression category corresponding to the facial image; the facial information model is used to determine a corresponding expression category according to facial information in the facial image; A privacy mode module, used to enable a privacy display mode when the expression category belongs to a first expression category, so as to hide the target content of the application program in the interface in the privacy display mode; The recovery module is used to enable the normal display mode when the expression category belongs to the second expression category, so as to normally display all the contents of the application program in the interface in the normal display mode.

12. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the method according to any one of claims 1 to 10 are implemented.

13. A readable storage medium, characterized in that: When the instructions in the readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the method as claimed in any one of method claims 1 to 10.

Images