Screen control method and device, terminal equipment and computer readable storage medium
By using a camera module to collect facial image information in the terminal device, the display screen is automatically turned off, solving the problems of high power consumption of mobile phone screens and complicated user operation, and realizing energy-saving and convenient screen control.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- XIAN WINGTECH INFORMATION TECH CO LTD
- Filing Date
- 2022-12-14
- Publication Date
- 2026-04-14
AI Technical Summary
In existing technologies, mobile phone screens need to remain lit for a set time before turning off, resulting in high power consumption of terminal devices and complicated manual screen-off operations for users.
The camera module captures facial images of people in front of the display screen, determines whether the preset screen-off conditions are met, and automatically controls the display screen to turn off, avoiding automatic screen-off after a set time.
It reduces the power consumption of terminal devices, simplifies the screen-off operation, avoids manual user intervention, and is suitable for various terminal devices such as mobile phones and tablets.
Smart Images

Figure CN115904052B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of terminal equipment technology, and in particular to a screen control method, apparatus, terminal equipment, and computer-readable storage medium. Background Technology
[0002] Mobile phones are an indispensable tool for life and production in modern society. To make it easier for users to unlock their phones, most mobile phones now support the raise-to-wake function. When the display screen lights up, if the user does not operate the phone within a set time, the display screen will turn off. Generally speaking, this set time is more than a few seconds, which leads to a large power consumption of the terminal device. Summary of the Invention
[0003] Therefore, it is necessary to provide a screen control method, apparatus, terminal device, and computer-readable storage medium that can reduce the power consumption of terminal devices in order to address the above-mentioned technical problems.
[0004] This application provides a screen control method applied to a terminal device, the terminal device being equipped with a camera module and a display screen, the method comprising:
[0005] When a screen-on trigger operation is detected, the camera module is activated.
[0006] The camera module, once activated, captures facial image information of the person's face in front of the display screen.
[0007] The facial image information is used to determine whether the preset screen-off conditions are met;
[0008] When it is determined that the facial image information meets the preset screen-off condition, the display screen is controlled to turn off.
[0009] In one embodiment, controlling the display screen to turn off includes:
[0010] The display screen is controlled to be in a locked state, wherein, when the display screen is in the locked state, the display screen is off and the terminal device is prohibited from responding to screen-on trigger operations.
[0011] In one embodiment, after controlling the display screen to be in a locked state, the method further includes:
[0012] When the unlocking conditions are met, the display screen is controlled to exit the locked state, wherein when the display screen exits the locked state, the terminal device is allowed to respond to the screen-on trigger operation;
[0013] The unlocking conditions include at least one of the following:
[0014] The duration for which the display screen remains locked reaches a first preset duration;
[0015] A preset unlocking operation was detected on the terminal device;
[0016] The terminal device remains in the same posture for a duration that reaches the second preset duration.
[0017] In one embodiment, triggering the camera module to turn on when a screen-on trigger operation is detected includes:
[0018] When a screen-on trigger operation is detected, the camera module is activated and the display screen is kept off.
[0019] In one embodiment, the screen-on trigger operation includes at least one of the following:
[0020] The lift operation performed on the terminal device;
[0021] A click operation performed on the display screen;
[0022] A pressing operation performed on a physical button, wherein the physical button is located on the terminal device.
[0023] In one embodiment, determining whether a preset screen-off condition is met based on the facial image information includes:
[0024] The facial image information is used to determine whether at least two of the first, second, and third conditions are met;
[0025] If at least two of the first condition, the second condition, and the third condition are met, then it is determined that the preset screen-off condition is met.
[0026] The first condition is that the ratio of the distance from the tip of the nose to the bottom of the chin to the length of the face, as indicated by the facial image information, is less than a preset ratio K, where 1 / 6 < K < 1 / 2; the second condition is that the number of skin wrinkles on the face, as indicated by the facial image information, is zero; and the third condition is that the eye state of the face, as indicated by the facial image information, is either not looking directly at the face or has its eyes closed.
[0027] In one embodiment, the terminal device pre-stores target facial image information, and the step of determining whether a preset screen-off condition is met based on the facial image information includes:
[0028] The collected facial image information and the target facial image information are matched for consistency.
[0029] When the collected facial image information matches the target facial image information, it is determined that the preset screen-off condition is met.
[0030] This application provides a screen control device for use in a terminal device, wherein the terminal device is equipped with a camera module and a display screen, and the device includes:
[0031] The trigger module is used to trigger the camera module to turn on when a screen-on trigger operation is detected;
[0032] The camera module is used to capture facial image information of the person in front of the display screen of the terminal device through the camera module after it is turned on;
[0033] The judgment module is used to determine whether the preset screen-off conditions are met based on the facial image information;
[0034] The control module is used to control the display screen to turn off when it is determined that the facial image information meets the preset screen-off conditions.
[0035] In one embodiment, the control module includes a locking unit, which controls the display screen to be in a locked state. When the display screen is in the locked state, the display screen is off and the terminal device is prohibited from responding to screen-on trigger operations.
[0036] In one embodiment, the screen control device further includes an unlocking module, which is used to control the display screen to exit the locked state when the unlocking conditions are met, wherein when the display screen exits the locked state, the terminal device is allowed to respond to the screen-on trigger operation;
[0037] The unlocking conditions include at least one of the following:
[0038] The duration for which the display screen remains locked reaches a first preset duration;
[0039] A preset unlocking operation was detected on the terminal device;
[0040] The terminal device remains in the same posture for a duration that reaches the second preset duration.
[0041] In one embodiment, the triggering module further includes a triggering unit, which is used to trigger the camera module to turn on and maintain the screen-off state of the display screen when a screen-on triggering operation is detected.
[0042] In one embodiment, the judgment module includes a first judgment unit, which is used to determine whether at least two of the first, second, and third conditions are met based on the facial image information; the first judgment unit is further used to determine that the preset screen-off condition is met if at least two of the first, second, and third conditions are met; wherein, the first condition is that the ratio of the distance from the tip of the nose to the bottom of the chin to the length of the face, as indicated by the facial image information, is less than a preset ratio K, 1 / 6 < K < 1 / 2; the second condition is that the number of skin wrinkles on the face, as indicated by the facial image information, is zero; and the third condition is that the eye state of the face, as indicated by the facial image information, is in a non-facing state or a closed-eye state.
[0043] In one embodiment, the terminal device pre-stores target face image information, and the judgment module includes a second judgment unit. The second judgment unit is used to perform consistency matching between the collected face image information and the target face image information. The second judgment unit is also used to determine that the preset screen-off condition is met when the collected face image information is matched with the target face image information.
[0044] This application provides a terminal device, including a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the steps of the screen control method provided in any embodiment of this application.
[0045] This application provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of the screen control method provided in any embodiment of this application.
[0046] The screen control method provided in this application can be applied to terminal devices. When a screen-on trigger operation is detected, the camera module is activated. The camera module acquires facial image information of a person's face in front of the terminal device's display screen and determines whether a preset screen-off condition is met based on the facial image information. If the facial image information meets the preset screen-off condition, the display screen is controlled to turn off. The screen control method provided in this application can automatically control the display screen to turn off based on facial image information, eliminating the need for a continuously set time before the display screen turns off, thereby reducing the power consumption of the terminal device. Attached Figure Description
[0047] Figure 1 This is a schematic diagram of the structure of a terminal device in one embodiment;
[0048] Figure 2 This is a flowchart illustrating a screen control method in one embodiment;
[0049] Figure 3 This is a flowchart illustrating the screen control method in another embodiment;
[0050] Figure 4 This is a flowchart illustrating a method for determining preset screen-off conditions in one embodiment;
[0051] Figure 5 This is a flowchart illustrating the preset screen-off condition determination method in another embodiment;
[0052] Figure 6 This is a schematic diagram of the interface settings in one embodiment;
[0053] Figure 7 This is a structural block diagram of the screen control device in one embodiment;
[0054] Figure 8 This is an internal structure diagram of a terminal device in one embodiment. Detailed Implementation
[0055] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0056] As described in the background section, most mobile phones currently support the raise-to-wake function. However, once the screen is on, even if unlocking fails, the display needs to remain lit for a set time before turning off, leading to high power consumption. Related technologies also allow users to manually turn off the screen, but this increases the complexity of the screen-off operation.
[0057] In view of this, this application provides a screen control method that can be applied to a terminal device. When a screen-on trigger operation is detected, a camera module is activated. The camera module acquires facial image information of a person's face in front of the terminal device's display screen and determines whether a preset screen-off condition is met based on the facial image information. If the facial image information meets the preset screen-off condition, the display screen is turned off. The screen control method provided in this application can automatically control the display screen to turn off based on the facial image information of a person's face in front of the display screen, eliminating the need for a continuously set time before the display screen turns off, thereby reducing the terminal device's power consumption and eliminating the need for the user to manually turn off the screen.
[0058] The screen control method provided in this application can be applied to terminal devices, which can be, but are not limited to, various personal computers, laptops, smartphones, tablets, and portable wearable devices. Figure 1As shown, the terminal device 100 may include a display screen 110 and a camera module 120. The display screen 110 has two states: on and off. When the display screen 110 is on, it emits light to display data; when the display screen 110 is off, it does not emit light, and the camera module 120 can be used to acquire image data and / or video data.
[0059] Please refer to Figure 2 This illustrates a screen control method provided in an embodiment of this application, which can be applied to, for example... Figure 1 The terminal device shown. (For example...) Figure 2 As shown, the method may include steps S220 to S280.
[0060] S220 triggers the camera module to turn on when a screen-on operation is detected.
[0061] It should be noted that the screen-on trigger operation is an operation used to instruct the terminal device to control the display screen to enter the screen-on state. This screen-on trigger operation can be personalized according to the user's settings, or it can be uniformly set by the terminal device at the factory. This application embodiment does not limit this.
[0062] Optionally, the screen-on trigger operation may include at least one of the following: a lift-up operation on the terminal device, a click operation on the display screen of the terminal device, and a press operation on a physical button, wherein the physical button is located on the terminal device. Optionally, the terminal device may be provided with one or more physical buttons, such as... Figure 1 As shown, the terminal device is equipped with multiple physical buttons 130. When the terminal device is equipped with multiple physical buttons 130, the pressing operation of the physical buttons 130 can include pressing operations of at least two of the multiple physical buttons 130 simultaneously. Optionally, the terminal device is equipped with a posture sensor, and the terminal device can determine whether the terminal device has been lifted by the detection signal of the posture sensor.
[0063] In an optional embodiment, when a screen-on trigger operation is detected, the camera module is activated, including: activating the camera module and controlling the display screen to enter a screen-on state. Since users are accustomed to the terminal device's display screen turning on when a screen-on trigger operation is detected, this embodiment controls the display screen to enter a screen-on state upon detecting the trigger operation, thus not changing the user's habits. Simultaneously, data, such as time, can be displayed on the screen while it is in a screen-on state, allowing the user to obtain information.
[0064] In another optional embodiment, triggering the camera module to turn on when a screen-on trigger operation is detected can include: triggering the camera module to turn on and maintaining the screen-off state of the display screen. This embodiment can further reduce the power consumption of the terminal device by maintaining the screen-off state even before determining whether the facial image information meets the preset screen-off conditions.
[0065] S240 captures facial image information of people in front of the display screen through the activated camera module.
[0066] It should be noted that facial image information can be used to indicate the features of a face displayed on the screen. For example, facial image information can be used to indicate whether a face has wrinkles, the proportions of the face, and the features of key facial features (such as whether the mouth is smiling), etc.
[0067] S260 uses facial image information to determine whether preset screen-off conditions are met.
[0068] It should be noted that the preset screen-off condition is used to indicate the conditions under which the terminal device needs to control the display screen to be in a screen-off state. The preset screen-off condition can be set as needed. In an optional embodiment, the preset screen-off condition includes facial image information indicating that the eyes of the face in front of the display screen are not looking directly at the screen. It is understood that when the eyes of the face in front of the display screen are not looking directly at the screen, the probability of accidentally triggering a screen-on operation is high. Controlling the display screen to be off in this situation can avoid the terminal device needing to maintain the screen on for at least a set time due to accidental triggering of the screen-on operation, thus preventing excessive power consumption.
[0069] S280: When it is determined that the face image information meets the preset screen-off conditions, the display screen is turned off.
[0070] Since screen-on triggering operations can occur erroneously for various reasons, meaning the user of the terminal device may not want the display screen to light up, but the terminal device may still detect the screen-on triggering operation. In this case, by comparing the facial image information of the person in front of the screen, it can be determined whether the preset screen-off conditions are met. If the preset screen-off conditions are met, the display screen is controlled to turn off, thus eliminating the need for the user to manually instruct the terminal device to turn off the screen (such as by clicking the corresponding physical button), simplifying the screen-off operation, and eliminating the need to wait for a set time for the display screen to turn off, thereby reducing the power consumption of the terminal device.
[0071] In an optional embodiment, if it is determined that the facial image information does not meet the preset screen-off conditions, the display screen is controlled to turn on. In this embodiment, when it is determined that the facial image information does not meet the preset screen-off conditions, the display screen is controlled to turn on, which can provide unlocking instructions to the user through the on-screen display. For example, for facial unlocking, the display screen can instruct the user to move closer to or further away from the display screen to facilitate the acquisition of facial image information, i.e., it can instruct the user to perform facial unlocking. Simultaneously, if the accuracy of facial unlocking depends on ambient light, controlling the display screen to turn on when the ambient light is less than the preset brightness can compensate for the ambient light level and meet the requirements of facial unlocking.
[0072] Please refer to Figure 3 This illustrates a screen locking control method provided in an embodiment of this application, such as... Figure 3 As shown, when it is determined that the face image information meets the preset screen-off conditions, the step of controlling the display screen to turn off may include step S282.
[0073] S282, when it is determined that the face image information meets the preset screen-off conditions, the display screen is controlled to be locked.
[0074] Specifically, when the display screen is locked, it remains off, and the terminal device is prohibited from responding to screen-on triggers. It should be noted that when the facial image information meets the preset screen-off conditions, the display screen is locked. Even if a screen-on trigger is executed at this time, the terminal device will not activate the camera module or keep the display screen on, thus avoiding the problem of frequent camera module activation or screen lighting, which would lead to high power consumption. Understandably, since the terminal device only locks the display screen when the facial image information meets the preset screen-off conditions—that is, only when the terminal device needs to be in a screen-off state, and not when the terminal device needs to keep the display screen on—it does not affect the normal use of the terminal device.
[0075] In an optional embodiment, locking the display screen does not affect other functions of the terminal device. Taking a smartphone as an example, if the smartphone receives an incoming call while the display screen is locked, the call can be answered using the smartphone's physical buttons or other methods. In other words, locking the display screen does not affect the smartphone's ability to answer calls.
[0076] Please continue to refer to this. Figure 3 After the control display screen is in a locked state, the screen control method may further include step S290.
[0077] S290, when the unlocking conditions are met, controls the display screen to exit the locked state.
[0078] Specifically, when the display screen is out of the locked state, the terminal device is allowed to respond to screen-on trigger operations. It should be noted that when the display screen is out of the locked state, the terminal device can control the display screen to enter the on state, or it can keep the display screen off.
[0079] In an optional embodiment, when the display screen exits the locked state, the terminal device allows response to a screen-on trigger operation while maintaining the display screen off. Since the holder of the terminal device may not necessarily need the display screen to enter the on state when the unlocking conditions are met, maintaining the display screen off when the display screen exits the locked state can further reduce the power consumption of the terminal device.
[0080] In an optional embodiment, the unlocking conditions may include the duration for which the display screen is locked reaching a first preset duration, the detection of a preset unlocking operation applied to the terminal device, and the duration for which the terminal device's posture remains unchanged reaching a second preset duration. It should be noted that the duration for which the terminal device's posture remains unchanged reaching the second preset duration means that the terminal device has not been moved within the second preset duration, including that the terminal device's position and angle have not changed; in this case, the terminal device can be considered stationary. The first preset duration, the second preset duration, and the preset unlocking operation can be set as needed, and this application embodiment does not limit them. For example, if the terminal device has a volume down button, the preset unlocking operation applied to the terminal device may include double-clicking the volume down button. Optionally, if the terminal device has a posture sensor, determining whether the terminal device's posture has remained unchanged for the second preset duration may include: determining whether the terminal device's posture has remained unchanged for the second preset duration based on the posture sensor.
[0081] In daily life, infants and young children can come into contact with mobile phones to some extent. When they play with mobile phones, they often turn on the screen. Prolonged close-range staring at a bright mobile phone screen, especially in dim lighting conditions at night, can have a negative impact on the eyesight of infants and young children. This function of mobile phones can also easily attract the attention of infants and young children, leading to a certain degree of dependence.
[0082] In view of this, the present application provides a screen control method. The preset screen-off condition of the screen control method can be at least two of the first condition, the second condition, and the third condition. When the face image information indicates that the face in front of the display screen meets at least two of the first condition, the second condition, and the third condition, the face in front of the display screen can be considered to be the face of an infant or toddler, and the display screen can be controlled to turn off. This can prevent infants and toddlers from staring at a bright mobile phone screen at close range for a long time, protect the eyesight of infants and toddlers, and eliminate the need for human intervention (such as taking the terminal device away from the infant's hands). It can also prevent infants and toddlers from crying and reduce the power consumption of the terminal device.
[0083] Please refer to Figure 4 This illustrates a preset screen-off condition determination method provided by an embodiment of this application, such as... Figure 4 As shown, the step of determining whether the preset screen-off conditions are met by using facial image information may include steps S262 to S264.
[0084] S262, determine whether at least two of the first, second, and third conditions are met based on the facial image information.
[0085] S264 If at least two of the first, second, and third conditions are met, then the preset screen-off condition is satisfied.
[0086] The first condition is that the ratio of the distance from the tip of the nose to the bottom of the chin, as indicated by the facial image information, to the length of the face is less than a preset ratio K. The second condition is that the facial image information indicates that the skin wrinkles on the face are zero. The third condition is that the facial image information indicates that the eyes on the face are in a non-facing state or a closed state. It should be noted that in this application embodiment, each condition can be determined sequentially (this sequential order does not mean the first, second, and third conditions are judged in the same order, but rather that the three conditions are judged in a specific order, not simultaneously), or each condition can be judged simultaneously. In the sequential case, if the first two conditions are met, the third condition can be judged without checking whether the preset screen-off condition is met. Optionally, the preset ratio K can be... or
[0087] In an optional embodiment, determining whether the number of skin wrinkles on a face is zero may include: determining whether the number of first shapes is zero based on the face image information; if the number of first shapes is zero, then determining that the number of skin wrinkles on the face is zero, wherein the shape of the first shape is striped, and the brightness of the pixels constituting the first shape is less than the brightness of the pixels surrounding the first shape.
[0088] In an optional embodiment, determining whether the eyes of a face are in a non-facing state or a closed state may include: extracting the eye region based on the face image information; if the distance between the upper eyelid and the lower eyelid of the eye region is less than a preset distance, then the eyes of the face are determined to be in a closed state; if the pupil of the eye region is not located in the center of the eye, then the eyes of the face are determined to be in a non-facing state.
[0089] It should be noted that, such as Figure 4 The embodiment shown is designed to more accurately determine whether the face in front of the display screen is that of an infant. Therefore, the preset screen-off condition is set to at least two of the first, second, and third conditions to avoid the phenomenon of controlling the screen to turn off when the face in front of the display screen is not that of an infant, which would result in low accuracy of screen-off control.
[0090] The above embodiments describe the case where the preset screen-off condition is at least two of the first, second, and third conditions. The following embodiments will describe the case where the preset screen-off condition is that the collected facial information and the target image facial information are consistent.
[0091] Please refer to Figure 5 This illustrates another method for determining preset screen-off conditions provided in the embodiments of this application, such as... Figure 5 As shown, the step of determining whether the preset screen-off conditions are met by using facial image information may include steps S266 to S268.
[0092] S266 performs consistency matching between the collected facial image information and the target facial image information.
[0093] S268, when the collected face image information matches the target face image information, it is determined that the preset screen-off condition is met.
[0094] The terminal device pre-stores target facial image information, which can optionally be specified by the user. In this embodiment, the user can specify target facial image information, thereby enabling the terminal device to automatically control the display screen to turn off, or even lock, when the facial image information of the person in front of the display screen matches the target facial image information.
[0095] Please refer to Figure 6 This illustrates a settings interface 600 for preset screen-off conditions provided in an embodiment of this application. For example... Figure 6As shown, the settings interface 600 may include a screen-off switching entry 610. The terminal device has a first state and a second state, wherein the first state is when the terminal device executes the screen control method provided in any embodiment of this application, and the second state is when the terminal device does not execute the screen control method provided in any embodiment of this application. The terminal device can switch from the first state to the second state, or from the second state to the first state, in response to a first trigger operation acting on the screen-off switching entry 610. It is understood that when the terminal device is currently in the first state and the first trigger operation is detected, the terminal device is switched from the first state to the second state; when the terminal device is currently in the second state and the first trigger operation is detected, the terminal device is switched from the second state to the first state. This embodiment provides a screen-off switching entry 610, allowing users to indicate whether the terminal device is in the first or second state as needed, thus improving human-computer interaction performance.
[0096] Regarding such Figure 5 In the illustrated embodiment, the terminal device can pre-store multiple preset facial image information, each of which is different. Please continue to refer to... Figure 6 The preset screen-off condition settings interface 600 may include an information switching entry 620 corresponding one-to-one with each preset face image information. The terminal device may, in response to a second trigger operation acting on the information switching entry 620, switch the preset face image information corresponding to the information switching entry 620 from a third state to a fourth state, or from a fourth state to a third state. Specifically, when the preset face image information is in the third state, it is the target face image information; when the preset face image information is in the fourth state, it is not the target face image information. It is understood that when the preset face image information is in the third state and a second trigger operation acting on the information switching entry 620 is detected, the preset face image information is switched from the third state to the fourth state; when the preset face image information is in the fourth state and a second trigger operation acting on the information switching entry 620 is detected, the preset face image information is switched from the fourth state to the third state. In this embodiment, the preset face image information can be set as the target face image information or removed from the target face image information at any time through the information switching entry 620, without having to delete the preset face image information to remove it from the target face image information. At the same time, when it is necessary to use the preset face information as the target face image information again, the user can directly trigger the information switching entry 620 without having to re-enter the preset face image information, which is convenient for the user.
[0097] It should be noted that, Figure 4 and Figure 5As an example only, the preset screen-off conditions in this application embodiment can also be set to other content as needed.
[0098] In another optional embodiment, determining whether the preset screen-off condition is met based on the facial image information may include: if at least two of the first, second, and third conditions are met, or if the collected facial information is consistent with the facial information in the target image, then the preset screen-off condition is met.
[0099] It should be understood that, although Figures 2-5 The steps in the flowchart are shown sequentially as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order in which these steps are executed, and they can be performed in other orders. Figures 2-5 At least some of the steps in the process may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least some of the sub-steps or stages of other steps.
[0100] Please refer to Figure 7 This application illustrates a screen control device 700 provided in an embodiment of the present application. The screen control device 700 can be applied to a terminal device, which is equipped with a camera module and a display screen, such as... Figure 7 As shown, the device may include: a trigger module 702, a camera module 704, a judgment module 706, and a control module 708. The trigger module 702 is used to trigger the camera module to turn on when a screen-on trigger operation is detected. The camera module 704 is used to acquire facial image information of a person's face in front of the terminal device's display screen through the turned-on camera module. The judgment module 706 is used to determine whether a preset screen-off condition is met based on the facial image information. The control module 708 is used to control the display screen to turn off when it is determined that the facial image information meets the preset screen-off condition.
[0101] In an optional embodiment, the control module includes a locking unit for controlling the display screen to be in a locked state. When the display screen is in the locked state, the display screen is off and the terminal device is prohibited from responding to screen-on trigger operations.
[0102] In an optional embodiment, the screen control device may further include an unlocking module, which is used to control the display screen to exit the locked state when an unlocking condition is met. Wherein, when the display screen exits the locked state, the terminal device is allowed to respond to the screen-on trigger operation; the unlocking condition includes at least one of the following:
[0103] The duration for which the display screen remains locked reaches a first preset duration;
[0104] A preset unlocking operation was detected on the terminal device;
[0105] The terminal device remains in the same posture for a duration that reaches the second preset duration.
[0106] In an optional embodiment, the triggering module includes a triggering unit, which is used to trigger the camera module to turn on and maintain the screen-off state of the display screen when a screen-on triggering operation is detected.
[0107] In an optional embodiment, the judgment module includes a first judgment unit, which is used to determine whether at least two of the first, second, and third conditions are met based on the facial image information. The first judgment unit is further used to determine that a preset screen-off condition is met if at least two of the first, second, and third conditions are met. The first condition is that the ratio of the distance from the tip of the nose to the bottom of the chin, as indicated by the facial image information, to the length of the face is less than a preset ratio K, where 1 / 6 < K < 1 / 2; the second condition is that the number of skin wrinkles on the face, as indicated by the facial image information, is zero; and the third condition is that the eyes on the face are in a non-facing or closed-eye state, as indicated by the facial image information.
[0108] In an optional embodiment, the terminal device pre-stores target facial image information, and the judgment module includes a second judgment unit. The second judgment unit is used to perform consistency matching between the collected facial image information and the target facial image information. The second judgment unit is also used to determine that a preset screen-off condition is met when the collected facial image information is found to match the target facial image information.
[0109] For specific limitations regarding the screen control device, please refer to the limitations of the screen control method above, which will not be repeated here. Each module in the aforementioned screen control device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor of the terminal device in hardware form or independently of it, or stored in the memory of the terminal device in software form, so that the processor can call and execute the operations corresponding to each module.
[0110] In an optional embodiment, a terminal device is provided, the internal structure of which can be as follows: Figure 8 As shown, the terminal device includes a processor, memory, communication interface, screen module, and input device connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, carrier networks, Near Field Communication (NFC), or other technologies. When the computer program is executed by the processor, it implements a screen control method. The screen module may include an LCD screen or an e-ink display. The input device may be a touch layer covering the screen module, buttons, a trackball, or a touchpad on the terminal device's casing, or an external keyboard, touchpad, or mouse.
[0111] Please continue to refer to this. Figure 8 In an optional embodiment, the terminal device may further include a camera module and an attitude sensor, which are connected to the processor. Optionally, the camera module and attitude sensor are connected to the processor via a system bus.
[0112] Those skilled in the art will understand that Figure 8 The structure shown is merely a block diagram of a portion of the structure related to the solution of this application and does not constitute a limitation on the terminal device to which the solution of this application is applied. A specific terminal device may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.
[0113] In an optional embodiment, the screen control device provided in this application can be implemented as a computer program, which can be configured as follows: Figure 8 The terminal device shown is running the program. The terminal device's memory can store the various program modules that make up the screen control device, for example, Figure 7 The diagram shows a trigger module 702, a camera module 704, a judgment module 706, and a control module 708. The computer program comprised of these modules causes the processor to execute the steps of the screen control methods in the various embodiments of this application described in this specification.
[0114] For example, Figure 8 The terminal device shown can be accessed via, for example... Figure 7The trigger module 702 in the screen control device shown triggers the camera module to turn on when a screen-on trigger operation is detected. The terminal device can use the camera module 704 to capture facial image information of the person's face in front of the display screen through the turned-on camera module. The terminal device can use the judgment module 706 to determine whether the preset screen-off conditions are met based on the facial image information. The terminal device can use the control module 708 to control the display screen to turn off when it is determined that the facial image information meets the preset screen-off conditions.
[0115] In an optional embodiment, a terminal device is also provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above-described method embodiments.
[0116] In an optional embodiment, a computer-readable storage medium is also provided, on which a computer program is stored, which, when executed by a processor, implements the steps in the above-described method embodiments.
[0117] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, or optical storage, etc. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static random access memory (SRAM) and dynamic random access memory (DRAM), etc.
[0118] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0119] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.
Claims
1. A screen control method, characterized in that, Applied to a terminal device, the terminal device being equipped with a camera module and a display screen, the method includes: When a screen-on trigger operation is detected, the camera module is activated. The camera module, once activated, captures facial image information of the person's face in front of the display screen. The facial image information is used to determine whether the preset screen-off conditions are met; When it is determined that the facial image information meets the preset screen-off condition, the display screen is controlled to turn off; The step of determining whether the preset screen-off conditions are met based on the facial image information includes: The facial image information is used to determine whether at least two of the first, second, and third conditions are met; If at least two of the first condition, the second condition, and the third condition are met, then it is determined that the preset screen-off condition is met. The first condition is that the ratio of the distance from the tip of the nose to the bottom of the chin to the length of the face, as indicated by the facial image information, is less than a preset ratio K, where 1 / 6 < K < 1 / 2; the second condition is that the number of skin wrinkles on the face, as indicated by the facial image information, is zero; and the third condition is that the eye state of the face, as indicated by the facial image information, is either not looking directly at the face or has its eyes closed.
2. The method according to claim 1, characterized in that, The control of turning off the display screen includes: The display screen is controlled to be in a locked state, wherein, when the display screen is in the locked state, the display screen is off and the terminal device is prohibited from responding to screen-on trigger operations.
3. The method according to claim 2, characterized in that, After the display screen is locked, the method further includes: When the unlocking conditions are met, the display screen is controlled to exit the locked state, wherein when the display screen exits the locked state, the terminal device is allowed to respond to the screen-on trigger operation; The unlocking conditions include at least one of the following: The duration for which the display screen remains locked reaches a first preset duration; A preset unlocking operation was detected on the terminal device; The terminal device remains in the same posture for a duration that reaches the second preset duration.
4. The method according to claim 1, characterized in that, The step of triggering the camera module to turn on when a screen-on trigger operation is detected includes: When a screen-on trigger operation is detected, the camera module is activated and the display screen is kept off.
5. The method according to claim 1, characterized in that, The screen-on trigger operation includes at least one of the following: The lift operation performed on the terminal device; A click operation performed on the display screen; A pressing operation performed on a physical button, wherein the physical button is located on the terminal device.
6. The method according to any one of claims 1-5, characterized in that, The terminal device pre-stores target facial image information, and the step of determining whether a preset screen-off condition is met based on the facial image information includes: The collected facial image information and the target facial image information are matched for consistency. When the collected facial image information matches the target facial image information, it is determined that the preset screen-off condition is met.
7. A screen control device, characterized in that, Applied to a terminal device, the terminal device being equipped with a camera module and a display screen, the device includes: The trigger module is used to trigger the camera module to turn on when a screen-on trigger operation is detected; The camera module is used to capture facial image information of the person in front of the display screen of the terminal device through the camera module after it is turned on; The judgment module is used to determine whether the preset screen-off conditions are met based on the facial image information; The control module is used to control the display screen to turn off when it is determined that the face image information meets the preset screen-off conditions; The judgment module includes a first judgment unit; The first judgment unit is used to determine whether at least two of the first, second, and third conditions are met based on the face image information; The first judgment unit is further configured to determine that the preset screen-off condition is met if at least two of the first condition, the second condition, and the third condition are met. The first condition is that the ratio of the distance from the tip of the nose to the bottom of the chin to the length of the face, as indicated by the facial image information, is less than a preset ratio K, where 1 / 6 < K < 1 / 2; the second condition is that the number of skin wrinkles on the face, as indicated by the facial image information, is zero; and the third condition is that the eye state of the face, as indicated by the facial image information, is either not looking directly at the face or has its eyes closed.
8. A terminal device, comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 6.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 6.
Citation Information
Patent Citations
Human face identification-based unlocking method and apparatus, and mobile terminal
CN108549802A
Screen control method and device of electronic equipment, electronic equipment and storage medium
CN113885708A